this post was submitted on 26 Sep 2024
95 points (94.4% liked)

Technology

59392 readers
2708 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] nehal3m@sh.itjust.works 28 points 1 month ago* (last edited 1 month ago) (1 children)

In 15 words: deep learning worked, got predictably better with scale, and we dedicated increasing resources to it.

Are you sure about that Sam? Because one, you’re the snake oil salesman writing this and I wouldn’t trust you as far as I can throw you, and two, yeah maybe it scales predictably but the prediction is that training the next generation for marginal improvement will cost an exponential 100 billion (and that is taking your Microsoft discount for compute into account). You’re hitting a wall hard and the profits are still not in sight. This avenue of progress is a dead end and Sam knows it, because OpenAI is selling PPU’s instead of stock and looking to Saudi investment. Don’t get stuck with the bag folks, the few thousand days Sam claims to need aren’t survivable.

[–] kn0wmad1c@programming.dev 12 points 1 month ago

First of all, you make a great point.

Second of all, that quote made me laugh out loud. "In 15 words"? Why is that even there? I saw Sam sitting there with Word open, cursor blinking at the end of his sentence about how deep learning worked, wondering how to make it more impactful. So he copies the sentence and pastes it into a chatgpt box and asks, "how can I make this hit differently?" and chatgpt, in all it's gptness, responds: "try counting the number of words in the sentence and throwing that in front."