this post was submitted on 11 Oct 2023
506 points (92.6% liked)

Technology

58138 readers
4309 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] nodsocket@lemmy.world 3 points 11 months ago (2 children)

Wait, you guys don't already have hundreds of gigabytes of memory?

[–] GenderNeutralBro@lemmy.sdf.org 7 points 11 months ago

Technically I could upgrade my desktop to 192GB of memory (4x48). That's still only about half the amount required for the largest BLOOM model, for instance.

To go beyond that today, you'd need to move beyond the Intel Core or AMD Ryzen platforms and get something like a Xeon. At that point you're spending 5 figures on hardware.

I know you're just joking, but figured I'd add context for anyone wondering.

[–] p03locke@lemmy.dbzer0.com 2 points 11 months ago (1 children)

Don't worry about the RAM. Worry about the VRAM.

[–] nodsocket@lemmy.world 4 points 11 months ago

Google drive is my swap space