Technology

59605 readers

3274 users here now

This is a most excellent place for technology news and articles.

Our Rules

Follow the lemmy.world rules.
Only tech related content.
Be excellent to each another!
Mod approved content bots can post up to 10 articles per day.
Threads asking for personal tech support may be deleted.
Politics threads may be removed.
No memes allowed as posts, OK to post as comments.
Only approved bots from the list below, to ask if your bot can be added please contact us.
Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 1 year ago

MODERATORS

255

Mark Zuckerberg indicates Meta is spending billions of dollars on Nvidia AI chips (www.cnbc.com)

submitted 10 months ago by 31337@sh.itjust.works to c/technology@lemmy.world

51 comments fedilink hide all child comments

Summary: Meta, led by CEO Mark Zuckerberg, is investing billions in Nvidia's H100 graphics cards to build a massive compute infrastructure for AI research and projects. By end of 2024, Meta aims to have 350,000 of these GPUs, with total expenditures potentially reaching $9 billion. This move is part of Meta's focus on developing artificial general intelligence (AGI), competing with firms like OpenAI and Google's DeepMind. The company's AI and computing investments are a key part of its 2024 budget, emphasizing AI as their largest investment area.

you are viewing a single comment's thread
view the rest of the comments

[–] simple@lemm.ee 35 points 10 months ago (7 children)

Who isn't at this point? Feels like every player in AI is buying thousands of Nvidia enterprise cards.

[–] 31337@sh.itjust.works 15 points 10 months ago (6 children)

The equivalent of 600k H100s seems pretty extreme though. IDK how many OpenAI has access to, but it's estimated they "only" used 25k to train GPT4. OpenAI has, in the past, claimed the diminishing returns on just scaling their model past GPT4s size probably isn't worth it. So, maybe Meta is planning on experimenting with new ANN architectures, or planning on mass deployment of models?

[–] ExLisper@linux.community 5 points 10 months ago (1 children)

Or they just have too much money.

[–] FaceDeer@kbin.social 4 points 10 months ago

Which will be solved by them spending it.

load more comments (4 replies)