this post was submitted on 16 Mar 2024
94 points (94.3% liked)

Technology

59440 readers
3120 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
top 13 comments
sorted by: hot top controversial new old
[–] DingoBilly@lemmy.world 17 points 8 months ago (2 children)

My reading of chip wars and similar chip fabrication places is this stuff takes decades to develop and is insanely expensive. Is that not the case here?

[–] agressivelyPassive@feddit.de 13 points 8 months ago (1 children)

They won't start from scratch.

You can license ARM cores, scale up the design a bit and get to first pre-production units within a year or two.

OpenAI needs extremely large amounts of computing power and is almost 100% dependent on Nvidia to get it. That's not a good situation to be in. Even if they can't compete with Nvidia directly, building their own chips might be cheaper than paying Nvidia's profit margin.

[–] HeavyRaptor@lemmy.zip 2 points 8 months ago (1 children)

I could kinda see them designing a chip maybe but that's not what they are saying. Many companies have their own chip by going to AMD for example and using their designs and process nodes to create something more use-case specific. For example the steam deck's soc is a custom design madefor Valve. Or as you said it is possible to licence and customise designs from Arm to create your own custom SOC. This is what smartphone manufacturers do. Then they take their designs to a foundry like TSMC to create actual chips out of them.

But I don't think that's what openai is aiming for here, they want their own foundry. They themselves want to design and produce the chips.

Not even considering the actual design of the chips, just being able to mass produce something on the scale of modern transistors with economical yields is an insane task.

On some of the newest nodes, one aspect of lythography (the process of marking out transistors with a directed light) involves creating a micro-drop of certain molten metals. While the drop is falling, it is hit by a low power laser to change its shape to a 'pancake' like form. After this it is hit by a more powerful laser that vaporises the drop, crating a very specific wavelength of light. This light is then focused into an extremely sharp laser that marks out the transistor patterns on the target silicon. The process happens thousands of times a second.

Of course you can't just buy one of these machines on Amazon. Each company guards their newest process nodes with the utmost secrecy, as developing a new node can cost billions of dollars, not even mentioning what it costs to build, outfit, and run an actual foundry itself.

This is one machine that is part of the complex process that is making microchips. Nvidia doesn't even have their own foundry, they have been relying on Samsung and TSMC recently.

Asking for trillions of dollars to build something from scratch is just so unbelievably silly. Almost as silly as someone actually giving it to them.

[–] agressivelyPassive@feddit.de 2 points 8 months ago

Building the entire pipeline initially would be insane, true.

But as an aspiration, it's not that dumb. Start with a highly optimized ARM chip in gen 1, add more ASIC components in gen 2, have some packaging in-house for gen 3, etc. etc.

OpenAI seems to aim at the long game. Investing billions now to save trillions later could be sane.

[–] porous_grey_matter@lemmy.ml 5 points 8 months ago (1 children)
[–] SnotFlickerman@lemmy.blahaj.zone 5 points 8 months ago (1 children)

It's just the next step in the AI hype cycle. The AI hype could have died considerably by the time these places are even spinning up to create chips.

[–] porous_grey_matter@lemmy.ml 1 points 8 months ago

Yes, it's pure unfiltered bullshit. A time honoured way to get investment tbh

[–] hark@lemmy.world 17 points 8 months ago (1 children)

My only hope is that this shits all over nvidia's stock price and makes them humble. Please end this bullshit where a mid-range consumer card is $500+.

[–] webghost0101@sopuli.xyz 12 points 8 months ago* (last edited 8 months ago) (1 children)

You guys only need $500 for mid-range gpu?

Base 4070 is going above 600 here.

[–] ReveredOxygen@sh.itjust.works 5 points 8 months ago

7700 goes for $450 in the US

[–] SnotFlickerman@lemmy.blahaj.zone 12 points 8 months ago* (last edited 8 months ago) (1 children)

Can someone just pull a Garfield and put Sam Altman in a box to be sent to Abu Dhabi like he's Nermal?

[–] fluxion@lemmy.world 10 points 8 months ago* (last edited 8 months ago)

They couldn't even replace him as CEO for 5 minutes before $$$ made everyone fold like a wet noodle

[–] Rogers@lemmy.ml 8 points 8 months ago

Knowning openai they will make the platform as locked down as they can