8
Amazon's Trainium2 AI Accelerator Features 96 GB of HBM, Quadruples Training Performance
(www.anandtech.com)
this post was submitted on 30 Nov 2023
8 points (90.0% liked)
Hardware
5004 readers
14 users here now
This is a community dedicated to the hardware aspect of technology, from PC parts, to gadgets, to servers, to industrial control equipment, to semiconductors.
Rules:
- Posts must be relevant to electronic hardware
- No NSFW content
- No hate speech, bigotry, etc
founded 4 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
It seems to me like this approach to custom-built ML hardware which can only be leased as a service, not bought outright (such as this or Google's TPUs), is not very promising for research. Sure, this might be a cost-effective way for companies to deploy LLMs and maybe AWS can squeeze out a few interesting papers but since nobody else can do this without paying Amazon obscene amounts of money I don't see this leading to the next great innovation in the field. It's at least interesting that Google's TPUs barely had an impact, I'm curious to see if this will also be true for Amazon.