this post was submitted on 18 Jun 2024
148 points (96.8% liked)

Technology

58152 readers
3776 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[โ€“] Blaster_M@lemmy.world 10 points 3 months ago* (last edited 3 months ago) (1 children)

Well, actually, what if I want AI "crap" capability with my Linux ARM laptop?

The TOPS on those systems are no joke. Consider that it's 1/2 the performance of an RTX 2060 in a slim laptop form factor.

Edit: The performance variance is still the same. 2060 can do almost 13 TFLOPS fp16 or about 102 TOPS measured (this figure is on other sites too, this is what I can find atm). SD Elite X can do 45 TOPS. Not bad, considering existing x86_64 CPUs with an NPU do 10-16 TOPS.

[โ€“] wewbull@feddit.uk 5 points 3 months ago

Don't confuse TFLOPs and TOPs. Especially when the latter is 4-bit integer operations.