this post was submitted on 24 Jan 2025
200 points (98.5% liked)

technology

23479 readers
528 users here now

On the road to fully automated luxury gay space communism.

Spreading Linux propaganda since 2020

Rules:

founded 4 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] DragonBallZinn@hexbear.net 67 points 4 days ago* (last edited 4 days ago) (15 children)

cheaply and less powerful

So AI could be more sustainable this whole time? Interesting…

Who wants to bet their AI will be used for more useful things too?

[–] Hexboare@hexbear.net 7 points 4 days ago (2 children)

So AI could be more sustainable this whole time? Interesting…

It's not that unsustainable unless you believe the predicts that your microwave will be building it's own LLM model every month by 2030

The electricity and water usage isn't very high in general or compared to data centre usage more broadly (and is basically nothing compared to crypto)

[–] dinklesplein@hexbear.net 8 points 3 days ago (1 children)

source: ML guy i know so this could be entirely unsubstantiated but apparently the main environmental burden of LLM infrastructure comes from training new models not serving inference from already deployed models.

[–] tellmeaboutit@lemmygrad.ml 1 points 3 days ago

That might change now that companies are creating “reasoning” models like DeepSeek R1. They aren’t really all that different architecturally but they produce longer outputs which just requires more compute.

load more comments (12 replies)