LocalLLaMA

3040 readers

2 users here now

Welcome to LocalLLaMA! Here we discuss running and developing machine learning models at home. Lets explore cutting edge open source neural network technology together.

Get support from the community! Ask questions, share prompts, discuss benchmarks, get hyped at the latest and greatest model releases! Enjoy talking about our awesome hobby.

As ambassadors of the self-hosting machine learning community, we strive to support each other and share our enthusiasm in a positive constructive way.

founded 2 years ago

MODERATORS

SkySyrup@sh.itjust.works

pax@sh.itjust.works

noneabove1182@sh.itjust.works

Smokeydope@lemmy.world

MonsterBug@sh.itjust.works

LLMs and their efficiency, can they really replace humans? (arxiv.org)

submitted 4 days ago by thickertoofan@lemm.ee to c/localllama@sh.itjust.works

9 comments fedilink hide all child comments

AI bros won't hype this up for the news for sure, but 480x energy doesn't sound optimistic enough for replacement.

you are viewing a single comment's thread
view the rest of the comments

[–] hendrik@palaver.p3x.de 5 points 4 days ago

I'm not sure about the significance of this preprint. Writing energy-efficient sorting algorithms and lab course example code is a very specific problem. It doesn't say a lot about AI in general. Also: Did they forget to tell the AI it's supposed to write energy-efficient code? I didn't read the entire paper. But the prompt example doesn't look like it's in there.