this post was submitted on 20 Jan 2024
110 points (100.0% liked)

Technology

37383 readers
263 users here now

Rumors, happenings, and innovations in the technology sphere. If it's technological news or discussion of technology, it probably belongs here.

Subcommunities on Beehaw:


This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] zygo_histo_morpheus@programming.dev 7 points 5 months ago (2 children)

The article mentions AI. 16gigs feels far too little to run a LLM of respectable size so I wonder what exactly this means? Feels like no one is gonna be happy about a 16gig LLM (high RAM usage and bad AI features)

[–] Omega_Haxors@lemmy.ml 7 points 5 months ago

Of fucking course it's AI, why the hell wouldn't it be AI. For fuck sake, it's like they want their users to switch to Linux.

[–] corship@feddit.de 5 points 5 months ago

No 16 gigs is ok for an LLM

On your gpu