TechTakes

1384 readers

259 users here now

Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.

This is not debate club. Unless it’s amusing debate.

For actually-good tech, you want our NotAwfulTech community

founded 1 year ago

MODERATORS

dgerard@awful.systems

953

The Google AI isn’t hallucinating about glue in pizza, it’s just over indexing an 11 year old Reddit post by a dude named fucksmith. (lemmy.dbzer0.com)

submitted 5 months ago by db0@lemmy.dbzer0.com to c/techtakes@awful.systems

259 comments fedilink hide all child comments

Source

I see Google's deal with Reddit is going just great...

you are viewing a single comment's thread
view the rest of the comments

[–] Soyweiser@awful.systems 33 points 5 months ago (1 children)

I also wanted to post this post. But it is going to be very funny if it turns out that LLMs are partially very energy inefficient but very data efficient storage systems. Shannon would be pleased for us reaching the theoretical minimum of bits per char of words using AI.

[–] sinedpick@awful.systems 19 points 5 months ago* (last edited 5 months ago) (1 children)

huh, I looked into the LLM for compression thing and I found this survey CW: PDF which on the second page has a figure that says there were over 30k publications on using transformers for compression in 2023. Shannon must be so proud.

edit: never mind it's just publications on transformers, not compression. My brain is leaking through my ears.

[–] jonhendry@iosdev.space 11 points 5 months ago

@sinedpick

I wonder how many of those 30k were LLM-generated.