TechTakes

1013 readers

237 users here now

Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.

For actually-good tech, you want our NotAwfulTech community

founded 1 year ago

MODERATORS

[email protected]

931

The Google AI isn’t hallucinating about glue in pizza, it’s just over indexing an 11 year old Reddit post by a dude named fucksmith. (lemmy.dbzer0.com)

submitted 1 month ago by [email protected] to c/[email protected]

251 comments fedilink hide all child comments

Source

I see Google's deal with Reddit is going just great...

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 33 points 1 month ago (1 children)

I also wanted to post this post. But it is going to be very funny if it turns out that LLMs are partially very energy inefficient but very data efficient storage systems. Shannon would be pleased for us reaching the theoretical minimum of bits per char of words using AI.

[–] [email protected] 18 points 1 month ago* (last edited 1 month ago) (1 children)

huh, I looked into the LLM for compression thing and I found this survey CW: PDF which on the second page has a figure that says there were over 30k publications on using transformers for compression in 2023. Shannon must be so proud.

edit: never mind it's just publications on transformers, not compression. My brain is leaking through my ears.

[–] [email protected] 11 points 1 month ago

@sinedpick

I wonder how many of those 30k were LLM-generated.