this post was submitted on 15 May 2024
638 points (98.9% liked)

TechTakes

1483 readers
285 users here now

Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.

This is not debate club. Unless it’s amusing debate.

For actually-good tech, you want our NotAwfulTech community

founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 17 points 7 months ago* (last edited 7 months ago) (3 children)

I'm not a big AI guy but it's really not quite like that, models do NOT contain all the data they were trained on.

Edit: I have no idea what's going on down below this comment

[–] [email protected] 15 points 7 months ago (1 children)

I’m not a big AI guy

we can tell

[–] [email protected] 4 points 7 months ago* (last edited 7 months ago) (2 children)

The guy above you is right though. So what are you on about?

[–] [email protected] 11 points 7 months ago (2 children)

what a weird opportunity for someone to burn a throwaway account. not even gonna dig into what you’ve imagined the other guy is right about, given he didn’t post any information of value

[–] xantoxis 6 points 7 months ago (2 children)

Lemmy is starting to have a huge problem with people creating multiple sockpuppets--probably programmatically generating them, in fact--just to win internet arguments. If this goes on too long you're going to see a really surprising number of sudden downvotes on everything you've said in this conversation, and anyone who agreed with you.

[–] [email protected] 10 points 7 months ago* (last edited 7 months ago) (1 children)

It’ll actually be good if that happens because 1) it could be dealt with here, 2) that could be used to feed something that helps defend against it

(e: I mean, it’ll be a nuisance, and @self would be driven to drink, but it could still be handled)

[–] [email protected] 10 points 7 months ago (1 children)

we already ignore offsite downvotes

[–] [email protected] 7 points 7 months ago

aha, good to know too :D

[–] [email protected] 8 points 7 months ago (1 children)

I truly wish those so inclined good luck with the downvotes and with coordinating their sockpuppets in a way that isn’t extremely fucking obvious

[–] [email protected] 12 points 7 months ago

They’ll use AI! /s

[–] [email protected] 7 points 7 months ago

[:popcorn intensifies:]

[–] [email protected] 8 points 7 months ago* (last edited 7 months ago) (1 children)

that's a misleading and meaningless way of putting it. if I rip a page out of my textbook and bring it into an exam room, I do not have with me all the data in my textbook. and yet

[–] QuaternionsRock -1 points 7 months ago* (last edited 7 months ago) (2 children)

It doesn’t do that, either. LLMs retain the linguistic patterns found in textbooks, nothing more. It’s remarkable that they can do so much with this information alone, but it’s still a far cry from genuine intelligence.

[–] [email protected] 15 points 7 months ago* (last edited 7 months ago) (1 children)

And yet they can spit out copyrighted material verbatim, or near-verbatim, how strange and peculiar.

[–] [email protected] 10 points 7 months ago
[–] [email protected] 14 points 7 months ago* (last edited 7 months ago) (1 children)

Yeah, even setting aside the intelligence claims, I know I'd be feeling a lot more positive about LLMs as a fun theoretical tool if they weren't being sold as personal assistants or search engine replacements etc, which even the apologists here admit they're really really bad at.

(Also I'd argue "linguistic patterns" is pushing it. "Textual patterns" more like, it's not supposed to have any idea about grammar or even about what "text" is.) (I say "supposed to" because who knows what sort of hacks they're running under the hood.)

[–] QuaternionsRock 2 points 7 months ago

Yeah I completely agree with you there. I really don’t like the way AI is being monetized and commercialized; it all just seems poised to go terribly. Ideally there shouldn’t be any incentive to overstate the capabilities of these models, as doing so just makes everything worse.

[–] [email protected] 4 points 7 months ago

Modified Thursday, May 16th, 2024 at 9:17:13 AM GMT+02:00 Edit: I have no idea what’s going on down below this comment

lol. at least you're honest about it