this post was submitted on 02 Aug 2023
361 points (94.1% liked)

Technology

59658 readers
3035 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 1 year ago
MODERATORS
L3s
[email protected]
[email protected]
L4s
enu
361
Tech experts are starting to doubt that ChatGPT and A.I. ‘hallucinations’ will ever go away: ‘This isn’t fixable’ (fortune.com)
submitted 1 year ago by L4s to c/technology
137 comments fedilink hide all child comments
 

Tech experts are starting to doubt that ChatGPT and A.I. ‘hallucinations’ will ever go away: ‘This isn’t fixable’::Experts are starting to doubt it, and even OpenAI CEO Sam Altman is a bit stumped.

you are viewing a single comment's thread
view the rest of the comments
[–] drem 2 points 1 year ago (1 children)

I did manage to write a back-propogation algorithm, at this point I don't fully understand the math behind back-propogation. Generally back-propogation algorithms take the activation, calculate the delta(?) with the activation and the target output (only on last layer). I don't know where tokens come in. From your comment it sounds like it has to do something in a unsupervised learning network. I am also not a professional. Sorry if I didn't really understand your comment.

[–] [email protected] 2 points 1 year ago (1 children)

Mathematically, I have no idea where the tokens come in exactly. My studies have been more conceptual than actually getting down to the knitty-gritty, for the most part.

But conceptually, from my understanding, tokens are just a variable that is assigned a speculated fitness, then used as the new "base" data set.

I think chicken would go good in this, but beef wouldn't be as good. My token is the next ingredient i am deciding to put in.

[–] [email protected] 3 points 1 year ago (1 children)

You guys should all check out Andrej Karpathy's neural networks zero to hero videos. He has one on LLMs that explains all this.

[–] [email protected] 1 points 1 year ago

Here is an alternative Piped link(s): https://piped.video/playlist?list=PLAqhIrjkxbuWI23v9cThsA9GvCAUhRvKZ

Piped is a privacy-respecting open-source alternative frontend to YouTube.

I'm open-source, check me out at GitHub.