this post was submitted on 25 Sep 2023
560 points (96.1% liked)

Technology

60008 readers
3602 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 2 years ago
MODERATORS
 

Running AI is so expensive that Amazon will probably charge you to use Alexa in future, says outgoing exec::In an interview with Bloomberg, Dave Limp said that he "absolutely" believes that Amazon will soon start charging a subscription fee for Alexa

you are viewing a single comment's thread
view the rest of the comments
[–] Hazdaz -2 points 1 year ago (3 children)

training data.

Wouldn't that data be stored in some kind of database?

[–] [email protected] 3 points 1 year ago

No, the data will influence the model.

Some of the data may be found in the model itself (i.e. the AI generated images outputting mangled author signatures from the original works that were used during training) but not in the traditional form of a database. You can't directly retrieve that data back in its original form even if some models can be coerced to do something similar.

It's basically a statistical model built from training data.

The training of these huge models also cost a fortune. Allegedly in the millions of $ in a data and processing-intensive process.

[–] TipRing 3 points 1 year ago

The training data isn't stored in the model. You can take an existing model and fine tune it on a whole bunch of additional data and the model size won't change.

[–] [email protected] 2 points 1 year ago

The other answers are a bit confusing...

Yes, that's in a database.

However, you can think of it like a large library of books on how to best tune a ukulele. There might be a lot of information to figure out how to tone the ukulele and a lot of skill to put all that knowledge to use, but the ukulele once tuned, is quite small and portable.