this post was submitted on 25 Feb 2024
319 points (87.2% liked)

Technology

60082 readers
4271 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 2 years ago
MODERATORS
L3s
[email protected]
[email protected]
L4s
enu
319
New report: 60% of OpenAI model's responses contain plagiarism (www.axios.com)
submitted 10 months ago by [email protected] to c/technology
46 comments fedilink hide all child comments
 

A new report from plagiarism detector Copyleaks found that 60% of OpenAI's GPT-3.5 outputs contained some form of plagiarism.

Why it matters: Content creators from authors and songwriters to The New York Times are arguing in court that generative AI trained on copyrighted material ends up spitting out exact copies.

you are viewing a single comment's thread
view the rest of the comments
[–] BetaDoggo_ 52 points 10 months ago (3 children)

This looks like an ad. They go on about what their proprietary detection method found without any details about how it came to these conclusions or even how they generated the test data. They give 0 actual examples for any of their claims.

Here's the original blog post the article is referencing: https://copyleaks.com/blog/copyleaks-ai-plagiarism-analysis-report

[–] drahardja 16 points 10 months ago

Yep, Axios straight-up printed an ad as news.

[–] Kolrami 11 points 10 months ago* (last edited 10 months ago)

They should show a small, but representative sample of questions they gave it.

Also they should compare the scores to similarity scores for a flesh and blood smart human that answers the questions.

[–] General_Effort 6 points 10 months ago

Well, I tried it. So here's an example.

this may soon be a thing of the past as

This fragment was flagged as plagiarism.