this post was submitted on 01 Sep 2023
235 points (95.7% liked)

Technology

59740 readers
3958 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 2 years ago
MODERATORS
 

There's no way for teachers to figure out if students are using ChatGPT to cheat, OpenAI says in new back-to-school guide::AI detectors used by educators to detect use of ChatGPT don't work, says OpenAI.

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 24 points 1 year ago (3 children)

Detecting whether a student used ChatGPT to write an assignment can be challenging, but there are some signs and strategies you can consider:

  • Unusual Language or Style: ChatGPT may produce content that is unusually advanced or complex for a student's typical writing style or ability. Look for inconsistencies in language usage, vocabulary, and sentence structure.

  • Inconsistent Knowledge: ChatGPT's knowledge is based on information up to its last training cut-off in September 2021. If the assignment contains information or references to events or developments that occurred after that date, it might indicate that they used an AI model.

  • Generic Information: If the content of the assignment seems to consist of general or widely available information without specific personal insights or original thought, it could be a sign that ChatGPT was used.

  • Inappropriate Sources: Check the sources cited in the assignment. If they cite sources that are unusual or not relevant to the topic, it may indicate that they generated the content using an AI model.

  • Plagiarism Detection Tools: Use plagiarism detection software, such as Turnitin or Copyscape, to check for similarities between the assignment and online sources. While these tools may not specifically detect AI-generated content, they can identify similarities between the assignment and publicly available text.

  • Interview or Discussion: Consider discussing the assignment topic with the student during a one-on-one interview or discussion. If they struggle to explain or elaborate on the content, it may indicate they didn't personally generate it.

It's important to approach these situations with caution and avoid making accusations without concrete evidence. If you suspect that a student used an AI model to complete an assignment, consider discussing your concerns with the student and offering them the opportunity to explain or rewrite the assignment in their own words.

[–] [email protected] 74 points 1 year ago (2 children)

This was definitely written by ChatGPT

[–] [email protected] 45 points 1 year ago (1 children)

You can tell because it's grammatically correct but logically incongruous. For example:

ChatGPT's knowledge is based on information up to its last training cut-off in September 2021. If the assignment contains information or references to events or developments that occurred after that date, it might indicate that they used an Al model.

That is the exact opposite of the conclusion you could draw.

[–] [email protected] 5 points 1 year ago (1 children)

Could have just been a brain fart/typo

[–] [email protected] 2 points 1 year ago

ChatGPT overuses the phrase "it's important to ..." That alone should send up red flags.

[–] [email protected] 7 points 1 year ago

Now sing it as a pirate shanty!

[–] [email protected] 12 points 1 year ago (1 children)

Best tip is to use chatgpt yourself and you learn to spot obvious stuff like this at literally the first sentence!

[–] [email protected] 4 points 1 year ago

It is tribal to circumvent gpt specific bullet

Like:

train it with snippets of your writing style.

Tell it to use specific sources