this post was submitted on 26 Aug 2023
400 points (85.7% liked)
Technology
60076 readers
4079 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I suppose most sensible people already know that ChatGPT is not the answer for medical diagnosis.
If the researcher wanted to investigate whether LLM is helpful, they should develop a model specifically using cancer treatment plans with GPT-4/3.5 before testing it thoroughly, in addition to entering prompts into the model that is available on OpenAI.
There have been a number of articles about how GPT has been out-diagnosing doctors in various domains. To me, that isn't that surprising as diagnosis is a pattern matching problem, something a neuralnet will be very good at. Human doctors were seen to be discounting rare conditions just because they were rare and so "it was much more likely to be something else" even if the symptoms backed up the conclusion. A computer can be more objective about such things.
...but none of that needs AI/ML. We've had expert systems since the 60s.
It's also very different from constructing a treatment plan, which is what we're discussing here.
Or they could feed the current model with a reputable source of medical information.
That wouldn't guarantee correct answers.
It's arguably more dangerous if ChatGPT gives mostly sane specific medical advice because it makes people put more trust in it than they should.
True but it would reduce the chances of it making stuff up entirely.