this post was submitted on 18 Dec 2023
114 points (75.0% liked)

Technology

59165 readers
2470 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 1 year ago
MODERATORS
L3s
[email protected]
[email protected]
L4s
enu
114
AI-screened eye pics diagnose childhood autism with 100% accuracy (newatlas.com)
submitted 10 months ago by L4s to c/technology
55 comments fedilink hide all child comments
 

AI-screened eye pics diagnose childhood autism with 100% accuracy::undefined

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 7 points 10 months ago (1 children)

Then somebody's lying with creative application of 100% accuracy rates.

The confidence interval of the sequence you describe is not 100%

[–] [email protected] 10 points 10 months ago

From TFA:

For ASD screening on the test set of images, the AI could pick out the children with an ASD diagnosis with a mean area under the receiver operating characteristic (AUROC) curve of 1.00. AUROC ranges in value from 0 to 1. A model whose predictions are 100% wrong has an AUROC of 0.0; one whose predictions are 100% correct has an AUROC of 1.0, indicating that the AI’s predictions in the current study were 100% correct. There was no notable decrease in the mean AUROC, even when 95% of the least important areas of the image – those not including the optic disc – were removed.

They at least define how they get the 100% value, but I'm not an AIologist so I can't tell if it is reasonable.