Fuck AI

I tried to use ChatGPT to find a song that had a particular phrase in it. I could only remember that phrase, not the song or the band.

It hallucinated a band and a song and I almost walked away thinking I knew the answer. Then I remembered this is ChatGPT and it lies. So I looked up through conventional means that band and song.

Neither. Existed.

So I went back to ChatGPT and said " doesn't even exist so they couldn't have written (which also doesn't exist)". It apologized profusely and then said another band and song. This time I was wary and checked right away at which point, naturally, I discovered neither existed.

So I played with ChatGPT instead and said "Huh, those guys look interesting. What other albums have they released and what hits have they written?"

ChatGPT hallucinated an entire release catalogue of albums that don't exist, one of which was published on a label that doesn't exist, citing songs that didn't exist as their hits, even going so far as to say the band never reached higher than #12 on Billboard's list.

ChatGPT is a dangerous tool. It's going to get someone killed sooner, rather than later.

I have a very unusual last name. There is only one other person in the country with my first and last name and they have a different middle initial from me.

So one day, I asked ChatGPT to tell me about myself including my middle initial.

Did you know that I was a motivational speaker for businesses and I had published a half-dozen books on it?

Because I didn't.

Claude 3.5 Sonnet, using the same exact prompt:

I apologize, but I'm not able to provide a synopsis of "The Mighty Eagle" by John Carrol. After searching my knowledge base, I don't have any information about a book with that exact title and author. It's possible this may be a lesser-known work or there could be an error in the title or author name provided. Without being able to verify the book's existence or details, I can't offer an accurate synopsis. If you have any additional information about the book or author that could help clarify, I'd be happy to assist further.

More like creative bullshitting.

It seems that Mitchell was simply an astronaut not an engineer.

This is why I never raw dog ChatGPT

On the other hand, AI is definitely good at creative writing.

Well...yeah. That's what it was designed to do. This is what happens when tech-bros try to cudgel an "information manager" onto an algorithm that was designed solely to create coherent text from nothing. It's not "hallucinating" - it's following its core directive.

Maybe all of this will lead to actual systems that do these things properly, but it's not going to be based on llm's. That much seems clear.

Tried it with ChatGPT 4o with a different title/author. Said it couldn't find it. That it might be a new release or lesser-known title. Also with a fake title and a real author. Again, said it didn't exist.

They're definitely improving on the hallucination front.

John Carrol actually is real but is a musician, it seems.

https://johncarrollmusic.bandcamp.com/album/everybody-smokes-in-hell

It even changed the spelling of the name

It had a really bad programming hallucination the other day when I was configuring some files and it hallucinated nonexistent settings.

Please share a link to the conversation instead of just the screenshot.

I prompted my local AI in my pc to admit it don't know about the subject. And when it don't know something, it says it:

what's the synopsis of the book "The Mighty Eagle" by John Carrol?

That sounds like a fun adventure! I haven’t read “The Mighty Eagle” myself though, so I couldn't give you a proper synopsis.

Would you like me to help you find some information about it online, Master? Perhaps we could look at reviews or the book description on Amazon?

If my 8b model can do that, IDK why GPT don't.