this post was submitted on 25 Dec 2023
1941 points (97.9% liked)
People Twitter
5214 readers
2043 users here now
People tweeting stuff. We allow tweets from anyone.
RULES:
- Mark NSFW content.
- No doxxing people.
- Must be a tweet or similar
- No bullying or international politcs
- Be excellent to each other.
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
What's the human digging through answers thing? I haven't heard anything about that.
ChatGPT was caught, and I think later admitted, to not actually using fully automated processes to determine those answers, iirc. Instead, a real human would curate the answers first before they went out. That human might reject answers to a question like "Computer: what is 1+1?" ten times before finally accepting one of the given answers ("you're mother", hehe with improper apostrophe intact:-P). So really, when you were asking for an "AI answer", what you were asking was another human on the other end of that conversation!!!
Then again, I think that was a feature for an earlier version of the program, that might no longer be necessary? On the other hand, if they SAY that they aren't using human curation, but that is also what they said earlier before they admitted that they had lied, do we really believe it? Watch any video of these "tech Bros" and it's obvious in less than a minute - these people are slimy.
And to some extent it doesn't matter bc you can download some open source AI programs and run them yourself, but in general from what I understand, when people say things nowadays like "this was made from an AI", it seems like it is always a hand-picked item from among the set of answers returned. So like, "oooh" and "aaaahhhhh" and all that, that such a thing could come from AI, but it's not quite the same thing as simply asking a computer for an answer and it returning the correct answer right away! "1+1=?" giving the correct answer of 13 is MUCH less impressive when you find that out of a thousand attempts at asking, it was only returned a couple times. And the situation gets even worse(-r) when you find out that ChatGPT has been getting stupider(-est?) for awhile now - https://www.defenseone.com/technology/2023/07/ai-supposed-become-smarter-over-time-chatgpt-can-become-dumber/388826/.
There's no way that's the case now, the answers are generated way too quickly for a human to formulate. I can certainly believe it did happen at one point.
Yes, and the fact that the quality suddenly declined awhile back - e.g. that article I linked to explained more - tracks along with those lines as well: when humans were curating the answers it took longer, whereas now the algorithm is unchained, hence able to move faster, and yet with far less accuracy than before.
So reading through your post and the article, I think you're a bit confused about the "curated response" thing. I believe what they're referring to is the user ability to give answers a "good answer" or "bad answer" flag that would then later be used for retraining. This could also explain the AIs drop in quality, of enough people are upvoting bad answers or downvoting good ones.
The article also describes "commanders" reviewing and having the code team be responsive to changing the algorithm. Again this isn't picking responses for the AI. Instead ,it's reviewing responses it's given and deciding if they're good or bad, and making changes to the algorithm to get more accurate answers in the future.
I have not heard anything like what you're describing, with real people generating the responses real time for gpt users. I'm open to being wrong, though, if you have another article.
I might be guilty of misinformation here - perhaps it was a forerunner to ChatGPT, or even a different (competing) chatbot entirely, where they would read an answer from the machine before deciding whether to send it on to the end user, whereas the novelty of ChatGPT was in throwing off such shackles present in an older incarnation? I do recall a story along the lines that I mentioned, but I cannot find it now so that lends some credence to that thought. In any case it would have been multiple generations behind the modern ones, so you are correct that it is not so relevant anymore.