BecomeMe

817 readers

2 users here now

Social Experiment. Become Me. What I see, you see.

founded 2 years ago

MODERATORS

[email protected]

ChatGPT gets code questions wrong 52% of the time (www.theregister.com)

submitted 1 year ago by [email protected] to c/[email protected]

9 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 5 points 1 year ago

•  A Purdue University study found that the ChatGPT OpenAI bot gave incorrect answers to programming questions half the time. 

•  However, 39.34% of participants preferred the ChatGPT responses due to their completeness and well-formulated language style. 

•  The study also showed that users can only identify errors in ChatGPT responses when they are obvious. 

•  Participants prefer ChatGPT's responses because of its polite language, articulated textbook-style responses, and comprehensiveness. 

•  The study is intended to complement the in-depth guidance and linguistic analysis of ChatGPT responses. 

•  The authors note that ChatGPT responses contain more "driving attributes" but do not describe risks as often as Stack Overflow posts.