this post was submitted on 15 Aug 2023
91 points (89.6% liked)

Technology

59578 readers
6091 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
 

ChatGPT Isn't as Good at Coding as We Thought::undefined

you are viewing a single comment's thread
view the rest of the comments
[–] daikiki 33 points 1 year ago* (last edited 1 year ago) (5 children)

I've experimented a bit with chatGPT, asking it to create some fairly simple code snippets to interact with a new API I was messing with, and it straight up confabulated methods for the API based on extant methods from similar APIs. It was all very convincing, but if there's no way of knowing that it's just making things up, it's literally worse than useless.

[–] sheogorath 10 points 1 year ago

ChatGPT has been helpful in being an interactive rubber duck. I used it to help myself breakdown the technical problems that I need to solve and it helps to cut down time taken to complete a difficult ticket that usually take a couple of days of work to a couple of hours.

[–] tbonebrad 4 points 1 year ago* (last edited 1 year ago)

I’ve had similar experiences with it telling me to call functions of third party libs that don’t exist. When you tell it “That function X does not exist” it says “I’m sorry, your right function X does not exist on library A. here is another example using function Y” then function Y doesn’t exist either.

I have found it useful in a limited scope, but I have found co-pilot to be much more of a daily time saver.

[–] fluxion 4 points 1 year ago

"just good enough to be dangerous"

[–] abhibeckert -4 points 1 year ago* (last edited 1 year ago)

So? Those mistakes will come up in testing, and you can easily fix them (either yourself, or ask it to do it for you, whichever is faster).

I regularly ask ChatGPT to write code against classes/functions that didn't exist until earlier today when I wrote those APIs. Obviously the model doesn't know those APIs... but it doesn't matter, you can just paste the function list or whole class definitions in and now it does know they're there and will use them.