this post was submitted on 25 May 2024
126 points (99.2% liked)

Not The Onion

12388 readers
1231 users here now

Welcome

We're not The Onion! Not affiliated with them in any way! Not operated by them in any way! All the news here is real!

The Rules

Posts must be:

  1. Links to news stories from...
  2. ...credible sources, with...
  3. ...their original headlines, that...
  4. ...would make people who see the headline think, “That has got to be a story from The Onion, America’s Finest News Source.”

Comments must abide by the server rules for Lemmy.world and generally abstain from trollish, bigoted, or otherwise disruptive behavior that makes this community less fun for everyone.

And that’s basically it!

founded 1 year ago
MODERATORS
 

Republican state Rep. Alex Kolodin said he used ChatGPT to write a subsection of House Bill 2394, which tackles AI-related impersonations of people by allowing Arizona residents to legally assert they are not featured in deepfake videos.

“I used it to write the part of the bill that had to do with defining what a deepfake was,” Kolodin told NBC News. “I was really struggling with the technical aspects of how to define what a deepfake was,” he said. “So I thought to myself, ‘Well, why not ask the subject matter expert, ChatGPT?’”

The bill was signed into law by Democratic Gov. Katie Hobbs on Tuesday. The legislation allows Arizona residents to obtain a court order stating the person identified in the deepfake video is not them.

Kolodin said that the portions ChatGPT created were precise.

“In fact, the portion of the bill that ChatGPT wrote was probably one of the least amended portions,” he said.

Hobbs was not aware of the portion of the legislation being authored by ChatGPT.

“I kind of wanted it to be a surprise once the bill got signed,” Kolodin said, noting that it was part of the plan.

top 21 comments
sorted by: hot top controversial new old
[–] XeroxCool 56 points 6 months ago

"I didn't really understand the technical aspects, which is why I turned to a technical service I also didn't understand"

[–] halcyoncmdr 35 points 6 months ago (2 children)

The fact he kept the use of an LLM, which are known to provide false information, a secret should be grounds for an immediate removal from office.

[–] ignotum 9 points 6 months ago (2 children)

If the output was wrong and he blindly trusted it, then none of the people reviewing it noticed anything, then they should all have been fired.

Sounds more like he had it generate the text, he checked that it was correct, then other people checked it and also couldn't find any issues with it.

Autocorrect also ducks up sometimes, that doesn't mean you should be fired for using it, unless you're too dumb or lazy to proofread it yourself and correct mistakes.

[–] halcyoncmdr 10 points 6 months ago* (last edited 6 months ago)

You assume that someone actively checked that. We know for a fact that legislators routinely don't actually read the bills they approve, and a disturbing amount of the time issues are found after things are signed into law because they didn't actually read the damned things in the first place.

He also claims he asked ChatGPT because he needed the definition of deepfake. So instead of going to any number of dictionaries where definitions are located... He asked an LLM AI that has been proven to provide false information, to generate an answer. And then kept that fact a secret.

The fact he admits that he purposefully kept the ChatGPT use a secret until after it was signed into law proves that he knew it was at least a shady idea. It doesn't matter whether it actually made a difference, that shows a disturbing lack of ethics.

We have apparently evidence that he doesn't know what a dictionary is, or how to find one, even online. And a willingness to use tools he doesn't understand to generate laws everyone will be bound by. From his actions here we have shown a pretty clear lack of proper ceitical thinking and ethics.

[–] [email protected] 1 points 6 months ago

If you can check that it's correct, then you can research the topic well enough to know what should be in it, which means you can just write the damn thing yourself.

They aren't too dumb and lazy to check it, but they are dumb and lazy enough to ask something else to write it for them. That is a highly specific amount of dumb and lazy.

[–] [email protected] 2 points 6 months ago

He also apparently could not find a real wctual subject matter expert, so he presumably is not very good at his job.

[–] [email protected] 16 points 6 months ago (4 children)

As long as he fact checked what chatgpt told him, who cares?

Chatgpt is a great starting place for a subject you don't yet understand, but it should always be fact checked before you apply it to whatever scenario you're in.

[–] halcyoncmdr 9 points 6 months ago* (last edited 6 months ago)

Purposely not disclosing the usage of a tool that is widely reported and known to provide false information until after it is signed into law shows a pretty clear lack of ethics.

[–] [email protected] 6 points 6 months ago (1 children)

As long as he fact checked what chatgpt told him, who cares?

But he can't fact check it - he was using it because he didn't know enough about the topic to write that section in the first place.

I was suggesting ChatGPT to a social worker I know who was complaining about the number of reports he has to write - AI could bang out a first draft that he could then work up into the final report because he knows the cases and the relevant laws and procedures. If he didn't know the subject inside and out it could be dangerous. Even then, he should flag it up for others to look it over in case of hallucinations.

[–] [email protected] 2 points 6 months ago

If he didn't know the subject inside and out it could be dangerous

Could be, but not necessarily. It's good to use as a starting point for further research. It's good to introduce you to terminology used in the field you're researching if you don't know it already.

Knowing what to search for is very very valuable. This can speed up your understanding of a subject significantly.

[–] Seudo 6 points 6 months ago (1 children)

The problem is GTP is learning from our existing knowledge base. If legislation is trying to amend a broken system, we don't want AI to be modeling that system. This case seems fairly harmless, an AI takeover isn't what we should be worries about.

Something like institutional racism being replicated in a more insidious manner is the concern. Relying on these closed systems potentially gives the type of people who implemented the discrimination being modeled to turn around and say, 'See, we were right all along!' If results are held up on a pedestal and AI is integrated into our political and legal systems, it may make changing society for the better much harder.

We shouldn't universally condemn tools like ChatGTP being used in this way, but we should tread very carefully when it comes to large scale societal changes.

[–] [email protected] 2 points 6 months ago

Agreed. Chatgpt is a great starting place. Nobody should take what it says as fact, but use what it says to help you research further.

[–] gedaliyah -4 points 6 months ago

All joking aside, this is the answer.

[–] gedaliyah 12 points 6 months ago

Prompt: Imagine that you are a capable legislator...

[–] [email protected] 5 points 6 months ago

This is the bill for anyone curious. https://legiscan.com/AZ/text/HB2394/2024

[–] PriorityMotif 5 points 6 months ago

ITT: A bunch of people who don't understand how an LLM works.

[–] PriorityMotif 5 points 6 months ago

hate the drivel about "false information" when using an LLM. You can use it to help write things you struggle to describe and rewrite things in a certain style. You don't have to use it for direct information.

Rewrite the previous text as if you are a legislator.

I strongly oppose the excessive focus on "false information" concerns surrounding the use of large language models (LLMs). These models can be valuable tools for assisting in writing tasks, helping to articulate ideas more clearly, and adapting content to various styles. Their use can enhance the quality and versatility of written communication.