this post was submitted on 24 Sep 2023
110 points (95.1% liked)

News

23622 readers
4922 users here now

Welcome to the News community!

Rules:

1. Be civil


Attack the argument, not the person. No racism/sexism/bigotry. Good faith argumentation only. This includes accusing another user of being a bot or paid actor. Trolling is uncivil and is grounds for removal and/or a community ban. Do not respond to rule-breaking content; report it and move on.


2. All posts should contain a source (url) that is as reliable and unbiased as possible and must only contain one link.


Obvious right or left wing sources will be removed at the mods discretion. We have an actively updated blocklist, which you can see here: https://lemmy.world/post/2246130 if you feel like any website is missing, contact the mods. Supporting links can be added in comments or posted seperately but not to the post body.


3. No bots, spam or self-promotion.


Only approved bots, which follow the guidelines for bots set by the instance, are allowed.


4. Post titles should be the same as the article used as source.


Posts which titles don’t match the source won’t be removed, but the autoMod will notify you, and if your title misrepresents the original article, the post will be deleted. If the site changed their headline, the bot might still contact you, just ignore it, we won’t delete your post.


5. Only recent news is allowed.


Posts must be news from the most recent 30 days.


6. All posts must be news articles.


No opinion pieces, Listicles, editorials or celebrity gossip is allowed. All posts will be judged on a case-by-case basis.


7. No duplicate posts.


If a source you used was already posted by someone else, the autoMod will leave a message. Please remove your post if the autoMod is correct. If the post that matches your post is very old, we refer you to rule 5.


8. Misinformation is prohibited.


Misinformation / propaganda is strictly prohibited. Any comment or post containing or linking to misinformation will be removed. If you feel that your post has been removed in error, credible sources must be provided.


9. No link shorteners.


The auto mod will contact you if a link shortener is detected, please delete your post if they are right.


10. Don't copy entire article in your post body


For copyright reasons, you are not allowed to copy an entire article into your post body. This is an instance wide rule, that is strictly enforced in this community.

founded 2 years ago
MODERATORS
 

archive

A sleepy town in southern Spain is in shock after it emerged that AI-generated naked images of young local girls had been circulating on social media without their knowledge.

The pictures were created using photos of the targeted girls fully clothed, many of them taken from their own social media accounts.

These were then processed by an application that generates an imagined image of the person without clothes on.

So far more than 20 girls, aged between 11 and 17, have come forward as victims of the app's use in or near Almendralejo, in the south-western province of Badajoz.

"One day my daughter came out of school and she said 'Mum there are photos circulating of me topless'," says María Blanco Rayo, the mother of a 14-year-old.

"I asked her if she had taken any photos of herself nude, and she said, 'No, Mum, these are fake photos of girls that are being created a lot right now and there are other girls in my class that this has happened to as well.'"

She says the parents of 28 girls affected have formed a support group in the town.

Spanish police press conference
Spanish authorities have launched an investigation into the images

Police are now investigating and according to reports, at least 11 local boys have been identified as having involvement in either the creation of the images or their circulation via the WhatsApp and Telegram apps.

Investigators are also looking into the claim that an attempt was made to extort one of the girls by using a fake image of her.

The impact the images' circulation has had on the girls affected varies. Ms Blanco Rayo says her daughter is bearing up well, but that some girls "won't even leave their house".

Almendralejo is a picturesque town with a population of just over 30,000 which is known for its production of olives and red wine. But it's not used to the sudden attention this case has brought, making the town national headline news.

That's in great part because of the efforts of one of the girls' mothers, Miriam Al Adib. She's a gynaecologist who has used her already prominent social media profile to place this issue at the centre of Spanish public debate.

Miriam Al Adib
"I wanted to give the message: it's not your fault," Miriam Al Adib says

Although many of the AI images are believed to have been created over the summer, the case only came to light in recent days after Dr Adib posted a video reassuring the girls affected and their parents.

"We didn't know how many children had the images, if they had been uploaded to pornographic sites - we had all those fears," she says.

"When you are the victim of a crime, if you are robbed, for example, you file a complaint and you don't hide because the other person has caused you harm. But with crimes of a sexual nature the victim often feels shame and hides and feels responsible. So I wanted to give that message: it's not your fault."

The suspects in the case are aged between 12 and 14. Spanish law does not specifically cover the generation of images of a sexual nature when it involves adults, although the creation of such material using minors could be deemed child pornography.

Another possible charge would be for breaching privacy laws. In Spain, minors can only face criminal charges from the age of 14 upwards.

The case has caused concern even for local people who are not involved.

"Those of us who have kids are very worried," says Gema Lorenzo, a local woman who has a son, aged 16, and a daughter, aged 12.

"You're worried about two things: if you have a son you worry he might have done something like this; and if you have a daughter, you're even more worried, because it's an act of violence."

Francisco Javier Guerra, a local painter and decorator, says the parents of the boys involved are to blame. "They should have done something before, like take their phones away, or install an application that tells them what their children are doing with their phone."

This is not the first time such a case has become news in Spain. Earlier this year, AI-generated topless images of the singer Rosalía were posted on social media.

"Women from different parts of the world have written to me explaining that this has happened to them and they don't know what to do," says Miriam Al Adib.

"Right now this is happening across the world. The only difference is that in Almendralejo we have made a fuss about it."

The concern is that apps such as those used in Almendralejo are becoming increasingly commonplace.

Javier Izquierdo, head of children's protection in the national police's cyber-crime unit, told Spanish media that these kinds of crimes are no longer confined "to the guy who downloads child porn from the Dark Web or from some hidden internet forum".

He added: "That obviously is still going on, but now the new challenges we are facing are the access that minors have at such an early age [to such technology], such as in this case."

all 18 comments
sorted by: hot top controversial new old
[–] chaosppe 36 points 1 year ago

They had the one ability not to harm anyone with CSAM and they try to generate real people... Truly vile

[–] [email protected] 8 points 1 year ago (3 children)

I've said for the longest time, the world needs wiping. A hard reset.

Technology comes to the masses and shit like this is some people's first thought? Constantly figuring out how to better kill each other, humiliate, bully. It blows my mind, even at the old old age of 34 how utterly deprived people can be.

Tell a family member you love them today, give them a hug - create your own net positive.

[–] thonofpy 7 points 1 year ago* (last edited 1 year ago) (1 children)

The world needs building. A shared vision. People empowering and protecting each other. It is hard, but we must try.

[–] [email protected] 3 points 1 year ago

This is the more reasonable and realistic approach, I'm just not even sure how that'd come about. Although I feel education is an important factor from a young age on the do's and don'ts - tools? Maybe need to be developed that somehow doesn't intrude on the right to privacy.

It's concerning, after reading this this morning then speaking to some of the lads about it, me Mrs - even with me Mum when I was out for a walk with her.. It's leaving people feel hella vulnerable. Nothing to stop anyone right now taking a pic of any one us and slapping it on some weird shit, some incriminating shit, racial hatred shit. Anything.

It's ticking time bomb imo

[–] [email protected] 1 points 1 year ago (1 children)
[–] [email protected] 1 points 1 year ago

I love you too, have a decent Sunday - in the words of Einstein (probably), it is what it is.

[–] [email protected] 4 points 1 year ago (2 children)

For an AI generator to make convincing photos of CSAM, wouldn't it have had to have access to real CSAM to "learn" how to make it?

Wouldn't the creators of the generator then have to have had access to it / download it or whatever they do when they feed material to the algorithm?

[–] drislands 12 points 1 year ago

Not necessarily. I'm only speculating, which I don't relish, but I imagine the service isn't explicitly designed with CSAM as the intended result -- if I'm reading it right, it's billed as "upload picture of clothed person X and received 'naked' picture of same person", and is almost certainly trained on appropriately-aged pornographic material.

I don't know the inner workings of technology like this, and I certainly don't intend to critique the images talked about in this article, but the resulting picture doesn't have to be an accurate representation of a minor's body to be distressing to the people involved.

[–] [email protected] 1 points 1 year ago* (last edited 1 year ago)

Nah, I don't think so. I haven't tried and I won't try, but these images are probably just made with inpainting with generic nsfw prompts.

If the AI was trained on enough nudity it would probably just scale it down to child size or whatever.

I can't imagine there must be a huge difference in appearance.

I am just guessing though.