902

Instagram is profiting from several ads that invite people to create nonconsensual nude images with AI image generation apps, once again showing that some of the most harmful applications of AI tools are not hidden on the dark corners of the internet, but are actively promoted to users by social media companies unable or unwilling to enforce their policies about who can buy ads on their platforms.

While parent company Meta’s Ad Library, which archives ads on its platforms, who paid for them, and where and when they were posted, shows that the company has taken down several of these ads previously, many ads that explicitly invited users to create nudes and some ad buyers were up until I reached out to Meta for comment. Some of these ads were for the best known nonconsensual “undress” or “nudify” services on the internet.

you are viewing a single comment's thread
view the rest of the comments
[-] exanime@lemmy.today 101 points 4 months ago* (last edited 4 months ago)

And yet, people are still scorned and offended as if they were.

I think you are missing the plot here... If a naked pic of yourself, your mother, your wife, your daughter is circulating around the campus, work or just online... Are you really going to be like "lol my nipples are lighter and they don't know" ??

You may not get that job, promotion, entry into program, etc. The harm done by naked pics in public would just as real weather the representation is accurate or not ... And that's not even starting to talk about the violation of privacy and overall creepiness of whatever people will do with that pic of your daughter out there

[-] Zoomboingding@lemmy.world 40 points 4 months ago

I believe their point is that an employer logically shouldn't care if some third party fabricates an image resembling you. We still have an issue with latent puritanism, and this needs to be addressed as we face the reality of more and more convincing fakes of images, audio, and video.

[-] exanime@lemmy.today 21 points 4 months ago

I agree... however, we live in the world we live in, where employers do discriminate as much as they can before getting in trouble with the law

[-] Zoomboingding@lemmy.world 15 points 4 months ago

I think the only thing we can do is to help out by calling this out. AI fakes are just advanced gossip, and people need to realize that.

[-] TwilightVulpine@lemmy.world 3 points 4 months ago

But it doesn't. Nobody who is harassed or has their prospects undermined because of AI fakes is helped by repeating that. Especially because as the technology advances the only way to verify its legitimacy will be to compare it with real intimate pictures, which the person cannot show without being exposed to the exact same treatment.

It also doesn't help that gossip can do all that harm as well so the point is moot.

Trying to point out that this is illogical and that nudes shouldn't even be such a big deal is an uphill battle against human emotional, social and cultural tendencies. It would take much more than some offhand comments to affect it at all, and I wouldn't count on that shift happening before the harms of AI fakes spread.

[-] Zoomboingding@lemmy.world 5 points 4 months ago

The ubiquity of AI fakes will necessitate a cultural shift. Honestly, the world is going to be a nightmare of misinformation soon and nudes may very well be the least of our worries.

What other options do we have? An ironclad verification system for any fabricated content? Wildly harsh penalties for all caught creating it? The ship has sailed - we won't be able to prevent it from happening.

I'd argue that overexposure will make people quickly become accustomed/nonplussed at information we don't believe to be true and verify with the source. Look at how we treat other fabricated content - if I showed you a screencap of the Pope saying "Fuck" you'd want to verify with a source directly.

[-] TwilightVulpine@lemmy.world 3 points 4 months ago

Does it seem to you that people are becoming more likely to verify sources?

Nevermind, like I just said before, how exactly do you verify fake porn with the source? Who is going to be volunteering their intimate pictures as reference? Or, do you really think all that it takes to avoid all issues is for the victim to say "that's fake, it's not me"?

Frankly, that sounds like pure wishful thinking to me.

[-] Zoomboingding@lemmy.world 4 points 4 months ago

In most cases, the answer should really be "It's none of my business", but yes, it'd involve asking the person whether they're authentic if you needed to verify for some reason.

But yes it really is wishful thinking, because it's honestly about to be a shitshow. People are going to start getting credibly framed for things like child porn.

[-] Thorny_Insight@lemm.ee 19 points 4 months ago

This is a transitional period issue. In a couple of years you can just say AI made it even if it's a real picture and everyone will believe you. Fake nudes are in no way a new thing anyway. I used to make dozens of these by request back in my edgy 4chan times 15 years ago.

[-] exanime@lemmy.today 19 points 4 months ago

This is a transitional period issue. In a couple of years you can just say AI made it even if it’s a real picture and everyone will believe you.

Sure, but the question of whether they harm the victim is still real... if your prospective employer finds tons of pics of you with nazi flags, guns and drugs... they may just "play it safe" and pass on you... no matter how much you claim (or even the employer might think) they are fakes

[-] Duamerthrax@lemmy.world 19 points 4 months ago* (last edited 4 months ago)

Dead internet.

It also means in a few years, any terrible thing someone does will just be excused as a "deep fake" if you have the resources and any terrible thing someone wants to pin on you with be cooked up in seconds. People wont just blanket believe or disbelieve any possible deep fake. They'll cherry pick what to believe based on their preexisting world view and how confident the story telling comes across.

As far as your old edits go, if they're anything like the ones I saw, they were terrible and not believable at all.

[-] TangledHyphae@lemmy.world 9 points 4 months ago

I'm still on the google prompt bandwagon of typing this query:

stuff i am searching for before:2023.. or ideally, even before COVID19, if you want more valuable, less tainted results. It's only going to get worse from here, 2024 is the year of saturation with garbage data on the web (yes I know it was already bad before, but now AI is pumping this shit out at an industrial scale.)

[-] CaptainEffort@sh.itjust.works 3 points 4 months ago

People do that now, even without the excuses of ai deepfakes. They simply ignore the stuff that doesn’t fit their worldview, only focusing on what does.

Ai stuff may make that easier, but it certainly won’t be some new problem.

[-] PiratePanPan@lemmy.dbzer0.com 10 points 4 months ago

"Fools! Everybody at my school is laughing at me for having a 2-incher, but little do they know it actually curves to the LEFT!"

[-] ipkpjersi@lemmy.ml 1 points 4 months ago

Mine curves to the left.

[-] Amir@lemmy.ml 2 points 4 months ago

On the other end, I welcome the widespread creation of these of EVERYONE, so that it becomes impossible for them to be believable. No one should be refused from a job/promotion because of the existence of a real one IMO and this will give plausible deniability.

[-] exanime@lemmy.today 25 points 4 months ago

People are refused for jobs/promotions on the most arbitrary basis, often against existing laws but they are impossible to enforce.

Even if it is normalized, there is always the escalation factor.. sure, nobody won't hire Anita because of her nudes out there, everyone has them and they are probably fake right?... but Perdita? hmmm I don't want my law firm associated in any way with her pics of tentacle porn, that's just too much!

Making sure we are all in the gutter is not really a good way to deal with this issue... specially since it will, once again, impact women 100x more than it will affect men

[-] TwilightVulpine@lemmy.world 7 points 4 months ago

This is a consideration that a lot of people are glossing over. Schlubby dudes might not even be affected to it at all. It's not going to be widespread for everyone.

[-] ipkpjersi@lemmy.ml 1 points 4 months ago

How should we deal with this issue then? I'm not sure what can be done about it.

[-] exanime@lemmy.today 4 points 4 months ago

That's a good question... I'm not an expert in this area but I do think it should be criminalized to a certain extent (even if it's hard to enforce)

Probably legislation should out some onus on the makers of these tools as well

[-] explodicle@sh.itjust.works 4 points 4 months ago

Post your clothed full body pic

[-] BreakDecks@lemmy.ml 0 points 4 months ago

Yeah, let's just sexually violate everyone. /s

Who the hell is upvoting this awful take? Please understand that it would never be equitable. If this became reality, it would be women and girls that were exploited the most viciously.

I guess if you don't give a shit about people, especially women and girls, feeling safe in public at all, you would say something like this...

[-] Amir@lemmy.ml 0 points 4 months ago

It's already possible. Do you want to make it punishable by jail time? How do you prove some anon on 4chan that posts nudes of someone else actually deepfaked it?

I don't see how this can otherwise be contained.

[-] BreakDecks@lemmy.ml 0 points 4 months ago

Do you want to make it punishable by jail time?

Yes, sex crimes deserve harsh punishments.

How do you prove some anon on 4chan that posts nudes of someone else actually deepfaked it?

It's either deepfaked, or revenge porn. Whichever charge sticks. If 4chan refuses to unmask anons posting illegal content, throw the book at 4chan. Way overdue anyway.

I don't see how this can otherwise be contained.

See previous two answers.

[-] Amir@lemmy.ml 0 points 4 months ago* (last edited 4 months ago)

Okay if you want to make everything punishable by law then we simply fundamentally disagree.

[-] Amir@lemmy.ml 0 points 4 months ago* (last edited 4 months ago)

Okay if you want to make everything punishable by law then we simply fundamentally disagree.

this post was submitted on 23 Apr 2024
902 points (97.1% liked)

Technology

58100 readers
5804 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS