South Korea’s Crackdown on Sexually Exploitative Deepfakes

By Hyunsu Yim

SEOUL (Reuters) – South Korean regulators and police this week vowed to combat sexually exploitative deepfakes, urging Telegram and other social media companies to cooperate as they crack down on the practice.

What Has Caused the Recent Uproar in South Korea?

Recent domestic media reports highlight that sexually explicit deepfake images and videos of South Korean women are often found in Telegram chatrooms. Concurrently, South Korean feminist groups and international K-pop fans are active on social media, calling for action and sharing tips on exposing such chatrooms.

This outcry follows the sentencing of a man involved in a deepfake pornography case targeting female students at Seoul National University earlier this month. Gender issues remain particularly sensitive in South Korea and are debated rigorously across public forums.

Are Sexual Deepfakes More Prevalent in South Korea?

South Korea is the most targeted country for deepfake pornography, with singers and actresses comprising 53% of individuals featured in these deepfakes, according to a 2023 report by Security Hero, a U.S. startup focused on identity theft protection.

South Korean police indicate that the number of deepfake sex crime cases has surged to 297 this year, compared to 156 for all of 2021 when data was first compiled. Most victims and perpetrators are teenagers.

High-profile digital sex crime cases, ranging from online sex blackmail to spycam pornography, have further complicated the issue in South Korea.

What Are Authorities Doing?

The crackdown on sexual deepfakes aligns with Pavel Durov, Telegram’s Russian-born founder, being formally investigated in France as authorities probe organized crime on the messaging app.

In addition to urging social media firms to cooperate more actively in deleting and blocking harmful content, South Korea’s media regulator has sought regular cooperation from French authorities on Telegram issues and facilitating direct communication with the platform.

Furthermore, the South Korean government announced plans for tougher laws to criminalize the purchase or viewing of sexually exploitative deepfakes. South Korean police are launching a seven-month initiative to crack down on digital sex crimes, increasing regulatory personnel monitoring these issues and establishing a 24-hour hotline for victims.

How Are Social Media Companies Responding?

Telegram claims to actively moderate harmful content on its platform, including illegal pornography.

YouTube recently demonetized a channel owned by a right-wing South Korean YouTuber with over one million subscribers, removing a video in which he downplayed the severity of deepfake crimes and mocked women for their concerns. YouTube cited violations of its harassment policies and reiterated its commitment to eradicating digital sex crimes on its platform.