Telegram Apologises and Removes 25 Deepfake Porn Videos After South Korean Authorities Pressure

Telegram’s Struggles with South Korean Authorities Over Deepfake Pornography

Telegram, the popular encrypted messaging app, is under fire in South Korea for failing to curb the spread of deepfake pornography and digital sex crimes on its platform.

Following a series of escalating complaints, the Korea Communications Standards Commission (KCSC) announced that Telegram had finally complied with a government request to delete 25 videos depicting sexually exploitative material.

These videos, which were largely created using deepfake technology to depict minors and women, had been circulating across various channels on the app.

In a X post by ‘Anonymous’,

One Telegram group sharing deepfake images reportedly has 220,000 members, targeting mostly minors. [...]

The map shows the locations of middle and high schools and universities in Korea that are believed to have been affected by deepfake crimes, at least 500 schools are listed. Six out of 10 victims of deepfake crimes investigated by police over the past three years were children.

The decision to remove the content came after increased pressure from South Korean authorities, who have been fighting a surge in online sex crimes.

A spokesperson from the KCSC revealed that Telegram had previously been difficult to engage with, often ignoring requests from regulators.

However, following this incident, the company issued an apology, stating that it now aims to "build a relationship of trust" with the South Korean government.

Telegram also committed to improving communication by providing a dedicated email address for future correspondence regarding illegal content.

A KCSC official stated,

"We wish to strengthen cooperation with Telegram by securing a hotline, starting with the exclusive email address, to resolve the circulation of deepfake sexual exploitation materials and ultimately eradicate digital sex crime content."

The Arrest of Telegram CEO Pavel Durov and Ongoing Legal Challenges

The pressure on Telegram intensified when the company’s CEO and owner, Pavel Durov, was arrested in France on August 24, 2024.

French authorities charged him with multiple crimes, including complicity in the dissemination of child sexual abuse material and failure to cooperate with police investigations.

Despite posting bail of 5 million euros, Durov’s legal troubles have thrust Telegram into the center of a global debate around content moderation, encryption, and cybercrime.

The arrest has brought more scrutiny to Telegram’s operations, with governments worldwide calling for greater oversight of its encrypted services.

Telegram, however, defended its practices, releasing a statement on August 25 that stated,

“It is absurd to claim that a platform or its owner are responsible for abuse of that platform.”

The company maintained that it complies with EU laws and that its content moderation standards align with industry norms.

Nonetheless, these claims have done little to appease critics, particularly in South Korea, where Telegram has become a significant battleground in the fight against digital sex crimes.

Growing Reports of Deepfake Pornography on Telegram

South Korean authorities have been grappling with a rising tide of digital sex crimes, many of which are enabled by deepfake technology.

The Korea National Police Agency revealed that it had launched a preliminary investigation into Telegram after uncovering proof that criminals were using the platform to create and distribute sexualised deepfake videos.

As of August 26, the police had received 88 reports of deepfake sexual content on Telegram and had identified 24 suspects linked to these crimes.

The platform’s role in these activities has placed it in the crosshairs of law enforcement, and the police continue to build their case against the company.

This is not the first time Telegram has been implicated in such crimes.

In 2020, the platform’s reputation was severely damaged when it was discovered that an online sexual blackmail ring, led by a 20-year-old named Cho Ju-bin, was using Telegram to blackmail women, including minors, into producing degrading and violent sexual imagery.

Cho was eventually sentenced to 40 years in prison for his role in the ring, but the scandal highlighted Telegram’s vulnerabilities in preventing the dissemination of illegal content.

A National Crisis: South Korea’s War Against Digital Sex Crimes

The digital sex crime epidemic in South Korea has worsened over the past few years.

According to police data, the number of deepfake cases has surged from 156 in 2021 to 297 as of July 2023, nearly doubling in just two years.

This alarming trend has prompted action from the highest levels of government.

Here are some statistics about the deepfake situation in South Korea:

Almost a third of videos on deepfake pornography websites feature non-Western individuals, with South Korean K-pop singers constituting a quarter of the targeted subjects. (Source: regmedia)

South Korean singers and actresses make up 53% of those featured in deepfake pornography, making them the most frequently targeted group. (Source: securityhero.io)

President Yoon Suk Yeol has repeatedly called for a zero-tolerance approach to digital sex crimes, particularly those involving minors or non-consenting adults.

During a televised cabinet meeting, Yoon addressed the issue, stating,

“It’s an exploitation of technology while relying on the protection of anonymity. It’s a clear criminal act.”

His administration has been relentless in pushing for more stringent regulations and thorough investigations to protect victims of these crimes.

Local media reports have highlighted how university students and even high school students have become targets of deepfake pornography, with doctored images of female students being shared in chatrooms on Telegram.

A journalist went undercover in one of the chatrooms and found out that some of them are run by Telegram bots:

These revelations have caused widespread outrage, with organisations like the Korean Teachers and Education Workers Union calling for an investigation into how these explicit materials are being distributed.

Many believe that stronger enforcement of South Korea’s Sexual Violence Prevention and Victims Protection Act is necessary.

Under this law, the creation and distribution of sexually explicit deepfakes is punishable by up to five years in prison or a fine of 50 million won (approximately $37,500).

Telegram’s Apology and Plans for Greater Cooperation

In response to mounting pressure from both South Korean authorities and the public, Telegram issued a rare apology on August 29, acknowledging its miscommunication with the KCSC regarding the handling of illicit content.

The platform characterised the situation as "unfortunate" and expressed its desire to cooperate with the South Korean government.

The KCSC has welcomed this newfound willingness to engage and is working with Telegram to establish a dedicated hotline for reporting incidents of illicit sexual content.

This hotline, along with the new email channel, is seen as a critical step in addressing the growing problem of deepfake pornography on Telegram.

Despite these developments, scepticism remains.

Telegram’s history of non-compliance, combined with the legal challenges facing its CEO, leaves many questioning whether the platform can be trusted to take meaningful action against digital sex crimes.

While the removal of 25 videos is a step in the right direction, it is just the beginning of what will likely be a long and arduous process of reform.