UNICEF has issued a call for governments around the world to criminalize AI-generated child sexual abuse material. According to NS3.AI, this appeal follows research indicating that over 1.2 million children had their images manipulated into explicit deepfakes over the past year. Investigations are currently underway against X's AI chatbot Grok, which has been accused of producing sexualized images of children. This has prompted several countries to ban the technology and regulators to initiate probes.
UNICEF is advocating for legal expansions to classify AI-generated content as abuse. The organization is also urging AI developers to implement safety measures and conduct child rights due diligence across the AI industry. These steps are deemed necessary to protect children from the harmful impacts of AI technology.