YouTube has taken a significant step in cracking down on deepfake videos by removing over 1,000 scam ads that utilized AI technology to feature celebrities like Taylor Swift, Steve Harvey, and Joe Rogan. The action was prompted by an investigation conducted by 404 Media, which uncovered an advertising ring responsible for creating misleading videos promoting Medicare scams. These videos collectively garnered almost 200 million views and received numerous complaints from users and the celebrities involved.
Recognizing the seriousness of the issue, YouTube is actively combating AI-driven celebrity scams and has updated its policies to address AI-generated content depicting deceased minors or victims of violence. The platform aims to prevent the spread of deepfakes, which convincingly portray individuals, often famous personalities, in deceptive scenarios.
This recent move is part of YouTube’s broader initiative to tackle AI-generated content that realistically portrays deceased minors or victims of well-documented violent events. The platform has updated its harassment and cyberbullying policies accordingly.
One alarming development involves the misuse of AI technology by content creators to recreate the likeness of deceased or missing children, giving them simulated voices to narrate their deaths. YouTube has made it clear that any content violating this policy will be swiftly removed, with creators being notified via email.
In a separate incident, sexually explicit deepfake content featuring Taylor Swift gained significant traction on X (formerly Twitter). One post alone amassed over 45 million views and 24,000 reposts before being taken down approximately 17 hours later. 404 Media’s investigation traced the creation of these explicit images back to a Telegram group specializing in sharing AI-generated images of women.
Cybersecurity firm Deeptrace reports that a staggering 96% of deepfakes have pornographic content, with the majority targeting women. These incidents highlight the challenges platforms face in combatting the misuse of AI technology and the need for vigilant measures to protect users and celebrities from deceptive content.
YouTube’s action in removing the AI-driven celebrity scam ads demonstrates its dedication to combating the spread of deepfakes and deceptive content. By updating its policies and actively monitoring for violations, the platform aims to create a safer online environment for users and eliminate harmful and misleading content.
The rise of deepfakes presents a global challenge that must be addressed by both technology companies and policymakers. Striking a balance between freedom of expression and the protection of individuals is critical in preserving the integrity of online platforms and ensuring user trust.