San Francisco City Attorney David Chiu has taken a groundbreaking step in the fight against nonconsensual AI-generated pornography. The city attorney’s office recently filed a lawsuit targeting websites that create and distribute deepfake pornographic images without the consent of the individuals depicted, including children.
Chiu’s lawsuit, filed in San Francisco Superior Court, alleges violations of state and federal laws related to deepfake pornography, revenge pornography, and child pornography. The defendants include 16 companies, some based in the UK, Estonia, Florida, and other locations, while others remain unidentified.
The websites in question allow users to upload images to be manipulated and used in pornographic content, even if the subjects have not given their consent. This practice not only violates the privacy and dignity of adults but also exposes children to exploitation. The complaint highlights the disturbing trend of using AI technology to create sexually explicit content featuring both real and fictitious individuals.
The proliferation of deepfake pornography has had far-reaching effects, leading to cases of bullying, threatening, and humiliating women and girls. Chiu cited an incident in which AI-generated nude images targeted eighth-grade students at a Beverly Hills middle school as a stark example of the harmful impact of this technology.
In response to the lawsuit, Chiu is seeking to have the websites taken down and the defendants permanently barred from engaging in such illegal activities. The lawsuit also aims to impose civil penalties and costs on the accused parties.
Chiu emphasized that while generative AI offers promising capabilities, it also poses risks when misused for creating nonconsensual and exploitative content. He stressed that this behavior constitutes sexual abuse rather than innovation and must be addressed with legal action.
The lawsuit signifies a crucial effort to combat the misuse of AI technology for nefarious purposes and to protect individuals from the harmful effects of deepfake pornography. By holding accountable those responsible for producing and disseminating nonconsensual pornographic content, Chiu is aiming to uphold the rights and dignity of all individuals, particularly women and children who have been targeted by this exploitative practice.
