Open AI has recently unveiled a new voice cloning tool named Voice Engine that can replicate someone’s speech based on a short 15-second audio sample. This tool has sparked concerns regarding the potential misuse, especially in an election year, as it can easily produce fake audios that may deceive listeners.
In response to these worries, OpenAI has decided to keep the voice cloning tool under strict control until measures are in place to prevent the spread of fake audios. The company is working closely with various partners from different sectors, including government, media, entertainment, education, and civil society, to gather feedback and ensure a responsible release of the technology.
The risks associated with generating human-like speech through AI are significant, particularly in the context of disinformation campaigns during important events such as elections. Voice cloning tools have become increasingly accessible and challenging to detect, making them potential tools for spreading false information and manipulating public opinion.
To address these concerns, OpenAI has implemented safety measures such as watermarking to track the origin of any audio generated by Voice Engine and proactive monitoring of its usage. The company also emphasized the importance of disclosing to audiences when they are listening to AI-generated voices to maintain transparency and trust.
The introduction of the voice cloning tool comes after a controversial incident involving a robocall impersonating US President Joe Biden during the New Hampshire primary. This event raised awareness about the dangers of AI-generated content in political campaigns and highlighted the need for safeguards to prevent misuse.
As technology continues to advance, it is crucial for developers and policymakers to collaborate in establishing ethical standards and regulations to mitigate the risks associated with AI-powered tools like Voice Engine. By prioritizing responsibility and transparency, companies like OpenAI can help ensure that emerging technologies are used for positive purposes while minimizing the potential for harm.
