OpenAI unveils voice-cloning tool

OpenAI unveils voice-cloning tool

OpenAI says ways to verify people consented to having their voices immitated by artificial intelligence and to automatically detect audio deep fakes involving prominent people should be built in widely deployed 'synthetic voice' tools
OpenAI says ways to verify people consented to having their voices immitated by artificial intelligence and to automatically detect audio deep fakes involving prominent people should be built in widely deployed 'synthetic voice' tools. Photo: SEBASTIEN BOZON / AFP
Source: AFP

OpenAI on Friday revealed a voice-cloning tool it plans to keep tightly controlled until safeguards are in place to thwart audio fakes meant to dupe listeners.

A model called "Voice Engine" can essentially duplicate someone's speech based on a 15-second audio sample, according to an OpenAI blog post sharing results of a small-scale test of the tool.

"We recognize that generating speech that resembles people's voices has serious risks, which are especially top of mind in an election year," the San Francisco-based company said.

"We are engaging with U.S. and international partners from across government, media, entertainment, education, civil society and beyond to ensure we are incorporating their feedback as we build."

Disinformation researchers fear rampant misuse of AI-powered applications in a pivotal election year thanks to proliferating voice cloning tools, which are cheap, easy to use and hard to trace.

Read also

'Operation Beethoven': Dutch 2.5bn-euro charm offensive to keep ASML

Acknowledging these problems, OpenAI said it was "taking a cautious and informed approach to a broader release due to the potential for synthetic voice misuse."

The cautious unveiling came a few months after a political consultant working for the long-shot presidential campaign of a Democratic rival to Joe Biden admitted being behind a robocall impersonating the US leader.

The AI-generated call, the brainchild of an operative for Minnesota congressman Dean Phillips, featured what sounded like Biden's voice urging people not to cast ballots in January's New Hampshire primary.

The incident caused alarm among experts who fear a deluge of AI-powered deepfake disinformation in the 2024 White House race as well as in other key elections around the globe this year.

OpenAI said that partners testing Voice Engine agreed to rules including requiring explicit and informed consent of any person whose voice is duplicated using the tool.

Read also

French cyberdefence chief warns Paris Olympics a 'target'

It must also be made clear to audiences when voices they are hearing are AI generated, the company added.

"We have implemented a set of safety measures, including watermarking to trace the origin of any audio generated by Voice Engine, as well as proactive monitoring of how it's being used," OpenAI said.

Source: AFP

Authors:
AFP avatar

AFP AFP text, photo, graphic, audio or video material shall not be published, broadcast, rewritten for broadcast or publication or redistributed directly or indirectly in any medium. AFP news material may not be stored in whole or in part in a computer or otherwise except for personal and non-commercial use. AFP will not be held liable for any delays, inaccuracies, errors or omissions in any AFP news material or in transmission or delivery of all or any part thereof or for any damages whatsoever. As a newswire service, AFP does not obtain releases from subjects, individuals, groups or entities contained in its photographs, videos, graphics or quoted in its texts. Further, no clearance is obtained from the owners of any trademarks or copyrighted materials whose marks and materials are included in AFP material. Therefore you will be solely responsible for obtaining any and all necessary releases from whatever individuals and/or entities necessary for any uses of AFP material.

Online view pixel