A former Baltimore high school athletic director has been arrested and charged with using an ai voice cloning service to frame the school principal.
ai-audio-baltimore-county-YBJNJAS6OZEE5OQVF5LFOFYN6M/”>The Baltimore Flag reports that Baltimore police believe an alleged recording of Pikesville High School Principal Eric Eiswert making racist and anti-Semitic comments was fake. The experts said The Baltimore Flag and to Baltimore police that the recording, which circulated through social media in January and briefly resulted in Eiswert's suspension, has a “flat tone, unusually clean background sounds, and a lack of pauses or consistent breathing sounds.”
Baltimore police traced the recording to Dazhon Darien, a former athletic director at the school whose name is also mentioned in the audio clip. He allegedly accessed the school's computers to search for “OpenAI tools.” It is unclear which ai voice platform Darien allegedly used.
In this tense environment, OpenAI decided in March to withdraw its ai text-to-speech generation platform, Voice Engine, from public use. The service, which only requires a 15-minute audio clip to clone someone's voice, is only available to a limited number of researchers due to the lack of guardrails around the technology.
US lawmakers have introduced, but have not yet passed, several bills, such as the No-Fake Act and the ai No-Fraud Act, that seek to prevent technology companies from using the face, voice or name of a person without their permission.