OpenAI released Sora – a new AI model able to generate high-resolution videos from text. However, the start-up ElevenLabs now enabled the possibility to add background sounds to the silent videos of OpenAI’s Sora.
Creating sound effects and adding them to videos is possible only through a description of the scene by the user. For demonstration, the company also released such generated content (a demo). The sound effects in the background of the video created by Sora are pretty authentic, giving realistic sounds in different scenarios, including details such as footsteps and beeps – all achieved only by describing the sound with text.
In a blog post, the company explained, “We used text prompts like ‘waves crashing,’ ‘metal clanging,’ ‘birds chirping,’ and ‘racing car engine’ to generate audio that we overlaid onto some of our favorite clips from the OpenAI Sora announcement,”
The AI start-up ElevenLabs was founded in 2022 by Piotr Dabkowski, a former Google engineer, and Mati Staniszewski, a former Palantir deployment strategist. Since then, the company has developed AI text-to-speech software, as well as an AI tool for auto-translation of video speeches in over 20 languages while maintaining the original voice tone and style.
There is also an option to register on their waitlist and express interest.
