D-ID, the company behind Deep Nostalgia, lets you create AI-generated videos from a single photo • TechCrunch

Israeli company AI she didwhich provided technology for projects such as deep nostalgiais launched new platform Where users can upload a single image and text to generate the video. With this new website called creative reality studiothe company targets sectors such as corporate training and education, internal and external corporate communications, product marketing and sales.

The platform is easy to use: Users can upload an image of a presenter or choose an image from the pre-created presenters to start the video creation process. Paid users have access to premium presenters that are more “expressive” because they have better facial expressions and hand movements than the default ones. Then, users can either type the text from a script or simply upload an audio clip of someone’s speech. Users can then select a language (the platform supports 119 languages), sound and patterns such as cheerful, sad, excited and friendly.

The company’s AI-based algorithms will generate a video based on these parameters. Users can then distribute the video anywhere. The company claims that the algorithm only takes half the duration of a video to create a clip, but in our tests, it took two minutes to create a one-minute video. This may change based on the type of presenter and language you selected.

“The COVID-19 pandemic has accelerated the need for digital content around the world. A big problem for organizations is creating educational content. Reading documents and looking at presentations can be dry and boring. In addition, they have to spend thousands of dollars to hire actors and create clips. Video tutorial. So we’re using our own AI to create presenters and educators to re-enact humans and make content more engaging and effective,” Jill Berry, CEO of D-ID, told TechCrunch in an interview.

Berry cited many use cases for this technology—from a multilingual message from the CEO to employees to the personal desires of an organization’s users.

D-ID launched the studio for testing in mid-August to iron out bugs ahead of the public launch. And while its main focus is on meeting the needs of businesses of all sizes, the company sees it a lot of attention from the creators on the platform.

Creating violent videos by deepfakes is a risk. That’s why the Israeli company has put in place protective barriers such as filtering swear words and racist remarks, as well as image recognition to avoid using celebrity faces. Uses Microsoft Azure Text Editing API To get rid of sexual remarks and offensive language in video scripts. D-ID said that the platform’s terms of use prevent users from creating political videos. In the event of a breach of any of these rules, the Company can suspend the violator’s account and remove his video from the Library.

Raise D-ID $25 million in Series B funding Led by Macquarie Capital back in March – raising a total of $47 million so far. So far, the company has relied on others using its API to create content – Deep Nostalgia is a prime example of this – with clients like Modelez and Warner Bros. And the India-based Josh short video app. Now, the company is expanding its money making products by launching a PowerPoint plugin along with this self-service platform. The plugin adds an interactive presenter to the suite, so users don’t just have to read the slides. They can choose between different avatars, sounds, and languages ​​- just like a self-service platform. But there is no requirement to have a dedicated provider at this time.

At launch, users will be able to sign up for a free 14-day trial account and create up to five minutes of AI-generated 720p video. After that, they can pay $49 per month to access 15 minutes of AI-generated HD video, a PowerPoint plugin and email support.

D-ID co-founders Eliran Cotta, Jill Berry, and Sila Blondheim. Image credits: she did

Users can also upload their own audio clips for audio reproduction. In addition, the company is working on a tool to allow users to upload their own footage to train the AI ​​to be more expressive so it can better mimic the person in the video. All of these features will be limited to the corporate organization category.

While the company faces competition such as paraphrase any And the soul machines In the field of AI-generated video, it claims that hardly any company claims to create high-quality videos from a single image.

Perry said D-ID does not aim to limit itself to corporate training, outreach and marketing videos. It also has ambitions to facilitate real-time video call translation and presenter cloning — making an avatar appear on the video instead of you during audio dictation.

The company is also considering becoming a major player in web3/metaverse development. “Because we have experience creating videos from a single image. We are thinking of ways to create digital avatars for metaverses,” said Berry.