Home Blog D-ID AI Video Translate Tool Launched, Can Generate Lip Synced Videos in...

D-ID AI Video Translate Tool Launched, Can Generate Lip Synced Videos in Multiple Languages

12
0


D-ID, the Tel Aviv-based synthetic intelligence (AI) startup, launched an AI-powered video translation device in beta on Wednesday. Dubbed Video Translate, the device can generate translated movies that mimic the voice of the unique speaker and sync the lip motion to match the phrases. The characteristic is at the moment accessible to the subscribers of the platform, and the corporate mentioned it is going to be accessible totally free for a restricted interval. The device will compete with related platforms comparable to ElevenLabs, Speechify, and extra.

The AI startup introduced the launch of the video translation characteristic in a publish on X (previously often known as Twitter). The new device joins the platform’s current choices comparable to avatar-based AI video era, AI agent creation, and AI-powered video marketing campaign creation. The Video Translate device is at the moment accessible in beta on the net. While D-ID does have iOS and Android apps, they don’t assist this characteristic for the time being.

With the brand new AI tool, customers can both add a video file from their system or drag it from a cloud server. Currently, the utmost supported file dimension is 2GB and the supported file codecs embody MP4, MOV, and MPEG. Gadgets 360 workers members had been in a position to check the platform and located it to be working as described, though the lip-syncing and AI voice seem barely unnatural and robotic, and figuring out these movies as AI-generated will likely be fairly simple.

However, there are a number of limitations when producing a video as effectively. The video translation will solely work when there’s a single particular person within the body of the video, and the particular person is front-facing with their face seen always. Further, background noise or music can distort the standard of era. Additionally, the platform doesn’t translate movies if the speaker is a well-known or recognisable particular person who seems in them.

The D-ID Video Translate device can translate movies into 30 totally different languages. Some of them embody Arabic, Chinese, English, French, German, Hindi, Italian, Japanese, Korean, Russian, Tamil, and Turkish.

Currently, the characteristic is on the market to all subscribers of the platform. Users can subscribe to D-ID by registering an electronic mail ID totally free. The free tier will get 20 credit, which isn’t replenished as soon as exhausted. The paid subscription begins at $56 (roughly Rs. 4,700) per 12 months and presents 40 credit per 30 days. The most costly plan will value $2,263 (roughly Rs. 1,90,000) per 12 months and presents 700 credit a month. The startup additionally presents enterprise-focused plans as effectively.



Leave a Reply