AI video creation platform D-ID has just launched an innovative tool that allows users to translate videos into multiple languages while seamlessly cloning the speaker's voice and synchronizing lip movements. This technology, called AI Video Translate, is set to revolutionize the way creators and businesses reach global audiences.
The new tool, currently available to D-ID subscribers for free, supports 30 languages, including Arabic, Mandarin, Japanese, Hindi, Spanish, and French. With a D-ID subscription starting at $56 per year, users can access this game-changing feature and expand their reach like never before.
D-ID's AI Video Translate technology stems from the company's previous work, which gained widespread attention a few years ago when users were able to animate older family photos and make them speak. The startup's success in this area led to a $25 million Series B fundraising in 2022, allowing them to focus on serving their growing number of enterprise customers in the U.S. who were utilizing their AI-powered video technology.
The new AI Video Translate tool is designed to help customers save on localization costs when scaling their campaigns to a global audience in areas such as marketing, entertainment, and social media. It will compete with other solutions for both dubbing and AI video, offering a more accessible and affordable option for creators of all sizes.
The introduction of AI Video Translate is expected to empower creators and businesses, enabling connections with global audiences in a more engaging and cost-effective manner. The technology, which clones the speaker's voice and synchronizes lip movements, is anticipated to enhance video translation significantly.
AI-Powered Lip Sync Augment Video Localization Efforts
D-ID's newly developed proprietary model, called Rosetta-1, powers the AI Video Translate feature, ensuring high-quality results. The tool is available through D-ID Studio and its API, with a one-month trial being offered to new users.
To use the feature, videos must be between 10 seconds and 5 minutes in length, with a file size under 2GB. The video should feature only one person facing the camera, with their face visible at all times for optimal results.
The launch of AI Video Translate comes at a time when the demand for AI-powered video solutions is growing rapidly. Companies like Microsoft and Vimeo have also announced their own AI translation and dubbing tools, making it easier for creators to reach global audiences.
D-ID AI Video Translate is set to disrupt the video translation market, offering a more advanced and user-friendly solution that combines voice cloning and lip sync technology. As the world becomes increasingly interconnected, tools like this will play a crucial role in breaking down language barriers and fostering global communication and collaboration.
BONUS: Get our $200 “AI Mastery Toolkit” FREE when you sign up!
