Game changer: YouTube introduces AI-powered tool for automatic dubbing in videos
Delhi : YouTube has released a new tool that assists video producers in automatically translating their videos into other languages. AI, or artificial intelligence, is used by this technology to carry out the translation. YouTube made the revelation during a gathering dubbed VidCon. Aloud, a business that also employs AI to subtitle films, and YouTube have a partnership. Aloud is a product of Google's internal incubator, Area 120.
YouTube implemented a tool that enables producers to have numerous audio tracks in different languages earlier this year. This implies that content producers can subtitle their films to make them understandable to viewers who speak other languages. More than 10,000 videos have already been dubbed by producers in more than 70 languages as of June 2023.
Before the advent of this new platform, authors were forced to collaborate with other dubbing service providers. It could be expensive and time-consuming to do this. Creators may now dub their videos for nothing thanks to Aloud, though. Google developed Aloud in 2022. It applies AI to translate, translate, and then produce a dubbed version of a video. Prior to Aloud producing the dub, creators can review and change the transcription.
This feature is presently being tested by YouTube with a large number of producers. Amjad Hanif, YouTube's vice president of creator products, brought this up in front of the conference attendees. Hanif also mentioned that this technology would soon be made available to all producers on YouTube.
Aloud is only at this time offered in English, Spanish, and Portuguese. However, there will be additional languages in the future, such Hindi and Bahasa Indonesia.
Hanif also claimed that YouTube is striving to recreate the original audio track's voice in the translated audio tracks. They desire the same facial expression and lip motions in the dubbed version as in the original. TechCrunch received confirmation from YouTube that they want to employ generative AI to bring new features to Aloud, including the preservation of the creator's voice, enhanced emotion transmission, and reanimated lip movements.
