YouTube, the popular video streaming site, is planning to integrate a new AI-powered tool that will make it easier for creators to dub their videos in multiple languages and help them to reach broader international audiences.
YouTube To Use AI To Enable Dubbing In Other Languages
Announced at VidCon 2023 in Anaheim, California, on Thursday, YouTube revealed that it is integrating with Aloud, an AI-powered dubbing service developed within Area 120, Google’s in-house incubator for experimental products.
In the past, video creators had to collaborate with third-party dubbing providers directly to create their audio tracks, which were either too difficult or too costly. The new AI-powered dubbing service will allow them to dub their videos at no additional cost, making video dubbing easy and cost-effective for a wide range of video creators.
How Will YouTube AI Dubbing Work
Aloud assists creators by transcribing, translating, and narrating their videos. It allows them to “quickly and easily dub their videos into multiple languages, unlocking knowledge that might be trapped in a single language today,” says Aloud’s website.
Before dubbing a video into another language, this tool first transcribes the video and then allows the creator to review and edit the transcription. Later, the tool finally translates and generates the video in the selected language before being published by the creator.
Check out the video below shared by Google’s Aloud team explaining the working of the tool:
How Will It Benefit Creators
Aloud can be very useful for video creators who speak limited languages, as this tool will allow them to add multi-language dubs to their videos.
In an interview with The Verge, Amjad Hanif, Vice President of Creator Products, YouTube, said that the video-sharing platform is already testing the tool with “hundreds” of creators.
In the coming days, Hanif added that YouTube is “working to make translated audio tracks sound like the creator’s voice, with more expression, and lip sync.” The company is reportedly planning to add these features in 2024.
Availability Of YouTube AI Dubbing
Aloud currently has access to a small number of languages. At present, the tool only supports English, Spanish, and Portuguese for translation purposes, with more languages coming soon.
