YouTube has unveiled a new AI-powered feature aimed at breaking down language barriers and facilitating video dubbing in various languages. During the recent VidCon event, YouTube announced that it will be leveraging the expertise of the Aloud team, an AI-powered dubbing service developed within Google’s Area 120 incubator.
The Aloud tool functions by transcribing the user’s video, providing a transcription that can be reviewed and edited. Subsequently, it translates and generates the dubbing for the video. While currently supporting a limited number of languages, YouTube has already commenced testing the tool with a select group of creators.
In a statement to The Verge, Amjad Hanif, a YouTube representative, said that Aloud presently supports “few” languages like English, Spanish, and Portuguese, with plans to add more languages in the future. Aloud’s inclusion on YouTube is anticipated to be very advantageous as more and more content creators want to include multilingual dubs in their videos.
Looking ahead, YouTube aims to enhance the tool’s capabilities by making translated audio tracks sound more natural, matching the creator’s voice with improved expression and lip sync. These enhancements are planned for implementation in 2024. The company added Multi-Language audio tracks earlier this year.
As YouTube takes a significant step towards bridging the language gap, users can look forward to a more inclusive and accessible video-sharing experience, where language will no longer be a barrier to content consumption.
Comments