Anyone who uploads a video to YouTube will be able to have it automatically translated into another language in the future. The function is called “auto dubbing” – in German: “automatic synchronization” – and is intended to help overcome language barriers.
In September 2024, YouTube officially announced that it would introduce an automatic video translation function. The company had previously used algorithms to generate subtitles. Now the video platform is going one step further.
In the future, users should be able to automatically synchronize videos when uploading them and have them translated into other languages - without much effort. Because artificial intelligence is supposed to take over this process, which is usually quite complex. YouTube relies on the synchronization service Aloud from sister company Google.
YouTube: This is how the automatic synchronization of videos works
With automatic synchronization, YouTube first creates a transcript of the original audio file. Users can then check this text and adjust it if necessary. Aloud then translates the text and creates an audio track in the selected language.
According to YouTube, it tested the function with hundreds of selected video producers for several months. The company is now making automatic synchronization available to the first users. In an official email to the first users, which BASIC thinking has, it says:
We'll soon enable auto-sync for new video uploads to your channel. This means YouTube automatically generates translated audio tracks in different languages to make your content accessible to more viewers.
However, according to YouTube, automatic synchronization of existing videos is not possible. However, newly uploaded videos in Spanish, Portuguese, German, French, Italian, Hindi, Indonesian and Japanese can be dubbed into English. Videos in English can then be dubbed into these languages.
Audio track: Change video language on YouTube
If videos are available in multiple languages, you have the option to choose the soundtrack yourself. To do this, click on the gear symbol in a video and then click on “Audio track“. All available languages will then be displayed there.
YouTube wants to enable natural-sounding synchronizations with its auto dubbing function. The newly generated soundtracks should correspond to the tone and intonation of the authors using AI. The atmosphere of the original sound should be retained.
Also interesting:
Source: https://www.basicthinking.de/blog/2024/11/25/automatische-synchronisation-youtube-uebersetzt-audiospuren-in-andere-sprachen/
