Meta launches AI-powered voice translation feature globally
Meta has announced the global launch of a new voiceover feature for Reels videos. The technology uses generative AI to translate a user’s voice with additional lip-syncing.
To use this feature, the user must select the option "Translate your voice with Meta AI" before publishing the video. The tool then creates an audio translation track, preserving the intonation of the original voice. After that, there is an option to activate lip sync with the translated audio.
Before publishing, the author can preview the result and decide whether to add synchronization. A corresponding message about the use of AI appears in the translated video.
The feature is currently available to Facebook creators with more than 1,000 followers, as well as to anyone with a public Instagram account. Meta recommends using the tool in videos that are directly facing the camera, without unnecessary background music or mouth covering. The system supports up to two speakers, but the company advises avoiding overlapping voices.
The company positions the new feature as a tool for expanding the audience of content beyond the author's native language. To this end, a tool for translation efficiency by language has also been introduced.
At launch, the translation feature is only available for English and Spanish, but the company plans to expand language support in the future.