YouTube’s Auto Dubbing Now Supports 27 Languages

YouTube is improving its auto dubbing feature by adding support for 27 languages, and users can now choose a preferred language in settings. The company also plans to make auto dubs feel even more natural with a new lip sync technology.

If auto dubs are generated automatically, content creators can still turn them off or submit their own dubs. With automatic smart filtering, YouTube can also recognize when some videos such as music or silent vlogs shouldn’t be dubbed.

While 27 supported languages for automatic dubbing is a lot, YouTube acknowledges that some auto dubs may contain errors due to incorrect speech recognition. Fortunately, YouTube users can now indicate their preferred languages for audio, titles, and descriptions.

To improve dub quality, YouTube has already rolled out an “Expressive Speech” technology that better captures the “original emotion and energy” of a content creator. Expressive Speech is currently available for all YouTube channels in English, French, German, Hindi, Indonesian, Italian, Portuguese and Spanish.

Lastly, the YouTube team is testing a lip-syncing technology that will reanimate speakers’ lip movements to make them look like they’re actually speaking translated languages. Auto dubbing with lip sync is currently available for select creators via a pilot program.