Amazon Prime Video Debuts AI-Assisted Lyp Sync Technology

Amazon is debuting a new AI-powered lip-sync technology today that will sync actors’ mouth movements to dubbed audio to improve immersion. The new lip-sync dubs are launching first on the first two seasons of the German television series Maxton Hall, the most-watched international original series ever on the platform, but they will only be available in English.

“With lip-syncing, we’re creating a more seamless and immersive way for customers to enjoy global content. And for creators, we’re making it easier for their stories to reach an even broader and global audience, all done under creative oversight to ensure the integrity of their artistic vision is preserved,” said Raf Soltanovich, vice president of technology at Prime Video and Amazon MGM Studios.

Amazon said today that it’s using this new lip-sync technology with human-dubbed audio. However, the company has also started testing AI-powered dubbing for select movies and series on Prime Video, with mixed results. However, I wouldn’t be surprised if Amazon eventually combines its various AI and VFX technologies to create AI-powered dubbing that’s perfectly synchronized to actors’ lip movements.

The upcoming third and final season of Maxton Hall, which will be released on Prime Video on December 9, will also have lip-sync dubs in English on day one. Amazon said today that it’s already working on expanding the technology to more content.