Prime Video Uses AI to Sync Actors’ Mouths in Dubbed Titles, Starting With Maxton Hall

Amazon’s Prime Video is promising to make English-language dubs look more natural by using AI to sync up the way the actors’ mouths move on screen. The feature will be available first on “Maxton Hall,” the German-language romance that is Prime Video’s most-watched international original series to date.

Lip-sync dubs are available starting Wednesday on “Maxton Hall” Seasons 1 and 2 globally in English and will also be included when the third and final season of the show releases on Prime Video on Dec. 9. The upcoming Season 3 is based on the 2018 novel “Save Me” by Mona Kasten. The Prime Video team worked with a combination of AI and VFX technologies to develop the feature, but the company is not sharing specifics on what AI tools it used. Amazon said it Prime Video plans to expand the technology to additional titles in the future.

Maxton Hall Launch and Season 3 Release Schedule

The streaming platform selected “Maxton Hall” as the inaugural title for the technology because it stands as the German-language romance that is Prime Video’s most-watched international original series to date. Viewers gained access to the updated dubbing across Seasons 1 and 2 globally in English starting Wednesday.

The technology will also apply to the conclusion of the series. The third and final season arrives on the platform on Dec. 9, with the upcoming episodes based on the 2018 novel “Save Me” by Mona Kasten. The service confirmed plans to scale the software to additional programming.

Technology Stack and Corporate Strategy

Developing the visual tool required a mix of artificial intelligence and visual effects systems. Even so, the company opted not to disclose specific vendor names or proprietary software models utilized in the workflow. Prime Video’s AI dub-syncing feature synchronizes actors’ lip movements with human-dubbed audio, which creates a seamless viewing experience that allows audiences to remain fully immersed in the story, according to Amazon.

Leadership emphasized that the technology exists to serve customer viewing habits while safeguarding creative intent. Amazon said that Prime Video continues to explore practical and useful applications of AI that help enhance the viewing experience, always with the customer at the center and creators in the driver’s seat.

Prime Video Uses AI to Sync Actors' Mouths in Dubbed Titles, Starting With Maxton Hall
Photo: yahoo.com

The engineering approach pairs the altered visual output directly with human-recorded dubbing performances. By keeping human voice actors at the core of the audio track, the company aims to preserve emotional delivery while correcting the visual dissonance of traditional localization.

“At Prime Video, we’re constantly innovating with new tools that enhance the viewing experience for our customers,” said Raf Soltanovich, VP of technology at Prime Video and Amazon MGM Studios. “With lip-syncing, we’re creating a more seamless and immersive way for customers to enjoy global content. And for creators, we’re making it easier for their stories to reach an even broader and global audience, all done under creative oversight to ensure the integrity of their artistic vision is preserved.”

Raf Soltanovich, VP of technology at Prime Video and Amazon MGM Studios

Industry Implications for Global Streaming

The new system creates a seamless viewing experience that allows audiences to remain fully immersed in the story.

Maxton Hall Season 3 – Official Teaser | Prime Video
Photo of author

Sophie Lin - Technology Editor

Sophie is a tech innovator and acclaimed tech writer recognized by the Online News Association. She translates the fast-paced world of technology, AI, and digital trends into compelling stories for readers of all backgrounds.

Slovenia Approves Tesla Supervised Full Self-Driving System

Leave a Comment

This site uses Akismet to reduce spam. Learn how your comment data is processed.