Introduction to AI Dubbing in Film

On May 9, AMC Theatres is set to begin screening a science fiction film originally shot in Swedish, but revamped to appear as if it were produced in English. The film, Watch the Skies, initially released in its native country as UFO Sweden, has undergone a process called "visual dubbing" with the assistance of artificial intelligence. This was made possible by an AI company named Flawless, which utilized its technology to digitally modify the film’s visuals, making the actors seem as though they are genuinely speaking in English. It’s worth noting that the original actors recorded their dialogues in English within a sound booth, while Flawless AI’s technology solely altered the lip movements of the actors in the film.

The Technology Behind AI Dubbing

According to Flawless’ website, their TrueSync AI technology has the capability to "capture every nuance of an actor’s performance and generate new lip movements that perfectly map to the new language audio, providing the perfect visual dub." As reported by Variety, this tool is compliant with the rules established by SAG-AFTRA, which concluded a four-month strike in 2023 after securing a deal with studios that safeguards its members from the potential threats posed by AI.

The Future of Foreign Films with AI Dubbing

The technology developed by Flawless AI has the potential to lower the barriers to entry for foreign films, making them more attractive to audiences who are reluctant to watch subtitled movies. Furthermore, it could provide a more immersive experience for viewers in countries where films are typically dubbed in their native language. "When we show our materials to filmmakers, especially over the past year, they realize the potential of transitioning from a local stage to a global stage," stated Scott Mann, the company’s co-founder, in an interview with Variety. "It’s a massive opportunity to get their work out, and it’s been invigorating. They’re excited about showcasing their work to a broader audience, particularly in America."

The Film: Watch the Skies

Watch the Skies is a film that revolves around a teenager who is convinced that her missing father was not deceased but abducted by aliens. In an attempt to uncover the truth behind her father’s disappearance, she joins forces with the UFO Club to search for him. AMC Theatres has committed to screening the film in 100 locations across the United States.