Ramayana in English: this actor wasn’t speaking English on set, but AI reshaped his mouth so it looks like he was. Here is how AI lip sync works.

Ramayana is a huge Indian film shot in Hindi that is now coming out in English for audiences all over the world, and an AI company is a big reason it can. As a film editor, I had to look closer.

Here is what I found: the English dialogue is recorded first, then the AI reshapes the actors’ mouths on screen so it looks like they were speaking English on set all along. The lead actors recorded their English lines themselves. So it’s not old-school dubbing, and it’s not someone else’s voice pasted over the performance. It’s his voice and his performance, just in a different language. What does that mean for international cinema? Watch to the end.

I mean, how crazy is this? Let me know in the comments what you think.

SOURCES
Director says AI is used only for lip-sync, not dubbing: https://www.outlookindia.com/art-entertainment/ramayana-nitesh-tiwari-clarifies-ai-is-used-only-for-lip-sync-not-dubbing
Brahma AI reported in the English trailer: https://www.newsbytesapp.com/news/entertainment/dnegs-brahma-ai-used-in-tiwaris-english-ramayana-trailer/tldr

TOOLS MENTIONED
Brahma AI (the AI lip sync tool shown in the video)

#Ramayana #AIinFilm #Filmmaking