The tool works by taking a source video – in this case, part of an online college course lecture created in partnership with Arizona State University recorded in English – and translating it into another language using next-generation translation models. One of the many new products Google unveiled at its I/O conference yesterday was its experimental 'Universal Translator,' part of its AI push. Not only does it offer real-time translations, but it also edits video so the lips closely match the translated audio.
What just happened? If you've ever watched a video dubbed into English and been put off by a speaker's lips moving out of sync with the words, you might love Google's new service.
