AI based Dubbing Project

The AI dubbing project integrates advanced technologies such as Speech-to-Text (STT) conversion for transcribing original audio, Translation of text to the target language for multilingual adaptation, Voice Cloning to replicate the source speaker's voice, Text-to-Speech (TTS) conversion for generating natural-sounding synthetic speech, and a Lip Synch based AI module to synchronize lip movements with the dubbed audio. Through the seamless separation of audio and video files, this project automates the dubbing process, enabling efficient and accurate localization of content across languages while maintaining lip synchronization and preserving the nuances of the original speaker's voice.

Status

Prototype is developed, Testing phase is in continuation