7.3k stars! AI open source videos automatically add subtitles and dubbing with Netflix-level accuracy.
I think we are now in the era of the fifth productivity revolution.
We have entered the era of smart technology.
Many friends who want to go abroad, on the one hand, they cannot understand short videos at home and abroad, and on the other hand, they are difficult to make. The essence is the language barrier.
Or some people watch foreign language movies, study materials, etc.
It doesn’t matter if you don’t understand the language. After all, AI has now replaced simultaneous interpretation to a certain extent. Watching a video in a foreign language is so easy!
The project I recommend to you today is VideoLingo, which is an open source multi-language video subtitle generation tool that can also be read out through TTS , which will be much more convenient.
Project introduction
VideoLingo is an open source multi-language video subtitle generation tool that provides efficient and accurate automatic translation and subtitle generation for video content. This project uses advanced natural language processing and speech recognition technology to automatically identify the language in the video and generate subtitles in multiple languages to help users better understand and share global video content. Supports a variety of common video formats and subtitle languages, especially suitable for applications in the fields of education, entertainment, and cross-language communication.
Main functions
🎙️ Word-level subtitle recognition based on WhisperX 📚 GPT generates a glossary to ensure translation consistency ✅ Only supports Netflix standard single line subtitles 🚀 Start with one click and output through Streamlit 📝 Detailed logging and support for progress recovery
Project link
🎥 Support downloading YouTube videos through yt-dlp
📝 Subtitle segmentation based on NLP and GPT
🔄 Three-step literal translation, reflection and adaptation process to ensure professional-level translation quality
🗣️ Dubbing alignment with methods like GPT-SoVITS