Video stream subber chrome extension

A Chrome extension that gets a website video stream and subtitles it in any language.

Demo · Report Bug · Request Feature

Table of Contents

1. About The Project
   • Built With
   • Demo
2. Getting Started
   • Prerequisites
   • Installation
3. Usage
4. Roadmap
5. Contributing
6. License
7. Acknowledgments

About The Project

The project consist of a Chrome extension that gets a website video stream and sends it to a Python backend which generates its subtitle in any other language and output the subtitled video. I used it to add subtitles to my favorite TV news: Arte Journal.




This project is a pipepline of different processes as follows:

1. The Chrome Extension detects HTTP reponses containing .m3u8 stream payloads and send it to the project's backend
2. The stream is turned into a video and audio file using the ffmpeg-python library
3. The audio file is transformed into timed transcripts using openAI's whisper
4. The transcript is translated in the target language using Google Translate
5. The translated transcript is merged to the original video as subtitles using the ffmpeg-python library

The whole process take around 40min for a 20min video.

(back to top)

Built With

• 
• 
• 
• 
• 
• 
• 

(back to top)

Demo

Arte.Journal.subber.light.mp4

Prerequisites

This project needs a environment with Python and pip.

Installation

1. Load the extension folder in Chrome following these steps
2. Install python packages using the Makefile command:

   make install

3. Run the backend with the Makefile command:

   make dev-run

(back to top)

Usage

Check and follow the steps of the video Demo.

(back to top)

Roadmap

• Build the basic pipeline
• Adapt frontend for any video stream
• Add websocket for front/back end communication
• Adapt project for multiple users
• Store assets on cloud services
• Improve processing speed

(back to top)

Contributing

Contributions are what make the open source community such an amazing place to learn, inspire, and create. Any contributions you make are greatly appreciated.

If you have a suggestion that would make this better, please fork the repo and create a pull request. You can also simply open an issue with the tag "enhancement". Don't forget to give the project a star! Thanks again!

1. Fork the Project
2. Create your Feature Branch (git checkout -b feature/AmazingFeature)
3. Commit your Changes (git commit -m 'Add some AmazingFeature')
4. Push to the Branch (git push origin feature/AmazingFeature)
5. Open a Pull Request

(back to top)

License

Distributed under the MIT License.

(back to top)

Acknowledgments

• Thanks to Tomo for inspiring and hinting way to build this project
• Img Shields
• GitHub Pages

(back to top)