Previously, a Taiwanese engineer spent less than 4 hours to create a "nostalgic 2D shooting game." Recently, he has a new work: a video player, which is also implemented through AI, and not only is it made this time, It is also shared for everyone to download and use for free. The power of this video player is that it can not only play MP4 and YouTube videos, but also has built-in automatic generation and translation of video subtitles (if it is only in English, you can directly use the built-in function to translate into Chinese), and download YouTube videos.
Engineers use GPT4 and Whisper API to create a video player (attachment point), with built-in automatic translation of subtitles, automatic generation of subtitles, download of YouTube videos, etc. Function Taiwanese engineer "Tutu and Chicken's Engineering World" recently shared "The video player he created using GPT 4 and Whisper API" on his YouTube channel. Unlike last time, this time he is using the latest OpenAI GPT4 is also used with Whisper API and ChatGPT API to enrich the functions of this video player. GPT4 is mainly used to generate the GUI and functions of the video, Whisper API is responsible for generating subtitles, and ChatGPT API is the translation function. The detailed production process is here I won’t mention it here. Those who are interested can watch the full video at the end of the article. Here’s a direct look at the video player work he created:
The Engineering World of Tutu and Chicken has a download point for the player. The link to the instructions for use is attached in the YouTube description column (version updates will also be in the description). Currently, there is only the Windows version:
Software download point
Operation instruction file
Download After decompressing, you can directly click on the application to start using it. No installation is required, which is the installation-free version.
The software interface is very simple. After all, it is a finished product made with GPT4 in a short time. It is recommended to set the API Key at the beginning. , click Set API Key in the upper left corner. The OpenAI API Key can be obtained here. After registering each OpenAI account, you will receive 5 US dollars in free usage. You can test it first and consider upgrading to a paid user if you are satisfied. Calculated in terms of tokens, it is very cheap:
Like this, after pasting your API Key, press Set API Key to start using it:
This video player Videos in MP4 format are locally supported and can also be used to play YouTube videos. After pasting the URL in the field below and clicking YouTube Video, not only will the playback start, but the YouTube video will also be automatically downloaded in the background:
YouTube part It will automatically determine whether the source has subtitle files. If so, it will download and enable the subtitles together. The middle slider can adjust the playback position. If you want to pause playback, please press PAUSE in the lower left corner. STOP in the lower right corner means to stop playback:
Translate is the translation function. Currently it only supports translating sources into Japanese, Traditional Chinese and English. For example, my video has English subtitles. If I want to translate it into Chinese, I choose Chinese Traditional:
Then press the Translate function, and the translation will start. It will take a while. The 15 minutes and 43 seconds video will take about 10 minutes to complete. The estimated time will also be prompted on the right. You can ignore it:
The automatically downloaded YouTube videos and subtitles can be found in the downloads folder of the video player:
The resolution cannot be selected when downloading, and it is guessed that it can only load 720p:
After the translation is completed, you will see the new Traditional Chinese subtitle file in the downloads folder:
Video playback will also automatically apply Traditional Chinese subtitles, which is really convenient:
The timestamp of the subtitle file will be retained for downloading, and then the original English content will be translated into Chinese. The translation quality is quite good, I really like it:
If your video does not have a subtitle file, you can click the Create subtitle function on the left , will automatically generate subtitles:
The actual test was really successful, but my video is a trailer, there are no words, only 3, 2, 1:
UPDATE: In the past two days, the author has added a new function. You can directly upload ready-made SRT files for CHATGPT to translate (of course you still need API KEY), click LOAD SRT ONLY next to OPEN, and select the subtitle file to be translated:
You can also choose the language and click Translate. It will take a little time to translate depending on the content:
The actual translation quality is good, you can go here to see the example (please select English subtitles):
As far as the player is concerned, this one is of course not up to par and a little too bright. But with the addition of the functions of generating subtitles and subtitle translation, it is quite worth using. It can also download YouTube videos. There should be no such built-in player on the market currently. Two-function video player.