It can automatically analyze videos, find potential clips, track speakers/faces for vertical video, generate captions, process multiple languages, dub content, and render the final videos.
The AI side currently supports local models through Ollama, so creators can use their own hardware instead of sending their footage to a hosted service.
One part I’m particularly interested in is making the application a platform developers can build on rather than just a desktop application. The desktop UI is a client of a local HTTP service, with an API that can be used to build things such as Discord bots, batch processors, alternative interfaces, OBS integrations, home-server deployments, and other automation.
The project is still in Alpha, and I’m looking for developers interested in testing the codebase, improving the pipelines, adding integrations, and experimenting with different local AI models.
I’d also appreciate feedback on the architecture/API and what would make Clips Kitty more useful as a platform for building other applications.
ColinGPT•1h ago
GitHub: https://github.com/ColinGPT9/clips-studio
It can automatically analyze videos, find potential clips, track speakers/faces for vertical video, generate captions, process multiple languages, dub content, and render the final videos.
The AI side currently supports local models through Ollama, so creators can use their own hardware instead of sending their footage to a hosted service.
One part I’m particularly interested in is making the application a platform developers can build on rather than just a desktop application. The desktop UI is a client of a local HTTP service, with an API that can be used to build things such as Discord bots, batch processors, alternative interfaces, OBS integrations, home-server deployments, and other automation.
The project is still in Alpha, and I’m looking for developers interested in testing the codebase, improving the pipelines, adding integrations, and experimenting with different local AI models.
I’d also appreciate feedback on the architecture/API and what would make Clips Kitty more useful as a platform for building other applications.
GitHub: https://github.com/ColinGPT9/clips-studio