After some frustrating attempts to prototype my ideas with electronics, I wondered how I could get a tangible interface with something like paper. OpenCV is surprisingly effective and delightfully experimental and glitchy, with much less compute than modern AI tools. From the README opening:
This project is a demonstration of how to communicate with and control an app from another app. Features the use of a novel OpenCV-based tangible user interface (TUI), mDNS-SD for automatic device discovery and connection over local network, websockets for inter-device messaging and rust-based android development via the NDK.
I wanted to encapsulate a few things I've learned over the years and then recently for this project. So hopefully this inspires someone stumbling across this project.
Beyond that, there are lots of very capable, cheap, usable old Android devices. Building with electronics and Raspberry Pi is cool but maybe we are overlooking what is capable with these phones. There are many directions I want to take this thought.
tonelord•1h ago
This project is a demonstration of how to communicate with and control an app from another app. Features the use of a novel OpenCV-based tangible user interface (TUI), mDNS-SD for automatic device discovery and connection over local network, websockets for inter-device messaging and rust-based android development via the NDK.
I wanted to encapsulate a few things I've learned over the years and then recently for this project. So hopefully this inspires someone stumbling across this project.
Beyond that, there are lots of very capable, cheap, usable old Android devices. Building with electronics and Raspberry Pi is cool but maybe we are overlooking what is capable with these phones. There are many directions I want to take this thought.