video[0]
The idea is you could carry around this hardware and ask it any questions about the conference. Who is speaking, what are they speaking about etc... it connects via WebRTC to a LLM and you get a bunch of info.
This is a workshop/demo project I did for a conference. When I was talking to the organizers I mentioned that I enjoy doing hardware + WebRTC projects. They thought that was cool and so we ran with it.
I have been doing these ESP32 + voice ai projects for a bit now. Started with an embedded sdk for livekit[1] that jul 2024 and been noodling with it since then. This code then found its way into pipecat/livekit etc...
So I hope it inspires you to go build with hardware and webrtc. It's a REALLY fun space right now. Lots of different cheap microcontrollers and even more cool projects.
nunobrito•1w ago
Maybe possible to propose as challenge an ESP32 project to play music according to what is stored on the memory card (completely offline)?
There are already voice recognition happening offline, but there isn't yet something that can find relevant music and play it offline.
Sean-Der•1w ago
But totally possible! It's a great idea and would love too help you build it :)
Wire some Open Source together and just start with a small collection of ogg files.
bestouff•1w ago