We originally built voice agents for sales training - basically AI role-play partners to help reps practice pitches and handle objections. Problem was even we stopped using it. Setting aside time for practice felt like overhead, and simulated scenarios never matched real conversations.

So we tried a different approach: instead of practicing fake calls, get help during real ones. Aya sits on your desktop and watches sales meetings. When someone raises an objection or asks something unexpected, it suggests responses or pulls up relevant info about their company.

The multimodal part is what makes it different - it's not just transcribing audio, but seeing your screen and understanding context from multiple inputs in real-time.

We open sourced it because the concept feels like it could work in other verticals too - education, customer support, even job interviews. But we're just one team focused on sales. Want to see what the community builds with it and where else this real-time AI assistance makes sense.

Built with Electron and LiveKit for screen recording. Runs in a transparent window so it's there but not intrusive. Still figuring out the privacy aspects of having AI watch your calls.

Try it: https://aya.miraipitch.com/ Code: https://github.com/MiraiPitch/Aya-Assistant

What do you think?