I decided to fork another project and make it as straightforward to use as possible.
It just runs on the background, and transcripts calls automatically when they happen and saves them as md files I can use in obsidian or anywhere else.
I still need to fix some tech issues, and make local AI summaries actually useful, but in the meantime, I have the app I've wished for a long time. Hope others find it useful.