Normally, it takes 300ms to analyse one image on my laptop, which is pretty fast for a local vision model. I use moondream2 as my vision model, you can set your custom model like moondream3.1 if you have a good GPU (for comparison I have currently have an RTX 3050). It works cross-platform. Just follow the README. If you like my work, you leave me a tip as an act for supporting open source!!
Looking for some feedback! Thank you.