I recently was trying to learn how to run local models on my Macbook Pro. This turned out to be easier said than done - it was difficult to understand if I could run models, which ones I could run, whether they would even fit on my machine, how the performance looks when I add in constraints, etc. So I built "scout", an entirely free website that allows you to check out which model your machine configuration can run. It is entirely FREE. My only request is to give me feedback, this has been a fun project and I am happy to come up with new features.

Disclaimer: This might as well be an early Alpha build - many things are not where I want them to be but give it a shot. Happy to answer any questions.

Really cool, practical idea. No feedback for you yet; I'll poke around more.

It's funny I come across this today. Was just telling a buddy of mine last week that I have a spare 3080 machine that he can have to play around with agents/llms, but I wasn't sure which ones it could play well with :)