Him using different ones is why I use Perplexity, I get to try different models and honestly its pretty darn decent, gives me everything in an organized way, I can see all the different links, and all the files it outputs can be downloaded as a simple zip file. It has everything from GTP5 to Deepseek R1 and even Grok.

There's other sites similar to perplexity that host multiple models as well, I have not tried the plethora of others, I feel like Perplexity does the most to make sure whatever model you pick it works right for you and all its output is usefully catalogued.

This is an interesting overview, thank you. Different tasks, different models, all-day-usage and pretty complete (while still opinionated, which I like).

However, checking the results my personal overall winner if I had to pick only ONE probably would be

  deepseek/deepseek-chat-v3-0324

which is a good compromise between fast, cheap and good :-) Only for specific tasks (write a poem...) I would prefer a thinking model.

i use gemini flash and pro for pretty much everything. Why? they offer it free to test.

I tried signup for openai wayy too much friction, they start asking for payment without even you using any free credits, guess what that's one sure way to lose business.

same for claude, i couldn't even get claude through vertex as its available only in limited regions, and i am in asia pasific right now.

> To access their best models via the API, OpenAI now requires you to complete a Know-You-Customer process similar to opening a bank account.

While this is true, you can download the OpenAI open source model and run it in Ollama.

The thinking is a little slow, but the results have been exceptional vs other local models.

https://ollama.com/library/gpt-oss

Which of these can I run locally on a 64GB Mac Mini Pro? And how much does quantization affect the quality?

> Almost all models got almost all my evaluations correct

I find this the most surprising. I have yet to cross 50% threshold of bullshit to possibly truth. In any kind of topic I use LLMs for.

> Six of the eleven picked the same movie

This is surely the greatest weakness of current LLMs for any task needing a spark of creativity.