I haven't evaluated this one, but for what I have, it seem the pplx-decider-v1.2 (and its -flash variant) are pretty good. Anyone evaluated all these open-source decision models on their own tasks? (I evaluated on MonitoringBench).
GavinEke•39m ago
I didn't look specifically at open-source but I evaluated as many decision models as I could on openrouter against how good are they at detecting phishing, which isn't the best use of these models but I was interested to see how they compared. https://emdashcyber.com/phishnchips-decision-models/
mstkllah•41m ago
Reads like an ad for Microsoft and its model because it's an article about a decision model that doesn't mention Jev or other decision models at all.
Den_VR•19m ago
No pelicans riding bicycles on this one, eh?
abhis3798•5m ago
Pelicans are deciding.
v3ss0n•4m ago
Yeah the most usesless and stupidest bench .. I don't know why LLM Community thinks its good idea to use that..
It can't work on decision systems.
liuliu•45m ago
GavinEke•39m ago