I've found this to be true for the past year or two now, and I was wondering if anyone has found a better solution than copying context to and from chatgpt.com. The "Pro" level (or whatever the max level is at the time) consistently has better insights than the agent, but immensely limited tool calling compared to the agent. Marrying the two of these together unlocks a lot of potential, but I really just want this intelligence to live on my laptop, instead of me being the intermediary.
verdverm•2h ago
I don't use Oai/Ant products or models, open weight absolutist that I am, but I would focus on your terminal workflows, custom tools, and repo context like AGENTS.md as a starting place. For tools, focus on moving deterministic workflows to scripts they can use, instead of having them do them differently each time based on markdown. You'll save yourself a lot of tokens and strife in the process.
qwerpy•1h ago
verdverm•1h ago
It's an iterative take-give, take away as much as you can so the bot can focus on the core task, then give some back to improve the agent output as you find repeated mistakes.
thechairman12•56m ago
Something is up.
verdverm•54m ago
> Something is up.
This is why open weights win. Deep transparency and the permissionless opportunity for anyone to investigate/benchmark is of primal importance to me. I'm not keen to have corporate-government (oligarchy) gatekeepers.
thechairman12•52m ago
verdverm•47m ago
Getting an OEM (DGX) Spark is good if you want complete control or an excellent learning environment. You can do much more than just run llms for tokens (which will be generated much slower). They have become much more pricey tho...
Kimi K3 is good at the high end, DS 4.1 flash is good, most flash models are sufficient (I typically start a task here), I like qwen 27B at the small end (dense is better than MoE at this size).
thechairman12•40m ago
I care the most about quality. It can be more expensive, and slower. My problems with the AIs are always intelligence related/effort related.
So I'm not sure if those smaller models you listed will be effective, given that I am having to turn to chatgpt.com's Pro to get quality answers.
Interested in Kimi & DS