I've seen GPT 5.6 Sol happily invoke objdump and even write jobs to run headlessly which Ghidra when trying to disassemble a binary.
A nice thing about running locally is you can run an uncensored model and you don’t have to worry about TOS violations on your OpenAI account when you ask it to “reverse engineer this ancient router firmware and give me a licence key that will work on it”.
A lot of tasks which need a bit of intelligence don't really need that much compute. Just good enough documentation / skills, tool calling and a good enough local model.
Not sure what exactly this means for all those data centers that are getting built... But exciting times.
This seems to be a pattern in the more recently released models that I think accounts for an increase in the quality of their work. They are very persistent in verifying that their work is actually correct, so even if they're not as "smart" as bigger models that get it right the first time, they have the ability to follow through to ensure that the work is actually done.
> And this was a debug session from hell, enormously helped by an AI doing much of the grunt-work.
> I'd like to call it my tireless helper, but the AI several times stated flat out that this was impossible and unsolvable and that we should just write a report about it.
> I suspect those things have been trained by people who may not be quite as stubborn as I am.
https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/lin...
Either we are in command over the software, or the corp is in command over us via the software. I can on a theoretical level understand the concerns, but either we ban all LLMs or we have a level playing field for everybody. Let's not forget: defense and offense are different sides of the same coin in software. I guess this wouldn't apply to bio weapons, but I am not in the know about that.
"It will comply with harmful, unethical, offensive, or illegal requests that the original Qwen3.8-27B would refuse. It has no meaningful built-in guardrails."
Surely this has unintended side effects on output quality?
I visualized this with Qwen 3 4B [0] and Sonnet [1] so that people can very easily grok what you mean by "the ability to follow through." What is key about the reasoning tokens is that they will form a pattern of verification tokens in the sequence which, has been shown, will develop in RL training purely without the supervised fine tuning (SFT) which is used to make the output human readable.
RobertasTa•35m ago
Two things surprised me along the way. The defaults differ by stack: llama.cpp's chat template defaults to xhigh while Ollama lands closer to medium, so how much Qwen "overthinks" partly depends on your runtime. And the model card recommends different sampling per mode (temp 1.0 thinking vs 0.7 non-thinking with presence penalty), which almost nobody adjusts when toggling thinking off.
Funny detail: with thinking fully off, my agent harness compensated by just running more tool calls — and still landed the correct fix.