This paper puts words to something I’ve noticed repeatedly with LLMs, particularly Qwen3.6. When I read its reasoning, it appears to recognise the mistake and then carry on as if it hadn’t noticed it at all.
> models often determine their answers based on implicit biases tied to question templates, then construct reasoning chains to justify their predetermined conclusions
> its reasoning was correct right until the final step (Yes/No answer)
Georgelemental•3m ago
Natural intelligences do this too
kibwen•5m ago
"Study: Communing With The Gods of Mount Olympus Via the Oracle at Delphi Is Not Always Faithful"
josefritzishere•3m ago
I don't think this is using the term "reasoning" correct. This is a fallacy. It's a word guessing machine. Even the "why" is expressed non-deterministically.
florianherrengt•33m ago
> models often determine their answers based on implicit biases tied to question templates, then construct reasoning chains to justify their predetermined conclusions > its reasoning was correct right until the final step (Yes/No answer)
Georgelemental•3m ago