They are language prediction models, not logical deduction engines.
It says so right in the name. Expecting logic or reason or decision making is a gross mis-application.
Ianjit•1h ago
My impression from Tao’s answers is that there is a gulf between the reality of what mathematicians actually do and the benchmarks that the frontier labs tout. It doesn’t seem trivial to close that gap and create an LLM that can replace mathematicians.
jk2444•30m ago
Why do you sound surprised by this?
"there is a gulf between the reality of what mathematicians actually do and the benchmarks that the frontier labs tout."
A lot of peoples wealth is on the line, I wish people opened their eyes rather than believing benchmarks blindly.
jqpabc123•2h ago
They are language prediction models, not logical deduction engines.
It says so right in the name. Expecting logic or reason or decision making is a gross mis-application.
Ianjit•1h ago
jk2444•30m ago
"there is a gulf between the reality of what mathematicians actually do and the benchmarks that the frontier labs tout."
A lot of peoples wealth is on the line, I wish people opened their eyes rather than believing benchmarks blindly.