> Why, then, do MCP interfaces have to "dumb it down"? Writing code and calling tools are almost the same thing, but it seems like LLMs can do one much better than the other?
> The answer is simple: LLMs have seen a lot of code. They have not seen a lot of "tool calls". In fact, the tool calls they have seen are probably limited to a contrived training set constructed by the LLM's own developers, in order to try to train it. Whereas they have seen real-world code from millions of open source projects.
I am curious: Is this a generally agreed upon fact or an assumption/conjecture?
We actually didn't know about the research when we started working on this but it seems to match our findings.
janpio•18m ago
Thanks, pretty solid basis then.
freigeist79•1h ago
you stole my idea seriously, i think it works so well because typescript is very clear in .. well type definitions. the llm can't get lost so fast between function calls because it understands exactly what data structures goes in and out.
janpio•1h ago
> The answer is simple: LLMs have seen a lot of code. They have not seen a lot of "tool calls". In fact, the tool calls they have seen are probably limited to a contrived training set constructed by the LLM's own developers, in order to try to train it. Whereas they have seen real-world code from millions of open source projects.
I am curious: Is this a generally agreed upon fact or an assumption/conjecture?
kentonv•57m ago
We actually didn't know about the research when we started working on this but it seems to match our findings.
janpio•18m ago