deterministic LLMs - what are they good for? do we need them? someone explain ...
Comments
handfuloflight•6h ago
Prompt: "Output a name of one of the states of the United States."
It will not tell me the names of the planets. Or the names of prescription drugs.
Why is this level of determinism not enough?
theGeatZhopa•6h ago
at some point one might need determined responses. RAG & Law, or in certain situations, where RAG is done on f.e. legal or some constraints are in hold. LLMs shouldn't respond non-deterministic then.
But this is solveable without deterministic AI. Nonetheless, to have some deterministic AI would solve some pain in some areas you & me not work in, but others.. ;)
handfuloflight•5h ago
I also work in those situations and I don't see how prompting with a grounded context isn't giving the determinism needed?
rvz•5h ago
Of course we do.
Reliability is more valuable than anything.
Would you want the AI system to mistake the sun for a yellow warning sign whilst you are driving on the highway?
handfuloflight•6h ago
It will not tell me the names of the planets. Or the names of prescription drugs.
Why is this level of determinism not enough?
theGeatZhopa•6h ago
But this is solveable without deterministic AI. Nonetheless, to have some deterministic AI would solve some pain in some areas you & me not work in, but others.. ;)
handfuloflight•5h ago