Just like LLM coding has massive problems with code security and general bugginess, LLM legal analysis and synthesis is (and will be) plagued with BS: incorrect findings, hallucinated citations, and so on. The client will bear the court's wrath when the contract is invalidated or pleadings are dicovered to be BS. There is no legal sanction for crap software. There is for crap legalese.
It's tempting to go after the law, but for anything important, you need an actual human brain. Fallible as it is, it's not just a pattern-predictor, it has a world model and understands people.
Could shake out rather like coding, where senior attorneys review and debug LLM output while junior positions wither.
I say that with no love for, or contempt for, the legal profession.
quantified•5mo ago
It's tempting to go after the law, but for anything important, you need an actual human brain. Fallible as it is, it's not just a pattern-predictor, it has a world model and understands people.
Could shake out rather like coding, where senior attorneys review and debug LLM output while junior positions wither.
I say that with no love for, or contempt for, the legal profession.