> We used ChatGPT-4o to generate the LLM-generated prompts, while UK-based lawyers generated the lawyer-generated advice
It would have been nice to also have layers assess the LLM output...
bufferoverflow•9mo ago
Would be good to know if ChatGPT is better or worse than an average lawyer. I'd bet when it comes to a bit more obscure law knowledge, it's unbeatable.
treetalker•9mo ago
Not a chance at the moment, and not for the future as far as I can see it.
mdp2021•9mo ago
The results in an image: https://dl.acm.org/cms/10.1145/3706598.3713470/asset/95dbaf8...
--
From the actual paper ( https://dl.acm.org/doi/10.1145/3706598.3713470 ):
> We used ChatGPT-4o to generate the LLM-generated prompts, while UK-based lawyers generated the lawyer-generated advice
It would have been nice to also have layers assess the LLM output...