Has there been any actual head to head comparison of this using frontier models? Any benchmarks that purport to measure this?
Has there been any actual head to head comparison of this using frontier models? Any benchmarks that purport to measure this?
steveklabnik•1h ago
mwigdahl•1h ago
steveklabnik•45m ago
I’ve seen a lot of blog posts with fairly dubious claims here with relatively flimsy evidence. And I’ve seen a few papers trying to tackle the topic. But I think it’s a very open area of research currently.