Has there been any actual head to head comparison of this using frontier models? Any benchmarks that purport to measure this?
Has there been any actual head to head comparison of this using frontier models? Any benchmarks that purport to measure this?
Conclusion: Elixir was the best (had the highest problem solve rate).
Reasons (Theo's interpretation):
- code collocation, where documentation is integrated directly within the source code
- design philosophy of a language (readability, clear idioms, and strict expectation management)
---
Sources from video:
- https://github.com/Tencent-Hunyuan/AutoCodeBenchmark/tree/ma...
- https://martinalderson.com/posts/which-programming-languages...
- https://simonwillison.net/2026/Jan/19/nanolang/#atom-everyth...
steveklabnik•1h ago
mwigdahl•1h ago
steveklabnik•1h ago
I’ve seen a lot of blog posts with fairly dubious claims here with relatively flimsy evidence. And I’ve seen a few papers trying to tackle the topic. But I think it’s a very open area of research currently.