It is inspired by Simon Willison's benchmark writeups[0], basically you can recreate them in one go.
Besides text and images, it supports SVG outputs and whole static websites, which is where benchmarks get the most interesting.
Additionally, I added the ability to alter chat history for the chat completion API, which I think is useful for model red teaming (or if you just want to see how different models apologize) - but I haven't found any impressive uses of that feature yet.
This thing helped me improve my intuition on different SOTA models' strengths and weaknesses; check out the various examples on the website, and feel free to create your own