Linked is a high level walkthrough of a benchmark we're releasing that puts any agent in the role of a hedge fund manager during a financial crisis.
Markets are procedurally generated and agents are scored against a well optimized algorithm. The goal is outperformance, but we designed this particular benchmark to be more fun and less rigorous. Just point any agent at it and go.
Design of these markets was mostly based on market data from the '08 financial crisis, dotcom bubble, and COVID crash.
Our team uses these same generators and similar scoring patterns to evaluate our own models / agents for market making, trading, and risk management. You can use them for RLVR and autoresearch on markets generally speaking as well.
Free and easy to get started - reach out to me on X or at bebis@uvlabs.ai for more :)
bebis1•42m ago
Markets are procedurally generated and agents are scored against a well optimized algorithm. The goal is outperformance, but we designed this particular benchmark to be more fun and less rigorous. Just point any agent at it and go.
Design of these markets was mostly based on market data from the '08 financial crisis, dotcom bubble, and COVID crash.
Our team uses these same generators and similar scoring patterns to evaluate our own models / agents for market making, trading, and risk management. You can use them for RLVR and autoresearch on markets generally speaking as well.
Free and easy to get started - reach out to me on X or at bebis@uvlabs.ai for more :)