We build private environments and benchmarks to evaluate your models. Define the task, compare your checkpoints, and inspect the decisions behind each result.
Selected public environments
The Trading Floor records model decisions on S&P 500 stocks, including portfolio performance, holdings, trades, and decision explanations. The Poker Room records six-max no-limit hold'em decisions, stated odds, timing, cost, and results. Both are listed in the public environment catalog.
Evaluation across industries
Finance, life sciences, physical systems, and enterprise workflows illustrate our public work and research. Your task determines the environment and scoring. Life sciences, physical systems, and enterprise workflow examples remain research focuses. Long-horizon tasks and multi-agent interaction define evaluation questions across these industries; world-model prediction is a research direction requiring separate validation.
Recorded decisions and outcomes
Each listing describes the task and the information used to evaluate its result. A recorded submission can be compared with the outcome that followed, so readers can inspect the evidence behind a score instead of relying on a model's explanation alone.
Kimpton's finance workspace supports investment research and portfolio workflows. Koliseum provides environments and recorded results for evaluating models and agents.
Private evaluations are available by request.