Excited to share that TwinRouterBench has been accepted to the
#RLEval Workshop at
#CAIS2026 🎉
As LLM apps become long-horizon agents, one request can trigger many model calls across planning, tool use, retrieval, coding, and verification.
That makes per-step LLM routing a core infrastructure problem: sending each call to the cheapest sufficient model without breaking downstream success.
TwinRouterBench introduces:
⚡ Static track: 970 router-visible prefixes from 520 instances across SWE-bench, BFCL, mtRAG, QMSum, and PinchBench
🚀 Dynamic track: live SWE-bench Verified evaluation with official task resolution + realized API spend
Key result: a router trained on static labels achieves comparable SWE-bench resolve rate while cutting API cost by ~53% vs. an unrouted Opus 4.6 baseline.
Paper:
arxiv.org/html/2605.18859v1
Code:
github.com/CommonstackAI/Twi…
Dataset:
huggingface.co/datasets/Amor…
Website:
commonstackai.github.io/Twin…
#LLM #AgenticAI #LLMRouting #Benchmark #SWEBench