Repository navigation
Leaderboard: re-price every router at OpenRouter's 2026-10-31 prices - #262
Merged
Merged
Conversation
Ran scripts/pricing/reprice.py --all --write on main, whose price table (#218, #250) now holds OpenRouter's list prices of 2026-10-31. Only cost values change in the prediction files; accuracy is not re-graded. The README rows of the 23 routers with prediction files are updated (Arena, Cost/1K, optimality columns) and the table re-ranked. External baseline rows keep their published numbers. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This was referenced Oct 31, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Re-prices every leaderboard router at OpenRouter's list prices of 2026-10-31, the price table now on
main(#218, #250). Made withscripts/pricing/reprice.py --all --write(#261).Changes (rows that moved)
BizRouter (#2, 77.08) and Chayan are unchanged.
What drives it:
deepseek-v4-prowas entered at its launch discount ($0.435/$0.87) and OpenRouter now lists $1.60/$3.20. This moves Weave, vLLM‑SR and Cross-Router.qwen3-235b-a22b-2507output goes from $0.10 to $0.55. This moves Hybrid, cruq and Auto Router.claude-opus-4-7was charged an older Opus price ($15/$75) against $5/$25. This moves AsiaInfo.gemma-4-31b-itgoes from $0.08/$0.35 to $0.20/$0.40. This moves KT-ModelRouter.Optimality columns move too. Opt.Sel and Opt.Cost compare each pick with the cheapest correct candidate, and the new prices change which candidate that is. Hybrid Router's Opt.Sel goes from 89.87 to 16.67 because qwen3-235b is no longer the cheapest. Opt.Acc doesn't depend on price.
Not included yet: DT-Router (#241) and Corealis (#235). Both routers make model calls of their own that aren't charged yet: DT-Router's LingDT drafts and judging calls, and Corealis's router model. Their rows come once they report those calls in
router_usage(#251).🤖 Generated with Claude Code