Predicting a market’s next move is a different skill from predicting an actual outcome, and Numinous (SN6) had been grading miners mostly on the first one.
The subnet published a scoring overhaul that keeps every forecast live from day seven until the event resolves, with the grade updating daily against whatever price the market currently shows.
Miners now get progressively tested against the truth as it comes into focus rather than judged on a single week-old snapshot forever.
The leaderboard becomes a rolling mark-to-market view of every open prediction across the entire miner population.
What Changed
The design difference between the old scoring rule and the new one is at the heart of everything the overhaul produces.
| Dimension | Old Scoring | New Scoring |
| When forecasts get graded | Once, at day seven | Every day from day seven until resolution |
| What each grade measures | Market price at day seven | Whatever price the market shows on that day |
| Final grade at event resolution | Ignored entirely | Equals the true difficulty-adjusted Brier score |
| Leaderboard behaviour | Frozen totals of week-old scores | Live mark-to-market of every open forecast |
| Score target over time | Never changes after day seven | Sharpens as the market absorbs more information |
The stale snapshot got replaced by a continuous grading pipeline that converges toward outcome truth.
Why the Change Matters
The design tension every forecasting subnet faces is whether to reward immediate signal or eventual accuracy, and Numinous just picked accuracy.
| What Improves | Effect on Miners |
| Genuine forecasting skill | Outranks market-timing skill because being right about the outcome carries more weight than anticipating short-term herd behaviour |
| Resistance to arbitrage | Private information advantage narrows every day the forecast stays open, since the market absorbs whatever edge miners started with |
| Honesty of the incentive | Optimal report at every horizon remains a miner’s true belief about the outcome, keeping the mechanism gameable-resistant |
| Uncertainty profile | New source appears from unresolved events, adding mark-to-market volatility on top of sampling uncertainty from forecast count |
Skill compounds very well under this system while short-term gaming produces diminishing returns as events approach resolution.
Grading That Follows the Truth
Forecasting subnets that measure the wrong signal train miners to optimize for the wrong outcome. Numinous just closed that loop by keeping every forecast open until the underlying event resolves.
The leaderboard now delivers what the subnet always promised its buyers: rankings measured against outcomes rather than proxies.
That change should attract exactly the kind of quantitative forecaster the subnet needs to reach commercial scale.
More on Numinous (SN6) below:
Enjoyed this article? Join our newsletter
Get the latest TAO & Bittensor news straight to your inbox.
We respect your privacy. Unsubscribe anytime.
Enjoyed this article?
Join our newsletter
Get the latest TAO & Bittensor news straight to your inbox — every morning before markets open.
No comments yet — be the first.