NullspanBench — Decision & Extraction Model Leaderboard

Following the Benchmark Heaven (JevBench) evaluation protocol: comparing 14 systems across Intelligence (I), Probability Calibration (C), Speed (S), and Cost (K) over 404 scored observations (S+P) spanning Open structured extraction (n=336) and Sealed Stanford SQuAD v2.0 + Adversarial prompt-injection traps (n=68).

Pool Filter:

1. NullspanBench Capability Score · Mean of Intelligence (I) & Calibration (C) 95% Bootstrap CIs (B=1,000) · S+P Pool

2. Pareto Frontier: Capability Against Cost & Speed Upper-Right is Best (More Capable & Cheaper / Faster)

Capability vs Cost ($ / 1,000 Decisions · Log Scale)

Encoders generate 0 output tokens; autoregressive API decoders pay per generated JSON token.

Capability vs Speed (p50 Latency ms / Decision · Log Scale)

Bubble size follows the official Composite Score; dashed line traces the Pareto-optimal frontier.

3. Composite Score Leaderboard · Four Axes (0–100) Weighted Harmonic Mean 14 Ranked Systems

Weights:

Intelligence (I): 25%

Calibration (C): 25%

Speed (S): 25%

Cost (K): 25%

# ▲	System ↕	Architecture / Runtime ↕	Composite ↕	Cap. ↕	Intel. (I) ↕	Calib. (C) ↕	Speed (S) ↕	Cost (K) ↕	$/1k dec. ↕	p50 ms ↕	Null ECE ↕	Open (S) ↕	Sealed (P) ↕

4. Compare Two Systems · Multi-Axis Radar Diagnostics Four Axes · Request Types · Difficulty Tiers · Subject Domains

■ System A:

● System B:

The Four Score Axes (0–100)

Competence per Request Type (Open / Sealed)

Competence per Difficulty Tier (Open & Sealed)

Competence by Subject Domain / Use Case

5. Competence Heatmap by Request Type, Difficulty Tier & Subject Domain Greener = Stronger Within Column · Exact Observation Counts (n=404)

System	Span (Open)	Span (Sealed)	Noul / p_null (Open)	Noul / p_null (Sealed)	Choice (Bool/Enum)	Math & Invariants	Score (Quantiles)	Tier: Easy	Tier: Standard	Tier: Judge	Tier: Hard	SRE Incident	Cloud Invoice	SQuAD v2.0 QA	Adversarial