Run
7 emulators 998 tests
Results as of this run. The arrow shows each target's movement since the previous run it was tested in. The suite grew this run, so an upward arrow can be the new tests biting rather than a target getting worse.
When this run was published the board led with a single correctness percentage. The figures here are that run's own results restated as divergence and coverage, so they read differently from what this page showed at the time. The changelog has the change.
Suite grew from 982 to 998 tests this run.
That's 16 new tests measured against every target. Movement below compares to the previous run, so a rise here is as likely to be the stricter suite as a real regression.
-
Grade baselineground truth
no divergence in all 33 regions · covers 100.0% of the suite
Tier breakdown
Tier 1 · Core 0.0% diverges100.0% coveredTier 2 · Complete 0.0% diverges100.0% coveredTier 3 · Strict 0.0% diverges100.0% covered -
Runs via: npx, Docker, Homebrew, binary, npm, cargo, embedded, GitHub Action, source
Disclosure: maintained by this board's author
Grade Bdiverged 1.5 percentage points moremoderate divergence (5.2%) · covers 98.6% of the suite
Tier breakdown
Tier 1 · Core 0.2% diverges100.0% coveredTier 2 · Complete 20.6% diverges93.0% covered 14 unsupportedTier 3 · Strict 3.1% diverges100.0% covered -
Grade Cdiverged 0.2 percentage points less
high divergence (15.3%) · covers 91.3% of the suite
Tier breakdown
Tier 1 · Core 14.5% diverges100.0% coveredTier 2 · Complete 8.0% diverges58.3% covered 83 unsupportedTier 3 · Strict 21.0% diverges98.8% covered 4 unsupported -
Grade Cdiverged 1.0 percentage points more
high divergence (15.7%) · covers 99.2% of the suite
Tier breakdown
Tier 1 · Core 6.5% diverges100.0% coveredTier 2 · Complete 18.1% diverges96.0% covered 8 unsupportedTier 3 · Strict 27.8% diverges100.0% covered -
Grade Cdiverged 0.9 percentage points more
high divergence (16.8%) · covers 98.7% of the suite
Tier breakdown
Tier 1 · Core 7.8% diverges100.0% coveredTier 2 · Complete 20.1% diverges93.5% covered 13 unsupportedTier 3 · Strict 28.1% diverges100.0% covered -
Grade Cdiverged 1.3 percentage points more
high divergence (18.0%) · covers 100.0% of the suite
Tier breakdown
Tier 1 · Core 10.9% diverges100.0% coveredTier 2 · Complete 29.6% diverges100.0% coveredTier 3 · Strict 21.3% diverges100.0% covered -
d2ecc8035822 9 unsupported ; covers 99.1% of the suite
Runs via: Docker, Homebrew, install script, Scoop, binary, JAR
Grade Cdiverged 1.3 percentage points morehigh divergence (20.9%) · covers 99.1% of the suite
Tier breakdown
Tier 1 · Core 8.6% diverges100.0% coveredTier 2 · Complete 36.7% diverges95.5% covered 9 unsupportedTier 3 · Strict 29.3% diverges100.0% covered -
Grade Ddiverged 0.1 percentage points less
high divergence (21.3%) · covers 88.8% of the suite · coverage lowers this row to D
Tier breakdown
Tier 1 · Core 8.6% diverges100.0% coveredTier 2 · Complete 39.7% diverges45.7% covered 108 unsupportedTier 3 · Strict 28.7% diverges98.8% covered 4 unsupported