Run
7 emulators 954 tests
Results as of this run. The arrow shows each target's movement since the previous run it was tested in. The suite grew this run, so an upward arrow can be the new tests biting rather than a target getting worse.
When this run was published the board led with a single correctness percentage. The figures here are that run's own results restated as divergence and coverage, so they read differently from what this page showed at the time. The changelog has the change.
Suite grew from 873 to 954 tests this run.
That's 81 new tests measured against every target. Movement below compares to the previous run, so a rise here is as likely to be the stricter suite as a real regression.
-
Grade baselineground truth0.0%Divergence100.0%Coverage
no divergence in all 3 regions
Tier breakdown
Tier 1 · Core 0.0% diverges100.0% coveredTier 2 · Complete 0.0% diverges100.0% coveredTier 3 · Strict 0.0% diverges100.0% covered -
Grade Adiverged 0.6 percentage points more0.6%Divergence98.5%Coverage
low divergence (0.6%) in 2 regions · up to 0.9% in the other 1
Tier breakdown
Tier 1 · Core 0.0% diverges100.0% coveredTier 2 · Complete 0.6% diverges91.2% covered 14 unsupportedTier 3 · Strict 1.6% diverges100.0% covered -
Grade Bdiverged 1.1 percentage points more14.5%Divergence100.0%Coverage
moderate divergence (14.5%) in 2 regions · up to 14.6% in the other 1
Tier breakdown
Tier 1 · Core 10.9% diverges100.0% coveredTier 2 · Complete 12.6% diverges100.0% coveredTier 3 · Strict 20.6% diverges100.0% covered -
Grade Cdiverged 0.8 percentage points less15.0%Divergence99.2%Coverage
high divergence (15.0%) in all 3 regions
Tier breakdown
Tier 1 · Core 6.5% diverges100.0% coveredTier 2 · Complete 13.2% diverges95.0% covered 8 unsupportedTier 3 · Strict 28.4% diverges100.0% covered -
Grade Cdiverged 0.9 percentage points less16.1%Divergence98.6%Coverage
high divergence (16.1%) in all 3 regions
Tier breakdown
Tier 1 · Core 7.8% diverges100.0% coveredTier 2 · Complete 15.7% diverges91.8% covered 13 unsupportedTier 3 · Strict 28.7% diverges100.0% covered -
Grade Cdiverged 2.9 percentage points more16.1%Divergence95.5%Coverage
high divergence (16.1%) in 2 regions · up to 16.2% in the other 1
Tier breakdown
Tier 1 · Core 14.5% diverges100.0% coveredTier 2 · Complete 10.1% diverges73.0% covered 43 unsupportedTier 3 · Strict 21.6% diverges100.0% covered -
4f69631e5601 9 unsupported ; covers 99.1% of the suite
Runs via: Docker, Homebrew, install script, Scoop, binary, JAR
Grade Cdiverged 2.6 percentage points more17.7%Divergence99.1%Coveragehigh divergence (17.7%) in 2 regions · up to 17.8% in the other 1
Tier breakdown
Tier 1 · Core 8.6% diverges100.0% coveredTier 2 · Complete 22.6% diverges94.3% covered 9 unsupportedTier 3 · Strict 28.7% diverges100.0% covered -
Grade Cdiverged 0.5 percentage points less22.4%Divergence92.9%Coverage
high divergence (22.4%) in all 3 regions
Tier breakdown
Tier 1 · Core 8.6% diverges100.0% coveredTier 2 · Complete 49.7% diverges57.2% covered 68 unsupportedTier 3 · Strict 29.4% diverges100.0% covered