Run
7 emulators 655 tests
Results as of this run. The arrow shows each target's movement since the previous run it was tested in. The suite grew this run, so an upward arrow can be the new tests biting rather than a target getting worse.
When this run was published the board led with a single correctness percentage. The figures here are that run's own results restated as divergence and coverage, so they read differently from what this page showed at the time. The changelog has the change.
Suite grew from 625 to 655 tests this run.
That's 30 new tests measured against every target. Movement below compares to the previous run, so a rise here is as likely to be the stricter suite as a real regression.
-
Grade baselineground truth0.0%Divergence100.0%Coverage
no divergence in all 33 regions
Tier breakdown
Tier 1 · Core 0.0% diverges100.0% coveredTier 2 · Complete 0.0% diverges100.0% coveredTier 3 · Strict 0.0% diverges100.0% covered -
Grade Adiverged 1.7 percentage points more3.8%Divergence100.0%Coverage
Tier breakdown
Tier 1 · Core 3.9% diverges100.0% coveredTier 2 · Complete 5.5% diverges100.0% coveredTier 3 · Strict 2.8% diverges100.0% covered -
Grade Bdiverged 1.7 percentage points more5.2%Divergence100.0%Coverage
Tier breakdown
Tier 1 · Core 4.5% diverges100.0% coveredTier 2 · Complete 7.3% diverges100.0% coveredTier 3 · Strict 5.2% diverges100.0% covered -
Grade Bdiverged 2.0 percentage points more5.0%Divergence95.9%Coverage
Tier breakdown
Tier 1 · Core 5.7% diverges100.0% coveredTier 2 · Complete 3.6% diverges75.5% covered 27 unsupportedTier 3 · Strict 4.7% diverges100.0% covered -
Grade Bdiverged 0.4 percentage points more12.1%Divergence100.0%Coverage
Tier breakdown
Tier 1 · Core 1.5% diverges100.0% coveredTier 2 · Complete 7.3% diverges100.0% coveredTier 3 · Strict 31.3% diverges100.0% covered -
Grade Bdiverged 0.3 percentage points more12.8%Divergence100.0%Coverage
Tier breakdown
Tier 1 · Core 1.5% diverges100.0% coveredTier 2 · Complete 11.8% diverges100.0% coveredTier 3 · Strict 31.3% diverges100.0% covered -
Grade Cdiverged 0.6 percentage points more14.8%Divergence93.1%Coverage
coverage lowers this row to C
Tier breakdown
Tier 1 · Core 2.1% diverges100.0% coveredTier 2 · Complete 49.1% diverges59.1% covered 45 unsupportedTier 3 · Strict 17.1% diverges100.0% covered -
Grade Ddiverged 0.6 percentage points more34.5%Divergence100.0%Coverage
Tier breakdown
Tier 1 · Core 18.0% diverges100.0% coveredTier 2 · Complete 27.3% diverges100.0% coveredTier 3 · Strict 64.5% diverges100.0% covered