Skip to content

Run

7 emulators 601 tests

Results as of this run. The arrow shows each target's movement since the previous run it was tested in.

When this run was published the board led with a single correctness percentage. The figures here are that run's own results restated as divergence and coverage, so they read differently from what this page showed at the time. The changelog has the change.

What changed in the suite this run

Suite on

ExtendDB joined the run as a target. The suite itself held steady at 601 tests.

  1. live (AWS)

    Runs via: AWS service

    Grade baseline

    no divergence in all 33 regions · covers 100.0% of the suite

    ground truth
    Tier breakdown
    Tier 1 · Core 0.0% diverges
    100.0% covered
    Tier 2 · Complete 0.0% diverges
    100.0% covered
    Tier 3 · Strict 0.0% diverges
    100.0% covered
  2. 0.9.13

    Runs via: npx, Docker, Homebrew, binary, npm, cargo, embedded, GitHub Action, source

    Disclosure: maintained by this board's author

    Grade A+

    no divergence · covers 100.0% of the suite

    unchanged
    Tier breakdown
    Tier 1 · Core 0.0% diverges
    100.0% covered
    Tier 2 · Complete 0.0% diverges
    100.0% covered
    Tier 3 · Strict 0.0% diverges
    100.0% covered
  3. Grade A

    no divergence · covers 95.8% of the suite · coverage lowers this row to A

    new
    Tier breakdown
    Tier 1 · Core 0.0% diverges
    100.0% covered
    Tier 2 · Complete 0.0% diverges
    75.7% covered 25 unsupported
    Tier 3 · Strict 0.0% diverges
    100.0% covered
  4. latest (efa6922b024a)

    Runs via: Docker, Homebrew, install script, Scoop, binary, JAR

    Grade A

    low divergence (0.5%) · covers 100.0% of the suite

    diverged 36.6 percentage points less
    Tier breakdown
    Tier 1 · Core 0.3% diverges
    100.0% covered
    Tier 2 · Complete 1.9% diverges
    100.0% covered
    Tier 3 · Strict 0.0% diverges
    100.0% covered
  5. 2026.5.0:7f5189f61

    Runs via: Docker, pip, Homebrew, binary

    Grade B

    moderate divergence (11.0%) · covers 100.0% of the suite

    unchanged
    Tier breakdown
    Tier 1 · Core 1.0% diverges
    100.0% covered
    Tier 2 · Complete 3.9% diverges
    100.0% covered
    Tier 3 · Strict 30.3% diverges
    100.0% covered
  6. latest (d89f8fcc6b1a)

    Runs via: Docker, JAR, Maven

    Grade B

    moderate divergence (11.8%) · covers 100.0% of the suite

    unchanged
    Tier breakdown
    Tier 1 · Core 1.0% diverges
    100.0% covered
    Tier 2 · Complete 8.7% diverges
    100.0% covered
    Tier 3 · Strict 30.3% diverges
    100.0% covered
  7. Grade C

    moderate divergence (14.8%) · covers 92.8% of the suite · coverage lowers this row to C

    unchanged
    Tier breakdown
    Tier 1 · Core 1.7% diverges
    100.0% covered
    Tier 2 · Complete 48.5% diverges
    58.3% covered 43 unsupported
    Tier 3 · Strict 17.4% diverges
    100.0% covered
  8. latest (89d602080662)

    Runs via: pip, Docker, source

    Grade D

    very high divergence (31.6%) · covers 100.0% of the suite

    diverged 4.8 percentage points less
    Tier breakdown
    Tier 1 · Core 14.2% diverges
    100.0% covered
    Tier 2 · Complete 23.3% diverges
    100.0% covered
    Tier 3 · Strict 63.1% diverges
    100.0% covered