Skip to content

Run

7 emulators 655 tests

Results as of this run. The arrow shows each target's movement since the previous run it was tested in. The suite grew this run, so an upward arrow can be the new tests biting rather than a target getting worse.

When this run was published the board led with a single correctness percentage. The figures here are that run's own results restated as divergence and coverage, so they read differently from what this page showed at the time. The changelog has the change.

Suite grew from 625 to 655 tests this run.

That's 30 new tests measured against every target. Movement below compares to the previous run, so a rise here is as likely to be the stricter suite as a real regression.

  1. live (AWS)

    Runs via: AWS service

    Grade baseline

    no divergence in all 33 regions · covers 100.0% of the suite

    ground truth
    Tier breakdown
    Tier 1 · Core 0.0% diverges
    100.0% covered
    Tier 2 · Complete 0.0% diverges
    100.0% covered
    Tier 3 · Strict 0.0% diverges
    100.0% covered
  2. 0.9.13

    Runs via: npx, Docker, Homebrew, binary, npm, cargo, embedded, GitHub Action, source

    Disclosure: maintained by this board's author

    Grade A

    low divergence (3.8%) · covers 100.0% of the suite

    diverged 1.7 percentage points more
    Tier breakdown
    Tier 1 · Core 3.9% diverges
    100.0% covered
    Tier 2 · Complete 5.5% diverges
    100.0% covered
    Tier 3 · Strict 2.8% diverges
    100.0% covered
  3. Grade B

    moderate divergence (5.0%) · covers 95.9% of the suite

    diverged 2.0 percentage points more
    Tier breakdown
    Tier 1 · Core 5.7% diverges
    100.0% covered
    Tier 2 · Complete 3.6% diverges
    75.5% covered 27 unsupported
    Tier 3 · Strict 4.7% diverges
    100.0% covered
  4. e981a5afd790

    Runs via: Docker, Homebrew, install script, Scoop, binary, JAR

    Grade B

    moderate divergence (5.2%) · covers 100.0% of the suite

    diverged 1.7 percentage points more
    Tier breakdown
    Tier 1 · Core 4.5% diverges
    100.0% covered
    Tier 2 · Complete 7.3% diverges
    100.0% covered
    Tier 3 · Strict 5.2% diverges
    100.0% covered
  5. 2026.5.0

    Runs via: Docker, pip, Homebrew, binary

    Grade B

    moderate divergence (12.1%) · covers 100.0% of the suite

    diverged 0.4 percentage points more
    Tier breakdown
    Tier 1 · Core 1.5% diverges
    100.0% covered
    Tier 2 · Complete 7.3% diverges
    100.0% covered
    Tier 3 · Strict 31.3% diverges
    100.0% covered
  6. d89f8fcc6b1a

    Runs via: Docker, JAR, Maven

    Grade B

    moderate divergence (12.8%) · covers 100.0% of the suite

    diverged 0.3 percentage points more
    Tier breakdown
    Tier 1 · Core 1.5% diverges
    100.0% covered
    Tier 2 · Complete 11.8% diverges
    100.0% covered
    Tier 3 · Strict 31.3% diverges
    100.0% covered
  7. Grade C

    moderate divergence (14.8%) · covers 93.1% of the suite · coverage lowers this row to C

    diverged 0.6 percentage points more
    Tier breakdown
    Tier 1 · Core 2.1% diverges
    100.0% covered
    Tier 2 · Complete 49.1% diverges
    59.1% covered 45 unsupported
    Tier 3 · Strict 17.1% diverges
    100.0% covered
  8. dcce0eaa8bff

    Runs via: pip, Docker, source

    Grade D

    very high divergence (34.5%) · covers 100.0% of the suite

    diverged 0.6 percentage points more
    Tier breakdown
    Tier 1 · Core 18.0% diverges
    100.0% covered
    Tier 2 · Complete 27.3% diverges
    100.0% covered
    Tier 3 · Strict 64.5% diverges
    100.0% covered