Skip to content

Run

7 emulators 954 tests

Results as of this run. The arrow shows each target's movement since the previous run it was tested in. The suite grew this run, so an upward arrow can be the new tests biting rather than a target getting worse.

When this run was published the board led with a single correctness percentage. The figures here are that run's own results restated as divergence and coverage, so they read differently from what this page showed at the time. The changelog has the change.

Suite grew from 873 to 954 tests this run.

That's 81 new tests measured against every target. Movement below compares to the previous run, so a rise here is as likely to be the stricter suite as a real regression.

Scored against 3 real regions. 1 dropped, out of scoring until it returns: ap-southeast-2
  1. live (AWS)

    Runs via: AWS service

    Grade baseline
    0.0%Divergence
    100.0%Coverage

    no divergence in all 3 regions

    ground truth
    Tier breakdown
    Tier 1 · Core 0.0% diverges
    100.0% covered
    Tier 2 · Complete 0.0% diverges
    100.0% covered
    Tier 3 · Strict 0.0% diverges
    100.0% covered
  2. Runs via: npx, Docker, Homebrew, binary, npm, cargo, embedded, GitHub Action, source

    Maintained by the board’s author

    Grade A
    0.6%Divergence
    98.5%Coverage

    low divergence (0.6%) in 2 regions · up to 0.9% in the other 1

    diverged 0.6 percentage points more
    Tier breakdown
    Tier 1 · Core 0.0% diverges
    100.0% covered
    Tier 2 · Complete 0.6% diverges
    91.2% covered 14 unsupported
    Tier 3 · Strict 1.6% diverges
    100.0% covered
  3. 0b5dba5153fc

    Runs via: pip, Docker, source

    Grade B
    14.5%Divergence
    100.0%Coverage

    moderate divergence (14.5%) in 2 regions · up to 14.6% in the other 1

    diverged 1.1 percentage points more
    Tier breakdown
    Tier 1 · Core 10.9% diverges
    100.0% covered
    Tier 2 · Complete 12.6% diverges
    100.0% covered
    Tier 3 · Strict 20.6% diverges
    100.0% covered
  4. Runs via: Docker, pip, Homebrew, binary

    Grade C
    15.0%Divergence
    99.2%Coverage

    high divergence (15.0%) in all 3 regions

    diverged 0.8 percentage points less
    Tier breakdown
    Tier 1 · Core 6.5% diverges
    100.0% covered
    Tier 2 · Complete 13.2% diverges
    95.0% covered 8 unsupported
    Tier 3 · Strict 28.4% diverges
    100.0% covered
  5. Grade C
    16.1%Divergence
    98.6%Coverage

    high divergence (16.1%) in all 3 regions

    diverged 0.9 percentage points less
    Tier breakdown
    Tier 1 · Core 7.8% diverges
    100.0% covered
    Tier 2 · Complete 15.7% diverges
    91.8% covered 13 unsupported
    Tier 3 · Strict 28.7% diverges
    100.0% covered
  6. Grade C
    16.1%Divergence
    95.5%Coverage

    high divergence (16.1%) in 2 regions · up to 16.2% in the other 1

    diverged 2.9 percentage points more
    Tier breakdown
    Tier 1 · Core 14.5% diverges
    100.0% covered
    Tier 2 · Complete 10.1% diverges
    73.0% covered 43 unsupported
    Tier 3 · Strict 21.6% diverges
    100.0% covered
  7. Runs via: Docker, Homebrew, install script, Scoop, binary, JAR

    Grade C
    17.7%Divergence
    99.1%Coverage

    high divergence (17.7%) in 2 regions · up to 17.8% in the other 1

    diverged 2.6 percentage points more
    Tier breakdown
    Tier 1 · Core 8.6% diverges
    100.0% covered
    Tier 2 · Complete 22.6% diverges
    94.3% covered 9 unsupported
    Tier 3 · Strict 28.7% diverges
    100.0% covered
  8. Grade C
    22.4%Divergence
    92.9%Coverage

    high divergence (22.4%) in all 3 regions

    diverged 0.5 percentage points less
    Tier breakdown
    Tier 1 · Core 8.6% diverges
    100.0% covered
    Tier 2 · Complete 49.7% diverges
    57.2% covered 68 unsupported
    Tier 3 · Strict 29.4% diverges
    100.0% covered