Skip to content

Run

10 emulators 1,678 tests

Results as of this run. The arrow shows each target's movement since the previous run it was tested in.

What changed in the suite this run

Suite on

Query's XOR ConditionalOperator beside an unknown Select is now pinned to the older enum wording, Value 'XOR' at 'conditionalOperator' ... [AND, OR]. eu-west-2 and us-east-1 gave the bare [ALL, OR] form when the test was written on 2026-10-09, and the weekly run on 2026-11-01 went red when eu-west-2 had moved. Twenty requests to each region on 2026-11-02 all gave the older wording.

Scored against 32 real regions. 2 dropped, out of scoring until it returns: me-central-1, me-south-1
  1. live (AWS)

    Runs via: AWS service

    Grade baseline
    0.0%Divergence
    100.0%Coverage

    no divergence in all 32 regions

    ground truth
    Tier breakdown
    Tier 1 · Core 0.0% diverges
    100.0% covered
    Tier 2 · Complete 0.0% diverges
    100.0% covered
    Tier 3 · Strict 0.0% diverges
    100.0% covered
  2. 71b13e204507

    Runs via: pip, Docker, source

    Grade A
    0.1%Divergence
    100.0%Coverage

    low divergence (0.1%) in 11 regions · up to 0.4% in the other 21

    diverged 0.1 percentage points more
    Tier breakdown
    Tier 1 · Core 0.0% diverges
    100.0% covered
    Tier 2 · Complete 0.2% diverges
    100.0% covered
    Tier 3 · Strict 0.1% diverges
    100.0% covered
  3. Runs via: npx, Docker, Homebrew, binary, npm, cargo, embedded, GitHub Action, source

    Maintained by the board’s author

    Grade A
    2.0%Divergence
    99.2%Coverage

    low divergence (2.0%) in 21 regions · up to 2.3% in the other 11

    unchanged
    Tier breakdown
    Tier 1 · Core 0.0% diverges
    100.0% covered
    Tier 2 · Complete 0.0% diverges
    96.9% covered 14 unsupported
    Tier 3 · Strict 4.7% diverges
    100.0% covered
    Also built for WebAssembly / OPFS
    • Grade B

      low divergence (1.3%) in 21 regions · up to 1.5% in the other 11 · covers 87.8% · coverage lowers this row to B

  4. Runs via: Docker, Homebrew, install script, Scoop, binary, JAR

    Grade B
    9.3%Divergence
    99.8%Coverage

    moderate divergence (9.3%) in 21 regions · up to 9.6% in the other 11

    diverged 5.1 percentage points less
    Tier breakdown
    Tier 1 · Core 0.0% diverges
    100.0% covered
    Tier 2 · Complete 0.0% diverges
    99.1% covered 4 unsupported
    Tier 3 · Strict 21.4% diverges
    100.0% covered
  5. Grade C
    10.1%Divergence
    70.0%Coverage

    moderate divergence (10.1%) in 11 regions · up to 10.4% in the other 21

    coverage lowers this row to C

    unchanged
    Tier breakdown
    Tier 1 · Core 0.0% diverges
    100.0% covered
    Tier 2 · Complete 2.7% diverges
    28.8% covered 322 unsupported
    Tier 3 · Strict 21.7% diverges
    75.0% covered 182 unsupported
    Also built for SQLite
    • SQLite
      Grade C

      moderate divergence (10.6%) in 11 regions · up to 10.9% in the other 21 · covers 73.4% · coverage lowers this row to C

  6. Runs via: Docker, pip, Homebrew, binary

    Grade C
    19.5%Divergence
    95.6%Coverage

    high divergence (19.5%) in 11 regions · up to 19.8% in the other 21

    unchanged
    Tier breakdown
    Tier 1 · Core 0.2% diverges
    100.0% covered
    Tier 2 · Complete 13.5% diverges
    89.6% covered 47 unsupported
    Tier 3 · Strict 36.5% diverges
    96.4% covered 26 unsupported
  7. Grade D
    24.8%Divergence
    95.3%Coverage

    high divergence (24.8%) in all 32 regions

    coverage lowers this row to D

    unchanged
    Tier breakdown
    Tier 1 · Core 7.6% diverges
    100.0% covered
    Tier 2 · Complete 11.9% diverges
    86.5% covered 61 unsupported
    Tier 3 · Strict 44.4% diverges
    97.5% covered 18 unsupported
  8. Grade D
    12.6%Divergence
    57.9%Coverage

    moderate divergence (12.6%) in 11 regions · up to 12.8% in the other 21

    coverage lowers this row to D

    unchanged
    Tier breakdown
    Tier 1 · Core 11.1% diverges
    100.0% covered
    Tier 2 · Complete 6.2% diverges
    8.8% covered 412 unsupported
    Tier 3 · Strict 17.6% diverges
    59.5% covered 295 unsupported
  9. Runs via: Docker, binary, source

    Grade F
    44.4%Divergence
    69.7%Coverage

    severe divergence (44.4%) in all 32 regions

    unchanged
    Tier breakdown
    Tier 1 · Core 47.3% diverges
    100.0% covered
    Tier 2 · Complete 13.1% diverges
    27.9% covered 326 unsupported
    Tier 3 · Strict 61.9% diverges
    75.0% covered 182 unsupported