Run
7 emulators 706 tests
Results as of this run. The arrow shows each target's movement since the previous run it was tested in. The suite grew this run, so an upward arrow can be the new tests biting rather than a target getting worse.
When this run was published the board led with a single correctness percentage. The figures here are that run's own results restated as divergence and coverage, so they read differently from what this page showed at the time. The changelog has the change.
Suite grew from 699 to 706 tests this run.
That's 7 new tests measured against every target. Movement below compares to the previous run, so a rise here is as likely to be the stricter suite as a real regression.
What changed in the suite this run
Suite on
Grew to 706 tests, up 7, tightening secondary-index behaviour in Tier 1. Query and Scan on a GSI or LSI now assert sparse membership: an item that omits the index key stays off the index but remains on the base table. And PutItem now rejects an item whose GSI or LSI key value is the wrong type, non-scalar, or an empty string while the base-table keys are valid, holding an index key to its declared scalar type the same way a table key is held.
-
Grade baselineground truth
no divergence in all 33 regions · covers 100.0% of the suite
Tier breakdown
Tier 1 · Core 0.0% diverges100.0% coveredTier 2 · Complete 0.0% diverges100.0% coveredTier 3 · Strict 0.0% diverges100.0% covered -
Runs via: npx, Docker, Homebrew, binary, npm, cargo, embedded, GitHub Action, source
Disclosure: maintained by this board's author
Grade Adiverged 0.7 percentage points morelow divergence (1.1%) · covers 98.0% of the suite
Tier breakdown
Tier 1 · Core 1.4% diverges100.0% coveredTier 2 · Complete 0.0% diverges89.4% covered 14 unsupportedTier 3 · Strict 1.4% diverges100.0% covered -
Grade Adiverged 0.4 percentage points more
low divergence (2.4%) · covers 94.1% of the suite
Tier breakdown
Tier 1 · Core 3.6% diverges100.0% coveredTier 2 · Complete 1.5% diverges68.2% covered 42 unsupportedTier 3 · Strict 0.9% diverges100.0% covered -
Grade Adiverged 0.8 percentage points more
low divergence (3.4%) · covers 100.0% of the suite
Tier breakdown
Tier 1 · Core 3.3% diverges100.0% coveredTier 2 · Complete 6.1% diverges100.0% coveredTier 3 · Strict 1.9% diverges100.0% covered -
18c54f4a774a 9 unsupported ; covers 98.7% of the suite
Runs via: Docker, Homebrew, install script, Scoop, binary, JAR
Grade Bdiverged 0.8 percentage points moremoderate divergence (7.9%) · covers 98.7% of the suite
Tier breakdown
Tier 1 · Core 7.2% diverges100.0% coveredTier 2 · Complete 11.4% diverges93.2% covered 9 unsupportedTier 3 · Strict 7.0% diverges100.0% covered -
Grade Bdiverged 0.1 percentage points less
moderate divergence (11.5%) · covers 98.9% of the suite
Tier breakdown
Tier 1 · Core 1.4% diverges100.0% coveredTier 2 · Complete 6.8% diverges93.9% covered 8 unsupportedTier 3 · Strict 31.3% diverges100.0% covered -
Grade Bdiverged 0.1 percentage points less
moderate divergence (12.6%) · covers 98.2% of the suite
Tier breakdown
Tier 1 · Core 2.8% diverges100.0% coveredTier 2 · Complete 9.8% diverges90.2% covered 13 unsupportedTier 3 · Strict 30.8% diverges100.0% covered -
Grade Cunchanged
high divergence (16.1%) · covers 90.5% of the suite
Tier breakdown
Tier 1 · Core 4.7% diverges100.0% coveredTier 2 · Complete 40.9% diverges49.2% covered 67 unsupportedTier 3 · Strict 20.1% diverges100.0% covered