Run
7 emulators 699 tests
Results as of this run. The arrow shows each target's movement since the previous run it was tested in.
When this run was published the board led with a single correctness percentage. The figures here are that run's own results restated as divergence and coverage, so they read differently from what this page showed at the time. The changelog has the change.
What changed in the suite this run
Suite on
Real DynamoDB in eu-west-2 reworded a chunk of its validation errors, and the Tier 3 error-message tests moved with it. They now assert the contract the error carries - its type, the field it objects to, and the constraint - rather than the exact prose, because AWS varies the wrapper, the echoed input value and the field casing from one region to the next. A four-region capture in June found eu-west-2 and eu-central-1 on the new wording and us-east-1 and ap-southeast-2 still on the old, so the line between contract and cosmetic is drawn from what is invariant across all four.
This moves some Tier 3 numbers. Targets that were only ever marked down for wording DynamoDB itself renders inconsistently now pass those checks, so their Tier 3 scores rise: the suite has stopped counting a cosmetic difference as a behavioural one. Genuine behavioural divergences are still pinned exactly, for example PutItem with a { NULL: false } attribute, which DynamoDB now accepts in eu-west-2 and normalises to { NULL: true }.
-
Grade baselineground truth0.0%Divergence100.0%Coverage
no divergence in all 32 regions
Tier breakdown
Tier 1 · Core 0.0% diverges100.0% coveredTier 2 · Complete 0.0% diverges100.0% coveredTier 3 · Strict 0.0% diverges100.0% covered -
Grade Adiverged 0.4 percentage points more0.4%Divergence98.0%Coverage
Tier breakdown
Tier 1 · Core 0.0% diverges100.0% coveredTier 2 · Complete 0.0% diverges89.4% covered 14 unsupportedTier 3 · Strict 1.4% diverges100.0% covered -
Grade Adiverged 10.4 percentage points less2.6%Divergence100.0%Coverage
Tier breakdown
Tier 1 · Core 1.7% diverges100.0% coveredTier 2 · Complete 6.1% diverges100.0% coveredTier 3 · Strict 1.9% diverges100.0% covered -
Grade Adiverged 3.9 percentage points less2.0%Divergence94.0%Coverage
Tier breakdown
Tier 1 · Core 2.8% diverges100.0% coveredTier 2 · Complete 1.5% diverges68.2% covered 42 unsupportedTier 3 · Strict 0.9% diverges100.0% covered -
c88ec20bf221 9 unsupported ; covers 98.7% of the suite
Runs via: Docker, Homebrew, install script, Scoop, binary, JAR
Grade Bunchanged7.3%Divergence98.7%CoverageTier breakdown
Tier 1 · Core 5.9% diverges100.0% coveredTier 2 · Complete 11.4% diverges93.2% covered 9 unsupportedTier 3 · Strict 7.0% diverges100.0% covered -
Grade Bunchanged11.6%Divergence98.9%Coverage
Tier breakdown
Tier 1 · Core 1.4% diverges100.0% coveredTier 2 · Complete 6.8% diverges93.9% covered 8 unsupportedTier 3 · Strict 31.3% diverges100.0% covered -
Grade Bunchanged12.7%Divergence98.1%Coverage
Tier breakdown
Tier 1 · Core 2.8% diverges100.0% coveredTier 2 · Complete 9.8% diverges90.2% covered 13 unsupportedTier 3 · Strict 30.8% diverges100.0% covered -
Grade Cdiverged 0.9 percentage points more16.2%Divergence90.4%Coverage
Tier breakdown
Tier 1 · Core 4.5% diverges100.0% coveredTier 2 · Complete 40.9% diverges49.2% covered 67 unsupportedTier 3 · Strict 20.1% diverges100.0% covered