Skip to content

Run

7 emulators 762 tests

Results as of this run. The arrow shows each target's movement since the previous run it was tested in. The suite grew this run, so an upward arrow can be the new tests biting rather than a target getting worse.

When this run was published the board led with a single correctness percentage. The figures here are that run's own results restated as divergence and coverage, so they read differently from what this page showed at the time. The changelog has the change.

Suite grew from 744 to 762 tests this run.

That's 18 new tests measured against every target. Movement below compares to the previous run, so a rise here is as likely to be the stricter suite as a real regression.

What changed in the suite this run

Suite on

Grew to 762 tests, up 18, covering a malformed value in the lookup Key of a TransactWriteItems Update, Delete, or ConditionCheck - the path a Put item key does not take. Captured across four regions (eu-west-2, us-east-1, ap-southeast-2, eu-central-1), where every string was identical, so they pin exactly. An empty-string Key surfaces as a top-level ValidationException with the same message a Put item key gives; a wrong-typed or non-scalar Key cancels with a ValidationError reason carrying "The provided key element does not match the schema" - the key-only form, not the "Type mismatch for key" message the item-key path returns. The same run confirmed the BatchWriteItem table-key schema-mismatch message is region-invariant.

  1. DynamoDB
    live (AWS)

    Runs via: AWS service

    Grade baseline

    no divergence in all 33 regions · covers 100.0% of the suite

    ground truth
    Tier breakdown
    Tier 1 · Core 0.0% diverges
    100.0% covered
    Tier 2 · Complete 0.0% diverges
    100.0% covered
    Tier 3 · Strict 0.0% diverges
    100.0% covered
  2. Dynoxide
    0.11.0 14 unsupported ; covers 98.2% of the suite

    Runs via: npx, Docker, Homebrew, binary, npm, cargo, embedded, GitHub Action, source

    Disclosure: maintained by this board's author

    Grade A

    low divergence (0.3%) · covers 98.2% of the suite

    diverged 5.4 percentage points less
    Tier breakdown
    Tier 1 · Core 0.0% diverges
    100.0% covered
    Tier 2 · Complete 0.0% diverges
    90.7% covered 14 unsupported
    Tier 3 · Strict 0.8% diverges
    100.0% covered
  3. ExtendDB
    v0.1.1 42 unsupported ; covers 94.5% of the suite

    Runs via: source

    Grade B

    moderate divergence (7.5%) · covers 94.5% of the suite

    diverged 1.4 percentage points more
    Tier breakdown
    Tier 1 · Core 6.4% diverges
    100.0% covered
    Tier 2 · Complete 7.3% diverges
    72.0% covered 42 unsupported
    Tier 3 · Strict 9.2% diverges
    100.0% covered
  4. Ministack
    45cc7b1398e0

    Runs via: pip, Docker, source

    Grade B

    moderate divergence (10.0%) · covers 100.0% of the suite

    unchanged
    Tier breakdown
    Tier 1 · Core 6.7% diverges
    100.0% covered
    Tier 2 · Complete 17.3% diverges
    100.0% covered
    Tier 3 · Strict 10.5% diverges
    100.0% covered
  5. Floci
    78ee619e895a 9 unsupported ; covers 98.8% of the suite

    Runs via: Docker, Homebrew, install script, Scoop, binary, JAR

    Grade B

    moderate divergence (10.8%) · covers 98.8% of the suite

    diverged 1.8 percentage points more
    Tier breakdown
    Tier 1 · Core 5.6% diverges
    100.0% covered
    Tier 2 · Complete 19.3% diverges
    94.0% covered 9 unsupported
    Tier 3 · Strict 13.4% diverges
    100.0% covered
  6. LocalStack
    2026.6.0 8 unsupported ; covers 99.0% of the suite

    Runs via: Docker, pip, Homebrew, binary

    Grade B

    moderate divergence (14.0%) · covers 99.0% of the suite

    diverged 0.7 percentage points more
    Tier breakdown
    Tier 1 · Core 2.1% diverges
    100.0% covered
    Tier 2 · Complete 10.0% diverges
    94.7% covered 8 unsupported
    Tier 3 · Strict 35.3% diverges
    100.0% covered
  7. DynamoDB Local
    d89f8fcc6b1a 13 unsupported ; covers 98.3% of the suite

    Runs via: Docker, JAR, Maven

    Grade C

    high divergence (15.2%) · covers 98.3% of the suite

    diverged 0.8 percentage points more
    Tier breakdown
    Tier 1 · Core 3.5% diverges
    100.0% covered
    Tier 2 · Complete 12.7% diverges
    91.3% covered 13 unsupported
    Tier 3 · Strict 35.3% diverges
    100.0% covered
  8. Dynalite
    4.0.0 67 unsupported ; covers 91.2% of the suite

    Runs via: npm, npx, embedded

    Grade C

    high divergence (21.0%) · covers 91.2% of the suite

    diverged 1.9 percentage points more
    Tier breakdown
    Tier 1 · Core 7.0% diverges
    100.0% covered
    Tier 2 · Complete 48.0% diverges
    55.3% covered 67 unsupported
    Tier 3 · Strict 26.1% diverges
    100.0% covered