Skip to content

Run

7 emulators 684 tests

Results as of this run. The arrow shows each target's movement since the previous run it was tested in. The suite grew this run, so an upward arrow can be the new tests biting rather than a target getting worse.

When this run was published the board led with a single correctness percentage. The figures here are that run's own results restated as divergence and coverage, so they read differently from what this page showed at the time. The changelog has the change.

Suite grew from 655 to 684 tests this run.

That's 29 new tests measured against every target. Movement below compares to the previous run, so a rise here is as likely to be the stricter suite as a real regression.

What changed in the suite this run

Suite on

Grew to 684 tests with a control-plane and table-configuration sweep: the CreateTable/UpdateTable config parameters and the secondary control-plane operations (limits, backups and PITR, exports and imports, Kinesis, resource policies, contributor insights), each characterised against real AWS and probe-skipped where a target doesn't implement it.

The published percentage changed with it. It now measures correctness over implemented operations, Pass / (Pass + Fail), so skips no longer count against the score. A skip is honest scope; a fail is a bug.

  1. DynamoDB
    live (AWS)

    Runs via: AWS service

    Grade baseline

    no divergence in all 33 regions · covers 100.0% of the suite

    ground truth
    Tier breakdown
    Tier 1 · Core 0.0% diverges
    100.0% covered
    Tier 2 · Complete 0.0% diverges
    100.0% covered
    Tier 3 · Strict 0.0% diverges
    100.0% covered
  2. Dynoxide
    0.9.13 14 unsupported ; covers 98.0% of the suite

    Runs via: npx, Docker, Homebrew, binary, npm, cargo, embedded, GitHub Action, source

    Disclosure: maintained by this board's author

    Grade B

    low divergence (4.4%) · covers 98.0% of the suite · coverage lowers this row to B

    diverged 0.6 percentage points more
    Tier breakdown
    Tier 1 · Core 5.2% diverges
    100.0% covered
    Tier 2 · Complete 4.8% diverges
    88.7% covered 14 unsupported
    Tier 3 · Strict 2.8% diverges
    100.0% covered
  3. ExtendDB
    v0.1.0 34 unsupported ; covers 95.0% of the suite

    Runs via: source

    Grade B

    moderate divergence (6.0%) · covers 95.0% of the suite

    diverged 1.0 percentage points more
    Tier breakdown
    Tier 1 · Core 6.9% diverges
    100.0% covered
    Tier 2 · Complete 4.8% diverges
    72.6% covered 34 unsupported
    Tier 3 · Strict 5.1% diverges
    100.0% covered
  4. Floci
    e981a5afd790 9 unsupported ; covers 98.7% of the suite

    Runs via: Docker, Homebrew, install script, Scoop, binary, JAR

    Grade B

    moderate divergence (6.4%) · covers 98.7% of the suite

    diverged 1.2 percentage points more
    Tier breakdown
    Tier 1 · Core 6.1% diverges
    100.0% covered
    Tier 2 · Complete 8.1% diverges
    92.7% covered 9 unsupported
    Tier 3 · Strict 6.1% diverges
    100.0% covered
  5. LocalStack
    2026.5.0 8 unsupported ; covers 98.8% of the suite

    Runs via: Docker, pip, Homebrew, binary

    Grade B

    moderate divergence (11.8%) · covers 98.8% of the suite

    diverged 0.2 percentage points less
    Tier breakdown
    Tier 1 · Core 1.4% diverges
    100.0% covered
    Tier 2 · Complete 7.3% diverges
    93.5% covered 8 unsupported
    Tier 3 · Strict 31.3% diverges
    100.0% covered
  6. DynamoDB Local
    d89f8fcc6b1a 13 unsupported ; covers 98.1% of the suite

    Runs via: Docker, JAR, Maven

    Grade B

    moderate divergence (12.7%) · covers 98.1% of the suite

    diverged 0.1 percentage points less
    Tier breakdown
    Tier 1 · Core 2.3% diverges
    100.0% covered
    Tier 2 · Complete 10.5% diverges
    89.5% covered 13 unsupported
    Tier 3 · Strict 30.8% diverges
    100.0% covered
  7. Dynalite
    4.0.0 59 unsupported ; covers 91.4% of the suite

    Runs via: npm, npx, embedded

    Grade C

    high divergence (15.6%) · covers 91.4% of the suite

    diverged 0.8 percentage points more
    Tier breakdown
    Tier 1 · Core 4.6% diverges
    100.0% covered
    Tier 2 · Complete 43.5% diverges
    52.4% covered 59 unsupported
    Tier 3 · Strict 17.3% diverges
    100.0% covered
  8. Ministack
    9641f520cebd 10 unsupported ; covers 98.5% of the suite

    Runs via: pip, Docker, source

    Grade D

    very high divergence (34.4%) · covers 98.5% of the suite

    diverged 0.1 percentage points less
    Tier breakdown
    Tier 1 · Core 19.1% diverges
    100.0% covered
    Tier 2 · Complete 24.2% diverges
    91.9% covered 10 unsupported
    Tier 3 · Strict 65.0% diverges
    100.0% covered