Skip to content

Run

7 emulators 982 tests

Results as of this run. The arrow shows each target's movement since the previous run it was tested in. The suite grew this run, so a downward arrow can be the new tests biting rather than a target regressing.

Suite grew from 954 to 982 tests this run.

That's 28 new tests measured against every target. Movement below compares to the previous run, so a fall here is as likely to be the stricter suite as a real regression.

What changed in the suite this run

Suite on

Grew to 979 tests, up 25, all characterised against real DynamoDB across the per-region ground truth 2.0.0 put in place. New coverage is PartiQL's RETURNING clause; the GSI lifecycle also joins the ground truth, and the sweep's drift classifier gains a converged case.

  • PartiQL RETURNING (#103, #105): the clause pinned across every PartiQL surface. DELETE accepts only RETURNING ALL OLD * and rejects the other three variants with a 400, the message pinned; UPDATE accepts all four ALL/MODIFIED x OLD/NEW forms, where MODIFIED returns just the changed attribute and drops the key. The empty-projection edges are pinned too: a MODIFIED projection that resolves to nothing - a nested leaf, a list index, a batch statement - returns Items: [] rather than a keyed row. BatchExecuteStatement honours RETURNING; ExecuteTransaction rejects it. The non-upsert paths round it out: INSERT on an existing item, and UPDATE or DELETE behind a false predicate, fail ConditionalCheckFailed and leave the item untouched.
  • GSI lifecycle in the ground truth (#100): the 14 UpdateTable GSI lifecycle tests are now observed by the weekly sweep and recorded as per-region ground truth. They are the one slice the gating run drops for runtime, so they were the one slice without a real-AWS answer; the sweep records them without slowing the gate.
  • Drift classification (#104): a drift where every region moves off the pinned answer at once is now classified as converged rather than moved, with the converged path covered end to end.
Scored against 33 real regions. 1 dropped, out of scoring until it returns: me-south-1
  1. DynamoDB
    live (AWS) full coverage
    100% ground truth
    region all regions
    Tier 1 100%
    Tier 2 100%
    Tier 3 100%
  2. Dynoxide
    0.11.4 14 unsupported ; covers 98.6% of the suite

    Disclosure: maintained by this board's author

    96.3% -3.0pp fell 3.0 percentage points
    region eu-west-2 + 5 regions
    Tier 1 99.8%
    Tier 2 85.2%
    Tier 3 96.9%
  3. LocalStack
    2026.6.3 8 unsupported ; covers 99.2% of the suite
    85.1% 0.0pp unchanged
    region 27 regions scores higher here than in eu-west-2
    Tier 1 93.5%
    Tier 2 85.7%
    Tier 3 72.2%
  4. DynamoDB Local
    d89f8fcc6b1a 13 unsupported ; covers 98.7% of the suite
    83.9% +0.1pp rose 0.1 percentage points
    region 27 regions scores higher here than in eu-west-2
    Tier 1 92.2%
    Tier 2 82.9%
    Tier 3 71.9%
  5. Ministack
    22a278f078f5 full coverage
    83.3% -2.3pp fell 2.3 percentage points
    region all regions
    Tier 1 89.1%
    Tier 2 76.5%
    Tier 3 78.7%
  6. ExtendDB
    v0.1.1 71 unsupported ; covers 92.8% of the suite
    83.2% 0.0pp unchanged
    region all regions
    Tier 1 85.5%
    Tier 2 86.2%
    Tier 3 78.8%
  7. Floci
    d2ecc8035822 9 unsupported ; covers 99.1% of the suite
    80.2% -2.0pp fell 2.0 percentage points
    region all regions
    Tier 1 91.4%
    Tier 2 67.2%
    Tier 3 70.7%
  8. Dynalite
    4.0.0 96 unsupported ; covers 90.2% of the suite
    76.2% 0.0pp unchanged
    region 27 regions scores higher here than in eu-west-2
    Tier 1 91.4%
    Tier 2 13.2%
    Tier 3 70.9%