Skip to content

Run

7 emulators 873 tests

Results as of this run. The arrow shows each target's movement since the previous run it was tested in. The suite grew this run, so a downward arrow can be the new tests biting rather than a target regressing.

Suite grew from 824 to 873 tests this run.

That's 49 new tests measured against every target. Movement below compares to the previous run, so a fall here is as likely to be the stricter suite as a real regression.

What changed in the suite this run

Suite on

Grew to 873 tests, up 49, all characterised against real DynamoDB in eu-west-2. New coverage in three areas:

  • ConsumedCapacity: the transactional read/write split on a same-token replay and on ExecuteTransaction, and a correction that single-item operations report the aggregate CapacityUnits and omit the split, which is transactional-only.
  • Empty-binary key values: rejected as a top-level ValidationException on every path, including secondary-index keys and inside transactions, mirroring the empty-string rejection.
  • Expression, limit and response-shape parity: KeyConditionExpression operand and nested-path rules, ExpressionAttributeNames/Values hygiene, projection validation and list-index fidelity, reversed-bounds BETWEEN, read-path key-length and segment caps, whitespace numbers, batch unprocessed fields and cross-table projection mixing, the bare no-op upsert, multi-subpath UPDATED_NEW, filter operand ordering, hash-only-GSI pagination, and CreateTable spec validation.
  1. DynamoDB
    live (AWS) full coverage
    100% ground truth
    region all regions
    Tier 1 100%
    Tier 2 100%
    Tier 3 100%
  2. Dynoxide
    0.11.1 14 unsupported ; covers 98.4% of the suite

    Disclosure: maintained by this board's author

    97.7% -0.8pp fell 0.8 percentage points
    Tier 1 98.0%
    Tier 2 97.9%
    Tier 3 97.1%
  3. Ministack
    65f91ff15e63 full coverage
    86.5% -2.5pp fell 2.5 percentage points
    Tier 1 91.0%
    Tier 2 81.9%
    Tier 3 81.6%
  4. ExtendDB
    v0.1.1 43 unsupported ; covers 95.1% of the suite
    86.0% -2.6pp fell 2.6 percentage points
    Tier 1 85.0%
    Tier 2 89.3%
    Tier 3 86.4%
  5. Floci
    794407b5deee 9 unsupported ; covers 99.0% of the suite
    84.7% -2.9pp fell 2.9 percentage points
    Tier 1 91.7%
    Tier 2 77.4%
    Tier 3 77.2%
  6. LocalStack
    - 8 unsupported ; covers 99.1% of the suite
    84.0% +0.7pp rose 0.7 percentage points
    Tier 1 93.0%
    Tier 2 87.8%
    Tier 3 67.3%
  7. DynamoDB Local
    d89f8fcc6b1a 13 unsupported ; covers 98.5% of the suite
    82.7% +0.8pp rose 0.8 percentage points
    Tier 1 91.7%
    Tier 2 84.5%
    Tier 3 66.9%
  8. Dynalite
    4.0.0 68 unsupported ; covers 92.2% of the suite
    75.2% -0.5pp fell 0.5 percentage points
    Tier 1 91.3%
    Tier 2 12.6%
    Tier 3 68.8%