Skip to content

Run

7 emulators 824 tests

Results as of this run. The arrow shows each target's movement since the previous run it was tested in. The suite grew this run, so a downward arrow can be the new tests biting rather than a target regressing.

Suite grew from 817 to 824 tests this run.

That's 7 new tests measured against every target. Movement below compares to the previous run, so a fall here is as likely to be the stricter suite as a real regression.

What changed in the suite this run

Suite on

Grew to 824 tests, up 7, in two parts: two sibling-parity gaps where one half of a rule was pinned and the other was not, and the capacity accounting of conditional and idempotent transactional writes. All characterised against real DynamoDB in eu-west-2.

The first covers the LSI side of the INCLUDE-projection-without-NonKeyAttributes rejection; the GSI side already had it. An LSI declared with ProjectionType INCLUDE and no NonKeyAttributes is rejected as a ValidationException in tier1 and pinned to the exact message in tier3, the same wording the GSI case returns.

The second pins the Query message for Select SPECIFIC_ATTRIBUTES with no ProjectionExpression, which Scan already had. Query and Scan enforce the same rule but word it differently: Query wraps the phrase in the "1 validation error detected:" envelope, Scan returns it bare.

The transaction cases settle what a conditional TransactWriteItems actually costs. A passing condition adds no read capacity: a conditional write bills the same 2 WCU per sub-1KB item as an unconditional one, and a standalone ConditionCheck costs 2 WCU, billed as write not read. Idempotent replay splits the accounting - the first call reports 2 write capacity units, a same-token replay within the window reports 2 read capacity units for re-reading the stored result. A failing condition cancels the transaction, and the response carries no ConsumedCapacity at all. Answers #27.

  1. live (AWS) full coverage
    100% ground truth
    Tier 1 100%
    Tier 2 100%
    Tier 3 100%
  2. 98.5% -0.6pp fell 0.6 percentage points
    Tier 1 99.3%
    Tier 2 98.6%
    Tier 3 97.2%
  3. 65f91ff15e63 full coverage
    89.0% -0.4pp fell 0.4 percentage points
    Tier 1 92.6%
    Tier 2 82.5%
    Tier 3 86.9%
  4. 88.6% -0.3pp fell 0.3 percentage points
    Tier 1 88.0%
    Tier 2 89.3%
    Tier 3 89.3%
  5. 87.6% -0.6pp fell 0.6 percentage points
    Tier 1 93.8%
    Tier 2 77.9%
    Tier 3 82.9%
  6. 83.3% -0.4pp fell 0.4 percentage points
    Tier 1 92.8%
    Tier 2 88.4%
    Tier 3 64.7%
  7. 81.9% -0.3pp fell 0.3 percentage points
    Tier 1 91.4%
    Tier 2 85.1%
    Tier 3 64.3%
  8. 75.7% -0.7pp fell 0.7 percentage points
    Tier 1 90.9%
    Tier 2 12.6%
    Tier 3 72.2%