Run
7 emulators 824 tests
Results as of this run. The arrow shows each target's movement since the previous run it was tested in. The suite grew this run, so a downward arrow can be the new tests biting rather than a target regressing.
Suite grew from 817 to 824 tests this run.
That's 7 new tests measured against every target. Movement below compares to the previous run, so a fall here is as likely to be the stricter suite as a real regression.
What changed in the suite this run
Suite on
Grew to 824 tests, up 7, in two parts: two sibling-parity gaps where one half of a rule was pinned and the other was not, and the capacity accounting of conditional and idempotent transactional writes. All characterised against real DynamoDB in eu-west-2.
The first covers the LSI side of the INCLUDE-projection-without-NonKeyAttributes rejection; the GSI side already had it. An LSI declared with ProjectionType INCLUDE and no NonKeyAttributes is rejected as a ValidationException in tier1 and pinned to the exact message in tier3, the same wording the GSI case returns.
The second pins the Query message for Select SPECIFIC_ATTRIBUTES with no ProjectionExpression, which Scan already had. Query and Scan enforce the same rule but word it differently: Query wraps the phrase in the "1 validation error detected:" envelope, Scan returns it bare.
The transaction cases settle what a conditional TransactWriteItems actually costs. A passing condition adds no read capacity: a conditional write bills the same 2 WCU per sub-1KB item as an unconditional one, and a standalone ConditionCheck costs 2 WCU, billed as write not read. Idempotent replay splits the accounting - the first call reports 2 write capacity units, a same-token replay within the window reports 2 read capacity units for re-reading the stored result. A failing condition cancels the transaction, and the response carries no ConsumedCapacity at all. Answers #27.
-
live (AWS) full coverage100% ground truthTier 1 100%Tier 2 100%Tier 3 100%
-
98.5% -0.6pp fell 0.6 percentage pointsTier 1 99.3%Tier 2 98.6%Tier 3 97.2%
-
65f91ff15e63 full coverage89.0% -0.4pp fell 0.4 percentage pointsTier 1 92.6%Tier 2 82.5%Tier 3 86.9%
-
88.6% -0.3pp fell 0.3 percentage pointsTier 1 88.0%Tier 2 89.3%Tier 3 89.3%
-
794407b5deee 9 unsupported ; covers 98.9% of the suite87.6% -0.6pp fell 0.6 percentage pointsTier 1 93.8%Tier 2 77.9%Tier 3 82.9%
-
83.3% -0.4pp fell 0.4 percentage pointsTier 1 92.8%Tier 2 88.4%Tier 3 64.7%
-
d89f8fcc6b1a 13 unsupported ; covers 98.4% of the suite81.9% -0.3pp fell 0.3 percentage pointsTier 1 91.4%Tier 2 85.1%Tier 3 64.3%
-
75.7% -0.7pp fell 0.7 percentage pointsTier 1 90.9%Tier 2 12.6%Tier 3 72.2%