Run
7 emulators 706 tests
Results as of this run. The arrow shows each target's movement since the previous run it was tested in. The suite grew this run, so a downward arrow can be the new tests biting rather than a target regressing.
Suite grew from 699 to 706 tests this run.
That's 7 new tests measured against every target. Movement below compares to the previous run, so a fall here is as likely to be the stricter suite as a real regression.
What changed in the suite this run
Suite on
Grew to 706 tests, up 7, tightening secondary-index behaviour in Tier 1. Query and Scan on a GSI or LSI now assert sparse membership: an item that omits the index key stays off the index but remains on the base table. And PutItem now rejects an item whose GSI or LSI key value is the wrong type, non-scalar, or an empty string while the base-table keys are valid, holding an index key to its declared scalar type the same way a table key is held.
-
live (AWS) full coverage100% ground truthTier 1 100%Tier 2 100%Tier 3 100%
-
98.8% -0.7pp fell 0.7 percentage pointsTier 1 98.6%Tier 2 100.0%Tier 3 98.6%
-
97.4% -0.4pp fell 0.4 percentage pointsTier 1 96.4%Tier 2 97.8%Tier 3 99.1%
-
6ab22e716ef2 full coverage96.6% -0.8pp fell 0.8 percentage pointsTier 1 96.7%Tier 2 93.9%Tier 3 98.1%
-
18c54f4a774a 9 unsupported ; covers 98.7% of the suite92.0% -0.8pp fell 0.8 percentage pointsTier 1 92.8%Tier 2 87.8%Tier 3 93.0%
-
88.4% +0.1pp rose 0.1 percentage pointsTier 1 98.6%Tier 2 92.7%Tier 3 68.7%
-
d89f8fcc6b1a 13 unsupported ; covers 98.2% of the suite87.2% +0.1pp rose 0.1 percentage pointsTier 1 97.2%Tier 2 89.1%Tier 3 69.2%
-
82.2% 0.0pp unchangedTier 1 95.3%Tier 2 16.9%Tier 3 79.9%