Skip to content

Run

7 emulators 706 tests

Results as of this run. The arrow shows each target's movement since the previous run it was tested in. The suite grew this run, so a downward arrow can be the new tests biting rather than a target regressing.

Suite grew from 699 to 706 tests this run.

That's 7 new tests measured against every target. Movement below compares to the previous run, so a fall here is as likely to be the stricter suite as a real regression.

What changed in the suite this run

Suite on

Grew to 706 tests, up 7, tightening secondary-index behaviour in Tier 1. Query and Scan on a GSI or LSI now assert sparse membership: an item that omits the index key stays off the index but remains on the base table. And PutItem now rejects an item whose GSI or LSI key value is the wrong type, non-scalar, or an empty string while the base-table keys are valid, holding an index key to its declared scalar type the same way a table key is held.

  1. live (AWS) full coverage
    100% ground truth
    Tier 1 100%
    Tier 2 100%
    Tier 3 100%
  2. 98.8% -0.7pp fell 0.7 percentage points
    Tier 1 98.6%
    Tier 2 100.0%
    Tier 3 98.6%
  3. 97.4% -0.4pp fell 0.4 percentage points
    Tier 1 96.4%
    Tier 2 97.8%
    Tier 3 99.1%
  4. 6ab22e716ef2 full coverage
    96.6% -0.8pp fell 0.8 percentage points
    Tier 1 96.7%
    Tier 2 93.9%
    Tier 3 98.1%
  5. 92.0% -0.8pp fell 0.8 percentage points
    Tier 1 92.8%
    Tier 2 87.8%
    Tier 3 93.0%
  6. 88.4% +0.1pp rose 0.1 percentage points
    Tier 1 98.6%
    Tier 2 92.7%
    Tier 3 68.7%
  7. 87.2% +0.1pp rose 0.1 percentage points
    Tier 1 97.2%
    Tier 2 89.1%
    Tier 3 69.2%
  8. Tier 1 95.3%
    Tier 2 16.9%
    Tier 3 79.9%