Skip to content

Run

7 emulators 744 tests

Results as of this run. The arrow shows each target's movement since the previous run it was tested in. The suite grew this run, so an upward arrow can be the new tests biting rather than a target getting worse.

When this run was published the board led with a single correctness percentage. The figures here are that run's own results restated as divergence and coverage, so they read differently from what this page showed at the time. The changelog has the change.

Suite grew from 736 to 744 tests this run.

That's 8 new tests measured against every target. Movement below compares to the previous run, so a rise here is as likely to be the stricter suite as a real regression.

What changed in the suite this run

Suite on

Grew to 744 tests, up 8, pinning the Select / ProjectionExpression rules on Query and Scan. A ProjectionExpression is only valid with Select SPECIFIC_ATTRIBUTES, and ALL_PROJECTED_ATTRIBUTES is only valid with an IndexName; real DynamoDB rejects both with a ValidationException before reading anything. The cases span ALL_ATTRIBUTES, COUNT, and ALL_PROJECTED_ATTRIBUTES, including the request that breaks both rules at once, where AWS reports the ProjectionExpression one. They assert the contractual phrase, so they hold whether or not the engine carries the wrapper AWS adds on Query but not Scan.

  1. live (AWS)

    Runs via: AWS service

    Grade baseline

    no divergence in all 33 regions · covers 100.0% of the suite

    ground truth
    Tier breakdown
    Tier 1 · Core 0.0% diverges
    100.0% covered
    Tier 2 · Complete 0.0% diverges
    100.0% covered
    Tier 3 · Strict 0.0% diverges
    100.0% covered
  2. Runs via: npx, Docker, Homebrew, binary, npm, cargo, embedded, GitHub Action, source

    Disclosure: maintained by this board's author

    Grade B

    moderate divergence (5.6%) · covers 98.1% of the suite

    diverged 1.0 percentage points more
    Tier breakdown
    Tier 1 · Core 4.8% diverges
    100.0% covered
    Tier 2 · Complete 5.7% diverges
    90.1% covered 14 unsupported
    Tier 3 · Strict 7.0% diverges
    100.0% covered
  3. Grade B

    moderate divergence (6.0%) · covers 94.4% of the suite

    diverged 0.7 percentage points more
    Tier breakdown
    Tier 1 · Core 6.4% diverges
    100.0% covered
    Tier 2 · Complete 5.7% diverges
    70.2% covered 42 unsupported
    Tier 3 · Strict 5.7% diverges
    100.0% covered
  4. Runs via: Docker, Homebrew, install script, Scoop, binary, JAR

    Grade B

    moderate divergence (9.0%) · covers 98.8% of the suite

    diverged 2.4 percentage points less
    Tier breakdown
    Tier 1 · Core 5.6% diverges
    100.0% covered
    Tier 2 · Complete 16.3% diverges
    93.6% covered 9 unsupported
    Tier 3 · Strict 10.0% diverges
    100.0% covered
  5. a64f3c3bebff

    Runs via: pip, Docker, source

    Grade B

    moderate divergence (9.9%) · covers 100.0% of the suite

    diverged 1.0 percentage points more
    Tier breakdown
    Tier 1 · Core 11.0% diverges
    100.0% covered
    Tier 2 · Complete 12.1% diverges
    100.0% covered
    Tier 3 · Strict 7.0% diverges
    100.0% covered
  6. Runs via: Docker, pip, Homebrew, binary

    Grade B

    moderate divergence (13.3%) · covers 98.9% of the suite

    diverged 0.1 percentage points less
    Tier breakdown
    Tier 1 · Core 2.1% diverges
    100.0% covered
    Tier 2 · Complete 8.5% diverges
    94.3% covered 8 unsupported
    Tier 3 · Strict 34.5% diverges
    100.0% covered
  7. Grade C

    moderate divergence (14.4%) · covers 98.3% of the suite · coverage lowers this row to C

    diverged 0.2 percentage points less
    Tier breakdown
    Tier 1 · Core 3.5% diverges
    100.0% covered
    Tier 2 · Complete 11.3% diverges
    90.8% covered 13 unsupported
    Tier 3 · Strict 34.1% diverges
    100.0% covered
  8. Grade C

    high divergence (19.1%) · covers 91.0% of the suite

    diverged 0.9 percentage points more
    Tier breakdown
    Tier 1 · Core 7.0% diverges
    100.0% covered
    Tier 2 · Complete 44.7% diverges
    52.5% covered 67 unsupported
    Tier 3 · Strict 23.1% diverges
    100.0% covered