Run
7 emulators 817 tests
Results as of this run. The arrow shows each target's movement since the previous run it was tested in. The suite grew this run, so a downward arrow can be the new tests biting rather than a target regressing.
Suite grew from 762 to 817 tests this run.
That's 55 new tests measured against every target. Movement below compares to the previous run, so a fall here is as likely to be the stricter suite as a real regression.
-
live (AWS) full coverage100% ground truthTier 1 100%Tier 2 100%Tier 3 100%
-
99.1% -0.6pp fell 0.6 percentage pointsTier 1 99.5%Tier 2 100.0%Tier 3 98.0%
-
40b3c73db5db full coverage89.4% -0.7pp fell 0.7 percentage pointsTier 1 92.8%Tier 2 82.7%Tier 3 87.6%
-
88.9% -3.2pp fell 3.2 percentage pointsTier 1 88.2%Tier 2 89.8%Tier 3 89.6%
-
0147b790fee4 9 unsupported ; covers 98.9% of the suite88.2% -0.9pp fell 0.9 percentage pointsTier 1 94.0%Tier 2 79.4%Tier 3 83.6%
-
83.7% -2.1pp fell 2.1 percentage pointsTier 1 92.8%Tier 2 89.4%Tier 3 65.2%
-
d89f8fcc6b1a 13 unsupported ; covers 98.4% of the suite82.2% -2.3pp fell 2.3 percentage pointsTier 1 91.4%Tier 2 86.1%Tier 3 64.8%
-
76.4% -0.6pp fell 0.6 percentage pointsTier 1 91.1%Tier 2 13.3%Tier 3 72.8%