1######
2Raptor
3######
4
5Raptor is a performance-testing framework for running browser pageload and browser benchmark tests. Raptor is cross-browser compatible and is currently running in production on Firefox Desktop, Firefox Android GeckoView, Fenix, Reference Browser, Chromium, and Chrome.
6
7- Contact: Dave Hunt [:davehunt]
8- Source code: https://searchfox.org/mozilla-central/source/testing/raptor
9- Good first bugs: https://codetribute.mozilla.org/projects/automation?project%3DRaptor
10
11Raptor currently supports three test types: 1) page-load performance tests, 2) standard benchmark-performance tests, and 3) "scenario"-based tests, such as power, CPU, and memory-usage measurements on Android (and desktop?).
12
13Locally, Raptor can be invoked with the following command:
14
15::
16
17    ./mach raptor
18
19**We're in the process of migrating away from webextension to browsertime. Currently, raptor supports both of them, but at the end of the migration, the support for webextension will be removed.**
20
21.. toctree::
22   :titlesonly:
23
24   browsertime
25   webextension
26   debugging
27   contributing
28   test-list
29
30.. contents::
31   :depth: 2
32   :local:
33
34Raptor tests
35************
36
37The following documents all testing we have for Raptor.
38
39Benchmarks
40----------
41Standard benchmarks are third-party tests (i.e. Speedometer) that we have integrated into Raptor to run per-commit in our production CI.
42
43.. dropdown:: ares6
44   :container: + anchor-id-ares6-b
45
46   **Owner**: :jandem and SpiderMonkey Team
47
48   * **alert threshold**: 2.0
49   * **apps**: firefox, chrome, chromium
50   * **expected**: pass
51   * **gecko profile entries**: 14000000
52   * **gecko profile interval**: 1
53   * **lower is better**: true
54   * **page cycles**: 4
55   * **page timeout**: 270000
56   * **subtest lower is better**: true
57   * **subtest unit**: ms
58   * **test url**: `<http://\<host\>:\<port\>/ARES-6/index.html?raptor>`__
59   * **type**: benchmark
60   * **unit**: ms
61   * **Test Task**:
62
63   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
64      :widths: 30 15 15 15 15
65      :header-rows: 1
66
67      * - **Test Name**
68        - mozilla-central
69        - autoland
70        - mozilla-release
71        - mozilla-beta
72      * - **browsertime-benchmark-firefox-ares6-e10s**
73        - ❌
74        - ❌
75        - ❌
76        - ❌
77      * - **browsertime-benchmark-firefox-ares6-fis-e10s**
78        - ❌
79        - ❌
80        - ❌
81        - ❌
82
83
84   .. list-table:: **test-linux1804-64-qr/opt**
85      :widths: 30 15 15 15 15
86      :header-rows: 1
87
88      * - **Test Name**
89        - mozilla-central
90        - autoland
91        - mozilla-release
92        - mozilla-beta
93      * - **browsertime-benchmark-firefox-ares6-e10s**
94        - ❌
95        - ❌
96        - ❌
97        - ❌
98      * - **browsertime-benchmark-firefox-ares6-fis-e10s**
99        - ❌
100        - ❌
101        - ❌
102        - ❌
103
104
105   .. list-table:: **test-linux1804-64-shippable-qr/opt**
106      :widths: 30 15 15 15 15
107      :header-rows: 1
108
109      * - **Test Name**
110        - mozilla-central
111        - autoland
112        - mozilla-release
113        - mozilla-beta
114      * - **browsertime-benchmark-chrome-ares6-e10s**
115        - ❌
116        - ❌
117        - ❌
118        - ❌
119      * - **browsertime-benchmark-chromium-ares6-e10s**
120        - ❌
121        - ❌
122        - ❌
123        - ❌
124      * - **browsertime-benchmark-firefox-ares6-e10s**
125        - ❌
126        - ❌
127        - ❌
128        - ❌
129      * - **browsertime-benchmark-firefox-ares6-fis-e10s**
130        - ✅
131        - ✅
132        - ✅
133        - ✅
134
135
136   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
137      :widths: 30 15 15 15 15
138      :header-rows: 1
139
140      * - **Test Name**
141        - mozilla-central
142        - autoland
143        - mozilla-release
144        - mozilla-beta
145      * - **browsertime-benchmark-chrome-ares6-e10s**
146        - ❌
147        - ❌
148        - ❌
149        - ❌
150      * - **browsertime-benchmark-chromium-ares6-e10s**
151        - ❌
152        - ❌
153        - ❌
154        - ❌
155      * - **browsertime-benchmark-firefox-ares6-e10s**
156        - ❌
157        - ❌
158        - ❌
159        - ❌
160      * - **browsertime-benchmark-firefox-ares6-fis-e10s**
161        - ✅
162        - ✅
163        - ✅
164        - ✅
165
166
167   .. list-table:: **test-windows10-32-qr/opt**
168      :widths: 30 15 15 15 15
169      :header-rows: 1
170
171      * - **Test Name**
172        - mozilla-central
173        - autoland
174        - mozilla-release
175        - mozilla-beta
176      * - **browsertime-benchmark-firefox-ares6-e10s**
177        - ❌
178        - ❌
179        - ❌
180        - ❌
181      * - **browsertime-benchmark-firefox-ares6-fis-e10s**
182        - ❌
183        - ❌
184        - ❌
185        - ❌
186
187
188   .. list-table:: **test-windows10-32-shippable-qr/opt**
189      :widths: 30 15 15 15 15
190      :header-rows: 1
191
192      * - **Test Name**
193        - mozilla-central
194        - autoland
195        - mozilla-release
196        - mozilla-beta
197      * - **browsertime-benchmark-chrome-ares6-e10s**
198        - ❌
199        - ❌
200        - ❌
201        - ❌
202      * - **browsertime-benchmark-chromium-ares6-e10s**
203        - ❌
204        - ❌
205        - ❌
206        - ❌
207      * - **browsertime-benchmark-firefox-ares6-e10s**
208        - ❌
209        - ❌
210        - ❌
211        - ❌
212      * - **browsertime-benchmark-firefox-ares6-fis-e10s**
213        - ❌
214        - ❌
215        - ❌
216        - ❌
217
218
219   .. list-table:: **test-windows10-64-qr/opt**
220      :widths: 30 15 15 15 15
221      :header-rows: 1
222
223      * - **Test Name**
224        - mozilla-central
225        - autoland
226        - mozilla-release
227        - mozilla-beta
228      * - **browsertime-benchmark-firefox-ares6-e10s**
229        - ❌
230        - ❌
231        - ❌
232        - ❌
233      * - **browsertime-benchmark-firefox-ares6-fis-e10s**
234        - ❌
235        - ❌
236        - ❌
237        - ❌
238
239
240   .. list-table:: **test-windows10-64-shippable-qr/opt**
241      :widths: 30 15 15 15 15
242      :header-rows: 1
243
244      * - **Test Name**
245        - mozilla-central
246        - autoland
247        - mozilla-release
248        - mozilla-beta
249      * - **browsertime-benchmark-chrome-ares6-e10s**
250        - ❌
251        - ❌
252        - ❌
253        - ❌
254      * - **browsertime-benchmark-chromium-ares6-e10s**
255        - ❌
256        - ❌
257        - ❌
258        - ❌
259      * - **browsertime-benchmark-firefox-ares6-e10s**
260        - ❌
261        - ❌
262        - ❌
263        - ❌
264      * - **browsertime-benchmark-firefox-ares6-fis-e10s**
265        - ✅
266        - ✅
267        - ✅
268        - ✅
269
270
271
272.. dropdown:: assorted-dom
273   :container: + anchor-id-assorted-dom-b
274
275   **Owner**: PerfTest Team
276
277   * **alert threshold**: 2.0
278   * **apps**: firefox, chrome, chromium
279   * **expected**: pass
280   * **fetch task**: assorted-dom
281   * **gecko profile entries**: 2000000
282   * **gecko profile interval**: 1
283   * **lower is better**: true
284   * **page cycles**: 1
285   * **page timeout**: 60000
286   * **screen capture**: true
287   * **test url**: `<http://\<host\>:\<port\>/assorted-dom/assorted/driver.html?raptor>`__
288   * **type**: benchmark
289   * **unit**: ms
290   * **Test Task**:
291
292   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
293      :widths: 30 15 15 15 15
294      :header-rows: 1
295
296      * - **Test Name**
297        - mozilla-central
298        - autoland
299        - mozilla-release
300        - mozilla-beta
301      * - **browsertime-benchmark-firefox-assorted-dom-e10s**
302        - ❌
303        - ❌
304        - ❌
305        - ❌
306      * - **browsertime-benchmark-firefox-assorted-dom-fis-e10s**
307        - ❌
308        - ❌
309        - ❌
310        - ❌
311
312
313   .. list-table:: **test-linux1804-64-qr/opt**
314      :widths: 30 15 15 15 15
315      :header-rows: 1
316
317      * - **Test Name**
318        - mozilla-central
319        - autoland
320        - mozilla-release
321        - mozilla-beta
322      * - **browsertime-benchmark-firefox-assorted-dom-e10s**
323        - ❌
324        - ❌
325        - ❌
326        - ❌
327      * - **browsertime-benchmark-firefox-assorted-dom-fis-e10s**
328        - ❌
329        - ❌
330        - ❌
331        - ❌
332
333
334   .. list-table:: **test-linux1804-64-shippable-qr/opt**
335      :widths: 30 15 15 15 15
336      :header-rows: 1
337
338      * - **Test Name**
339        - mozilla-central
340        - autoland
341        - mozilla-release
342        - mozilla-beta
343      * - **browsertime-benchmark-chrome-assorted-dom-e10s**
344        - ❌
345        - ❌
346        - ❌
347        - ❌
348      * - **browsertime-benchmark-chromium-assorted-dom-e10s**
349        - ❌
350        - ❌
351        - ❌
352        - ❌
353      * - **browsertime-benchmark-firefox-assorted-dom-e10s**
354        - ❌
355        - ❌
356        - ❌
357        - ❌
358      * - **browsertime-benchmark-firefox-assorted-dom-fis-e10s**
359        - ✅
360        - ✅
361        - ✅
362        - ✅
363
364
365   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
366      :widths: 30 15 15 15 15
367      :header-rows: 1
368
369      * - **Test Name**
370        - mozilla-central
371        - autoland
372        - mozilla-release
373        - mozilla-beta
374      * - **browsertime-benchmark-chrome-assorted-dom-e10s**
375        - ❌
376        - ❌
377        - ❌
378        - ❌
379      * - **browsertime-benchmark-chromium-assorted-dom-e10s**
380        - ❌
381        - ❌
382        - ❌
383        - ❌
384      * - **browsertime-benchmark-firefox-assorted-dom-e10s**
385        - ❌
386        - ❌
387        - ❌
388        - ❌
389      * - **browsertime-benchmark-firefox-assorted-dom-fis-e10s**
390        - ✅
391        - ✅
392        - ✅
393        - ✅
394
395
396   .. list-table:: **test-windows10-32-qr/opt**
397      :widths: 30 15 15 15 15
398      :header-rows: 1
399
400      * - **Test Name**
401        - mozilla-central
402        - autoland
403        - mozilla-release
404        - mozilla-beta
405      * - **browsertime-benchmark-firefox-assorted-dom-e10s**
406        - ❌
407        - ❌
408        - ❌
409        - ❌
410      * - **browsertime-benchmark-firefox-assorted-dom-fis-e10s**
411        - ❌
412        - ❌
413        - ❌
414        - ❌
415
416
417   .. list-table:: **test-windows10-32-shippable-qr/opt**
418      :widths: 30 15 15 15 15
419      :header-rows: 1
420
421      * - **Test Name**
422        - mozilla-central
423        - autoland
424        - mozilla-release
425        - mozilla-beta
426      * - **browsertime-benchmark-chrome-assorted-dom-e10s**
427        - ❌
428        - ❌
429        - ❌
430        - ❌
431      * - **browsertime-benchmark-chromium-assorted-dom-e10s**
432        - ❌
433        - ❌
434        - ❌
435        - ❌
436      * - **browsertime-benchmark-firefox-assorted-dom-e10s**
437        - ❌
438        - ❌
439        - ❌
440        - ❌
441      * - **browsertime-benchmark-firefox-assorted-dom-fis-e10s**
442        - ❌
443        - ❌
444        - ❌
445        - ❌
446
447
448   .. list-table:: **test-windows10-64-qr/opt**
449      :widths: 30 15 15 15 15
450      :header-rows: 1
451
452      * - **Test Name**
453        - mozilla-central
454        - autoland
455        - mozilla-release
456        - mozilla-beta
457      * - **browsertime-benchmark-firefox-assorted-dom-e10s**
458        - ❌
459        - ❌
460        - ❌
461        - ❌
462      * - **browsertime-benchmark-firefox-assorted-dom-fis-e10s**
463        - ❌
464        - ❌
465        - ❌
466        - ❌
467
468
469   .. list-table:: **test-windows10-64-shippable-qr/opt**
470      :widths: 30 15 15 15 15
471      :header-rows: 1
472
473      * - **Test Name**
474        - mozilla-central
475        - autoland
476        - mozilla-release
477        - mozilla-beta
478      * - **browsertime-benchmark-chrome-assorted-dom-e10s**
479        - ❌
480        - ❌
481        - ❌
482        - ❌
483      * - **browsertime-benchmark-chromium-assorted-dom-e10s**
484        - ❌
485        - ❌
486        - ❌
487        - ❌
488      * - **browsertime-benchmark-firefox-assorted-dom-e10s**
489        - ❌
490        - ❌
491        - ❌
492        - ❌
493      * - **browsertime-benchmark-firefox-assorted-dom-fis-e10s**
494        - ✅
495        - ✅
496        - ✅
497        - ✅
498
499
500
501.. dropdown:: jetstream2
502   :container: + anchor-id-jetstream2-b
503
504   **Owner**: :jandem and SpiderMonkey Team
505
506   * **alert threshold**: 2.0
507   * **apps**: firefox, chrome, chromium
508   * **expected**: pass
509   * **fetch task**: jetstream2
510   * **gecko profile entries**: 14000000
511   * **gecko profile interval**: 1
512   * **lower is better**: false
513   * **page cycles**: 4
514   * **page timeout**: 2000000
515   * **subtest lower is better**: false
516   * **subtest unit**: score
517   * **test url**: `<http://\<host\>:\<port\>/JetStream2/index.html?raptor>`__
518   * **type**: benchmark
519   * **unit**: score
520   * **Test Task**:
521
522   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
523      :widths: 30 15 15 15 15
524      :header-rows: 1
525
526      * - **Test Name**
527        - mozilla-central
528        - autoland
529        - mozilla-release
530        - mozilla-beta
531      * - **browsertime-benchmark-firefox-jetstream2-e10s**
532        - ❌
533        - ❌
534        - ❌
535        - ❌
536      * - **browsertime-benchmark-firefox-jetstream2-fis-e10s**
537        - ❌
538        - ❌
539        - ❌
540        - ❌
541
542
543   .. list-table:: **test-linux1804-64-qr/opt**
544      :widths: 30 15 15 15 15
545      :header-rows: 1
546
547      * - **Test Name**
548        - mozilla-central
549        - autoland
550        - mozilla-release
551        - mozilla-beta
552      * - **browsertime-benchmark-firefox-jetstream2-e10s**
553        - ❌
554        - ❌
555        - ❌
556        - ❌
557      * - **browsertime-benchmark-firefox-jetstream2-fis-e10s**
558        - ❌
559        - ❌
560        - ❌
561        - ❌
562
563
564   .. list-table:: **test-linux1804-64-shippable-qr/opt**
565      :widths: 30 15 15 15 15
566      :header-rows: 1
567
568      * - **Test Name**
569        - mozilla-central
570        - autoland
571        - mozilla-release
572        - mozilla-beta
573      * - **browsertime-benchmark-chrome-jetstream2-e10s**
574        - ❌
575        - ❌
576        - ❌
577        - ❌
578      * - **browsertime-benchmark-chromium-jetstream2-e10s**
579        - ❌
580        - ❌
581        - ❌
582        - ❌
583      * - **browsertime-benchmark-firefox-jetstream2-e10s**
584        - ❌
585        - ❌
586        - ❌
587        - ❌
588      * - **browsertime-benchmark-firefox-jetstream2-fis-e10s**
589        - ✅
590        - ✅
591        - ✅
592        - ✅
593
594
595   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
596      :widths: 30 15 15 15 15
597      :header-rows: 1
598
599      * - **Test Name**
600        - mozilla-central
601        - autoland
602        - mozilla-release
603        - mozilla-beta
604      * - **browsertime-benchmark-chrome-jetstream2-e10s**
605        - ❌
606        - ❌
607        - ❌
608        - ❌
609      * - **browsertime-benchmark-chromium-jetstream2-e10s**
610        - ❌
611        - ❌
612        - ❌
613        - ❌
614      * - **browsertime-benchmark-firefox-jetstream2-e10s**
615        - ❌
616        - ❌
617        - ❌
618        - ❌
619      * - **browsertime-benchmark-firefox-jetstream2-fis-e10s**
620        - ✅
621        - ✅
622        - ✅
623        - ✅
624
625
626   .. list-table:: **test-windows10-32-qr/opt**
627      :widths: 30 15 15 15 15
628      :header-rows: 1
629
630      * - **Test Name**
631        - mozilla-central
632        - autoland
633        - mozilla-release
634        - mozilla-beta
635      * - **browsertime-benchmark-firefox-jetstream2-e10s**
636        - ❌
637        - ❌
638        - ❌
639        - ❌
640      * - **browsertime-benchmark-firefox-jetstream2-fis-e10s**
641        - ❌
642        - ❌
643        - ❌
644        - ❌
645
646
647   .. list-table:: **test-windows10-32-shippable-qr/opt**
648      :widths: 30 15 15 15 15
649      :header-rows: 1
650
651      * - **Test Name**
652        - mozilla-central
653        - autoland
654        - mozilla-release
655        - mozilla-beta
656      * - **browsertime-benchmark-chrome-jetstream2-e10s**
657        - ❌
658        - ❌
659        - ❌
660        - ❌
661      * - **browsertime-benchmark-chromium-jetstream2-e10s**
662        - ❌
663        - ❌
664        - ❌
665        - ❌
666      * - **browsertime-benchmark-firefox-jetstream2-e10s**
667        - ❌
668        - ❌
669        - ❌
670        - ❌
671      * - **browsertime-benchmark-firefox-jetstream2-fis-e10s**
672        - ❌
673        - ❌
674        - ❌
675        - ❌
676
677
678   .. list-table:: **test-windows10-64-qr/opt**
679      :widths: 30 15 15 15 15
680      :header-rows: 1
681
682      * - **Test Name**
683        - mozilla-central
684        - autoland
685        - mozilla-release
686        - mozilla-beta
687      * - **browsertime-benchmark-firefox-jetstream2-e10s**
688        - ❌
689        - ❌
690        - ❌
691        - ❌
692      * - **browsertime-benchmark-firefox-jetstream2-fis-e10s**
693        - ❌
694        - ❌
695        - ❌
696        - ❌
697
698
699   .. list-table:: **test-windows10-64-shippable-qr/opt**
700      :widths: 30 15 15 15 15
701      :header-rows: 1
702
703      * - **Test Name**
704        - mozilla-central
705        - autoland
706        - mozilla-release
707        - mozilla-beta
708      * - **browsertime-benchmark-chrome-jetstream2-e10s**
709        - ❌
710        - ❌
711        - ❌
712        - ❌
713      * - **browsertime-benchmark-chromium-jetstream2-e10s**
714        - ❌
715        - ❌
716        - ❌
717        - ❌
718      * - **browsertime-benchmark-firefox-jetstream2-e10s**
719        - ❌
720        - ❌
721        - ❌
722        - ❌
723      * - **browsertime-benchmark-firefox-jetstream2-fis-e10s**
724        - ✅
725        - ✅
726        - ✅
727        - ✅
728
729
730
731.. dropdown:: matrix-react-bench
732   :container: + anchor-id-matrix-react-bench-b
733
734   **Owner**: :jandem and SpiderMonkey Team
735
736   * **alert threshold**: 2.0
737   * **apps**: firefox, chrome, chromium
738   * **expected**: pass
739   * **fetch task**: matrix-react-bench
740   * **gecko profile entries**: 14000000
741   * **gecko profile interval**: 1
742   * **lower is better**: true
743   * **page cycles**: 30
744   * **page timeout**: 2000000
745   * **subtest lower is better**: true
746   * **subtest unit**: ms
747   * **test url**: `<http://\<host\>:\<port\>/matrix-react-bench/matrix_demo.html>`__
748   * **type**: benchmark
749   * **unit**: ms
750   * **Test Task**:
751
752   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
753      :widths: 30 15 15 15 15
754      :header-rows: 1
755
756      * - **Test Name**
757        - mozilla-central
758        - autoland
759        - mozilla-release
760        - mozilla-beta
761      * - **browsertime-benchmark-firefox-matrix-react-bench-e10s**
762        - ❌
763        - ❌
764        - ❌
765        - ❌
766      * - **browsertime-benchmark-firefox-matrix-react-bench-fis-e10s**
767        - ❌
768        - ❌
769        - ❌
770        - ❌
771
772
773   .. list-table:: **test-linux1804-64-qr/opt**
774      :widths: 30 15 15 15 15
775      :header-rows: 1
776
777      * - **Test Name**
778        - mozilla-central
779        - autoland
780        - mozilla-release
781        - mozilla-beta
782      * - **browsertime-benchmark-firefox-matrix-react-bench-e10s**
783        - ❌
784        - ❌
785        - ❌
786        - ❌
787      * - **browsertime-benchmark-firefox-matrix-react-bench-fis-e10s**
788        - ❌
789        - ❌
790        - ❌
791        - ❌
792
793
794   .. list-table:: **test-linux1804-64-shippable-qr/opt**
795      :widths: 30 15 15 15 15
796      :header-rows: 1
797
798      * - **Test Name**
799        - mozilla-central
800        - autoland
801        - mozilla-release
802        - mozilla-beta
803      * - **browsertime-benchmark-chrome-matrix-react-bench-e10s**
804        - ❌
805        - ❌
806        - ❌
807        - ❌
808      * - **browsertime-benchmark-chromium-matrix-react-bench-e10s**
809        - ❌
810        - ❌
811        - ❌
812        - ❌
813      * - **browsertime-benchmark-firefox-matrix-react-bench-e10s**
814        - ❌
815        - ❌
816        - ❌
817        - ❌
818      * - **browsertime-benchmark-firefox-matrix-react-bench-fis-e10s**
819        - ✅
820        - ✅
821        - ✅
822        - ✅
823
824
825   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
826      :widths: 30 15 15 15 15
827      :header-rows: 1
828
829      * - **Test Name**
830        - mozilla-central
831        - autoland
832        - mozilla-release
833        - mozilla-beta
834      * - **browsertime-benchmark-chrome-matrix-react-bench-e10s**
835        - ❌
836        - ❌
837        - ❌
838        - ❌
839      * - **browsertime-benchmark-chromium-matrix-react-bench-e10s**
840        - ❌
841        - ❌
842        - ❌
843        - ❌
844      * - **browsertime-benchmark-firefox-matrix-react-bench-e10s**
845        - ❌
846        - ❌
847        - ❌
848        - ❌
849      * - **browsertime-benchmark-firefox-matrix-react-bench-fis-e10s**
850        - ✅
851        - ✅
852        - ✅
853        - ✅
854
855
856   .. list-table:: **test-windows10-32-qr/opt**
857      :widths: 30 15 15 15 15
858      :header-rows: 1
859
860      * - **Test Name**
861        - mozilla-central
862        - autoland
863        - mozilla-release
864        - mozilla-beta
865      * - **browsertime-benchmark-firefox-matrix-react-bench-e10s**
866        - ❌
867        - ❌
868        - ❌
869        - ❌
870      * - **browsertime-benchmark-firefox-matrix-react-bench-fis-e10s**
871        - ❌
872        - ❌
873        - ❌
874        - ❌
875
876
877   .. list-table:: **test-windows10-32-shippable-qr/opt**
878      :widths: 30 15 15 15 15
879      :header-rows: 1
880
881      * - **Test Name**
882        - mozilla-central
883        - autoland
884        - mozilla-release
885        - mozilla-beta
886      * - **browsertime-benchmark-chrome-matrix-react-bench-e10s**
887        - ❌
888        - ❌
889        - ❌
890        - ❌
891      * - **browsertime-benchmark-chromium-matrix-react-bench-e10s**
892        - ❌
893        - ❌
894        - ❌
895        - ❌
896      * - **browsertime-benchmark-firefox-matrix-react-bench-e10s**
897        - ❌
898        - ❌
899        - ❌
900        - ❌
901      * - **browsertime-benchmark-firefox-matrix-react-bench-fis-e10s**
902        - ❌
903        - ❌
904        - ❌
905        - ❌
906
907
908   .. list-table:: **test-windows10-64-qr/opt**
909      :widths: 30 15 15 15 15
910      :header-rows: 1
911
912      * - **Test Name**
913        - mozilla-central
914        - autoland
915        - mozilla-release
916        - mozilla-beta
917      * - **browsertime-benchmark-firefox-matrix-react-bench-e10s**
918        - ❌
919        - ❌
920        - ❌
921        - ❌
922      * - **browsertime-benchmark-firefox-matrix-react-bench-fis-e10s**
923        - ❌
924        - ❌
925        - ❌
926        - ❌
927
928
929   .. list-table:: **test-windows10-64-shippable-qr/opt**
930      :widths: 30 15 15 15 15
931      :header-rows: 1
932
933      * - **Test Name**
934        - mozilla-central
935        - autoland
936        - mozilla-release
937        - mozilla-beta
938      * - **browsertime-benchmark-chrome-matrix-react-bench-e10s**
939        - ❌
940        - ❌
941        - ❌
942        - ❌
943      * - **browsertime-benchmark-chromium-matrix-react-bench-e10s**
944        - ❌
945        - ❌
946        - ❌
947        - ❌
948      * - **browsertime-benchmark-firefox-matrix-react-bench-e10s**
949        - ❌
950        - ❌
951        - ❌
952        - ❌
953      * - **browsertime-benchmark-firefox-matrix-react-bench-fis-e10s**
954        - ✅
955        - ✅
956        - ✅
957        - ✅
958
959
960
961.. dropdown:: motionmark-animometer
962   :container: + anchor-id-motionmark-animometer-b
963
964   **Owner**: :jgilbert and Graphics(gfx) Team
965
966   * **alert threshold**: 2.0
967   * **apps**: firefox, chrome, chromium
968   * **expected**: pass
969   * **gecko profile entries**: 8000000
970   * **gecko profile interval**: 1
971   * **lower is better**: false
972   * **page cycles**: 1
973   * **page timeout**: 600000
974   * **test url**: `<http://\<host\>:\<port\>/MotionMark/developer.html?test-interval=15&display=minimal&tiles=big&controller=fixed&frame-rate=30&kalman-process-error=1&kalman-measurement-error=4&time-measurement=performance&suite-name=Animometer&raptor=true&oskey={platform}>`__
975   * **type**: benchmark
976   * **unit**: score
977   * **Test Task**:
978
979   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
980      :widths: 30 15 15 15 15
981      :header-rows: 1
982
983      * - **Test Name**
984        - mozilla-central
985        - autoland
986        - mozilla-release
987        - mozilla-beta
988      * - **browsertime-benchmark-firefox-motionmark-animometer-e10s**
989        - ❌
990        - ❌
991        - ❌
992        - ❌
993      * - **browsertime-benchmark-firefox-motionmark-animometer-fis-e10s**
994        - ❌
995        - ❌
996        - ❌
997        - ❌
998
999
1000   .. list-table:: **test-linux1804-64-qr/opt**
1001      :widths: 30 15 15 15 15
1002      :header-rows: 1
1003
1004      * - **Test Name**
1005        - mozilla-central
1006        - autoland
1007        - mozilla-release
1008        - mozilla-beta
1009      * - **browsertime-benchmark-firefox-motionmark-animometer-e10s**
1010        - ❌
1011        - ❌
1012        - ❌
1013        - ❌
1014      * - **browsertime-benchmark-firefox-motionmark-animometer-fis-e10s**
1015        - ❌
1016        - ❌
1017        - ❌
1018        - ❌
1019
1020
1021   .. list-table:: **test-linux1804-64-shippable-qr/opt**
1022      :widths: 30 15 15 15 15
1023      :header-rows: 1
1024
1025      * - **Test Name**
1026        - mozilla-central
1027        - autoland
1028        - mozilla-release
1029        - mozilla-beta
1030      * - **browsertime-benchmark-chrome-motionmark-animometer-e10s**
1031        - ❌
1032        - ❌
1033        - ❌
1034        - ❌
1035      * - **browsertime-benchmark-chromium-motionmark-animometer-e10s**
1036        - ❌
1037        - ❌
1038        - ❌
1039        - ❌
1040      * - **browsertime-benchmark-firefox-motionmark-animometer-e10s**
1041        - ❌
1042        - ❌
1043        - ❌
1044        - ❌
1045      * - **browsertime-benchmark-firefox-motionmark-animometer-fis-e10s**
1046        - ✅
1047        - ✅
1048        - ✅
1049        - ✅
1050
1051
1052   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
1053      :widths: 30 15 15 15 15
1054      :header-rows: 1
1055
1056      * - **Test Name**
1057        - mozilla-central
1058        - autoland
1059        - mozilla-release
1060        - mozilla-beta
1061      * - **browsertime-benchmark-chrome-motionmark-animometer-e10s**
1062        - ❌
1063        - ❌
1064        - ❌
1065        - ❌
1066      * - **browsertime-benchmark-chromium-motionmark-animometer-e10s**
1067        - ❌
1068        - ❌
1069        - ❌
1070        - ❌
1071      * - **browsertime-benchmark-firefox-motionmark-animometer-e10s**
1072        - ❌
1073        - ❌
1074        - ❌
1075        - ❌
1076      * - **browsertime-benchmark-firefox-motionmark-animometer-fis-e10s**
1077        - ✅
1078        - ✅
1079        - ✅
1080        - ✅
1081
1082
1083   .. list-table:: **test-windows10-32-qr/opt**
1084      :widths: 30 15 15 15 15
1085      :header-rows: 1
1086
1087      * - **Test Name**
1088        - mozilla-central
1089        - autoland
1090        - mozilla-release
1091        - mozilla-beta
1092      * - **browsertime-benchmark-firefox-motionmark-animometer-e10s**
1093        - ❌
1094        - ❌
1095        - ❌
1096        - ❌
1097      * - **browsertime-benchmark-firefox-motionmark-animometer-fis-e10s**
1098        - ❌
1099        - ❌
1100        - ❌
1101        - ❌
1102
1103
1104   .. list-table:: **test-windows10-32-shippable-qr/opt**
1105      :widths: 30 15 15 15 15
1106      :header-rows: 1
1107
1108      * - **Test Name**
1109        - mozilla-central
1110        - autoland
1111        - mozilla-release
1112        - mozilla-beta
1113      * - **browsertime-benchmark-chrome-motionmark-animometer-e10s**
1114        - ❌
1115        - ❌
1116        - ❌
1117        - ❌
1118      * - **browsertime-benchmark-chromium-motionmark-animometer-e10s**
1119        - ❌
1120        - ❌
1121        - ❌
1122        - ❌
1123      * - **browsertime-benchmark-firefox-motionmark-animometer-e10s**
1124        - ❌
1125        - ❌
1126        - ❌
1127        - ❌
1128      * - **browsertime-benchmark-firefox-motionmark-animometer-fis-e10s**
1129        - ❌
1130        - ❌
1131        - ❌
1132        - ❌
1133
1134
1135   .. list-table:: **test-windows10-64-qr/opt**
1136      :widths: 30 15 15 15 15
1137      :header-rows: 1
1138
1139      * - **Test Name**
1140        - mozilla-central
1141        - autoland
1142        - mozilla-release
1143        - mozilla-beta
1144      * - **browsertime-benchmark-firefox-motionmark-animometer-e10s**
1145        - ❌
1146        - ❌
1147        - ❌
1148        - ❌
1149      * - **browsertime-benchmark-firefox-motionmark-animometer-fis-e10s**
1150        - ❌
1151        - ❌
1152        - ❌
1153        - ❌
1154
1155
1156   .. list-table:: **test-windows10-64-shippable-qr/opt**
1157      :widths: 30 15 15 15 15
1158      :header-rows: 1
1159
1160      * - **Test Name**
1161        - mozilla-central
1162        - autoland
1163        - mozilla-release
1164        - mozilla-beta
1165      * - **browsertime-benchmark-chrome-motionmark-animometer-e10s**
1166        - ❌
1167        - ❌
1168        - ❌
1169        - ❌
1170      * - **browsertime-benchmark-chromium-motionmark-animometer-e10s**
1171        - ❌
1172        - ❌
1173        - ❌
1174        - ❌
1175      * - **browsertime-benchmark-firefox-motionmark-animometer-e10s**
1176        - ❌
1177        - ❌
1178        - ❌
1179        - ❌
1180      * - **browsertime-benchmark-firefox-motionmark-animometer-fis-e10s**
1181        - ✅
1182        - ✅
1183        - ✅
1184        - ✅
1185
1186
1187
1188.. dropdown:: motionmark-htmlsuite
1189   :container: + anchor-id-motionmark-htmlsuite-b
1190
1191   **Owner**: :jgilbert and Graphics(gfx) Team
1192
1193   * **alert threshold**: 2.0
1194   * **apps**: firefox, chrome, chromium
1195   * **expected**: pass
1196   * **gecko profile entries**: 8000000
1197   * **gecko profile interval**: 1
1198   * **lower is better**: false
1199   * **page cycles**: 5
1200   * **page timeout**: 600000
1201   * **test url**: `<http://\<host\>:\<port\>/MotionMark/developer.html?test-interval=15&display=minimal&tiles=big&controller=fixed&frame-rate=30&kalman-process-error=1&kalman-measurement-error=4&time-measurement=performance&suite-name=HTMLsuite&raptor=true&oskey={platform}>`__
1202   * **type**: benchmark
1203   * **unit**: score
1204   * **Test Task**:
1205
1206   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
1207      :widths: 30 15 15 15 15
1208      :header-rows: 1
1209
1210      * - **Test Name**
1211        - mozilla-central
1212        - autoland
1213        - mozilla-release
1214        - mozilla-beta
1215      * - **browsertime-benchmark-firefox-motionmark-htmlsuite-e10s**
1216        - ❌
1217        - ❌
1218        - ❌
1219        - ❌
1220      * - **browsertime-benchmark-firefox-motionmark-htmlsuite-fis-e10s**
1221        - ❌
1222        - ❌
1223        - ❌
1224        - ❌
1225
1226
1227   .. list-table:: **test-linux1804-64-qr/opt**
1228      :widths: 30 15 15 15 15
1229      :header-rows: 1
1230
1231      * - **Test Name**
1232        - mozilla-central
1233        - autoland
1234        - mozilla-release
1235        - mozilla-beta
1236      * - **browsertime-benchmark-firefox-motionmark-htmlsuite-e10s**
1237        - ❌
1238        - ❌
1239        - ❌
1240        - ❌
1241      * - **browsertime-benchmark-firefox-motionmark-htmlsuite-fis-e10s**
1242        - ❌
1243        - ❌
1244        - ❌
1245        - ❌
1246
1247
1248   .. list-table:: **test-linux1804-64-shippable-qr/opt**
1249      :widths: 30 15 15 15 15
1250      :header-rows: 1
1251
1252      * - **Test Name**
1253        - mozilla-central
1254        - autoland
1255        - mozilla-release
1256        - mozilla-beta
1257      * - **browsertime-benchmark-chrome-motionmark-htmlsuite-e10s**
1258        - ❌
1259        - ❌
1260        - ❌
1261        - ❌
1262      * - **browsertime-benchmark-chromium-motionmark-htmlsuite-e10s**
1263        - ❌
1264        - ❌
1265        - ❌
1266        - ❌
1267      * - **browsertime-benchmark-firefox-motionmark-htmlsuite-e10s**
1268        - ❌
1269        - ❌
1270        - ❌
1271        - ❌
1272      * - **browsertime-benchmark-firefox-motionmark-htmlsuite-fis-e10s**
1273        - ✅
1274        - ✅
1275        - ✅
1276        - ✅
1277
1278
1279   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
1280      :widths: 30 15 15 15 15
1281      :header-rows: 1
1282
1283      * - **Test Name**
1284        - mozilla-central
1285        - autoland
1286        - mozilla-release
1287        - mozilla-beta
1288      * - **browsertime-benchmark-chrome-motionmark-htmlsuite-e10s**
1289        - ❌
1290        - ❌
1291        - ❌
1292        - ❌
1293      * - **browsertime-benchmark-chromium-motionmark-htmlsuite-e10s**
1294        - ❌
1295        - ❌
1296        - ❌
1297        - ❌
1298      * - **browsertime-benchmark-firefox-motionmark-htmlsuite-e10s**
1299        - ❌
1300        - ❌
1301        - ❌
1302        - ❌
1303      * - **browsertime-benchmark-firefox-motionmark-htmlsuite-fis-e10s**
1304        - ✅
1305        - ✅
1306        - ✅
1307        - ✅
1308
1309
1310   .. list-table:: **test-windows10-32-qr/opt**
1311      :widths: 30 15 15 15 15
1312      :header-rows: 1
1313
1314      * - **Test Name**
1315        - mozilla-central
1316        - autoland
1317        - mozilla-release
1318        - mozilla-beta
1319      * - **browsertime-benchmark-firefox-motionmark-htmlsuite-e10s**
1320        - ❌
1321        - ❌
1322        - ❌
1323        - ❌
1324      * - **browsertime-benchmark-firefox-motionmark-htmlsuite-fis-e10s**
1325        - ❌
1326        - ❌
1327        - ❌
1328        - ❌
1329
1330
1331   .. list-table:: **test-windows10-32-shippable-qr/opt**
1332      :widths: 30 15 15 15 15
1333      :header-rows: 1
1334
1335      * - **Test Name**
1336        - mozilla-central
1337        - autoland
1338        - mozilla-release
1339        - mozilla-beta
1340      * - **browsertime-benchmark-chrome-motionmark-htmlsuite-e10s**
1341        - ❌
1342        - ❌
1343        - ❌
1344        - ❌
1345      * - **browsertime-benchmark-chromium-motionmark-htmlsuite-e10s**
1346        - ❌
1347        - ❌
1348        - ❌
1349        - ❌
1350      * - **browsertime-benchmark-firefox-motionmark-htmlsuite-e10s**
1351        - ❌
1352        - ❌
1353        - ❌
1354        - ❌
1355      * - **browsertime-benchmark-firefox-motionmark-htmlsuite-fis-e10s**
1356        - ❌
1357        - ❌
1358        - ❌
1359        - ❌
1360
1361
1362   .. list-table:: **test-windows10-64-qr/opt**
1363      :widths: 30 15 15 15 15
1364      :header-rows: 1
1365
1366      * - **Test Name**
1367        - mozilla-central
1368        - autoland
1369        - mozilla-release
1370        - mozilla-beta
1371      * - **browsertime-benchmark-firefox-motionmark-htmlsuite-e10s**
1372        - ❌
1373        - ❌
1374        - ❌
1375        - ❌
1376      * - **browsertime-benchmark-firefox-motionmark-htmlsuite-fis-e10s**
1377        - ❌
1378        - ❌
1379        - ❌
1380        - ❌
1381
1382
1383   .. list-table:: **test-windows10-64-shippable-qr/opt**
1384      :widths: 30 15 15 15 15
1385      :header-rows: 1
1386
1387      * - **Test Name**
1388        - mozilla-central
1389        - autoland
1390        - mozilla-release
1391        - mozilla-beta
1392      * - **browsertime-benchmark-chrome-motionmark-htmlsuite-e10s**
1393        - ❌
1394        - ❌
1395        - ❌
1396        - ❌
1397      * - **browsertime-benchmark-chromium-motionmark-htmlsuite-e10s**
1398        - ❌
1399        - ❌
1400        - ❌
1401        - ❌
1402      * - **browsertime-benchmark-firefox-motionmark-htmlsuite-e10s**
1403        - ❌
1404        - ❌
1405        - ❌
1406        - ❌
1407      * - **browsertime-benchmark-firefox-motionmark-htmlsuite-fis-e10s**
1408        - ✅
1409        - ✅
1410        - ✅
1411        - ✅
1412
1413
1414
1415.. dropdown:: raptor-speedometer-geckoview
1416   :container: + anchor-id-raptor-speedometer-geckoview-b
1417
1418   **Owner**: SpiderMonkey Team
1419
1420   * **alert threshold**: 2.0
1421   * **apps**: geckoview
1422   * **expected**: pass
1423   * **gecko profile entries**: 14000000
1424   * **gecko profile interval**: 1
1425   * **lower is better**: false
1426   * **page cycles**: 1
1427   * **page timeout**: 420000
1428   * **subtest lower is better**: true
1429   * **subtest unit**: ms
1430   * **test url**: `<http://\<host\>:\<port\>/Speedometer/index.html?raptor>`__
1431   * **type**: benchmark
1432   * **unit**: score
1433
1434.. dropdown:: raptor-youtube-playback-h264-1080p30-firefox
1435   :container: + anchor-id-raptor-youtube-playback-h264-1080p30-firefox-b
1436
1437   **Owner**: PerfTest Team
1438
1439   * **alert threshold**: 2.0
1440   * **apps**: firefox
1441   * **expected**: pass
1442   * **lower is better**: true
1443   * **page cycles**: 20
1444   * **page timeout**: 2700000
1445   * **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false}
1446   * **subtest lower is better**: true
1447   * **subtest unit**: score
1448   * **test url**: `<https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-h264-test&tests=18&raptor=true&muted=true&command=run&exclude=1,2>`__
1449   * **type**: benchmark
1450   * **unit**: score
1451   * **use live sites**: true
1452
1453.. dropdown:: raptor-youtube-playback-h264-1080p60-firefox
1454   :container: + anchor-id-raptor-youtube-playback-h264-1080p60-firefox-b
1455
1456   **Owner**: PerfTest Team
1457
1458   * **alert threshold**: 2.0
1459   * **apps**: firefox
1460   * **expected**: pass
1461   * **lower is better**: true
1462   * **page cycles**: 20
1463   * **page timeout**: 2700000
1464   * **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false}
1465   * **subtest lower is better**: true
1466   * **subtest unit**: score
1467   * **test url**: `<https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-hfr-test&raptor=true&tests=46&muted=true&command=run&exclude=1,2>`__
1468   * **type**: benchmark
1469   * **unit**: score
1470   * **use live sites**: true
1471
1472.. dropdown:: raptor-youtube-playback-h264-full-1080p30-firefox
1473   :container: + anchor-id-raptor-youtube-playback-h264-full-1080p30-firefox-b
1474
1475   **Owner**: PerfTest Team
1476
1477   * **alert threshold**: 2.0
1478   * **apps**: firefox
1479   * **expected**: pass
1480   * **lower is better**: true
1481   * **page cycles**: 20
1482   * **page timeout**: 2700000
1483   * **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false, "full-screen-api.allow-trusted-requests-only": false, "full-screen-api.warning.timeout": 0}
1484   * **subtest lower is better**: true
1485   * **subtest unit**: score
1486   * **test url**: `<https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-h264-test&tests=18&raptor=true&muted=true&command=run&fullscreen=true&exclude=1,2>`__
1487   * **type**: benchmark
1488   * **unit**: score
1489   * **use live sites**: true
1490
1491.. dropdown:: raptor-youtube-playback-h264-full-1080p60-firefox
1492   :container: + anchor-id-raptor-youtube-playback-h264-full-1080p60-firefox-b
1493
1494   **Owner**: PerfTest Team
1495
1496   * **alert threshold**: 2.0
1497   * **apps**: firefox
1498   * **expected**: pass
1499   * **lower is better**: true
1500   * **page cycles**: 20
1501   * **page timeout**: 2700000
1502   * **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false, "full-screen-api.allow-trusted-requests-only": false, "full-screen-api.warning.timeout": 0}
1503   * **subtest lower is better**: true
1504   * **subtest unit**: score
1505   * **test url**: `<https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-hfr-test&raptor=true&tests=46&muted=true&command=run&fullscreen=true&exclude=1,2>`__
1506   * **type**: benchmark
1507   * **unit**: score
1508   * **use live sites**: true
1509
1510.. dropdown:: raptor-youtube-playback-v9-1080p30-firefox
1511   :container: + anchor-id-raptor-youtube-playback-v9-1080p30-firefox-b
1512
1513   **Owner**: PerfTest Team
1514
1515   * **alert threshold**: 2.0
1516   * **apps**: firefox
1517   * **expected**: pass
1518   * **lower is better**: true
1519   * **page cycles**: 20
1520   * **page timeout**: 2700000
1521   * **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false}
1522   * **subtest lower is better**: true
1523   * **subtest unit**: score
1524   * **test url**: `<https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-vp9-test&raptor=true&tests=18&muted=true&command=run&exclude=1,2>`__
1525   * **type**: benchmark
1526   * **unit**: score
1527   * **use live sites**: true
1528
1529.. dropdown:: raptor-youtube-playback-v9-1080p60-firefox
1530   :container: + anchor-id-raptor-youtube-playback-v9-1080p60-firefox-b
1531
1532   **Owner**: PerfTest Team
1533
1534   * **alert threshold**: 2.0
1535   * **apps**: firefox
1536   * **expected**: pass
1537   * **lower is better**: true
1538   * **page cycles**: 20
1539   * **page timeout**: 2700000
1540   * **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false}
1541   * **subtest lower is better**: true
1542   * **subtest unit**: score
1543   * **test url**: `<https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-hfr-test&raptor=true&tests=14&muted=true&command=run&exclude=1,2>`__
1544   * **type**: benchmark
1545   * **unit**: score
1546   * **use live sites**: true
1547
1548.. dropdown:: raptor-youtube-playback-v9-full-1080p30-firefox
1549   :container: + anchor-id-raptor-youtube-playback-v9-full-1080p30-firefox-b
1550
1551   **Owner**: PerfTest Team
1552
1553   * **alert threshold**: 2.0
1554   * **apps**: firefox
1555   * **expected**: pass
1556   * **lower is better**: true
1557   * **page cycles**: 20
1558   * **page timeout**: 2700000
1559   * **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false, "full-screen-api.allow-trusted-requests-only": false, "full-screen-api.warning.timeout": 0}
1560   * **subtest lower is better**: true
1561   * **subtest unit**: score
1562   * **test url**: `<https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-vp9-test&raptor=true&tests=18&muted=true&command=run&fullscreen=true&exclude=1,2>`__
1563   * **type**: benchmark
1564   * **unit**: score
1565   * **use live sites**: true
1566
1567.. dropdown:: raptor-youtube-playback-v9-full-1080p60-firefox
1568   :container: + anchor-id-raptor-youtube-playback-v9-full-1080p60-firefox-b
1569
1570   **Owner**: PerfTest Team
1571
1572   * **alert threshold**: 2.0
1573   * **apps**: firefox
1574   * **expected**: pass
1575   * **lower is better**: true
1576   * **page cycles**: 20
1577   * **page timeout**: 2700000
1578   * **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false, "full-screen-api.allow-trusted-requests-only": false, "full-screen-api.warning.timeout": 0}
1579   * **subtest lower is better**: true
1580   * **subtest unit**: score
1581   * **test url**: `<https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-hfr-test&raptor=true&tests=14&muted=true&command=run&fullscreen=true&exclude=1,2>`__
1582   * **type**: benchmark
1583   * **unit**: score
1584   * **use live sites**: true
1585
1586.. dropdown:: speedometer
1587   :container: + anchor-id-speedometer-b
1588
1589   **Owner**: SpiderMonkey Team
1590
1591   * **alert threshold**: 2.0
1592   * **apps**: firefox, chrome, chromium
1593   * **expected**: pass
1594   * **gecko profile entries**: 14000000
1595   * **gecko profile interval**: 1
1596   * **lower is better**: false
1597   * **page cycles**: 5
1598   * **page timeout**: 180000
1599   * **subtest lower is better**: true
1600   * **subtest unit**: ms
1601   * **test url**: `<http://\<host\>:\<port\>/Speedometer/index.html?raptor>`__
1602   * **type**: benchmark
1603   * **unit**: score
1604   * **Test Task**:
1605
1606   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
1607      :widths: 30 15 15 15 15
1608      :header-rows: 1
1609
1610      * - **Test Name**
1611        - mozilla-central
1612        - autoland
1613        - mozilla-release
1614        - mozilla-beta
1615      * - **browsertime-power-fenix-speedometer-e10s**
1616        - ❌
1617        - ❌
1618        - ❌
1619        - ❌
1620      * - **browsertime-power-geckoview-speedometer-e10s**
1621        - ❌
1622        - ❌
1623        - ❌
1624        - ❌
1625      * - **browsertime-power-refbrow-speedometer-e10s**
1626        - ❌
1627        - ❌
1628        - ❌
1629        - ❌
1630      * - **browsertime-speedometer-mobile-fenix-e10s**
1631        - ❌
1632        - ❌
1633        - ❌
1634        - ❌
1635      * - **browsertime-speedometer-mobile-geckoview-e10s**
1636        - ❌
1637        - ❌
1638        - ❌
1639        - ❌
1640
1641
1642   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
1643      :widths: 30 15 15 15 15
1644      :header-rows: 1
1645
1646      * - **Test Name**
1647        - mozilla-central
1648        - autoland
1649        - mozilla-release
1650        - mozilla-beta
1651      * - **browsertime-power-fenix-speedometer-e10s**
1652        - ❌
1653        - ❌
1654        - ❌
1655        - ❌
1656      * - **browsertime-power-geckoview-speedometer-e10s**
1657        - ❌
1658        - ❌
1659        - ❌
1660        - ❌
1661      * - **browsertime-power-refbrow-speedometer-e10s**
1662        - ❌
1663        - ❌
1664        - ❌
1665        - ❌
1666      * - **browsertime-speedometer-mobile-chrome-m-e10s**
1667        - ❌
1668        - ❌
1669        - ❌
1670        - ❌
1671      * - **browsertime-speedometer-mobile-fenix-e10s**
1672        - ❌
1673        - ❌
1674        - ❌
1675        - ❌
1676      * - **browsertime-speedometer-mobile-geckoview-e10s**
1677        - ✅
1678        - ✅
1679        - ✅
1680        - ✅
1681
1682
1683   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
1684      :widths: 30 15 15 15 15
1685      :header-rows: 1
1686
1687      * - **Test Name**
1688        - mozilla-central
1689        - autoland
1690        - mozilla-release
1691        - mozilla-beta
1692      * - **browsertime-power-fenix-speedometer-e10s**
1693        - ❌
1694        - ❌
1695        - ❌
1696        - ❌
1697      * - **browsertime-power-geckoview-speedometer-e10s**
1698        - ❌
1699        - ❌
1700        - ❌
1701        - ❌
1702      * - **browsertime-power-refbrow-speedometer-e10s**
1703        - ❌
1704        - ❌
1705        - ❌
1706        - ❌
1707      * - **browsertime-speedometer-mobile-fenix-e10s**
1708        - ❌
1709        - ❌
1710        - ❌
1711        - ❌
1712      * - **browsertime-speedometer-mobile-geckoview-e10s**
1713        - ❌
1714        - ❌
1715        - ❌
1716        - ❌
1717
1718
1719   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
1720      :widths: 30 15 15 15 15
1721      :header-rows: 1
1722
1723      * - **Test Name**
1724        - mozilla-central
1725        - autoland
1726        - mozilla-release
1727        - mozilla-beta
1728      * - **browsertime-power-fenix-speedometer-e10s**
1729        - ❌
1730        - ❌
1731        - ❌
1732        - ❌
1733      * - **browsertime-power-geckoview-speedometer-e10s**
1734        - ❌
1735        - ❌
1736        - ❌
1737        - ❌
1738      * - **browsertime-power-refbrow-speedometer-e10s**
1739        - ❌
1740        - ❌
1741        - ❌
1742        - ❌
1743      * - **browsertime-speedometer-mobile-chrome-m-e10s**
1744        - ✅
1745        - ❌
1746        - ✅
1747        - ❌
1748      * - **browsertime-speedometer-mobile-fenix-e10s**
1749        - ✅
1750        - ❌
1751        - ✅
1752        - ❌
1753      * - **browsertime-speedometer-mobile-geckoview-e10s**
1754        - ✅
1755        - ✅
1756        - ✅
1757        - ✅
1758
1759
1760   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
1761      :widths: 30 15 15 15 15
1762      :header-rows: 1
1763
1764      * - **Test Name**
1765        - mozilla-central
1766        - autoland
1767        - mozilla-release
1768        - mozilla-beta
1769      * - **browsertime-power-fenix-speedometer-e10s**
1770        - ❌
1771        - ❌
1772        - ❌
1773        - ❌
1774      * - **browsertime-power-geckoview-speedometer-e10s**
1775        - ❌
1776        - ❌
1777        - ❌
1778        - ❌
1779      * - **browsertime-power-refbrow-speedometer-e10s**
1780        - ❌
1781        - ❌
1782        - ❌
1783        - ❌
1784      * - **browsertime-speedometer-mobile-fenix-e10s**
1785        - ❌
1786        - ❌
1787        - ❌
1788        - ❌
1789      * - **browsertime-speedometer-mobile-geckoview-e10s**
1790        - ❌
1791        - ❌
1792        - ❌
1793        - ❌
1794
1795
1796   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
1797      :widths: 30 15 15 15 15
1798      :header-rows: 1
1799
1800      * - **Test Name**
1801        - mozilla-central
1802        - autoland
1803        - mozilla-release
1804        - mozilla-beta
1805      * - **browsertime-power-fenix-speedometer-e10s**
1806        - ❌
1807        - ❌
1808        - ❌
1809        - ❌
1810      * - **browsertime-power-geckoview-speedometer-e10s**
1811        - ❌
1812        - ❌
1813        - ❌
1814        - ❌
1815      * - **browsertime-power-refbrow-speedometer-e10s**
1816        - ❌
1817        - ❌
1818        - ❌
1819        - ❌
1820      * - **browsertime-speedometer-mobile-chrome-m-e10s**
1821        - ❌
1822        - ❌
1823        - ❌
1824        - ❌
1825      * - **browsertime-speedometer-mobile-fenix-e10s**
1826        - ❌
1827        - ❌
1828        - ❌
1829        - ❌
1830      * - **browsertime-speedometer-mobile-geckoview-e10s**
1831        - ❌
1832        - ❌
1833        - ❌
1834        - ❌
1835
1836
1837   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
1838      :widths: 30 15 15 15 15
1839      :header-rows: 1
1840
1841      * - **Test Name**
1842        - mozilla-central
1843        - autoland
1844        - mozilla-release
1845        - mozilla-beta
1846      * - **browsertime-speedometer-mobile-fenix-e10s**
1847        - ❌
1848        - ❌
1849        - ❌
1850        - ❌
1851      * - **browsertime-speedometer-mobile-geckoview-e10s**
1852        - ❌
1853        - ❌
1854        - ❌
1855        - ❌
1856
1857
1858   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
1859      :widths: 30 15 15 15 15
1860      :header-rows: 1
1861
1862      * - **Test Name**
1863        - mozilla-central
1864        - autoland
1865        - mozilla-release
1866        - mozilla-beta
1867      * - **browsertime-speedometer-mobile-chrome-m-e10s**
1868        - ❌
1869        - ❌
1870        - ❌
1871        - ❌
1872      * - **browsertime-speedometer-mobile-fenix-e10s**
1873        - ❌
1874        - ❌
1875        - ❌
1876        - ❌
1877      * - **browsertime-speedometer-mobile-geckoview-e10s**
1878        - ❌
1879        - ❌
1880        - ❌
1881        - ❌
1882
1883
1884   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
1885      :widths: 30 15 15 15 15
1886      :header-rows: 1
1887
1888      * - **Test Name**
1889        - mozilla-central
1890        - autoland
1891        - mozilla-release
1892        - mozilla-beta
1893      * - **browsertime-benchmark-firefox-speedometer-e10s**
1894        - ❌
1895        - ❌
1896        - ❌
1897        - ❌
1898      * - **browsertime-benchmark-firefox-speedometer-fis-e10s**
1899        - ❌
1900        - ❌
1901        - ❌
1902        - ❌
1903
1904
1905   .. list-table:: **test-linux1804-64-qr/opt**
1906      :widths: 30 15 15 15 15
1907      :header-rows: 1
1908
1909      * - **Test Name**
1910        - mozilla-central
1911        - autoland
1912        - mozilla-release
1913        - mozilla-beta
1914      * - **browsertime-benchmark-firefox-speedometer-e10s**
1915        - ❌
1916        - ❌
1917        - ❌
1918        - ❌
1919      * - **browsertime-benchmark-firefox-speedometer-fis-e10s**
1920        - ❌
1921        - ❌
1922        - ❌
1923        - ❌
1924
1925
1926   .. list-table:: **test-linux1804-64-shippable-qr/opt**
1927      :widths: 30 15 15 15 15
1928      :header-rows: 1
1929
1930      * - **Test Name**
1931        - mozilla-central
1932        - autoland
1933        - mozilla-release
1934        - mozilla-beta
1935      * - **browsertime-benchmark-chrome-speedometer-e10s**
1936        - ❌
1937        - ❌
1938        - ❌
1939        - ❌
1940      * - **browsertime-benchmark-chromium-speedometer-e10s**
1941        - ❌
1942        - ❌
1943        - ❌
1944        - ❌
1945      * - **browsertime-benchmark-firefox-speedometer-e10s**
1946        - ❌
1947        - ❌
1948        - ❌
1949        - ❌
1950      * - **browsertime-benchmark-firefox-speedometer-fis-e10s**
1951        - ✅
1952        - ✅
1953        - ✅
1954        - ✅
1955
1956
1957   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
1958      :widths: 30 15 15 15 15
1959      :header-rows: 1
1960
1961      * - **Test Name**
1962        - mozilla-central
1963        - autoland
1964        - mozilla-release
1965        - mozilla-beta
1966      * - **browsertime-benchmark-chrome-speedometer-e10s**
1967        - ❌
1968        - ❌
1969        - ❌
1970        - ❌
1971      * - **browsertime-benchmark-chromium-speedometer-e10s**
1972        - ❌
1973        - ❌
1974        - ❌
1975        - ❌
1976      * - **browsertime-benchmark-firefox-speedometer-e10s**
1977        - ❌
1978        - ❌
1979        - ❌
1980        - ❌
1981      * - **browsertime-benchmark-firefox-speedometer-fis-e10s**
1982        - ✅
1983        - ✅
1984        - ✅
1985        - ✅
1986
1987
1988   .. list-table:: **test-windows10-32-qr/opt**
1989      :widths: 30 15 15 15 15
1990      :header-rows: 1
1991
1992      * - **Test Name**
1993        - mozilla-central
1994        - autoland
1995        - mozilla-release
1996        - mozilla-beta
1997      * - **browsertime-benchmark-firefox-speedometer-e10s**
1998        - ❌
1999        - ❌
2000        - ❌
2001        - ❌
2002      * - **browsertime-benchmark-firefox-speedometer-fis-e10s**
2003        - ❌
2004        - ❌
2005        - ❌
2006        - ❌
2007
2008
2009   .. list-table:: **test-windows10-32-shippable-qr/opt**
2010      :widths: 30 15 15 15 15
2011      :header-rows: 1
2012
2013      * - **Test Name**
2014        - mozilla-central
2015        - autoland
2016        - mozilla-release
2017        - mozilla-beta
2018      * - **browsertime-benchmark-chrome-speedometer-e10s**
2019        - ❌
2020        - ❌
2021        - ❌
2022        - ❌
2023      * - **browsertime-benchmark-chromium-speedometer-e10s**
2024        - ❌
2025        - ❌
2026        - ❌
2027        - ❌
2028      * - **browsertime-benchmark-firefox-speedometer-e10s**
2029        - ❌
2030        - ❌
2031        - ❌
2032        - ❌
2033      * - **browsertime-benchmark-firefox-speedometer-fis-e10s**
2034        - ❌
2035        - ❌
2036        - ❌
2037        - ❌
2038
2039
2040   .. list-table:: **test-windows10-64-qr/opt**
2041      :widths: 30 15 15 15 15
2042      :header-rows: 1
2043
2044      * - **Test Name**
2045        - mozilla-central
2046        - autoland
2047        - mozilla-release
2048        - mozilla-beta
2049      * - **browsertime-benchmark-firefox-speedometer-e10s**
2050        - ❌
2051        - ❌
2052        - ❌
2053        - ❌
2054      * - **browsertime-benchmark-firefox-speedometer-fis-e10s**
2055        - ❌
2056        - ❌
2057        - ❌
2058        - ❌
2059
2060
2061   .. list-table:: **test-windows10-64-shippable-qr/opt**
2062      :widths: 30 15 15 15 15
2063      :header-rows: 1
2064
2065      * - **Test Name**
2066        - mozilla-central
2067        - autoland
2068        - mozilla-release
2069        - mozilla-beta
2070      * - **browsertime-benchmark-chrome-speedometer-e10s**
2071        - ❌
2072        - ❌
2073        - ❌
2074        - ❌
2075      * - **browsertime-benchmark-chromium-speedometer-e10s**
2076        - ❌
2077        - ❌
2078        - ❌
2079        - ❌
2080      * - **browsertime-benchmark-firefox-speedometer-e10s**
2081        - ❌
2082        - ❌
2083        - ❌
2084        - ❌
2085      * - **browsertime-benchmark-firefox-speedometer-fis-e10s**
2086        - ✅
2087        - ✅
2088        - ✅
2089        - ✅
2090
2091
2092   **Owner**: SpiderMonkey Team
2093
2094   * **alert threshold**: 2.0
2095   * **apps**: fenix, geckoview, refbrow, chrome-m
2096   * **expected**: pass
2097   * **gecko profile entries**: 14000000
2098   * **gecko profile interval**: 1
2099   * **lower is better**: false
2100   * **page cycles**: 1
2101   * **page timeout**: 420000
2102   * **subtest lower is better**: true
2103   * **subtest unit**: ms
2104   * **test url**: `<http://\<host\>:\<port\>/Speedometer/index.html?raptor>`__
2105   * **type**: benchmark
2106   * **unit**: score
2107   * **Test Task**:
2108
2109   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
2110      :widths: 30 15 15 15 15
2111      :header-rows: 1
2112
2113      * - **Test Name**
2114        - mozilla-central
2115        - autoland
2116        - mozilla-release
2117        - mozilla-beta
2118      * - **browsertime-power-fenix-speedometer-e10s**
2119        - ❌
2120        - ❌
2121        - ❌
2122        - ❌
2123      * - **browsertime-power-geckoview-speedometer-e10s**
2124        - ❌
2125        - ❌
2126        - ❌
2127        - ❌
2128      * - **browsertime-power-refbrow-speedometer-e10s**
2129        - ❌
2130        - ❌
2131        - ❌
2132        - ❌
2133      * - **browsertime-speedometer-mobile-fenix-e10s**
2134        - ❌
2135        - ❌
2136        - ❌
2137        - ❌
2138      * - **browsertime-speedometer-mobile-geckoview-e10s**
2139        - ❌
2140        - ❌
2141        - ❌
2142        - ❌
2143
2144
2145   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
2146      :widths: 30 15 15 15 15
2147      :header-rows: 1
2148
2149      * - **Test Name**
2150        - mozilla-central
2151        - autoland
2152        - mozilla-release
2153        - mozilla-beta
2154      * - **browsertime-power-fenix-speedometer-e10s**
2155        - ❌
2156        - ❌
2157        - ❌
2158        - ❌
2159      * - **browsertime-power-geckoview-speedometer-e10s**
2160        - ❌
2161        - ❌
2162        - ❌
2163        - ❌
2164      * - **browsertime-power-refbrow-speedometer-e10s**
2165        - ❌
2166        - ❌
2167        - ❌
2168        - ❌
2169      * - **browsertime-speedometer-mobile-chrome-m-e10s**
2170        - ❌
2171        - ❌
2172        - ❌
2173        - ❌
2174      * - **browsertime-speedometer-mobile-fenix-e10s**
2175        - ❌
2176        - ❌
2177        - ❌
2178        - ❌
2179      * - **browsertime-speedometer-mobile-geckoview-e10s**
2180        - ✅
2181        - ✅
2182        - ✅
2183        - ✅
2184
2185
2186   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
2187      :widths: 30 15 15 15 15
2188      :header-rows: 1
2189
2190      * - **Test Name**
2191        - mozilla-central
2192        - autoland
2193        - mozilla-release
2194        - mozilla-beta
2195      * - **browsertime-power-fenix-speedometer-e10s**
2196        - ❌
2197        - ❌
2198        - ❌
2199        - ❌
2200      * - **browsertime-power-geckoview-speedometer-e10s**
2201        - ❌
2202        - ❌
2203        - ❌
2204        - ❌
2205      * - **browsertime-power-refbrow-speedometer-e10s**
2206        - ❌
2207        - ❌
2208        - ❌
2209        - ❌
2210      * - **browsertime-speedometer-mobile-fenix-e10s**
2211        - ❌
2212        - ❌
2213        - ❌
2214        - ❌
2215      * - **browsertime-speedometer-mobile-geckoview-e10s**
2216        - ❌
2217        - ❌
2218        - ❌
2219        - ❌
2220
2221
2222   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
2223      :widths: 30 15 15 15 15
2224      :header-rows: 1
2225
2226      * - **Test Name**
2227        - mozilla-central
2228        - autoland
2229        - mozilla-release
2230        - mozilla-beta
2231      * - **browsertime-power-fenix-speedometer-e10s**
2232        - ❌
2233        - ❌
2234        - ❌
2235        - ❌
2236      * - **browsertime-power-geckoview-speedometer-e10s**
2237        - ❌
2238        - ❌
2239        - ❌
2240        - ❌
2241      * - **browsertime-power-refbrow-speedometer-e10s**
2242        - ❌
2243        - ❌
2244        - ❌
2245        - ❌
2246      * - **browsertime-speedometer-mobile-chrome-m-e10s**
2247        - ✅
2248        - ❌
2249        - ✅
2250        - ❌
2251      * - **browsertime-speedometer-mobile-fenix-e10s**
2252        - ✅
2253        - ❌
2254        - ✅
2255        - ❌
2256      * - **browsertime-speedometer-mobile-geckoview-e10s**
2257        - ✅
2258        - ✅
2259        - ✅
2260        - ✅
2261
2262
2263   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
2264      :widths: 30 15 15 15 15
2265      :header-rows: 1
2266
2267      * - **Test Name**
2268        - mozilla-central
2269        - autoland
2270        - mozilla-release
2271        - mozilla-beta
2272      * - **browsertime-power-fenix-speedometer-e10s**
2273        - ❌
2274        - ❌
2275        - ❌
2276        - ❌
2277      * - **browsertime-power-geckoview-speedometer-e10s**
2278        - ❌
2279        - ❌
2280        - ❌
2281        - ❌
2282      * - **browsertime-power-refbrow-speedometer-e10s**
2283        - ❌
2284        - ❌
2285        - ❌
2286        - ❌
2287      * - **browsertime-speedometer-mobile-fenix-e10s**
2288        - ❌
2289        - ❌
2290        - ❌
2291        - ❌
2292      * - **browsertime-speedometer-mobile-geckoview-e10s**
2293        - ❌
2294        - ❌
2295        - ❌
2296        - ❌
2297
2298
2299   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
2300      :widths: 30 15 15 15 15
2301      :header-rows: 1
2302
2303      * - **Test Name**
2304        - mozilla-central
2305        - autoland
2306        - mozilla-release
2307        - mozilla-beta
2308      * - **browsertime-power-fenix-speedometer-e10s**
2309        - ❌
2310        - ❌
2311        - ❌
2312        - ❌
2313      * - **browsertime-power-geckoview-speedometer-e10s**
2314        - ❌
2315        - ❌
2316        - ❌
2317        - ❌
2318      * - **browsertime-power-refbrow-speedometer-e10s**
2319        - ❌
2320        - ❌
2321        - ❌
2322        - ❌
2323      * - **browsertime-speedometer-mobile-chrome-m-e10s**
2324        - ❌
2325        - ❌
2326        - ❌
2327        - ❌
2328      * - **browsertime-speedometer-mobile-fenix-e10s**
2329        - ❌
2330        - ❌
2331        - ❌
2332        - ❌
2333      * - **browsertime-speedometer-mobile-geckoview-e10s**
2334        - ❌
2335        - ❌
2336        - ❌
2337        - ❌
2338
2339
2340   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
2341      :widths: 30 15 15 15 15
2342      :header-rows: 1
2343
2344      * - **Test Name**
2345        - mozilla-central
2346        - autoland
2347        - mozilla-release
2348        - mozilla-beta
2349      * - **browsertime-speedometer-mobile-fenix-e10s**
2350        - ❌
2351        - ❌
2352        - ❌
2353        - ❌
2354      * - **browsertime-speedometer-mobile-geckoview-e10s**
2355        - ❌
2356        - ❌
2357        - ❌
2358        - ❌
2359
2360
2361   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
2362      :widths: 30 15 15 15 15
2363      :header-rows: 1
2364
2365      * - **Test Name**
2366        - mozilla-central
2367        - autoland
2368        - mozilla-release
2369        - mozilla-beta
2370      * - **browsertime-speedometer-mobile-chrome-m-e10s**
2371        - ❌
2372        - ❌
2373        - ❌
2374        - ❌
2375      * - **browsertime-speedometer-mobile-fenix-e10s**
2376        - ❌
2377        - ❌
2378        - ❌
2379        - ❌
2380      * - **browsertime-speedometer-mobile-geckoview-e10s**
2381        - ❌
2382        - ❌
2383        - ❌
2384        - ❌
2385
2386
2387   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
2388      :widths: 30 15 15 15 15
2389      :header-rows: 1
2390
2391      * - **Test Name**
2392        - mozilla-central
2393        - autoland
2394        - mozilla-release
2395        - mozilla-beta
2396      * - **browsertime-benchmark-firefox-speedometer-e10s**
2397        - ❌
2398        - ❌
2399        - ❌
2400        - ❌
2401      * - **browsertime-benchmark-firefox-speedometer-fis-e10s**
2402        - ❌
2403        - ❌
2404        - ❌
2405        - ❌
2406
2407
2408   .. list-table:: **test-linux1804-64-qr/opt**
2409      :widths: 30 15 15 15 15
2410      :header-rows: 1
2411
2412      * - **Test Name**
2413        - mozilla-central
2414        - autoland
2415        - mozilla-release
2416        - mozilla-beta
2417      * - **browsertime-benchmark-firefox-speedometer-e10s**
2418        - ❌
2419        - ❌
2420        - ❌
2421        - ❌
2422      * - **browsertime-benchmark-firefox-speedometer-fis-e10s**
2423        - ❌
2424        - ❌
2425        - ❌
2426        - ❌
2427
2428
2429   .. list-table:: **test-linux1804-64-shippable-qr/opt**
2430      :widths: 30 15 15 15 15
2431      :header-rows: 1
2432
2433      * - **Test Name**
2434        - mozilla-central
2435        - autoland
2436        - mozilla-release
2437        - mozilla-beta
2438      * - **browsertime-benchmark-chrome-speedometer-e10s**
2439        - ❌
2440        - ❌
2441        - ❌
2442        - ❌
2443      * - **browsertime-benchmark-chromium-speedometer-e10s**
2444        - ❌
2445        - ❌
2446        - ❌
2447        - ❌
2448      * - **browsertime-benchmark-firefox-speedometer-e10s**
2449        - ❌
2450        - ❌
2451        - ❌
2452        - ❌
2453      * - **browsertime-benchmark-firefox-speedometer-fis-e10s**
2454        - ✅
2455        - ✅
2456        - ✅
2457        - ✅
2458
2459
2460   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
2461      :widths: 30 15 15 15 15
2462      :header-rows: 1
2463
2464      * - **Test Name**
2465        - mozilla-central
2466        - autoland
2467        - mozilla-release
2468        - mozilla-beta
2469      * - **browsertime-benchmark-chrome-speedometer-e10s**
2470        - ❌
2471        - ❌
2472        - ❌
2473        - ❌
2474      * - **browsertime-benchmark-chromium-speedometer-e10s**
2475        - ❌
2476        - ❌
2477        - ❌
2478        - ❌
2479      * - **browsertime-benchmark-firefox-speedometer-e10s**
2480        - ❌
2481        - ❌
2482        - ❌
2483        - ❌
2484      * - **browsertime-benchmark-firefox-speedometer-fis-e10s**
2485        - ✅
2486        - ✅
2487        - ✅
2488        - ✅
2489
2490
2491   .. list-table:: **test-windows10-32-qr/opt**
2492      :widths: 30 15 15 15 15
2493      :header-rows: 1
2494
2495      * - **Test Name**
2496        - mozilla-central
2497        - autoland
2498        - mozilla-release
2499        - mozilla-beta
2500      * - **browsertime-benchmark-firefox-speedometer-e10s**
2501        - ❌
2502        - ❌
2503        - ❌
2504        - ❌
2505      * - **browsertime-benchmark-firefox-speedometer-fis-e10s**
2506        - ❌
2507        - ❌
2508        - ❌
2509        - ❌
2510
2511
2512   .. list-table:: **test-windows10-32-shippable-qr/opt**
2513      :widths: 30 15 15 15 15
2514      :header-rows: 1
2515
2516      * - **Test Name**
2517        - mozilla-central
2518        - autoland
2519        - mozilla-release
2520        - mozilla-beta
2521      * - **browsertime-benchmark-chrome-speedometer-e10s**
2522        - ❌
2523        - ❌
2524        - ❌
2525        - ❌
2526      * - **browsertime-benchmark-chromium-speedometer-e10s**
2527        - ❌
2528        - ❌
2529        - ❌
2530        - ❌
2531      * - **browsertime-benchmark-firefox-speedometer-e10s**
2532        - ❌
2533        - ❌
2534        - ❌
2535        - ❌
2536      * - **browsertime-benchmark-firefox-speedometer-fis-e10s**
2537        - ❌
2538        - ❌
2539        - ❌
2540        - ❌
2541
2542
2543   .. list-table:: **test-windows10-64-qr/opt**
2544      :widths: 30 15 15 15 15
2545      :header-rows: 1
2546
2547      * - **Test Name**
2548        - mozilla-central
2549        - autoland
2550        - mozilla-release
2551        - mozilla-beta
2552      * - **browsertime-benchmark-firefox-speedometer-e10s**
2553        - ❌
2554        - ❌
2555        - ❌
2556        - ❌
2557      * - **browsertime-benchmark-firefox-speedometer-fis-e10s**
2558        - ❌
2559        - ❌
2560        - ❌
2561        - ❌
2562
2563
2564   .. list-table:: **test-windows10-64-shippable-qr/opt**
2565      :widths: 30 15 15 15 15
2566      :header-rows: 1
2567
2568      * - **Test Name**
2569        - mozilla-central
2570        - autoland
2571        - mozilla-release
2572        - mozilla-beta
2573      * - **browsertime-benchmark-chrome-speedometer-e10s**
2574        - ❌
2575        - ❌
2576        - ❌
2577        - ❌
2578      * - **browsertime-benchmark-chromium-speedometer-e10s**
2579        - ❌
2580        - ❌
2581        - ❌
2582        - ❌
2583      * - **browsertime-benchmark-firefox-speedometer-e10s**
2584        - ❌
2585        - ❌
2586        - ❌
2587        - ❌
2588      * - **browsertime-benchmark-firefox-speedometer-fis-e10s**
2589        - ✅
2590        - ✅
2591        - ✅
2592        - ✅
2593
2594
2595
2596.. dropdown:: stylebench
2597   :container: + anchor-id-stylebench-b
2598
2599   **Owner**: :emelio and Layout Team
2600
2601   * **alert threshold**: 2.0
2602   * **apps**: firefox, chrome, chromium
2603   * **expected**: pass
2604   * **gecko profile entries**: 8000000
2605   * **gecko profile interval**: 1
2606   * **lower is better**: false
2607   * **page cycles**: 5
2608   * **page timeout**: 120000
2609   * **subtest lower is better**: true
2610   * **subtest unit**: ms
2611   * **test url**: `<http://\<host\>:\<port\>/StyleBench/index.html?raptor>`__
2612   * **type**: benchmark
2613   * **unit**: score
2614   * **Test Task**:
2615
2616   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
2617      :widths: 30 15 15 15 15
2618      :header-rows: 1
2619
2620      * - **Test Name**
2621        - mozilla-central
2622        - autoland
2623        - mozilla-release
2624        - mozilla-beta
2625      * - **browsertime-benchmark-firefox-stylebench-e10s**
2626        - ❌
2627        - ❌
2628        - ❌
2629        - ❌
2630      * - **browsertime-benchmark-firefox-stylebench-fis-e10s**
2631        - ❌
2632        - ❌
2633        - ❌
2634        - ❌
2635
2636
2637   .. list-table:: **test-linux1804-64-qr/opt**
2638      :widths: 30 15 15 15 15
2639      :header-rows: 1
2640
2641      * - **Test Name**
2642        - mozilla-central
2643        - autoland
2644        - mozilla-release
2645        - mozilla-beta
2646      * - **browsertime-benchmark-firefox-stylebench-e10s**
2647        - ❌
2648        - ❌
2649        - ❌
2650        - ❌
2651      * - **browsertime-benchmark-firefox-stylebench-fis-e10s**
2652        - ❌
2653        - ❌
2654        - ❌
2655        - ❌
2656
2657
2658   .. list-table:: **test-linux1804-64-shippable-qr/opt**
2659      :widths: 30 15 15 15 15
2660      :header-rows: 1
2661
2662      * - **Test Name**
2663        - mozilla-central
2664        - autoland
2665        - mozilla-release
2666        - mozilla-beta
2667      * - **browsertime-benchmark-chrome-stylebench-e10s**
2668        - ❌
2669        - ❌
2670        - ❌
2671        - ❌
2672      * - **browsertime-benchmark-chromium-stylebench-e10s**
2673        - ❌
2674        - ❌
2675        - ❌
2676        - ❌
2677      * - **browsertime-benchmark-firefox-stylebench-e10s**
2678        - ❌
2679        - ❌
2680        - ❌
2681        - ❌
2682      * - **browsertime-benchmark-firefox-stylebench-fis-e10s**
2683        - ✅
2684        - ✅
2685        - ✅
2686        - ✅
2687
2688
2689   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
2690      :widths: 30 15 15 15 15
2691      :header-rows: 1
2692
2693      * - **Test Name**
2694        - mozilla-central
2695        - autoland
2696        - mozilla-release
2697        - mozilla-beta
2698      * - **browsertime-benchmark-chrome-stylebench-e10s**
2699        - ❌
2700        - ❌
2701        - ❌
2702        - ❌
2703      * - **browsertime-benchmark-chromium-stylebench-e10s**
2704        - ❌
2705        - ❌
2706        - ❌
2707        - ❌
2708      * - **browsertime-benchmark-firefox-stylebench-e10s**
2709        - ❌
2710        - ❌
2711        - ❌
2712        - ❌
2713      * - **browsertime-benchmark-firefox-stylebench-fis-e10s**
2714        - ✅
2715        - ✅
2716        - ✅
2717        - ✅
2718
2719
2720   .. list-table:: **test-windows10-32-qr/opt**
2721      :widths: 30 15 15 15 15
2722      :header-rows: 1
2723
2724      * - **Test Name**
2725        - mozilla-central
2726        - autoland
2727        - mozilla-release
2728        - mozilla-beta
2729      * - **browsertime-benchmark-firefox-stylebench-e10s**
2730        - ❌
2731        - ❌
2732        - ❌
2733        - ❌
2734      * - **browsertime-benchmark-firefox-stylebench-fis-e10s**
2735        - ❌
2736        - ❌
2737        - ❌
2738        - ❌
2739
2740
2741   .. list-table:: **test-windows10-32-shippable-qr/opt**
2742      :widths: 30 15 15 15 15
2743      :header-rows: 1
2744
2745      * - **Test Name**
2746        - mozilla-central
2747        - autoland
2748        - mozilla-release
2749        - mozilla-beta
2750      * - **browsertime-benchmark-chrome-stylebench-e10s**
2751        - ❌
2752        - ❌
2753        - ❌
2754        - ❌
2755      * - **browsertime-benchmark-chromium-stylebench-e10s**
2756        - ❌
2757        - ❌
2758        - ❌
2759        - ❌
2760      * - **browsertime-benchmark-firefox-stylebench-e10s**
2761        - ❌
2762        - ❌
2763        - ❌
2764        - ❌
2765      * - **browsertime-benchmark-firefox-stylebench-fis-e10s**
2766        - ❌
2767        - ❌
2768        - ❌
2769        - ❌
2770
2771
2772   .. list-table:: **test-windows10-64-qr/opt**
2773      :widths: 30 15 15 15 15
2774      :header-rows: 1
2775
2776      * - **Test Name**
2777        - mozilla-central
2778        - autoland
2779        - mozilla-release
2780        - mozilla-beta
2781      * - **browsertime-benchmark-firefox-stylebench-e10s**
2782        - ❌
2783        - ❌
2784        - ❌
2785        - ❌
2786      * - **browsertime-benchmark-firefox-stylebench-fis-e10s**
2787        - ❌
2788        - ❌
2789        - ❌
2790        - ❌
2791
2792
2793   .. list-table:: **test-windows10-64-shippable-qr/opt**
2794      :widths: 30 15 15 15 15
2795      :header-rows: 1
2796
2797      * - **Test Name**
2798        - mozilla-central
2799        - autoland
2800        - mozilla-release
2801        - mozilla-beta
2802      * - **browsertime-benchmark-chrome-stylebench-e10s**
2803        - ❌
2804        - ❌
2805        - ❌
2806        - ❌
2807      * - **browsertime-benchmark-chromium-stylebench-e10s**
2808        - ❌
2809        - ❌
2810        - ❌
2811        - ❌
2812      * - **browsertime-benchmark-firefox-stylebench-e10s**
2813        - ❌
2814        - ❌
2815        - ❌
2816        - ❌
2817      * - **browsertime-benchmark-firefox-stylebench-fis-e10s**
2818        - ✅
2819        - ✅
2820        - ✅
2821        - ✅
2822
2823
2824
2825.. dropdown:: sunspider
2826   :container: + anchor-id-sunspider-b
2827
2828   **Owner**: :jandem and SpiderMonkey Team
2829
2830   * **alert threshold**: 2.0
2831   * **apps**: firefox, chrome, chromium
2832   * **expected**: pass
2833   * **gecko profile entries**: 8000000
2834   * **gecko profile interval**: 1
2835   * **lower is better**: true
2836   * **page cycles**: 5
2837   * **page timeout**: 55000
2838   * **test url**: `<http://\<host\>:\<port\>/SunSpider/sunspider-1.0.1/sunspider-1.0.1/driver.html?raptor>`__
2839   * **type**: benchmark
2840   * **unit**: ms
2841   * **Test Task**:
2842
2843   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
2844      :widths: 30 15 15 15 15
2845      :header-rows: 1
2846
2847      * - **Test Name**
2848        - mozilla-central
2849        - autoland
2850        - mozilla-release
2851        - mozilla-beta
2852      * - **browsertime-benchmark-firefox-sunspider-e10s**
2853        - ❌
2854        - ❌
2855        - ❌
2856        - ❌
2857      * - **browsertime-benchmark-firefox-sunspider-fis-e10s**
2858        - ❌
2859        - ❌
2860        - ❌
2861        - ❌
2862
2863
2864   .. list-table:: **test-linux1804-64-qr/opt**
2865      :widths: 30 15 15 15 15
2866      :header-rows: 1
2867
2868      * - **Test Name**
2869        - mozilla-central
2870        - autoland
2871        - mozilla-release
2872        - mozilla-beta
2873      * - **browsertime-benchmark-firefox-sunspider-e10s**
2874        - ❌
2875        - ❌
2876        - ❌
2877        - ❌
2878      * - **browsertime-benchmark-firefox-sunspider-fis-e10s**
2879        - ❌
2880        - ❌
2881        - ❌
2882        - ❌
2883
2884
2885   .. list-table:: **test-linux1804-64-shippable-qr/opt**
2886      :widths: 30 15 15 15 15
2887      :header-rows: 1
2888
2889      * - **Test Name**
2890        - mozilla-central
2891        - autoland
2892        - mozilla-release
2893        - mozilla-beta
2894      * - **browsertime-benchmark-chrome-sunspider-e10s**
2895        - ❌
2896        - ❌
2897        - ❌
2898        - ❌
2899      * - **browsertime-benchmark-chromium-sunspider-e10s**
2900        - ❌
2901        - ❌
2902        - ❌
2903        - ❌
2904      * - **browsertime-benchmark-firefox-sunspider-e10s**
2905        - ❌
2906        - ❌
2907        - ❌
2908        - ❌
2909      * - **browsertime-benchmark-firefox-sunspider-fis-e10s**
2910        - ✅
2911        - ✅
2912        - ✅
2913        - ✅
2914
2915
2916   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
2917      :widths: 30 15 15 15 15
2918      :header-rows: 1
2919
2920      * - **Test Name**
2921        - mozilla-central
2922        - autoland
2923        - mozilla-release
2924        - mozilla-beta
2925      * - **browsertime-benchmark-chrome-sunspider-e10s**
2926        - ❌
2927        - ❌
2928        - ❌
2929        - ❌
2930      * - **browsertime-benchmark-chromium-sunspider-e10s**
2931        - ❌
2932        - ❌
2933        - ❌
2934        - ❌
2935      * - **browsertime-benchmark-firefox-sunspider-e10s**
2936        - ❌
2937        - ❌
2938        - ❌
2939        - ❌
2940      * - **browsertime-benchmark-firefox-sunspider-fis-e10s**
2941        - ✅
2942        - ✅
2943        - ✅
2944        - ✅
2945
2946
2947   .. list-table:: **test-windows10-32-qr/opt**
2948      :widths: 30 15 15 15 15
2949      :header-rows: 1
2950
2951      * - **Test Name**
2952        - mozilla-central
2953        - autoland
2954        - mozilla-release
2955        - mozilla-beta
2956      * - **browsertime-benchmark-firefox-sunspider-e10s**
2957        - ❌
2958        - ❌
2959        - ❌
2960        - ❌
2961      * - **browsertime-benchmark-firefox-sunspider-fis-e10s**
2962        - ❌
2963        - ❌
2964        - ❌
2965        - ❌
2966
2967
2968   .. list-table:: **test-windows10-32-shippable-qr/opt**
2969      :widths: 30 15 15 15 15
2970      :header-rows: 1
2971
2972      * - **Test Name**
2973        - mozilla-central
2974        - autoland
2975        - mozilla-release
2976        - mozilla-beta
2977      * - **browsertime-benchmark-chrome-sunspider-e10s**
2978        - ❌
2979        - ❌
2980        - ❌
2981        - ❌
2982      * - **browsertime-benchmark-chromium-sunspider-e10s**
2983        - ❌
2984        - ❌
2985        - ❌
2986        - ❌
2987      * - **browsertime-benchmark-firefox-sunspider-e10s**
2988        - ❌
2989        - ❌
2990        - ❌
2991        - ❌
2992      * - **browsertime-benchmark-firefox-sunspider-fis-e10s**
2993        - ❌
2994        - ❌
2995        - ❌
2996        - ❌
2997
2998
2999   .. list-table:: **test-windows10-64-qr/opt**
3000      :widths: 30 15 15 15 15
3001      :header-rows: 1
3002
3003      * - **Test Name**
3004        - mozilla-central
3005        - autoland
3006        - mozilla-release
3007        - mozilla-beta
3008      * - **browsertime-benchmark-firefox-sunspider-e10s**
3009        - ❌
3010        - ❌
3011        - ❌
3012        - ❌
3013      * - **browsertime-benchmark-firefox-sunspider-fis-e10s**
3014        - ❌
3015        - ❌
3016        - ❌
3017        - ❌
3018
3019
3020   .. list-table:: **test-windows10-64-shippable-qr/opt**
3021      :widths: 30 15 15 15 15
3022      :header-rows: 1
3023
3024      * - **Test Name**
3025        - mozilla-central
3026        - autoland
3027        - mozilla-release
3028        - mozilla-beta
3029      * - **browsertime-benchmark-chrome-sunspider-e10s**
3030        - ❌
3031        - ❌
3032        - ❌
3033        - ❌
3034      * - **browsertime-benchmark-chromium-sunspider-e10s**
3035        - ❌
3036        - ❌
3037        - ❌
3038        - ❌
3039      * - **browsertime-benchmark-firefox-sunspider-e10s**
3040        - ❌
3041        - ❌
3042        - ❌
3043        - ❌
3044      * - **browsertime-benchmark-firefox-sunspider-fis-e10s**
3045        - ✅
3046        - ✅
3047        - ✅
3048        - ✅
3049
3050
3051
3052.. dropdown:: unity-webgl
3053   :container: + anchor-id-unity-webgl-b
3054
3055   **Owner**: :jgilbert and Graphics(gfx) Team
3056
3057   * **alert threshold**: 2.0
3058   * **apps**: geckoview, refbrow, fenix, chrome-m
3059   * **expected**: pass
3060   * **fetch task**: unity-webgl
3061   * **gecko profile entries**: 8000000
3062   * **gecko profile interval**: 1
3063   * **lower is better**: false
3064   * **page cycles**: 1
3065   * **page timeout**: 420000
3066   * **test url**: `<http://\<host\>:\<port\>/unity-webgl/index.html?raptor>`__
3067   * **type**: benchmark
3068   * **unit**: score
3069   * **Test Task**:
3070
3071   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
3072      :widths: 30 15 15 15 15
3073      :header-rows: 1
3074
3075      * - **Test Name**
3076        - mozilla-central
3077        - autoland
3078        - mozilla-release
3079        - mozilla-beta
3080      * - **browsertime-unity-webgl-mobile-fenix-e10s**
3081        - ❌
3082        - ❌
3083        - ❌
3084        - ❌
3085      * - **browsertime-unity-webgl-mobile-geckoview-e10s**
3086        - ❌
3087        - ❌
3088        - ❌
3089        - ❌
3090      * - **browsertime-unity-webgl-mobile-refbrow-e10s**
3091        - ❌
3092        - ❌
3093        - ❌
3094        - ❌
3095
3096
3097   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
3098      :widths: 30 15 15 15 15
3099      :header-rows: 1
3100
3101      * - **Test Name**
3102        - mozilla-central
3103        - autoland
3104        - mozilla-release
3105        - mozilla-beta
3106      * - **browsertime-unity-webgl-mobile-chrome-m-e10s**
3107        - ❌
3108        - ❌
3109        - ❌
3110        - ❌
3111      * - **browsertime-unity-webgl-mobile-fenix-e10s**
3112        - ❌
3113        - ❌
3114        - ❌
3115        - ❌
3116      * - **browsertime-unity-webgl-mobile-geckoview-e10s**
3117        - ✅
3118        - ✅
3119        - ✅
3120        - ✅
3121      * - **browsertime-unity-webgl-mobile-refbrow-e10s**
3122        - ❌
3123        - ❌
3124        - ❌
3125        - ❌
3126
3127
3128   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
3129      :widths: 30 15 15 15 15
3130      :header-rows: 1
3131
3132      * - **Test Name**
3133        - mozilla-central
3134        - autoland
3135        - mozilla-release
3136        - mozilla-beta
3137      * - **browsertime-unity-webgl-mobile-fenix-e10s**
3138        - ❌
3139        - ❌
3140        - ❌
3141        - ❌
3142      * - **browsertime-unity-webgl-mobile-geckoview-e10s**
3143        - ❌
3144        - ❌
3145        - ❌
3146        - ❌
3147      * - **browsertime-unity-webgl-mobile-refbrow-e10s**
3148        - ❌
3149        - ❌
3150        - ❌
3151        - ❌
3152
3153
3154   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
3155      :widths: 30 15 15 15 15
3156      :header-rows: 1
3157
3158      * - **Test Name**
3159        - mozilla-central
3160        - autoland
3161        - mozilla-release
3162        - mozilla-beta
3163      * - **browsertime-unity-webgl-mobile-chrome-m-e10s**
3164        - ✅
3165        - ❌
3166        - ✅
3167        - ❌
3168      * - **browsertime-unity-webgl-mobile-fenix-e10s**
3169        - ✅
3170        - ❌
3171        - ✅
3172        - ❌
3173      * - **browsertime-unity-webgl-mobile-geckoview-e10s**
3174        - ✅
3175        - ✅
3176        - ✅
3177        - ✅
3178      * - **browsertime-unity-webgl-mobile-refbrow-e10s**
3179        - ❌
3180        - ❌
3181        - ❌
3182        - ❌
3183
3184
3185   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
3186      :widths: 30 15 15 15 15
3187      :header-rows: 1
3188
3189      * - **Test Name**
3190        - mozilla-central
3191        - autoland
3192        - mozilla-release
3193        - mozilla-beta
3194      * - **browsertime-unity-webgl-mobile-fenix-e10s**
3195        - ❌
3196        - ❌
3197        - ❌
3198        - ❌
3199      * - **browsertime-unity-webgl-mobile-geckoview-e10s**
3200        - ❌
3201        - ❌
3202        - ❌
3203        - ❌
3204      * - **browsertime-unity-webgl-mobile-refbrow-e10s**
3205        - ❌
3206        - ❌
3207        - ❌
3208        - ❌
3209
3210
3211   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
3212      :widths: 30 15 15 15 15
3213      :header-rows: 1
3214
3215      * - **Test Name**
3216        - mozilla-central
3217        - autoland
3218        - mozilla-release
3219        - mozilla-beta
3220      * - **browsertime-unity-webgl-mobile-chrome-m-e10s**
3221        - ❌
3222        - ❌
3223        - ❌
3224        - ❌
3225      * - **browsertime-unity-webgl-mobile-fenix-e10s**
3226        - ❌
3227        - ❌
3228        - ❌
3229        - ❌
3230      * - **browsertime-unity-webgl-mobile-geckoview-e10s**
3231        - ❌
3232        - ❌
3233        - ❌
3234        - ❌
3235      * - **browsertime-unity-webgl-mobile-refbrow-e10s**
3236        - ❌
3237        - ❌
3238        - ❌
3239        - ❌
3240
3241
3242   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
3243      :widths: 30 15 15 15 15
3244      :header-rows: 1
3245
3246      * - **Test Name**
3247        - mozilla-central
3248        - autoland
3249        - mozilla-release
3250        - mozilla-beta
3251      * - **browsertime-unity-webgl-mobile-fenix-e10s**
3252        - ❌
3253        - ❌
3254        - ❌
3255        - ❌
3256      * - **browsertime-unity-webgl-mobile-geckoview-e10s**
3257        - ❌
3258        - ❌
3259        - ❌
3260        - ❌
3261      * - **browsertime-unity-webgl-mobile-refbrow-e10s**
3262        - ❌
3263        - ❌
3264        - ❌
3265        - ❌
3266
3267
3268   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
3269      :widths: 30 15 15 15 15
3270      :header-rows: 1
3271
3272      * - **Test Name**
3273        - mozilla-central
3274        - autoland
3275        - mozilla-release
3276        - mozilla-beta
3277      * - **browsertime-unity-webgl-mobile-chrome-m-e10s**
3278        - ❌
3279        - ❌
3280        - ❌
3281        - ❌
3282      * - **browsertime-unity-webgl-mobile-fenix-e10s**
3283        - ❌
3284        - ❌
3285        - ❌
3286        - ❌
3287      * - **browsertime-unity-webgl-mobile-geckoview-e10s**
3288        - ❌
3289        - ❌
3290        - ❌
3291        - ❌
3292      * - **browsertime-unity-webgl-mobile-refbrow-e10s**
3293        - ❌
3294        - ❌
3295        - ❌
3296        - ❌
3297
3298
3299   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
3300      :widths: 30 15 15 15 15
3301      :header-rows: 1
3302
3303      * - **Test Name**
3304        - mozilla-central
3305        - autoland
3306        - mozilla-release
3307        - mozilla-beta
3308      * - **browsertime-benchmark-firefox-unity-webgl-e10s**
3309        - ❌
3310        - ❌
3311        - ❌
3312        - ❌
3313      * - **browsertime-benchmark-firefox-unity-webgl-fis-e10s**
3314        - ❌
3315        - ❌
3316        - ❌
3317        - ❌
3318
3319
3320   .. list-table:: **test-linux1804-64-qr/opt**
3321      :widths: 30 15 15 15 15
3322      :header-rows: 1
3323
3324      * - **Test Name**
3325        - mozilla-central
3326        - autoland
3327        - mozilla-release
3328        - mozilla-beta
3329      * - **browsertime-benchmark-firefox-unity-webgl-e10s**
3330        - ❌
3331        - ❌
3332        - ❌
3333        - ❌
3334      * - **browsertime-benchmark-firefox-unity-webgl-fis-e10s**
3335        - ❌
3336        - ❌
3337        - ❌
3338        - ❌
3339
3340
3341   .. list-table:: **test-linux1804-64-shippable-qr/opt**
3342      :widths: 30 15 15 15 15
3343      :header-rows: 1
3344
3345      * - **Test Name**
3346        - mozilla-central
3347        - autoland
3348        - mozilla-release
3349        - mozilla-beta
3350      * - **browsertime-benchmark-chrome-unity-webgl-e10s**
3351        - ❌
3352        - ❌
3353        - ❌
3354        - ❌
3355      * - **browsertime-benchmark-chromium-unity-webgl-e10s**
3356        - ❌
3357        - ❌
3358        - ❌
3359        - ❌
3360      * - **browsertime-benchmark-firefox-unity-webgl-e10s**
3361        - ❌
3362        - ❌
3363        - ❌
3364        - ❌
3365      * - **browsertime-benchmark-firefox-unity-webgl-fis-e10s**
3366        - ✅
3367        - ✅
3368        - ✅
3369        - ❌
3370
3371
3372   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
3373      :widths: 30 15 15 15 15
3374      :header-rows: 1
3375
3376      * - **Test Name**
3377        - mozilla-central
3378        - autoland
3379        - mozilla-release
3380        - mozilla-beta
3381      * - **browsertime-benchmark-chrome-unity-webgl-e10s**
3382        - ❌
3383        - ❌
3384        - ❌
3385        - ❌
3386      * - **browsertime-benchmark-chromium-unity-webgl-e10s**
3387        - ❌
3388        - ❌
3389        - ❌
3390        - ❌
3391      * - **browsertime-benchmark-firefox-unity-webgl-e10s**
3392        - ❌
3393        - ❌
3394        - ❌
3395        - ❌
3396      * - **browsertime-benchmark-firefox-unity-webgl-fis-e10s**
3397        - ✅
3398        - ✅
3399        - ✅
3400        - ❌
3401
3402
3403   .. list-table:: **test-windows10-32-qr/opt**
3404      :widths: 30 15 15 15 15
3405      :header-rows: 1
3406
3407      * - **Test Name**
3408        - mozilla-central
3409        - autoland
3410        - mozilla-release
3411        - mozilla-beta
3412      * - **browsertime-benchmark-firefox-unity-webgl-e10s**
3413        - ❌
3414        - ❌
3415        - ❌
3416        - ❌
3417      * - **browsertime-benchmark-firefox-unity-webgl-fis-e10s**
3418        - ❌
3419        - ❌
3420        - ❌
3421        - ❌
3422
3423
3424   .. list-table:: **test-windows10-32-shippable-qr/opt**
3425      :widths: 30 15 15 15 15
3426      :header-rows: 1
3427
3428      * - **Test Name**
3429        - mozilla-central
3430        - autoland
3431        - mozilla-release
3432        - mozilla-beta
3433      * - **browsertime-benchmark-chrome-unity-webgl-e10s**
3434        - ❌
3435        - ❌
3436        - ❌
3437        - ❌
3438      * - **browsertime-benchmark-chromium-unity-webgl-e10s**
3439        - ❌
3440        - ❌
3441        - ❌
3442        - ❌
3443      * - **browsertime-benchmark-firefox-unity-webgl-e10s**
3444        - ❌
3445        - ❌
3446        - ❌
3447        - ❌
3448      * - **browsertime-benchmark-firefox-unity-webgl-fis-e10s**
3449        - ❌
3450        - ❌
3451        - ❌
3452        - ❌
3453
3454
3455   .. list-table:: **test-windows10-64-qr/opt**
3456      :widths: 30 15 15 15 15
3457      :header-rows: 1
3458
3459      * - **Test Name**
3460        - mozilla-central
3461        - autoland
3462        - mozilla-release
3463        - mozilla-beta
3464      * - **browsertime-benchmark-firefox-unity-webgl-e10s**
3465        - ❌
3466        - ❌
3467        - ❌
3468        - ❌
3469      * - **browsertime-benchmark-firefox-unity-webgl-fis-e10s**
3470        - ❌
3471        - ❌
3472        - ❌
3473        - ❌
3474
3475
3476   .. list-table:: **test-windows10-64-shippable-qr/opt**
3477      :widths: 30 15 15 15 15
3478      :header-rows: 1
3479
3480      * - **Test Name**
3481        - mozilla-central
3482        - autoland
3483        - mozilla-release
3484        - mozilla-beta
3485      * - **browsertime-benchmark-chrome-unity-webgl-e10s**
3486        - ❌
3487        - ❌
3488        - ❌
3489        - ❌
3490      * - **browsertime-benchmark-chromium-unity-webgl-e10s**
3491        - ❌
3492        - ❌
3493        - ❌
3494        - ❌
3495      * - **browsertime-benchmark-firefox-unity-webgl-e10s**
3496        - ❌
3497        - ❌
3498        - ❌
3499        - ❌
3500      * - **browsertime-benchmark-firefox-unity-webgl-fis-e10s**
3501        - ✅
3502        - ✅
3503        - ✅
3504        - ❌
3505
3506
3507   **Owner**: :jgilbert and Graphics(gfx) Team
3508
3509   * **alert threshold**: 2.0
3510   * **apps**: firefox, chrome, chromium
3511   * **expected**: pass
3512   * **fetch task**: unity-webgl
3513   * **gecko profile entries**: 8000000
3514   * **gecko profile interval**: 1
3515   * **lower is better**: false
3516   * **page cycles**: 5
3517   * **page timeout**: 420000
3518   * **test url**: `<http://\<host\>:\<port\>/unity-webgl/index.html?raptor>`__
3519   * **type**: benchmark
3520   * **unit**: score
3521   * **Test Task**:
3522
3523   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
3524      :widths: 30 15 15 15 15
3525      :header-rows: 1
3526
3527      * - **Test Name**
3528        - mozilla-central
3529        - autoland
3530        - mozilla-release
3531        - mozilla-beta
3532      * - **browsertime-unity-webgl-mobile-fenix-e10s**
3533        - ❌
3534        - ❌
3535        - ❌
3536        - ❌
3537      * - **browsertime-unity-webgl-mobile-geckoview-e10s**
3538        - ❌
3539        - ❌
3540        - ❌
3541        - ❌
3542      * - **browsertime-unity-webgl-mobile-refbrow-e10s**
3543        - ❌
3544        - ❌
3545        - ❌
3546        - ❌
3547
3548
3549   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
3550      :widths: 30 15 15 15 15
3551      :header-rows: 1
3552
3553      * - **Test Name**
3554        - mozilla-central
3555        - autoland
3556        - mozilla-release
3557        - mozilla-beta
3558      * - **browsertime-unity-webgl-mobile-chrome-m-e10s**
3559        - ❌
3560        - ❌
3561        - ❌
3562        - ❌
3563      * - **browsertime-unity-webgl-mobile-fenix-e10s**
3564        - ❌
3565        - ❌
3566        - ❌
3567        - ❌
3568      * - **browsertime-unity-webgl-mobile-geckoview-e10s**
3569        - ✅
3570        - ✅
3571        - ✅
3572        - ✅
3573      * - **browsertime-unity-webgl-mobile-refbrow-e10s**
3574        - ❌
3575        - ❌
3576        - ❌
3577        - ❌
3578
3579
3580   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
3581      :widths: 30 15 15 15 15
3582      :header-rows: 1
3583
3584      * - **Test Name**
3585        - mozilla-central
3586        - autoland
3587        - mozilla-release
3588        - mozilla-beta
3589      * - **browsertime-unity-webgl-mobile-fenix-e10s**
3590        - ❌
3591        - ❌
3592        - ❌
3593        - ❌
3594      * - **browsertime-unity-webgl-mobile-geckoview-e10s**
3595        - ❌
3596        - ❌
3597        - ❌
3598        - ❌
3599      * - **browsertime-unity-webgl-mobile-refbrow-e10s**
3600        - ❌
3601        - ❌
3602        - ❌
3603        - ❌
3604
3605
3606   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
3607      :widths: 30 15 15 15 15
3608      :header-rows: 1
3609
3610      * - **Test Name**
3611        - mozilla-central
3612        - autoland
3613        - mozilla-release
3614        - mozilla-beta
3615      * - **browsertime-unity-webgl-mobile-chrome-m-e10s**
3616        - ✅
3617        - ❌
3618        - ✅
3619        - ❌
3620      * - **browsertime-unity-webgl-mobile-fenix-e10s**
3621        - ✅
3622        - ❌
3623        - ✅
3624        - ❌
3625      * - **browsertime-unity-webgl-mobile-geckoview-e10s**
3626        - ✅
3627        - ✅
3628        - ✅
3629        - ✅
3630      * - **browsertime-unity-webgl-mobile-refbrow-e10s**
3631        - ❌
3632        - ❌
3633        - ❌
3634        - ❌
3635
3636
3637   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
3638      :widths: 30 15 15 15 15
3639      :header-rows: 1
3640
3641      * - **Test Name**
3642        - mozilla-central
3643        - autoland
3644        - mozilla-release
3645        - mozilla-beta
3646      * - **browsertime-unity-webgl-mobile-fenix-e10s**
3647        - ❌
3648        - ❌
3649        - ❌
3650        - ❌
3651      * - **browsertime-unity-webgl-mobile-geckoview-e10s**
3652        - ❌
3653        - ❌
3654        - ❌
3655        - ❌
3656      * - **browsertime-unity-webgl-mobile-refbrow-e10s**
3657        - ❌
3658        - ❌
3659        - ❌
3660        - ❌
3661
3662
3663   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
3664      :widths: 30 15 15 15 15
3665      :header-rows: 1
3666
3667      * - **Test Name**
3668        - mozilla-central
3669        - autoland
3670        - mozilla-release
3671        - mozilla-beta
3672      * - **browsertime-unity-webgl-mobile-chrome-m-e10s**
3673        - ❌
3674        - ❌
3675        - ❌
3676        - ❌
3677      * - **browsertime-unity-webgl-mobile-fenix-e10s**
3678        - ❌
3679        - ❌
3680        - ❌
3681        - ❌
3682      * - **browsertime-unity-webgl-mobile-geckoview-e10s**
3683        - ❌
3684        - ❌
3685        - ❌
3686        - ❌
3687      * - **browsertime-unity-webgl-mobile-refbrow-e10s**
3688        - ❌
3689        - ❌
3690        - ❌
3691        - ❌
3692
3693
3694   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
3695      :widths: 30 15 15 15 15
3696      :header-rows: 1
3697
3698      * - **Test Name**
3699        - mozilla-central
3700        - autoland
3701        - mozilla-release
3702        - mozilla-beta
3703      * - **browsertime-unity-webgl-mobile-fenix-e10s**
3704        - ❌
3705        - ❌
3706        - ❌
3707        - ❌
3708      * - **browsertime-unity-webgl-mobile-geckoview-e10s**
3709        - ❌
3710        - ❌
3711        - ❌
3712        - ❌
3713      * - **browsertime-unity-webgl-mobile-refbrow-e10s**
3714        - ❌
3715        - ❌
3716        - ❌
3717        - ❌
3718
3719
3720   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
3721      :widths: 30 15 15 15 15
3722      :header-rows: 1
3723
3724      * - **Test Name**
3725        - mozilla-central
3726        - autoland
3727        - mozilla-release
3728        - mozilla-beta
3729      * - **browsertime-unity-webgl-mobile-chrome-m-e10s**
3730        - ❌
3731        - ❌
3732        - ❌
3733        - ❌
3734      * - **browsertime-unity-webgl-mobile-fenix-e10s**
3735        - ❌
3736        - ❌
3737        - ❌
3738        - ❌
3739      * - **browsertime-unity-webgl-mobile-geckoview-e10s**
3740        - ❌
3741        - ❌
3742        - ❌
3743        - ❌
3744      * - **browsertime-unity-webgl-mobile-refbrow-e10s**
3745        - ❌
3746        - ❌
3747        - ❌
3748        - ❌
3749
3750
3751   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
3752      :widths: 30 15 15 15 15
3753      :header-rows: 1
3754
3755      * - **Test Name**
3756        - mozilla-central
3757        - autoland
3758        - mozilla-release
3759        - mozilla-beta
3760      * - **browsertime-benchmark-firefox-unity-webgl-e10s**
3761        - ❌
3762        - ❌
3763        - ❌
3764        - ❌
3765      * - **browsertime-benchmark-firefox-unity-webgl-fis-e10s**
3766        - ❌
3767        - ❌
3768        - ❌
3769        - ❌
3770
3771
3772   .. list-table:: **test-linux1804-64-qr/opt**
3773      :widths: 30 15 15 15 15
3774      :header-rows: 1
3775
3776      * - **Test Name**
3777        - mozilla-central
3778        - autoland
3779        - mozilla-release
3780        - mozilla-beta
3781      * - **browsertime-benchmark-firefox-unity-webgl-e10s**
3782        - ❌
3783        - ❌
3784        - ❌
3785        - ❌
3786      * - **browsertime-benchmark-firefox-unity-webgl-fis-e10s**
3787        - ❌
3788        - ❌
3789        - ❌
3790        - ❌
3791
3792
3793   .. list-table:: **test-linux1804-64-shippable-qr/opt**
3794      :widths: 30 15 15 15 15
3795      :header-rows: 1
3796
3797      * - **Test Name**
3798        - mozilla-central
3799        - autoland
3800        - mozilla-release
3801        - mozilla-beta
3802      * - **browsertime-benchmark-chrome-unity-webgl-e10s**
3803        - ❌
3804        - ❌
3805        - ❌
3806        - ❌
3807      * - **browsertime-benchmark-chromium-unity-webgl-e10s**
3808        - ❌
3809        - ❌
3810        - ❌
3811        - ❌
3812      * - **browsertime-benchmark-firefox-unity-webgl-e10s**
3813        - ❌
3814        - ❌
3815        - ❌
3816        - ❌
3817      * - **browsertime-benchmark-firefox-unity-webgl-fis-e10s**
3818        - ✅
3819        - ✅
3820        - ✅
3821        - ❌
3822
3823
3824   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
3825      :widths: 30 15 15 15 15
3826      :header-rows: 1
3827
3828      * - **Test Name**
3829        - mozilla-central
3830        - autoland
3831        - mozilla-release
3832        - mozilla-beta
3833      * - **browsertime-benchmark-chrome-unity-webgl-e10s**
3834        - ❌
3835        - ❌
3836        - ❌
3837        - ❌
3838      * - **browsertime-benchmark-chromium-unity-webgl-e10s**
3839        - ❌
3840        - ❌
3841        - ❌
3842        - ❌
3843      * - **browsertime-benchmark-firefox-unity-webgl-e10s**
3844        - ❌
3845        - ❌
3846        - ❌
3847        - ❌
3848      * - **browsertime-benchmark-firefox-unity-webgl-fis-e10s**
3849        - ✅
3850        - ✅
3851        - ✅
3852        - ❌
3853
3854
3855   .. list-table:: **test-windows10-32-qr/opt**
3856      :widths: 30 15 15 15 15
3857      :header-rows: 1
3858
3859      * - **Test Name**
3860        - mozilla-central
3861        - autoland
3862        - mozilla-release
3863        - mozilla-beta
3864      * - **browsertime-benchmark-firefox-unity-webgl-e10s**
3865        - ❌
3866        - ❌
3867        - ❌
3868        - ❌
3869      * - **browsertime-benchmark-firefox-unity-webgl-fis-e10s**
3870        - ❌
3871        - ❌
3872        - ❌
3873        - ❌
3874
3875
3876   .. list-table:: **test-windows10-32-shippable-qr/opt**
3877      :widths: 30 15 15 15 15
3878      :header-rows: 1
3879
3880      * - **Test Name**
3881        - mozilla-central
3882        - autoland
3883        - mozilla-release
3884        - mozilla-beta
3885      * - **browsertime-benchmark-chrome-unity-webgl-e10s**
3886        - ❌
3887        - ❌
3888        - ❌
3889        - ❌
3890      * - **browsertime-benchmark-chromium-unity-webgl-e10s**
3891        - ❌
3892        - ❌
3893        - ❌
3894        - ❌
3895      * - **browsertime-benchmark-firefox-unity-webgl-e10s**
3896        - ❌
3897        - ❌
3898        - ❌
3899        - ❌
3900      * - **browsertime-benchmark-firefox-unity-webgl-fis-e10s**
3901        - ❌
3902        - ❌
3903        - ❌
3904        - ❌
3905
3906
3907   .. list-table:: **test-windows10-64-qr/opt**
3908      :widths: 30 15 15 15 15
3909      :header-rows: 1
3910
3911      * - **Test Name**
3912        - mozilla-central
3913        - autoland
3914        - mozilla-release
3915        - mozilla-beta
3916      * - **browsertime-benchmark-firefox-unity-webgl-e10s**
3917        - ❌
3918        - ❌
3919        - ❌
3920        - ❌
3921      * - **browsertime-benchmark-firefox-unity-webgl-fis-e10s**
3922        - ❌
3923        - ❌
3924        - ❌
3925        - ❌
3926
3927
3928   .. list-table:: **test-windows10-64-shippable-qr/opt**
3929      :widths: 30 15 15 15 15
3930      :header-rows: 1
3931
3932      * - **Test Name**
3933        - mozilla-central
3934        - autoland
3935        - mozilla-release
3936        - mozilla-beta
3937      * - **browsertime-benchmark-chrome-unity-webgl-e10s**
3938        - ❌
3939        - ❌
3940        - ❌
3941        - ❌
3942      * - **browsertime-benchmark-chromium-unity-webgl-e10s**
3943        - ❌
3944        - ❌
3945        - ❌
3946        - ❌
3947      * - **browsertime-benchmark-firefox-unity-webgl-e10s**
3948        - ❌
3949        - ❌
3950        - ❌
3951        - ❌
3952      * - **browsertime-benchmark-firefox-unity-webgl-fis-e10s**
3953        - ✅
3954        - ✅
3955        - ✅
3956        - ❌
3957
3958
3959
3960.. dropdown:: wasm-godot
3961   :container: + anchor-id-wasm-godot-b
3962
3963   **Owner**: :lth and SpiderMonkey Team
3964
3965   * **alert threshold**: 2.0
3966   * **apps**: firefox, chrome, chromium
3967   * **expected**: pass
3968   * **gecko profile entries**: 8000000
3969   * **gecko profile interval**: 1
3970   * **lower is better**: true
3971   * **newtab per cycle**: true
3972   * **page cycles**: 5
3973   * **page timeout**: 120000
3974   * **test url**: `<http://localhost:\<port\>/wasm-godot/index.html>`__
3975   * **type**: benchmark
3976   * **unit**: ms
3977   * **Test Task**:
3978
3979   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
3980      :widths: 30 15 15 15 15
3981      :header-rows: 1
3982
3983      * - **Test Name**
3984        - mozilla-central
3985        - autoland
3986        - mozilla-release
3987        - mozilla-beta
3988      * - **browsertime-benchmark-wasm-firefox-wasm-godot-e10s**
3989        - ❌
3990        - ❌
3991        - ❌
3992        - ❌
3993      * - **browsertime-benchmark-wasm-firefox-wasm-godot-fis-e10s**
3994        - ❌
3995        - ❌
3996        - ❌
3997        - ❌
3998
3999
4000   .. list-table:: **test-linux1804-64-qr/opt**
4001      :widths: 30 15 15 15 15
4002      :header-rows: 1
4003
4004      * - **Test Name**
4005        - mozilla-central
4006        - autoland
4007        - mozilla-release
4008        - mozilla-beta
4009      * - **browsertime-benchmark-wasm-firefox-wasm-godot-e10s**
4010        - ❌
4011        - ❌
4012        - ❌
4013        - ❌
4014      * - **browsertime-benchmark-wasm-firefox-wasm-godot-fis-e10s**
4015        - ❌
4016        - ❌
4017        - ❌
4018        - ❌
4019
4020
4021   .. list-table:: **test-linux1804-64-shippable-qr/opt**
4022      :widths: 30 15 15 15 15
4023      :header-rows: 1
4024
4025      * - **Test Name**
4026        - mozilla-central
4027        - autoland
4028        - mozilla-release
4029        - mozilla-beta
4030      * - **browsertime-benchmark-wasm-chrome-wasm-godot-e10s**
4031        - ❌
4032        - ❌
4033        - ❌
4034        - ❌
4035      * - **browsertime-benchmark-wasm-chromium-wasm-godot-e10s**
4036        - ❌
4037        - ❌
4038        - ❌
4039        - ❌
4040      * - **browsertime-benchmark-wasm-firefox-wasm-godot-e10s**
4041        - ❌
4042        - ❌
4043        - ❌
4044        - ❌
4045      * - **browsertime-benchmark-wasm-firefox-wasm-godot-fis-e10s**
4046        - ✅
4047        - ❌
4048        - ✅
4049        - ❌
4050
4051
4052   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
4053      :widths: 30 15 15 15 15
4054      :header-rows: 1
4055
4056      * - **Test Name**
4057        - mozilla-central
4058        - autoland
4059        - mozilla-release
4060        - mozilla-beta
4061      * - **browsertime-benchmark-wasm-chrome-wasm-godot-e10s**
4062        - ❌
4063        - ❌
4064        - ❌
4065        - ❌
4066      * - **browsertime-benchmark-wasm-chromium-wasm-godot-e10s**
4067        - ❌
4068        - ❌
4069        - ❌
4070        - ❌
4071      * - **browsertime-benchmark-wasm-firefox-wasm-godot-e10s**
4072        - ❌
4073        - ❌
4074        - ❌
4075        - ❌
4076      * - **browsertime-benchmark-wasm-firefox-wasm-godot-fis-e10s**
4077        - ✅
4078        - ❌
4079        - ✅
4080        - ❌
4081
4082
4083   .. list-table:: **test-windows10-32-qr/opt**
4084      :widths: 30 15 15 15 15
4085      :header-rows: 1
4086
4087      * - **Test Name**
4088        - mozilla-central
4089        - autoland
4090        - mozilla-release
4091        - mozilla-beta
4092      * - **browsertime-benchmark-wasm-firefox-wasm-godot-e10s**
4093        - ❌
4094        - ❌
4095        - ❌
4096        - ❌
4097      * - **browsertime-benchmark-wasm-firefox-wasm-godot-fis-e10s**
4098        - ❌
4099        - ❌
4100        - ❌
4101        - ❌
4102
4103
4104   .. list-table:: **test-windows10-32-shippable-qr/opt**
4105      :widths: 30 15 15 15 15
4106      :header-rows: 1
4107
4108      * - **Test Name**
4109        - mozilla-central
4110        - autoland
4111        - mozilla-release
4112        - mozilla-beta
4113      * - **browsertime-benchmark-wasm-chrome-wasm-godot-e10s**
4114        - ❌
4115        - ❌
4116        - ❌
4117        - ❌
4118      * - **browsertime-benchmark-wasm-chromium-wasm-godot-e10s**
4119        - ❌
4120        - ❌
4121        - ❌
4122        - ❌
4123      * - **browsertime-benchmark-wasm-firefox-wasm-godot-e10s**
4124        - ❌
4125        - ❌
4126        - ❌
4127        - ❌
4128      * - **browsertime-benchmark-wasm-firefox-wasm-godot-fis-e10s**
4129        - ❌
4130        - ❌
4131        - ❌
4132        - ❌
4133
4134
4135   .. list-table:: **test-windows10-64-qr/opt**
4136      :widths: 30 15 15 15 15
4137      :header-rows: 1
4138
4139      * - **Test Name**
4140        - mozilla-central
4141        - autoland
4142        - mozilla-release
4143        - mozilla-beta
4144      * - **browsertime-benchmark-wasm-firefox-wasm-godot-e10s**
4145        - ❌
4146        - ❌
4147        - ❌
4148        - ❌
4149      * - **browsertime-benchmark-wasm-firefox-wasm-godot-fis-e10s**
4150        - ❌
4151        - ❌
4152        - ❌
4153        - ❌
4154
4155
4156   .. list-table:: **test-windows10-64-shippable-qr/opt**
4157      :widths: 30 15 15 15 15
4158      :header-rows: 1
4159
4160      * - **Test Name**
4161        - mozilla-central
4162        - autoland
4163        - mozilla-release
4164        - mozilla-beta
4165      * - **browsertime-benchmark-wasm-chrome-wasm-godot-e10s**
4166        - ❌
4167        - ❌
4168        - ❌
4169        - ❌
4170      * - **browsertime-benchmark-wasm-chromium-wasm-godot-e10s**
4171        - ❌
4172        - ❌
4173        - ❌
4174        - ❌
4175      * - **browsertime-benchmark-wasm-firefox-wasm-godot-e10s**
4176        - ❌
4177        - ❌
4178        - ❌
4179        - ❌
4180      * - **browsertime-benchmark-wasm-firefox-wasm-godot-fis-e10s**
4181        - ✅
4182        - ❌
4183        - ✅
4184        - ❌
4185
4186
4187
4188.. dropdown:: wasm-godot-baseline
4189   :container: + anchor-id-wasm-godot-baseline-b
4190
4191   **Owner**: :lth and SpiderMonkey Team
4192
4193   * **alert threshold**: 2.0
4194   * **apps**: firefox
4195   * **expected**: pass
4196   * **gecko profile entries**: 8000000
4197   * **gecko profile interval**: 1
4198   * **lower is better**: true
4199   * **newtab per cycle**: true
4200   * **page cycles**: 5
4201   * **page timeout**: 120000
4202   * **preferences**: {"javascript.options.wasm_baselinejit": true, "javascript.options.wasm_optimizingjit": false}
4203   * **test url**: `<http://localhost:\<port\>/wasm-godot/index.html>`__
4204   * **type**: benchmark
4205   * **unit**: ms
4206   * **Test Task**:
4207
4208   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
4209      :widths: 30 15 15 15 15
4210      :header-rows: 1
4211
4212      * - **Test Name**
4213        - mozilla-central
4214        - autoland
4215        - mozilla-release
4216        - mozilla-beta
4217      * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline-e10s**
4218        - ❌
4219        - ❌
4220        - ❌
4221        - ❌
4222      * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline-fis-e10s**
4223        - ❌
4224        - ❌
4225        - ❌
4226        - ❌
4227
4228
4229   .. list-table:: **test-linux1804-64-qr/opt**
4230      :widths: 30 15 15 15 15
4231      :header-rows: 1
4232
4233      * - **Test Name**
4234        - mozilla-central
4235        - autoland
4236        - mozilla-release
4237        - mozilla-beta
4238      * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline-e10s**
4239        - ❌
4240        - ❌
4241        - ❌
4242        - ❌
4243      * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline-fis-e10s**
4244        - ❌
4245        - ❌
4246        - ❌
4247        - ❌
4248
4249
4250   .. list-table:: **test-linux1804-64-shippable-qr/opt**
4251      :widths: 30 15 15 15 15
4252      :header-rows: 1
4253
4254      * - **Test Name**
4255        - mozilla-central
4256        - autoland
4257        - mozilla-release
4258        - mozilla-beta
4259      * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline-e10s**
4260        - ❌
4261        - ❌
4262        - ❌
4263        - ❌
4264      * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline-fis-e10s**
4265        - ✅
4266        - ❌
4267        - ✅
4268        - ❌
4269
4270
4271   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
4272      :widths: 30 15 15 15 15
4273      :header-rows: 1
4274
4275      * - **Test Name**
4276        - mozilla-central
4277        - autoland
4278        - mozilla-release
4279        - mozilla-beta
4280      * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline-e10s**
4281        - ❌
4282        - ❌
4283        - ❌
4284        - ❌
4285      * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline-fis-e10s**
4286        - ✅
4287        - ❌
4288        - ✅
4289        - ❌
4290
4291
4292   .. list-table:: **test-windows10-32-qr/opt**
4293      :widths: 30 15 15 15 15
4294      :header-rows: 1
4295
4296      * - **Test Name**
4297        - mozilla-central
4298        - autoland
4299        - mozilla-release
4300        - mozilla-beta
4301      * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline-e10s**
4302        - ❌
4303        - ❌
4304        - ❌
4305        - ❌
4306      * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline-fis-e10s**
4307        - ❌
4308        - ❌
4309        - ❌
4310        - ❌
4311
4312
4313   .. list-table:: **test-windows10-32-shippable-qr/opt**
4314      :widths: 30 15 15 15 15
4315      :header-rows: 1
4316
4317      * - **Test Name**
4318        - mozilla-central
4319        - autoland
4320        - mozilla-release
4321        - mozilla-beta
4322      * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline-e10s**
4323        - ❌
4324        - ❌
4325        - ❌
4326        - ❌
4327      * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline-fis-e10s**
4328        - ❌
4329        - ❌
4330        - ❌
4331        - ❌
4332
4333
4334   .. list-table:: **test-windows10-64-qr/opt**
4335      :widths: 30 15 15 15 15
4336      :header-rows: 1
4337
4338      * - **Test Name**
4339        - mozilla-central
4340        - autoland
4341        - mozilla-release
4342        - mozilla-beta
4343      * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline-e10s**
4344        - ❌
4345        - ❌
4346        - ❌
4347        - ❌
4348      * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline-fis-e10s**
4349        - ❌
4350        - ❌
4351        - ❌
4352        - ❌
4353
4354
4355   .. list-table:: **test-windows10-64-shippable-qr/opt**
4356      :widths: 30 15 15 15 15
4357      :header-rows: 1
4358
4359      * - **Test Name**
4360        - mozilla-central
4361        - autoland
4362        - mozilla-release
4363        - mozilla-beta
4364      * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline-e10s**
4365        - ❌
4366        - ❌
4367        - ❌
4368        - ❌
4369      * - **browsertime-benchmark-wasm-firefox-wasm-godot-baseline-fis-e10s**
4370        - ✅
4371        - ❌
4372        - ✅
4373        - ❌
4374
4375
4376
4377.. dropdown:: wasm-godot-optimizing
4378   :container: + anchor-id-wasm-godot-optimizing-b
4379
4380   **Owner**: :lth and SpiderMonkey Team
4381
4382   * **alert threshold**: 2.0
4383   * **apps**: firefox
4384   * **expected**: pass
4385   * **gecko profile entries**: 8000000
4386   * **gecko profile interval**: 1
4387   * **lower is better**: true
4388   * **newtab per cycle**: true
4389   * **page cycles**: 5
4390   * **page timeout**: 120000
4391   * **preferences**: {"javascript.options.wasm_baselinejit": false, "javascript.options.wasm_optimizingjit": true}
4392   * **test url**: `<http://localhost:\<port\>/wasm-godot/index.html>`__
4393   * **type**: benchmark
4394   * **unit**: ms
4395   * **Test Task**:
4396
4397   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
4398      :widths: 30 15 15 15 15
4399      :header-rows: 1
4400
4401      * - **Test Name**
4402        - mozilla-central
4403        - autoland
4404        - mozilla-release
4405        - mozilla-beta
4406      * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing-e10s**
4407        - ❌
4408        - ❌
4409        - ❌
4410        - ❌
4411      * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing-fis-e10s**
4412        - ❌
4413        - ❌
4414        - ❌
4415        - ❌
4416
4417
4418   .. list-table:: **test-linux1804-64-qr/opt**
4419      :widths: 30 15 15 15 15
4420      :header-rows: 1
4421
4422      * - **Test Name**
4423        - mozilla-central
4424        - autoland
4425        - mozilla-release
4426        - mozilla-beta
4427      * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing-e10s**
4428        - ❌
4429        - ❌
4430        - ❌
4431        - ❌
4432      * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing-fis-e10s**
4433        - ❌
4434        - ❌
4435        - ❌
4436        - ❌
4437
4438
4439   .. list-table:: **test-linux1804-64-shippable-qr/opt**
4440      :widths: 30 15 15 15 15
4441      :header-rows: 1
4442
4443      * - **Test Name**
4444        - mozilla-central
4445        - autoland
4446        - mozilla-release
4447        - mozilla-beta
4448      * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing-e10s**
4449        - ❌
4450        - ❌
4451        - ❌
4452        - ❌
4453      * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing-fis-e10s**
4454        - ✅
4455        - ❌
4456        - ✅
4457        - ❌
4458
4459
4460   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
4461      :widths: 30 15 15 15 15
4462      :header-rows: 1
4463
4464      * - **Test Name**
4465        - mozilla-central
4466        - autoland
4467        - mozilla-release
4468        - mozilla-beta
4469      * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing-e10s**
4470        - ❌
4471        - ❌
4472        - ❌
4473        - ❌
4474      * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing-fis-e10s**
4475        - ✅
4476        - ❌
4477        - ✅
4478        - ❌
4479
4480
4481   .. list-table:: **test-windows10-32-qr/opt**
4482      :widths: 30 15 15 15 15
4483      :header-rows: 1
4484
4485      * - **Test Name**
4486        - mozilla-central
4487        - autoland
4488        - mozilla-release
4489        - mozilla-beta
4490      * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing-e10s**
4491        - ❌
4492        - ❌
4493        - ❌
4494        - ❌
4495      * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing-fis-e10s**
4496        - ❌
4497        - ❌
4498        - ❌
4499        - ❌
4500
4501
4502   .. list-table:: **test-windows10-32-shippable-qr/opt**
4503      :widths: 30 15 15 15 15
4504      :header-rows: 1
4505
4506      * - **Test Name**
4507        - mozilla-central
4508        - autoland
4509        - mozilla-release
4510        - mozilla-beta
4511      * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing-e10s**
4512        - ❌
4513        - ❌
4514        - ❌
4515        - ❌
4516      * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing-fis-e10s**
4517        - ❌
4518        - ❌
4519        - ❌
4520        - ❌
4521
4522
4523   .. list-table:: **test-windows10-64-qr/opt**
4524      :widths: 30 15 15 15 15
4525      :header-rows: 1
4526
4527      * - **Test Name**
4528        - mozilla-central
4529        - autoland
4530        - mozilla-release
4531        - mozilla-beta
4532      * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing-e10s**
4533        - ❌
4534        - ❌
4535        - ❌
4536        - ❌
4537      * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing-fis-e10s**
4538        - ❌
4539        - ❌
4540        - ❌
4541        - ❌
4542
4543
4544   .. list-table:: **test-windows10-64-shippable-qr/opt**
4545      :widths: 30 15 15 15 15
4546      :header-rows: 1
4547
4548      * - **Test Name**
4549        - mozilla-central
4550        - autoland
4551        - mozilla-release
4552        - mozilla-beta
4553      * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing-e10s**
4554        - ❌
4555        - ❌
4556        - ❌
4557        - ❌
4558      * - **browsertime-benchmark-wasm-firefox-wasm-godot-optimizing-fis-e10s**
4559        - ✅
4560        - ❌
4561        - ✅
4562        - ❌
4563
4564
4565
4566.. dropdown:: wasm-misc
4567   :container: + anchor-id-wasm-misc-b
4568
4569   **Owner**: :lth and SpiderMonkey Team
4570
4571   * **alert threshold**: 2.0
4572   * **apps**: firefox, chrome, chromium
4573   * **expected**: pass
4574   * **fetch task**: wasm-misc
4575   * **gecko profile entries**: 4000000
4576   * **gecko profile interval**: 1
4577   * **lower is better**: true
4578   * **page cycles**: 5
4579   * **page timeout**: 1200000
4580   * **test url**: `<http://\<host\>:\<port\>/wasm-misc/index.html?raptor>`__
4581   * **type**: benchmark
4582   * **unit**: ms
4583   * **Test Task**:
4584
4585   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
4586      :widths: 30 15 15 15 15
4587      :header-rows: 1
4588
4589      * - **Test Name**
4590        - mozilla-central
4591        - autoland
4592        - mozilla-release
4593        - mozilla-beta
4594      * - **browsertime-benchmark-wasm-firefox-wasm-misc-e10s**
4595        - ❌
4596        - ❌
4597        - ❌
4598        - ❌
4599      * - **browsertime-benchmark-wasm-firefox-wasm-misc-fis-e10s**
4600        - ❌
4601        - ❌
4602        - ❌
4603        - ❌
4604
4605
4606   .. list-table:: **test-linux1804-64-qr/opt**
4607      :widths: 30 15 15 15 15
4608      :header-rows: 1
4609
4610      * - **Test Name**
4611        - mozilla-central
4612        - autoland
4613        - mozilla-release
4614        - mozilla-beta
4615      * - **browsertime-benchmark-wasm-firefox-wasm-misc-e10s**
4616        - ❌
4617        - ❌
4618        - ❌
4619        - ❌
4620      * - **browsertime-benchmark-wasm-firefox-wasm-misc-fis-e10s**
4621        - ❌
4622        - ❌
4623        - ❌
4624        - ❌
4625
4626
4627   .. list-table:: **test-linux1804-64-shippable-qr/opt**
4628      :widths: 30 15 15 15 15
4629      :header-rows: 1
4630
4631      * - **Test Name**
4632        - mozilla-central
4633        - autoland
4634        - mozilla-release
4635        - mozilla-beta
4636      * - **browsertime-benchmark-wasm-chrome-wasm-misc-e10s**
4637        - ❌
4638        - ❌
4639        - ❌
4640        - ❌
4641      * - **browsertime-benchmark-wasm-chromium-wasm-misc-e10s**
4642        - ❌
4643        - ❌
4644        - ❌
4645        - ❌
4646      * - **browsertime-benchmark-wasm-firefox-wasm-misc-e10s**
4647        - ❌
4648        - ❌
4649        - ❌
4650        - ❌
4651      * - **browsertime-benchmark-wasm-firefox-wasm-misc-fis-e10s**
4652        - ✅
4653        - ❌
4654        - ✅
4655        - ❌
4656
4657
4658   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
4659      :widths: 30 15 15 15 15
4660      :header-rows: 1
4661
4662      * - **Test Name**
4663        - mozilla-central
4664        - autoland
4665        - mozilla-release
4666        - mozilla-beta
4667      * - **browsertime-benchmark-wasm-chrome-wasm-misc-e10s**
4668        - ❌
4669        - ❌
4670        - ❌
4671        - ❌
4672      * - **browsertime-benchmark-wasm-chromium-wasm-misc-e10s**
4673        - ❌
4674        - ❌
4675        - ❌
4676        - ❌
4677      * - **browsertime-benchmark-wasm-firefox-wasm-misc-e10s**
4678        - ❌
4679        - ❌
4680        - ❌
4681        - ❌
4682      * - **browsertime-benchmark-wasm-firefox-wasm-misc-fis-e10s**
4683        - ✅
4684        - ❌
4685        - ✅
4686        - ❌
4687
4688
4689   .. list-table:: **test-windows10-32-qr/opt**
4690      :widths: 30 15 15 15 15
4691      :header-rows: 1
4692
4693      * - **Test Name**
4694        - mozilla-central
4695        - autoland
4696        - mozilla-release
4697        - mozilla-beta
4698      * - **browsertime-benchmark-wasm-firefox-wasm-misc-e10s**
4699        - ❌
4700        - ❌
4701        - ❌
4702        - ❌
4703      * - **browsertime-benchmark-wasm-firefox-wasm-misc-fis-e10s**
4704        - ❌
4705        - ❌
4706        - ❌
4707        - ❌
4708
4709
4710   .. list-table:: **test-windows10-32-shippable-qr/opt**
4711      :widths: 30 15 15 15 15
4712      :header-rows: 1
4713
4714      * - **Test Name**
4715        - mozilla-central
4716        - autoland
4717        - mozilla-release
4718        - mozilla-beta
4719      * - **browsertime-benchmark-wasm-chrome-wasm-misc-e10s**
4720        - ❌
4721        - ❌
4722        - ❌
4723        - ❌
4724      * - **browsertime-benchmark-wasm-chromium-wasm-misc-e10s**
4725        - ❌
4726        - ❌
4727        - ❌
4728        - ❌
4729      * - **browsertime-benchmark-wasm-firefox-wasm-misc-e10s**
4730        - ❌
4731        - ❌
4732        - ❌
4733        - ❌
4734      * - **browsertime-benchmark-wasm-firefox-wasm-misc-fis-e10s**
4735        - ❌
4736        - ❌
4737        - ❌
4738        - ❌
4739
4740
4741   .. list-table:: **test-windows10-64-qr/opt**
4742      :widths: 30 15 15 15 15
4743      :header-rows: 1
4744
4745      * - **Test Name**
4746        - mozilla-central
4747        - autoland
4748        - mozilla-release
4749        - mozilla-beta
4750      * - **browsertime-benchmark-wasm-firefox-wasm-misc-e10s**
4751        - ❌
4752        - ❌
4753        - ❌
4754        - ❌
4755      * - **browsertime-benchmark-wasm-firefox-wasm-misc-fis-e10s**
4756        - ❌
4757        - ❌
4758        - ❌
4759        - ❌
4760
4761
4762   .. list-table:: **test-windows10-64-shippable-qr/opt**
4763      :widths: 30 15 15 15 15
4764      :header-rows: 1
4765
4766      * - **Test Name**
4767        - mozilla-central
4768        - autoland
4769        - mozilla-release
4770        - mozilla-beta
4771      * - **browsertime-benchmark-wasm-chrome-wasm-misc-e10s**
4772        - ❌
4773        - ❌
4774        - ❌
4775        - ❌
4776      * - **browsertime-benchmark-wasm-chromium-wasm-misc-e10s**
4777        - ❌
4778        - ❌
4779        - ❌
4780        - ❌
4781      * - **browsertime-benchmark-wasm-firefox-wasm-misc-e10s**
4782        - ❌
4783        - ❌
4784        - ❌
4785        - ❌
4786      * - **browsertime-benchmark-wasm-firefox-wasm-misc-fis-e10s**
4787        - ✅
4788        - ❌
4789        - ✅
4790        - ❌
4791
4792
4793
4794.. dropdown:: wasm-misc-baseline
4795   :container: + anchor-id-wasm-misc-baseline-b
4796
4797   **Owner**: :lth and SpiderMonkey Team
4798
4799   * **alert threshold**: 2.0
4800   * **apps**: firefox
4801   * **expected**: pass
4802   * **fetch task**: wasm-misc
4803   * **gecko profile entries**: 4000000
4804   * **gecko profile interval**: 1
4805   * **lower is better**: true
4806   * **page cycles**: 5
4807   * **page timeout**: 1200000
4808   * **preferences**: {"javascript.options.wasm_baselinejit": true, "javascript.options.wasm_optimizingjit": false}
4809   * **test url**: `<http://\<host\>:\<port\>/wasm-misc/index.html?raptor>`__
4810   * **type**: benchmark
4811   * **unit**: ms
4812   * **Test Task**:
4813
4814   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
4815      :widths: 30 15 15 15 15
4816      :header-rows: 1
4817
4818      * - **Test Name**
4819        - mozilla-central
4820        - autoland
4821        - mozilla-release
4822        - mozilla-beta
4823      * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline-e10s**
4824        - ❌
4825        - ❌
4826        - ❌
4827        - ❌
4828      * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline-fis-e10s**
4829        - ❌
4830        - ❌
4831        - ❌
4832        - ❌
4833
4834
4835   .. list-table:: **test-linux1804-64-qr/opt**
4836      :widths: 30 15 15 15 15
4837      :header-rows: 1
4838
4839      * - **Test Name**
4840        - mozilla-central
4841        - autoland
4842        - mozilla-release
4843        - mozilla-beta
4844      * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline-e10s**
4845        - ❌
4846        - ❌
4847        - ❌
4848        - ❌
4849      * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline-fis-e10s**
4850        - ❌
4851        - ❌
4852        - ❌
4853        - ❌
4854
4855
4856   .. list-table:: **test-linux1804-64-shippable-qr/opt**
4857      :widths: 30 15 15 15 15
4858      :header-rows: 1
4859
4860      * - **Test Name**
4861        - mozilla-central
4862        - autoland
4863        - mozilla-release
4864        - mozilla-beta
4865      * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline-e10s**
4866        - ❌
4867        - ❌
4868        - ❌
4869        - ❌
4870      * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline-fis-e10s**
4871        - ✅
4872        - ❌
4873        - ✅
4874        - ❌
4875
4876
4877   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
4878      :widths: 30 15 15 15 15
4879      :header-rows: 1
4880
4881      * - **Test Name**
4882        - mozilla-central
4883        - autoland
4884        - mozilla-release
4885        - mozilla-beta
4886      * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline-e10s**
4887        - ❌
4888        - ❌
4889        - ❌
4890        - ❌
4891      * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline-fis-e10s**
4892        - ✅
4893        - ❌
4894        - ✅
4895        - ❌
4896
4897
4898   .. list-table:: **test-windows10-32-qr/opt**
4899      :widths: 30 15 15 15 15
4900      :header-rows: 1
4901
4902      * - **Test Name**
4903        - mozilla-central
4904        - autoland
4905        - mozilla-release
4906        - mozilla-beta
4907      * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline-e10s**
4908        - ❌
4909        - ❌
4910        - ❌
4911        - ❌
4912      * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline-fis-e10s**
4913        - ❌
4914        - ❌
4915        - ❌
4916        - ❌
4917
4918
4919   .. list-table:: **test-windows10-32-shippable-qr/opt**
4920      :widths: 30 15 15 15 15
4921      :header-rows: 1
4922
4923      * - **Test Name**
4924        - mozilla-central
4925        - autoland
4926        - mozilla-release
4927        - mozilla-beta
4928      * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline-e10s**
4929        - ❌
4930        - ❌
4931        - ❌
4932        - ❌
4933      * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline-fis-e10s**
4934        - ❌
4935        - ❌
4936        - ❌
4937        - ❌
4938
4939
4940   .. list-table:: **test-windows10-64-qr/opt**
4941      :widths: 30 15 15 15 15
4942      :header-rows: 1
4943
4944      * - **Test Name**
4945        - mozilla-central
4946        - autoland
4947        - mozilla-release
4948        - mozilla-beta
4949      * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline-e10s**
4950        - ❌
4951        - ❌
4952        - ❌
4953        - ❌
4954      * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline-fis-e10s**
4955        - ❌
4956        - ❌
4957        - ❌
4958        - ❌
4959
4960
4961   .. list-table:: **test-windows10-64-shippable-qr/opt**
4962      :widths: 30 15 15 15 15
4963      :header-rows: 1
4964
4965      * - **Test Name**
4966        - mozilla-central
4967        - autoland
4968        - mozilla-release
4969        - mozilla-beta
4970      * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline-e10s**
4971        - ❌
4972        - ❌
4973        - ❌
4974        - ❌
4975      * - **browsertime-benchmark-wasm-firefox-wasm-misc-baseline-fis-e10s**
4976        - ✅
4977        - ❌
4978        - ✅
4979        - ❌
4980
4981
4982
4983.. dropdown:: wasm-misc-optimizing
4984   :container: + anchor-id-wasm-misc-optimizing-b
4985
4986   **Owner**: :lth and SpiderMonkey Team
4987
4988   * **alert threshold**: 2.0
4989   * **apps**: firefox
4990   * **expected**: pass
4991   * **fetch task**: wasm-misc
4992   * **gecko profile entries**: 4000000
4993   * **gecko profile interval**: 1
4994   * **lower is better**: true
4995   * **page cycles**: 5
4996   * **page timeout**: 1200000
4997   * **preferences**: {"javascript.options.wasm_baselinejit": false, "javascript.options.wasm_optimizingjit": true}
4998   * **test url**: `<http://\<host\>:\<port\>/wasm-misc/index.html?raptor>`__
4999   * **type**: benchmark
5000   * **unit**: ms
5001   * **Test Task**:
5002
5003   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
5004      :widths: 30 15 15 15 15
5005      :header-rows: 1
5006
5007      * - **Test Name**
5008        - mozilla-central
5009        - autoland
5010        - mozilla-release
5011        - mozilla-beta
5012      * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing-e10s**
5013        - ❌
5014        - ❌
5015        - ❌
5016        - ❌
5017      * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing-fis-e10s**
5018        - ❌
5019        - ❌
5020        - ❌
5021        - ❌
5022
5023
5024   .. list-table:: **test-linux1804-64-qr/opt**
5025      :widths: 30 15 15 15 15
5026      :header-rows: 1
5027
5028      * - **Test Name**
5029        - mozilla-central
5030        - autoland
5031        - mozilla-release
5032        - mozilla-beta
5033      * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing-e10s**
5034        - ❌
5035        - ❌
5036        - ❌
5037        - ❌
5038      * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing-fis-e10s**
5039        - ❌
5040        - ❌
5041        - ❌
5042        - ❌
5043
5044
5045   .. list-table:: **test-linux1804-64-shippable-qr/opt**
5046      :widths: 30 15 15 15 15
5047      :header-rows: 1
5048
5049      * - **Test Name**
5050        - mozilla-central
5051        - autoland
5052        - mozilla-release
5053        - mozilla-beta
5054      * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing-e10s**
5055        - ❌
5056        - ❌
5057        - ❌
5058        - ❌
5059      * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing-fis-e10s**
5060        - ✅
5061        - ❌
5062        - ✅
5063        - ❌
5064
5065
5066   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
5067      :widths: 30 15 15 15 15
5068      :header-rows: 1
5069
5070      * - **Test Name**
5071        - mozilla-central
5072        - autoland
5073        - mozilla-release
5074        - mozilla-beta
5075      * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing-e10s**
5076        - ❌
5077        - ❌
5078        - ❌
5079        - ❌
5080      * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing-fis-e10s**
5081        - ✅
5082        - ❌
5083        - ✅
5084        - ❌
5085
5086
5087   .. list-table:: **test-windows10-32-qr/opt**
5088      :widths: 30 15 15 15 15
5089      :header-rows: 1
5090
5091      * - **Test Name**
5092        - mozilla-central
5093        - autoland
5094        - mozilla-release
5095        - mozilla-beta
5096      * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing-e10s**
5097        - ❌
5098        - ❌
5099        - ❌
5100        - ❌
5101      * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing-fis-e10s**
5102        - ❌
5103        - ❌
5104        - ❌
5105        - ❌
5106
5107
5108   .. list-table:: **test-windows10-32-shippable-qr/opt**
5109      :widths: 30 15 15 15 15
5110      :header-rows: 1
5111
5112      * - **Test Name**
5113        - mozilla-central
5114        - autoland
5115        - mozilla-release
5116        - mozilla-beta
5117      * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing-e10s**
5118        - ❌
5119        - ❌
5120        - ❌
5121        - ❌
5122      * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing-fis-e10s**
5123        - ❌
5124        - ❌
5125        - ❌
5126        - ❌
5127
5128
5129   .. list-table:: **test-windows10-64-qr/opt**
5130      :widths: 30 15 15 15 15
5131      :header-rows: 1
5132
5133      * - **Test Name**
5134        - mozilla-central
5135        - autoland
5136        - mozilla-release
5137        - mozilla-beta
5138      * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing-e10s**
5139        - ❌
5140        - ❌
5141        - ❌
5142        - ❌
5143      * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing-fis-e10s**
5144        - ❌
5145        - ❌
5146        - ❌
5147        - ❌
5148
5149
5150   .. list-table:: **test-windows10-64-shippable-qr/opt**
5151      :widths: 30 15 15 15 15
5152      :header-rows: 1
5153
5154      * - **Test Name**
5155        - mozilla-central
5156        - autoland
5157        - mozilla-release
5158        - mozilla-beta
5159      * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing-e10s**
5160        - ❌
5161        - ❌
5162        - ❌
5163        - ❌
5164      * - **browsertime-benchmark-wasm-firefox-wasm-misc-optimizing-fis-e10s**
5165        - ✅
5166        - ❌
5167        - ✅
5168        - ❌
5169
5170
5171
5172.. dropdown:: webaudio
5173   :container: + anchor-id-webaudio-b
5174
5175   **Owner**: :padenot and Media Team
5176
5177   * **alert threshold**: 2.0
5178   * **apps**: firefox, chrome, chromium
5179   * **expected**: pass
5180   * **gecko profile entries**: 4000000
5181   * **gecko profile interval**: 1
5182   * **lower is better**: true
5183   * **page cycles**: 5
5184   * **page timeout**: 360000
5185   * **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false}
5186   * **test url**: `<http://\<host\>:\<port\>/webaudio/index.html?raptor>`__
5187   * **type**: benchmark
5188   * **unit**: score
5189   * **Test Task**:
5190
5191   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
5192      :widths: 30 15 15 15 15
5193      :header-rows: 1
5194
5195      * - **Test Name**
5196        - mozilla-central
5197        - autoland
5198        - mozilla-release
5199        - mozilla-beta
5200      * - **browsertime-benchmark-firefox-webaudio-e10s**
5201        - ❌
5202        - ❌
5203        - ❌
5204        - ❌
5205      * - **browsertime-benchmark-firefox-webaudio-fis-e10s**
5206        - ❌
5207        - ❌
5208        - ❌
5209        - ❌
5210
5211
5212   .. list-table:: **test-linux1804-64-qr/opt**
5213      :widths: 30 15 15 15 15
5214      :header-rows: 1
5215
5216      * - **Test Name**
5217        - mozilla-central
5218        - autoland
5219        - mozilla-release
5220        - mozilla-beta
5221      * - **browsertime-benchmark-firefox-webaudio-e10s**
5222        - ❌
5223        - ❌
5224        - ❌
5225        - ❌
5226      * - **browsertime-benchmark-firefox-webaudio-fis-e10s**
5227        - ❌
5228        - ❌
5229        - ❌
5230        - ❌
5231
5232
5233   .. list-table:: **test-linux1804-64-shippable-qr/opt**
5234      :widths: 30 15 15 15 15
5235      :header-rows: 1
5236
5237      * - **Test Name**
5238        - mozilla-central
5239        - autoland
5240        - mozilla-release
5241        - mozilla-beta
5242      * - **browsertime-benchmark-chrome-webaudio-e10s**
5243        - ❌
5244        - ❌
5245        - ❌
5246        - ❌
5247      * - **browsertime-benchmark-chromium-webaudio-e10s**
5248        - ❌
5249        - ❌
5250        - ❌
5251        - ❌
5252      * - **browsertime-benchmark-firefox-webaudio-e10s**
5253        - ❌
5254        - ❌
5255        - ❌
5256        - ❌
5257      * - **browsertime-benchmark-firefox-webaudio-fis-e10s**
5258        - ✅
5259        - ✅
5260        - ✅
5261        - ✅
5262
5263
5264   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
5265      :widths: 30 15 15 15 15
5266      :header-rows: 1
5267
5268      * - **Test Name**
5269        - mozilla-central
5270        - autoland
5271        - mozilla-release
5272        - mozilla-beta
5273      * - **browsertime-benchmark-chrome-webaudio-e10s**
5274        - ❌
5275        - ❌
5276        - ❌
5277        - ❌
5278      * - **browsertime-benchmark-chromium-webaudio-e10s**
5279        - ❌
5280        - ❌
5281        - ❌
5282        - ❌
5283      * - **browsertime-benchmark-firefox-webaudio-e10s**
5284        - ❌
5285        - ❌
5286        - ❌
5287        - ❌
5288      * - **browsertime-benchmark-firefox-webaudio-fis-e10s**
5289        - ✅
5290        - ✅
5291        - ✅
5292        - ✅
5293
5294
5295   .. list-table:: **test-windows10-32-qr/opt**
5296      :widths: 30 15 15 15 15
5297      :header-rows: 1
5298
5299      * - **Test Name**
5300        - mozilla-central
5301        - autoland
5302        - mozilla-release
5303        - mozilla-beta
5304      * - **browsertime-benchmark-firefox-webaudio-e10s**
5305        - ❌
5306        - ❌
5307        - ❌
5308        - ❌
5309      * - **browsertime-benchmark-firefox-webaudio-fis-e10s**
5310        - ❌
5311        - ❌
5312        - ❌
5313        - ❌
5314
5315
5316   .. list-table:: **test-windows10-32-shippable-qr/opt**
5317      :widths: 30 15 15 15 15
5318      :header-rows: 1
5319
5320      * - **Test Name**
5321        - mozilla-central
5322        - autoland
5323        - mozilla-release
5324        - mozilla-beta
5325      * - **browsertime-benchmark-chrome-webaudio-e10s**
5326        - ❌
5327        - ❌
5328        - ❌
5329        - ❌
5330      * - **browsertime-benchmark-chromium-webaudio-e10s**
5331        - ❌
5332        - ❌
5333        - ❌
5334        - ❌
5335      * - **browsertime-benchmark-firefox-webaudio-e10s**
5336        - ❌
5337        - ❌
5338        - ❌
5339        - ❌
5340      * - **browsertime-benchmark-firefox-webaudio-fis-e10s**
5341        - ❌
5342        - ❌
5343        - ❌
5344        - ❌
5345
5346
5347   .. list-table:: **test-windows10-64-qr/opt**
5348      :widths: 30 15 15 15 15
5349      :header-rows: 1
5350
5351      * - **Test Name**
5352        - mozilla-central
5353        - autoland
5354        - mozilla-release
5355        - mozilla-beta
5356      * - **browsertime-benchmark-firefox-webaudio-e10s**
5357        - ❌
5358        - ❌
5359        - ❌
5360        - ❌
5361      * - **browsertime-benchmark-firefox-webaudio-fis-e10s**
5362        - ❌
5363        - ❌
5364        - ❌
5365        - ❌
5366
5367
5368   .. list-table:: **test-windows10-64-shippable-qr/opt**
5369      :widths: 30 15 15 15 15
5370      :header-rows: 1
5371
5372      * - **Test Name**
5373        - mozilla-central
5374        - autoland
5375        - mozilla-release
5376        - mozilla-beta
5377      * - **browsertime-benchmark-chrome-webaudio-e10s**
5378        - ❌
5379        - ❌
5380        - ❌
5381        - ❌
5382      * - **browsertime-benchmark-chromium-webaudio-e10s**
5383        - ❌
5384        - ❌
5385        - ❌
5386        - ❌
5387      * - **browsertime-benchmark-firefox-webaudio-e10s**
5388        - ❌
5389        - ❌
5390        - ❌
5391        - ❌
5392      * - **browsertime-benchmark-firefox-webaudio-fis-e10s**
5393        - ✅
5394        - ✅
5395        - ✅
5396        - ✅
5397
5398
5399
5400.. dropdown:: youtube-playback
5401   :container: + anchor-id-youtube-playback-b
5402
5403   **Owner**: PerfTest Team
5404
5405   * **alert on**: H264.1080p30@1X_dropped_frames, H264.1080p60@1X_dropped_frames, H264.1440p30@1X_dropped_frames, H264.144p15@1X_dropped_frames, H264.2160p30@1X_dropped_frames, H264.240p30@1X_dropped_frames, H264.360p30@1X_dropped_frames, H264.480p30@1X_dropped_frames, H264.720p30@1X_dropped_frames, H264.720p60@1X_dropped_frames, VP9.1080p30@1X_dropped_frames, VP9.1080p60@1X_dropped_frames, VP9.1440p30@1X_dropped_frames, VP9.1440p60@1X_dropped_frames, VP9.144p30@1X_dropped_frames, VP9.2160p30@1X_dropped_frames, VP9.2160p60@1X_dropped_frames, VP9.240p30@1X_dropped_frames, VP9.360p30@1X_dropped_frames, VP9.480p30@1X_dropped_frames, VP9.720p30@1X_dropped_frames, VP9.720p60@1X_dropped_frames
5406   * **alert threshold**: 2.0
5407   * **apps**: firefox, geckoview, fenix,refbrow, chrome
5408   * **expected**: pass
5409   * **gecko profile entries**: 50000000
5410   * **gecko profile interval**: 1000
5411   * **gecko profile threads**: MediaPlayback
5412   * **lower is better**: true
5413   * **page cycles**: 1
5414   * **page timeout**: 2700000
5415   * **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false}
5416   * **subtest lower is better**: true
5417   * **subtest unit**: score
5418   * **test url**: `<http://yttest.prod.mozaws.net/2019/main.html?test_type=playbackperf-test&raptor=true&command=run&exclude=1,2&muted=true>`__
5419   * **type**: benchmark
5420   * **unit**: score
5421   * **use live sites**: true
5422
5423.. dropdown:: youtube-playback-av1-sfr
5424   :container: + anchor-id-youtube-playback-av1-sfr-b
5425
5426   **Owner**: PerfTest Team
5427
5428   * **alert threshold**: 2.0
5429   * **apps**: firefox, geckoview, fenix, refbrow, chrome
5430   * **expected**: pass
5431   * **gecko profile entries**: 50000000
5432   * **gecko profile interval**: 1000
5433   * **gecko profile threads**: MediaPlayback
5434   * **lower is better**: true
5435   * **page cycles**: 1
5436   * **page timeout**: 2700000
5437   * **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false}
5438   * **subtest lower is better**: true
5439   * **subtest unit**: score
5440   * **test url**: `<https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-av1-test&raptor=true&exclude=1,2&muted=true&command=run>`__
5441   * **type**: benchmark
5442   * **unit**: score
5443   * **use live sites**: true
5444   * **Test Task**:
5445
5446   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
5447      :widths: 30 15 15 15 15
5448      :header-rows: 1
5449
5450      * - **Test Name**
5451        - mozilla-central
5452        - autoland
5453        - mozilla-release
5454        - mozilla-beta
5455      * - **browsertime-firefox-youtube-playback-av1-sfr-e10s**
5456        - ❌
5457        - ❌
5458        - ❌
5459        - ❌
5460      * - **browsertime-firefox-youtube-playback-av1-sfr-fis-e10s**
5461        - ✅
5462        - ❌
5463        - ✅
5464        - ❌
5465
5466
5467
5468.. dropdown:: youtube-playback-h264-1080p30
5469   :container: + anchor-id-youtube-playback-h264-1080p30-b
5470
5471   **Owner**: PerfTest Team
5472
5473   * **alert threshold**: 2.0
5474   * **apps**: firefox
5475   * **expected**: pass
5476   * **gecko profile entries**: 50000000
5477   * **gecko profile interval**: 1000
5478   * **gecko profile threads**: MediaPlayback
5479   * **lower is better**: true
5480   * **page cycles**: 1
5481   * **page timeout**: 2700000
5482   * **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false}
5483   * **subtest lower is better**: true
5484   * **subtest unit**: score
5485   * **test url**: `<https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-h264-test&tests=18&raptor=true&muted=true&command=run&exclude=1,2>`__
5486   * **type**: benchmark
5487   * **unit**: score
5488   * **use live sites**: true
5489
5490.. dropdown:: youtube-playback-h264-1080p60
5491   :container: + anchor-id-youtube-playback-h264-1080p60-b
5492
5493   **Owner**: PerfTest Team
5494
5495   * **alert threshold**: 2.0
5496   * **apps**: firefox
5497   * **expected**: pass
5498   * **gecko profile entries**: 50000000
5499   * **gecko profile interval**: 1000
5500   * **gecko profile threads**: MediaPlayback
5501   * **lower is better**: true
5502   * **page cycles**: 1
5503   * **page timeout**: 2700000
5504   * **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false}
5505   * **subtest lower is better**: true
5506   * **subtest unit**: score
5507   * **test url**: `<https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-hfr-test&raptor=true&tests=46&muted=true&command=run&exclude=1,2>`__
5508   * **type**: benchmark
5509   * **unit**: score
5510   * **use live sites**: true
5511
5512.. dropdown:: youtube-playback-h264-full-1080p30
5513   :container: + anchor-id-youtube-playback-h264-full-1080p30-b
5514
5515   **Owner**: PerfTest Team
5516
5517   * **alert threshold**: 2.0
5518   * **apps**: firefox
5519   * **expected**: pass
5520   * **gecko profile entries**: 50000000
5521   * **gecko profile interval**: 1000
5522   * **gecko profile threads**: MediaPlayback
5523   * **lower is better**: true
5524   * **page cycles**: 1
5525   * **page timeout**: 2700000
5526   * **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false, "full-screen-api.allow-trusted-requests-only": false, "full-screen-api.warning.timeout": 0}
5527   * **subtest lower is better**: true
5528   * **subtest unit**: score
5529   * **test url**: `<https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-h264-test&tests=18&raptor=true&muted=true&command=run&fullscreen=true&exclude=1,2>`__
5530   * **type**: benchmark
5531   * **unit**: score
5532   * **use live sites**: true
5533
5534.. dropdown:: youtube-playback-h264-full-1080p60
5535   :container: + anchor-id-youtube-playback-h264-full-1080p60-b
5536
5537   **Owner**: PerfTest Team
5538
5539   * **alert threshold**: 2.0
5540   * **apps**: firefox
5541   * **expected**: pass
5542   * **gecko profile entries**: 50000000
5543   * **gecko profile interval**: 1000
5544   * **gecko profile threads**: MediaPlayback
5545   * **lower is better**: true
5546   * **page cycles**: 1
5547   * **page timeout**: 2700000
5548   * **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false, "full-screen-api.allow-trusted-requests-only": false, "full-screen-api.warning.timeout": 0}
5549   * **subtest lower is better**: true
5550   * **subtest unit**: score
5551   * **test url**: `<https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-hfr-test&raptor=true&tests=46&muted=true&command=run&fullscreen=true&exclude=1,2>`__
5552   * **type**: benchmark
5553   * **unit**: score
5554   * **use live sites**: true
5555
5556.. dropdown:: youtube-playback-h264-sfr
5557   :container: + anchor-id-youtube-playback-h264-sfr-b
5558
5559   **Owner**: PerfTest Team
5560
5561   * **alert threshold**: 2.0
5562   * **apps**: firefox, geckoview, fenix, refbrow, chrome
5563   * **expected**: pass
5564   * **gecko profile entries**: 50000000
5565   * **gecko profile interval**: 1000
5566   * **gecko profile threads**: MediaPlayback
5567   * **lower is better**: true
5568   * **page cycles**: 1
5569   * **page timeout**: 2700000
5570   * **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false}
5571   * **subtest lower is better**: true
5572   * **subtest unit**: score
5573   * **test url**: `<https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-h264-test&raptor=true&exclude=1,2&muted=true&command=run>`__
5574   * **type**: benchmark
5575   * **unit**: score
5576   * **use live sites**: true
5577   * **Test Task**:
5578
5579   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
5580      :widths: 30 15 15 15 15
5581      :header-rows: 1
5582
5583      * - **Test Name**
5584        - mozilla-central
5585        - autoland
5586        - mozilla-release
5587        - mozilla-beta
5588      * - **browsertime-mobile-fenix-youtube-playback-h264-sfr-e10s**
5589        - ❌
5590        - ❌
5591        - ❌
5592        - ❌
5593      * - **browsertime-mobile-geckoview-youtube-playback-h264-sfr-e10s**
5594        - ❌
5595        - ❌
5596        - ❌
5597        - ❌
5598      * - **browsertime-mobile-refbrow-youtube-playback-h264-sfr-e10s**
5599        - ❌
5600        - ❌
5601        - ❌
5602        - ❌
5603
5604
5605   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
5606      :widths: 30 15 15 15 15
5607      :header-rows: 1
5608
5609      * - **Test Name**
5610        - mozilla-central
5611        - autoland
5612        - mozilla-release
5613        - mozilla-beta
5614      * - **browsertime-mobile-fenix-youtube-playback-h264-sfr-e10s**
5615        - ❌
5616        - ❌
5617        - ❌
5618        - ❌
5619      * - **browsertime-mobile-geckoview-youtube-playback-h264-sfr-e10s**
5620        - ✅
5621        - ❌
5622        - ✅
5623        - ❌
5624      * - **browsertime-mobile-refbrow-youtube-playback-h264-sfr-e10s**
5625        - ❌
5626        - ❌
5627        - ❌
5628        - ❌
5629
5630
5631   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
5632      :widths: 30 15 15 15 15
5633      :header-rows: 1
5634
5635      * - **Test Name**
5636        - mozilla-central
5637        - autoland
5638        - mozilla-release
5639        - mozilla-beta
5640      * - **browsertime-mobile-fenix-youtube-playback-h264-sfr-e10s**
5641        - ❌
5642        - ❌
5643        - ❌
5644        - ❌
5645      * - **browsertime-mobile-geckoview-youtube-playback-h264-sfr-e10s**
5646        - ❌
5647        - ❌
5648        - ❌
5649        - ❌
5650      * - **browsertime-mobile-refbrow-youtube-playback-h264-sfr-e10s**
5651        - ❌
5652        - ❌
5653        - ❌
5654        - ❌
5655
5656
5657   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
5658      :widths: 30 15 15 15 15
5659      :header-rows: 1
5660
5661      * - **Test Name**
5662        - mozilla-central
5663        - autoland
5664        - mozilla-release
5665        - mozilla-beta
5666      * - **browsertime-mobile-fenix-youtube-playback-h264-sfr-e10s**
5667        - ❌
5668        - ❌
5669        - ❌
5670        - ❌
5671      * - **browsertime-mobile-geckoview-youtube-playback-h264-sfr-e10s**
5672        - ✅
5673        - ❌
5674        - ✅
5675        - ❌
5676      * - **browsertime-mobile-refbrow-youtube-playback-h264-sfr-e10s**
5677        - ❌
5678        - ❌
5679        - ❌
5680        - ❌
5681
5682
5683   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
5684      :widths: 30 15 15 15 15
5685      :header-rows: 1
5686
5687      * - **Test Name**
5688        - mozilla-central
5689        - autoland
5690        - mozilla-release
5691        - mozilla-beta
5692      * - **browsertime-mobile-fenix-youtube-playback-h264-sfr-e10s**
5693        - ❌
5694        - ❌
5695        - ❌
5696        - ❌
5697      * - **browsertime-mobile-geckoview-youtube-playback-h264-sfr-e10s**
5698        - ❌
5699        - ❌
5700        - ❌
5701        - ❌
5702      * - **browsertime-mobile-refbrow-youtube-playback-h264-sfr-e10s**
5703        - ❌
5704        - ❌
5705        - ❌
5706        - ❌
5707
5708
5709   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
5710      :widths: 30 15 15 15 15
5711      :header-rows: 1
5712
5713      * - **Test Name**
5714        - mozilla-central
5715        - autoland
5716        - mozilla-release
5717        - mozilla-beta
5718      * - **browsertime-mobile-fenix-youtube-playback-h264-sfr-e10s**
5719        - ❌
5720        - ❌
5721        - ❌
5722        - ❌
5723      * - **browsertime-mobile-geckoview-youtube-playback-h264-sfr-e10s**
5724        - ❌
5725        - ❌
5726        - ❌
5727        - ❌
5728      * - **browsertime-mobile-refbrow-youtube-playback-h264-sfr-e10s**
5729        - ❌
5730        - ❌
5731        - ❌
5732        - ❌
5733
5734
5735   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
5736      :widths: 30 15 15 15 15
5737      :header-rows: 1
5738
5739      * - **Test Name**
5740        - mozilla-central
5741        - autoland
5742        - mozilla-release
5743        - mozilla-beta
5744      * - **browsertime-firefox-youtube-playback-h264-sfr-e10s**
5745        - ❌
5746        - ❌
5747        - ❌
5748        - ❌
5749      * - **browsertime-firefox-youtube-playback-h264-sfr-fis-e10s**
5750        - ❌
5751        - ❌
5752        - ❌
5753        - ❌
5754
5755
5756   .. list-table:: **test-linux1804-64-qr/opt**
5757      :widths: 30 15 15 15 15
5758      :header-rows: 1
5759
5760      * - **Test Name**
5761        - mozilla-central
5762        - autoland
5763        - mozilla-release
5764        - mozilla-beta
5765      * - **browsertime-firefox-youtube-playback-h264-sfr-e10s**
5766        - ❌
5767        - ❌
5768        - ❌
5769        - ❌
5770      * - **browsertime-firefox-youtube-playback-h264-sfr-fis-e10s**
5771        - ❌
5772        - ❌
5773        - ❌
5774        - ❌
5775
5776
5777   .. list-table:: **test-linux1804-64-shippable-qr/opt**
5778      :widths: 30 15 15 15 15
5779      :header-rows: 1
5780
5781      * - **Test Name**
5782        - mozilla-central
5783        - autoland
5784        - mozilla-release
5785        - mozilla-beta
5786      * - **browsertime-firefox-youtube-playback-h264-sfr-e10s**
5787        - ❌
5788        - ❌
5789        - ❌
5790        - ❌
5791      * - **browsertime-firefox-youtube-playback-h264-sfr-fis-e10s**
5792        - ✅
5793        - ❌
5794        - ✅
5795        - ❌
5796
5797
5798   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
5799      :widths: 30 15 15 15 15
5800      :header-rows: 1
5801
5802      * - **Test Name**
5803        - mozilla-central
5804        - autoland
5805        - mozilla-release
5806        - mozilla-beta
5807      * - **browsertime-firefox-youtube-playback-h264-sfr-e10s**
5808        - ❌
5809        - ❌
5810        - ❌
5811        - ❌
5812      * - **browsertime-firefox-youtube-playback-h264-sfr-fis-e10s**
5813        - ✅
5814        - ❌
5815        - ✅
5816        - ❌
5817
5818
5819   .. list-table:: **test-windows10-32-qr/opt**
5820      :widths: 30 15 15 15 15
5821      :header-rows: 1
5822
5823      * - **Test Name**
5824        - mozilla-central
5825        - autoland
5826        - mozilla-release
5827        - mozilla-beta
5828      * - **browsertime-firefox-youtube-playback-h264-sfr-e10s**
5829        - ❌
5830        - ❌
5831        - ❌
5832        - ❌
5833      * - **browsertime-firefox-youtube-playback-h264-sfr-fis-e10s**
5834        - ❌
5835        - ❌
5836        - ❌
5837        - ❌
5838
5839
5840   .. list-table:: **test-windows10-32-shippable-qr/opt**
5841      :widths: 30 15 15 15 15
5842      :header-rows: 1
5843
5844      * - **Test Name**
5845        - mozilla-central
5846        - autoland
5847        - mozilla-release
5848        - mozilla-beta
5849      * - **browsertime-firefox-youtube-playback-h264-sfr-e10s**
5850        - ❌
5851        - ❌
5852        - ❌
5853        - ❌
5854      * - **browsertime-firefox-youtube-playback-h264-sfr-fis-e10s**
5855        - ❌
5856        - ❌
5857        - ❌
5858        - ❌
5859
5860
5861   .. list-table:: **test-windows10-64-qr/opt**
5862      :widths: 30 15 15 15 15
5863      :header-rows: 1
5864
5865      * - **Test Name**
5866        - mozilla-central
5867        - autoland
5868        - mozilla-release
5869        - mozilla-beta
5870      * - **browsertime-firefox-youtube-playback-h264-sfr-e10s**
5871        - ❌
5872        - ❌
5873        - ❌
5874        - ❌
5875      * - **browsertime-firefox-youtube-playback-h264-sfr-fis-e10s**
5876        - ❌
5877        - ❌
5878        - ❌
5879        - ❌
5880
5881
5882   .. list-table:: **test-windows10-64-shippable-qr/opt**
5883      :widths: 30 15 15 15 15
5884      :header-rows: 1
5885
5886      * - **Test Name**
5887        - mozilla-central
5888        - autoland
5889        - mozilla-release
5890        - mozilla-beta
5891      * - **browsertime-firefox-youtube-playback-h264-sfr-e10s**
5892        - ❌
5893        - ❌
5894        - ❌
5895        - ❌
5896      * - **browsertime-firefox-youtube-playback-h264-sfr-fis-e10s**
5897        - ✅
5898        - ❌
5899        - ✅
5900        - ❌
5901
5902
5903
5904.. dropdown:: youtube-playback-hfr
5905   :container: + anchor-id-youtube-playback-hfr-b
5906
5907   **Owner**: PerfTest Team
5908
5909   * **alert on**: H2641080p60fps@1X_dropped_frames, H264720p60fps@1X_dropped_frames
5910   * **alert threshold**: 2.0
5911   * **apps**: firefox, geckoview, fenix, refbrow, chrome
5912   * **expected**: pass
5913   * **gecko profile entries**: 50000000
5914   * **gecko profile interval**: 1000
5915   * **gecko profile threads**: MediaPlayback
5916   * **lower is better**: true
5917   * **page cycles**: 1
5918   * **page timeout**: 2700000
5919   * **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false}
5920   * **subtest lower is better**: true
5921   * **subtest unit**: score
5922   * **test url**: `<https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-hfr-test&raptor=true&exclude=1,2&muted=true&command=run>`__
5923   * **type**: benchmark
5924   * **unit**: score
5925   * **use live sites**: true
5926   * **Test Task**:
5927
5928   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
5929      :widths: 30 15 15 15 15
5930      :header-rows: 1
5931
5932      * - **Test Name**
5933        - mozilla-central
5934        - autoland
5935        - mozilla-release
5936        - mozilla-beta
5937      * - **browsertime-mobile-fenix-youtube-playback-hfr-e10s**
5938        - ❌
5939        - ❌
5940        - ❌
5941        - ❌
5942      * - **browsertime-mobile-geckoview-youtube-playback-hfr-e10s**
5943        - ❌
5944        - ❌
5945        - ❌
5946        - ❌
5947      * - **browsertime-mobile-refbrow-youtube-playback-hfr-e10s**
5948        - ❌
5949        - ❌
5950        - ❌
5951        - ❌
5952
5953
5954   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
5955      :widths: 30 15 15 15 15
5956      :header-rows: 1
5957
5958      * - **Test Name**
5959        - mozilla-central
5960        - autoland
5961        - mozilla-release
5962        - mozilla-beta
5963      * - **browsertime-mobile-fenix-youtube-playback-hfr-e10s**
5964        - ❌
5965        - ❌
5966        - ❌
5967        - ❌
5968      * - **browsertime-mobile-geckoview-youtube-playback-hfr-e10s**
5969        - ✅
5970        - ❌
5971        - ✅
5972        - ❌
5973      * - **browsertime-mobile-refbrow-youtube-playback-hfr-e10s**
5974        - ❌
5975        - ❌
5976        - ❌
5977        - ❌
5978
5979
5980   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
5981      :widths: 30 15 15 15 15
5982      :header-rows: 1
5983
5984      * - **Test Name**
5985        - mozilla-central
5986        - autoland
5987        - mozilla-release
5988        - mozilla-beta
5989      * - **browsertime-mobile-fenix-youtube-playback-hfr-e10s**
5990        - ❌
5991        - ❌
5992        - ❌
5993        - ❌
5994      * - **browsertime-mobile-geckoview-youtube-playback-hfr-e10s**
5995        - ❌
5996        - ❌
5997        - ❌
5998        - ❌
5999      * - **browsertime-mobile-refbrow-youtube-playback-hfr-e10s**
6000        - ❌
6001        - ❌
6002        - ❌
6003        - ❌
6004
6005
6006   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
6007      :widths: 30 15 15 15 15
6008      :header-rows: 1
6009
6010      * - **Test Name**
6011        - mozilla-central
6012        - autoland
6013        - mozilla-release
6014        - mozilla-beta
6015      * - **browsertime-mobile-fenix-youtube-playback-hfr-e10s**
6016        - ❌
6017        - ❌
6018        - ❌
6019        - ❌
6020      * - **browsertime-mobile-geckoview-youtube-playback-hfr-e10s**
6021        - ✅
6022        - ❌
6023        - ✅
6024        - ❌
6025      * - **browsertime-mobile-refbrow-youtube-playback-hfr-e10s**
6026        - ❌
6027        - ❌
6028        - ❌
6029        - ❌
6030
6031
6032   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
6033      :widths: 30 15 15 15 15
6034      :header-rows: 1
6035
6036      * - **Test Name**
6037        - mozilla-central
6038        - autoland
6039        - mozilla-release
6040        - mozilla-beta
6041      * - **browsertime-mobile-fenix-youtube-playback-hfr-e10s**
6042        - ❌
6043        - ❌
6044        - ❌
6045        - ❌
6046      * - **browsertime-mobile-geckoview-youtube-playback-hfr-e10s**
6047        - ❌
6048        - ❌
6049        - ❌
6050        - ❌
6051      * - **browsertime-mobile-refbrow-youtube-playback-hfr-e10s**
6052        - ❌
6053        - ❌
6054        - ❌
6055        - ❌
6056
6057
6058   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
6059      :widths: 30 15 15 15 15
6060      :header-rows: 1
6061
6062      * - **Test Name**
6063        - mozilla-central
6064        - autoland
6065        - mozilla-release
6066        - mozilla-beta
6067      * - **browsertime-mobile-fenix-youtube-playback-hfr-e10s**
6068        - ❌
6069        - ❌
6070        - ❌
6071        - ❌
6072      * - **browsertime-mobile-geckoview-youtube-playback-hfr-e10s**
6073        - ❌
6074        - ❌
6075        - ❌
6076        - ❌
6077      * - **browsertime-mobile-refbrow-youtube-playback-hfr-e10s**
6078        - ❌
6079        - ❌
6080        - ❌
6081        - ❌
6082
6083
6084   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
6085      :widths: 30 15 15 15 15
6086      :header-rows: 1
6087
6088      * - **Test Name**
6089        - mozilla-central
6090        - autoland
6091        - mozilla-release
6092        - mozilla-beta
6093      * - **browsertime-firefox-youtube-playback-hfr-e10s**
6094        - ❌
6095        - ❌
6096        - ❌
6097        - ❌
6098      * - **browsertime-firefox-youtube-playback-hfr-fis-e10s**
6099        - ❌
6100        - ❌
6101        - ❌
6102        - ❌
6103
6104
6105   .. list-table:: **test-linux1804-64-qr/opt**
6106      :widths: 30 15 15 15 15
6107      :header-rows: 1
6108
6109      * - **Test Name**
6110        - mozilla-central
6111        - autoland
6112        - mozilla-release
6113        - mozilla-beta
6114      * - **browsertime-firefox-youtube-playback-hfr-e10s**
6115        - ❌
6116        - ❌
6117        - ❌
6118        - ❌
6119      * - **browsertime-firefox-youtube-playback-hfr-fis-e10s**
6120        - ❌
6121        - ❌
6122        - ❌
6123        - ❌
6124
6125
6126   .. list-table:: **test-linux1804-64-shippable-qr/opt**
6127      :widths: 30 15 15 15 15
6128      :header-rows: 1
6129
6130      * - **Test Name**
6131        - mozilla-central
6132        - autoland
6133        - mozilla-release
6134        - mozilla-beta
6135      * - **browsertime-firefox-youtube-playback-hfr-e10s**
6136        - ❌
6137        - ❌
6138        - ❌
6139        - ❌
6140      * - **browsertime-firefox-youtube-playback-hfr-fis-e10s**
6141        - ✅
6142        - ❌
6143        - ✅
6144        - ❌
6145
6146
6147   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
6148      :widths: 30 15 15 15 15
6149      :header-rows: 1
6150
6151      * - **Test Name**
6152        - mozilla-central
6153        - autoland
6154        - mozilla-release
6155        - mozilla-beta
6156      * - **browsertime-firefox-youtube-playback-hfr-e10s**
6157        - ❌
6158        - ❌
6159        - ❌
6160        - ❌
6161      * - **browsertime-firefox-youtube-playback-hfr-fis-e10s**
6162        - ✅
6163        - ❌
6164        - ✅
6165        - ❌
6166
6167
6168   .. list-table:: **test-windows10-32-qr/opt**
6169      :widths: 30 15 15 15 15
6170      :header-rows: 1
6171
6172      * - **Test Name**
6173        - mozilla-central
6174        - autoland
6175        - mozilla-release
6176        - mozilla-beta
6177      * - **browsertime-firefox-youtube-playback-hfr-e10s**
6178        - ❌
6179        - ❌
6180        - ❌
6181        - ❌
6182      * - **browsertime-firefox-youtube-playback-hfr-fis-e10s**
6183        - ❌
6184        - ❌
6185        - ❌
6186        - ❌
6187
6188
6189   .. list-table:: **test-windows10-32-shippable-qr/opt**
6190      :widths: 30 15 15 15 15
6191      :header-rows: 1
6192
6193      * - **Test Name**
6194        - mozilla-central
6195        - autoland
6196        - mozilla-release
6197        - mozilla-beta
6198      * - **browsertime-firefox-youtube-playback-hfr-e10s**
6199        - ❌
6200        - ❌
6201        - ❌
6202        - ❌
6203      * - **browsertime-firefox-youtube-playback-hfr-fis-e10s**
6204        - ❌
6205        - ❌
6206        - ❌
6207        - ❌
6208
6209
6210   .. list-table:: **test-windows10-64-qr/opt**
6211      :widths: 30 15 15 15 15
6212      :header-rows: 1
6213
6214      * - **Test Name**
6215        - mozilla-central
6216        - autoland
6217        - mozilla-release
6218        - mozilla-beta
6219      * - **browsertime-firefox-youtube-playback-hfr-e10s**
6220        - ❌
6221        - ❌
6222        - ❌
6223        - ❌
6224      * - **browsertime-firefox-youtube-playback-hfr-fis-e10s**
6225        - ❌
6226        - ❌
6227        - ❌
6228        - ❌
6229
6230
6231   .. list-table:: **test-windows10-64-shippable-qr/opt**
6232      :widths: 30 15 15 15 15
6233      :header-rows: 1
6234
6235      * - **Test Name**
6236        - mozilla-central
6237        - autoland
6238        - mozilla-release
6239        - mozilla-beta
6240      * - **browsertime-firefox-youtube-playback-hfr-e10s**
6241        - ❌
6242        - ❌
6243        - ❌
6244        - ❌
6245      * - **browsertime-firefox-youtube-playback-hfr-fis-e10s**
6246        - ✅
6247        - ❌
6248        - ✅
6249        - ❌
6250
6251
6252
6253.. dropdown:: youtube-playback-v9-1080p30
6254   :container: + anchor-id-youtube-playback-v9-1080p30-b
6255
6256   **Owner**: PerfTest Team
6257
6258   * **alert threshold**: 2.0
6259   * **apps**: firefox
6260   * **expected**: pass
6261   * **gecko profile entries**: 50000000
6262   * **gecko profile interval**: 1000
6263   * **gecko profile threads**: MediaPlayback
6264   * **lower is better**: true
6265   * **page cycles**: 1
6266   * **page timeout**: 2700000
6267   * **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false}
6268   * **subtest lower is better**: true
6269   * **subtest unit**: score
6270   * **test url**: `<https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-vp9-test&raptor=true&tests=18&muted=true&command=run&exclude=1,2>`__
6271   * **type**: benchmark
6272   * **unit**: score
6273   * **use live sites**: true
6274
6275.. dropdown:: youtube-playback-v9-1080p60
6276   :container: + anchor-id-youtube-playback-v9-1080p60-b
6277
6278   **Owner**: PerfTest Team
6279
6280   * **alert threshold**: 2.0
6281   * **apps**: firefox
6282   * **expected**: pass
6283   * **gecko profile entries**: 50000000
6284   * **gecko profile interval**: 1000
6285   * **gecko profile threads**: MediaPlayback
6286   * **lower is better**: true
6287   * **page cycles**: 1
6288   * **page timeout**: 2700000
6289   * **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false}
6290   * **subtest lower is better**: true
6291   * **subtest unit**: score
6292   * **test url**: `<https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-hfr-test&raptor=true&tests=14&muted=true&command=run&exclude=1,2>`__
6293   * **type**: benchmark
6294   * **unit**: score
6295   * **use live sites**: true
6296
6297.. dropdown:: youtube-playback-v9-full-1080p30
6298   :container: + anchor-id-youtube-playback-v9-full-1080p30-b
6299
6300   **Owner**: PerfTest Team
6301
6302   * **alert threshold**: 2.0
6303   * **apps**: firefox
6304   * **expected**: pass
6305   * **gecko profile entries**: 50000000
6306   * **gecko profile interval**: 1000
6307   * **gecko profile threads**: MediaPlayback
6308   * **lower is better**: true
6309   * **page cycles**: 1
6310   * **page timeout**: 2700000
6311   * **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false, "full-screen-api.allow-trusted-requests-only": false, "full-screen-api.warning.timeout": 0}
6312   * **subtest lower is better**: true
6313   * **subtest unit**: score
6314   * **test url**: `<https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-vp9-test&raptor=true&tests=18&muted=true&command=run&fullscreen=true&exclude=1,2>`__
6315   * **type**: benchmark
6316   * **unit**: score
6317   * **use live sites**: true
6318
6319.. dropdown:: youtube-playback-v9-full-1080p60
6320   :container: + anchor-id-youtube-playback-v9-full-1080p60-b
6321
6322   **Owner**: PerfTest Team
6323
6324   * **alert threshold**: 2.0
6325   * **apps**: firefox
6326   * **expected**: pass
6327   * **gecko profile entries**: 50000000
6328   * **gecko profile interval**: 1000
6329   * **gecko profile threads**: MediaPlayback
6330   * **lower is better**: true
6331   * **page cycles**: 1
6332   * **page timeout**: 2700000
6333   * **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false, "full-screen-api.allow-trusted-requests-only": false, "full-screen-api.warning.timeout": 0}
6334   * **subtest lower is better**: true
6335   * **subtest unit**: score
6336   * **test url**: `<https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-hfr-test&raptor=true&tests=14&muted=true&command=run&fullscreen=true&exclude=1,2>`__
6337   * **type**: benchmark
6338   * **unit**: score
6339   * **use live sites**: true
6340
6341.. dropdown:: youtube-playback-vp9-sfr
6342   :container: + anchor-id-youtube-playback-vp9-sfr-b
6343
6344   **Owner**: PerfTest Team
6345
6346   * **alert threshold**: 2.0
6347   * **apps**: firefox, geckoview, fenix, refbrow, chrome
6348   * **expected**: pass
6349   * **gecko profile entries**: 50000000
6350   * **gecko profile interval**: 1000
6351   * **gecko profile threads**: MediaPlayback
6352   * **lower is better**: true
6353   * **page cycles**: 1
6354   * **page timeout**: 2700000
6355   * **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false}
6356   * **subtest lower is better**: true
6357   * **subtest unit**: score
6358   * **test url**: `<https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-sfr-vp9-test&raptor=true&exclude=1,2&muted=true&command=run>`__
6359   * **type**: benchmark
6360   * **unit**: score
6361   * **use live sites**: true
6362   * **Test Task**:
6363
6364   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
6365      :widths: 30 15 15 15 15
6366      :header-rows: 1
6367
6368      * - **Test Name**
6369        - mozilla-central
6370        - autoland
6371        - mozilla-release
6372        - mozilla-beta
6373      * - **browsertime-mobile-fenix-youtube-playback-vp9-sfr-e10s**
6374        - ❌
6375        - ❌
6376        - ❌
6377        - ❌
6378      * - **browsertime-mobile-geckoview-youtube-playback-vp9-sfr-e10s**
6379        - ❌
6380        - ❌
6381        - ❌
6382        - ❌
6383      * - **browsertime-mobile-refbrow-youtube-playback-vp9-sfr-e10s**
6384        - ❌
6385        - ❌
6386        - ❌
6387        - ❌
6388
6389
6390   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
6391      :widths: 30 15 15 15 15
6392      :header-rows: 1
6393
6394      * - **Test Name**
6395        - mozilla-central
6396        - autoland
6397        - mozilla-release
6398        - mozilla-beta
6399      * - **browsertime-mobile-fenix-youtube-playback-vp9-sfr-e10s**
6400        - ❌
6401        - ❌
6402        - ❌
6403        - ❌
6404      * - **browsertime-mobile-geckoview-youtube-playback-vp9-sfr-e10s**
6405        - ✅
6406        - ❌
6407        - ✅
6408        - ❌
6409      * - **browsertime-mobile-refbrow-youtube-playback-vp9-sfr-e10s**
6410        - ❌
6411        - ❌
6412        - ❌
6413        - ❌
6414
6415
6416   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
6417      :widths: 30 15 15 15 15
6418      :header-rows: 1
6419
6420      * - **Test Name**
6421        - mozilla-central
6422        - autoland
6423        - mozilla-release
6424        - mozilla-beta
6425      * - **browsertime-mobile-fenix-youtube-playback-vp9-sfr-e10s**
6426        - ❌
6427        - ❌
6428        - ❌
6429        - ❌
6430      * - **browsertime-mobile-geckoview-youtube-playback-vp9-sfr-e10s**
6431        - ❌
6432        - ❌
6433        - ❌
6434        - ❌
6435      * - **browsertime-mobile-refbrow-youtube-playback-vp9-sfr-e10s**
6436        - ❌
6437        - ❌
6438        - ❌
6439        - ❌
6440
6441
6442   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
6443      :widths: 30 15 15 15 15
6444      :header-rows: 1
6445
6446      * - **Test Name**
6447        - mozilla-central
6448        - autoland
6449        - mozilla-release
6450        - mozilla-beta
6451      * - **browsertime-mobile-fenix-youtube-playback-vp9-sfr-e10s**
6452        - ❌
6453        - ❌
6454        - ❌
6455        - ❌
6456      * - **browsertime-mobile-geckoview-youtube-playback-vp9-sfr-e10s**
6457        - ❌
6458        - ❌
6459        - ❌
6460        - ❌
6461      * - **browsertime-mobile-refbrow-youtube-playback-vp9-sfr-e10s**
6462        - ❌
6463        - ❌
6464        - ❌
6465        - ❌
6466
6467
6468   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
6469      :widths: 30 15 15 15 15
6470      :header-rows: 1
6471
6472      * - **Test Name**
6473        - mozilla-central
6474        - autoland
6475        - mozilla-release
6476        - mozilla-beta
6477      * - **browsertime-firefox-youtube-playback-vp9-sfr-e10s**
6478        - ❌
6479        - ❌
6480        - ❌
6481        - ❌
6482      * - **browsertime-firefox-youtube-playback-vp9-sfr-fis-e10s**
6483        - ❌
6484        - ❌
6485        - ❌
6486        - ❌
6487
6488
6489   .. list-table:: **test-linux1804-64-qr/opt**
6490      :widths: 30 15 15 15 15
6491      :header-rows: 1
6492
6493      * - **Test Name**
6494        - mozilla-central
6495        - autoland
6496        - mozilla-release
6497        - mozilla-beta
6498      * - **browsertime-firefox-youtube-playback-vp9-sfr-e10s**
6499        - ❌
6500        - ❌
6501        - ❌
6502        - ❌
6503      * - **browsertime-firefox-youtube-playback-vp9-sfr-fis-e10s**
6504        - ❌
6505        - ❌
6506        - ❌
6507        - ❌
6508
6509
6510   .. list-table:: **test-linux1804-64-shippable-qr/opt**
6511      :widths: 30 15 15 15 15
6512      :header-rows: 1
6513
6514      * - **Test Name**
6515        - mozilla-central
6516        - autoland
6517        - mozilla-release
6518        - mozilla-beta
6519      * - **browsertime-firefox-youtube-playback-vp9-sfr-e10s**
6520        - ❌
6521        - ❌
6522        - ❌
6523        - ❌
6524      * - **browsertime-firefox-youtube-playback-vp9-sfr-fis-e10s**
6525        - ✅
6526        - ❌
6527        - ✅
6528        - ❌
6529
6530
6531   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
6532      :widths: 30 15 15 15 15
6533      :header-rows: 1
6534
6535      * - **Test Name**
6536        - mozilla-central
6537        - autoland
6538        - mozilla-release
6539        - mozilla-beta
6540      * - **browsertime-firefox-youtube-playback-vp9-sfr-e10s**
6541        - ❌
6542        - ❌
6543        - ❌
6544        - ❌
6545      * - **browsertime-firefox-youtube-playback-vp9-sfr-fis-e10s**
6546        - ✅
6547        - ❌
6548        - ✅
6549        - ❌
6550
6551
6552   .. list-table:: **test-windows10-32-qr/opt**
6553      :widths: 30 15 15 15 15
6554      :header-rows: 1
6555
6556      * - **Test Name**
6557        - mozilla-central
6558        - autoland
6559        - mozilla-release
6560        - mozilla-beta
6561      * - **browsertime-firefox-youtube-playback-vp9-sfr-e10s**
6562        - ❌
6563        - ❌
6564        - ❌
6565        - ❌
6566      * - **browsertime-firefox-youtube-playback-vp9-sfr-fis-e10s**
6567        - ❌
6568        - ❌
6569        - ❌
6570        - ❌
6571
6572
6573   .. list-table:: **test-windows10-32-shippable-qr/opt**
6574      :widths: 30 15 15 15 15
6575      :header-rows: 1
6576
6577      * - **Test Name**
6578        - mozilla-central
6579        - autoland
6580        - mozilla-release
6581        - mozilla-beta
6582      * - **browsertime-firefox-youtube-playback-vp9-sfr-e10s**
6583        - ❌
6584        - ❌
6585        - ❌
6586        - ❌
6587      * - **browsertime-firefox-youtube-playback-vp9-sfr-fis-e10s**
6588        - ❌
6589        - ❌
6590        - ❌
6591        - ❌
6592
6593
6594   .. list-table:: **test-windows10-64-qr/opt**
6595      :widths: 30 15 15 15 15
6596      :header-rows: 1
6597
6598      * - **Test Name**
6599        - mozilla-central
6600        - autoland
6601        - mozilla-release
6602        - mozilla-beta
6603      * - **browsertime-firefox-youtube-playback-vp9-sfr-e10s**
6604        - ❌
6605        - ❌
6606        - ❌
6607        - ❌
6608      * - **browsertime-firefox-youtube-playback-vp9-sfr-fis-e10s**
6609        - ❌
6610        - ❌
6611        - ❌
6612        - ❌
6613
6614
6615   .. list-table:: **test-windows10-64-shippable-qr/opt**
6616      :widths: 30 15 15 15 15
6617      :header-rows: 1
6618
6619      * - **Test Name**
6620        - mozilla-central
6621        - autoland
6622        - mozilla-release
6623        - mozilla-beta
6624      * - **browsertime-firefox-youtube-playback-vp9-sfr-e10s**
6625        - ❌
6626        - ❌
6627        - ❌
6628        - ❌
6629      * - **browsertime-firefox-youtube-playback-vp9-sfr-fis-e10s**
6630        - ✅
6631        - ❌
6632        - ✅
6633        - ❌
6634
6635
6636
6637.. dropdown:: youtube-playback-widevine-h264-sfr
6638   :container: + anchor-id-youtube-playback-widevine-h264-sfr-b
6639
6640   **Owner**: PerfTest Team
6641
6642   * **alert threshold**: 2.0
6643   * **apps**: firefox, geckoview, fenix, refbrow, chrome
6644   * **expected**: pass
6645   * **gecko profile entries**: 50000000
6646   * **gecko profile interval**: 1000
6647   * **gecko profile threads**: MediaPlayback
6648   * **lower is better**: true
6649   * **page cycles**: 1
6650   * **page timeout**: 2700000
6651   * **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false, "media.eme.enabled": true, "media.gmp-manager.updateEnabled": true, "media.eme.require-app-approval": false}
6652   * **subtest lower is better**: true
6653   * **subtest unit**: score
6654   * **test url**: `<https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-widevine-sfr-h264-test&raptor=true&exclude=1,2&muted=true&command=run>`__
6655   * **type**: benchmark
6656   * **unit**: score
6657   * **use live sites**: true
6658   * **Test Task**:
6659
6660   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
6661      :widths: 30 15 15 15 15
6662      :header-rows: 1
6663
6664      * - **Test Name**
6665        - mozilla-central
6666        - autoland
6667        - mozilla-release
6668        - mozilla-beta
6669      * - **browsertime-firefox-youtube-playback-widevine-h264-sfr-e10s**
6670        - ❌
6671        - ❌
6672        - ❌
6673        - ❌
6674      * - **browsertime-firefox-youtube-playback-widevine-h264-sfr-fis-e10s**
6675        - ❌
6676        - ❌
6677        - ❌
6678        - ❌
6679
6680
6681   .. list-table:: **test-linux1804-64-qr/opt**
6682      :widths: 30 15 15 15 15
6683      :header-rows: 1
6684
6685      * - **Test Name**
6686        - mozilla-central
6687        - autoland
6688        - mozilla-release
6689        - mozilla-beta
6690      * - **browsertime-firefox-youtube-playback-widevine-h264-sfr-e10s**
6691        - ❌
6692        - ❌
6693        - ❌
6694        - ❌
6695      * - **browsertime-firefox-youtube-playback-widevine-h264-sfr-fis-e10s**
6696        - ❌
6697        - ❌
6698        - ❌
6699        - ❌
6700
6701
6702   .. list-table:: **test-linux1804-64-shippable-qr/opt**
6703      :widths: 30 15 15 15 15
6704      :header-rows: 1
6705
6706      * - **Test Name**
6707        - mozilla-central
6708        - autoland
6709        - mozilla-release
6710        - mozilla-beta
6711      * - **browsertime-firefox-youtube-playback-widevine-h264-sfr-e10s**
6712        - ❌
6713        - ❌
6714        - ❌
6715        - ❌
6716      * - **browsertime-firefox-youtube-playback-widevine-h264-sfr-fis-e10s**
6717        - ✅
6718        - ❌
6719        - ✅
6720        - ❌
6721
6722
6723   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
6724      :widths: 30 15 15 15 15
6725      :header-rows: 1
6726
6727      * - **Test Name**
6728        - mozilla-central
6729        - autoland
6730        - mozilla-release
6731        - mozilla-beta
6732      * - **browsertime-firefox-youtube-playback-widevine-h264-sfr-e10s**
6733        - ❌
6734        - ❌
6735        - ❌
6736        - ❌
6737      * - **browsertime-firefox-youtube-playback-widevine-h264-sfr-fis-e10s**
6738        - ✅
6739        - ❌
6740        - ✅
6741        - ❌
6742
6743
6744   .. list-table:: **test-windows10-32-qr/opt**
6745      :widths: 30 15 15 15 15
6746      :header-rows: 1
6747
6748      * - **Test Name**
6749        - mozilla-central
6750        - autoland
6751        - mozilla-release
6752        - mozilla-beta
6753      * - **browsertime-firefox-youtube-playback-widevine-h264-sfr-e10s**
6754        - ❌
6755        - ❌
6756        - ❌
6757        - ❌
6758      * - **browsertime-firefox-youtube-playback-widevine-h264-sfr-fis-e10s**
6759        - ❌
6760        - ❌
6761        - ❌
6762        - ❌
6763
6764
6765   .. list-table:: **test-windows10-32-shippable-qr/opt**
6766      :widths: 30 15 15 15 15
6767      :header-rows: 1
6768
6769      * - **Test Name**
6770        - mozilla-central
6771        - autoland
6772        - mozilla-release
6773        - mozilla-beta
6774      * - **browsertime-firefox-youtube-playback-widevine-h264-sfr-e10s**
6775        - ❌
6776        - ❌
6777        - ❌
6778        - ❌
6779      * - **browsertime-firefox-youtube-playback-widevine-h264-sfr-fis-e10s**
6780        - ❌
6781        - ❌
6782        - ❌
6783        - ❌
6784
6785
6786   .. list-table:: **test-windows10-64-qr/opt**
6787      :widths: 30 15 15 15 15
6788      :header-rows: 1
6789
6790      * - **Test Name**
6791        - mozilla-central
6792        - autoland
6793        - mozilla-release
6794        - mozilla-beta
6795      * - **browsertime-firefox-youtube-playback-widevine-h264-sfr-e10s**
6796        - ❌
6797        - ❌
6798        - ❌
6799        - ❌
6800      * - **browsertime-firefox-youtube-playback-widevine-h264-sfr-fis-e10s**
6801        - ❌
6802        - ❌
6803        - ❌
6804        - ❌
6805
6806
6807   .. list-table:: **test-windows10-64-shippable-qr/opt**
6808      :widths: 30 15 15 15 15
6809      :header-rows: 1
6810
6811      * - **Test Name**
6812        - mozilla-central
6813        - autoland
6814        - mozilla-release
6815        - mozilla-beta
6816      * - **browsertime-firefox-youtube-playback-widevine-h264-sfr-e10s**
6817        - ❌
6818        - ❌
6819        - ❌
6820        - ❌
6821      * - **browsertime-firefox-youtube-playback-widevine-h264-sfr-fis-e10s**
6822        - ✅
6823        - ❌
6824        - ✅
6825        - ❌
6826
6827
6828
6829.. dropdown:: youtube-playback-widevine-hfr
6830   :container: + anchor-id-youtube-playback-widevine-hfr-b
6831
6832   **Owner**: PerfTest Team
6833
6834   * **alert threshold**: 2.0
6835   * **apps**: firefox, geckoview, fenix, refbrow, chrome
6836   * **expected**: pass
6837   * **gecko profile entries**: 50000000
6838   * **gecko profile interval**: 1000
6839   * **gecko profile threads**: MediaPlayback
6840   * **lower is better**: true
6841   * **page cycles**: 1
6842   * **page timeout**: 2700000
6843   * **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false, "media.eme.enabled": true, "media.gmp-manager.updateEnabled": true, "media.eme.require-app-approval": false}
6844   * **subtest lower is better**: true
6845   * **subtest unit**: score
6846   * **test url**: `<https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-widevine-hfr-test&raptor=true&exclude=1,2&muted=true&command=run>`__
6847   * **type**: benchmark
6848   * **unit**: score
6849   * **use live sites**: true
6850   * **Test Task**:
6851
6852   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
6853      :widths: 30 15 15 15 15
6854      :header-rows: 1
6855
6856      * - **Test Name**
6857        - mozilla-central
6858        - autoland
6859        - mozilla-release
6860        - mozilla-beta
6861      * - **browsertime-firefox-youtube-playback-widevine-hfr-e10s**
6862        - ❌
6863        - ❌
6864        - ❌
6865        - ❌
6866      * - **browsertime-firefox-youtube-playback-widevine-hfr-fis-e10s**
6867        - ❌
6868        - ❌
6869        - ❌
6870        - ❌
6871
6872
6873   .. list-table:: **test-linux1804-64-qr/opt**
6874      :widths: 30 15 15 15 15
6875      :header-rows: 1
6876
6877      * - **Test Name**
6878        - mozilla-central
6879        - autoland
6880        - mozilla-release
6881        - mozilla-beta
6882      * - **browsertime-firefox-youtube-playback-widevine-hfr-e10s**
6883        - ❌
6884        - ❌
6885        - ❌
6886        - ❌
6887      * - **browsertime-firefox-youtube-playback-widevine-hfr-fis-e10s**
6888        - ❌
6889        - ❌
6890        - ❌
6891        - ❌
6892
6893
6894   .. list-table:: **test-linux1804-64-shippable-qr/opt**
6895      :widths: 30 15 15 15 15
6896      :header-rows: 1
6897
6898      * - **Test Name**
6899        - mozilla-central
6900        - autoland
6901        - mozilla-release
6902        - mozilla-beta
6903      * - **browsertime-firefox-youtube-playback-widevine-hfr-e10s**
6904        - ❌
6905        - ❌
6906        - ❌
6907        - ❌
6908      * - **browsertime-firefox-youtube-playback-widevine-hfr-fis-e10s**
6909        - ✅
6910        - ❌
6911        - ✅
6912        - ❌
6913
6914
6915   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
6916      :widths: 30 15 15 15 15
6917      :header-rows: 1
6918
6919      * - **Test Name**
6920        - mozilla-central
6921        - autoland
6922        - mozilla-release
6923        - mozilla-beta
6924      * - **browsertime-firefox-youtube-playback-widevine-hfr-e10s**
6925        - ❌
6926        - ❌
6927        - ❌
6928        - ❌
6929      * - **browsertime-firefox-youtube-playback-widevine-hfr-fis-e10s**
6930        - ✅
6931        - ❌
6932        - ✅
6933        - ❌
6934
6935
6936   .. list-table:: **test-windows10-32-qr/opt**
6937      :widths: 30 15 15 15 15
6938      :header-rows: 1
6939
6940      * - **Test Name**
6941        - mozilla-central
6942        - autoland
6943        - mozilla-release
6944        - mozilla-beta
6945      * - **browsertime-firefox-youtube-playback-widevine-hfr-e10s**
6946        - ❌
6947        - ❌
6948        - ❌
6949        - ❌
6950      * - **browsertime-firefox-youtube-playback-widevine-hfr-fis-e10s**
6951        - ❌
6952        - ❌
6953        - ❌
6954        - ❌
6955
6956
6957   .. list-table:: **test-windows10-32-shippable-qr/opt**
6958      :widths: 30 15 15 15 15
6959      :header-rows: 1
6960
6961      * - **Test Name**
6962        - mozilla-central
6963        - autoland
6964        - mozilla-release
6965        - mozilla-beta
6966      * - **browsertime-firefox-youtube-playback-widevine-hfr-e10s**
6967        - ❌
6968        - ❌
6969        - ❌
6970        - ❌
6971      * - **browsertime-firefox-youtube-playback-widevine-hfr-fis-e10s**
6972        - ❌
6973        - ❌
6974        - ❌
6975        - ❌
6976
6977
6978   .. list-table:: **test-windows10-64-qr/opt**
6979      :widths: 30 15 15 15 15
6980      :header-rows: 1
6981
6982      * - **Test Name**
6983        - mozilla-central
6984        - autoland
6985        - mozilla-release
6986        - mozilla-beta
6987      * - **browsertime-firefox-youtube-playback-widevine-hfr-e10s**
6988        - ❌
6989        - ❌
6990        - ❌
6991        - ❌
6992      * - **browsertime-firefox-youtube-playback-widevine-hfr-fis-e10s**
6993        - ❌
6994        - ❌
6995        - ❌
6996        - ❌
6997
6998
6999   .. list-table:: **test-windows10-64-shippable-qr/opt**
7000      :widths: 30 15 15 15 15
7001      :header-rows: 1
7002
7003      * - **Test Name**
7004        - mozilla-central
7005        - autoland
7006        - mozilla-release
7007        - mozilla-beta
7008      * - **browsertime-firefox-youtube-playback-widevine-hfr-e10s**
7009        - ❌
7010        - ❌
7011        - ❌
7012        - ❌
7013      * - **browsertime-firefox-youtube-playback-widevine-hfr-fis-e10s**
7014        - ✅
7015        - ❌
7016        - ✅
7017        - ❌
7018
7019
7020
7021.. dropdown:: youtube-playback-widevine-vp9-sfr
7022   :container: + anchor-id-youtube-playback-widevine-vp9-sfr-b
7023
7024   **Owner**: PerfTest Team
7025
7026   * **alert threshold**: 2.0
7027   * **apps**: firefox, geckoview, fenix, refbrow, chrome
7028   * **expected**: pass
7029   * **gecko profile entries**: 50000000
7030   * **gecko profile interval**: 1000
7031   * **gecko profile threads**: MediaPlayback
7032   * **lower is better**: true
7033   * **page cycles**: 1
7034   * **page timeout**: 2700000
7035   * **preferences**: {"media.autoplay.default": 0, "media.autoplay.ask-permission": false, "media.autoplay.blocking_policy": 0, "media.autoplay.block-webaudio": false, "media.allowed-to-play.enabled": true, "media.block-autoplay-until-in-foreground": false, "media.eme.enabled": true, "media.gmp-manager.updateEnabled": true, "media.eme.require-app-approval": false}
7036   * **subtest lower is better**: true
7037   * **subtest unit**: score
7038   * **test url**: `<https://yttest.prod.mozaws.net/2020/main.html?test_type=playbackperf-widevine-sfr-vp9-test&raptor=true&exclude=1,2&muted=true&command=run>`__
7039   * **type**: benchmark
7040   * **unit**: score
7041   * **use live sites**: true
7042   * **Test Task**:
7043
7044   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
7045      :widths: 30 15 15 15 15
7046      :header-rows: 1
7047
7048      * - **Test Name**
7049        - mozilla-central
7050        - autoland
7051        - mozilla-release
7052        - mozilla-beta
7053      * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr-e10s**
7054        - ❌
7055        - ❌
7056        - ❌
7057        - ❌
7058      * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr-fis-e10s**
7059        - ❌
7060        - ❌
7061        - ❌
7062        - ❌
7063
7064
7065   .. list-table:: **test-linux1804-64-qr/opt**
7066      :widths: 30 15 15 15 15
7067      :header-rows: 1
7068
7069      * - **Test Name**
7070        - mozilla-central
7071        - autoland
7072        - mozilla-release
7073        - mozilla-beta
7074      * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr-e10s**
7075        - ❌
7076        - ❌
7077        - ❌
7078        - ❌
7079      * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr-fis-e10s**
7080        - ❌
7081        - ❌
7082        - ❌
7083        - ❌
7084
7085
7086   .. list-table:: **test-linux1804-64-shippable-qr/opt**
7087      :widths: 30 15 15 15 15
7088      :header-rows: 1
7089
7090      * - **Test Name**
7091        - mozilla-central
7092        - autoland
7093        - mozilla-release
7094        - mozilla-beta
7095      * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr-e10s**
7096        - ❌
7097        - ❌
7098        - ❌
7099        - ❌
7100      * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr-fis-e10s**
7101        - ✅
7102        - ❌
7103        - ✅
7104        - ❌
7105
7106
7107   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
7108      :widths: 30 15 15 15 15
7109      :header-rows: 1
7110
7111      * - **Test Name**
7112        - mozilla-central
7113        - autoland
7114        - mozilla-release
7115        - mozilla-beta
7116      * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr-e10s**
7117        - ❌
7118        - ❌
7119        - ❌
7120        - ❌
7121      * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr-fis-e10s**
7122        - ✅
7123        - ❌
7124        - ✅
7125        - ❌
7126
7127
7128   .. list-table:: **test-windows10-32-qr/opt**
7129      :widths: 30 15 15 15 15
7130      :header-rows: 1
7131
7132      * - **Test Name**
7133        - mozilla-central
7134        - autoland
7135        - mozilla-release
7136        - mozilla-beta
7137      * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr-e10s**
7138        - ❌
7139        - ❌
7140        - ❌
7141        - ❌
7142      * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr-fis-e10s**
7143        - ❌
7144        - ❌
7145        - ❌
7146        - ❌
7147
7148
7149   .. list-table:: **test-windows10-32-shippable-qr/opt**
7150      :widths: 30 15 15 15 15
7151      :header-rows: 1
7152
7153      * - **Test Name**
7154        - mozilla-central
7155        - autoland
7156        - mozilla-release
7157        - mozilla-beta
7158      * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr-e10s**
7159        - ❌
7160        - ❌
7161        - ❌
7162        - ❌
7163      * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr-fis-e10s**
7164        - ❌
7165        - ❌
7166        - ❌
7167        - ❌
7168
7169
7170   .. list-table:: **test-windows10-64-qr/opt**
7171      :widths: 30 15 15 15 15
7172      :header-rows: 1
7173
7174      * - **Test Name**
7175        - mozilla-central
7176        - autoland
7177        - mozilla-release
7178        - mozilla-beta
7179      * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr-e10s**
7180        - ❌
7181        - ❌
7182        - ❌
7183        - ❌
7184      * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr-fis-e10s**
7185        - ❌
7186        - ❌
7187        - ❌
7188        - ❌
7189
7190
7191   .. list-table:: **test-windows10-64-shippable-qr/opt**
7192      :widths: 30 15 15 15 15
7193      :header-rows: 1
7194
7195      * - **Test Name**
7196        - mozilla-central
7197        - autoland
7198        - mozilla-release
7199        - mozilla-beta
7200      * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr-e10s**
7201        - ❌
7202        - ❌
7203        - ❌
7204        - ❌
7205      * - **browsertime-firefox-youtube-playback-widevine-vp9-sfr-fis-e10s**
7206        - ✅
7207        - ❌
7208        - ✅
7209        - ❌
7210
7211
7212
7213
7214Custom
7215------
7216Browsertime tests that use a custom pageload test script. These use the pageload type, but may have other intentions.
7217
7218.. dropdown:: process-switch
7219   :container: + anchor-id-process-switch-c
7220
7221   **Owner**: PerfTest Team
7222
7223   * **accept zero vismet**: true
7224   * **alert on**: fcp, loadtime
7225   * **alert threshold**: 2.0
7226   * **apps**: firefox, chrome, chromium
7227   * **browser cycles**: 25
7228   * **browsertime args**: --pageCompleteWaitTime=1000 --pageCompleteCheckInactivity=true
7229   * **expected**: pass
7230   * **gecko profile entries**: 14000000
7231   * **gecko profile interval**: 1
7232   * **lower is better**: true
7233   * **measure**: fnbpaint, fcp, dcf, loadtime
7234   * **page cycles**: 25
7235   * **page timeout**: 60000
7236   * **playback**: mitmproxy
7237   * **playback pageset manifest**: mitm5-linux-firefox-proc-switch.manifest
7238   * **playback version**: 5.1.1
7239   * **test script**: process_switch.js
7240   * **test url**: `<https://mozilla.seanfeng.dev/files/red.html,https://mozilla.pettay.fi/moztests/blue.html>`__
7241   * **type**: pageload
7242   * **unit**: ms
7243   * **use live sites**: false
7244   * **Test Task**:
7245
7246   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
7247      :widths: 30 15 15 15 15
7248      :header-rows: 1
7249
7250      * - **Test Name**
7251        - mozilla-central
7252        - autoland
7253        - mozilla-release
7254        - mozilla-beta
7255      * - **browsertime-custom-firefox-process-switch-e10s**
7256        - ❌
7257        - ❌
7258        - ❌
7259        - ❌
7260      * - **browsertime-custom-firefox-process-switch-fis-e10s**
7261        - ❌
7262        - ❌
7263        - ❌
7264        - ❌
7265
7266
7267   .. list-table:: **test-linux1804-64-qr/opt**
7268      :widths: 30 15 15 15 15
7269      :header-rows: 1
7270
7271      * - **Test Name**
7272        - mozilla-central
7273        - autoland
7274        - mozilla-release
7275        - mozilla-beta
7276      * - **browsertime-custom-firefox-process-switch-e10s**
7277        - ❌
7278        - ❌
7279        - ❌
7280        - ❌
7281      * - **browsertime-custom-firefox-process-switch-fis-e10s**
7282        - ❌
7283        - ❌
7284        - ❌
7285        - ❌
7286
7287
7288   .. list-table:: **test-linux1804-64-shippable-qr/opt**
7289      :widths: 30 15 15 15 15
7290      :header-rows: 1
7291
7292      * - **Test Name**
7293        - mozilla-central
7294        - autoland
7295        - mozilla-release
7296        - mozilla-beta
7297      * - **browsertime-custom-firefox-process-switch-e10s**
7298        - ❌
7299        - ❌
7300        - ❌
7301        - ❌
7302      * - **browsertime-custom-firefox-process-switch-fis-e10s**
7303        - ✅
7304        - ❌
7305        - ❌
7306        - ❌
7307
7308
7309   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
7310      :widths: 30 15 15 15 15
7311      :header-rows: 1
7312
7313      * - **Test Name**
7314        - mozilla-central
7315        - autoland
7316        - mozilla-release
7317        - mozilla-beta
7318      * - **browsertime-custom-firefox-process-switch-e10s**
7319        - ❌
7320        - ❌
7321        - ❌
7322        - ❌
7323      * - **browsertime-custom-firefox-process-switch-fis-e10s**
7324        - ✅
7325        - ❌
7326        - ❌
7327        - ❌
7328
7329
7330   .. list-table:: **test-windows10-32-qr/opt**
7331      :widths: 30 15 15 15 15
7332      :header-rows: 1
7333
7334      * - **Test Name**
7335        - mozilla-central
7336        - autoland
7337        - mozilla-release
7338        - mozilla-beta
7339      * - **browsertime-custom-firefox-process-switch-e10s**
7340        - ❌
7341        - ❌
7342        - ❌
7343        - ❌
7344      * - **browsertime-custom-firefox-process-switch-fis-e10s**
7345        - ❌
7346        - ❌
7347        - ❌
7348        - ❌
7349
7350
7351   .. list-table:: **test-windows10-32-shippable-qr/opt**
7352      :widths: 30 15 15 15 15
7353      :header-rows: 1
7354
7355      * - **Test Name**
7356        - mozilla-central
7357        - autoland
7358        - mozilla-release
7359        - mozilla-beta
7360      * - **browsertime-custom-firefox-process-switch-e10s**
7361        - ❌
7362        - ❌
7363        - ❌
7364        - ❌
7365      * - **browsertime-custom-firefox-process-switch-fis-e10s**
7366        - ❌
7367        - ❌
7368        - ❌
7369        - ❌
7370
7371
7372   .. list-table:: **test-windows10-64-qr/opt**
7373      :widths: 30 15 15 15 15
7374      :header-rows: 1
7375
7376      * - **Test Name**
7377        - mozilla-central
7378        - autoland
7379        - mozilla-release
7380        - mozilla-beta
7381      * - **browsertime-custom-firefox-process-switch-e10s**
7382        - ❌
7383        - ❌
7384        - ❌
7385        - ❌
7386      * - **browsertime-custom-firefox-process-switch-fis-e10s**
7387        - ❌
7388        - ❌
7389        - ❌
7390        - ❌
7391
7392
7393   .. list-table:: **test-windows10-64-shippable-qr/opt**
7394      :widths: 30 15 15 15 15
7395      :header-rows: 1
7396
7397      * - **Test Name**
7398        - mozilla-central
7399        - autoland
7400        - mozilla-release
7401        - mozilla-beta
7402      * - **browsertime-custom-firefox-process-switch-e10s**
7403        - ❌
7404        - ❌
7405        - ❌
7406        - ❌
7407      * - **browsertime-custom-firefox-process-switch-fis-e10s**
7408        - ✅
7409        - ❌
7410        - ❌
7411        - ❌
7412
7413
7414
7415.. dropdown:: welcome
7416   :container: + anchor-id-welcome-c
7417
7418   **Owner**: PerfTest Team
7419
7420   * **alert on**: fcp, loadtime
7421   * **alert threshold**: 2.0
7422   * **apps**: firefox
7423   * **browser cycles**: 25
7424   * **expected**: pass
7425   * **gecko profile entries**: 14000000
7426   * **gecko profile interval**: 1
7427   * **lower is better**: true
7428   * **measure**: fnbpaint, fcp, dcf, loadtime
7429   * **page cycles**: 25
7430   * **page timeout**: 60000
7431   * **playback**: mitmproxy
7432   * **playback pageset manifest**: mitm5-linux-firefox-welcome.manifest
7433   * **playback version**: 5.1.1
7434   * **test script**: welcome.js
7435   * **test url**: `<about:welcome>`__
7436   * **type**: pageload
7437   * **unit**: ms
7438   * **use live sites**: false
7439   * **Test Task**:
7440
7441   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
7442      :widths: 30 15 15 15 15
7443      :header-rows: 1
7444
7445      * - **Test Name**
7446        - mozilla-central
7447        - autoland
7448        - mozilla-release
7449        - mozilla-beta
7450      * - **browsertime-first-install-firefox-welcome-e10s**
7451        - ❌
7452        - ❌
7453        - ❌
7454        - ❌
7455      * - **browsertime-first-install-firefox-welcome-fis-e10s**
7456        - ❌
7457        - ❌
7458        - ❌
7459        - ❌
7460
7461
7462   .. list-table:: **test-linux1804-64-qr/opt**
7463      :widths: 30 15 15 15 15
7464      :header-rows: 1
7465
7466      * - **Test Name**
7467        - mozilla-central
7468        - autoland
7469        - mozilla-release
7470        - mozilla-beta
7471      * - **browsertime-first-install-firefox-welcome-e10s**
7472        - ❌
7473        - ❌
7474        - ❌
7475        - ❌
7476      * - **browsertime-first-install-firefox-welcome-fis-e10s**
7477        - ❌
7478        - ❌
7479        - ❌
7480        - ❌
7481
7482
7483   .. list-table:: **test-linux1804-64-shippable-qr/opt**
7484      :widths: 30 15 15 15 15
7485      :header-rows: 1
7486
7487      * - **Test Name**
7488        - mozilla-central
7489        - autoland
7490        - mozilla-release
7491        - mozilla-beta
7492      * - **browsertime-first-install-firefox-welcome-e10s**
7493        - ❌
7494        - ❌
7495        - ❌
7496        - ❌
7497      * - **browsertime-first-install-firefox-welcome-fis-e10s**
7498        - ✅
7499        - ✅
7500        - ❌
7501        - ❌
7502
7503
7504   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
7505      :widths: 30 15 15 15 15
7506      :header-rows: 1
7507
7508      * - **Test Name**
7509        - mozilla-central
7510        - autoland
7511        - mozilla-release
7512        - mozilla-beta
7513      * - **browsertime-first-install-firefox-welcome-e10s**
7514        - ❌
7515        - ❌
7516        - ❌
7517        - ❌
7518      * - **browsertime-first-install-firefox-welcome-fis-e10s**
7519        - ✅
7520        - ✅
7521        - ❌
7522        - ❌
7523
7524
7525   .. list-table:: **test-windows10-32-qr/opt**
7526      :widths: 30 15 15 15 15
7527      :header-rows: 1
7528
7529      * - **Test Name**
7530        - mozilla-central
7531        - autoland
7532        - mozilla-release
7533        - mozilla-beta
7534      * - **browsertime-first-install-firefox-welcome-e10s**
7535        - ❌
7536        - ❌
7537        - ❌
7538        - ❌
7539      * - **browsertime-first-install-firefox-welcome-fis-e10s**
7540        - ❌
7541        - ❌
7542        - ❌
7543        - ❌
7544
7545
7546   .. list-table:: **test-windows10-32-shippable-qr/opt**
7547      :widths: 30 15 15 15 15
7548      :header-rows: 1
7549
7550      * - **Test Name**
7551        - mozilla-central
7552        - autoland
7553        - mozilla-release
7554        - mozilla-beta
7555      * - **browsertime-first-install-firefox-welcome-e10s**
7556        - ❌
7557        - ❌
7558        - ❌
7559        - ❌
7560      * - **browsertime-first-install-firefox-welcome-fis-e10s**
7561        - ❌
7562        - ❌
7563        - ❌
7564        - ❌
7565
7566
7567   .. list-table:: **test-windows10-64-qr/opt**
7568      :widths: 30 15 15 15 15
7569      :header-rows: 1
7570
7571      * - **Test Name**
7572        - mozilla-central
7573        - autoland
7574        - mozilla-release
7575        - mozilla-beta
7576      * - **browsertime-first-install-firefox-welcome-e10s**
7577        - ❌
7578        - ❌
7579        - ❌
7580        - ❌
7581      * - **browsertime-first-install-firefox-welcome-fis-e10s**
7582        - ❌
7583        - ❌
7584        - ❌
7585        - ❌
7586
7587
7588   .. list-table:: **test-windows10-64-shippable-qr/opt**
7589      :widths: 30 15 15 15 15
7590      :header-rows: 1
7591
7592      * - **Test Name**
7593        - mozilla-central
7594        - autoland
7595        - mozilla-release
7596        - mozilla-beta
7597      * - **browsertime-first-install-firefox-welcome-e10s**
7598        - ❌
7599        - ❌
7600        - ❌
7601        - ❌
7602      * - **browsertime-first-install-firefox-welcome-fis-e10s**
7603        - ✅
7604        - ✅
7605        - ❌
7606        - ❌
7607
7608
7609
7610
7611Desktop
7612-------
7613Tests for page-load performance. The links direct to the actual websites that are being tested.
7614
7615.. dropdown:: amazon
7616   :container: + anchor-id-amazon-d
7617
7618   **Owner**: PerfTest Team
7619
7620   * **alert on**: fcp, loadtime
7621   * **alert threshold**: 2.0
7622   * **apps**: firefox, chrome, chromium
7623   * **browser cycles**: 25
7624   * **expected**: pass
7625   * **gecko profile entries**: 14000000
7626   * **gecko profile interval**: 1
7627   * **lower is better**: true
7628   * **measure**: fnbpaint, fcp, dcf, loadtime
7629   * **page cycles**: 25
7630   * **page timeout**: 60000
7631   * **playback**: mitmproxy
7632   * **playback pageset manifest**: mitm7-linux-firefox-amazon.manifest
7633   * **playback version**: 7.0.4
7634   * **secondary url**: `<https://www.amazon.com/Acer-A515-46-R14K-Quad-Core-Processor-Backlit/dp/B08VKNVDDR/ref=sr_1_3?dchild=1&keywords=laptop&qid=1627047187&sr=8-3>`__
7635   * **test url**: `<https://www.amazon.com/s?k=laptop&ref=nb_sb_noss_1>`__
7636   * **type**: pageload
7637   * **unit**: ms
7638   * **use live sites**: false
7639   * **Test Task**:
7640
7641   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
7642      :widths: 30 15 15 15 15
7643      :header-rows: 1
7644
7645      * - **Test Name**
7646        - mozilla-central
7647        - autoland
7648        - mozilla-release
7649        - mozilla-beta
7650      * - **browsertime-tp6m-fenix-amazon-e10s**
7651        - ❌
7652        - ❌
7653        - ❌
7654        - ❌
7655      * - **browsertime-tp6m-geckoview-amazon-e10s**
7656        - ❌
7657        - ❌
7658        - ❌
7659        - ❌
7660      * - **browsertime-tp6m-live-fenix-amazon-e10s**
7661        - ❌
7662        - ❌
7663        - ❌
7664        - ❌
7665      * - **browsertime-tp6m-live-geckoview-amazon-e10s**
7666        - ❌
7667        - ❌
7668        - ❌
7669        - ❌
7670      * - **browsertime-tp6m-refbrow-amazon-e10s**
7671        - ❌
7672        - ❌
7673        - ❌
7674        - ❌
7675
7676
7677   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
7678      :widths: 30 15 15 15 15
7679      :header-rows: 1
7680
7681      * - **Test Name**
7682        - mozilla-central
7683        - autoland
7684        - mozilla-release
7685        - mozilla-beta
7686      * - **browsertime-tp6m-chrome-m-amazon-e10s**
7687        - ❌
7688        - ❌
7689        - ❌
7690        - ❌
7691      * - **browsertime-tp6m-fenix-amazon-e10s**
7692        - ❌
7693        - ❌
7694        - ❌
7695        - ❌
7696      * - **browsertime-tp6m-geckoview-amazon-e10s**
7697        - ✅
7698        - ✅
7699        - ✅
7700        - ✅
7701      * - **browsertime-tp6m-live-chrome-m-amazon-e10s**
7702        - ❌
7703        - ❌
7704        - ❌
7705        - ❌
7706      * - **browsertime-tp6m-live-fenix-amazon-e10s**
7707        - ❌
7708        - ❌
7709        - ❌
7710        - ❌
7711      * - **browsertime-tp6m-live-geckoview-amazon-e10s**
7712        - ❌
7713        - ❌
7714        - ❌
7715        - ❌
7716      * - **browsertime-tp6m-refbrow-amazon-e10s**
7717        - ❌
7718        - ❌
7719        - ❌
7720        - ❌
7721
7722
7723   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
7724      :widths: 30 15 15 15 15
7725      :header-rows: 1
7726
7727      * - **Test Name**
7728        - mozilla-central
7729        - autoland
7730        - mozilla-release
7731        - mozilla-beta
7732      * - **browsertime-tp6m-fenix-amazon-e10s**
7733        - ❌
7734        - ❌
7735        - ❌
7736        - ❌
7737      * - **browsertime-tp6m-geckoview-amazon-e10s**
7738        - ❌
7739        - ❌
7740        - ❌
7741        - ❌
7742      * - **browsertime-tp6m-live-fenix-amazon-e10s**
7743        - ❌
7744        - ❌
7745        - ❌
7746        - ❌
7747      * - **browsertime-tp6m-live-geckoview-amazon-e10s**
7748        - ❌
7749        - ❌
7750        - ❌
7751        - ❌
7752      * - **browsertime-tp6m-refbrow-amazon-e10s**
7753        - ❌
7754        - ❌
7755        - ❌
7756        - ❌
7757
7758
7759   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
7760      :widths: 30 15 15 15 15
7761      :header-rows: 1
7762
7763      * - **Test Name**
7764        - mozilla-central
7765        - autoland
7766        - mozilla-release
7767        - mozilla-beta
7768      * - **browsertime-tp6m-chrome-m-amazon-e10s**
7769        - ❌
7770        - ❌
7771        - ❌
7772        - ❌
7773      * - **browsertime-tp6m-fenix-amazon-e10s**
7774        - ❌
7775        - ❌
7776        - ❌
7777        - ❌
7778      * - **browsertime-tp6m-geckoview-amazon-e10s**
7779        - ✅
7780        - ✅
7781        - ✅
7782        - ✅
7783      * - **browsertime-tp6m-live-chrome-m-amazon-e10s**
7784        - ❌
7785        - ❌
7786        - ❌
7787        - ❌
7788      * - **browsertime-tp6m-live-fenix-amazon-e10s**
7789        - ❌
7790        - ❌
7791        - ❌
7792        - ❌
7793      * - **browsertime-tp6m-live-geckoview-amazon-e10s**
7794        - ❌
7795        - ❌
7796        - ❌
7797        - ❌
7798      * - **browsertime-tp6m-profiling-geckoview-amazon-e10s**
7799        - ✅
7800        - ❌
7801        - ❌
7802        - ❌
7803      * - **browsertime-tp6m-refbrow-amazon-e10s**
7804        - ❌
7805        - ❌
7806        - ❌
7807        - ❌
7808
7809
7810   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
7811      :widths: 30 15 15 15 15
7812      :header-rows: 1
7813
7814      * - **Test Name**
7815        - mozilla-central
7816        - autoland
7817        - mozilla-release
7818        - mozilla-beta
7819      * - **browsertime-tp6m-fenix-amazon-e10s**
7820        - ❌
7821        - ❌
7822        - ❌
7823        - ❌
7824      * - **browsertime-tp6m-geckoview-amazon-e10s**
7825        - ❌
7826        - ❌
7827        - ❌
7828        - ❌
7829      * - **browsertime-tp6m-live-fenix-amazon-e10s**
7830        - ❌
7831        - ❌
7832        - ❌
7833        - ❌
7834      * - **browsertime-tp6m-live-geckoview-amazon-e10s**
7835        - ❌
7836        - ❌
7837        - ❌
7838        - ❌
7839      * - **browsertime-tp6m-refbrow-amazon-e10s**
7840        - ❌
7841        - ❌
7842        - ❌
7843        - ❌
7844
7845
7846   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
7847      :widths: 30 15 15 15 15
7848      :header-rows: 1
7849
7850      * - **Test Name**
7851        - mozilla-central
7852        - autoland
7853        - mozilla-release
7854        - mozilla-beta
7855      * - **browsertime-tp6m-chrome-m-amazon-e10s**
7856        - ❌
7857        - ❌
7858        - ❌
7859        - ❌
7860      * - **browsertime-tp6m-fenix-amazon-e10s**
7861        - ❌
7862        - ❌
7863        - ❌
7864        - ❌
7865      * - **browsertime-tp6m-geckoview-amazon-e10s**
7866        - ❌
7867        - ❌
7868        - ❌
7869        - ❌
7870      * - **browsertime-tp6m-live-chrome-m-amazon-e10s**
7871        - ❌
7872        - ❌
7873        - ❌
7874        - ❌
7875      * - **browsertime-tp6m-live-fenix-amazon-e10s**
7876        - ❌
7877        - ❌
7878        - ❌
7879        - ❌
7880      * - **browsertime-tp6m-live-geckoview-amazon-e10s**
7881        - ❌
7882        - ❌
7883        - ❌
7884        - ❌
7885      * - **browsertime-tp6m-refbrow-amazon-e10s**
7886        - ❌
7887        - ❌
7888        - ❌
7889        - ❌
7890
7891
7892   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
7893      :widths: 30 15 15 15 15
7894      :header-rows: 1
7895
7896      * - **Test Name**
7897        - mozilla-central
7898        - autoland
7899        - mozilla-release
7900        - mozilla-beta
7901      * - **browsertime-tp6m-fenix-amazon-e10s**
7902        - ❌
7903        - ❌
7904        - ❌
7905        - ❌
7906      * - **browsertime-tp6m-geckoview-amazon-e10s**
7907        - ❌
7908        - ❌
7909        - ❌
7910        - ❌
7911      * - **browsertime-tp6m-live-fenix-amazon-e10s**
7912        - ❌
7913        - ❌
7914        - ❌
7915        - ❌
7916      * - **browsertime-tp6m-live-geckoview-amazon-e10s**
7917        - ❌
7918        - ❌
7919        - ❌
7920        - ❌
7921      * - **browsertime-tp6m-refbrow-amazon-e10s**
7922        - ❌
7923        - ❌
7924        - ❌
7925        - ❌
7926
7927
7928   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
7929      :widths: 30 15 15 15 15
7930      :header-rows: 1
7931
7932      * - **Test Name**
7933        - mozilla-central
7934        - autoland
7935        - mozilla-release
7936        - mozilla-beta
7937      * - **browsertime-tp6m-chrome-m-amazon-e10s**
7938        - ❌
7939        - ❌
7940        - ❌
7941        - ❌
7942      * - **browsertime-tp6m-fenix-amazon-e10s**
7943        - ❌
7944        - ❌
7945        - ❌
7946        - ❌
7947      * - **browsertime-tp6m-geckoview-amazon-e10s**
7948        - ❌
7949        - ❌
7950        - ❌
7951        - ❌
7952      * - **browsertime-tp6m-live-chrome-m-amazon-e10s**
7953        - ❌
7954        - ❌
7955        - ❌
7956        - ❌
7957      * - **browsertime-tp6m-live-fenix-amazon-e10s**
7958        - ❌
7959        - ❌
7960        - ❌
7961        - ❌
7962      * - **browsertime-tp6m-live-geckoview-amazon-e10s**
7963        - ❌
7964        - ❌
7965        - ❌
7966        - ❌
7967      * - **browsertime-tp6m-refbrow-amazon-e10s**
7968        - ❌
7969        - ❌
7970        - ❌
7971        - ❌
7972
7973
7974   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
7975      :widths: 30 15 15 15 15
7976      :header-rows: 1
7977
7978      * - **Test Name**
7979        - mozilla-central
7980        - autoland
7981        - mozilla-release
7982        - mozilla-beta
7983      * - **browsertime-tp6-essential-firefox-amazon-e10s**
7984        - ❌
7985        - ❌
7986        - ❌
7987        - ❌
7988      * - **browsertime-tp6-essential-firefox-amazon-fis-e10s**
7989        - ❌
7990        - ❌
7991        - ❌
7992        - ❌
7993      * - **browsertime-tp6-live-firefox-amazon-e10s**
7994        - ❌
7995        - ❌
7996        - ❌
7997        - ❌
7998      * - **browsertime-tp6-live-firefox-amazon-fis-e10s**
7999        - ❌
8000        - ❌
8001        - ❌
8002        - ❌
8003
8004
8005   .. list-table:: **test-linux1804-64-qr/opt**
8006      :widths: 30 15 15 15 15
8007      :header-rows: 1
8008
8009      * - **Test Name**
8010        - mozilla-central
8011        - autoland
8012        - mozilla-release
8013        - mozilla-beta
8014      * - **browsertime-tp6-essential-firefox-amazon-e10s**
8015        - ❌
8016        - ❌
8017        - ❌
8018        - ❌
8019      * - **browsertime-tp6-essential-firefox-amazon-fis-e10s**
8020        - ❌
8021        - ❌
8022        - ❌
8023        - ❌
8024      * - **browsertime-tp6-live-firefox-amazon-e10s**
8025        - ❌
8026        - ❌
8027        - ❌
8028        - ❌
8029      * - **browsertime-tp6-live-firefox-amazon-fis-e10s**
8030        - ❌
8031        - ❌
8032        - ❌
8033        - ❌
8034
8035
8036   .. list-table:: **test-linux1804-64-shippable-qr/opt**
8037      :widths: 30 15 15 15 15
8038      :header-rows: 1
8039
8040      * - **Test Name**
8041        - mozilla-central
8042        - autoland
8043        - mozilla-release
8044        - mozilla-beta
8045      * - **browsertime-tp6-essential-chrome-amazon-e10s**
8046        - ❌
8047        - ❌
8048        - ❌
8049        - ❌
8050      * - **browsertime-tp6-essential-chromium-amazon-e10s**
8051        - ❌
8052        - ❌
8053        - ❌
8054        - ❌
8055      * - **browsertime-tp6-essential-firefox-amazon-e10s**
8056        - ❌
8057        - ❌
8058        - ❌
8059        - ❌
8060      * - **browsertime-tp6-essential-firefox-amazon-fis-e10s**
8061        - ✅
8062        - ✅
8063        - ✅
8064        - ✅
8065      * - **browsertime-tp6-live-chrome-amazon-e10s**
8066        - ❌
8067        - ❌
8068        - ❌
8069        - ❌
8070      * - **browsertime-tp6-live-chromium-amazon-e10s**
8071        - ❌
8072        - ❌
8073        - ❌
8074        - ❌
8075      * - **browsertime-tp6-live-firefox-amazon-e10s**
8076        - ❌
8077        - ❌
8078        - ❌
8079        - ❌
8080      * - **browsertime-tp6-live-firefox-amazon-fis-e10s**
8081        - ❌
8082        - ❌
8083        - ❌
8084        - ❌
8085      * - **browsertime-tp6-profiling-firefox-amazon-e10s**
8086        - ✅
8087        - ❌
8088        - ❌
8089        - ❌
8090      * - **browsertime-tp6-profiling-firefox-amazon-fis-e10s**
8091        - ❌
8092        - ❌
8093        - ❌
8094        - ❌
8095
8096
8097   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
8098      :widths: 30 15 15 15 15
8099      :header-rows: 1
8100
8101      * - **Test Name**
8102        - mozilla-central
8103        - autoland
8104        - mozilla-release
8105        - mozilla-beta
8106      * - **browsertime-tp6-essential-chrome-amazon-e10s**
8107        - ❌
8108        - ❌
8109        - ❌
8110        - ❌
8111      * - **browsertime-tp6-essential-chromium-amazon-e10s**
8112        - ❌
8113        - ❌
8114        - ❌
8115        - ❌
8116      * - **browsertime-tp6-essential-firefox-amazon-e10s**
8117        - ❌
8118        - ❌
8119        - ❌
8120        - ❌
8121      * - **browsertime-tp6-essential-firefox-amazon-fis-e10s**
8122        - ✅
8123        - ✅
8124        - ✅
8125        - ✅
8126      * - **browsertime-tp6-live-chrome-amazon-e10s**
8127        - ❌
8128        - ❌
8129        - ❌
8130        - ❌
8131      * - **browsertime-tp6-live-chromium-amazon-e10s**
8132        - ❌
8133        - ❌
8134        - ❌
8135        - ❌
8136      * - **browsertime-tp6-live-firefox-amazon-e10s**
8137        - ❌
8138        - ❌
8139        - ❌
8140        - ❌
8141      * - **browsertime-tp6-live-firefox-amazon-fis-e10s**
8142        - ❌
8143        - ❌
8144        - ❌
8145        - ❌
8146      * - **browsertime-tp6-profiling-firefox-amazon-e10s**
8147        - ✅
8148        - ❌
8149        - ❌
8150        - ❌
8151      * - **browsertime-tp6-profiling-firefox-amazon-fis-e10s**
8152        - ❌
8153        - ❌
8154        - ❌
8155        - ❌
8156
8157
8158   .. list-table:: **test-windows10-32-qr/opt**
8159      :widths: 30 15 15 15 15
8160      :header-rows: 1
8161
8162      * - **Test Name**
8163        - mozilla-central
8164        - autoland
8165        - mozilla-release
8166        - mozilla-beta
8167      * - **browsertime-tp6-essential-firefox-amazon-e10s**
8168        - ❌
8169        - ❌
8170        - ❌
8171        - ❌
8172      * - **browsertime-tp6-essential-firefox-amazon-fis-e10s**
8173        - ❌
8174        - ❌
8175        - ❌
8176        - ❌
8177      * - **browsertime-tp6-live-firefox-amazon-e10s**
8178        - ❌
8179        - ❌
8180        - ❌
8181        - ❌
8182      * - **browsertime-tp6-live-firefox-amazon-fis-e10s**
8183        - ❌
8184        - ❌
8185        - ❌
8186        - ❌
8187
8188
8189   .. list-table:: **test-windows10-32-shippable-qr/opt**
8190      :widths: 30 15 15 15 15
8191      :header-rows: 1
8192
8193      * - **Test Name**
8194        - mozilla-central
8195        - autoland
8196        - mozilla-release
8197        - mozilla-beta
8198      * - **browsertime-tp6-essential-chrome-amazon-e10s**
8199        - ❌
8200        - ❌
8201        - ❌
8202        - ❌
8203      * - **browsertime-tp6-essential-chromium-amazon-e10s**
8204        - ❌
8205        - ❌
8206        - ❌
8207        - ❌
8208      * - **browsertime-tp6-essential-firefox-amazon-e10s**
8209        - ❌
8210        - ❌
8211        - ❌
8212        - ❌
8213      * - **browsertime-tp6-essential-firefox-amazon-fis-e10s**
8214        - ❌
8215        - ❌
8216        - ❌
8217        - ❌
8218      * - **browsertime-tp6-live-chrome-amazon-e10s**
8219        - ❌
8220        - ❌
8221        - ❌
8222        - ❌
8223      * - **browsertime-tp6-live-chromium-amazon-e10s**
8224        - ❌
8225        - ❌
8226        - ❌
8227        - ❌
8228      * - **browsertime-tp6-live-firefox-amazon-e10s**
8229        - ❌
8230        - ❌
8231        - ❌
8232        - ❌
8233      * - **browsertime-tp6-live-firefox-amazon-fis-e10s**
8234        - ❌
8235        - ❌
8236        - ❌
8237        - ❌
8238
8239
8240   .. list-table:: **test-windows10-64-qr/opt**
8241      :widths: 30 15 15 15 15
8242      :header-rows: 1
8243
8244      * - **Test Name**
8245        - mozilla-central
8246        - autoland
8247        - mozilla-release
8248        - mozilla-beta
8249      * - **browsertime-tp6-essential-firefox-amazon-e10s**
8250        - ❌
8251        - ❌
8252        - ❌
8253        - ❌
8254      * - **browsertime-tp6-essential-firefox-amazon-fis-e10s**
8255        - ❌
8256        - ❌
8257        - ❌
8258        - ❌
8259      * - **browsertime-tp6-live-firefox-amazon-e10s**
8260        - ❌
8261        - ❌
8262        - ❌
8263        - ❌
8264      * - **browsertime-tp6-live-firefox-amazon-fis-e10s**
8265        - ❌
8266        - ❌
8267        - ❌
8268        - ❌
8269
8270
8271   .. list-table:: **test-windows10-64-shippable-qr/opt**
8272      :widths: 30 15 15 15 15
8273      :header-rows: 1
8274
8275      * - **Test Name**
8276        - mozilla-central
8277        - autoland
8278        - mozilla-release
8279        - mozilla-beta
8280      * - **browsertime-tp6-essential-chrome-amazon-e10s**
8281        - ❌
8282        - ❌
8283        - ❌
8284        - ❌
8285      * - **browsertime-tp6-essential-chromium-amazon-e10s**
8286        - ❌
8287        - ❌
8288        - ❌
8289        - ❌
8290      * - **browsertime-tp6-essential-firefox-amazon-e10s**
8291        - ❌
8292        - ❌
8293        - ❌
8294        - ❌
8295      * - **browsertime-tp6-essential-firefox-amazon-fis-e10s**
8296        - ✅
8297        - ✅
8298        - ✅
8299        - ✅
8300      * - **browsertime-tp6-live-chrome-amazon-e10s**
8301        - ❌
8302        - ❌
8303        - ❌
8304        - ❌
8305      * - **browsertime-tp6-live-chromium-amazon-e10s**
8306        - ❌
8307        - ❌
8308        - ❌
8309        - ❌
8310      * - **browsertime-tp6-live-firefox-amazon-e10s**
8311        - ❌
8312        - ❌
8313        - ❌
8314        - ❌
8315      * - **browsertime-tp6-live-firefox-amazon-fis-e10s**
8316        - ❌
8317        - ❌
8318        - ❌
8319        - ❌
8320
8321
8322
8323.. dropdown:: bing-search
8324   :container: + anchor-id-bing-search-d
8325
8326   **Owner**: PerfTest Team
8327
8328   * **alert on**: fcp, loadtime
8329   * **alert threshold**: 2.0
8330   * **apps**: firefox, chrome, chromium
8331   * **browser cycles**: 25
8332   * **expected**: pass
8333   * **gecko profile entries**: 14000000
8334   * **gecko profile interval**: 1
8335   * **lower is better**: true
8336   * **measure**: fnbpaint, fcp, dcf, loadtime
8337   * **page cycles**: 25
8338   * **page timeout**: 60000
8339   * **playback**: mitmproxy
8340   * **playback pageset manifest**: mitm5-linux-firefox-bing-search.manifest
8341   * **playback version**: 5.1.1
8342   * **test url**: `<https://www.bing.com/search?q=barack+obama>`__
8343   * **type**: pageload
8344   * **unit**: ms
8345   * **use live sites**: false
8346   * **Test Task**:
8347
8348   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
8349      :widths: 30 15 15 15 15
8350      :header-rows: 1
8351
8352      * - **Test Name**
8353        - mozilla-central
8354        - autoland
8355        - mozilla-release
8356        - mozilla-beta
8357      * - **browsertime-tp6-essential-firefox-bing-search-e10s**
8358        - ❌
8359        - ❌
8360        - ❌
8361        - ❌
8362      * - **browsertime-tp6-essential-firefox-bing-search-fis-e10s**
8363        - ❌
8364        - ❌
8365        - ❌
8366        - ❌
8367      * - **browsertime-tp6-live-firefox-bing-search-e10s**
8368        - ❌
8369        - ❌
8370        - ❌
8371        - ❌
8372      * - **browsertime-tp6-live-firefox-bing-search-fis-e10s**
8373        - ❌
8374        - ❌
8375        - ❌
8376        - ❌
8377
8378
8379   .. list-table:: **test-linux1804-64-qr/opt**
8380      :widths: 30 15 15 15 15
8381      :header-rows: 1
8382
8383      * - **Test Name**
8384        - mozilla-central
8385        - autoland
8386        - mozilla-release
8387        - mozilla-beta
8388      * - **browsertime-tp6-essential-firefox-bing-search-e10s**
8389        - ❌
8390        - ❌
8391        - ❌
8392        - ❌
8393      * - **browsertime-tp6-essential-firefox-bing-search-fis-e10s**
8394        - ❌
8395        - ❌
8396        - ❌
8397        - ❌
8398      * - **browsertime-tp6-live-firefox-bing-search-e10s**
8399        - ❌
8400        - ❌
8401        - ❌
8402        - ❌
8403      * - **browsertime-tp6-live-firefox-bing-search-fis-e10s**
8404        - ❌
8405        - ❌
8406        - ❌
8407        - ❌
8408
8409
8410   .. list-table:: **test-linux1804-64-shippable-qr/opt**
8411      :widths: 30 15 15 15 15
8412      :header-rows: 1
8413
8414      * - **Test Name**
8415        - mozilla-central
8416        - autoland
8417        - mozilla-release
8418        - mozilla-beta
8419      * - **browsertime-tp6-essential-chrome-bing-search-e10s**
8420        - ❌
8421        - ❌
8422        - ❌
8423        - ❌
8424      * - **browsertime-tp6-essential-chromium-bing-search-e10s**
8425        - ❌
8426        - ❌
8427        - ❌
8428        - ❌
8429      * - **browsertime-tp6-essential-firefox-bing-search-e10s**
8430        - ❌
8431        - ❌
8432        - ❌
8433        - ❌
8434      * - **browsertime-tp6-essential-firefox-bing-search-fis-e10s**
8435        - ✅
8436        - ✅
8437        - ✅
8438        - ✅
8439      * - **browsertime-tp6-live-chrome-bing-search-e10s**
8440        - ❌
8441        - ❌
8442        - ❌
8443        - ❌
8444      * - **browsertime-tp6-live-chromium-bing-search-e10s**
8445        - ❌
8446        - ❌
8447        - ❌
8448        - ❌
8449      * - **browsertime-tp6-live-firefox-bing-search-e10s**
8450        - ❌
8451        - ❌
8452        - ❌
8453        - ❌
8454      * - **browsertime-tp6-live-firefox-bing-search-fis-e10s**
8455        - ❌
8456        - ❌
8457        - ❌
8458        - ❌
8459
8460
8461   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
8462      :widths: 30 15 15 15 15
8463      :header-rows: 1
8464
8465      * - **Test Name**
8466        - mozilla-central
8467        - autoland
8468        - mozilla-release
8469        - mozilla-beta
8470      * - **browsertime-tp6-essential-chrome-bing-search-e10s**
8471        - ❌
8472        - ❌
8473        - ❌
8474        - ❌
8475      * - **browsertime-tp6-essential-chromium-bing-search-e10s**
8476        - ❌
8477        - ❌
8478        - ❌
8479        - ❌
8480      * - **browsertime-tp6-essential-firefox-bing-search-e10s**
8481        - ❌
8482        - ❌
8483        - ❌
8484        - ❌
8485      * - **browsertime-tp6-essential-firefox-bing-search-fis-e10s**
8486        - ✅
8487        - ✅
8488        - ✅
8489        - ✅
8490      * - **browsertime-tp6-live-chrome-bing-search-e10s**
8491        - ❌
8492        - ❌
8493        - ❌
8494        - ❌
8495      * - **browsertime-tp6-live-chromium-bing-search-e10s**
8496        - ❌
8497        - ❌
8498        - ❌
8499        - ❌
8500      * - **browsertime-tp6-live-firefox-bing-search-e10s**
8501        - ❌
8502        - ❌
8503        - ❌
8504        - ❌
8505      * - **browsertime-tp6-live-firefox-bing-search-fis-e10s**
8506        - ❌
8507        - ❌
8508        - ❌
8509        - ❌
8510
8511
8512   .. list-table:: **test-windows10-32-qr/opt**
8513      :widths: 30 15 15 15 15
8514      :header-rows: 1
8515
8516      * - **Test Name**
8517        - mozilla-central
8518        - autoland
8519        - mozilla-release
8520        - mozilla-beta
8521      * - **browsertime-tp6-essential-firefox-bing-search-e10s**
8522        - ❌
8523        - ❌
8524        - ❌
8525        - ❌
8526      * - **browsertime-tp6-essential-firefox-bing-search-fis-e10s**
8527        - ❌
8528        - ❌
8529        - ❌
8530        - ❌
8531      * - **browsertime-tp6-live-firefox-bing-search-e10s**
8532        - ❌
8533        - ❌
8534        - ❌
8535        - ❌
8536      * - **browsertime-tp6-live-firefox-bing-search-fis-e10s**
8537        - ❌
8538        - ❌
8539        - ❌
8540        - ❌
8541
8542
8543   .. list-table:: **test-windows10-32-shippable-qr/opt**
8544      :widths: 30 15 15 15 15
8545      :header-rows: 1
8546
8547      * - **Test Name**
8548        - mozilla-central
8549        - autoland
8550        - mozilla-release
8551        - mozilla-beta
8552      * - **browsertime-tp6-essential-chrome-bing-search-e10s**
8553        - ❌
8554        - ❌
8555        - ❌
8556        - ❌
8557      * - **browsertime-tp6-essential-chromium-bing-search-e10s**
8558        - ❌
8559        - ❌
8560        - ❌
8561        - ❌
8562      * - **browsertime-tp6-essential-firefox-bing-search-e10s**
8563        - ❌
8564        - ❌
8565        - ❌
8566        - ❌
8567      * - **browsertime-tp6-essential-firefox-bing-search-fis-e10s**
8568        - ❌
8569        - ❌
8570        - ❌
8571        - ❌
8572      * - **browsertime-tp6-live-chrome-bing-search-e10s**
8573        - ❌
8574        - ❌
8575        - ❌
8576        - ❌
8577      * - **browsertime-tp6-live-chromium-bing-search-e10s**
8578        - ❌
8579        - ❌
8580        - ❌
8581        - ❌
8582      * - **browsertime-tp6-live-firefox-bing-search-e10s**
8583        - ❌
8584        - ❌
8585        - ❌
8586        - ❌
8587      * - **browsertime-tp6-live-firefox-bing-search-fis-e10s**
8588        - ❌
8589        - ❌
8590        - ❌
8591        - ❌
8592
8593
8594   .. list-table:: **test-windows10-64-qr/opt**
8595      :widths: 30 15 15 15 15
8596      :header-rows: 1
8597
8598      * - **Test Name**
8599        - mozilla-central
8600        - autoland
8601        - mozilla-release
8602        - mozilla-beta
8603      * - **browsertime-tp6-essential-firefox-bing-search-e10s**
8604        - ❌
8605        - ❌
8606        - ❌
8607        - ❌
8608      * - **browsertime-tp6-essential-firefox-bing-search-fis-e10s**
8609        - ❌
8610        - ❌
8611        - ❌
8612        - ❌
8613      * - **browsertime-tp6-live-firefox-bing-search-e10s**
8614        - ❌
8615        - ❌
8616        - ❌
8617        - ❌
8618      * - **browsertime-tp6-live-firefox-bing-search-fis-e10s**
8619        - ❌
8620        - ❌
8621        - ❌
8622        - ❌
8623
8624
8625   .. list-table:: **test-windows10-64-shippable-qr/opt**
8626      :widths: 30 15 15 15 15
8627      :header-rows: 1
8628
8629      * - **Test Name**
8630        - mozilla-central
8631        - autoland
8632        - mozilla-release
8633        - mozilla-beta
8634      * - **browsertime-tp6-essential-chrome-bing-search-e10s**
8635        - ❌
8636        - ❌
8637        - ❌
8638        - ❌
8639      * - **browsertime-tp6-essential-chromium-bing-search-e10s**
8640        - ❌
8641        - ❌
8642        - ❌
8643        - ❌
8644      * - **browsertime-tp6-essential-firefox-bing-search-e10s**
8645        - ❌
8646        - ❌
8647        - ❌
8648        - ❌
8649      * - **browsertime-tp6-essential-firefox-bing-search-fis-e10s**
8650        - ✅
8651        - ✅
8652        - ✅
8653        - ✅
8654      * - **browsertime-tp6-live-chrome-bing-search-e10s**
8655        - ❌
8656        - ❌
8657        - ❌
8658        - ❌
8659      * - **browsertime-tp6-live-chromium-bing-search-e10s**
8660        - ❌
8661        - ❌
8662        - ❌
8663        - ❌
8664      * - **browsertime-tp6-live-firefox-bing-search-e10s**
8665        - ❌
8666        - ❌
8667        - ❌
8668        - ❌
8669      * - **browsertime-tp6-live-firefox-bing-search-fis-e10s**
8670        - ❌
8671        - ❌
8672        - ❌
8673        - ❌
8674
8675
8676
8677.. dropdown:: buzzfeed
8678   :container: + anchor-id-buzzfeed-d
8679
8680   **Owner**: PerfTest Team
8681
8682   * **alert on**: fcp, loadtime
8683   * **alert threshold**: 2.0
8684   * **apps**: firefox, chrome, chromium
8685   * **browser cycles**: 25
8686   * **expected**: pass
8687   * **gecko profile entries**: 14000000
8688   * **gecko profile interval**: 1
8689   * **lower is better**: true
8690   * **measure**: fnbpaint, fcp, dcf, loadtime
8691   * **page cycles**: 25
8692   * **page timeout**: 60000
8693   * **playback**: mitmproxy
8694   * **playback pageset manifest**: mitm7-linux-firefox-buzzfeed.manifest
8695   * **playback version**: 7.0.4
8696   * **secondary url**: `<https://www.buzzfeed.com/quizzes>`__
8697   * **test url**: `<https://www.buzzfeed.com/>`__
8698   * **type**: pageload
8699   * **unit**: ms
8700   * **use live sites**: false
8701   * **Test Task**:
8702
8703   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
8704      :widths: 30 15 15 15 15
8705      :header-rows: 1
8706
8707      * - **Test Name**
8708        - mozilla-central
8709        - autoland
8710        - mozilla-release
8711        - mozilla-beta
8712      * - **browsertime-tp6-firefox-buzzfeed-e10s**
8713        - ❌
8714        - ❌
8715        - ❌
8716        - ❌
8717      * - **browsertime-tp6-firefox-buzzfeed-fis-e10s**
8718        - ❌
8719        - ❌
8720        - ❌
8721        - ❌
8722
8723
8724   .. list-table:: **test-linux1804-64-qr/opt**
8725      :widths: 30 15 15 15 15
8726      :header-rows: 1
8727
8728      * - **Test Name**
8729        - mozilla-central
8730        - autoland
8731        - mozilla-release
8732        - mozilla-beta
8733      * - **browsertime-tp6-firefox-buzzfeed-e10s**
8734        - ❌
8735        - ❌
8736        - ❌
8737        - ❌
8738      * - **browsertime-tp6-firefox-buzzfeed-fis-e10s**
8739        - ❌
8740        - ❌
8741        - ❌
8742        - ❌
8743
8744
8745   .. list-table:: **test-linux1804-64-shippable-qr/opt**
8746      :widths: 30 15 15 15 15
8747      :header-rows: 1
8748
8749      * - **Test Name**
8750        - mozilla-central
8751        - autoland
8752        - mozilla-release
8753        - mozilla-beta
8754      * - **browsertime-tp6-chrome-buzzfeed-e10s**
8755        - ❌
8756        - ❌
8757        - ❌
8758        - ❌
8759      * - **browsertime-tp6-chromium-buzzfeed-e10s**
8760        - ❌
8761        - ❌
8762        - ❌
8763        - ❌
8764      * - **browsertime-tp6-firefox-buzzfeed-e10s**
8765        - ❌
8766        - ❌
8767        - ❌
8768        - ❌
8769      * - **browsertime-tp6-firefox-buzzfeed-fis-e10s**
8770        - ✅
8771        - ✅
8772        - ✅
8773        - ✅
8774
8775
8776   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
8777      :widths: 30 15 15 15 15
8778      :header-rows: 1
8779
8780      * - **Test Name**
8781        - mozilla-central
8782        - autoland
8783        - mozilla-release
8784        - mozilla-beta
8785      * - **browsertime-tp6-chrome-buzzfeed-e10s**
8786        - ❌
8787        - ❌
8788        - ❌
8789        - ❌
8790      * - **browsertime-tp6-chromium-buzzfeed-e10s**
8791        - ❌
8792        - ❌
8793        - ❌
8794        - ❌
8795      * - **browsertime-tp6-firefox-buzzfeed-e10s**
8796        - ❌
8797        - ❌
8798        - ❌
8799        - ❌
8800      * - **browsertime-tp6-firefox-buzzfeed-fis-e10s**
8801        - ✅
8802        - ✅
8803        - ✅
8804        - ✅
8805
8806
8807   .. list-table:: **test-windows10-32-qr/opt**
8808      :widths: 30 15 15 15 15
8809      :header-rows: 1
8810
8811      * - **Test Name**
8812        - mozilla-central
8813        - autoland
8814        - mozilla-release
8815        - mozilla-beta
8816      * - **browsertime-tp6-firefox-buzzfeed-e10s**
8817        - ❌
8818        - ❌
8819        - ❌
8820        - ❌
8821      * - **browsertime-tp6-firefox-buzzfeed-fis-e10s**
8822        - ❌
8823        - ❌
8824        - ❌
8825        - ❌
8826
8827
8828   .. list-table:: **test-windows10-32-shippable-qr/opt**
8829      :widths: 30 15 15 15 15
8830      :header-rows: 1
8831
8832      * - **Test Name**
8833        - mozilla-central
8834        - autoland
8835        - mozilla-release
8836        - mozilla-beta
8837      * - **browsertime-tp6-chrome-buzzfeed-e10s**
8838        - ❌
8839        - ❌
8840        - ❌
8841        - ❌
8842      * - **browsertime-tp6-chromium-buzzfeed-e10s**
8843        - ❌
8844        - ❌
8845        - ❌
8846        - ❌
8847      * - **browsertime-tp6-firefox-buzzfeed-e10s**
8848        - ❌
8849        - ❌
8850        - ❌
8851        - ❌
8852      * - **browsertime-tp6-firefox-buzzfeed-fis-e10s**
8853        - ❌
8854        - ❌
8855        - ❌
8856        - ❌
8857
8858
8859   .. list-table:: **test-windows10-64-qr/opt**
8860      :widths: 30 15 15 15 15
8861      :header-rows: 1
8862
8863      * - **Test Name**
8864        - mozilla-central
8865        - autoland
8866        - mozilla-release
8867        - mozilla-beta
8868      * - **browsertime-tp6-firefox-buzzfeed-e10s**
8869        - ❌
8870        - ❌
8871        - ❌
8872        - ❌
8873      * - **browsertime-tp6-firefox-buzzfeed-fis-e10s**
8874        - ❌
8875        - ❌
8876        - ❌
8877        - ❌
8878
8879
8880   .. list-table:: **test-windows10-64-shippable-qr/opt**
8881      :widths: 30 15 15 15 15
8882      :header-rows: 1
8883
8884      * - **Test Name**
8885        - mozilla-central
8886        - autoland
8887        - mozilla-release
8888        - mozilla-beta
8889      * - **browsertime-tp6-chrome-buzzfeed-e10s**
8890        - ❌
8891        - ❌
8892        - ❌
8893        - ❌
8894      * - **browsertime-tp6-chromium-buzzfeed-e10s**
8895        - ❌
8896        - ❌
8897        - ❌
8898        - ❌
8899      * - **browsertime-tp6-firefox-buzzfeed-e10s**
8900        - ❌
8901        - ❌
8902        - ❌
8903        - ❌
8904      * - **browsertime-tp6-firefox-buzzfeed-fis-e10s**
8905        - ✅
8906        - ✅
8907        - ✅
8908        - ✅
8909
8910
8911
8912.. dropdown:: cnn
8913   :container: + anchor-id-cnn-d
8914
8915   **Owner**: PerfTest Team
8916
8917   * **alert on**: fcp, loadtime
8918   * **alert threshold**: 2.0
8919   * **apps**: firefox, chrome, chromium
8920   * **browser cycles**: 25
8921   * **expected**: pass
8922   * **gecko profile entries**: 14000000
8923   * **gecko profile interval**: 1
8924   * **lower is better**: true
8925   * **measure**: fnbpaint, fcp, dcf, loadtime
8926   * **page cycles**: 25
8927   * **page timeout**: 60000
8928   * **playback**: mitmproxy
8929   * **playback pageset manifest**: mitm7-linux-firefox-cnn.manifest
8930   * **playback version**: 7.0.4
8931   * **secondary url**: `<https://www.cnn.com/weather>`__
8932   * **test url**: `<https://www.cnn.com/2021/03/22/weather/climate-change-warm-waters-lake-michigan/index.html>`__
8933   * **type**: pageload
8934   * **unit**: ms
8935   * **use live sites**: false
8936   * **Test Task**:
8937
8938   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
8939      :widths: 30 15 15 15 15
8940      :header-rows: 1
8941
8942      * - **Test Name**
8943        - mozilla-central
8944        - autoland
8945        - mozilla-release
8946        - mozilla-beta
8947      * - **browsertime-tp6m-fenix-cnn-e10s**
8948        - ❌
8949        - ❌
8950        - ❌
8951        - ❌
8952      * - **browsertime-tp6m-geckoview-cnn-e10s**
8953        - ❌
8954        - ❌
8955        - ❌
8956        - ❌
8957      * - **browsertime-tp6m-live-fenix-cnn-e10s**
8958        - ❌
8959        - ❌
8960        - ❌
8961        - ❌
8962      * - **browsertime-tp6m-live-geckoview-cnn-e10s**
8963        - ❌
8964        - ❌
8965        - ❌
8966        - ❌
8967      * - **browsertime-tp6m-refbrow-cnn-e10s**
8968        - ❌
8969        - ❌
8970        - ❌
8971        - ❌
8972
8973
8974   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
8975      :widths: 30 15 15 15 15
8976      :header-rows: 1
8977
8978      * - **Test Name**
8979        - mozilla-central
8980        - autoland
8981        - mozilla-release
8982        - mozilla-beta
8983      * - **browsertime-tp6m-chrome-m-cnn-e10s**
8984        - ❌
8985        - ❌
8986        - ❌
8987        - ❌
8988      * - **browsertime-tp6m-fenix-cnn-e10s**
8989        - ❌
8990        - ❌
8991        - ❌
8992        - ❌
8993      * - **browsertime-tp6m-geckoview-cnn-e10s**
8994        - ✅
8995        - ✅
8996        - ✅
8997        - ✅
8998      * - **browsertime-tp6m-live-chrome-m-cnn-e10s**
8999        - ❌
9000        - ❌
9001        - ❌
9002        - ❌
9003      * - **browsertime-tp6m-live-fenix-cnn-e10s**
9004        - ❌
9005        - ❌
9006        - ❌
9007        - ❌
9008      * - **browsertime-tp6m-live-geckoview-cnn-e10s**
9009        - ❌
9010        - ❌
9011        - ❌
9012        - ❌
9013      * - **browsertime-tp6m-refbrow-cnn-e10s**
9014        - ❌
9015        - ❌
9016        - ❌
9017        - ❌
9018
9019
9020   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
9021      :widths: 30 15 15 15 15
9022      :header-rows: 1
9023
9024      * - **Test Name**
9025        - mozilla-central
9026        - autoland
9027        - mozilla-release
9028        - mozilla-beta
9029      * - **browsertime-tp6m-fenix-cnn-e10s**
9030        - ❌
9031        - ❌
9032        - ❌
9033        - ❌
9034      * - **browsertime-tp6m-geckoview-cnn-e10s**
9035        - ❌
9036        - ❌
9037        - ❌
9038        - ❌
9039      * - **browsertime-tp6m-live-fenix-cnn-e10s**
9040        - ❌
9041        - ❌
9042        - ❌
9043        - ❌
9044      * - **browsertime-tp6m-live-geckoview-cnn-e10s**
9045        - ❌
9046        - ❌
9047        - ❌
9048        - ❌
9049      * - **browsertime-tp6m-refbrow-cnn-e10s**
9050        - ❌
9051        - ❌
9052        - ❌
9053        - ❌
9054
9055
9056   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
9057      :widths: 30 15 15 15 15
9058      :header-rows: 1
9059
9060      * - **Test Name**
9061        - mozilla-central
9062        - autoland
9063        - mozilla-release
9064        - mozilla-beta
9065      * - **browsertime-tp6m-chrome-m-cnn-e10s**
9066        - ❌
9067        - ❌
9068        - ❌
9069        - ❌
9070      * - **browsertime-tp6m-fenix-cnn-e10s**
9071        - ❌
9072        - ❌
9073        - ❌
9074        - ❌
9075      * - **browsertime-tp6m-geckoview-cnn-e10s**
9076        - ✅
9077        - ✅
9078        - ✅
9079        - ✅
9080      * - **browsertime-tp6m-live-chrome-m-cnn-e10s**
9081        - ❌
9082        - ❌
9083        - ❌
9084        - ❌
9085      * - **browsertime-tp6m-live-fenix-cnn-e10s**
9086        - ❌
9087        - ❌
9088        - ❌
9089        - ❌
9090      * - **browsertime-tp6m-live-geckoview-cnn-e10s**
9091        - ❌
9092        - ❌
9093        - ❌
9094        - ❌
9095      * - **browsertime-tp6m-refbrow-cnn-e10s**
9096        - ❌
9097        - ❌
9098        - ❌
9099        - ❌
9100
9101
9102   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
9103      :widths: 30 15 15 15 15
9104      :header-rows: 1
9105
9106      * - **Test Name**
9107        - mozilla-central
9108        - autoland
9109        - mozilla-release
9110        - mozilla-beta
9111      * - **browsertime-tp6m-fenix-cnn-e10s**
9112        - ❌
9113        - ❌
9114        - ❌
9115        - ❌
9116      * - **browsertime-tp6m-geckoview-cnn-e10s**
9117        - ❌
9118        - ❌
9119        - ❌
9120        - ❌
9121      * - **browsertime-tp6m-live-fenix-cnn-e10s**
9122        - ❌
9123        - ❌
9124        - ❌
9125        - ❌
9126      * - **browsertime-tp6m-live-geckoview-cnn-e10s**
9127        - ❌
9128        - ❌
9129        - ❌
9130        - ❌
9131      * - **browsertime-tp6m-refbrow-cnn-e10s**
9132        - ❌
9133        - ❌
9134        - ❌
9135        - ❌
9136
9137
9138   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
9139      :widths: 30 15 15 15 15
9140      :header-rows: 1
9141
9142      * - **Test Name**
9143        - mozilla-central
9144        - autoland
9145        - mozilla-release
9146        - mozilla-beta
9147      * - **browsertime-tp6m-chrome-m-cnn-e10s**
9148        - ❌
9149        - ❌
9150        - ❌
9151        - ❌
9152      * - **browsertime-tp6m-fenix-cnn-e10s**
9153        - ❌
9154        - ❌
9155        - ❌
9156        - ❌
9157      * - **browsertime-tp6m-geckoview-cnn-e10s**
9158        - ❌
9159        - ❌
9160        - ❌
9161        - ❌
9162      * - **browsertime-tp6m-live-chrome-m-cnn-e10s**
9163        - ❌
9164        - ❌
9165        - ❌
9166        - ❌
9167      * - **browsertime-tp6m-live-fenix-cnn-e10s**
9168        - ❌
9169        - ❌
9170        - ❌
9171        - ❌
9172      * - **browsertime-tp6m-live-geckoview-cnn-e10s**
9173        - ❌
9174        - ❌
9175        - ❌
9176        - ❌
9177      * - **browsertime-tp6m-refbrow-cnn-e10s**
9178        - ❌
9179        - ❌
9180        - ❌
9181        - ❌
9182
9183
9184   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
9185      :widths: 30 15 15 15 15
9186      :header-rows: 1
9187
9188      * - **Test Name**
9189        - mozilla-central
9190        - autoland
9191        - mozilla-release
9192        - mozilla-beta
9193      * - **browsertime-tp6m-fenix-cnn-e10s**
9194        - ❌
9195        - ❌
9196        - ❌
9197        - ❌
9198      * - **browsertime-tp6m-geckoview-cnn-e10s**
9199        - ❌
9200        - ❌
9201        - ❌
9202        - ❌
9203      * - **browsertime-tp6m-live-fenix-cnn-e10s**
9204        - ❌
9205        - ❌
9206        - ❌
9207        - ❌
9208      * - **browsertime-tp6m-live-geckoview-cnn-e10s**
9209        - ❌
9210        - ❌
9211        - ❌
9212        - ❌
9213      * - **browsertime-tp6m-refbrow-cnn-e10s**
9214        - ❌
9215        - ❌
9216        - ❌
9217        - ❌
9218
9219
9220   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
9221      :widths: 30 15 15 15 15
9222      :header-rows: 1
9223
9224      * - **Test Name**
9225        - mozilla-central
9226        - autoland
9227        - mozilla-release
9228        - mozilla-beta
9229      * - **browsertime-tp6m-chrome-m-cnn-e10s**
9230        - ❌
9231        - ❌
9232        - ❌
9233        - ❌
9234      * - **browsertime-tp6m-fenix-cnn-e10s**
9235        - ❌
9236        - ❌
9237        - ❌
9238        - ❌
9239      * - **browsertime-tp6m-geckoview-cnn-e10s**
9240        - ❌
9241        - ❌
9242        - ❌
9243        - ❌
9244      * - **browsertime-tp6m-live-chrome-m-cnn-e10s**
9245        - ❌
9246        - ❌
9247        - ❌
9248        - ❌
9249      * - **browsertime-tp6m-live-fenix-cnn-e10s**
9250        - ❌
9251        - ❌
9252        - ❌
9253        - ❌
9254      * - **browsertime-tp6m-live-geckoview-cnn-e10s**
9255        - ❌
9256        - ❌
9257        - ❌
9258        - ❌
9259      * - **browsertime-tp6m-refbrow-cnn-e10s**
9260        - ❌
9261        - ❌
9262        - ❌
9263        - ❌
9264
9265
9266   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
9267      :widths: 30 15 15 15 15
9268      :header-rows: 1
9269
9270      * - **Test Name**
9271        - mozilla-central
9272        - autoland
9273        - mozilla-release
9274        - mozilla-beta
9275      * - **browsertime-tp6-essential-firefox-cnn-e10s**
9276        - ❌
9277        - ❌
9278        - ❌
9279        - ❌
9280      * - **browsertime-tp6-essential-firefox-cnn-fis-e10s**
9281        - ❌
9282        - ❌
9283        - ❌
9284        - ❌
9285      * - **browsertime-tp6-live-sheriffed-firefox-cnn-e10s**
9286        - ❌
9287        - ❌
9288        - ❌
9289        - ❌
9290      * - **browsertime-tp6-live-sheriffed-firefox-cnn-fis-e10s**
9291        - ❌
9292        - ❌
9293        - ❌
9294        - ❌
9295
9296
9297   .. list-table:: **test-linux1804-64-qr/opt**
9298      :widths: 30 15 15 15 15
9299      :header-rows: 1
9300
9301      * - **Test Name**
9302        - mozilla-central
9303        - autoland
9304        - mozilla-release
9305        - mozilla-beta
9306      * - **browsertime-tp6-essential-firefox-cnn-e10s**
9307        - ❌
9308        - ❌
9309        - ❌
9310        - ❌
9311      * - **browsertime-tp6-essential-firefox-cnn-fis-e10s**
9312        - ❌
9313        - ❌
9314        - ❌
9315        - ❌
9316      * - **browsertime-tp6-live-sheriffed-firefox-cnn-e10s**
9317        - ❌
9318        - ❌
9319        - ❌
9320        - ❌
9321      * - **browsertime-tp6-live-sheriffed-firefox-cnn-fis-e10s**
9322        - ❌
9323        - ❌
9324        - ❌
9325        - ❌
9326
9327
9328   .. list-table:: **test-linux1804-64-shippable-qr/opt**
9329      :widths: 30 15 15 15 15
9330      :header-rows: 1
9331
9332      * - **Test Name**
9333        - mozilla-central
9334        - autoland
9335        - mozilla-release
9336        - mozilla-beta
9337      * - **browsertime-tp6-essential-chrome-cnn-e10s**
9338        - ❌
9339        - ❌
9340        - ❌
9341        - ❌
9342      * - **browsertime-tp6-essential-chromium-cnn-e10s**
9343        - ❌
9344        - ❌
9345        - ❌
9346        - ❌
9347      * - **browsertime-tp6-essential-firefox-cnn-e10s**
9348        - ❌
9349        - ❌
9350        - ❌
9351        - ❌
9352      * - **browsertime-tp6-essential-firefox-cnn-fis-e10s**
9353        - ✅
9354        - ✅
9355        - ✅
9356        - ✅
9357      * - **browsertime-tp6-live-sheriffed-firefox-cnn-e10s**
9358        - ❌
9359        - ❌
9360        - ❌
9361        - ❌
9362      * - **browsertime-tp6-live-sheriffed-firefox-cnn-fis-e10s**
9363        - ❌
9364        - ❌
9365        - ❌
9366        - ❌
9367
9368
9369   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
9370      :widths: 30 15 15 15 15
9371      :header-rows: 1
9372
9373      * - **Test Name**
9374        - mozilla-central
9375        - autoland
9376        - mozilla-release
9377        - mozilla-beta
9378      * - **browsertime-tp6-essential-chrome-cnn-e10s**
9379        - ❌
9380        - ❌
9381        - ❌
9382        - ❌
9383      * - **browsertime-tp6-essential-chromium-cnn-e10s**
9384        - ❌
9385        - ❌
9386        - ❌
9387        - ❌
9388      * - **browsertime-tp6-essential-firefox-cnn-e10s**
9389        - ❌
9390        - ❌
9391        - ❌
9392        - ❌
9393      * - **browsertime-tp6-essential-firefox-cnn-fis-e10s**
9394        - ✅
9395        - ✅
9396        - ✅
9397        - ✅
9398      * - **browsertime-tp6-live-sheriffed-firefox-cnn-e10s**
9399        - ❌
9400        - ❌
9401        - ❌
9402        - ❌
9403      * - **browsertime-tp6-live-sheriffed-firefox-cnn-fis-e10s**
9404        - ❌
9405        - ❌
9406        - ❌
9407        - ❌
9408
9409
9410   .. list-table:: **test-windows10-32-qr/opt**
9411      :widths: 30 15 15 15 15
9412      :header-rows: 1
9413
9414      * - **Test Name**
9415        - mozilla-central
9416        - autoland
9417        - mozilla-release
9418        - mozilla-beta
9419      * - **browsertime-tp6-essential-firefox-cnn-e10s**
9420        - ❌
9421        - ❌
9422        - ❌
9423        - ❌
9424      * - **browsertime-tp6-essential-firefox-cnn-fis-e10s**
9425        - ❌
9426        - ❌
9427        - ❌
9428        - ❌
9429      * - **browsertime-tp6-live-sheriffed-firefox-cnn-e10s**
9430        - ❌
9431        - ❌
9432        - ❌
9433        - ❌
9434      * - **browsertime-tp6-live-sheriffed-firefox-cnn-fis-e10s**
9435        - ❌
9436        - ❌
9437        - ❌
9438        - ❌
9439
9440
9441   .. list-table:: **test-windows10-32-shippable-qr/opt**
9442      :widths: 30 15 15 15 15
9443      :header-rows: 1
9444
9445      * - **Test Name**
9446        - mozilla-central
9447        - autoland
9448        - mozilla-release
9449        - mozilla-beta
9450      * - **browsertime-tp6-essential-chrome-cnn-e10s**
9451        - ❌
9452        - ❌
9453        - ❌
9454        - ❌
9455      * - **browsertime-tp6-essential-chromium-cnn-e10s**
9456        - ❌
9457        - ❌
9458        - ❌
9459        - ❌
9460      * - **browsertime-tp6-essential-firefox-cnn-e10s**
9461        - ❌
9462        - ❌
9463        - ❌
9464        - ❌
9465      * - **browsertime-tp6-essential-firefox-cnn-fis-e10s**
9466        - ❌
9467        - ❌
9468        - ❌
9469        - ❌
9470      * - **browsertime-tp6-live-sheriffed-firefox-cnn-e10s**
9471        - ❌
9472        - ❌
9473        - ❌
9474        - ❌
9475      * - **browsertime-tp6-live-sheriffed-firefox-cnn-fis-e10s**
9476        - ❌
9477        - ❌
9478        - ❌
9479        - ❌
9480
9481
9482   .. list-table:: **test-windows10-64-qr/opt**
9483      :widths: 30 15 15 15 15
9484      :header-rows: 1
9485
9486      * - **Test Name**
9487        - mozilla-central
9488        - autoland
9489        - mozilla-release
9490        - mozilla-beta
9491      * - **browsertime-tp6-essential-firefox-cnn-e10s**
9492        - ❌
9493        - ❌
9494        - ❌
9495        - ❌
9496      * - **browsertime-tp6-essential-firefox-cnn-fis-e10s**
9497        - ❌
9498        - ❌
9499        - ❌
9500        - ❌
9501      * - **browsertime-tp6-live-sheriffed-firefox-cnn-e10s**
9502        - ❌
9503        - ❌
9504        - ❌
9505        - ❌
9506      * - **browsertime-tp6-live-sheriffed-firefox-cnn-fis-e10s**
9507        - ❌
9508        - ❌
9509        - ❌
9510        - ❌
9511
9512
9513   .. list-table:: **test-windows10-64-shippable-qr/opt**
9514      :widths: 30 15 15 15 15
9515      :header-rows: 1
9516
9517      * - **Test Name**
9518        - mozilla-central
9519        - autoland
9520        - mozilla-release
9521        - mozilla-beta
9522      * - **browsertime-tp6-essential-chrome-cnn-e10s**
9523        - ❌
9524        - ❌
9525        - ❌
9526        - ❌
9527      * - **browsertime-tp6-essential-chromium-cnn-e10s**
9528        - ❌
9529        - ❌
9530        - ❌
9531        - ❌
9532      * - **browsertime-tp6-essential-firefox-cnn-e10s**
9533        - ❌
9534        - ❌
9535        - ❌
9536        - ❌
9537      * - **browsertime-tp6-essential-firefox-cnn-fis-e10s**
9538        - ✅
9539        - ✅
9540        - ✅
9541        - ✅
9542      * - **browsertime-tp6-live-sheriffed-firefox-cnn-e10s**
9543        - ❌
9544        - ❌
9545        - ❌
9546        - ❌
9547      * - **browsertime-tp6-live-sheriffed-firefox-cnn-fis-e10s**
9548        - ❌
9549        - ❌
9550        - ❌
9551        - ❌
9552
9553
9554
9555.. dropdown:: ebay
9556   :container: + anchor-id-ebay-d
9557
9558   **Owner**: PerfTest Team
9559
9560   * **alert on**: fcp, loadtime
9561   * **alert threshold**: 2.0
9562   * **apps**: firefox, chrome, chromium
9563   * **browser cycles**: 25
9564   * **expected**: pass
9565   * **gecko profile entries**: 14000000
9566   * **gecko profile interval**: 1
9567   * **lower is better**: true
9568   * **measure**: fnbpaint, fcp, dcf, loadtime
9569   * **page cycles**: 25
9570   * **page timeout**: 60000
9571   * **playback**: mitmproxy
9572   * **playback pageset manifest**: mitm7-linux-firefox-ebay.manifest
9573   * **playback version**: 7.0.4
9574   * **secondary url**: `<https://www.ebay.com/deals>`__
9575   * **test url**: `<https://www.ebay.com/>`__
9576   * **type**: pageload
9577   * **unit**: ms
9578   * **use live sites**: false
9579   * **Test Task**:
9580
9581   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
9582      :widths: 30 15 15 15 15
9583      :header-rows: 1
9584
9585      * - **Test Name**
9586        - mozilla-central
9587        - autoland
9588        - mozilla-release
9589        - mozilla-beta
9590      * - **browsertime-tp6-firefox-ebay-e10s**
9591        - ❌
9592        - ❌
9593        - ❌
9594        - ❌
9595      * - **browsertime-tp6-firefox-ebay-fis-e10s**
9596        - ❌
9597        - ❌
9598        - ❌
9599        - ❌
9600      * - **browsertime-tp6-live-firefox-ebay-e10s**
9601        - ❌
9602        - ❌
9603        - ❌
9604        - ❌
9605      * - **browsertime-tp6-live-firefox-ebay-fis-e10s**
9606        - ❌
9607        - ❌
9608        - ❌
9609        - ❌
9610
9611
9612   .. list-table:: **test-linux1804-64-qr/opt**
9613      :widths: 30 15 15 15 15
9614      :header-rows: 1
9615
9616      * - **Test Name**
9617        - mozilla-central
9618        - autoland
9619        - mozilla-release
9620        - mozilla-beta
9621      * - **browsertime-tp6-firefox-ebay-e10s**
9622        - ❌
9623        - ❌
9624        - ❌
9625        - ❌
9626      * - **browsertime-tp6-firefox-ebay-fis-e10s**
9627        - ❌
9628        - ❌
9629        - ❌
9630        - ❌
9631      * - **browsertime-tp6-live-firefox-ebay-e10s**
9632        - ❌
9633        - ❌
9634        - ❌
9635        - ❌
9636      * - **browsertime-tp6-live-firefox-ebay-fis-e10s**
9637        - ❌
9638        - ❌
9639        - ❌
9640        - ❌
9641
9642
9643   .. list-table:: **test-linux1804-64-shippable-qr/opt**
9644      :widths: 30 15 15 15 15
9645      :header-rows: 1
9646
9647      * - **Test Name**
9648        - mozilla-central
9649        - autoland
9650        - mozilla-release
9651        - mozilla-beta
9652      * - **browsertime-tp6-chrome-ebay-e10s**
9653        - ❌
9654        - ❌
9655        - ❌
9656        - ❌
9657      * - **browsertime-tp6-chromium-ebay-e10s**
9658        - ❌
9659        - ❌
9660        - ❌
9661        - ❌
9662      * - **browsertime-tp6-firefox-ebay-e10s**
9663        - ❌
9664        - ❌
9665        - ❌
9666        - ❌
9667      * - **browsertime-tp6-firefox-ebay-fis-e10s**
9668        - ✅
9669        - ✅
9670        - ✅
9671        - ✅
9672      * - **browsertime-tp6-live-chrome-ebay-e10s**
9673        - ❌
9674        - ❌
9675        - ❌
9676        - ❌
9677      * - **browsertime-tp6-live-chromium-ebay-e10s**
9678        - ❌
9679        - ❌
9680        - ❌
9681        - ❌
9682      * - **browsertime-tp6-live-firefox-ebay-e10s**
9683        - ❌
9684        - ❌
9685        - ❌
9686        - ❌
9687      * - **browsertime-tp6-live-firefox-ebay-fis-e10s**
9688        - ❌
9689        - ❌
9690        - ❌
9691        - ❌
9692
9693
9694   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
9695      :widths: 30 15 15 15 15
9696      :header-rows: 1
9697
9698      * - **Test Name**
9699        - mozilla-central
9700        - autoland
9701        - mozilla-release
9702        - mozilla-beta
9703      * - **browsertime-tp6-chrome-ebay-e10s**
9704        - ❌
9705        - ❌
9706        - ❌
9707        - ❌
9708      * - **browsertime-tp6-chromium-ebay-e10s**
9709        - ❌
9710        - ❌
9711        - ❌
9712        - ❌
9713      * - **browsertime-tp6-firefox-ebay-e10s**
9714        - ❌
9715        - ❌
9716        - ❌
9717        - ❌
9718      * - **browsertime-tp6-firefox-ebay-fis-e10s**
9719        - ✅
9720        - ✅
9721        - ✅
9722        - ✅
9723      * - **browsertime-tp6-live-chrome-ebay-e10s**
9724        - ❌
9725        - ❌
9726        - ❌
9727        - ❌
9728      * - **browsertime-tp6-live-chromium-ebay-e10s**
9729        - ❌
9730        - ❌
9731        - ❌
9732        - ❌
9733      * - **browsertime-tp6-live-firefox-ebay-e10s**
9734        - ❌
9735        - ❌
9736        - ❌
9737        - ❌
9738      * - **browsertime-tp6-live-firefox-ebay-fis-e10s**
9739        - ❌
9740        - ❌
9741        - ❌
9742        - ❌
9743
9744
9745   .. list-table:: **test-windows10-32-qr/opt**
9746      :widths: 30 15 15 15 15
9747      :header-rows: 1
9748
9749      * - **Test Name**
9750        - mozilla-central
9751        - autoland
9752        - mozilla-release
9753        - mozilla-beta
9754      * - **browsertime-tp6-firefox-ebay-e10s**
9755        - ❌
9756        - ❌
9757        - ❌
9758        - ❌
9759      * - **browsertime-tp6-firefox-ebay-fis-e10s**
9760        - ❌
9761        - ❌
9762        - ❌
9763        - ❌
9764      * - **browsertime-tp6-live-firefox-ebay-e10s**
9765        - ❌
9766        - ❌
9767        - ❌
9768        - ❌
9769      * - **browsertime-tp6-live-firefox-ebay-fis-e10s**
9770        - ❌
9771        - ❌
9772        - ❌
9773        - ❌
9774
9775
9776   .. list-table:: **test-windows10-32-shippable-qr/opt**
9777      :widths: 30 15 15 15 15
9778      :header-rows: 1
9779
9780      * - **Test Name**
9781        - mozilla-central
9782        - autoland
9783        - mozilla-release
9784        - mozilla-beta
9785      * - **browsertime-tp6-chrome-ebay-e10s**
9786        - ❌
9787        - ❌
9788        - ❌
9789        - ❌
9790      * - **browsertime-tp6-chromium-ebay-e10s**
9791        - ❌
9792        - ❌
9793        - ❌
9794        - ❌
9795      * - **browsertime-tp6-firefox-ebay-e10s**
9796        - ❌
9797        - ❌
9798        - ❌
9799        - ❌
9800      * - **browsertime-tp6-firefox-ebay-fis-e10s**
9801        - ❌
9802        - ❌
9803        - ❌
9804        - ❌
9805      * - **browsertime-tp6-live-chrome-ebay-e10s**
9806        - ❌
9807        - ❌
9808        - ❌
9809        - ❌
9810      * - **browsertime-tp6-live-chromium-ebay-e10s**
9811        - ❌
9812        - ❌
9813        - ❌
9814        - ❌
9815      * - **browsertime-tp6-live-firefox-ebay-e10s**
9816        - ❌
9817        - ❌
9818        - ❌
9819        - ❌
9820      * - **browsertime-tp6-live-firefox-ebay-fis-e10s**
9821        - ❌
9822        - ❌
9823        - ❌
9824        - ❌
9825
9826
9827   .. list-table:: **test-windows10-64-qr/opt**
9828      :widths: 30 15 15 15 15
9829      :header-rows: 1
9830
9831      * - **Test Name**
9832        - mozilla-central
9833        - autoland
9834        - mozilla-release
9835        - mozilla-beta
9836      * - **browsertime-tp6-firefox-ebay-e10s**
9837        - ❌
9838        - ❌
9839        - ❌
9840        - ❌
9841      * - **browsertime-tp6-firefox-ebay-fis-e10s**
9842        - ❌
9843        - ❌
9844        - ❌
9845        - ❌
9846      * - **browsertime-tp6-live-firefox-ebay-e10s**
9847        - ❌
9848        - ❌
9849        - ❌
9850        - ❌
9851      * - **browsertime-tp6-live-firefox-ebay-fis-e10s**
9852        - ❌
9853        - ❌
9854        - ❌
9855        - ❌
9856
9857
9858   .. list-table:: **test-windows10-64-shippable-qr/opt**
9859      :widths: 30 15 15 15 15
9860      :header-rows: 1
9861
9862      * - **Test Name**
9863        - mozilla-central
9864        - autoland
9865        - mozilla-release
9866        - mozilla-beta
9867      * - **browsertime-tp6-chrome-ebay-e10s**
9868        - ❌
9869        - ❌
9870        - ❌
9871        - ❌
9872      * - **browsertime-tp6-chromium-ebay-e10s**
9873        - ❌
9874        - ❌
9875        - ❌
9876        - ❌
9877      * - **browsertime-tp6-firefox-ebay-e10s**
9878        - ❌
9879        - ❌
9880        - ❌
9881        - ❌
9882      * - **browsertime-tp6-firefox-ebay-fis-e10s**
9883        - ✅
9884        - ✅
9885        - ✅
9886        - ✅
9887      * - **browsertime-tp6-live-chrome-ebay-e10s**
9888        - ❌
9889        - ❌
9890        - ❌
9891        - ❌
9892      * - **browsertime-tp6-live-chromium-ebay-e10s**
9893        - ❌
9894        - ❌
9895        - ❌
9896        - ❌
9897      * - **browsertime-tp6-live-firefox-ebay-e10s**
9898        - ❌
9899        - ❌
9900        - ❌
9901        - ❌
9902      * - **browsertime-tp6-live-firefox-ebay-fis-e10s**
9903        - ❌
9904        - ❌
9905        - ❌
9906        - ❌
9907
9908
9909
9910.. dropdown:: espn
9911   :container: + anchor-id-espn-d
9912
9913   **Owner**: PerfTest Team
9914
9915   * **alert on**: fcp, loadtime
9916   * **alert threshold**: 2.0
9917   * **apps**: firefox, chrome, chromium
9918   * **browser cycles**: 25
9919   * **expected**: pass
9920   * **gecko profile entries**: 14000000
9921   * **gecko profile interval**: 1
9922   * **lower is better**: true
9923   * **measure**: fnbpaint, fcp, dcf, loadtime
9924   * **page cycles**: 25
9925   * **page timeout**: 60000
9926   * **playback**: mitmproxy
9927   * **playback pageset manifest**: mitm7-linux-firefox-espn.manifest
9928   * **playback version**: 7.0.4
9929   * **secondary url**: `<https://www.espn.com/nba/draft/news>`__
9930   * **test url**: `<http://www.espn.com/nba/story/_/page/allstarweekend25788027/the-comparison-lebron-james-michael-jordan-their-own-words>`__
9931   * **type**: pageload
9932   * **unit**: ms
9933   * **use live sites**: false
9934   * **Test Task**:
9935
9936   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
9937      :widths: 30 15 15 15 15
9938      :header-rows: 1
9939
9940      * - **Test Name**
9941        - mozilla-central
9942        - autoland
9943        - mozilla-release
9944        - mozilla-beta
9945      * - **browsertime-tp6m-essential-fenix-espn-e10s**
9946        - ❌
9947        - ❌
9948        - ❌
9949        - ❌
9950      * - **browsertime-tp6m-essential-geckoview-espn-e10s**
9951        - ❌
9952        - ❌
9953        - ❌
9954        - ❌
9955      * - **browsertime-tp6m-essential-refbrow-espn-e10s**
9956        - ❌
9957        - ❌
9958        - ❌
9959        - ❌
9960      * - **browsertime-tp6m-live-fenix-espn-e10s**
9961        - ❌
9962        - ❌
9963        - ❌
9964        - ❌
9965      * - **browsertime-tp6m-live-geckoview-espn-e10s**
9966        - ❌
9967        - ❌
9968        - ❌
9969        - ❌
9970
9971
9972   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
9973      :widths: 30 15 15 15 15
9974      :header-rows: 1
9975
9976      * - **Test Name**
9977        - mozilla-central
9978        - autoland
9979        - mozilla-release
9980        - mozilla-beta
9981      * - **browsertime-tp6m-essential-chrome-m-espn-e10s**
9982        - ❌
9983        - ❌
9984        - ❌
9985        - ❌
9986      * - **browsertime-tp6m-essential-fenix-espn-e10s**
9987        - ❌
9988        - ❌
9989        - ❌
9990        - ❌
9991      * - **browsertime-tp6m-essential-geckoview-espn-e10s**
9992        - ✅
9993        - ✅
9994        - ✅
9995        - ✅
9996      * - **browsertime-tp6m-essential-refbrow-espn-e10s**
9997        - ❌
9998        - ❌
9999        - ❌
10000        - ❌
10001      * - **browsertime-tp6m-live-chrome-m-espn-e10s**
10002        - ❌
10003        - ❌
10004        - ❌
10005        - ❌
10006      * - **browsertime-tp6m-live-fenix-espn-e10s**
10007        - ❌
10008        - ❌
10009        - ❌
10010        - ❌
10011      * - **browsertime-tp6m-live-geckoview-espn-e10s**
10012        - ❌
10013        - ❌
10014        - ❌
10015        - ❌
10016
10017
10018   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
10019      :widths: 30 15 15 15 15
10020      :header-rows: 1
10021
10022      * - **Test Name**
10023        - mozilla-central
10024        - autoland
10025        - mozilla-release
10026        - mozilla-beta
10027      * - **browsertime-tp6m-essential-fenix-espn-e10s**
10028        - ❌
10029        - ❌
10030        - ❌
10031        - ❌
10032      * - **browsertime-tp6m-essential-geckoview-espn-e10s**
10033        - ❌
10034        - ❌
10035        - ❌
10036        - ❌
10037      * - **browsertime-tp6m-essential-refbrow-espn-e10s**
10038        - ❌
10039        - ❌
10040        - ❌
10041        - ❌
10042      * - **browsertime-tp6m-live-fenix-espn-e10s**
10043        - ❌
10044        - ❌
10045        - ❌
10046        - ❌
10047      * - **browsertime-tp6m-live-geckoview-espn-e10s**
10048        - ❌
10049        - ❌
10050        - ❌
10051        - ❌
10052
10053
10054   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
10055      :widths: 30 15 15 15 15
10056      :header-rows: 1
10057
10058      * - **Test Name**
10059        - mozilla-central
10060        - autoland
10061        - mozilla-release
10062        - mozilla-beta
10063      * - **browsertime-tp6m-essential-chrome-m-espn-e10s**
10064        - ❌
10065        - ❌
10066        - ❌
10067        - ❌
10068      * - **browsertime-tp6m-essential-fenix-espn-e10s**
10069        - ❌
10070        - ❌
10071        - ❌
10072        - ❌
10073      * - **browsertime-tp6m-essential-geckoview-espn-e10s**
10074        - ✅
10075        - ✅
10076        - ✅
10077        - ✅
10078      * - **browsertime-tp6m-essential-refbrow-espn-e10s**
10079        - ❌
10080        - ❌
10081        - ❌
10082        - ❌
10083      * - **browsertime-tp6m-live-chrome-m-espn-e10s**
10084        - ❌
10085        - ❌
10086        - ❌
10087        - ❌
10088      * - **browsertime-tp6m-live-fenix-espn-e10s**
10089        - ❌
10090        - ❌
10091        - ❌
10092        - ❌
10093      * - **browsertime-tp6m-live-geckoview-espn-e10s**
10094        - ❌
10095        - ❌
10096        - ❌
10097        - ❌
10098
10099
10100   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
10101      :widths: 30 15 15 15 15
10102      :header-rows: 1
10103
10104      * - **Test Name**
10105        - mozilla-central
10106        - autoland
10107        - mozilla-release
10108        - mozilla-beta
10109      * - **browsertime-tp6m-essential-fenix-espn-e10s**
10110        - ❌
10111        - ❌
10112        - ❌
10113        - ❌
10114      * - **browsertime-tp6m-essential-geckoview-espn-e10s**
10115        - ❌
10116        - ❌
10117        - ❌
10118        - ❌
10119      * - **browsertime-tp6m-essential-refbrow-espn-e10s**
10120        - ❌
10121        - ❌
10122        - ❌
10123        - ❌
10124      * - **browsertime-tp6m-live-fenix-espn-e10s**
10125        - ❌
10126        - ❌
10127        - ❌
10128        - ❌
10129      * - **browsertime-tp6m-live-geckoview-espn-e10s**
10130        - ❌
10131        - ❌
10132        - ❌
10133        - ❌
10134
10135
10136   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
10137      :widths: 30 15 15 15 15
10138      :header-rows: 1
10139
10140      * - **Test Name**
10141        - mozilla-central
10142        - autoland
10143        - mozilla-release
10144        - mozilla-beta
10145      * - **browsertime-tp6m-essential-chrome-m-espn-e10s**
10146        - ❌
10147        - ❌
10148        - ❌
10149        - ❌
10150      * - **browsertime-tp6m-essential-fenix-espn-e10s**
10151        - ❌
10152        - ❌
10153        - ❌
10154        - ❌
10155      * - **browsertime-tp6m-essential-geckoview-espn-e10s**
10156        - ❌
10157        - ❌
10158        - ❌
10159        - ❌
10160      * - **browsertime-tp6m-essential-refbrow-espn-e10s**
10161        - ❌
10162        - ❌
10163        - ❌
10164        - ❌
10165      * - **browsertime-tp6m-live-chrome-m-espn-e10s**
10166        - ❌
10167        - ❌
10168        - ❌
10169        - ❌
10170      * - **browsertime-tp6m-live-fenix-espn-e10s**
10171        - ❌
10172        - ❌
10173        - ❌
10174        - ❌
10175      * - **browsertime-tp6m-live-geckoview-espn-e10s**
10176        - ❌
10177        - ❌
10178        - ❌
10179        - ❌
10180
10181
10182   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
10183      :widths: 30 15 15 15 15
10184      :header-rows: 1
10185
10186      * - **Test Name**
10187        - mozilla-central
10188        - autoland
10189        - mozilla-release
10190        - mozilla-beta
10191      * - **browsertime-tp6m-essential-fenix-espn-e10s**
10192        - ❌
10193        - ❌
10194        - ❌
10195        - ❌
10196      * - **browsertime-tp6m-essential-geckoview-espn-e10s**
10197        - ❌
10198        - ❌
10199        - ❌
10200        - ❌
10201      * - **browsertime-tp6m-essential-refbrow-espn-e10s**
10202        - ❌
10203        - ❌
10204        - ❌
10205        - ❌
10206      * - **browsertime-tp6m-live-fenix-espn-e10s**
10207        - ❌
10208        - ❌
10209        - ❌
10210        - ❌
10211      * - **browsertime-tp6m-live-geckoview-espn-e10s**
10212        - ❌
10213        - ❌
10214        - ❌
10215        - ❌
10216
10217
10218   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
10219      :widths: 30 15 15 15 15
10220      :header-rows: 1
10221
10222      * - **Test Name**
10223        - mozilla-central
10224        - autoland
10225        - mozilla-release
10226        - mozilla-beta
10227      * - **browsertime-tp6m-essential-chrome-m-espn-e10s**
10228        - ❌
10229        - ❌
10230        - ❌
10231        - ❌
10232      * - **browsertime-tp6m-essential-fenix-espn-e10s**
10233        - ❌
10234        - ❌
10235        - ❌
10236        - ❌
10237      * - **browsertime-tp6m-essential-geckoview-espn-e10s**
10238        - ❌
10239        - ❌
10240        - ❌
10241        - ❌
10242      * - **browsertime-tp6m-essential-refbrow-espn-e10s**
10243        - ❌
10244        - ❌
10245        - ❌
10246        - ❌
10247      * - **browsertime-tp6m-live-chrome-m-espn-e10s**
10248        - ❌
10249        - ❌
10250        - ❌
10251        - ❌
10252      * - **browsertime-tp6m-live-fenix-espn-e10s**
10253        - ❌
10254        - ❌
10255        - ❌
10256        - ❌
10257      * - **browsertime-tp6m-live-geckoview-espn-e10s**
10258        - ❌
10259        - ❌
10260        - ❌
10261        - ❌
10262
10263
10264   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
10265      :widths: 30 15 15 15 15
10266      :header-rows: 1
10267
10268      * - **Test Name**
10269        - mozilla-central
10270        - autoland
10271        - mozilla-release
10272        - mozilla-beta
10273      * - **browsertime-tp6-firefox-espn-e10s**
10274        - ❌
10275        - ❌
10276        - ❌
10277        - ❌
10278      * - **browsertime-tp6-firefox-espn-fis-e10s**
10279        - ❌
10280        - ❌
10281        - ❌
10282        - ❌
10283
10284
10285   .. list-table:: **test-linux1804-64-qr/opt**
10286      :widths: 30 15 15 15 15
10287      :header-rows: 1
10288
10289      * - **Test Name**
10290        - mozilla-central
10291        - autoland
10292        - mozilla-release
10293        - mozilla-beta
10294      * - **browsertime-tp6-firefox-espn-e10s**
10295        - ❌
10296        - ❌
10297        - ❌
10298        - ❌
10299      * - **browsertime-tp6-firefox-espn-fis-e10s**
10300        - ❌
10301        - ❌
10302        - ❌
10303        - ❌
10304
10305
10306   .. list-table:: **test-linux1804-64-shippable-qr/opt**
10307      :widths: 30 15 15 15 15
10308      :header-rows: 1
10309
10310      * - **Test Name**
10311        - mozilla-central
10312        - autoland
10313        - mozilla-release
10314        - mozilla-beta
10315      * - **browsertime-tp6-chrome-espn-e10s**
10316        - ❌
10317        - ❌
10318        - ❌
10319        - ❌
10320      * - **browsertime-tp6-chromium-espn-e10s**
10321        - ❌
10322        - ❌
10323        - ❌
10324        - ❌
10325      * - **browsertime-tp6-firefox-espn-e10s**
10326        - ❌
10327        - ❌
10328        - ❌
10329        - ❌
10330      * - **browsertime-tp6-firefox-espn-fis-e10s**
10331        - ✅
10332        - ✅
10333        - ✅
10334        - ✅
10335
10336
10337   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
10338      :widths: 30 15 15 15 15
10339      :header-rows: 1
10340
10341      * - **Test Name**
10342        - mozilla-central
10343        - autoland
10344        - mozilla-release
10345        - mozilla-beta
10346      * - **browsertime-tp6-chrome-espn-e10s**
10347        - ❌
10348        - ❌
10349        - ❌
10350        - ❌
10351      * - **browsertime-tp6-chromium-espn-e10s**
10352        - ❌
10353        - ❌
10354        - ❌
10355        - ❌
10356      * - **browsertime-tp6-firefox-espn-e10s**
10357        - ❌
10358        - ❌
10359        - ❌
10360        - ❌
10361      * - **browsertime-tp6-firefox-espn-fis-e10s**
10362        - ✅
10363        - ✅
10364        - ✅
10365        - ✅
10366
10367
10368   .. list-table:: **test-windows10-32-qr/opt**
10369      :widths: 30 15 15 15 15
10370      :header-rows: 1
10371
10372      * - **Test Name**
10373        - mozilla-central
10374        - autoland
10375        - mozilla-release
10376        - mozilla-beta
10377      * - **browsertime-tp6-firefox-espn-e10s**
10378        - ❌
10379        - ❌
10380        - ❌
10381        - ❌
10382      * - **browsertime-tp6-firefox-espn-fis-e10s**
10383        - ❌
10384        - ❌
10385        - ❌
10386        - ❌
10387
10388
10389   .. list-table:: **test-windows10-32-shippable-qr/opt**
10390      :widths: 30 15 15 15 15
10391      :header-rows: 1
10392
10393      * - **Test Name**
10394        - mozilla-central
10395        - autoland
10396        - mozilla-release
10397        - mozilla-beta
10398      * - **browsertime-tp6-chrome-espn-e10s**
10399        - ❌
10400        - ❌
10401        - ❌
10402        - ❌
10403      * - **browsertime-tp6-chromium-espn-e10s**
10404        - ❌
10405        - ❌
10406        - ❌
10407        - ❌
10408      * - **browsertime-tp6-firefox-espn-e10s**
10409        - ❌
10410        - ❌
10411        - ❌
10412        - ❌
10413      * - **browsertime-tp6-firefox-espn-fis-e10s**
10414        - ❌
10415        - ❌
10416        - ❌
10417        - ❌
10418
10419
10420   .. list-table:: **test-windows10-64-qr/opt**
10421      :widths: 30 15 15 15 15
10422      :header-rows: 1
10423
10424      * - **Test Name**
10425        - mozilla-central
10426        - autoland
10427        - mozilla-release
10428        - mozilla-beta
10429      * - **browsertime-tp6-firefox-espn-e10s**
10430        - ❌
10431        - ❌
10432        - ❌
10433        - ❌
10434      * - **browsertime-tp6-firefox-espn-fis-e10s**
10435        - ❌
10436        - ❌
10437        - ❌
10438        - ❌
10439
10440
10441   .. list-table:: **test-windows10-64-shippable-qr/opt**
10442      :widths: 30 15 15 15 15
10443      :header-rows: 1
10444
10445      * - **Test Name**
10446        - mozilla-central
10447        - autoland
10448        - mozilla-release
10449        - mozilla-beta
10450      * - **browsertime-tp6-chrome-espn-e10s**
10451        - ❌
10452        - ❌
10453        - ❌
10454        - ❌
10455      * - **browsertime-tp6-chromium-espn-e10s**
10456        - ❌
10457        - ❌
10458        - ❌
10459        - ❌
10460      * - **browsertime-tp6-firefox-espn-e10s**
10461        - ❌
10462        - ❌
10463        - ❌
10464        - ❌
10465      * - **browsertime-tp6-firefox-espn-fis-e10s**
10466        - ✅
10467        - ✅
10468        - ✅
10469        - ✅
10470
10471
10472
10473.. dropdown:: expedia
10474   :container: + anchor-id-expedia-d
10475
10476   **Owner**: PerfTest Team
10477
10478   * **alert on**: fcp, loadtime
10479   * **alert threshold**: 2.0
10480   * **apps**: firefox, chrome, chromium
10481   * **browser cycles**: 25
10482   * **expected**: pass
10483   * **gecko profile entries**: 14000000
10484   * **gecko profile interval**: 1
10485   * **lower is better**: true
10486   * **measure**: fnbpaint, fcp, dcf, loadtime
10487   * **page cycles**: 25
10488   * **page timeout**: 60000
10489   * **playback**: mitmproxy
10490   * **playback pageset manifest**: mitm7-linux-firefox-expedia.manifest
10491   * **playback version**: 7.0.4
10492   * **secondary url**: `<https://groups.expedia.com/Group-Rate/?locale=en_US&ol=1>`__
10493   * **test url**: `<https://expedia.com/Hotel-Search?destination=New+York%2C+New+York&latLong=40.756680%2C-73.986470&regionId=178293&startDate=&endDate=&rooms=1&_xpid=11905%7C1&adults=2>`__
10494   * **type**: pageload
10495   * **unit**: ms
10496   * **use live sites**: false
10497   * **Test Task**:
10498
10499   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
10500      :widths: 30 15 15 15 15
10501      :header-rows: 1
10502
10503      * - **Test Name**
10504        - mozilla-central
10505        - autoland
10506        - mozilla-release
10507        - mozilla-beta
10508      * - **browsertime-tp6m-live-fenix-expedia-e10s**
10509        - ❌
10510        - ❌
10511        - ❌
10512        - ❌
10513      * - **browsertime-tp6m-live-geckoview-expedia-e10s**
10514        - ❌
10515        - ❌
10516        - ❌
10517        - ❌
10518
10519
10520   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
10521      :widths: 30 15 15 15 15
10522      :header-rows: 1
10523
10524      * - **Test Name**
10525        - mozilla-central
10526        - autoland
10527        - mozilla-release
10528        - mozilla-beta
10529      * - **browsertime-tp6m-live-chrome-m-expedia-e10s**
10530        - ❌
10531        - ❌
10532        - ❌
10533        - ❌
10534      * - **browsertime-tp6m-live-fenix-expedia-e10s**
10535        - ❌
10536        - ❌
10537        - ❌
10538        - ❌
10539      * - **browsertime-tp6m-live-geckoview-expedia-e10s**
10540        - ❌
10541        - ❌
10542        - ❌
10543        - ❌
10544
10545
10546   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
10547      :widths: 30 15 15 15 15
10548      :header-rows: 1
10549
10550      * - **Test Name**
10551        - mozilla-central
10552        - autoland
10553        - mozilla-release
10554        - mozilla-beta
10555      * - **browsertime-tp6m-live-fenix-expedia-e10s**
10556        - ❌
10557        - ❌
10558        - ❌
10559        - ❌
10560      * - **browsertime-tp6m-live-geckoview-expedia-e10s**
10561        - ❌
10562        - ❌
10563        - ❌
10564        - ❌
10565
10566
10567   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
10568      :widths: 30 15 15 15 15
10569      :header-rows: 1
10570
10571      * - **Test Name**
10572        - mozilla-central
10573        - autoland
10574        - mozilla-release
10575        - mozilla-beta
10576      * - **browsertime-tp6m-live-chrome-m-expedia-e10s**
10577        - ❌
10578        - ❌
10579        - ❌
10580        - ❌
10581      * - **browsertime-tp6m-live-fenix-expedia-e10s**
10582        - ❌
10583        - ❌
10584        - ❌
10585        - ❌
10586      * - **browsertime-tp6m-live-geckoview-expedia-e10s**
10587        - ❌
10588        - ❌
10589        - ❌
10590        - ❌
10591
10592
10593   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
10594      :widths: 30 15 15 15 15
10595      :header-rows: 1
10596
10597      * - **Test Name**
10598        - mozilla-central
10599        - autoland
10600        - mozilla-release
10601        - mozilla-beta
10602      * - **browsertime-tp6m-live-fenix-expedia-e10s**
10603        - ❌
10604        - ❌
10605        - ❌
10606        - ❌
10607      * - **browsertime-tp6m-live-geckoview-expedia-e10s**
10608        - ❌
10609        - ❌
10610        - ❌
10611        - ❌
10612
10613
10614   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
10615      :widths: 30 15 15 15 15
10616      :header-rows: 1
10617
10618      * - **Test Name**
10619        - mozilla-central
10620        - autoland
10621        - mozilla-release
10622        - mozilla-beta
10623      * - **browsertime-tp6m-live-chrome-m-expedia-e10s**
10624        - ❌
10625        - ❌
10626        - ❌
10627        - ❌
10628      * - **browsertime-tp6m-live-fenix-expedia-e10s**
10629        - ❌
10630        - ❌
10631        - ❌
10632        - ❌
10633      * - **browsertime-tp6m-live-geckoview-expedia-e10s**
10634        - ❌
10635        - ❌
10636        - ❌
10637        - ❌
10638
10639
10640   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
10641      :widths: 30 15 15 15 15
10642      :header-rows: 1
10643
10644      * - **Test Name**
10645        - mozilla-central
10646        - autoland
10647        - mozilla-release
10648        - mozilla-beta
10649      * - **browsertime-tp6m-live-fenix-expedia-e10s**
10650        - ❌
10651        - ❌
10652        - ❌
10653        - ❌
10654      * - **browsertime-tp6m-live-geckoview-expedia-e10s**
10655        - ❌
10656        - ❌
10657        - ❌
10658        - ❌
10659
10660
10661   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
10662      :widths: 30 15 15 15 15
10663      :header-rows: 1
10664
10665      * - **Test Name**
10666        - mozilla-central
10667        - autoland
10668        - mozilla-release
10669        - mozilla-beta
10670      * - **browsertime-tp6m-live-chrome-m-expedia-e10s**
10671        - ❌
10672        - ❌
10673        - ❌
10674        - ❌
10675      * - **browsertime-tp6m-live-fenix-expedia-e10s**
10676        - ❌
10677        - ❌
10678        - ❌
10679        - ❌
10680      * - **browsertime-tp6m-live-geckoview-expedia-e10s**
10681        - ❌
10682        - ❌
10683        - ❌
10684        - ❌
10685
10686
10687   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
10688      :widths: 30 15 15 15 15
10689      :header-rows: 1
10690
10691      * - **Test Name**
10692        - mozilla-central
10693        - autoland
10694        - mozilla-release
10695        - mozilla-beta
10696      * - **browsertime-tp6-firefox-expedia-e10s**
10697        - ❌
10698        - ❌
10699        - ❌
10700        - ❌
10701      * - **browsertime-tp6-firefox-expedia-fis-e10s**
10702        - ❌
10703        - ❌
10704        - ❌
10705        - ❌
10706
10707
10708   .. list-table:: **test-linux1804-64-qr/opt**
10709      :widths: 30 15 15 15 15
10710      :header-rows: 1
10711
10712      * - **Test Name**
10713        - mozilla-central
10714        - autoland
10715        - mozilla-release
10716        - mozilla-beta
10717      * - **browsertime-tp6-firefox-expedia-e10s**
10718        - ❌
10719        - ❌
10720        - ❌
10721        - ❌
10722      * - **browsertime-tp6-firefox-expedia-fis-e10s**
10723        - ❌
10724        - ❌
10725        - ❌
10726        - ❌
10727
10728
10729   .. list-table:: **test-linux1804-64-shippable-qr/opt**
10730      :widths: 30 15 15 15 15
10731      :header-rows: 1
10732
10733      * - **Test Name**
10734        - mozilla-central
10735        - autoland
10736        - mozilla-release
10737        - mozilla-beta
10738      * - **browsertime-tp6-chrome-expedia-e10s**
10739        - ❌
10740        - ❌
10741        - ❌
10742        - ❌
10743      * - **browsertime-tp6-chromium-expedia-e10s**
10744        - ❌
10745        - ❌
10746        - ❌
10747        - ❌
10748      * - **browsertime-tp6-firefox-expedia-e10s**
10749        - ❌
10750        - ❌
10751        - ❌
10752        - ❌
10753      * - **browsertime-tp6-firefox-expedia-fis-e10s**
10754        - ✅
10755        - ✅
10756        - ✅
10757        - ✅
10758
10759
10760   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
10761      :widths: 30 15 15 15 15
10762      :header-rows: 1
10763
10764      * - **Test Name**
10765        - mozilla-central
10766        - autoland
10767        - mozilla-release
10768        - mozilla-beta
10769      * - **browsertime-tp6-chrome-expedia-e10s**
10770        - ❌
10771        - ❌
10772        - ❌
10773        - ❌
10774      * - **browsertime-tp6-chromium-expedia-e10s**
10775        - ❌
10776        - ❌
10777        - ❌
10778        - ❌
10779      * - **browsertime-tp6-firefox-expedia-e10s**
10780        - ❌
10781        - ❌
10782        - ❌
10783        - ❌
10784      * - **browsertime-tp6-firefox-expedia-fis-e10s**
10785        - ✅
10786        - ✅
10787        - ✅
10788        - ✅
10789
10790
10791   .. list-table:: **test-windows10-32-qr/opt**
10792      :widths: 30 15 15 15 15
10793      :header-rows: 1
10794
10795      * - **Test Name**
10796        - mozilla-central
10797        - autoland
10798        - mozilla-release
10799        - mozilla-beta
10800      * - **browsertime-tp6-firefox-expedia-e10s**
10801        - ❌
10802        - ❌
10803        - ❌
10804        - ❌
10805      * - **browsertime-tp6-firefox-expedia-fis-e10s**
10806        - ❌
10807        - ❌
10808        - ❌
10809        - ❌
10810
10811
10812   .. list-table:: **test-windows10-32-shippable-qr/opt**
10813      :widths: 30 15 15 15 15
10814      :header-rows: 1
10815
10816      * - **Test Name**
10817        - mozilla-central
10818        - autoland
10819        - mozilla-release
10820        - mozilla-beta
10821      * - **browsertime-tp6-chrome-expedia-e10s**
10822        - ❌
10823        - ❌
10824        - ❌
10825        - ❌
10826      * - **browsertime-tp6-chromium-expedia-e10s**
10827        - ❌
10828        - ❌
10829        - ❌
10830        - ❌
10831      * - **browsertime-tp6-firefox-expedia-e10s**
10832        - ❌
10833        - ❌
10834        - ❌
10835        - ❌
10836      * - **browsertime-tp6-firefox-expedia-fis-e10s**
10837        - ❌
10838        - ❌
10839        - ❌
10840        - ❌
10841
10842
10843   .. list-table:: **test-windows10-64-qr/opt**
10844      :widths: 30 15 15 15 15
10845      :header-rows: 1
10846
10847      * - **Test Name**
10848        - mozilla-central
10849        - autoland
10850        - mozilla-release
10851        - mozilla-beta
10852      * - **browsertime-tp6-firefox-expedia-e10s**
10853        - ❌
10854        - ❌
10855        - ❌
10856        - ❌
10857      * - **browsertime-tp6-firefox-expedia-fis-e10s**
10858        - ❌
10859        - ❌
10860        - ❌
10861        - ❌
10862
10863
10864   .. list-table:: **test-windows10-64-shippable-qr/opt**
10865      :widths: 30 15 15 15 15
10866      :header-rows: 1
10867
10868      * - **Test Name**
10869        - mozilla-central
10870        - autoland
10871        - mozilla-release
10872        - mozilla-beta
10873      * - **browsertime-tp6-chrome-expedia-e10s**
10874        - ❌
10875        - ❌
10876        - ❌
10877        - ❌
10878      * - **browsertime-tp6-chromium-expedia-e10s**
10879        - ❌
10880        - ❌
10881        - ❌
10882        - ❌
10883      * - **browsertime-tp6-firefox-expedia-e10s**
10884        - ❌
10885        - ❌
10886        - ❌
10887        - ❌
10888      * - **browsertime-tp6-firefox-expedia-fis-e10s**
10889        - ✅
10890        - ✅
10891        - ✅
10892        - ✅
10893
10894
10895
10896.. dropdown:: facebook
10897   :container: + anchor-id-facebook-d
10898
10899   **Owner**: PerfTest Team
10900
10901   * **alert on**: fcp, loadtime
10902   * **alert threshold**: 2.0
10903   * **apps**: firefox, chrome, chromium
10904   * **browser cycles**: 25
10905   * **expected**: pass
10906   * **gecko profile entries**: 14000000
10907   * **gecko profile interval**: 1
10908   * **lower is better**: true
10909   * **measure**: fnbpaint, fcp, dcf, loadtime
10910   * **page cycles**: 25
10911   * **page timeout**: 60000
10912   * **playback**: mitmproxy
10913   * **playback pageset manifest**: mitm6-linux-firefox-facebook.manifest
10914   * **playback version**: 6.0.2
10915   * **secondary url**: `<https://www.facebook.com/marketplace/?ref=bookmark>`__
10916   * **test url**: `<https://www.facebook.com>`__
10917   * **type**: pageload
10918   * **unit**: ms
10919   * **use live sites**: false
10920   * **Test Task**:
10921
10922   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
10923      :widths: 30 15 15 15 15
10924      :header-rows: 1
10925
10926      * - **Test Name**
10927        - mozilla-central
10928        - autoland
10929        - mozilla-release
10930        - mozilla-beta
10931      * - **browsertime-tp6m-essential-fenix-facebook-e10s**
10932        - ❌
10933        - ❌
10934        - ❌
10935        - ❌
10936      * - **browsertime-tp6m-essential-geckoview-facebook-e10s**
10937        - ❌
10938        - ❌
10939        - ❌
10940        - ❌
10941      * - **browsertime-tp6m-essential-refbrow-facebook-e10s**
10942        - ❌
10943        - ❌
10944        - ❌
10945        - ❌
10946      * - **browsertime-tp6m-live-fenix-facebook-e10s**
10947        - ❌
10948        - ❌
10949        - ❌
10950        - ❌
10951      * - **browsertime-tp6m-live-geckoview-facebook-e10s**
10952        - ❌
10953        - ❌
10954        - ❌
10955        - ❌
10956
10957
10958   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
10959      :widths: 30 15 15 15 15
10960      :header-rows: 1
10961
10962      * - **Test Name**
10963        - mozilla-central
10964        - autoland
10965        - mozilla-release
10966        - mozilla-beta
10967      * - **browsertime-tp6m-essential-chrome-m-facebook-e10s**
10968        - ❌
10969        - ❌
10970        - ❌
10971        - ❌
10972      * - **browsertime-tp6m-essential-fenix-facebook-e10s**
10973        - ❌
10974        - ❌
10975        - ❌
10976        - ❌
10977      * - **browsertime-tp6m-essential-geckoview-facebook-e10s**
10978        - ✅
10979        - ✅
10980        - ✅
10981        - ✅
10982      * - **browsertime-tp6m-essential-refbrow-facebook-e10s**
10983        - ❌
10984        - ❌
10985        - ❌
10986        - ❌
10987      * - **browsertime-tp6m-live-chrome-m-facebook-e10s**
10988        - ❌
10989        - ❌
10990        - ❌
10991        - ❌
10992      * - **browsertime-tp6m-live-fenix-facebook-e10s**
10993        - ❌
10994        - ❌
10995        - ❌
10996        - ❌
10997      * - **browsertime-tp6m-live-geckoview-facebook-e10s**
10998        - ❌
10999        - ❌
11000        - ❌
11001        - ❌
11002
11003
11004   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
11005      :widths: 30 15 15 15 15
11006      :header-rows: 1
11007
11008      * - **Test Name**
11009        - mozilla-central
11010        - autoland
11011        - mozilla-release
11012        - mozilla-beta
11013      * - **browsertime-tp6m-essential-fenix-facebook-e10s**
11014        - ❌
11015        - ❌
11016        - ❌
11017        - ❌
11018      * - **browsertime-tp6m-essential-geckoview-facebook-e10s**
11019        - ❌
11020        - ❌
11021        - ❌
11022        - ❌
11023      * - **browsertime-tp6m-essential-refbrow-facebook-e10s**
11024        - ❌
11025        - ❌
11026        - ❌
11027        - ❌
11028      * - **browsertime-tp6m-live-fenix-facebook-e10s**
11029        - ❌
11030        - ❌
11031        - ❌
11032        - ❌
11033      * - **browsertime-tp6m-live-geckoview-facebook-e10s**
11034        - ❌
11035        - ❌
11036        - ❌
11037        - ❌
11038
11039
11040   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
11041      :widths: 30 15 15 15 15
11042      :header-rows: 1
11043
11044      * - **Test Name**
11045        - mozilla-central
11046        - autoland
11047        - mozilla-release
11048        - mozilla-beta
11049      * - **browsertime-tp6m-essential-chrome-m-facebook-e10s**
11050        - ❌
11051        - ❌
11052        - ❌
11053        - ❌
11054      * - **browsertime-tp6m-essential-fenix-facebook-e10s**
11055        - ❌
11056        - ❌
11057        - ❌
11058        - ❌
11059      * - **browsertime-tp6m-essential-geckoview-facebook-e10s**
11060        - ✅
11061        - ✅
11062        - ✅
11063        - ✅
11064      * - **browsertime-tp6m-essential-refbrow-facebook-e10s**
11065        - ❌
11066        - ❌
11067        - ❌
11068        - ❌
11069      * - **browsertime-tp6m-live-chrome-m-facebook-e10s**
11070        - ❌
11071        - ❌
11072        - ❌
11073        - ❌
11074      * - **browsertime-tp6m-live-fenix-facebook-e10s**
11075        - ❌
11076        - ❌
11077        - ❌
11078        - ❌
11079      * - **browsertime-tp6m-live-geckoview-facebook-e10s**
11080        - ❌
11081        - ❌
11082        - ❌
11083        - ❌
11084
11085
11086   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
11087      :widths: 30 15 15 15 15
11088      :header-rows: 1
11089
11090      * - **Test Name**
11091        - mozilla-central
11092        - autoland
11093        - mozilla-release
11094        - mozilla-beta
11095      * - **browsertime-tp6m-essential-fenix-facebook-e10s**
11096        - ❌
11097        - ❌
11098        - ❌
11099        - ❌
11100      * - **browsertime-tp6m-essential-geckoview-facebook-e10s**
11101        - ❌
11102        - ❌
11103        - ❌
11104        - ❌
11105      * - **browsertime-tp6m-essential-refbrow-facebook-e10s**
11106        - ❌
11107        - ❌
11108        - ❌
11109        - ❌
11110      * - **browsertime-tp6m-live-fenix-facebook-e10s**
11111        - ❌
11112        - ❌
11113        - ❌
11114        - ❌
11115      * - **browsertime-tp6m-live-geckoview-facebook-e10s**
11116        - ❌
11117        - ❌
11118        - ❌
11119        - ❌
11120
11121
11122   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
11123      :widths: 30 15 15 15 15
11124      :header-rows: 1
11125
11126      * - **Test Name**
11127        - mozilla-central
11128        - autoland
11129        - mozilla-release
11130        - mozilla-beta
11131      * - **browsertime-tp6m-essential-chrome-m-facebook-e10s**
11132        - ❌
11133        - ❌
11134        - ❌
11135        - ❌
11136      * - **browsertime-tp6m-essential-fenix-facebook-e10s**
11137        - ❌
11138        - ❌
11139        - ❌
11140        - ❌
11141      * - **browsertime-tp6m-essential-geckoview-facebook-e10s**
11142        - ❌
11143        - ❌
11144        - ❌
11145        - ❌
11146      * - **browsertime-tp6m-essential-refbrow-facebook-e10s**
11147        - ❌
11148        - ❌
11149        - ❌
11150        - ❌
11151      * - **browsertime-tp6m-live-chrome-m-facebook-e10s**
11152        - ❌
11153        - ❌
11154        - ❌
11155        - ❌
11156      * - **browsertime-tp6m-live-fenix-facebook-e10s**
11157        - ❌
11158        - ❌
11159        - ❌
11160        - ❌
11161      * - **browsertime-tp6m-live-geckoview-facebook-e10s**
11162        - ❌
11163        - ❌
11164        - ❌
11165        - ❌
11166
11167
11168   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
11169      :widths: 30 15 15 15 15
11170      :header-rows: 1
11171
11172      * - **Test Name**
11173        - mozilla-central
11174        - autoland
11175        - mozilla-release
11176        - mozilla-beta
11177      * - **browsertime-tp6m-essential-fenix-facebook-e10s**
11178        - ❌
11179        - ❌
11180        - ❌
11181        - ❌
11182      * - **browsertime-tp6m-essential-geckoview-facebook-e10s**
11183        - ❌
11184        - ❌
11185        - ❌
11186        - ❌
11187      * - **browsertime-tp6m-essential-refbrow-facebook-e10s**
11188        - ❌
11189        - ❌
11190        - ❌
11191        - ❌
11192      * - **browsertime-tp6m-live-fenix-facebook-e10s**
11193        - ❌
11194        - ❌
11195        - ❌
11196        - ❌
11197      * - **browsertime-tp6m-live-geckoview-facebook-e10s**
11198        - ❌
11199        - ❌
11200        - ❌
11201        - ❌
11202
11203
11204   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
11205      :widths: 30 15 15 15 15
11206      :header-rows: 1
11207
11208      * - **Test Name**
11209        - mozilla-central
11210        - autoland
11211        - mozilla-release
11212        - mozilla-beta
11213      * - **browsertime-tp6m-essential-chrome-m-facebook-e10s**
11214        - ❌
11215        - ❌
11216        - ❌
11217        - ❌
11218      * - **browsertime-tp6m-essential-fenix-facebook-e10s**
11219        - ❌
11220        - ❌
11221        - ❌
11222        - ❌
11223      * - **browsertime-tp6m-essential-geckoview-facebook-e10s**
11224        - ❌
11225        - ❌
11226        - ❌
11227        - ❌
11228      * - **browsertime-tp6m-essential-refbrow-facebook-e10s**
11229        - ❌
11230        - ❌
11231        - ❌
11232        - ❌
11233      * - **browsertime-tp6m-live-chrome-m-facebook-e10s**
11234        - ❌
11235        - ❌
11236        - ❌
11237        - ❌
11238      * - **browsertime-tp6m-live-fenix-facebook-e10s**
11239        - ❌
11240        - ❌
11241        - ❌
11242        - ❌
11243      * - **browsertime-tp6m-live-geckoview-facebook-e10s**
11244        - ❌
11245        - ❌
11246        - ❌
11247        - ❌
11248
11249
11250   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
11251      :widths: 30 15 15 15 15
11252      :header-rows: 1
11253
11254      * - **Test Name**
11255        - mozilla-central
11256        - autoland
11257        - mozilla-release
11258        - mozilla-beta
11259      * - **browsertime-tp6-firefox-facebook-e10s**
11260        - ❌
11261        - ❌
11262        - ❌
11263        - ❌
11264      * - **browsertime-tp6-firefox-facebook-fis-e10s**
11265        - ❌
11266        - ❌
11267        - ❌
11268        - ❌
11269      * - **browsertime-tp6-live-firefox-facebook-e10s**
11270        - ❌
11271        - ❌
11272        - ❌
11273        - ❌
11274      * - **browsertime-tp6-live-firefox-facebook-fis-e10s**
11275        - ❌
11276        - ❌
11277        - ❌
11278        - ❌
11279
11280
11281   .. list-table:: **test-linux1804-64-qr/opt**
11282      :widths: 30 15 15 15 15
11283      :header-rows: 1
11284
11285      * - **Test Name**
11286        - mozilla-central
11287        - autoland
11288        - mozilla-release
11289        - mozilla-beta
11290      * - **browsertime-tp6-firefox-facebook-e10s**
11291        - ❌
11292        - ❌
11293        - ❌
11294        - ❌
11295      * - **browsertime-tp6-firefox-facebook-fis-e10s**
11296        - ❌
11297        - ❌
11298        - ❌
11299        - ❌
11300      * - **browsertime-tp6-live-firefox-facebook-e10s**
11301        - ❌
11302        - ❌
11303        - ❌
11304        - ❌
11305      * - **browsertime-tp6-live-firefox-facebook-fis-e10s**
11306        - ❌
11307        - ❌
11308        - ❌
11309        - ❌
11310
11311
11312   .. list-table:: **test-linux1804-64-shippable-qr/opt**
11313      :widths: 30 15 15 15 15
11314      :header-rows: 1
11315
11316      * - **Test Name**
11317        - mozilla-central
11318        - autoland
11319        - mozilla-release
11320        - mozilla-beta
11321      * - **browsertime-tp6-chrome-facebook-e10s**
11322        - ❌
11323        - ❌
11324        - ❌
11325        - ❌
11326      * - **browsertime-tp6-chromium-facebook-e10s**
11327        - ❌
11328        - ❌
11329        - ❌
11330        - ❌
11331      * - **browsertime-tp6-firefox-facebook-e10s**
11332        - ❌
11333        - ❌
11334        - ❌
11335        - ❌
11336      * - **browsertime-tp6-firefox-facebook-fis-e10s**
11337        - ✅
11338        - ✅
11339        - ✅
11340        - ✅
11341      * - **browsertime-tp6-live-chrome-facebook-e10s**
11342        - ❌
11343        - ❌
11344        - ❌
11345        - ❌
11346      * - **browsertime-tp6-live-chromium-facebook-e10s**
11347        - ❌
11348        - ❌
11349        - ❌
11350        - ❌
11351      * - **browsertime-tp6-live-firefox-facebook-e10s**
11352        - ❌
11353        - ❌
11354        - ❌
11355        - ❌
11356      * - **browsertime-tp6-live-firefox-facebook-fis-e10s**
11357        - ❌
11358        - ❌
11359        - ❌
11360        - ❌
11361
11362
11363   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
11364      :widths: 30 15 15 15 15
11365      :header-rows: 1
11366
11367      * - **Test Name**
11368        - mozilla-central
11369        - autoland
11370        - mozilla-release
11371        - mozilla-beta
11372      * - **browsertime-tp6-chrome-facebook-e10s**
11373        - ❌
11374        - ❌
11375        - ❌
11376        - ❌
11377      * - **browsertime-tp6-chromium-facebook-e10s**
11378        - ❌
11379        - ❌
11380        - ❌
11381        - ❌
11382      * - **browsertime-tp6-firefox-facebook-e10s**
11383        - ❌
11384        - ❌
11385        - ❌
11386        - ❌
11387      * - **browsertime-tp6-firefox-facebook-fis-e10s**
11388        - ✅
11389        - ✅
11390        - ✅
11391        - ✅
11392      * - **browsertime-tp6-live-chrome-facebook-e10s**
11393        - ❌
11394        - ❌
11395        - ❌
11396        - ❌
11397      * - **browsertime-tp6-live-chromium-facebook-e10s**
11398        - ❌
11399        - ❌
11400        - ❌
11401        - ❌
11402      * - **browsertime-tp6-live-firefox-facebook-e10s**
11403        - ❌
11404        - ❌
11405        - ❌
11406        - ❌
11407      * - **browsertime-tp6-live-firefox-facebook-fis-e10s**
11408        - ❌
11409        - ❌
11410        - ❌
11411        - ❌
11412
11413
11414   .. list-table:: **test-windows10-32-qr/opt**
11415      :widths: 30 15 15 15 15
11416      :header-rows: 1
11417
11418      * - **Test Name**
11419        - mozilla-central
11420        - autoland
11421        - mozilla-release
11422        - mozilla-beta
11423      * - **browsertime-tp6-firefox-facebook-e10s**
11424        - ❌
11425        - ❌
11426        - ❌
11427        - ❌
11428      * - **browsertime-tp6-firefox-facebook-fis-e10s**
11429        - ❌
11430        - ❌
11431        - ❌
11432        - ❌
11433      * - **browsertime-tp6-live-firefox-facebook-e10s**
11434        - ❌
11435        - ❌
11436        - ❌
11437        - ❌
11438      * - **browsertime-tp6-live-firefox-facebook-fis-e10s**
11439        - ❌
11440        - ❌
11441        - ❌
11442        - ❌
11443
11444
11445   .. list-table:: **test-windows10-32-shippable-qr/opt**
11446      :widths: 30 15 15 15 15
11447      :header-rows: 1
11448
11449      * - **Test Name**
11450        - mozilla-central
11451        - autoland
11452        - mozilla-release
11453        - mozilla-beta
11454      * - **browsertime-tp6-chrome-facebook-e10s**
11455        - ❌
11456        - ❌
11457        - ❌
11458        - ❌
11459      * - **browsertime-tp6-chromium-facebook-e10s**
11460        - ❌
11461        - ❌
11462        - ❌
11463        - ❌
11464      * - **browsertime-tp6-firefox-facebook-e10s**
11465        - ❌
11466        - ❌
11467        - ❌
11468        - ❌
11469      * - **browsertime-tp6-firefox-facebook-fis-e10s**
11470        - ❌
11471        - ❌
11472        - ❌
11473        - ❌
11474      * - **browsertime-tp6-live-chrome-facebook-e10s**
11475        - ❌
11476        - ❌
11477        - ❌
11478        - ❌
11479      * - **browsertime-tp6-live-chromium-facebook-e10s**
11480        - ❌
11481        - ❌
11482        - ❌
11483        - ❌
11484      * - **browsertime-tp6-live-firefox-facebook-e10s**
11485        - ❌
11486        - ❌
11487        - ❌
11488        - ❌
11489      * - **browsertime-tp6-live-firefox-facebook-fis-e10s**
11490        - ❌
11491        - ❌
11492        - ❌
11493        - ❌
11494
11495
11496   .. list-table:: **test-windows10-64-qr/opt**
11497      :widths: 30 15 15 15 15
11498      :header-rows: 1
11499
11500      * - **Test Name**
11501        - mozilla-central
11502        - autoland
11503        - mozilla-release
11504        - mozilla-beta
11505      * - **browsertime-tp6-firefox-facebook-e10s**
11506        - ❌
11507        - ❌
11508        - ❌
11509        - ❌
11510      * - **browsertime-tp6-firefox-facebook-fis-e10s**
11511        - ❌
11512        - ❌
11513        - ❌
11514        - ❌
11515      * - **browsertime-tp6-live-firefox-facebook-e10s**
11516        - ❌
11517        - ❌
11518        - ❌
11519        - ❌
11520      * - **browsertime-tp6-live-firefox-facebook-fis-e10s**
11521        - ❌
11522        - ❌
11523        - ❌
11524        - ❌
11525
11526
11527   .. list-table:: **test-windows10-64-shippable-qr/opt**
11528      :widths: 30 15 15 15 15
11529      :header-rows: 1
11530
11531      * - **Test Name**
11532        - mozilla-central
11533        - autoland
11534        - mozilla-release
11535        - mozilla-beta
11536      * - **browsertime-tp6-chrome-facebook-e10s**
11537        - ❌
11538        - ❌
11539        - ❌
11540        - ❌
11541      * - **browsertime-tp6-chromium-facebook-e10s**
11542        - ❌
11543        - ❌
11544        - ❌
11545        - ❌
11546      * - **browsertime-tp6-firefox-facebook-e10s**
11547        - ❌
11548        - ❌
11549        - ❌
11550        - ❌
11551      * - **browsertime-tp6-firefox-facebook-fis-e10s**
11552        - ✅
11553        - ✅
11554        - ✅
11555        - ✅
11556      * - **browsertime-tp6-live-chrome-facebook-e10s**
11557        - ❌
11558        - ❌
11559        - ❌
11560        - ❌
11561      * - **browsertime-tp6-live-chromium-facebook-e10s**
11562        - ❌
11563        - ❌
11564        - ❌
11565        - ❌
11566      * - **browsertime-tp6-live-firefox-facebook-e10s**
11567        - ❌
11568        - ❌
11569        - ❌
11570        - ❌
11571      * - **browsertime-tp6-live-firefox-facebook-fis-e10s**
11572        - ❌
11573        - ❌
11574        - ❌
11575        - ❌
11576
11577
11578
11579.. dropdown:: fandom
11580   :container: + anchor-id-fandom-d
11581
11582   **Owner**: PerfTest Team
11583
11584   * **alert on**: fcp, loadtime
11585   * **alert threshold**: 2.0
11586   * **apps**: firefox, chrome, chromium
11587   * **browser cycles**: 25
11588   * **expected**: pass
11589   * **gecko profile entries**: 14000000
11590   * **gecko profile interval**: 1
11591   * **lower is better**: true
11592   * **measure**: fnbpaint, fcp, dcf, loadtime
11593   * **page cycles**: 25
11594   * **page timeout**: 60000
11595   * **playback**: mitmproxy
11596   * **playback pageset manifest**: mitm5-linux-firefox-fandom.manifest
11597   * **playback version**: 5.1.1
11598   * **test url**: `<https://www.fandom.com/articles/fallout-76-will-live-and-die-on-the-creativity-of-its-playerbase>`__
11599   * **type**: pageload
11600   * **unit**: ms
11601   * **use live sites**: false
11602   * **Test Task**:
11603
11604   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
11605      :widths: 30 15 15 15 15
11606      :header-rows: 1
11607
11608      * - **Test Name**
11609        - mozilla-central
11610        - autoland
11611        - mozilla-release
11612        - mozilla-beta
11613      * - **browsertime-tp6-essential-firefox-fandom-e10s**
11614        - ❌
11615        - ❌
11616        - ❌
11617        - ❌
11618      * - **browsertime-tp6-essential-firefox-fandom-fis-e10s**
11619        - ❌
11620        - ❌
11621        - ❌
11622        - ❌
11623      * - **browsertime-tp6-live-firefox-fandom-e10s**
11624        - ❌
11625        - ❌
11626        - ❌
11627        - ❌
11628      * - **browsertime-tp6-live-firefox-fandom-fis-e10s**
11629        - ❌
11630        - ❌
11631        - ❌
11632        - ❌
11633
11634
11635   .. list-table:: **test-linux1804-64-qr/opt**
11636      :widths: 30 15 15 15 15
11637      :header-rows: 1
11638
11639      * - **Test Name**
11640        - mozilla-central
11641        - autoland
11642        - mozilla-release
11643        - mozilla-beta
11644      * - **browsertime-tp6-essential-firefox-fandom-e10s**
11645        - ❌
11646        - ❌
11647        - ❌
11648        - ❌
11649      * - **browsertime-tp6-essential-firefox-fandom-fis-e10s**
11650        - ❌
11651        - ❌
11652        - ❌
11653        - ❌
11654      * - **browsertime-tp6-live-firefox-fandom-e10s**
11655        - ❌
11656        - ❌
11657        - ❌
11658        - ❌
11659      * - **browsertime-tp6-live-firefox-fandom-fis-e10s**
11660        - ❌
11661        - ❌
11662        - ❌
11663        - ❌
11664
11665
11666   .. list-table:: **test-linux1804-64-shippable-qr/opt**
11667      :widths: 30 15 15 15 15
11668      :header-rows: 1
11669
11670      * - **Test Name**
11671        - mozilla-central
11672        - autoland
11673        - mozilla-release
11674        - mozilla-beta
11675      * - **browsertime-tp6-essential-chrome-fandom-e10s**
11676        - ❌
11677        - ❌
11678        - ❌
11679        - ❌
11680      * - **browsertime-tp6-essential-chromium-fandom-e10s**
11681        - ❌
11682        - ❌
11683        - ❌
11684        - ❌
11685      * - **browsertime-tp6-essential-firefox-fandom-e10s**
11686        - ❌
11687        - ❌
11688        - ❌
11689        - ❌
11690      * - **browsertime-tp6-essential-firefox-fandom-fis-e10s**
11691        - ✅
11692        - ✅
11693        - ✅
11694        - ✅
11695      * - **browsertime-tp6-live-chrome-fandom-e10s**
11696        - ❌
11697        - ❌
11698        - ❌
11699        - ❌
11700      * - **browsertime-tp6-live-chromium-fandom-e10s**
11701        - ❌
11702        - ❌
11703        - ❌
11704        - ❌
11705      * - **browsertime-tp6-live-firefox-fandom-e10s**
11706        - ❌
11707        - ❌
11708        - ❌
11709        - ❌
11710      * - **browsertime-tp6-live-firefox-fandom-fis-e10s**
11711        - ❌
11712        - ❌
11713        - ❌
11714        - ❌
11715
11716
11717   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
11718      :widths: 30 15 15 15 15
11719      :header-rows: 1
11720
11721      * - **Test Name**
11722        - mozilla-central
11723        - autoland
11724        - mozilla-release
11725        - mozilla-beta
11726      * - **browsertime-tp6-essential-chrome-fandom-e10s**
11727        - ❌
11728        - ❌
11729        - ❌
11730        - ❌
11731      * - **browsertime-tp6-essential-chromium-fandom-e10s**
11732        - ❌
11733        - ❌
11734        - ❌
11735        - ❌
11736      * - **browsertime-tp6-essential-firefox-fandom-e10s**
11737        - ❌
11738        - ❌
11739        - ❌
11740        - ❌
11741      * - **browsertime-tp6-essential-firefox-fandom-fis-e10s**
11742        - ✅
11743        - ✅
11744        - ✅
11745        - ✅
11746      * - **browsertime-tp6-live-chrome-fandom-e10s**
11747        - ❌
11748        - ❌
11749        - ❌
11750        - ❌
11751      * - **browsertime-tp6-live-chromium-fandom-e10s**
11752        - ❌
11753        - ❌
11754        - ❌
11755        - ❌
11756      * - **browsertime-tp6-live-firefox-fandom-e10s**
11757        - ❌
11758        - ❌
11759        - ❌
11760        - ❌
11761      * - **browsertime-tp6-live-firefox-fandom-fis-e10s**
11762        - ❌
11763        - ❌
11764        - ❌
11765        - ❌
11766
11767
11768   .. list-table:: **test-windows10-32-qr/opt**
11769      :widths: 30 15 15 15 15
11770      :header-rows: 1
11771
11772      * - **Test Name**
11773        - mozilla-central
11774        - autoland
11775        - mozilla-release
11776        - mozilla-beta
11777      * - **browsertime-tp6-essential-firefox-fandom-e10s**
11778        - ❌
11779        - ❌
11780        - ❌
11781        - ❌
11782      * - **browsertime-tp6-essential-firefox-fandom-fis-e10s**
11783        - ❌
11784        - ❌
11785        - ❌
11786        - ❌
11787      * - **browsertime-tp6-live-firefox-fandom-e10s**
11788        - ❌
11789        - ❌
11790        - ❌
11791        - ❌
11792      * - **browsertime-tp6-live-firefox-fandom-fis-e10s**
11793        - ❌
11794        - ❌
11795        - ❌
11796        - ❌
11797
11798
11799   .. list-table:: **test-windows10-32-shippable-qr/opt**
11800      :widths: 30 15 15 15 15
11801      :header-rows: 1
11802
11803      * - **Test Name**
11804        - mozilla-central
11805        - autoland
11806        - mozilla-release
11807        - mozilla-beta
11808      * - **browsertime-tp6-essential-chrome-fandom-e10s**
11809        - ❌
11810        - ❌
11811        - ❌
11812        - ❌
11813      * - **browsertime-tp6-essential-chromium-fandom-e10s**
11814        - ❌
11815        - ❌
11816        - ❌
11817        - ❌
11818      * - **browsertime-tp6-essential-firefox-fandom-e10s**
11819        - ❌
11820        - ❌
11821        - ❌
11822        - ❌
11823      * - **browsertime-tp6-essential-firefox-fandom-fis-e10s**
11824        - ❌
11825        - ❌
11826        - ❌
11827        - ❌
11828      * - **browsertime-tp6-live-chrome-fandom-e10s**
11829        - ❌
11830        - ❌
11831        - ❌
11832        - ❌
11833      * - **browsertime-tp6-live-chromium-fandom-e10s**
11834        - ❌
11835        - ❌
11836        - ❌
11837        - ❌
11838      * - **browsertime-tp6-live-firefox-fandom-e10s**
11839        - ❌
11840        - ❌
11841        - ❌
11842        - ❌
11843      * - **browsertime-tp6-live-firefox-fandom-fis-e10s**
11844        - ❌
11845        - ❌
11846        - ❌
11847        - ❌
11848
11849
11850   .. list-table:: **test-windows10-64-qr/opt**
11851      :widths: 30 15 15 15 15
11852      :header-rows: 1
11853
11854      * - **Test Name**
11855        - mozilla-central
11856        - autoland
11857        - mozilla-release
11858        - mozilla-beta
11859      * - **browsertime-tp6-essential-firefox-fandom-e10s**
11860        - ❌
11861        - ❌
11862        - ❌
11863        - ❌
11864      * - **browsertime-tp6-essential-firefox-fandom-fis-e10s**
11865        - ❌
11866        - ❌
11867        - ❌
11868        - ❌
11869      * - **browsertime-tp6-live-firefox-fandom-e10s**
11870        - ❌
11871        - ❌
11872        - ❌
11873        - ❌
11874      * - **browsertime-tp6-live-firefox-fandom-fis-e10s**
11875        - ❌
11876        - ❌
11877        - ❌
11878        - ❌
11879
11880
11881   .. list-table:: **test-windows10-64-shippable-qr/opt**
11882      :widths: 30 15 15 15 15
11883      :header-rows: 1
11884
11885      * - **Test Name**
11886        - mozilla-central
11887        - autoland
11888        - mozilla-release
11889        - mozilla-beta
11890      * - **browsertime-tp6-essential-chrome-fandom-e10s**
11891        - ❌
11892        - ❌
11893        - ❌
11894        - ❌
11895      * - **browsertime-tp6-essential-chromium-fandom-e10s**
11896        - ❌
11897        - ❌
11898        - ❌
11899        - ❌
11900      * - **browsertime-tp6-essential-firefox-fandom-e10s**
11901        - ❌
11902        - ❌
11903        - ❌
11904        - ❌
11905      * - **browsertime-tp6-essential-firefox-fandom-fis-e10s**
11906        - ✅
11907        - ✅
11908        - ✅
11909        - ✅
11910      * - **browsertime-tp6-live-chrome-fandom-e10s**
11911        - ❌
11912        - ❌
11913        - ❌
11914        - ❌
11915      * - **browsertime-tp6-live-chromium-fandom-e10s**
11916        - ❌
11917        - ❌
11918        - ❌
11919        - ❌
11920      * - **browsertime-tp6-live-firefox-fandom-e10s**
11921        - ❌
11922        - ❌
11923        - ❌
11924        - ❌
11925      * - **browsertime-tp6-live-firefox-fandom-fis-e10s**
11926        - ❌
11927        - ❌
11928        - ❌
11929        - ❌
11930
11931
11932
11933.. dropdown:: google-docs
11934   :container: + anchor-id-google-docs-d
11935
11936   **Owner**: PerfTest Team
11937
11938   * **alert on**: fcp, loadtime
11939   * **alert threshold**: 2.0
11940   * **apps**: firefox, chrome, chromium
11941   * **browser cycles**: 25
11942   * **expected**: pass
11943   * **gecko profile entries**: 14000000
11944   * **gecko profile interval**: 1
11945   * **lower is better**: true
11946   * **measure**: fnbpaint, fcp, dcf, loadtime
11947   * **page complete wait time**: 8000
11948   * **page cycles**: 25
11949   * **page timeout**: 60000
11950   * **playback**: mitmproxy
11951   * **playback pageset manifest**: mitm7-linux-firefox-google-docs.manifest
11952   * **playback version**: 7.0.4
11953   * **secondary url**: `<https://docs.google.com/document/d/1vUnn0ePU-ynArE1OdxyEHXR2G0sl74ja_st_4OOzlgE/preview>`__
11954   * **test url**: `<https://docs.google.com/document/d/1US-07msg12slQtI_xchzYxcKlTs6Fp7WqIc6W5GK5M8/edit?usp=sharing>`__
11955   * **type**: pageload
11956   * **unit**: ms
11957   * **use live sites**: false
11958   * **Test Task**:
11959
11960   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
11961      :widths: 30 15 15 15 15
11962      :header-rows: 1
11963
11964      * - **Test Name**
11965        - mozilla-central
11966        - autoland
11967        - mozilla-release
11968        - mozilla-beta
11969      * - **browsertime-tp6-firefox-google-docs-e10s**
11970        - ❌
11971        - ❌
11972        - ❌
11973        - ❌
11974      * - **browsertime-tp6-firefox-google-docs-fis-e10s**
11975        - ❌
11976        - ❌
11977        - ❌
11978        - ❌
11979      * - **browsertime-tp6-live-firefox-google-docs-e10s**
11980        - ❌
11981        - ❌
11982        - ❌
11983        - ❌
11984      * - **browsertime-tp6-live-firefox-google-docs-fis-e10s**
11985        - ❌
11986        - ❌
11987        - ❌
11988        - ❌
11989
11990
11991   .. list-table:: **test-linux1804-64-qr/opt**
11992      :widths: 30 15 15 15 15
11993      :header-rows: 1
11994
11995      * - **Test Name**
11996        - mozilla-central
11997        - autoland
11998        - mozilla-release
11999        - mozilla-beta
12000      * - **browsertime-tp6-firefox-google-docs-e10s**
12001        - ❌
12002        - ❌
12003        - ❌
12004        - ❌
12005      * - **browsertime-tp6-firefox-google-docs-fis-e10s**
12006        - ❌
12007        - ❌
12008        - ❌
12009        - ❌
12010      * - **browsertime-tp6-live-firefox-google-docs-e10s**
12011        - ❌
12012        - ❌
12013        - ❌
12014        - ❌
12015      * - **browsertime-tp6-live-firefox-google-docs-fis-e10s**
12016        - ❌
12017        - ❌
12018        - ❌
12019        - ❌
12020
12021
12022   .. list-table:: **test-linux1804-64-shippable-qr/opt**
12023      :widths: 30 15 15 15 15
12024      :header-rows: 1
12025
12026      * - **Test Name**
12027        - mozilla-central
12028        - autoland
12029        - mozilla-release
12030        - mozilla-beta
12031      * - **browsertime-tp6-chrome-google-docs-e10s**
12032        - ❌
12033        - ❌
12034        - ❌
12035        - ❌
12036      * - **browsertime-tp6-chromium-google-docs-e10s**
12037        - ❌
12038        - ❌
12039        - ❌
12040        - ❌
12041      * - **browsertime-tp6-firefox-google-docs-e10s**
12042        - ❌
12043        - ❌
12044        - ❌
12045        - ❌
12046      * - **browsertime-tp6-firefox-google-docs-fis-e10s**
12047        - ✅
12048        - ✅
12049        - ✅
12050        - ✅
12051      * - **browsertime-tp6-live-chrome-google-docs-e10s**
12052        - ❌
12053        - ❌
12054        - ❌
12055        - ❌
12056      * - **browsertime-tp6-live-chromium-google-docs-e10s**
12057        - ❌
12058        - ❌
12059        - ❌
12060        - ❌
12061      * - **browsertime-tp6-live-firefox-google-docs-e10s**
12062        - ❌
12063        - ❌
12064        - ❌
12065        - ❌
12066      * - **browsertime-tp6-live-firefox-google-docs-fis-e10s**
12067        - ❌
12068        - ❌
12069        - ❌
12070        - ❌
12071
12072
12073   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
12074      :widths: 30 15 15 15 15
12075      :header-rows: 1
12076
12077      * - **Test Name**
12078        - mozilla-central
12079        - autoland
12080        - mozilla-release
12081        - mozilla-beta
12082      * - **browsertime-tp6-chrome-google-docs-e10s**
12083        - ❌
12084        - ❌
12085        - ❌
12086        - ❌
12087      * - **browsertime-tp6-chromium-google-docs-e10s**
12088        - ❌
12089        - ❌
12090        - ❌
12091        - ❌
12092      * - **browsertime-tp6-firefox-google-docs-e10s**
12093        - ❌
12094        - ❌
12095        - ❌
12096        - ❌
12097      * - **browsertime-tp6-firefox-google-docs-fis-e10s**
12098        - ✅
12099        - ✅
12100        - ✅
12101        - ✅
12102      * - **browsertime-tp6-live-chrome-google-docs-e10s**
12103        - ❌
12104        - ❌
12105        - ❌
12106        - ❌
12107      * - **browsertime-tp6-live-chromium-google-docs-e10s**
12108        - ❌
12109        - ❌
12110        - ❌
12111        - ❌
12112      * - **browsertime-tp6-live-firefox-google-docs-e10s**
12113        - ❌
12114        - ❌
12115        - ❌
12116        - ❌
12117      * - **browsertime-tp6-live-firefox-google-docs-fis-e10s**
12118        - ❌
12119        - ❌
12120        - ❌
12121        - ❌
12122
12123
12124   .. list-table:: **test-windows10-32-qr/opt**
12125      :widths: 30 15 15 15 15
12126      :header-rows: 1
12127
12128      * - **Test Name**
12129        - mozilla-central
12130        - autoland
12131        - mozilla-release
12132        - mozilla-beta
12133      * - **browsertime-tp6-firefox-google-docs-e10s**
12134        - ❌
12135        - ❌
12136        - ❌
12137        - ❌
12138      * - **browsertime-tp6-firefox-google-docs-fis-e10s**
12139        - ❌
12140        - ❌
12141        - ❌
12142        - ❌
12143      * - **browsertime-tp6-live-firefox-google-docs-e10s**
12144        - ❌
12145        - ❌
12146        - ❌
12147        - ❌
12148      * - **browsertime-tp6-live-firefox-google-docs-fis-e10s**
12149        - ❌
12150        - ❌
12151        - ❌
12152        - ❌
12153
12154
12155   .. list-table:: **test-windows10-32-shippable-qr/opt**
12156      :widths: 30 15 15 15 15
12157      :header-rows: 1
12158
12159      * - **Test Name**
12160        - mozilla-central
12161        - autoland
12162        - mozilla-release
12163        - mozilla-beta
12164      * - **browsertime-tp6-chrome-google-docs-e10s**
12165        - ❌
12166        - ❌
12167        - ❌
12168        - ❌
12169      * - **browsertime-tp6-chromium-google-docs-e10s**
12170        - ❌
12171        - ❌
12172        - ❌
12173        - ❌
12174      * - **browsertime-tp6-firefox-google-docs-e10s**
12175        - ❌
12176        - ❌
12177        - ❌
12178        - ❌
12179      * - **browsertime-tp6-firefox-google-docs-fis-e10s**
12180        - ❌
12181        - ❌
12182        - ❌
12183        - ❌
12184      * - **browsertime-tp6-live-chrome-google-docs-e10s**
12185        - ❌
12186        - ❌
12187        - ❌
12188        - ❌
12189      * - **browsertime-tp6-live-chromium-google-docs-e10s**
12190        - ❌
12191        - ❌
12192        - ❌
12193        - ❌
12194      * - **browsertime-tp6-live-firefox-google-docs-e10s**
12195        - ❌
12196        - ❌
12197        - ❌
12198        - ❌
12199      * - **browsertime-tp6-live-firefox-google-docs-fis-e10s**
12200        - ❌
12201        - ❌
12202        - ❌
12203        - ❌
12204
12205
12206   .. list-table:: **test-windows10-64-qr/opt**
12207      :widths: 30 15 15 15 15
12208      :header-rows: 1
12209
12210      * - **Test Name**
12211        - mozilla-central
12212        - autoland
12213        - mozilla-release
12214        - mozilla-beta
12215      * - **browsertime-tp6-firefox-google-docs-e10s**
12216        - ❌
12217        - ❌
12218        - ❌
12219        - ❌
12220      * - **browsertime-tp6-firefox-google-docs-fis-e10s**
12221        - ❌
12222        - ❌
12223        - ❌
12224        - ❌
12225      * - **browsertime-tp6-live-firefox-google-docs-e10s**
12226        - ❌
12227        - ❌
12228        - ❌
12229        - ❌
12230      * - **browsertime-tp6-live-firefox-google-docs-fis-e10s**
12231        - ❌
12232        - ❌
12233        - ❌
12234        - ❌
12235
12236
12237   .. list-table:: **test-windows10-64-shippable-qr/opt**
12238      :widths: 30 15 15 15 15
12239      :header-rows: 1
12240
12241      * - **Test Name**
12242        - mozilla-central
12243        - autoland
12244        - mozilla-release
12245        - mozilla-beta
12246      * - **browsertime-tp6-chrome-google-docs-e10s**
12247        - ❌
12248        - ❌
12249        - ❌
12250        - ❌
12251      * - **browsertime-tp6-chromium-google-docs-e10s**
12252        - ❌
12253        - ❌
12254        - ❌
12255        - ❌
12256      * - **browsertime-tp6-firefox-google-docs-e10s**
12257        - ❌
12258        - ❌
12259        - ❌
12260        - ❌
12261      * - **browsertime-tp6-firefox-google-docs-fis-e10s**
12262        - ✅
12263        - ✅
12264        - ✅
12265        - ✅
12266      * - **browsertime-tp6-live-chrome-google-docs-e10s**
12267        - ❌
12268        - ❌
12269        - ❌
12270        - ❌
12271      * - **browsertime-tp6-live-chromium-google-docs-e10s**
12272        - ❌
12273        - ❌
12274        - ❌
12275        - ❌
12276      * - **browsertime-tp6-live-firefox-google-docs-e10s**
12277        - ❌
12278        - ❌
12279        - ❌
12280        - ❌
12281      * - **browsertime-tp6-live-firefox-google-docs-fis-e10s**
12282        - ❌
12283        - ❌
12284        - ❌
12285        - ❌
12286
12287
12288
12289.. dropdown:: google-docs-canvas
12290   :container: + anchor-id-google-docs-canvas-d
12291
12292   **Owner**: PerfTest Team
12293
12294   * **alert on**: fcp, loadtime
12295   * **alert threshold**: 2.0
12296   * **apps**: firefox, chrome, chromium
12297   * **browser cycles**: 25
12298   * **expected**: pass
12299   * **gecko profile entries**: 14000000
12300   * **gecko profile interval**: 1
12301   * **lower is better**: true
12302   * **measure**: fnbpaint, fcp, dcf, loadtime
12303   * **page cycles**: 25
12304   * **page timeout**: 60000
12305   * **playback**: mitmproxy
12306   * **playback pageset manifest**: mitm6-linux-firefox-google-docs-canvas.manifest
12307   * **playback version**: 6.0.2
12308   * **test url**: `<https://docs.google.com/document/d/1vUnn0ePU-ynArE1OdxyEHXR2G0sl74ja_st_4OOzlgE/preview>`__
12309   * **type**: pageload
12310   * **unit**: ms
12311   * **use live sites**: false
12312   * **Test Task**:
12313
12314   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
12315      :widths: 30 15 15 15 15
12316      :header-rows: 1
12317
12318      * - **Test Name**
12319        - mozilla-central
12320        - autoland
12321        - mozilla-release
12322        - mozilla-beta
12323      * - **browsertime-tp6-firefox-google-docs-canvas-e10s**
12324        - ❌
12325        - ❌
12326        - ❌
12327        - ❌
12328      * - **browsertime-tp6-firefox-google-docs-canvas-fis-e10s**
12329        - ❌
12330        - ❌
12331        - ❌
12332        - ❌
12333
12334
12335   .. list-table:: **test-linux1804-64-qr/opt**
12336      :widths: 30 15 15 15 15
12337      :header-rows: 1
12338
12339      * - **Test Name**
12340        - mozilla-central
12341        - autoland
12342        - mozilla-release
12343        - mozilla-beta
12344      * - **browsertime-tp6-firefox-google-docs-canvas-e10s**
12345        - ❌
12346        - ❌
12347        - ❌
12348        - ❌
12349      * - **browsertime-tp6-firefox-google-docs-canvas-fis-e10s**
12350        - ❌
12351        - ❌
12352        - ❌
12353        - ❌
12354
12355
12356   .. list-table:: **test-linux1804-64-shippable-qr/opt**
12357      :widths: 30 15 15 15 15
12358      :header-rows: 1
12359
12360      * - **Test Name**
12361        - mozilla-central
12362        - autoland
12363        - mozilla-release
12364        - mozilla-beta
12365      * - **browsertime-tp6-chrome-google-docs-canvas-e10s**
12366        - ❌
12367        - ❌
12368        - ❌
12369        - ❌
12370      * - **browsertime-tp6-chromium-google-docs-canvas-e10s**
12371        - ❌
12372        - ❌
12373        - ❌
12374        - ❌
12375      * - **browsertime-tp6-firefox-google-docs-canvas-e10s**
12376        - ❌
12377        - ❌
12378        - ❌
12379        - ❌
12380      * - **browsertime-tp6-firefox-google-docs-canvas-fis-e10s**
12381        - ✅
12382        - ✅
12383        - ✅
12384        - ✅
12385
12386
12387   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
12388      :widths: 30 15 15 15 15
12389      :header-rows: 1
12390
12391      * - **Test Name**
12392        - mozilla-central
12393        - autoland
12394        - mozilla-release
12395        - mozilla-beta
12396      * - **browsertime-tp6-chrome-google-docs-canvas-e10s**
12397        - ❌
12398        - ❌
12399        - ❌
12400        - ❌
12401      * - **browsertime-tp6-chromium-google-docs-canvas-e10s**
12402        - ❌
12403        - ❌
12404        - ❌
12405        - ❌
12406      * - **browsertime-tp6-firefox-google-docs-canvas-e10s**
12407        - ❌
12408        - ❌
12409        - ❌
12410        - ❌
12411      * - **browsertime-tp6-firefox-google-docs-canvas-fis-e10s**
12412        - ✅
12413        - ✅
12414        - ✅
12415        - ✅
12416
12417
12418   .. list-table:: **test-windows10-32-qr/opt**
12419      :widths: 30 15 15 15 15
12420      :header-rows: 1
12421
12422      * - **Test Name**
12423        - mozilla-central
12424        - autoland
12425        - mozilla-release
12426        - mozilla-beta
12427      * - **browsertime-tp6-firefox-google-docs-canvas-e10s**
12428        - ❌
12429        - ❌
12430        - ❌
12431        - ❌
12432      * - **browsertime-tp6-firefox-google-docs-canvas-fis-e10s**
12433        - ❌
12434        - ❌
12435        - ❌
12436        - ❌
12437
12438
12439   .. list-table:: **test-windows10-32-shippable-qr/opt**
12440      :widths: 30 15 15 15 15
12441      :header-rows: 1
12442
12443      * - **Test Name**
12444        - mozilla-central
12445        - autoland
12446        - mozilla-release
12447        - mozilla-beta
12448      * - **browsertime-tp6-chrome-google-docs-canvas-e10s**
12449        - ❌
12450        - ❌
12451        - ❌
12452        - ❌
12453      * - **browsertime-tp6-chromium-google-docs-canvas-e10s**
12454        - ❌
12455        - ❌
12456        - ❌
12457        - ❌
12458      * - **browsertime-tp6-firefox-google-docs-canvas-e10s**
12459        - ❌
12460        - ❌
12461        - ❌
12462        - ❌
12463      * - **browsertime-tp6-firefox-google-docs-canvas-fis-e10s**
12464        - ❌
12465        - ❌
12466        - ❌
12467        - ❌
12468
12469
12470   .. list-table:: **test-windows10-64-qr/opt**
12471      :widths: 30 15 15 15 15
12472      :header-rows: 1
12473
12474      * - **Test Name**
12475        - mozilla-central
12476        - autoland
12477        - mozilla-release
12478        - mozilla-beta
12479      * - **browsertime-tp6-firefox-google-docs-canvas-e10s**
12480        - ❌
12481        - ❌
12482        - ❌
12483        - ❌
12484      * - **browsertime-tp6-firefox-google-docs-canvas-fis-e10s**
12485        - ❌
12486        - ❌
12487        - ❌
12488        - ❌
12489
12490
12491   .. list-table:: **test-windows10-64-shippable-qr/opt**
12492      :widths: 30 15 15 15 15
12493      :header-rows: 1
12494
12495      * - **Test Name**
12496        - mozilla-central
12497        - autoland
12498        - mozilla-release
12499        - mozilla-beta
12500      * - **browsertime-tp6-chrome-google-docs-canvas-e10s**
12501        - ❌
12502        - ❌
12503        - ❌
12504        - ❌
12505      * - **browsertime-tp6-chromium-google-docs-canvas-e10s**
12506        - ❌
12507        - ❌
12508        - ❌
12509        - ❌
12510      * - **browsertime-tp6-firefox-google-docs-canvas-e10s**
12511        - ❌
12512        - ❌
12513        - ❌
12514        - ❌
12515      * - **browsertime-tp6-firefox-google-docs-canvas-fis-e10s**
12516        - ✅
12517        - ✅
12518        - ✅
12519        - ✅
12520
12521
12522
12523.. dropdown:: google-mail
12524   :container: + anchor-id-google-mail-d
12525
12526   **Owner**: PerfTest Team
12527
12528   * **alert on**: fcp, loadtime
12529   * **alert threshold**: 2.0
12530   * **apps**: firefox, chrome, chromium
12531   * **browser cycles**: 25
12532   * **expected**: pass
12533   * **gecko profile entries**: 14000000
12534   * **gecko profile interval**: 1
12535   * **lower is better**: true
12536   * **measure**: fnbpaint, fcp, dcf, loadtime
12537   * **page cycles**: 25
12538   * **page timeout**: 60000
12539   * **playback**: mitmproxy
12540   * **playback pageset manifest**: mitm5-linux-firefox-google-mail.manifest
12541   * **playback version**: 5.1.1
12542   * **test url**: `<https://mail.google.com/>`__
12543   * **type**: pageload
12544   * **unit**: ms
12545   * **use live sites**: false
12546   * **Test Task**:
12547
12548   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
12549      :widths: 30 15 15 15 15
12550      :header-rows: 1
12551
12552      * - **Test Name**
12553        - mozilla-central
12554        - autoland
12555        - mozilla-release
12556        - mozilla-beta
12557      * - **browsertime-tp6-firefox-google-mail-e10s**
12558        - ❌
12559        - ❌
12560        - ❌
12561        - ❌
12562      * - **browsertime-tp6-firefox-google-mail-fis-e10s**
12563        - ❌
12564        - ❌
12565        - ❌
12566        - ❌
12567      * - **browsertime-tp6-live-firefox-google-mail-e10s**
12568        - ❌
12569        - ❌
12570        - ❌
12571        - ❌
12572      * - **browsertime-tp6-live-firefox-google-mail-fis-e10s**
12573        - ❌
12574        - ❌
12575        - ❌
12576        - ❌
12577
12578
12579   .. list-table:: **test-linux1804-64-qr/opt**
12580      :widths: 30 15 15 15 15
12581      :header-rows: 1
12582
12583      * - **Test Name**
12584        - mozilla-central
12585        - autoland
12586        - mozilla-release
12587        - mozilla-beta
12588      * - **browsertime-tp6-firefox-google-mail-e10s**
12589        - ❌
12590        - ❌
12591        - ❌
12592        - ❌
12593      * - **browsertime-tp6-firefox-google-mail-fis-e10s**
12594        - ❌
12595        - ❌
12596        - ❌
12597        - ❌
12598      * - **browsertime-tp6-live-firefox-google-mail-e10s**
12599        - ❌
12600        - ❌
12601        - ❌
12602        - ❌
12603      * - **browsertime-tp6-live-firefox-google-mail-fis-e10s**
12604        - ❌
12605        - ❌
12606        - ❌
12607        - ❌
12608
12609
12610   .. list-table:: **test-linux1804-64-shippable-qr/opt**
12611      :widths: 30 15 15 15 15
12612      :header-rows: 1
12613
12614      * - **Test Name**
12615        - mozilla-central
12616        - autoland
12617        - mozilla-release
12618        - mozilla-beta
12619      * - **browsertime-tp6-chrome-google-mail-e10s**
12620        - ❌
12621        - ❌
12622        - ❌
12623        - ❌
12624      * - **browsertime-tp6-chromium-google-mail-e10s**
12625        - ❌
12626        - ❌
12627        - ❌
12628        - ❌
12629      * - **browsertime-tp6-firefox-google-mail-e10s**
12630        - ❌
12631        - ❌
12632        - ❌
12633        - ❌
12634      * - **browsertime-tp6-firefox-google-mail-fis-e10s**
12635        - ✅
12636        - ✅
12637        - ✅
12638        - ✅
12639      * - **browsertime-tp6-live-chrome-google-mail-e10s**
12640        - ❌
12641        - ❌
12642        - ❌
12643        - ❌
12644      * - **browsertime-tp6-live-chromium-google-mail-e10s**
12645        - ❌
12646        - ❌
12647        - ❌
12648        - ❌
12649      * - **browsertime-tp6-live-firefox-google-mail-e10s**
12650        - ❌
12651        - ❌
12652        - ❌
12653        - ❌
12654      * - **browsertime-tp6-live-firefox-google-mail-fis-e10s**
12655        - ❌
12656        - ❌
12657        - ❌
12658        - ❌
12659
12660
12661   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
12662      :widths: 30 15 15 15 15
12663      :header-rows: 1
12664
12665      * - **Test Name**
12666        - mozilla-central
12667        - autoland
12668        - mozilla-release
12669        - mozilla-beta
12670      * - **browsertime-tp6-chrome-google-mail-e10s**
12671        - ❌
12672        - ❌
12673        - ❌
12674        - ❌
12675      * - **browsertime-tp6-chromium-google-mail-e10s**
12676        - ❌
12677        - ❌
12678        - ❌
12679        - ❌
12680      * - **browsertime-tp6-firefox-google-mail-e10s**
12681        - ❌
12682        - ❌
12683        - ❌
12684        - ❌
12685      * - **browsertime-tp6-firefox-google-mail-fis-e10s**
12686        - ✅
12687        - ✅
12688        - ✅
12689        - ✅
12690      * - **browsertime-tp6-live-chrome-google-mail-e10s**
12691        - ❌
12692        - ❌
12693        - ❌
12694        - ❌
12695      * - **browsertime-tp6-live-chromium-google-mail-e10s**
12696        - ❌
12697        - ❌
12698        - ❌
12699        - ❌
12700      * - **browsertime-tp6-live-firefox-google-mail-e10s**
12701        - ❌
12702        - ❌
12703        - ❌
12704        - ❌
12705      * - **browsertime-tp6-live-firefox-google-mail-fis-e10s**
12706        - ❌
12707        - ❌
12708        - ❌
12709        - ❌
12710
12711
12712   .. list-table:: **test-windows10-32-qr/opt**
12713      :widths: 30 15 15 15 15
12714      :header-rows: 1
12715
12716      * - **Test Name**
12717        - mozilla-central
12718        - autoland
12719        - mozilla-release
12720        - mozilla-beta
12721      * - **browsertime-tp6-firefox-google-mail-e10s**
12722        - ❌
12723        - ❌
12724        - ❌
12725        - ❌
12726      * - **browsertime-tp6-firefox-google-mail-fis-e10s**
12727        - ❌
12728        - ❌
12729        - ❌
12730        - ❌
12731      * - **browsertime-tp6-live-firefox-google-mail-e10s**
12732        - ❌
12733        - ❌
12734        - ❌
12735        - ❌
12736      * - **browsertime-tp6-live-firefox-google-mail-fis-e10s**
12737        - ❌
12738        - ❌
12739        - ❌
12740        - ❌
12741
12742
12743   .. list-table:: **test-windows10-32-shippable-qr/opt**
12744      :widths: 30 15 15 15 15
12745      :header-rows: 1
12746
12747      * - **Test Name**
12748        - mozilla-central
12749        - autoland
12750        - mozilla-release
12751        - mozilla-beta
12752      * - **browsertime-tp6-chrome-google-mail-e10s**
12753        - ❌
12754        - ❌
12755        - ❌
12756        - ❌
12757      * - **browsertime-tp6-chromium-google-mail-e10s**
12758        - ❌
12759        - ❌
12760        - ❌
12761        - ❌
12762      * - **browsertime-tp6-firefox-google-mail-e10s**
12763        - ❌
12764        - ❌
12765        - ❌
12766        - ❌
12767      * - **browsertime-tp6-firefox-google-mail-fis-e10s**
12768        - ❌
12769        - ❌
12770        - ❌
12771        - ❌
12772      * - **browsertime-tp6-live-chrome-google-mail-e10s**
12773        - ❌
12774        - ❌
12775        - ❌
12776        - ❌
12777      * - **browsertime-tp6-live-chromium-google-mail-e10s**
12778        - ❌
12779        - ❌
12780        - ❌
12781        - ❌
12782      * - **browsertime-tp6-live-firefox-google-mail-e10s**
12783        - ❌
12784        - ❌
12785        - ❌
12786        - ❌
12787      * - **browsertime-tp6-live-firefox-google-mail-fis-e10s**
12788        - ❌
12789        - ❌
12790        - ❌
12791        - ❌
12792
12793
12794   .. list-table:: **test-windows10-64-qr/opt**
12795      :widths: 30 15 15 15 15
12796      :header-rows: 1
12797
12798      * - **Test Name**
12799        - mozilla-central
12800        - autoland
12801        - mozilla-release
12802        - mozilla-beta
12803      * - **browsertime-tp6-firefox-google-mail-e10s**
12804        - ❌
12805        - ❌
12806        - ❌
12807        - ❌
12808      * - **browsertime-tp6-firefox-google-mail-fis-e10s**
12809        - ❌
12810        - ❌
12811        - ❌
12812        - ❌
12813      * - **browsertime-tp6-live-firefox-google-mail-e10s**
12814        - ❌
12815        - ❌
12816        - ❌
12817        - ❌
12818      * - **browsertime-tp6-live-firefox-google-mail-fis-e10s**
12819        - ❌
12820        - ❌
12821        - ❌
12822        - ❌
12823
12824
12825   .. list-table:: **test-windows10-64-shippable-qr/opt**
12826      :widths: 30 15 15 15 15
12827      :header-rows: 1
12828
12829      * - **Test Name**
12830        - mozilla-central
12831        - autoland
12832        - mozilla-release
12833        - mozilla-beta
12834      * - **browsertime-tp6-chrome-google-mail-e10s**
12835        - ❌
12836        - ❌
12837        - ❌
12838        - ❌
12839      * - **browsertime-tp6-chromium-google-mail-e10s**
12840        - ❌
12841        - ❌
12842        - ❌
12843        - ❌
12844      * - **browsertime-tp6-firefox-google-mail-e10s**
12845        - ❌
12846        - ❌
12847        - ❌
12848        - ❌
12849      * - **browsertime-tp6-firefox-google-mail-fis-e10s**
12850        - ✅
12851        - ✅
12852        - ✅
12853        - ✅
12854      * - **browsertime-tp6-live-chrome-google-mail-e10s**
12855        - ❌
12856        - ❌
12857        - ❌
12858        - ❌
12859      * - **browsertime-tp6-live-chromium-google-mail-e10s**
12860        - ❌
12861        - ❌
12862        - ❌
12863        - ❌
12864      * - **browsertime-tp6-live-firefox-google-mail-e10s**
12865        - ❌
12866        - ❌
12867        - ❌
12868        - ❌
12869      * - **browsertime-tp6-live-firefox-google-mail-fis-e10s**
12870        - ❌
12871        - ❌
12872        - ❌
12873        - ❌
12874
12875
12876
12877.. dropdown:: google-search
12878   :container: + anchor-id-google-search-d
12879
12880   **Owner**: PerfTest Team
12881
12882   * **alert on**: fcp, loadtime
12883   * **alert threshold**: 2.0
12884   * **apps**: firefox, chrome, chromium
12885   * **browser cycles**: 25
12886   * **expected**: pass
12887   * **gecko profile entries**: 14000000
12888   * **gecko profile interval**: 1
12889   * **lower is better**: true
12890   * **measure**: fnbpaint, fcp, dcf, loadtime
12891   * **page cycles**: 25
12892   * **page timeout**: 60000
12893   * **playback**: mitmproxy
12894   * **playback pageset manifest**: mitm5-linux-firefox-google-search.manifest
12895   * **playback version**: 5.1.1
12896   * **test url**: `<https://www.google.com/search?hl=en&q=barack+obama&cad=h>`__
12897   * **type**: pageload
12898   * **unit**: ms
12899   * **use live sites**: false
12900   * **Test Task**:
12901
12902   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
12903      :widths: 30 15 15 15 15
12904      :header-rows: 1
12905
12906      * - **Test Name**
12907        - mozilla-central
12908        - autoland
12909        - mozilla-release
12910        - mozilla-beta
12911      * - **browsertime-tp6-firefox-google-search-e10s**
12912        - ❌
12913        - ❌
12914        - ❌
12915        - ❌
12916      * - **browsertime-tp6-firefox-google-search-fis-e10s**
12917        - ❌
12918        - ❌
12919        - ❌
12920        - ❌
12921      * - **browsertime-tp6-live-firefox-google-search-e10s**
12922        - ❌
12923        - ❌
12924        - ❌
12925        - ❌
12926      * - **browsertime-tp6-live-firefox-google-search-fis-e10s**
12927        - ❌
12928        - ❌
12929        - ❌
12930        - ❌
12931
12932
12933   .. list-table:: **test-linux1804-64-qr/opt**
12934      :widths: 30 15 15 15 15
12935      :header-rows: 1
12936
12937      * - **Test Name**
12938        - mozilla-central
12939        - autoland
12940        - mozilla-release
12941        - mozilla-beta
12942      * - **browsertime-tp6-firefox-google-search-e10s**
12943        - ❌
12944        - ❌
12945        - ❌
12946        - ❌
12947      * - **browsertime-tp6-firefox-google-search-fis-e10s**
12948        - ❌
12949        - ❌
12950        - ❌
12951        - ❌
12952      * - **browsertime-tp6-live-firefox-google-search-e10s**
12953        - ❌
12954        - ❌
12955        - ❌
12956        - ❌
12957      * - **browsertime-tp6-live-firefox-google-search-fis-e10s**
12958        - ❌
12959        - ❌
12960        - ❌
12961        - ❌
12962
12963
12964   .. list-table:: **test-linux1804-64-shippable-qr/opt**
12965      :widths: 30 15 15 15 15
12966      :header-rows: 1
12967
12968      * - **Test Name**
12969        - mozilla-central
12970        - autoland
12971        - mozilla-release
12972        - mozilla-beta
12973      * - **browsertime-tp6-chrome-google-search-e10s**
12974        - ❌
12975        - ❌
12976        - ❌
12977        - ❌
12978      * - **browsertime-tp6-chromium-google-search-e10s**
12979        - ❌
12980        - ❌
12981        - ❌
12982        - ❌
12983      * - **browsertime-tp6-firefox-google-search-e10s**
12984        - ❌
12985        - ❌
12986        - ❌
12987        - ❌
12988      * - **browsertime-tp6-firefox-google-search-fis-e10s**
12989        - ✅
12990        - ✅
12991        - ✅
12992        - ✅
12993      * - **browsertime-tp6-live-chrome-google-search-e10s**
12994        - ❌
12995        - ❌
12996        - ❌
12997        - ❌
12998      * - **browsertime-tp6-live-chromium-google-search-e10s**
12999        - ❌
13000        - ❌
13001        - ❌
13002        - ❌
13003      * - **browsertime-tp6-live-firefox-google-search-e10s**
13004        - ❌
13005        - ❌
13006        - ❌
13007        - ❌
13008      * - **browsertime-tp6-live-firefox-google-search-fis-e10s**
13009        - ❌
13010        - ❌
13011        - ❌
13012        - ❌
13013
13014
13015   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
13016      :widths: 30 15 15 15 15
13017      :header-rows: 1
13018
13019      * - **Test Name**
13020        - mozilla-central
13021        - autoland
13022        - mozilla-release
13023        - mozilla-beta
13024      * - **browsertime-tp6-chrome-google-search-e10s**
13025        - ❌
13026        - ❌
13027        - ❌
13028        - ❌
13029      * - **browsertime-tp6-chromium-google-search-e10s**
13030        - ❌
13031        - ❌
13032        - ❌
13033        - ❌
13034      * - **browsertime-tp6-firefox-google-search-e10s**
13035        - ❌
13036        - ❌
13037        - ❌
13038        - ❌
13039      * - **browsertime-tp6-firefox-google-search-fis-e10s**
13040        - ✅
13041        - ✅
13042        - ✅
13043        - ✅
13044      * - **browsertime-tp6-live-chrome-google-search-e10s**
13045        - ❌
13046        - ❌
13047        - ❌
13048        - ❌
13049      * - **browsertime-tp6-live-chromium-google-search-e10s**
13050        - ❌
13051        - ❌
13052        - ❌
13053        - ❌
13054      * - **browsertime-tp6-live-firefox-google-search-e10s**
13055        - ❌
13056        - ❌
13057        - ❌
13058        - ❌
13059      * - **browsertime-tp6-live-firefox-google-search-fis-e10s**
13060        - ❌
13061        - ❌
13062        - ❌
13063        - ❌
13064
13065
13066   .. list-table:: **test-windows10-32-qr/opt**
13067      :widths: 30 15 15 15 15
13068      :header-rows: 1
13069
13070      * - **Test Name**
13071        - mozilla-central
13072        - autoland
13073        - mozilla-release
13074        - mozilla-beta
13075      * - **browsertime-tp6-firefox-google-search-e10s**
13076        - ❌
13077        - ❌
13078        - ❌
13079        - ❌
13080      * - **browsertime-tp6-firefox-google-search-fis-e10s**
13081        - ❌
13082        - ❌
13083        - ❌
13084        - ❌
13085      * - **browsertime-tp6-live-firefox-google-search-e10s**
13086        - ❌
13087        - ❌
13088        - ❌
13089        - ❌
13090      * - **browsertime-tp6-live-firefox-google-search-fis-e10s**
13091        - ❌
13092        - ❌
13093        - ❌
13094        - ❌
13095
13096
13097   .. list-table:: **test-windows10-32-shippable-qr/opt**
13098      :widths: 30 15 15 15 15
13099      :header-rows: 1
13100
13101      * - **Test Name**
13102        - mozilla-central
13103        - autoland
13104        - mozilla-release
13105        - mozilla-beta
13106      * - **browsertime-tp6-chrome-google-search-e10s**
13107        - ❌
13108        - ❌
13109        - ❌
13110        - ❌
13111      * - **browsertime-tp6-chromium-google-search-e10s**
13112        - ❌
13113        - ❌
13114        - ❌
13115        - ❌
13116      * - **browsertime-tp6-firefox-google-search-e10s**
13117        - ❌
13118        - ❌
13119        - ❌
13120        - ❌
13121      * - **browsertime-tp6-firefox-google-search-fis-e10s**
13122        - ❌
13123        - ❌
13124        - ❌
13125        - ❌
13126      * - **browsertime-tp6-live-chrome-google-search-e10s**
13127        - ❌
13128        - ❌
13129        - ❌
13130        - ❌
13131      * - **browsertime-tp6-live-chromium-google-search-e10s**
13132        - ❌
13133        - ❌
13134        - ❌
13135        - ❌
13136      * - **browsertime-tp6-live-firefox-google-search-e10s**
13137        - ❌
13138        - ❌
13139        - ❌
13140        - ❌
13141      * - **browsertime-tp6-live-firefox-google-search-fis-e10s**
13142        - ❌
13143        - ❌
13144        - ❌
13145        - ❌
13146
13147
13148   .. list-table:: **test-windows10-64-qr/opt**
13149      :widths: 30 15 15 15 15
13150      :header-rows: 1
13151
13152      * - **Test Name**
13153        - mozilla-central
13154        - autoland
13155        - mozilla-release
13156        - mozilla-beta
13157      * - **browsertime-tp6-firefox-google-search-e10s**
13158        - ❌
13159        - ❌
13160        - ❌
13161        - ❌
13162      * - **browsertime-tp6-firefox-google-search-fis-e10s**
13163        - ❌
13164        - ❌
13165        - ❌
13166        - ❌
13167      * - **browsertime-tp6-live-firefox-google-search-e10s**
13168        - ❌
13169        - ❌
13170        - ❌
13171        - ❌
13172      * - **browsertime-tp6-live-firefox-google-search-fis-e10s**
13173        - ❌
13174        - ❌
13175        - ❌
13176        - ❌
13177
13178
13179   .. list-table:: **test-windows10-64-shippable-qr/opt**
13180      :widths: 30 15 15 15 15
13181      :header-rows: 1
13182
13183      * - **Test Name**
13184        - mozilla-central
13185        - autoland
13186        - mozilla-release
13187        - mozilla-beta
13188      * - **browsertime-tp6-chrome-google-search-e10s**
13189        - ❌
13190        - ❌
13191        - ❌
13192        - ❌
13193      * - **browsertime-tp6-chromium-google-search-e10s**
13194        - ❌
13195        - ❌
13196        - ❌
13197        - ❌
13198      * - **browsertime-tp6-firefox-google-search-e10s**
13199        - ❌
13200        - ❌
13201        - ❌
13202        - ❌
13203      * - **browsertime-tp6-firefox-google-search-fis-e10s**
13204        - ✅
13205        - ✅
13206        - ✅
13207        - ✅
13208      * - **browsertime-tp6-live-chrome-google-search-e10s**
13209        - ❌
13210        - ❌
13211        - ❌
13212        - ❌
13213      * - **browsertime-tp6-live-chromium-google-search-e10s**
13214        - ❌
13215        - ❌
13216        - ❌
13217        - ❌
13218      * - **browsertime-tp6-live-firefox-google-search-e10s**
13219        - ❌
13220        - ❌
13221        - ❌
13222        - ❌
13223      * - **browsertime-tp6-live-firefox-google-search-fis-e10s**
13224        - ❌
13225        - ❌
13226        - ❌
13227        - ❌
13228
13229
13230
13231.. dropdown:: google-slides
13232   :container: + anchor-id-google-slides-d
13233
13234   **Owner**: PerfTest Team
13235
13236   * **alert on**: fcp, loadtime
13237   * **alert threshold**: 2.0
13238   * **apps**: firefox, chrome, chromium
13239   * **browser cycles**: 25
13240   * **expected**: pass
13241   * **gecko profile entries**: 14000000
13242   * **gecko profile interval**: 1
13243   * **lower is better**: true
13244   * **measure**: fnbpaint, fcp, dcf, loadtime
13245   * **page cycles**: 25
13246   * **page timeout**: 60000
13247   * **playback**: mitmproxy
13248   * **playback pageset manifest**: mitm6-linux-firefox-google-slides.manifest
13249   * **playback version**: 6.0.2
13250   * **secondary url**: `<https://docs.google.com/document/d/1vUnn0ePU-ynArE1OdxyEHXR2G0sl74ja_st_4OOzlgE/preview>`__
13251   * **test url**: `<https://docs.google.com/presentation/d/1Ici0ceWwpFvmIb3EmKeWSq_vAQdmmdFcWqaiLqUkJng/edit?usp=sharing>`__
13252   * **type**: pageload
13253   * **unit**: ms
13254   * **use live sites**: false
13255   * **Test Task**:
13256
13257   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
13258      :widths: 30 15 15 15 15
13259      :header-rows: 1
13260
13261      * - **Test Name**
13262        - mozilla-central
13263        - autoland
13264        - mozilla-release
13265        - mozilla-beta
13266      * - **browsertime-tp6-essential-firefox-google-slides-e10s**
13267        - ❌
13268        - ❌
13269        - ❌
13270        - ❌
13271      * - **browsertime-tp6-essential-firefox-google-slides-fis-e10s**
13272        - ❌
13273        - ❌
13274        - ❌
13275        - ❌
13276      * - **browsertime-tp6-live-firefox-google-slides-e10s**
13277        - ❌
13278        - ❌
13279        - ❌
13280        - ❌
13281      * - **browsertime-tp6-live-firefox-google-slides-fis-e10s**
13282        - ❌
13283        - ❌
13284        - ❌
13285        - ❌
13286
13287
13288   .. list-table:: **test-linux1804-64-qr/opt**
13289      :widths: 30 15 15 15 15
13290      :header-rows: 1
13291
13292      * - **Test Name**
13293        - mozilla-central
13294        - autoland
13295        - mozilla-release
13296        - mozilla-beta
13297      * - **browsertime-tp6-essential-firefox-google-slides-e10s**
13298        - ❌
13299        - ❌
13300        - ❌
13301        - ❌
13302      * - **browsertime-tp6-essential-firefox-google-slides-fis-e10s**
13303        - ❌
13304        - ❌
13305        - ❌
13306        - ❌
13307      * - **browsertime-tp6-live-firefox-google-slides-e10s**
13308        - ❌
13309        - ❌
13310        - ❌
13311        - ❌
13312      * - **browsertime-tp6-live-firefox-google-slides-fis-e10s**
13313        - ❌
13314        - ❌
13315        - ❌
13316        - ❌
13317
13318
13319   .. list-table:: **test-linux1804-64-shippable-qr/opt**
13320      :widths: 30 15 15 15 15
13321      :header-rows: 1
13322
13323      * - **Test Name**
13324        - mozilla-central
13325        - autoland
13326        - mozilla-release
13327        - mozilla-beta
13328      * - **browsertime-tp6-essential-chrome-google-slides-e10s**
13329        - ❌
13330        - ❌
13331        - ❌
13332        - ❌
13333      * - **browsertime-tp6-essential-chromium-google-slides-e10s**
13334        - ❌
13335        - ❌
13336        - ❌
13337        - ❌
13338      * - **browsertime-tp6-essential-firefox-google-slides-e10s**
13339        - ❌
13340        - ❌
13341        - ❌
13342        - ❌
13343      * - **browsertime-tp6-essential-firefox-google-slides-fis-e10s**
13344        - ✅
13345        - ✅
13346        - ✅
13347        - ✅
13348      * - **browsertime-tp6-live-chrome-google-slides-e10s**
13349        - ❌
13350        - ❌
13351        - ❌
13352        - ❌
13353      * - **browsertime-tp6-live-chromium-google-slides-e10s**
13354        - ❌
13355        - ❌
13356        - ❌
13357        - ❌
13358      * - **browsertime-tp6-live-firefox-google-slides-e10s**
13359        - ❌
13360        - ❌
13361        - ❌
13362        - ❌
13363      * - **browsertime-tp6-live-firefox-google-slides-fis-e10s**
13364        - ❌
13365        - ❌
13366        - ❌
13367        - ❌
13368
13369
13370   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
13371      :widths: 30 15 15 15 15
13372      :header-rows: 1
13373
13374      * - **Test Name**
13375        - mozilla-central
13376        - autoland
13377        - mozilla-release
13378        - mozilla-beta
13379      * - **browsertime-tp6-essential-chrome-google-slides-e10s**
13380        - ❌
13381        - ❌
13382        - ❌
13383        - ❌
13384      * - **browsertime-tp6-essential-chromium-google-slides-e10s**
13385        - ❌
13386        - ❌
13387        - ❌
13388        - ❌
13389      * - **browsertime-tp6-essential-firefox-google-slides-e10s**
13390        - ❌
13391        - ❌
13392        - ❌
13393        - ❌
13394      * - **browsertime-tp6-essential-firefox-google-slides-fis-e10s**
13395        - ✅
13396        - ✅
13397        - ✅
13398        - ✅
13399      * - **browsertime-tp6-live-chrome-google-slides-e10s**
13400        - ❌
13401        - ❌
13402        - ❌
13403        - ❌
13404      * - **browsertime-tp6-live-chromium-google-slides-e10s**
13405        - ❌
13406        - ❌
13407        - ❌
13408        - ❌
13409      * - **browsertime-tp6-live-firefox-google-slides-e10s**
13410        - ❌
13411        - ❌
13412        - ❌
13413        - ❌
13414      * - **browsertime-tp6-live-firefox-google-slides-fis-e10s**
13415        - ❌
13416        - ❌
13417        - ❌
13418        - ❌
13419
13420
13421   .. list-table:: **test-windows10-32-qr/opt**
13422      :widths: 30 15 15 15 15
13423      :header-rows: 1
13424
13425      * - **Test Name**
13426        - mozilla-central
13427        - autoland
13428        - mozilla-release
13429        - mozilla-beta
13430      * - **browsertime-tp6-essential-firefox-google-slides-e10s**
13431        - ❌
13432        - ❌
13433        - ❌
13434        - ❌
13435      * - **browsertime-tp6-essential-firefox-google-slides-fis-e10s**
13436        - ❌
13437        - ❌
13438        - ❌
13439        - ❌
13440      * - **browsertime-tp6-live-firefox-google-slides-e10s**
13441        - ❌
13442        - ❌
13443        - ❌
13444        - ❌
13445      * - **browsertime-tp6-live-firefox-google-slides-fis-e10s**
13446        - ❌
13447        - ❌
13448        - ❌
13449        - ❌
13450
13451
13452   .. list-table:: **test-windows10-32-shippable-qr/opt**
13453      :widths: 30 15 15 15 15
13454      :header-rows: 1
13455
13456      * - **Test Name**
13457        - mozilla-central
13458        - autoland
13459        - mozilla-release
13460        - mozilla-beta
13461      * - **browsertime-tp6-essential-chrome-google-slides-e10s**
13462        - ❌
13463        - ❌
13464        - ❌
13465        - ❌
13466      * - **browsertime-tp6-essential-chromium-google-slides-e10s**
13467        - ❌
13468        - ❌
13469        - ❌
13470        - ❌
13471      * - **browsertime-tp6-essential-firefox-google-slides-e10s**
13472        - ❌
13473        - ❌
13474        - ❌
13475        - ❌
13476      * - **browsertime-tp6-essential-firefox-google-slides-fis-e10s**
13477        - ❌
13478        - ❌
13479        - ❌
13480        - ❌
13481      * - **browsertime-tp6-live-chrome-google-slides-e10s**
13482        - ❌
13483        - ❌
13484        - ❌
13485        - ❌
13486      * - **browsertime-tp6-live-chromium-google-slides-e10s**
13487        - ❌
13488        - ❌
13489        - ❌
13490        - ❌
13491      * - **browsertime-tp6-live-firefox-google-slides-e10s**
13492        - ❌
13493        - ❌
13494        - ❌
13495        - ❌
13496      * - **browsertime-tp6-live-firefox-google-slides-fis-e10s**
13497        - ❌
13498        - ❌
13499        - ❌
13500        - ❌
13501
13502
13503   .. list-table:: **test-windows10-64-qr/opt**
13504      :widths: 30 15 15 15 15
13505      :header-rows: 1
13506
13507      * - **Test Name**
13508        - mozilla-central
13509        - autoland
13510        - mozilla-release
13511        - mozilla-beta
13512      * - **browsertime-tp6-essential-firefox-google-slides-e10s**
13513        - ❌
13514        - ❌
13515        - ❌
13516        - ❌
13517      * - **browsertime-tp6-essential-firefox-google-slides-fis-e10s**
13518        - ❌
13519        - ❌
13520        - ❌
13521        - ❌
13522      * - **browsertime-tp6-live-firefox-google-slides-e10s**
13523        - ❌
13524        - ❌
13525        - ❌
13526        - ❌
13527      * - **browsertime-tp6-live-firefox-google-slides-fis-e10s**
13528        - ❌
13529        - ❌
13530        - ❌
13531        - ❌
13532
13533
13534   .. list-table:: **test-windows10-64-shippable-qr/opt**
13535      :widths: 30 15 15 15 15
13536      :header-rows: 1
13537
13538      * - **Test Name**
13539        - mozilla-central
13540        - autoland
13541        - mozilla-release
13542        - mozilla-beta
13543      * - **browsertime-tp6-essential-chrome-google-slides-e10s**
13544        - ❌
13545        - ❌
13546        - ❌
13547        - ❌
13548      * - **browsertime-tp6-essential-chromium-google-slides-e10s**
13549        - ❌
13550        - ❌
13551        - ❌
13552        - ❌
13553      * - **browsertime-tp6-essential-firefox-google-slides-e10s**
13554        - ❌
13555        - ❌
13556        - ❌
13557        - ❌
13558      * - **browsertime-tp6-essential-firefox-google-slides-fis-e10s**
13559        - ✅
13560        - ✅
13561        - ✅
13562        - ✅
13563      * - **browsertime-tp6-live-chrome-google-slides-e10s**
13564        - ❌
13565        - ❌
13566        - ❌
13567        - ❌
13568      * - **browsertime-tp6-live-chromium-google-slides-e10s**
13569        - ❌
13570        - ❌
13571        - ❌
13572        - ❌
13573      * - **browsertime-tp6-live-firefox-google-slides-e10s**
13574        - ❌
13575        - ❌
13576        - ❌
13577        - ❌
13578      * - **browsertime-tp6-live-firefox-google-slides-fis-e10s**
13579        - ❌
13580        - ❌
13581        - ❌
13582        - ❌
13583
13584
13585
13586.. dropdown:: imdb
13587   :container: + anchor-id-imdb-d
13588
13589   **Owner**: PerfTest Team
13590
13591   * **alert on**: fcp, loadtime
13592   * **alert threshold**: 2.0
13593   * **apps**: firefox, chrome, chromium
13594   * **browser cycles**: 25
13595   * **expected**: pass
13596   * **gecko profile entries**: 14000000
13597   * **gecko profile interval**: 1
13598   * **lower is better**: true
13599   * **measure**: fnbpaint, fcp, dcf, loadtime
13600   * **page cycles**: 25
13601   * **page timeout**: 60000
13602   * **playback**: mitmproxy
13603   * **playback pageset manifest**: mitm7-linux-firefox-imdb.manifest
13604   * **playback version**: 7.0.4
13605   * **secondary url**: `<https://www.imdb.com/title/tt0084967/episodes/?ref_=tt_ov_epl>`__
13606   * **test url**: `<https://www.imdb.com/title/tt0084967/?ref_=nv_sr_2>`__
13607   * **type**: pageload
13608   * **unit**: ms
13609   * **use live sites**: false
13610   * **Test Task**:
13611
13612   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
13613      :widths: 30 15 15 15 15
13614      :header-rows: 1
13615
13616      * - **Test Name**
13617        - mozilla-central
13618        - autoland
13619        - mozilla-release
13620        - mozilla-beta
13621      * - **browsertime-tp6m-fenix-imdb-e10s**
13622        - ❌
13623        - ❌
13624        - ❌
13625        - ❌
13626      * - **browsertime-tp6m-geckoview-imdb-e10s**
13627        - ❌
13628        - ❌
13629        - ❌
13630        - ❌
13631      * - **browsertime-tp6m-live-fenix-imdb-e10s**
13632        - ❌
13633        - ❌
13634        - ❌
13635        - ❌
13636      * - **browsertime-tp6m-live-geckoview-imdb-e10s**
13637        - ❌
13638        - ❌
13639        - ❌
13640        - ❌
13641      * - **browsertime-tp6m-refbrow-imdb-e10s**
13642        - ❌
13643        - ❌
13644        - ❌
13645        - ❌
13646
13647
13648   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
13649      :widths: 30 15 15 15 15
13650      :header-rows: 1
13651
13652      * - **Test Name**
13653        - mozilla-central
13654        - autoland
13655        - mozilla-release
13656        - mozilla-beta
13657      * - **browsertime-tp6m-chrome-m-imdb-e10s**
13658        - ❌
13659        - ❌
13660        - ❌
13661        - ❌
13662      * - **browsertime-tp6m-fenix-imdb-e10s**
13663        - ❌
13664        - ❌
13665        - ❌
13666        - ❌
13667      * - **browsertime-tp6m-geckoview-imdb-e10s**
13668        - ✅
13669        - ✅
13670        - ✅
13671        - ✅
13672      * - **browsertime-tp6m-live-chrome-m-imdb-e10s**
13673        - ❌
13674        - ❌
13675        - ❌
13676        - ❌
13677      * - **browsertime-tp6m-live-fenix-imdb-e10s**
13678        - ❌
13679        - ❌
13680        - ❌
13681        - ❌
13682      * - **browsertime-tp6m-live-geckoview-imdb-e10s**
13683        - ❌
13684        - ❌
13685        - ❌
13686        - ❌
13687      * - **browsertime-tp6m-refbrow-imdb-e10s**
13688        - ❌
13689        - ❌
13690        - ❌
13691        - ❌
13692
13693
13694   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
13695      :widths: 30 15 15 15 15
13696      :header-rows: 1
13697
13698      * - **Test Name**
13699        - mozilla-central
13700        - autoland
13701        - mozilla-release
13702        - mozilla-beta
13703      * - **browsertime-tp6m-fenix-imdb-e10s**
13704        - ❌
13705        - ❌
13706        - ❌
13707        - ❌
13708      * - **browsertime-tp6m-geckoview-imdb-e10s**
13709        - ❌
13710        - ❌
13711        - ❌
13712        - ❌
13713      * - **browsertime-tp6m-live-fenix-imdb-e10s**
13714        - ❌
13715        - ❌
13716        - ❌
13717        - ❌
13718      * - **browsertime-tp6m-live-geckoview-imdb-e10s**
13719        - ❌
13720        - ❌
13721        - ❌
13722        - ❌
13723      * - **browsertime-tp6m-refbrow-imdb-e10s**
13724        - ❌
13725        - ❌
13726        - ❌
13727        - ❌
13728
13729
13730   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
13731      :widths: 30 15 15 15 15
13732      :header-rows: 1
13733
13734      * - **Test Name**
13735        - mozilla-central
13736        - autoland
13737        - mozilla-release
13738        - mozilla-beta
13739      * - **browsertime-tp6m-chrome-m-imdb-e10s**
13740        - ❌
13741        - ❌
13742        - ❌
13743        - ❌
13744      * - **browsertime-tp6m-fenix-imdb-e10s**
13745        - ❌
13746        - ❌
13747        - ❌
13748        - ❌
13749      * - **browsertime-tp6m-geckoview-imdb-e10s**
13750        - ✅
13751        - ✅
13752        - ✅
13753        - ✅
13754      * - **browsertime-tp6m-live-chrome-m-imdb-e10s**
13755        - ❌
13756        - ❌
13757        - ❌
13758        - ❌
13759      * - **browsertime-tp6m-live-fenix-imdb-e10s**
13760        - ❌
13761        - ❌
13762        - ❌
13763        - ❌
13764      * - **browsertime-tp6m-live-geckoview-imdb-e10s**
13765        - ❌
13766        - ❌
13767        - ❌
13768        - ❌
13769      * - **browsertime-tp6m-refbrow-imdb-e10s**
13770        - ❌
13771        - ❌
13772        - ❌
13773        - ❌
13774
13775
13776   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
13777      :widths: 30 15 15 15 15
13778      :header-rows: 1
13779
13780      * - **Test Name**
13781        - mozilla-central
13782        - autoland
13783        - mozilla-release
13784        - mozilla-beta
13785      * - **browsertime-tp6m-fenix-imdb-e10s**
13786        - ❌
13787        - ❌
13788        - ❌
13789        - ❌
13790      * - **browsertime-tp6m-geckoview-imdb-e10s**
13791        - ❌
13792        - ❌
13793        - ❌
13794        - ❌
13795      * - **browsertime-tp6m-live-fenix-imdb-e10s**
13796        - ❌
13797        - ❌
13798        - ❌
13799        - ❌
13800      * - **browsertime-tp6m-live-geckoview-imdb-e10s**
13801        - ❌
13802        - ❌
13803        - ❌
13804        - ❌
13805      * - **browsertime-tp6m-refbrow-imdb-e10s**
13806        - ❌
13807        - ❌
13808        - ❌
13809        - ❌
13810
13811
13812   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
13813      :widths: 30 15 15 15 15
13814      :header-rows: 1
13815
13816      * - **Test Name**
13817        - mozilla-central
13818        - autoland
13819        - mozilla-release
13820        - mozilla-beta
13821      * - **browsertime-tp6m-chrome-m-imdb-e10s**
13822        - ❌
13823        - ❌
13824        - ❌
13825        - ❌
13826      * - **browsertime-tp6m-fenix-imdb-e10s**
13827        - ❌
13828        - ❌
13829        - ❌
13830        - ❌
13831      * - **browsertime-tp6m-geckoview-imdb-e10s**
13832        - ❌
13833        - ❌
13834        - ❌
13835        - ❌
13836      * - **browsertime-tp6m-live-chrome-m-imdb-e10s**
13837        - ❌
13838        - ❌
13839        - ❌
13840        - ❌
13841      * - **browsertime-tp6m-live-fenix-imdb-e10s**
13842        - ❌
13843        - ❌
13844        - ❌
13845        - ❌
13846      * - **browsertime-tp6m-live-geckoview-imdb-e10s**
13847        - ❌
13848        - ❌
13849        - ❌
13850        - ❌
13851      * - **browsertime-tp6m-refbrow-imdb-e10s**
13852        - ❌
13853        - ❌
13854        - ❌
13855        - ❌
13856
13857
13858   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
13859      :widths: 30 15 15 15 15
13860      :header-rows: 1
13861
13862      * - **Test Name**
13863        - mozilla-central
13864        - autoland
13865        - mozilla-release
13866        - mozilla-beta
13867      * - **browsertime-tp6m-fenix-imdb-e10s**
13868        - ❌
13869        - ❌
13870        - ❌
13871        - ❌
13872      * - **browsertime-tp6m-geckoview-imdb-e10s**
13873        - ❌
13874        - ❌
13875        - ❌
13876        - ❌
13877      * - **browsertime-tp6m-live-fenix-imdb-e10s**
13878        - ❌
13879        - ❌
13880        - ❌
13881        - ❌
13882      * - **browsertime-tp6m-live-geckoview-imdb-e10s**
13883        - ❌
13884        - ❌
13885        - ❌
13886        - ❌
13887      * - **browsertime-tp6m-refbrow-imdb-e10s**
13888        - ❌
13889        - ❌
13890        - ❌
13891        - ❌
13892
13893
13894   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
13895      :widths: 30 15 15 15 15
13896      :header-rows: 1
13897
13898      * - **Test Name**
13899        - mozilla-central
13900        - autoland
13901        - mozilla-release
13902        - mozilla-beta
13903      * - **browsertime-tp6m-chrome-m-imdb-e10s**
13904        - ❌
13905        - ❌
13906        - ❌
13907        - ❌
13908      * - **browsertime-tp6m-fenix-imdb-e10s**
13909        - ❌
13910        - ❌
13911        - ❌
13912        - ❌
13913      * - **browsertime-tp6m-geckoview-imdb-e10s**
13914        - ❌
13915        - ❌
13916        - ❌
13917        - ❌
13918      * - **browsertime-tp6m-live-chrome-m-imdb-e10s**
13919        - ❌
13920        - ❌
13921        - ❌
13922        - ❌
13923      * - **browsertime-tp6m-live-fenix-imdb-e10s**
13924        - ❌
13925        - ❌
13926        - ❌
13927        - ❌
13928      * - **browsertime-tp6m-live-geckoview-imdb-e10s**
13929        - ❌
13930        - ❌
13931        - ❌
13932        - ❌
13933      * - **browsertime-tp6m-refbrow-imdb-e10s**
13934        - ❌
13935        - ❌
13936        - ❌
13937        - ❌
13938
13939
13940   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
13941      :widths: 30 15 15 15 15
13942      :header-rows: 1
13943
13944      * - **Test Name**
13945        - mozilla-central
13946        - autoland
13947        - mozilla-release
13948        - mozilla-beta
13949      * - **browsertime-tp6-firefox-imdb-e10s**
13950        - ❌
13951        - ❌
13952        - ❌
13953        - ❌
13954      * - **browsertime-tp6-firefox-imdb-fis-e10s**
13955        - ❌
13956        - ❌
13957        - ❌
13958        - ❌
13959      * - **browsertime-tp6-live-firefox-imdb-e10s**
13960        - ❌
13961        - ❌
13962        - ❌
13963        - ❌
13964      * - **browsertime-tp6-live-firefox-imdb-fis-e10s**
13965        - ❌
13966        - ❌
13967        - ❌
13968        - ❌
13969
13970
13971   .. list-table:: **test-linux1804-64-qr/opt**
13972      :widths: 30 15 15 15 15
13973      :header-rows: 1
13974
13975      * - **Test Name**
13976        - mozilla-central
13977        - autoland
13978        - mozilla-release
13979        - mozilla-beta
13980      * - **browsertime-tp6-firefox-imdb-e10s**
13981        - ❌
13982        - ❌
13983        - ❌
13984        - ❌
13985      * - **browsertime-tp6-firefox-imdb-fis-e10s**
13986        - ❌
13987        - ❌
13988        - ❌
13989        - ❌
13990      * - **browsertime-tp6-live-firefox-imdb-e10s**
13991        - ❌
13992        - ❌
13993        - ❌
13994        - ❌
13995      * - **browsertime-tp6-live-firefox-imdb-fis-e10s**
13996        - ❌
13997        - ❌
13998        - ❌
13999        - ❌
14000
14001
14002   .. list-table:: **test-linux1804-64-shippable-qr/opt**
14003      :widths: 30 15 15 15 15
14004      :header-rows: 1
14005
14006      * - **Test Name**
14007        - mozilla-central
14008        - autoland
14009        - mozilla-release
14010        - mozilla-beta
14011      * - **browsertime-tp6-chrome-imdb-e10s**
14012        - ❌
14013        - ❌
14014        - ❌
14015        - ❌
14016      * - **browsertime-tp6-chromium-imdb-e10s**
14017        - ❌
14018        - ❌
14019        - ❌
14020        - ❌
14021      * - **browsertime-tp6-firefox-imdb-e10s**
14022        - ❌
14023        - ❌
14024        - ❌
14025        - ❌
14026      * - **browsertime-tp6-firefox-imdb-fis-e10s**
14027        - ✅
14028        - ✅
14029        - ✅
14030        - ✅
14031      * - **browsertime-tp6-live-chrome-imdb-e10s**
14032        - ❌
14033        - ❌
14034        - ❌
14035        - ❌
14036      * - **browsertime-tp6-live-chromium-imdb-e10s**
14037        - ❌
14038        - ❌
14039        - ❌
14040        - ❌
14041      * - **browsertime-tp6-live-firefox-imdb-e10s**
14042        - ❌
14043        - ❌
14044        - ❌
14045        - ❌
14046      * - **browsertime-tp6-live-firefox-imdb-fis-e10s**
14047        - ❌
14048        - ❌
14049        - ❌
14050        - ❌
14051
14052
14053   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
14054      :widths: 30 15 15 15 15
14055      :header-rows: 1
14056
14057      * - **Test Name**
14058        - mozilla-central
14059        - autoland
14060        - mozilla-release
14061        - mozilla-beta
14062      * - **browsertime-tp6-chrome-imdb-e10s**
14063        - ❌
14064        - ❌
14065        - ❌
14066        - ❌
14067      * - **browsertime-tp6-chromium-imdb-e10s**
14068        - ❌
14069        - ❌
14070        - ❌
14071        - ❌
14072      * - **browsertime-tp6-firefox-imdb-e10s**
14073        - ❌
14074        - ❌
14075        - ❌
14076        - ❌
14077      * - **browsertime-tp6-firefox-imdb-fis-e10s**
14078        - ✅
14079        - ✅
14080        - ✅
14081        - ✅
14082      * - **browsertime-tp6-live-chrome-imdb-e10s**
14083        - ❌
14084        - ❌
14085        - ❌
14086        - ❌
14087      * - **browsertime-tp6-live-chromium-imdb-e10s**
14088        - ❌
14089        - ❌
14090        - ❌
14091        - ❌
14092      * - **browsertime-tp6-live-firefox-imdb-e10s**
14093        - ❌
14094        - ❌
14095        - ❌
14096        - ❌
14097      * - **browsertime-tp6-live-firefox-imdb-fis-e10s**
14098        - ❌
14099        - ❌
14100        - ❌
14101        - ❌
14102
14103
14104   .. list-table:: **test-windows10-32-qr/opt**
14105      :widths: 30 15 15 15 15
14106      :header-rows: 1
14107
14108      * - **Test Name**
14109        - mozilla-central
14110        - autoland
14111        - mozilla-release
14112        - mozilla-beta
14113      * - **browsertime-tp6-firefox-imdb-e10s**
14114        - ❌
14115        - ❌
14116        - ❌
14117        - ❌
14118      * - **browsertime-tp6-firefox-imdb-fis-e10s**
14119        - ❌
14120        - ❌
14121        - ❌
14122        - ❌
14123      * - **browsertime-tp6-live-firefox-imdb-e10s**
14124        - ❌
14125        - ❌
14126        - ❌
14127        - ❌
14128      * - **browsertime-tp6-live-firefox-imdb-fis-e10s**
14129        - ❌
14130        - ❌
14131        - ❌
14132        - ❌
14133
14134
14135   .. list-table:: **test-windows10-32-shippable-qr/opt**
14136      :widths: 30 15 15 15 15
14137      :header-rows: 1
14138
14139      * - **Test Name**
14140        - mozilla-central
14141        - autoland
14142        - mozilla-release
14143        - mozilla-beta
14144      * - **browsertime-tp6-chrome-imdb-e10s**
14145        - ❌
14146        - ❌
14147        - ❌
14148        - ❌
14149      * - **browsertime-tp6-chromium-imdb-e10s**
14150        - ❌
14151        - ❌
14152        - ❌
14153        - ❌
14154      * - **browsertime-tp6-firefox-imdb-e10s**
14155        - ❌
14156        - ❌
14157        - ❌
14158        - ❌
14159      * - **browsertime-tp6-firefox-imdb-fis-e10s**
14160        - ❌
14161        - ❌
14162        - ❌
14163        - ❌
14164      * - **browsertime-tp6-live-chrome-imdb-e10s**
14165        - ❌
14166        - ❌
14167        - ❌
14168        - ❌
14169      * - **browsertime-tp6-live-chromium-imdb-e10s**
14170        - ❌
14171        - ❌
14172        - ❌
14173        - ❌
14174      * - **browsertime-tp6-live-firefox-imdb-e10s**
14175        - ❌
14176        - ❌
14177        - ❌
14178        - ❌
14179      * - **browsertime-tp6-live-firefox-imdb-fis-e10s**
14180        - ❌
14181        - ❌
14182        - ❌
14183        - ❌
14184
14185
14186   .. list-table:: **test-windows10-64-qr/opt**
14187      :widths: 30 15 15 15 15
14188      :header-rows: 1
14189
14190      * - **Test Name**
14191        - mozilla-central
14192        - autoland
14193        - mozilla-release
14194        - mozilla-beta
14195      * - **browsertime-tp6-firefox-imdb-e10s**
14196        - ❌
14197        - ❌
14198        - ❌
14199        - ❌
14200      * - **browsertime-tp6-firefox-imdb-fis-e10s**
14201        - ❌
14202        - ❌
14203        - ❌
14204        - ❌
14205      * - **browsertime-tp6-live-firefox-imdb-e10s**
14206        - ❌
14207        - ❌
14208        - ❌
14209        - ❌
14210      * - **browsertime-tp6-live-firefox-imdb-fis-e10s**
14211        - ❌
14212        - ❌
14213        - ❌
14214        - ❌
14215
14216
14217   .. list-table:: **test-windows10-64-shippable-qr/opt**
14218      :widths: 30 15 15 15 15
14219      :header-rows: 1
14220
14221      * - **Test Name**
14222        - mozilla-central
14223        - autoland
14224        - mozilla-release
14225        - mozilla-beta
14226      * - **browsertime-tp6-chrome-imdb-e10s**
14227        - ❌
14228        - ❌
14229        - ❌
14230        - ❌
14231      * - **browsertime-tp6-chromium-imdb-e10s**
14232        - ❌
14233        - ❌
14234        - ❌
14235        - ❌
14236      * - **browsertime-tp6-firefox-imdb-e10s**
14237        - ❌
14238        - ❌
14239        - ❌
14240        - ❌
14241      * - **browsertime-tp6-firefox-imdb-fis-e10s**
14242        - ✅
14243        - ✅
14244        - ✅
14245        - ✅
14246      * - **browsertime-tp6-live-chrome-imdb-e10s**
14247        - ❌
14248        - ❌
14249        - ❌
14250        - ❌
14251      * - **browsertime-tp6-live-chromium-imdb-e10s**
14252        - ❌
14253        - ❌
14254        - ❌
14255        - ❌
14256      * - **browsertime-tp6-live-firefox-imdb-e10s**
14257        - ❌
14258        - ❌
14259        - ❌
14260        - ❌
14261      * - **browsertime-tp6-live-firefox-imdb-fis-e10s**
14262        - ❌
14263        - ❌
14264        - ❌
14265        - ❌
14266
14267
14268
14269.. dropdown:: imgur
14270   :container: + anchor-id-imgur-d
14271
14272   **Owner**: PerfTest Team
14273
14274   * **alert on**: fcp, loadtime
14275   * **alert threshold**: 2.0
14276   * **apps**: firefox, chrome, chromium
14277   * **browser cycles**: 25
14278   * **expected**: pass
14279   * **gecko profile entries**: 14000000
14280   * **gecko profile interval**: 1
14281   * **lower is better**: true
14282   * **measure**: fnbpaint, fcp, dcf, loadtime
14283   * **page cycles**: 25
14284   * **page timeout**: 60000
14285   * **playback**: mitmproxy
14286   * **playback pageset manifest**: mitm7-linux-firefox-imgur.manifest
14287   * **playback version**: 7.0.4
14288   * **preferences**: {"media.autoplay.default": 5, "media.autoplay.ask-permission": true, "media.autoplay.blocking_policy": 1, "media.autoplay.block-webaudio": true, "media.allowed-to-play.enabled": false, "media.block-autoplay-until-in-foreground": true}
14289   * **secondary url**: `<https://imgur.com/gallery/L13Ci>`__
14290   * **test url**: `<https://imgur.com/gallery/m5tYJL6>`__
14291   * **type**: pageload
14292   * **unit**: ms
14293   * **use live sites**: false
14294   * **Test Task**:
14295
14296   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
14297      :widths: 30 15 15 15 15
14298      :header-rows: 1
14299
14300      * - **Test Name**
14301        - mozilla-central
14302        - autoland
14303        - mozilla-release
14304        - mozilla-beta
14305      * - **browsertime-tp6-firefox-imgur-e10s**
14306        - ❌
14307        - ❌
14308        - ❌
14309        - ❌
14310      * - **browsertime-tp6-firefox-imgur-fis-e10s**
14311        - ❌
14312        - ❌
14313        - ❌
14314        - ❌
14315      * - **browsertime-tp6-live-firefox-imgur-e10s**
14316        - ❌
14317        - ❌
14318        - ❌
14319        - ❌
14320      * - **browsertime-tp6-live-firefox-imgur-fis-e10s**
14321        - ❌
14322        - ❌
14323        - ❌
14324        - ❌
14325
14326
14327   .. list-table:: **test-linux1804-64-qr/opt**
14328      :widths: 30 15 15 15 15
14329      :header-rows: 1
14330
14331      * - **Test Name**
14332        - mozilla-central
14333        - autoland
14334        - mozilla-release
14335        - mozilla-beta
14336      * - **browsertime-tp6-firefox-imgur-e10s**
14337        - ❌
14338        - ❌
14339        - ❌
14340        - ❌
14341      * - **browsertime-tp6-firefox-imgur-fis-e10s**
14342        - ❌
14343        - ❌
14344        - ❌
14345        - ❌
14346      * - **browsertime-tp6-live-firefox-imgur-e10s**
14347        - ❌
14348        - ❌
14349        - ❌
14350        - ❌
14351      * - **browsertime-tp6-live-firefox-imgur-fis-e10s**
14352        - ❌
14353        - ❌
14354        - ❌
14355        - ❌
14356
14357
14358   .. list-table:: **test-linux1804-64-shippable-qr/opt**
14359      :widths: 30 15 15 15 15
14360      :header-rows: 1
14361
14362      * - **Test Name**
14363        - mozilla-central
14364        - autoland
14365        - mozilla-release
14366        - mozilla-beta
14367      * - **browsertime-tp6-chrome-imgur-e10s**
14368        - ❌
14369        - ❌
14370        - ❌
14371        - ❌
14372      * - **browsertime-tp6-chromium-imgur-e10s**
14373        - ❌
14374        - ❌
14375        - ❌
14376        - ❌
14377      * - **browsertime-tp6-firefox-imgur-e10s**
14378        - ❌
14379        - ❌
14380        - ❌
14381        - ❌
14382      * - **browsertime-tp6-firefox-imgur-fis-e10s**
14383        - ✅
14384        - ✅
14385        - ✅
14386        - ✅
14387      * - **browsertime-tp6-live-chrome-imgur-e10s**
14388        - ❌
14389        - ❌
14390        - ❌
14391        - ❌
14392      * - **browsertime-tp6-live-chromium-imgur-e10s**
14393        - ❌
14394        - ❌
14395        - ❌
14396        - ❌
14397      * - **browsertime-tp6-live-firefox-imgur-e10s**
14398        - ❌
14399        - ❌
14400        - ❌
14401        - ❌
14402      * - **browsertime-tp6-live-firefox-imgur-fis-e10s**
14403        - ❌
14404        - ❌
14405        - ❌
14406        - ❌
14407
14408
14409   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
14410      :widths: 30 15 15 15 15
14411      :header-rows: 1
14412
14413      * - **Test Name**
14414        - mozilla-central
14415        - autoland
14416        - mozilla-release
14417        - mozilla-beta
14418      * - **browsertime-tp6-chrome-imgur-e10s**
14419        - ❌
14420        - ❌
14421        - ❌
14422        - ❌
14423      * - **browsertime-tp6-chromium-imgur-e10s**
14424        - ❌
14425        - ❌
14426        - ❌
14427        - ❌
14428      * - **browsertime-tp6-firefox-imgur-e10s**
14429        - ❌
14430        - ❌
14431        - ❌
14432        - ❌
14433      * - **browsertime-tp6-firefox-imgur-fis-e10s**
14434        - ✅
14435        - ✅
14436        - ✅
14437        - ✅
14438      * - **browsertime-tp6-live-chrome-imgur-e10s**
14439        - ❌
14440        - ❌
14441        - ❌
14442        - ❌
14443      * - **browsertime-tp6-live-chromium-imgur-e10s**
14444        - ❌
14445        - ❌
14446        - ❌
14447        - ❌
14448      * - **browsertime-tp6-live-firefox-imgur-e10s**
14449        - ❌
14450        - ❌
14451        - ❌
14452        - ❌
14453      * - **browsertime-tp6-live-firefox-imgur-fis-e10s**
14454        - ❌
14455        - ❌
14456        - ❌
14457        - ❌
14458
14459
14460   .. list-table:: **test-windows10-32-qr/opt**
14461      :widths: 30 15 15 15 15
14462      :header-rows: 1
14463
14464      * - **Test Name**
14465        - mozilla-central
14466        - autoland
14467        - mozilla-release
14468        - mozilla-beta
14469      * - **browsertime-tp6-firefox-imgur-e10s**
14470        - ❌
14471        - ❌
14472        - ❌
14473        - ❌
14474      * - **browsertime-tp6-firefox-imgur-fis-e10s**
14475        - ❌
14476        - ❌
14477        - ❌
14478        - ❌
14479      * - **browsertime-tp6-live-firefox-imgur-e10s**
14480        - ❌
14481        - ❌
14482        - ❌
14483        - ❌
14484      * - **browsertime-tp6-live-firefox-imgur-fis-e10s**
14485        - ❌
14486        - ❌
14487        - ❌
14488        - ❌
14489
14490
14491   .. list-table:: **test-windows10-32-shippable-qr/opt**
14492      :widths: 30 15 15 15 15
14493      :header-rows: 1
14494
14495      * - **Test Name**
14496        - mozilla-central
14497        - autoland
14498        - mozilla-release
14499        - mozilla-beta
14500      * - **browsertime-tp6-chrome-imgur-e10s**
14501        - ❌
14502        - ❌
14503        - ❌
14504        - ❌
14505      * - **browsertime-tp6-chromium-imgur-e10s**
14506        - ❌
14507        - ❌
14508        - ❌
14509        - ❌
14510      * - **browsertime-tp6-firefox-imgur-e10s**
14511        - ❌
14512        - ❌
14513        - ❌
14514        - ❌
14515      * - **browsertime-tp6-firefox-imgur-fis-e10s**
14516        - ❌
14517        - ❌
14518        - ❌
14519        - ❌
14520      * - **browsertime-tp6-live-chrome-imgur-e10s**
14521        - ❌
14522        - ❌
14523        - ❌
14524        - ❌
14525      * - **browsertime-tp6-live-chromium-imgur-e10s**
14526        - ❌
14527        - ❌
14528        - ❌
14529        - ❌
14530      * - **browsertime-tp6-live-firefox-imgur-e10s**
14531        - ❌
14532        - ❌
14533        - ❌
14534        - ❌
14535      * - **browsertime-tp6-live-firefox-imgur-fis-e10s**
14536        - ❌
14537        - ❌
14538        - ❌
14539        - ❌
14540
14541
14542   .. list-table:: **test-windows10-64-qr/opt**
14543      :widths: 30 15 15 15 15
14544      :header-rows: 1
14545
14546      * - **Test Name**
14547        - mozilla-central
14548        - autoland
14549        - mozilla-release
14550        - mozilla-beta
14551      * - **browsertime-tp6-firefox-imgur-e10s**
14552        - ❌
14553        - ❌
14554        - ❌
14555        - ❌
14556      * - **browsertime-tp6-firefox-imgur-fis-e10s**
14557        - ❌
14558        - ❌
14559        - ❌
14560        - ❌
14561      * - **browsertime-tp6-live-firefox-imgur-e10s**
14562        - ❌
14563        - ❌
14564        - ❌
14565        - ❌
14566      * - **browsertime-tp6-live-firefox-imgur-fis-e10s**
14567        - ❌
14568        - ❌
14569        - ❌
14570        - ❌
14571
14572
14573   .. list-table:: **test-windows10-64-shippable-qr/opt**
14574      :widths: 30 15 15 15 15
14575      :header-rows: 1
14576
14577      * - **Test Name**
14578        - mozilla-central
14579        - autoland
14580        - mozilla-release
14581        - mozilla-beta
14582      * - **browsertime-tp6-chrome-imgur-e10s**
14583        - ❌
14584        - ❌
14585        - ❌
14586        - ❌
14587      * - **browsertime-tp6-chromium-imgur-e10s**
14588        - ❌
14589        - ❌
14590        - ❌
14591        - ❌
14592      * - **browsertime-tp6-firefox-imgur-e10s**
14593        - ❌
14594        - ❌
14595        - ❌
14596        - ❌
14597      * - **browsertime-tp6-firefox-imgur-fis-e10s**
14598        - ✅
14599        - ✅
14600        - ✅
14601        - ✅
14602      * - **browsertime-tp6-live-chrome-imgur-e10s**
14603        - ❌
14604        - ❌
14605        - ❌
14606        - ❌
14607      * - **browsertime-tp6-live-chromium-imgur-e10s**
14608        - ❌
14609        - ❌
14610        - ❌
14611        - ❌
14612      * - **browsertime-tp6-live-firefox-imgur-e10s**
14613        - ❌
14614        - ❌
14615        - ❌
14616        - ❌
14617      * - **browsertime-tp6-live-firefox-imgur-fis-e10s**
14618        - ❌
14619        - ❌
14620        - ❌
14621        - ❌
14622
14623
14624
14625.. dropdown:: instagram
14626   :container: + anchor-id-instagram-d
14627
14628   **Owner**: PerfTest Team
14629
14630   * **alert on**: fcp, loadtime
14631   * **alert threshold**: 2.0
14632   * **apps**: firefox, chrome, chromium
14633   * **browser cycles**: 25
14634   * **expected**: pass
14635   * **gecko profile entries**: 14000000
14636   * **gecko profile interval**: 1
14637   * **lower is better**: true
14638   * **measure**: fnbpaint, fcp, dcf, loadtime
14639   * **page cycles**: 25
14640   * **page timeout**: 60000
14641   * **playback**: mitmproxy
14642   * **playback pageset manifest**: mitm6-linux-firefox-instagram.manifest
14643   * **playback version**: 6.0.2
14644   * **secondary url**: `<https://www.instagram.com/nobelprize_org/>`__
14645   * **test url**: `<https://www.instagram.com/>`__
14646   * **type**: pageload
14647   * **unit**: ms
14648   * **use live sites**: false
14649   * **Test Task**:
14650
14651   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
14652      :widths: 30 15 15 15 15
14653      :header-rows: 1
14654
14655      * - **Test Name**
14656        - mozilla-central
14657        - autoland
14658        - mozilla-release
14659        - mozilla-beta
14660      * - **browsertime-tp6m-fenix-instagram-e10s**
14661        - ❌
14662        - ❌
14663        - ❌
14664        - ❌
14665      * - **browsertime-tp6m-geckoview-instagram-e10s**
14666        - ❌
14667        - ❌
14668        - ❌
14669        - ❌
14670      * - **browsertime-tp6m-live-fenix-instagram-e10s**
14671        - ❌
14672        - ❌
14673        - ❌
14674        - ❌
14675      * - **browsertime-tp6m-live-geckoview-instagram-e10s**
14676        - ❌
14677        - ❌
14678        - ❌
14679        - ❌
14680      * - **browsertime-tp6m-refbrow-instagram-e10s**
14681        - ❌
14682        - ❌
14683        - ❌
14684        - ❌
14685
14686
14687   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
14688      :widths: 30 15 15 15 15
14689      :header-rows: 1
14690
14691      * - **Test Name**
14692        - mozilla-central
14693        - autoland
14694        - mozilla-release
14695        - mozilla-beta
14696      * - **browsertime-tp6m-chrome-m-instagram-e10s**
14697        - ❌
14698        - ❌
14699        - ❌
14700        - ❌
14701      * - **browsertime-tp6m-fenix-instagram-e10s**
14702        - ❌
14703        - ❌
14704        - ❌
14705        - ❌
14706      * - **browsertime-tp6m-geckoview-instagram-e10s**
14707        - ✅
14708        - ✅
14709        - ✅
14710        - ✅
14711      * - **browsertime-tp6m-live-chrome-m-instagram-e10s**
14712        - ❌
14713        - ❌
14714        - ❌
14715        - ❌
14716      * - **browsertime-tp6m-live-fenix-instagram-e10s**
14717        - ❌
14718        - ❌
14719        - ❌
14720        - ❌
14721      * - **browsertime-tp6m-live-geckoview-instagram-e10s**
14722        - ❌
14723        - ❌
14724        - ❌
14725        - ❌
14726      * - **browsertime-tp6m-refbrow-instagram-e10s**
14727        - ❌
14728        - ❌
14729        - ❌
14730        - ❌
14731
14732
14733   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
14734      :widths: 30 15 15 15 15
14735      :header-rows: 1
14736
14737      * - **Test Name**
14738        - mozilla-central
14739        - autoland
14740        - mozilla-release
14741        - mozilla-beta
14742      * - **browsertime-tp6m-fenix-instagram-e10s**
14743        - ❌
14744        - ❌
14745        - ❌
14746        - ❌
14747      * - **browsertime-tp6m-geckoview-instagram-e10s**
14748        - ❌
14749        - ❌
14750        - ❌
14751        - ❌
14752      * - **browsertime-tp6m-live-fenix-instagram-e10s**
14753        - ❌
14754        - ❌
14755        - ❌
14756        - ❌
14757      * - **browsertime-tp6m-live-geckoview-instagram-e10s**
14758        - ❌
14759        - ❌
14760        - ❌
14761        - ❌
14762      * - **browsertime-tp6m-refbrow-instagram-e10s**
14763        - ❌
14764        - ❌
14765        - ❌
14766        - ❌
14767
14768
14769   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
14770      :widths: 30 15 15 15 15
14771      :header-rows: 1
14772
14773      * - **Test Name**
14774        - mozilla-central
14775        - autoland
14776        - mozilla-release
14777        - mozilla-beta
14778      * - **browsertime-tp6m-chrome-m-instagram-e10s**
14779        - ❌
14780        - ❌
14781        - ❌
14782        - ❌
14783      * - **browsertime-tp6m-fenix-instagram-e10s**
14784        - ❌
14785        - ❌
14786        - ❌
14787        - ❌
14788      * - **browsertime-tp6m-geckoview-instagram-e10s**
14789        - ✅
14790        - ✅
14791        - ✅
14792        - ✅
14793      * - **browsertime-tp6m-live-chrome-m-instagram-e10s**
14794        - ❌
14795        - ❌
14796        - ❌
14797        - ❌
14798      * - **browsertime-tp6m-live-fenix-instagram-e10s**
14799        - ❌
14800        - ❌
14801        - ❌
14802        - ❌
14803      * - **browsertime-tp6m-live-geckoview-instagram-e10s**
14804        - ❌
14805        - ❌
14806        - ❌
14807        - ❌
14808      * - **browsertime-tp6m-refbrow-instagram-e10s**
14809        - ❌
14810        - ❌
14811        - ❌
14812        - ❌
14813
14814
14815   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
14816      :widths: 30 15 15 15 15
14817      :header-rows: 1
14818
14819      * - **Test Name**
14820        - mozilla-central
14821        - autoland
14822        - mozilla-release
14823        - mozilla-beta
14824      * - **browsertime-tp6m-fenix-instagram-e10s**
14825        - ❌
14826        - ❌
14827        - ❌
14828        - ❌
14829      * - **browsertime-tp6m-geckoview-instagram-e10s**
14830        - ❌
14831        - ❌
14832        - ❌
14833        - ❌
14834      * - **browsertime-tp6m-live-fenix-instagram-e10s**
14835        - ❌
14836        - ❌
14837        - ❌
14838        - ❌
14839      * - **browsertime-tp6m-live-geckoview-instagram-e10s**
14840        - ❌
14841        - ❌
14842        - ❌
14843        - ❌
14844      * - **browsertime-tp6m-refbrow-instagram-e10s**
14845        - ❌
14846        - ❌
14847        - ❌
14848        - ❌
14849
14850
14851   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
14852      :widths: 30 15 15 15 15
14853      :header-rows: 1
14854
14855      * - **Test Name**
14856        - mozilla-central
14857        - autoland
14858        - mozilla-release
14859        - mozilla-beta
14860      * - **browsertime-tp6m-chrome-m-instagram-e10s**
14861        - ❌
14862        - ❌
14863        - ❌
14864        - ❌
14865      * - **browsertime-tp6m-fenix-instagram-e10s**
14866        - ❌
14867        - ❌
14868        - ❌
14869        - ❌
14870      * - **browsertime-tp6m-geckoview-instagram-e10s**
14871        - ❌
14872        - ❌
14873        - ❌
14874        - ❌
14875      * - **browsertime-tp6m-live-chrome-m-instagram-e10s**
14876        - ❌
14877        - ❌
14878        - ❌
14879        - ❌
14880      * - **browsertime-tp6m-live-fenix-instagram-e10s**
14881        - ❌
14882        - ❌
14883        - ❌
14884        - ❌
14885      * - **browsertime-tp6m-live-geckoview-instagram-e10s**
14886        - ❌
14887        - ❌
14888        - ❌
14889        - ❌
14890      * - **browsertime-tp6m-refbrow-instagram-e10s**
14891        - ❌
14892        - ❌
14893        - ❌
14894        - ❌
14895
14896
14897   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
14898      :widths: 30 15 15 15 15
14899      :header-rows: 1
14900
14901      * - **Test Name**
14902        - mozilla-central
14903        - autoland
14904        - mozilla-release
14905        - mozilla-beta
14906      * - **browsertime-tp6m-fenix-instagram-e10s**
14907        - ❌
14908        - ❌
14909        - ❌
14910        - ❌
14911      * - **browsertime-tp6m-geckoview-instagram-e10s**
14912        - ❌
14913        - ❌
14914        - ❌
14915        - ❌
14916      * - **browsertime-tp6m-live-fenix-instagram-e10s**
14917        - ❌
14918        - ❌
14919        - ❌
14920        - ❌
14921      * - **browsertime-tp6m-live-geckoview-instagram-e10s**
14922        - ❌
14923        - ❌
14924        - ❌
14925        - ❌
14926      * - **browsertime-tp6m-refbrow-instagram-e10s**
14927        - ❌
14928        - ❌
14929        - ❌
14930        - ❌
14931
14932
14933   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
14934      :widths: 30 15 15 15 15
14935      :header-rows: 1
14936
14937      * - **Test Name**
14938        - mozilla-central
14939        - autoland
14940        - mozilla-release
14941        - mozilla-beta
14942      * - **browsertime-tp6m-chrome-m-instagram-e10s**
14943        - ❌
14944        - ❌
14945        - ❌
14946        - ❌
14947      * - **browsertime-tp6m-fenix-instagram-e10s**
14948        - ❌
14949        - ❌
14950        - ❌
14951        - ❌
14952      * - **browsertime-tp6m-geckoview-instagram-e10s**
14953        - ❌
14954        - ❌
14955        - ❌
14956        - ❌
14957      * - **browsertime-tp6m-live-chrome-m-instagram-e10s**
14958        - ❌
14959        - ❌
14960        - ❌
14961        - ❌
14962      * - **browsertime-tp6m-live-fenix-instagram-e10s**
14963        - ❌
14964        - ❌
14965        - ❌
14966        - ❌
14967      * - **browsertime-tp6m-live-geckoview-instagram-e10s**
14968        - ❌
14969        - ❌
14970        - ❌
14971        - ❌
14972      * - **browsertime-tp6m-refbrow-instagram-e10s**
14973        - ❌
14974        - ❌
14975        - ❌
14976        - ❌
14977
14978
14979   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
14980      :widths: 30 15 15 15 15
14981      :header-rows: 1
14982
14983      * - **Test Name**
14984        - mozilla-central
14985        - autoland
14986        - mozilla-release
14987        - mozilla-beta
14988      * - **browsertime-tp6-essential-firefox-instagram-e10s**
14989        - ❌
14990        - ❌
14991        - ❌
14992        - ❌
14993      * - **browsertime-tp6-essential-firefox-instagram-fis-e10s**
14994        - ❌
14995        - ❌
14996        - ❌
14997        - ❌
14998
14999
15000   .. list-table:: **test-linux1804-64-qr/opt**
15001      :widths: 30 15 15 15 15
15002      :header-rows: 1
15003
15004      * - **Test Name**
15005        - mozilla-central
15006        - autoland
15007        - mozilla-release
15008        - mozilla-beta
15009      * - **browsertime-tp6-essential-firefox-instagram-e10s**
15010        - ❌
15011        - ❌
15012        - ❌
15013        - ❌
15014      * - **browsertime-tp6-essential-firefox-instagram-fis-e10s**
15015        - ❌
15016        - ❌
15017        - ❌
15018        - ❌
15019
15020
15021   .. list-table:: **test-linux1804-64-shippable-qr/opt**
15022      :widths: 30 15 15 15 15
15023      :header-rows: 1
15024
15025      * - **Test Name**
15026        - mozilla-central
15027        - autoland
15028        - mozilla-release
15029        - mozilla-beta
15030      * - **browsertime-tp6-essential-chrome-instagram-e10s**
15031        - ❌
15032        - ❌
15033        - ❌
15034        - ❌
15035      * - **browsertime-tp6-essential-chromium-instagram-e10s**
15036        - ❌
15037        - ❌
15038        - ❌
15039        - ❌
15040      * - **browsertime-tp6-essential-firefox-instagram-e10s**
15041        - ❌
15042        - ❌
15043        - ❌
15044        - ❌
15045      * - **browsertime-tp6-essential-firefox-instagram-fis-e10s**
15046        - ✅
15047        - ✅
15048        - ✅
15049        - ✅
15050
15051
15052   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
15053      :widths: 30 15 15 15 15
15054      :header-rows: 1
15055
15056      * - **Test Name**
15057        - mozilla-central
15058        - autoland
15059        - mozilla-release
15060        - mozilla-beta
15061      * - **browsertime-tp6-essential-chrome-instagram-e10s**
15062        - ❌
15063        - ❌
15064        - ❌
15065        - ❌
15066      * - **browsertime-tp6-essential-chromium-instagram-e10s**
15067        - ❌
15068        - ❌
15069        - ❌
15070        - ❌
15071      * - **browsertime-tp6-essential-firefox-instagram-e10s**
15072        - ❌
15073        - ❌
15074        - ❌
15075        - ❌
15076      * - **browsertime-tp6-essential-firefox-instagram-fis-e10s**
15077        - ✅
15078        - ✅
15079        - ✅
15080        - ✅
15081
15082
15083   .. list-table:: **test-windows10-32-qr/opt**
15084      :widths: 30 15 15 15 15
15085      :header-rows: 1
15086
15087      * - **Test Name**
15088        - mozilla-central
15089        - autoland
15090        - mozilla-release
15091        - mozilla-beta
15092      * - **browsertime-tp6-essential-firefox-instagram-e10s**
15093        - ❌
15094        - ❌
15095        - ❌
15096        - ❌
15097      * - **browsertime-tp6-essential-firefox-instagram-fis-e10s**
15098        - ❌
15099        - ❌
15100        - ❌
15101        - ❌
15102
15103
15104   .. list-table:: **test-windows10-32-shippable-qr/opt**
15105      :widths: 30 15 15 15 15
15106      :header-rows: 1
15107
15108      * - **Test Name**
15109        - mozilla-central
15110        - autoland
15111        - mozilla-release
15112        - mozilla-beta
15113      * - **browsertime-tp6-essential-chrome-instagram-e10s**
15114        - ❌
15115        - ❌
15116        - ❌
15117        - ❌
15118      * - **browsertime-tp6-essential-chromium-instagram-e10s**
15119        - ❌
15120        - ❌
15121        - ❌
15122        - ❌
15123      * - **browsertime-tp6-essential-firefox-instagram-e10s**
15124        - ❌
15125        - ❌
15126        - ❌
15127        - ❌
15128      * - **browsertime-tp6-essential-firefox-instagram-fis-e10s**
15129        - ❌
15130        - ❌
15131        - ❌
15132        - ❌
15133
15134
15135   .. list-table:: **test-windows10-64-qr/opt**
15136      :widths: 30 15 15 15 15
15137      :header-rows: 1
15138
15139      * - **Test Name**
15140        - mozilla-central
15141        - autoland
15142        - mozilla-release
15143        - mozilla-beta
15144      * - **browsertime-tp6-essential-firefox-instagram-e10s**
15145        - ❌
15146        - ❌
15147        - ❌
15148        - ❌
15149      * - **browsertime-tp6-essential-firefox-instagram-fis-e10s**
15150        - ❌
15151        - ❌
15152        - ❌
15153        - ❌
15154
15155
15156   .. list-table:: **test-windows10-64-shippable-qr/opt**
15157      :widths: 30 15 15 15 15
15158      :header-rows: 1
15159
15160      * - **Test Name**
15161        - mozilla-central
15162        - autoland
15163        - mozilla-release
15164        - mozilla-beta
15165      * - **browsertime-tp6-essential-chrome-instagram-e10s**
15166        - ❌
15167        - ❌
15168        - ❌
15169        - ❌
15170      * - **browsertime-tp6-essential-chromium-instagram-e10s**
15171        - ❌
15172        - ❌
15173        - ❌
15174        - ❌
15175      * - **browsertime-tp6-essential-firefox-instagram-e10s**
15176        - ❌
15177        - ❌
15178        - ❌
15179        - ❌
15180      * - **browsertime-tp6-essential-firefox-instagram-fis-e10s**
15181        - ✅
15182        - ✅
15183        - ✅
15184        - ✅
15185
15186
15187
15188.. dropdown:: linkedin
15189   :container: + anchor-id-linkedin-d
15190
15191   **Owner**: PerfTest Team
15192
15193   * **alert on**: fcp, loadtime
15194   * **alert threshold**: 2.0
15195   * **apps**: firefox, chrome, chromium
15196   * **browser cycles**: 25
15197   * **expected**: pass
15198   * **gecko profile entries**: 14000000
15199   * **gecko profile interval**: 1
15200   * **lower is better**: true
15201   * **measure**: fnbpaint, fcp, dcf, loadtime
15202   * **page cycles**: 25
15203   * **page timeout**: 60000
15204   * **playback**: mitmproxy
15205   * **playback pageset manifest**: mitm6-linux-firefox-linkedin.manifest
15206   * **playback version**: 6.0.2
15207   * **secondary url**: `<https://www.linkedin.com/in/thommy-harris-hk-385723106/>`__
15208   * **test url**: `<https://www.linkedin.com/feed/>`__
15209   * **type**: pageload
15210   * **unit**: ms
15211   * **use live sites**: false
15212   * **Test Task**:
15213
15214   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
15215      :widths: 30 15 15 15 15
15216      :header-rows: 1
15217
15218      * - **Test Name**
15219        - mozilla-central
15220        - autoland
15221        - mozilla-release
15222        - mozilla-beta
15223      * - **browsertime-tp6-firefox-linkedin-e10s**
15224        - ❌
15225        - ❌
15226        - ❌
15227        - ❌
15228      * - **browsertime-tp6-firefox-linkedin-fis-e10s**
15229        - ❌
15230        - ❌
15231        - ❌
15232        - ❌
15233      * - **browsertime-tp6-live-firefox-linkedin-e10s**
15234        - ❌
15235        - ❌
15236        - ❌
15237        - ❌
15238      * - **browsertime-tp6-live-firefox-linkedin-fis-e10s**
15239        - ❌
15240        - ❌
15241        - ❌
15242        - ❌
15243
15244
15245   .. list-table:: **test-linux1804-64-qr/opt**
15246      :widths: 30 15 15 15 15
15247      :header-rows: 1
15248
15249      * - **Test Name**
15250        - mozilla-central
15251        - autoland
15252        - mozilla-release
15253        - mozilla-beta
15254      * - **browsertime-tp6-firefox-linkedin-e10s**
15255        - ❌
15256        - ❌
15257        - ❌
15258        - ❌
15259      * - **browsertime-tp6-firefox-linkedin-fis-e10s**
15260        - ❌
15261        - ❌
15262        - ❌
15263        - ❌
15264      * - **browsertime-tp6-live-firefox-linkedin-e10s**
15265        - ❌
15266        - ❌
15267        - ❌
15268        - ❌
15269      * - **browsertime-tp6-live-firefox-linkedin-fis-e10s**
15270        - ❌
15271        - ❌
15272        - ❌
15273        - ❌
15274
15275
15276   .. list-table:: **test-linux1804-64-shippable-qr/opt**
15277      :widths: 30 15 15 15 15
15278      :header-rows: 1
15279
15280      * - **Test Name**
15281        - mozilla-central
15282        - autoland
15283        - mozilla-release
15284        - mozilla-beta
15285      * - **browsertime-tp6-chrome-linkedin-e10s**
15286        - ❌
15287        - ❌
15288        - ❌
15289        - ❌
15290      * - **browsertime-tp6-chromium-linkedin-e10s**
15291        - ❌
15292        - ❌
15293        - ❌
15294        - ❌
15295      * - **browsertime-tp6-firefox-linkedin-e10s**
15296        - ❌
15297        - ❌
15298        - ❌
15299        - ❌
15300      * - **browsertime-tp6-firefox-linkedin-fis-e10s**
15301        - ✅
15302        - ✅
15303        - ✅
15304        - ✅
15305      * - **browsertime-tp6-live-chrome-linkedin-e10s**
15306        - ❌
15307        - ❌
15308        - ❌
15309        - ❌
15310      * - **browsertime-tp6-live-chromium-linkedin-e10s**
15311        - ❌
15312        - ❌
15313        - ❌
15314        - ❌
15315      * - **browsertime-tp6-live-firefox-linkedin-e10s**
15316        - ❌
15317        - ❌
15318        - ❌
15319        - ❌
15320      * - **browsertime-tp6-live-firefox-linkedin-fis-e10s**
15321        - ❌
15322        - ❌
15323        - ❌
15324        - ❌
15325
15326
15327   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
15328      :widths: 30 15 15 15 15
15329      :header-rows: 1
15330
15331      * - **Test Name**
15332        - mozilla-central
15333        - autoland
15334        - mozilla-release
15335        - mozilla-beta
15336      * - **browsertime-tp6-chrome-linkedin-e10s**
15337        - ❌
15338        - ❌
15339        - ❌
15340        - ❌
15341      * - **browsertime-tp6-chromium-linkedin-e10s**
15342        - ❌
15343        - ❌
15344        - ❌
15345        - ❌
15346      * - **browsertime-tp6-firefox-linkedin-e10s**
15347        - ❌
15348        - ❌
15349        - ❌
15350        - ❌
15351      * - **browsertime-tp6-firefox-linkedin-fis-e10s**
15352        - ✅
15353        - ✅
15354        - ✅
15355        - ✅
15356      * - **browsertime-tp6-live-chrome-linkedin-e10s**
15357        - ❌
15358        - ❌
15359        - ❌
15360        - ❌
15361      * - **browsertime-tp6-live-chromium-linkedin-e10s**
15362        - ❌
15363        - ❌
15364        - ❌
15365        - ❌
15366      * - **browsertime-tp6-live-firefox-linkedin-e10s**
15367        - ❌
15368        - ❌
15369        - ❌
15370        - ❌
15371      * - **browsertime-tp6-live-firefox-linkedin-fis-e10s**
15372        - ❌
15373        - ❌
15374        - ❌
15375        - ❌
15376
15377
15378   .. list-table:: **test-windows10-32-qr/opt**
15379      :widths: 30 15 15 15 15
15380      :header-rows: 1
15381
15382      * - **Test Name**
15383        - mozilla-central
15384        - autoland
15385        - mozilla-release
15386        - mozilla-beta
15387      * - **browsertime-tp6-firefox-linkedin-e10s**
15388        - ❌
15389        - ❌
15390        - ❌
15391        - ❌
15392      * - **browsertime-tp6-firefox-linkedin-fis-e10s**
15393        - ❌
15394        - ❌
15395        - ❌
15396        - ❌
15397      * - **browsertime-tp6-live-firefox-linkedin-e10s**
15398        - ❌
15399        - ❌
15400        - ❌
15401        - ❌
15402      * - **browsertime-tp6-live-firefox-linkedin-fis-e10s**
15403        - ❌
15404        - ❌
15405        - ❌
15406        - ❌
15407
15408
15409   .. list-table:: **test-windows10-32-shippable-qr/opt**
15410      :widths: 30 15 15 15 15
15411      :header-rows: 1
15412
15413      * - **Test Name**
15414        - mozilla-central
15415        - autoland
15416        - mozilla-release
15417        - mozilla-beta
15418      * - **browsertime-tp6-chrome-linkedin-e10s**
15419        - ❌
15420        - ❌
15421        - ❌
15422        - ❌
15423      * - **browsertime-tp6-chromium-linkedin-e10s**
15424        - ❌
15425        - ❌
15426        - ❌
15427        - ❌
15428      * - **browsertime-tp6-firefox-linkedin-e10s**
15429        - ❌
15430        - ❌
15431        - ❌
15432        - ❌
15433      * - **browsertime-tp6-firefox-linkedin-fis-e10s**
15434        - ❌
15435        - ❌
15436        - ❌
15437        - ❌
15438      * - **browsertime-tp6-live-chrome-linkedin-e10s**
15439        - ❌
15440        - ❌
15441        - ❌
15442        - ❌
15443      * - **browsertime-tp6-live-chromium-linkedin-e10s**
15444        - ❌
15445        - ❌
15446        - ❌
15447        - ❌
15448      * - **browsertime-tp6-live-firefox-linkedin-e10s**
15449        - ❌
15450        - ❌
15451        - ❌
15452        - ❌
15453      * - **browsertime-tp6-live-firefox-linkedin-fis-e10s**
15454        - ❌
15455        - ❌
15456        - ❌
15457        - ❌
15458
15459
15460   .. list-table:: **test-windows10-64-qr/opt**
15461      :widths: 30 15 15 15 15
15462      :header-rows: 1
15463
15464      * - **Test Name**
15465        - mozilla-central
15466        - autoland
15467        - mozilla-release
15468        - mozilla-beta
15469      * - **browsertime-tp6-firefox-linkedin-e10s**
15470        - ❌
15471        - ❌
15472        - ❌
15473        - ❌
15474      * - **browsertime-tp6-firefox-linkedin-fis-e10s**
15475        - ❌
15476        - ❌
15477        - ❌
15478        - ❌
15479      * - **browsertime-tp6-live-firefox-linkedin-e10s**
15480        - ❌
15481        - ❌
15482        - ❌
15483        - ❌
15484      * - **browsertime-tp6-live-firefox-linkedin-fis-e10s**
15485        - ❌
15486        - ❌
15487        - ❌
15488        - ❌
15489
15490
15491   .. list-table:: **test-windows10-64-shippable-qr/opt**
15492      :widths: 30 15 15 15 15
15493      :header-rows: 1
15494
15495      * - **Test Name**
15496        - mozilla-central
15497        - autoland
15498        - mozilla-release
15499        - mozilla-beta
15500      * - **browsertime-tp6-chrome-linkedin-e10s**
15501        - ❌
15502        - ❌
15503        - ❌
15504        - ❌
15505      * - **browsertime-tp6-chromium-linkedin-e10s**
15506        - ❌
15507        - ❌
15508        - ❌
15509        - ❌
15510      * - **browsertime-tp6-firefox-linkedin-e10s**
15511        - ❌
15512        - ❌
15513        - ❌
15514        - ❌
15515      * - **browsertime-tp6-firefox-linkedin-fis-e10s**
15516        - ✅
15517        - ✅
15518        - ✅
15519        - ✅
15520      * - **browsertime-tp6-live-chrome-linkedin-e10s**
15521        - ❌
15522        - ❌
15523        - ❌
15524        - ❌
15525      * - **browsertime-tp6-live-chromium-linkedin-e10s**
15526        - ❌
15527        - ❌
15528        - ❌
15529        - ❌
15530      * - **browsertime-tp6-live-firefox-linkedin-e10s**
15531        - ❌
15532        - ❌
15533        - ❌
15534        - ❌
15535      * - **browsertime-tp6-live-firefox-linkedin-fis-e10s**
15536        - ❌
15537        - ❌
15538        - ❌
15539        - ❌
15540
15541
15542
15543.. dropdown:: microsoft
15544   :container: + anchor-id-microsoft-d
15545
15546   **Owner**: PerfTest Team
15547
15548   * **alert on**: fcp, loadtime
15549   * **alert threshold**: 2.0
15550   * **apps**: firefox, chrome, chromium
15551   * **browser cycles**: 25
15552   * **expected**: pass
15553   * **gecko profile entries**: 14000000
15554   * **gecko profile interval**: 1
15555   * **lower is better**: true
15556   * **measure**: fnbpaint, fcp, dcf, loadtime
15557   * **page cycles**: 25
15558   * **page timeout**: 60000
15559   * **playback**: mitmproxy
15560   * **playback pageset manifest**: mitm7-linux-firefox-microsoft.manifest
15561   * **playback version**: 7.0.4
15562   * **secondary url**: `<https://support.microsoft.com/en-us>`__
15563   * **test url**: `<https://www.microsoft.com/en-us/>`__
15564   * **type**: pageload
15565   * **unit**: ms
15566   * **use live sites**: false
15567   * **Test Task**:
15568
15569   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
15570      :widths: 30 15 15 15 15
15571      :header-rows: 1
15572
15573      * - **Test Name**
15574        - mozilla-central
15575        - autoland
15576        - mozilla-release
15577        - mozilla-beta
15578      * - **browsertime-tp6-firefox-microsoft-e10s**
15579        - ❌
15580        - ❌
15581        - ❌
15582        - ❌
15583      * - **browsertime-tp6-firefox-microsoft-fis-e10s**
15584        - ❌
15585        - ❌
15586        - ❌
15587        - ❌
15588      * - **browsertime-tp6-live-firefox-microsoft-e10s**
15589        - ❌
15590        - ❌
15591        - ❌
15592        - ❌
15593      * - **browsertime-tp6-live-firefox-microsoft-fis-e10s**
15594        - ❌
15595        - ❌
15596        - ❌
15597        - ❌
15598
15599
15600   .. list-table:: **test-linux1804-64-qr/opt**
15601      :widths: 30 15 15 15 15
15602      :header-rows: 1
15603
15604      * - **Test Name**
15605        - mozilla-central
15606        - autoland
15607        - mozilla-release
15608        - mozilla-beta
15609      * - **browsertime-tp6-firefox-microsoft-e10s**
15610        - ❌
15611        - ❌
15612        - ❌
15613        - ❌
15614      * - **browsertime-tp6-firefox-microsoft-fis-e10s**
15615        - ❌
15616        - ❌
15617        - ❌
15618        - ❌
15619      * - **browsertime-tp6-live-firefox-microsoft-e10s**
15620        - ❌
15621        - ❌
15622        - ❌
15623        - ❌
15624      * - **browsertime-tp6-live-firefox-microsoft-fis-e10s**
15625        - ❌
15626        - ❌
15627        - ❌
15628        - ❌
15629
15630
15631   .. list-table:: **test-linux1804-64-shippable-qr/opt**
15632      :widths: 30 15 15 15 15
15633      :header-rows: 1
15634
15635      * - **Test Name**
15636        - mozilla-central
15637        - autoland
15638        - mozilla-release
15639        - mozilla-beta
15640      * - **browsertime-tp6-chrome-microsoft-e10s**
15641        - ❌
15642        - ❌
15643        - ❌
15644        - ❌
15645      * - **browsertime-tp6-chromium-microsoft-e10s**
15646        - ❌
15647        - ❌
15648        - ❌
15649        - ❌
15650      * - **browsertime-tp6-firefox-microsoft-e10s**
15651        - ❌
15652        - ❌
15653        - ❌
15654        - ❌
15655      * - **browsertime-tp6-firefox-microsoft-fis-e10s**
15656        - ✅
15657        - ✅
15658        - ✅
15659        - ✅
15660      * - **browsertime-tp6-live-chrome-microsoft-e10s**
15661        - ❌
15662        - ❌
15663        - ❌
15664        - ❌
15665      * - **browsertime-tp6-live-chromium-microsoft-e10s**
15666        - ❌
15667        - ❌
15668        - ❌
15669        - ❌
15670      * - **browsertime-tp6-live-firefox-microsoft-e10s**
15671        - ❌
15672        - ❌
15673        - ❌
15674        - ❌
15675      * - **browsertime-tp6-live-firefox-microsoft-fis-e10s**
15676        - ❌
15677        - ❌
15678        - ❌
15679        - ❌
15680
15681
15682   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
15683      :widths: 30 15 15 15 15
15684      :header-rows: 1
15685
15686      * - **Test Name**
15687        - mozilla-central
15688        - autoland
15689        - mozilla-release
15690        - mozilla-beta
15691      * - **browsertime-tp6-chrome-microsoft-e10s**
15692        - ❌
15693        - ❌
15694        - ❌
15695        - ❌
15696      * - **browsertime-tp6-chromium-microsoft-e10s**
15697        - ❌
15698        - ❌
15699        - ❌
15700        - ❌
15701      * - **browsertime-tp6-firefox-microsoft-e10s**
15702        - ❌
15703        - ❌
15704        - ❌
15705        - ❌
15706      * - **browsertime-tp6-firefox-microsoft-fis-e10s**
15707        - ✅
15708        - ✅
15709        - ✅
15710        - ✅
15711      * - **browsertime-tp6-live-chrome-microsoft-e10s**
15712        - ❌
15713        - ❌
15714        - ❌
15715        - ❌
15716      * - **browsertime-tp6-live-chromium-microsoft-e10s**
15717        - ❌
15718        - ❌
15719        - ❌
15720        - ❌
15721      * - **browsertime-tp6-live-firefox-microsoft-e10s**
15722        - ❌
15723        - ❌
15724        - ❌
15725        - ❌
15726      * - **browsertime-tp6-live-firefox-microsoft-fis-e10s**
15727        - ❌
15728        - ❌
15729        - ❌
15730        - ❌
15731
15732
15733   .. list-table:: **test-windows10-32-qr/opt**
15734      :widths: 30 15 15 15 15
15735      :header-rows: 1
15736
15737      * - **Test Name**
15738        - mozilla-central
15739        - autoland
15740        - mozilla-release
15741        - mozilla-beta
15742      * - **browsertime-tp6-firefox-microsoft-e10s**
15743        - ❌
15744        - ❌
15745        - ❌
15746        - ❌
15747      * - **browsertime-tp6-firefox-microsoft-fis-e10s**
15748        - ❌
15749        - ❌
15750        - ❌
15751        - ❌
15752      * - **browsertime-tp6-live-firefox-microsoft-e10s**
15753        - ❌
15754        - ❌
15755        - ❌
15756        - ❌
15757      * - **browsertime-tp6-live-firefox-microsoft-fis-e10s**
15758        - ❌
15759        - ❌
15760        - ❌
15761        - ❌
15762
15763
15764   .. list-table:: **test-windows10-32-shippable-qr/opt**
15765      :widths: 30 15 15 15 15
15766      :header-rows: 1
15767
15768      * - **Test Name**
15769        - mozilla-central
15770        - autoland
15771        - mozilla-release
15772        - mozilla-beta
15773      * - **browsertime-tp6-chrome-microsoft-e10s**
15774        - ❌
15775        - ❌
15776        - ❌
15777        - ❌
15778      * - **browsertime-tp6-chromium-microsoft-e10s**
15779        - ❌
15780        - ❌
15781        - ❌
15782        - ❌
15783      * - **browsertime-tp6-firefox-microsoft-e10s**
15784        - ❌
15785        - ❌
15786        - ❌
15787        - ❌
15788      * - **browsertime-tp6-firefox-microsoft-fis-e10s**
15789        - ❌
15790        - ❌
15791        - ❌
15792        - ❌
15793      * - **browsertime-tp6-live-chrome-microsoft-e10s**
15794        - ❌
15795        - ❌
15796        - ❌
15797        - ❌
15798      * - **browsertime-tp6-live-chromium-microsoft-e10s**
15799        - ❌
15800        - ❌
15801        - ❌
15802        - ❌
15803      * - **browsertime-tp6-live-firefox-microsoft-e10s**
15804        - ❌
15805        - ❌
15806        - ❌
15807        - ❌
15808      * - **browsertime-tp6-live-firefox-microsoft-fis-e10s**
15809        - ❌
15810        - ❌
15811        - ❌
15812        - ❌
15813
15814
15815   .. list-table:: **test-windows10-64-qr/opt**
15816      :widths: 30 15 15 15 15
15817      :header-rows: 1
15818
15819      * - **Test Name**
15820        - mozilla-central
15821        - autoland
15822        - mozilla-release
15823        - mozilla-beta
15824      * - **browsertime-tp6-firefox-microsoft-e10s**
15825        - ❌
15826        - ❌
15827        - ❌
15828        - ❌
15829      * - **browsertime-tp6-firefox-microsoft-fis-e10s**
15830        - ❌
15831        - ❌
15832        - ❌
15833        - ❌
15834      * - **browsertime-tp6-live-firefox-microsoft-e10s**
15835        - ❌
15836        - ❌
15837        - ❌
15838        - ❌
15839      * - **browsertime-tp6-live-firefox-microsoft-fis-e10s**
15840        - ❌
15841        - ❌
15842        - ❌
15843        - ❌
15844
15845
15846   .. list-table:: **test-windows10-64-shippable-qr/opt**
15847      :widths: 30 15 15 15 15
15848      :header-rows: 1
15849
15850      * - **Test Name**
15851        - mozilla-central
15852        - autoland
15853        - mozilla-release
15854        - mozilla-beta
15855      * - **browsertime-tp6-chrome-microsoft-e10s**
15856        - ❌
15857        - ❌
15858        - ❌
15859        - ❌
15860      * - **browsertime-tp6-chromium-microsoft-e10s**
15861        - ❌
15862        - ❌
15863        - ❌
15864        - ❌
15865      * - **browsertime-tp6-firefox-microsoft-e10s**
15866        - ❌
15867        - ❌
15868        - ❌
15869        - ❌
15870      * - **browsertime-tp6-firefox-microsoft-fis-e10s**
15871        - ✅
15872        - ✅
15873        - ✅
15874        - ✅
15875      * - **browsertime-tp6-live-chrome-microsoft-e10s**
15876        - ❌
15877        - ❌
15878        - ❌
15879        - ❌
15880      * - **browsertime-tp6-live-chromium-microsoft-e10s**
15881        - ❌
15882        - ❌
15883        - ❌
15884        - ❌
15885      * - **browsertime-tp6-live-firefox-microsoft-e10s**
15886        - ❌
15887        - ❌
15888        - ❌
15889        - ❌
15890      * - **browsertime-tp6-live-firefox-microsoft-fis-e10s**
15891        - ❌
15892        - ❌
15893        - ❌
15894        - ❌
15895
15896
15897
15898.. dropdown:: netflix
15899   :container: + anchor-id-netflix-d
15900
15901   **Owner**: PerfTest Team
15902
15903   * **alert on**: fcp, loadtime
15904   * **alert threshold**: 2.0
15905   * **apps**: firefox, chrome, chromium
15906   * **browser cycles**: 25
15907   * **expected**: pass
15908   * **gecko profile entries**: 14000000
15909   * **gecko profile interval**: 1
15910   * **lower is better**: true
15911   * **measure**: fnbpaint, fcp, dcf, loadtime
15912   * **page cycles**: 25
15913   * **page timeout**: 60000
15914   * **playback**: mitmproxy
15915   * **playback pageset manifest**: mitm6-linux-firefox-netflix.manifest
15916   * **playback version**: 6.0.2
15917   * **secondary url**: `<https://www.netflix.com/title/699257>`__
15918   * **test url**: `<https://www.netflix.com/title/80117263>`__
15919   * **type**: pageload
15920   * **unit**: ms
15921   * **use live sites**: false
15922   * **Test Task**:
15923
15924   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
15925      :widths: 30 15 15 15 15
15926      :header-rows: 1
15927
15928      * - **Test Name**
15929        - mozilla-central
15930        - autoland
15931        - mozilla-release
15932        - mozilla-beta
15933      * - **browsertime-tp6-firefox-netflix-e10s**
15934        - ❌
15935        - ❌
15936        - ❌
15937        - ❌
15938      * - **browsertime-tp6-firefox-netflix-fis-e10s**
15939        - ❌
15940        - ❌
15941        - ❌
15942        - ❌
15943      * - **browsertime-tp6-live-firefox-netflix-e10s**
15944        - ❌
15945        - ❌
15946        - ❌
15947        - ❌
15948      * - **browsertime-tp6-live-firefox-netflix-fis-e10s**
15949        - ❌
15950        - ❌
15951        - ❌
15952        - ❌
15953
15954
15955   .. list-table:: **test-linux1804-64-qr/opt**
15956      :widths: 30 15 15 15 15
15957      :header-rows: 1
15958
15959      * - **Test Name**
15960        - mozilla-central
15961        - autoland
15962        - mozilla-release
15963        - mozilla-beta
15964      * - **browsertime-tp6-firefox-netflix-e10s**
15965        - ❌
15966        - ❌
15967        - ❌
15968        - ❌
15969      * - **browsertime-tp6-firefox-netflix-fis-e10s**
15970        - ❌
15971        - ❌
15972        - ❌
15973        - ❌
15974      * - **browsertime-tp6-live-firefox-netflix-e10s**
15975        - ❌
15976        - ❌
15977        - ❌
15978        - ❌
15979      * - **browsertime-tp6-live-firefox-netflix-fis-e10s**
15980        - ❌
15981        - ❌
15982        - ❌
15983        - ❌
15984
15985
15986   .. list-table:: **test-linux1804-64-shippable-qr/opt**
15987      :widths: 30 15 15 15 15
15988      :header-rows: 1
15989
15990      * - **Test Name**
15991        - mozilla-central
15992        - autoland
15993        - mozilla-release
15994        - mozilla-beta
15995      * - **browsertime-tp6-chrome-netflix-e10s**
15996        - ❌
15997        - ❌
15998        - ❌
15999        - ❌
16000      * - **browsertime-tp6-chromium-netflix-e10s**
16001        - ❌
16002        - ❌
16003        - ❌
16004        - ❌
16005      * - **browsertime-tp6-firefox-netflix-e10s**
16006        - ❌
16007        - ❌
16008        - ❌
16009        - ❌
16010      * - **browsertime-tp6-firefox-netflix-fis-e10s**
16011        - ✅
16012        - ✅
16013        - ✅
16014        - ✅
16015      * - **browsertime-tp6-live-chrome-netflix-e10s**
16016        - ❌
16017        - ❌
16018        - ❌
16019        - ❌
16020      * - **browsertime-tp6-live-chromium-netflix-e10s**
16021        - ❌
16022        - ❌
16023        - ❌
16024        - ❌
16025      * - **browsertime-tp6-live-firefox-netflix-e10s**
16026        - ❌
16027        - ❌
16028        - ❌
16029        - ❌
16030      * - **browsertime-tp6-live-firefox-netflix-fis-e10s**
16031        - ❌
16032        - ❌
16033        - ❌
16034        - ❌
16035
16036
16037   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
16038      :widths: 30 15 15 15 15
16039      :header-rows: 1
16040
16041      * - **Test Name**
16042        - mozilla-central
16043        - autoland
16044        - mozilla-release
16045        - mozilla-beta
16046      * - **browsertime-tp6-chrome-netflix-e10s**
16047        - ❌
16048        - ❌
16049        - ❌
16050        - ❌
16051      * - **browsertime-tp6-chromium-netflix-e10s**
16052        - ❌
16053        - ❌
16054        - ❌
16055        - ❌
16056      * - **browsertime-tp6-firefox-netflix-e10s**
16057        - ❌
16058        - ❌
16059        - ❌
16060        - ❌
16061      * - **browsertime-tp6-firefox-netflix-fis-e10s**
16062        - ❌
16063        - ❌
16064        - ❌
16065        - ❌
16066      * - **browsertime-tp6-live-chrome-netflix-e10s**
16067        - ❌
16068        - ❌
16069        - ❌
16070        - ❌
16071      * - **browsertime-tp6-live-chromium-netflix-e10s**
16072        - ❌
16073        - ❌
16074        - ❌
16075        - ❌
16076      * - **browsertime-tp6-live-firefox-netflix-e10s**
16077        - ❌
16078        - ❌
16079        - ❌
16080        - ❌
16081      * - **browsertime-tp6-live-firefox-netflix-fis-e10s**
16082        - ❌
16083        - ❌
16084        - ❌
16085        - ❌
16086
16087
16088   .. list-table:: **test-windows10-32-qr/opt**
16089      :widths: 30 15 15 15 15
16090      :header-rows: 1
16091
16092      * - **Test Name**
16093        - mozilla-central
16094        - autoland
16095        - mozilla-release
16096        - mozilla-beta
16097      * - **browsertime-tp6-firefox-netflix-e10s**
16098        - ❌
16099        - ❌
16100        - ❌
16101        - ❌
16102      * - **browsertime-tp6-firefox-netflix-fis-e10s**
16103        - ❌
16104        - ❌
16105        - ❌
16106        - ❌
16107      * - **browsertime-tp6-live-firefox-netflix-e10s**
16108        - ❌
16109        - ❌
16110        - ❌
16111        - ❌
16112      * - **browsertime-tp6-live-firefox-netflix-fis-e10s**
16113        - ❌
16114        - ❌
16115        - ❌
16116        - ❌
16117
16118
16119   .. list-table:: **test-windows10-32-shippable-qr/opt**
16120      :widths: 30 15 15 15 15
16121      :header-rows: 1
16122
16123      * - **Test Name**
16124        - mozilla-central
16125        - autoland
16126        - mozilla-release
16127        - mozilla-beta
16128      * - **browsertime-tp6-chrome-netflix-e10s**
16129        - ❌
16130        - ❌
16131        - ❌
16132        - ❌
16133      * - **browsertime-tp6-chromium-netflix-e10s**
16134        - ❌
16135        - ❌
16136        - ❌
16137        - ❌
16138      * - **browsertime-tp6-firefox-netflix-e10s**
16139        - ❌
16140        - ❌
16141        - ❌
16142        - ❌
16143      * - **browsertime-tp6-firefox-netflix-fis-e10s**
16144        - ❌
16145        - ❌
16146        - ❌
16147        - ❌
16148      * - **browsertime-tp6-live-chrome-netflix-e10s**
16149        - ❌
16150        - ❌
16151        - ❌
16152        - ❌
16153      * - **browsertime-tp6-live-chromium-netflix-e10s**
16154        - ❌
16155        - ❌
16156        - ❌
16157        - ❌
16158      * - **browsertime-tp6-live-firefox-netflix-e10s**
16159        - ❌
16160        - ❌
16161        - ❌
16162        - ❌
16163      * - **browsertime-tp6-live-firefox-netflix-fis-e10s**
16164        - ❌
16165        - ❌
16166        - ❌
16167        - ❌
16168
16169
16170   .. list-table:: **test-windows10-64-qr/opt**
16171      :widths: 30 15 15 15 15
16172      :header-rows: 1
16173
16174      * - **Test Name**
16175        - mozilla-central
16176        - autoland
16177        - mozilla-release
16178        - mozilla-beta
16179      * - **browsertime-tp6-firefox-netflix-e10s**
16180        - ❌
16181        - ❌
16182        - ❌
16183        - ❌
16184      * - **browsertime-tp6-firefox-netflix-fis-e10s**
16185        - ❌
16186        - ❌
16187        - ❌
16188        - ❌
16189      * - **browsertime-tp6-live-firefox-netflix-e10s**
16190        - ❌
16191        - ❌
16192        - ❌
16193        - ❌
16194      * - **browsertime-tp6-live-firefox-netflix-fis-e10s**
16195        - ❌
16196        - ❌
16197        - ❌
16198        - ❌
16199
16200
16201   .. list-table:: **test-windows10-64-shippable-qr/opt**
16202      :widths: 30 15 15 15 15
16203      :header-rows: 1
16204
16205      * - **Test Name**
16206        - mozilla-central
16207        - autoland
16208        - mozilla-release
16209        - mozilla-beta
16210      * - **browsertime-tp6-chrome-netflix-e10s**
16211        - ❌
16212        - ❌
16213        - ❌
16214        - ❌
16215      * - **browsertime-tp6-chromium-netflix-e10s**
16216        - ❌
16217        - ❌
16218        - ❌
16219        - ❌
16220      * - **browsertime-tp6-firefox-netflix-e10s**
16221        - ❌
16222        - ❌
16223        - ❌
16224        - ❌
16225      * - **browsertime-tp6-firefox-netflix-fis-e10s**
16226        - ✅
16227        - ✅
16228        - ✅
16229        - ✅
16230      * - **browsertime-tp6-live-chrome-netflix-e10s**
16231        - ❌
16232        - ❌
16233        - ❌
16234        - ❌
16235      * - **browsertime-tp6-live-chromium-netflix-e10s**
16236        - ❌
16237        - ❌
16238        - ❌
16239        - ❌
16240      * - **browsertime-tp6-live-firefox-netflix-e10s**
16241        - ❌
16242        - ❌
16243        - ❌
16244        - ❌
16245      * - **browsertime-tp6-live-firefox-netflix-fis-e10s**
16246        - ❌
16247        - ❌
16248        - ❌
16249        - ❌
16250
16251
16252
16253.. dropdown:: nytimes
16254   :container: + anchor-id-nytimes-d
16255
16256   **Owner**: PerfTest Team
16257
16258   * **alert on**: fcp, loadtime
16259   * **alert threshold**: 2.0
16260   * **apps**: firefox, chrome, chromium
16261   * **browser cycles**: 25
16262   * **expected**: pass
16263   * **gecko profile entries**: 14000000
16264   * **gecko profile interval**: 1
16265   * **lower is better**: true
16266   * **measure**: fnbpaint, fcp, dcf, loadtime
16267   * **page cycles**: 25
16268   * **page timeout**: 60000
16269   * **playback**: mitmproxy
16270   * **playback pageset manifest**: mitm7-linux-firefox-nytimes.manifest
16271   * **playback version**: 7.0.4
16272   * **secondary url**: `<https://www.nytimes.com/section/opinion/columnists>`__
16273   * **test url**: `<https://www.nytimes.com/2020/02/19/opinion/surprise-medical-bill.html>`__
16274   * **type**: pageload
16275   * **unit**: ms
16276   * **use live sites**: false
16277   * **Test Task**:
16278
16279   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
16280      :widths: 30 15 15 15 15
16281      :header-rows: 1
16282
16283      * - **Test Name**
16284        - mozilla-central
16285        - autoland
16286        - mozilla-release
16287        - mozilla-beta
16288      * - **browsertime-tp6m-live-fenix-nytimes-e10s**
16289        - ❌
16290        - ❌
16291        - ❌
16292        - ❌
16293      * - **browsertime-tp6m-live-geckoview-nytimes-e10s**
16294        - ❌
16295        - ❌
16296        - ❌
16297        - ❌
16298
16299
16300   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
16301      :widths: 30 15 15 15 15
16302      :header-rows: 1
16303
16304      * - **Test Name**
16305        - mozilla-central
16306        - autoland
16307        - mozilla-release
16308        - mozilla-beta
16309      * - **browsertime-tp6m-live-chrome-m-nytimes-e10s**
16310        - ❌
16311        - ❌
16312        - ❌
16313        - ❌
16314      * - **browsertime-tp6m-live-fenix-nytimes-e10s**
16315        - ❌
16316        - ❌
16317        - ❌
16318        - ❌
16319      * - **browsertime-tp6m-live-geckoview-nytimes-e10s**
16320        - ❌
16321        - ❌
16322        - ❌
16323        - ❌
16324
16325
16326   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
16327      :widths: 30 15 15 15 15
16328      :header-rows: 1
16329
16330      * - **Test Name**
16331        - mozilla-central
16332        - autoland
16333        - mozilla-release
16334        - mozilla-beta
16335      * - **browsertime-tp6m-live-fenix-nytimes-e10s**
16336        - ❌
16337        - ❌
16338        - ❌
16339        - ❌
16340      * - **browsertime-tp6m-live-geckoview-nytimes-e10s**
16341        - ❌
16342        - ❌
16343        - ❌
16344        - ❌
16345
16346
16347   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
16348      :widths: 30 15 15 15 15
16349      :header-rows: 1
16350
16351      * - **Test Name**
16352        - mozilla-central
16353        - autoland
16354        - mozilla-release
16355        - mozilla-beta
16356      * - **browsertime-tp6m-live-chrome-m-nytimes-e10s**
16357        - ❌
16358        - ❌
16359        - ❌
16360        - ❌
16361      * - **browsertime-tp6m-live-fenix-nytimes-e10s**
16362        - ❌
16363        - ❌
16364        - ❌
16365        - ❌
16366      * - **browsertime-tp6m-live-geckoview-nytimes-e10s**
16367        - ❌
16368        - ❌
16369        - ❌
16370        - ❌
16371
16372
16373   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
16374      :widths: 30 15 15 15 15
16375      :header-rows: 1
16376
16377      * - **Test Name**
16378        - mozilla-central
16379        - autoland
16380        - mozilla-release
16381        - mozilla-beta
16382      * - **browsertime-tp6m-live-fenix-nytimes-e10s**
16383        - ❌
16384        - ❌
16385        - ❌
16386        - ❌
16387      * - **browsertime-tp6m-live-geckoview-nytimes-e10s**
16388        - ❌
16389        - ❌
16390        - ❌
16391        - ❌
16392
16393
16394   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
16395      :widths: 30 15 15 15 15
16396      :header-rows: 1
16397
16398      * - **Test Name**
16399        - mozilla-central
16400        - autoland
16401        - mozilla-release
16402        - mozilla-beta
16403      * - **browsertime-tp6m-live-chrome-m-nytimes-e10s**
16404        - ❌
16405        - ❌
16406        - ❌
16407        - ❌
16408      * - **browsertime-tp6m-live-fenix-nytimes-e10s**
16409        - ❌
16410        - ❌
16411        - ❌
16412        - ❌
16413      * - **browsertime-tp6m-live-geckoview-nytimes-e10s**
16414        - ❌
16415        - ❌
16416        - ❌
16417        - ❌
16418
16419
16420   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
16421      :widths: 30 15 15 15 15
16422      :header-rows: 1
16423
16424      * - **Test Name**
16425        - mozilla-central
16426        - autoland
16427        - mozilla-release
16428        - mozilla-beta
16429      * - **browsertime-tp6m-live-fenix-nytimes-e10s**
16430        - ❌
16431        - ❌
16432        - ❌
16433        - ❌
16434      * - **browsertime-tp6m-live-geckoview-nytimes-e10s**
16435        - ❌
16436        - ❌
16437        - ❌
16438        - ❌
16439
16440
16441   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
16442      :widths: 30 15 15 15 15
16443      :header-rows: 1
16444
16445      * - **Test Name**
16446        - mozilla-central
16447        - autoland
16448        - mozilla-release
16449        - mozilla-beta
16450      * - **browsertime-tp6m-live-chrome-m-nytimes-e10s**
16451        - ❌
16452        - ❌
16453        - ❌
16454        - ❌
16455      * - **browsertime-tp6m-live-fenix-nytimes-e10s**
16456        - ❌
16457        - ❌
16458        - ❌
16459        - ❌
16460      * - **browsertime-tp6m-live-geckoview-nytimes-e10s**
16461        - ❌
16462        - ❌
16463        - ❌
16464        - ❌
16465
16466
16467   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
16468      :widths: 30 15 15 15 15
16469      :header-rows: 1
16470
16471      * - **Test Name**
16472        - mozilla-central
16473        - autoland
16474        - mozilla-release
16475        - mozilla-beta
16476      * - **browsertime-tp6-firefox-nytimes-e10s**
16477        - ❌
16478        - ❌
16479        - ❌
16480        - ❌
16481      * - **browsertime-tp6-firefox-nytimes-fis-e10s**
16482        - ❌
16483        - ❌
16484        - ❌
16485        - ❌
16486
16487
16488   .. list-table:: **test-linux1804-64-qr/opt**
16489      :widths: 30 15 15 15 15
16490      :header-rows: 1
16491
16492      * - **Test Name**
16493        - mozilla-central
16494        - autoland
16495        - mozilla-release
16496        - mozilla-beta
16497      * - **browsertime-tp6-firefox-nytimes-e10s**
16498        - ❌
16499        - ❌
16500        - ❌
16501        - ❌
16502      * - **browsertime-tp6-firefox-nytimes-fis-e10s**
16503        - ❌
16504        - ❌
16505        - ❌
16506        - ❌
16507
16508
16509   .. list-table:: **test-linux1804-64-shippable-qr/opt**
16510      :widths: 30 15 15 15 15
16511      :header-rows: 1
16512
16513      * - **Test Name**
16514        - mozilla-central
16515        - autoland
16516        - mozilla-release
16517        - mozilla-beta
16518      * - **browsertime-tp6-chrome-nytimes-e10s**
16519        - ❌
16520        - ❌
16521        - ❌
16522        - ❌
16523      * - **browsertime-tp6-chromium-nytimes-e10s**
16524        - ❌
16525        - ❌
16526        - ❌
16527        - ❌
16528      * - **browsertime-tp6-firefox-nytimes-e10s**
16529        - ❌
16530        - ❌
16531        - ❌
16532        - ❌
16533      * - **browsertime-tp6-firefox-nytimes-fis-e10s**
16534        - ✅
16535        - ✅
16536        - ✅
16537        - ✅
16538
16539
16540   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
16541      :widths: 30 15 15 15 15
16542      :header-rows: 1
16543
16544      * - **Test Name**
16545        - mozilla-central
16546        - autoland
16547        - mozilla-release
16548        - mozilla-beta
16549      * - **browsertime-tp6-chrome-nytimes-e10s**
16550        - ❌
16551        - ❌
16552        - ❌
16553        - ❌
16554      * - **browsertime-tp6-chromium-nytimes-e10s**
16555        - ❌
16556        - ❌
16557        - ❌
16558        - ❌
16559      * - **browsertime-tp6-firefox-nytimes-e10s**
16560        - ❌
16561        - ❌
16562        - ❌
16563        - ❌
16564      * - **browsertime-tp6-firefox-nytimes-fis-e10s**
16565        - ✅
16566        - ✅
16567        - ✅
16568        - ✅
16569
16570
16571   .. list-table:: **test-windows10-32-qr/opt**
16572      :widths: 30 15 15 15 15
16573      :header-rows: 1
16574
16575      * - **Test Name**
16576        - mozilla-central
16577        - autoland
16578        - mozilla-release
16579        - mozilla-beta
16580      * - **browsertime-tp6-firefox-nytimes-e10s**
16581        - ❌
16582        - ❌
16583        - ❌
16584        - ❌
16585      * - **browsertime-tp6-firefox-nytimes-fis-e10s**
16586        - ❌
16587        - ❌
16588        - ❌
16589        - ❌
16590
16591
16592   .. list-table:: **test-windows10-32-shippable-qr/opt**
16593      :widths: 30 15 15 15 15
16594      :header-rows: 1
16595
16596      * - **Test Name**
16597        - mozilla-central
16598        - autoland
16599        - mozilla-release
16600        - mozilla-beta
16601      * - **browsertime-tp6-chrome-nytimes-e10s**
16602        - ❌
16603        - ❌
16604        - ❌
16605        - ❌
16606      * - **browsertime-tp6-chromium-nytimes-e10s**
16607        - ❌
16608        - ❌
16609        - ❌
16610        - ❌
16611      * - **browsertime-tp6-firefox-nytimes-e10s**
16612        - ❌
16613        - ❌
16614        - ❌
16615        - ❌
16616      * - **browsertime-tp6-firefox-nytimes-fis-e10s**
16617        - ❌
16618        - ❌
16619        - ❌
16620        - ❌
16621
16622
16623   .. list-table:: **test-windows10-64-qr/opt**
16624      :widths: 30 15 15 15 15
16625      :header-rows: 1
16626
16627      * - **Test Name**
16628        - mozilla-central
16629        - autoland
16630        - mozilla-release
16631        - mozilla-beta
16632      * - **browsertime-tp6-firefox-nytimes-e10s**
16633        - ❌
16634        - ❌
16635        - ❌
16636        - ❌
16637      * - **browsertime-tp6-firefox-nytimes-fis-e10s**
16638        - ❌
16639        - ❌
16640        - ❌
16641        - ❌
16642
16643
16644   .. list-table:: **test-windows10-64-shippable-qr/opt**
16645      :widths: 30 15 15 15 15
16646      :header-rows: 1
16647
16648      * - **Test Name**
16649        - mozilla-central
16650        - autoland
16651        - mozilla-release
16652        - mozilla-beta
16653      * - **browsertime-tp6-chrome-nytimes-e10s**
16654        - ❌
16655        - ❌
16656        - ❌
16657        - ❌
16658      * - **browsertime-tp6-chromium-nytimes-e10s**
16659        - ❌
16660        - ❌
16661        - ❌
16662        - ❌
16663      * - **browsertime-tp6-firefox-nytimes-e10s**
16664        - ❌
16665        - ❌
16666        - ❌
16667        - ❌
16668      * - **browsertime-tp6-firefox-nytimes-fis-e10s**
16669        - ✅
16670        - ✅
16671        - ✅
16672        - ✅
16673
16674
16675
16676.. dropdown:: office
16677   :container: + anchor-id-office-d
16678
16679   **Owner**: PerfTest Team
16680
16681   * **alert on**: fcp, loadtime
16682   * **alert threshold**: 2.0
16683   * **apps**: firefox, chrome, chromium
16684   * **browser cycles**: 25
16685   * **expected**: pass
16686   * **gecko profile entries**: 14000000
16687   * **gecko profile interval**: 1
16688   * **lower is better**: true
16689   * **measure**: fnbpaint, fcp, dcf, loadtime
16690   * **page cycles**: 25
16691   * **page timeout**: 60000
16692   * **playback**: mitmproxy
16693   * **playback pageset manifest**: mitm7-linux-firefox-office.manifest
16694   * **playback version**: 7.0.4
16695   * **secondary url**: `<https://www.office.com/>`__
16696   * **test url**: `<https://www.office.com/launch/powerpoint?auth=1>`__
16697   * **type**: pageload
16698   * **unit**: ms
16699   * **use live sites**: false
16700   * **Test Task**:
16701
16702   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
16703      :widths: 30 15 15 15 15
16704      :header-rows: 1
16705
16706      * - **Test Name**
16707        - mozilla-central
16708        - autoland
16709        - mozilla-release
16710        - mozilla-beta
16711      * - **browsertime-tp6-firefox-office-e10s**
16712        - ❌
16713        - ❌
16714        - ❌
16715        - ❌
16716      * - **browsertime-tp6-firefox-office-fis-e10s**
16717        - ❌
16718        - ❌
16719        - ❌
16720        - ❌
16721
16722
16723   .. list-table:: **test-linux1804-64-qr/opt**
16724      :widths: 30 15 15 15 15
16725      :header-rows: 1
16726
16727      * - **Test Name**
16728        - mozilla-central
16729        - autoland
16730        - mozilla-release
16731        - mozilla-beta
16732      * - **browsertime-tp6-firefox-office-e10s**
16733        - ❌
16734        - ❌
16735        - ❌
16736        - ❌
16737      * - **browsertime-tp6-firefox-office-fis-e10s**
16738        - ❌
16739        - ❌
16740        - ❌
16741        - ❌
16742
16743
16744   .. list-table:: **test-linux1804-64-shippable-qr/opt**
16745      :widths: 30 15 15 15 15
16746      :header-rows: 1
16747
16748      * - **Test Name**
16749        - mozilla-central
16750        - autoland
16751        - mozilla-release
16752        - mozilla-beta
16753      * - **browsertime-tp6-chrome-office-e10s**
16754        - ❌
16755        - ❌
16756        - ❌
16757        - ❌
16758      * - **browsertime-tp6-chromium-office-e10s**
16759        - ❌
16760        - ❌
16761        - ❌
16762        - ❌
16763      * - **browsertime-tp6-firefox-office-e10s**
16764        - ❌
16765        - ❌
16766        - ❌
16767        - ❌
16768      * - **browsertime-tp6-firefox-office-fis-e10s**
16769        - ✅
16770        - ✅
16771        - ✅
16772        - ✅
16773
16774
16775   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
16776      :widths: 30 15 15 15 15
16777      :header-rows: 1
16778
16779      * - **Test Name**
16780        - mozilla-central
16781        - autoland
16782        - mozilla-release
16783        - mozilla-beta
16784      * - **browsertime-tp6-chrome-office-e10s**
16785        - ❌
16786        - ❌
16787        - ❌
16788        - ❌
16789      * - **browsertime-tp6-chromium-office-e10s**
16790        - ❌
16791        - ❌
16792        - ❌
16793        - ❌
16794      * - **browsertime-tp6-firefox-office-e10s**
16795        - ❌
16796        - ❌
16797        - ❌
16798        - ❌
16799      * - **browsertime-tp6-firefox-office-fis-e10s**
16800        - ✅
16801        - ✅
16802        - ✅
16803        - ✅
16804
16805
16806   .. list-table:: **test-windows10-32-qr/opt**
16807      :widths: 30 15 15 15 15
16808      :header-rows: 1
16809
16810      * - **Test Name**
16811        - mozilla-central
16812        - autoland
16813        - mozilla-release
16814        - mozilla-beta
16815      * - **browsertime-tp6-firefox-office-e10s**
16816        - ❌
16817        - ❌
16818        - ❌
16819        - ❌
16820      * - **browsertime-tp6-firefox-office-fis-e10s**
16821        - ❌
16822        - ❌
16823        - ❌
16824        - ❌
16825
16826
16827   .. list-table:: **test-windows10-32-shippable-qr/opt**
16828      :widths: 30 15 15 15 15
16829      :header-rows: 1
16830
16831      * - **Test Name**
16832        - mozilla-central
16833        - autoland
16834        - mozilla-release
16835        - mozilla-beta
16836      * - **browsertime-tp6-chrome-office-e10s**
16837        - ❌
16838        - ❌
16839        - ❌
16840        - ❌
16841      * - **browsertime-tp6-chromium-office-e10s**
16842        - ❌
16843        - ❌
16844        - ❌
16845        - ❌
16846      * - **browsertime-tp6-firefox-office-e10s**
16847        - ❌
16848        - ❌
16849        - ❌
16850        - ❌
16851      * - **browsertime-tp6-firefox-office-fis-e10s**
16852        - ❌
16853        - ❌
16854        - ❌
16855        - ❌
16856
16857
16858   .. list-table:: **test-windows10-64-qr/opt**
16859      :widths: 30 15 15 15 15
16860      :header-rows: 1
16861
16862      * - **Test Name**
16863        - mozilla-central
16864        - autoland
16865        - mozilla-release
16866        - mozilla-beta
16867      * - **browsertime-tp6-firefox-office-e10s**
16868        - ❌
16869        - ❌
16870        - ❌
16871        - ❌
16872      * - **browsertime-tp6-firefox-office-fis-e10s**
16873        - ❌
16874        - ❌
16875        - ❌
16876        - ❌
16877
16878
16879   .. list-table:: **test-windows10-64-shippable-qr/opt**
16880      :widths: 30 15 15 15 15
16881      :header-rows: 1
16882
16883      * - **Test Name**
16884        - mozilla-central
16885        - autoland
16886        - mozilla-release
16887        - mozilla-beta
16888      * - **browsertime-tp6-chrome-office-e10s**
16889        - ❌
16890        - ❌
16891        - ❌
16892        - ❌
16893      * - **browsertime-tp6-chromium-office-e10s**
16894        - ❌
16895        - ❌
16896        - ❌
16897        - ❌
16898      * - **browsertime-tp6-firefox-office-e10s**
16899        - ❌
16900        - ❌
16901        - ❌
16902        - ❌
16903      * - **browsertime-tp6-firefox-office-fis-e10s**
16904        - ✅
16905        - ✅
16906        - ✅
16907        - ✅
16908
16909
16910
16911.. dropdown:: outlook
16912   :container: + anchor-id-outlook-d
16913
16914   **Owner**: PerfTest Team
16915
16916   * **alert on**: fcp, loadtime
16917   * **alert threshold**: 2.0
16918   * **apps**: firefox, chrome, chromium
16919   * **browser cycles**: 25
16920   * **expected**: pass
16921   * **gecko profile entries**: 14000000
16922   * **gecko profile interval**: 1
16923   * **lower is better**: true
16924   * **measure**: fnbpaint, fcp, dcf, loadtime
16925   * **page cycles**: 25
16926   * **page timeout**: 60000
16927   * **playback**: mitmproxy
16928   * **playback pageset manifest**: mitm5-linux-firefox-live.manifest
16929   * **playback version**: 5.1.1
16930   * **test url**: `<https://outlook.live.com/mail/inbox>`__
16931   * **type**: pageload
16932   * **unit**: ms
16933   * **use live sites**: false
16934   * **Test Task**:
16935
16936   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
16937      :widths: 30 15 15 15 15
16938      :header-rows: 1
16939
16940      * - **Test Name**
16941        - mozilla-central
16942        - autoland
16943        - mozilla-release
16944        - mozilla-beta
16945      * - **browsertime-tp6-firefox-outlook-e10s**
16946        - ❌
16947        - ❌
16948        - ❌
16949        - ❌
16950      * - **browsertime-tp6-firefox-outlook-fis-e10s**
16951        - ❌
16952        - ❌
16953        - ❌
16954        - ❌
16955      * - **browsertime-tp6-live-firefox-outlook-e10s**
16956        - ❌
16957        - ❌
16958        - ❌
16959        - ❌
16960      * - **browsertime-tp6-live-firefox-outlook-fis-e10s**
16961        - ❌
16962        - ❌
16963        - ❌
16964        - ❌
16965
16966
16967   .. list-table:: **test-linux1804-64-qr/opt**
16968      :widths: 30 15 15 15 15
16969      :header-rows: 1
16970
16971      * - **Test Name**
16972        - mozilla-central
16973        - autoland
16974        - mozilla-release
16975        - mozilla-beta
16976      * - **browsertime-tp6-firefox-outlook-e10s**
16977        - ❌
16978        - ❌
16979        - ❌
16980        - ❌
16981      * - **browsertime-tp6-firefox-outlook-fis-e10s**
16982        - ❌
16983        - ❌
16984        - ❌
16985        - ❌
16986      * - **browsertime-tp6-live-firefox-outlook-e10s**
16987        - ❌
16988        - ❌
16989        - ❌
16990        - ❌
16991      * - **browsertime-tp6-live-firefox-outlook-fis-e10s**
16992        - ❌
16993        - ❌
16994        - ❌
16995        - ❌
16996
16997
16998   .. list-table:: **test-linux1804-64-shippable-qr/opt**
16999      :widths: 30 15 15 15 15
17000      :header-rows: 1
17001
17002      * - **Test Name**
17003        - mozilla-central
17004        - autoland
17005        - mozilla-release
17006        - mozilla-beta
17007      * - **browsertime-tp6-chrome-outlook-e10s**
17008        - ❌
17009        - ❌
17010        - ❌
17011        - ❌
17012      * - **browsertime-tp6-chromium-outlook-e10s**
17013        - ❌
17014        - ❌
17015        - ❌
17016        - ❌
17017      * - **browsertime-tp6-firefox-outlook-e10s**
17018        - ❌
17019        - ❌
17020        - ❌
17021        - ❌
17022      * - **browsertime-tp6-firefox-outlook-fis-e10s**
17023        - ✅
17024        - ✅
17025        - ✅
17026        - ✅
17027      * - **browsertime-tp6-live-chrome-outlook-e10s**
17028        - ❌
17029        - ❌
17030        - ❌
17031        - ❌
17032      * - **browsertime-tp6-live-chromium-outlook-e10s**
17033        - ❌
17034        - ❌
17035        - ❌
17036        - ❌
17037      * - **browsertime-tp6-live-firefox-outlook-e10s**
17038        - ❌
17039        - ❌
17040        - ❌
17041        - ❌
17042      * - **browsertime-tp6-live-firefox-outlook-fis-e10s**
17043        - ❌
17044        - ❌
17045        - ❌
17046        - ❌
17047
17048
17049   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
17050      :widths: 30 15 15 15 15
17051      :header-rows: 1
17052
17053      * - **Test Name**
17054        - mozilla-central
17055        - autoland
17056        - mozilla-release
17057        - mozilla-beta
17058      * - **browsertime-tp6-chrome-outlook-e10s**
17059        - ❌
17060        - ❌
17061        - ❌
17062        - ❌
17063      * - **browsertime-tp6-chromium-outlook-e10s**
17064        - ❌
17065        - ❌
17066        - ❌
17067        - ❌
17068      * - **browsertime-tp6-firefox-outlook-e10s**
17069        - ❌
17070        - ❌
17071        - ❌
17072        - ❌
17073      * - **browsertime-tp6-firefox-outlook-fis-e10s**
17074        - ✅
17075        - ✅
17076        - ✅
17077        - ✅
17078      * - **browsertime-tp6-live-chrome-outlook-e10s**
17079        - ❌
17080        - ❌
17081        - ❌
17082        - ❌
17083      * - **browsertime-tp6-live-chromium-outlook-e10s**
17084        - ❌
17085        - ❌
17086        - ❌
17087        - ❌
17088      * - **browsertime-tp6-live-firefox-outlook-e10s**
17089        - ❌
17090        - ❌
17091        - ❌
17092        - ❌
17093      * - **browsertime-tp6-live-firefox-outlook-fis-e10s**
17094        - ❌
17095        - ❌
17096        - ❌
17097        - ❌
17098
17099
17100   .. list-table:: **test-windows10-32-qr/opt**
17101      :widths: 30 15 15 15 15
17102      :header-rows: 1
17103
17104      * - **Test Name**
17105        - mozilla-central
17106        - autoland
17107        - mozilla-release
17108        - mozilla-beta
17109      * - **browsertime-tp6-firefox-outlook-e10s**
17110        - ❌
17111        - ❌
17112        - ❌
17113        - ❌
17114      * - **browsertime-tp6-firefox-outlook-fis-e10s**
17115        - ❌
17116        - ❌
17117        - ❌
17118        - ❌
17119      * - **browsertime-tp6-live-firefox-outlook-e10s**
17120        - ❌
17121        - ❌
17122        - ❌
17123        - ❌
17124      * - **browsertime-tp6-live-firefox-outlook-fis-e10s**
17125        - ❌
17126        - ❌
17127        - ❌
17128        - ❌
17129
17130
17131   .. list-table:: **test-windows10-32-shippable-qr/opt**
17132      :widths: 30 15 15 15 15
17133      :header-rows: 1
17134
17135      * - **Test Name**
17136        - mozilla-central
17137        - autoland
17138        - mozilla-release
17139        - mozilla-beta
17140      * - **browsertime-tp6-chrome-outlook-e10s**
17141        - ❌
17142        - ❌
17143        - ❌
17144        - ❌
17145      * - **browsertime-tp6-chromium-outlook-e10s**
17146        - ❌
17147        - ❌
17148        - ❌
17149        - ❌
17150      * - **browsertime-tp6-firefox-outlook-e10s**
17151        - ❌
17152        - ❌
17153        - ❌
17154        - ❌
17155      * - **browsertime-tp6-firefox-outlook-fis-e10s**
17156        - ❌
17157        - ❌
17158        - ❌
17159        - ❌
17160      * - **browsertime-tp6-live-chrome-outlook-e10s**
17161        - ❌
17162        - ❌
17163        - ❌
17164        - ❌
17165      * - **browsertime-tp6-live-chromium-outlook-e10s**
17166        - ❌
17167        - ❌
17168        - ❌
17169        - ❌
17170      * - **browsertime-tp6-live-firefox-outlook-e10s**
17171        - ❌
17172        - ❌
17173        - ❌
17174        - ❌
17175      * - **browsertime-tp6-live-firefox-outlook-fis-e10s**
17176        - ❌
17177        - ❌
17178        - ❌
17179        - ❌
17180
17181
17182   .. list-table:: **test-windows10-64-qr/opt**
17183      :widths: 30 15 15 15 15
17184      :header-rows: 1
17185
17186      * - **Test Name**
17187        - mozilla-central
17188        - autoland
17189        - mozilla-release
17190        - mozilla-beta
17191      * - **browsertime-tp6-firefox-outlook-e10s**
17192        - ❌
17193        - ❌
17194        - ❌
17195        - ❌
17196      * - **browsertime-tp6-firefox-outlook-fis-e10s**
17197        - ❌
17198        - ❌
17199        - ❌
17200        - ❌
17201      * - **browsertime-tp6-live-firefox-outlook-e10s**
17202        - ❌
17203        - ❌
17204        - ❌
17205        - ❌
17206      * - **browsertime-tp6-live-firefox-outlook-fis-e10s**
17207        - ❌
17208        - ❌
17209        - ❌
17210        - ❌
17211
17212
17213   .. list-table:: **test-windows10-64-shippable-qr/opt**
17214      :widths: 30 15 15 15 15
17215      :header-rows: 1
17216
17217      * - **Test Name**
17218        - mozilla-central
17219        - autoland
17220        - mozilla-release
17221        - mozilla-beta
17222      * - **browsertime-tp6-chrome-outlook-e10s**
17223        - ❌
17224        - ❌
17225        - ❌
17226        - ❌
17227      * - **browsertime-tp6-chromium-outlook-e10s**
17228        - ❌
17229        - ❌
17230        - ❌
17231        - ❌
17232      * - **browsertime-tp6-firefox-outlook-e10s**
17233        - ❌
17234        - ❌
17235        - ❌
17236        - ❌
17237      * - **browsertime-tp6-firefox-outlook-fis-e10s**
17238        - ✅
17239        - ✅
17240        - ✅
17241        - ✅
17242      * - **browsertime-tp6-live-chrome-outlook-e10s**
17243        - ❌
17244        - ❌
17245        - ❌
17246        - ❌
17247      * - **browsertime-tp6-live-chromium-outlook-e10s**
17248        - ❌
17249        - ❌
17250        - ❌
17251        - ❌
17252      * - **browsertime-tp6-live-firefox-outlook-e10s**
17253        - ❌
17254        - ❌
17255        - ❌
17256        - ❌
17257      * - **browsertime-tp6-live-firefox-outlook-fis-e10s**
17258        - ❌
17259        - ❌
17260        - ❌
17261        - ❌
17262
17263
17264
17265.. dropdown:: paypal
17266   :container: + anchor-id-paypal-d
17267
17268   **Owner**: PerfTest Team
17269
17270   * **alert on**: fcp, loadtime
17271   * **alert threshold**: 2.0
17272   * **apps**: firefox, chrome, chromium
17273   * **browser cycles**: 25
17274   * **expected**: pass
17275   * **gecko profile entries**: 14000000
17276   * **gecko profile interval**: 1
17277   * **lower is better**: true
17278   * **measure**: fnbpaint, fcp, dcf, loadtime
17279   * **page cycles**: 25
17280   * **page timeout**: 60000
17281   * **playback**: mitmproxy
17282   * **playback pageset manifest**: mitm5-linux-firefox-paypal.manifest
17283   * **playback version**: 5.1.1
17284   * **test url**: `<https://www.paypal.com/myaccount/summary/>`__
17285   * **type**: pageload
17286   * **unit**: ms
17287   * **use live sites**: false
17288   * **Test Task**:
17289
17290   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
17291      :widths: 30 15 15 15 15
17292      :header-rows: 1
17293
17294      * - **Test Name**
17295        - mozilla-central
17296        - autoland
17297        - mozilla-release
17298        - mozilla-beta
17299      * - **browsertime-tp6-firefox-paypal-e10s**
17300        - ❌
17301        - ❌
17302        - ❌
17303        - ❌
17304      * - **browsertime-tp6-firefox-paypal-fis-e10s**
17305        - ❌
17306        - ❌
17307        - ❌
17308        - ❌
17309      * - **browsertime-tp6-live-firefox-paypal-e10s**
17310        - ❌
17311        - ❌
17312        - ❌
17313        - ❌
17314      * - **browsertime-tp6-live-firefox-paypal-fis-e10s**
17315        - ❌
17316        - ❌
17317        - ❌
17318        - ❌
17319
17320
17321   .. list-table:: **test-linux1804-64-qr/opt**
17322      :widths: 30 15 15 15 15
17323      :header-rows: 1
17324
17325      * - **Test Name**
17326        - mozilla-central
17327        - autoland
17328        - mozilla-release
17329        - mozilla-beta
17330      * - **browsertime-tp6-firefox-paypal-e10s**
17331        - ❌
17332        - ❌
17333        - ❌
17334        - ❌
17335      * - **browsertime-tp6-firefox-paypal-fis-e10s**
17336        - ❌
17337        - ❌
17338        - ❌
17339        - ❌
17340      * - **browsertime-tp6-live-firefox-paypal-e10s**
17341        - ❌
17342        - ❌
17343        - ❌
17344        - ❌
17345      * - **browsertime-tp6-live-firefox-paypal-fis-e10s**
17346        - ❌
17347        - ❌
17348        - ❌
17349        - ❌
17350
17351
17352   .. list-table:: **test-linux1804-64-shippable-qr/opt**
17353      :widths: 30 15 15 15 15
17354      :header-rows: 1
17355
17356      * - **Test Name**
17357        - mozilla-central
17358        - autoland
17359        - mozilla-release
17360        - mozilla-beta
17361      * - **browsertime-tp6-chrome-paypal-e10s**
17362        - ❌
17363        - ❌
17364        - ❌
17365        - ❌
17366      * - **browsertime-tp6-chromium-paypal-e10s**
17367        - ❌
17368        - ❌
17369        - ❌
17370        - ❌
17371      * - **browsertime-tp6-firefox-paypal-e10s**
17372        - ❌
17373        - ❌
17374        - ❌
17375        - ❌
17376      * - **browsertime-tp6-firefox-paypal-fis-e10s**
17377        - ✅
17378        - ✅
17379        - ✅
17380        - ✅
17381      * - **browsertime-tp6-live-chrome-paypal-e10s**
17382        - ❌
17383        - ❌
17384        - ❌
17385        - ❌
17386      * - **browsertime-tp6-live-chromium-paypal-e10s**
17387        - ❌
17388        - ❌
17389        - ❌
17390        - ❌
17391      * - **browsertime-tp6-live-firefox-paypal-e10s**
17392        - ❌
17393        - ❌
17394        - ❌
17395        - ❌
17396      * - **browsertime-tp6-live-firefox-paypal-fis-e10s**
17397        - ❌
17398        - ❌
17399        - ❌
17400        - ❌
17401
17402
17403   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
17404      :widths: 30 15 15 15 15
17405      :header-rows: 1
17406
17407      * - **Test Name**
17408        - mozilla-central
17409        - autoland
17410        - mozilla-release
17411        - mozilla-beta
17412      * - **browsertime-tp6-chrome-paypal-e10s**
17413        - ❌
17414        - ❌
17415        - ❌
17416        - ❌
17417      * - **browsertime-tp6-chromium-paypal-e10s**
17418        - ❌
17419        - ❌
17420        - ❌
17421        - ❌
17422      * - **browsertime-tp6-firefox-paypal-e10s**
17423        - ❌
17424        - ❌
17425        - ❌
17426        - ❌
17427      * - **browsertime-tp6-firefox-paypal-fis-e10s**
17428        - ✅
17429        - ✅
17430        - ✅
17431        - ✅
17432      * - **browsertime-tp6-live-chrome-paypal-e10s**
17433        - ❌
17434        - ❌
17435        - ❌
17436        - ❌
17437      * - **browsertime-tp6-live-chromium-paypal-e10s**
17438        - ❌
17439        - ❌
17440        - ❌
17441        - ❌
17442      * - **browsertime-tp6-live-firefox-paypal-e10s**
17443        - ❌
17444        - ❌
17445        - ❌
17446        - ❌
17447      * - **browsertime-tp6-live-firefox-paypal-fis-e10s**
17448        - ❌
17449        - ❌
17450        - ❌
17451        - ❌
17452
17453
17454   .. list-table:: **test-windows10-32-qr/opt**
17455      :widths: 30 15 15 15 15
17456      :header-rows: 1
17457
17458      * - **Test Name**
17459        - mozilla-central
17460        - autoland
17461        - mozilla-release
17462        - mozilla-beta
17463      * - **browsertime-tp6-firefox-paypal-e10s**
17464        - ❌
17465        - ❌
17466        - ❌
17467        - ❌
17468      * - **browsertime-tp6-firefox-paypal-fis-e10s**
17469        - ❌
17470        - ❌
17471        - ❌
17472        - ❌
17473      * - **browsertime-tp6-live-firefox-paypal-e10s**
17474        - ❌
17475        - ❌
17476        - ❌
17477        - ❌
17478      * - **browsertime-tp6-live-firefox-paypal-fis-e10s**
17479        - ❌
17480        - ❌
17481        - ❌
17482        - ❌
17483
17484
17485   .. list-table:: **test-windows10-32-shippable-qr/opt**
17486      :widths: 30 15 15 15 15
17487      :header-rows: 1
17488
17489      * - **Test Name**
17490        - mozilla-central
17491        - autoland
17492        - mozilla-release
17493        - mozilla-beta
17494      * - **browsertime-tp6-chrome-paypal-e10s**
17495        - ❌
17496        - ❌
17497        - ❌
17498        - ❌
17499      * - **browsertime-tp6-chromium-paypal-e10s**
17500        - ❌
17501        - ❌
17502        - ❌
17503        - ❌
17504      * - **browsertime-tp6-firefox-paypal-e10s**
17505        - ❌
17506        - ❌
17507        - ❌
17508        - ❌
17509      * - **browsertime-tp6-firefox-paypal-fis-e10s**
17510        - ❌
17511        - ❌
17512        - ❌
17513        - ❌
17514      * - **browsertime-tp6-live-chrome-paypal-e10s**
17515        - ❌
17516        - ❌
17517        - ❌
17518        - ❌
17519      * - **browsertime-tp6-live-chromium-paypal-e10s**
17520        - ❌
17521        - ❌
17522        - ❌
17523        - ❌
17524      * - **browsertime-tp6-live-firefox-paypal-e10s**
17525        - ❌
17526        - ❌
17527        - ❌
17528        - ❌
17529      * - **browsertime-tp6-live-firefox-paypal-fis-e10s**
17530        - ❌
17531        - ❌
17532        - ❌
17533        - ❌
17534
17535
17536   .. list-table:: **test-windows10-64-qr/opt**
17537      :widths: 30 15 15 15 15
17538      :header-rows: 1
17539
17540      * - **Test Name**
17541        - mozilla-central
17542        - autoland
17543        - mozilla-release
17544        - mozilla-beta
17545      * - **browsertime-tp6-firefox-paypal-e10s**
17546        - ❌
17547        - ❌
17548        - ❌
17549        - ❌
17550      * - **browsertime-tp6-firefox-paypal-fis-e10s**
17551        - ❌
17552        - ❌
17553        - ❌
17554        - ❌
17555      * - **browsertime-tp6-live-firefox-paypal-e10s**
17556        - ❌
17557        - ❌
17558        - ❌
17559        - ❌
17560      * - **browsertime-tp6-live-firefox-paypal-fis-e10s**
17561        - ❌
17562        - ❌
17563        - ❌
17564        - ❌
17565
17566
17567   .. list-table:: **test-windows10-64-shippable-qr/opt**
17568      :widths: 30 15 15 15 15
17569      :header-rows: 1
17570
17571      * - **Test Name**
17572        - mozilla-central
17573        - autoland
17574        - mozilla-release
17575        - mozilla-beta
17576      * - **browsertime-tp6-chrome-paypal-e10s**
17577        - ❌
17578        - ❌
17579        - ❌
17580        - ❌
17581      * - **browsertime-tp6-chromium-paypal-e10s**
17582        - ❌
17583        - ❌
17584        - ❌
17585        - ❌
17586      * - **browsertime-tp6-firefox-paypal-e10s**
17587        - ❌
17588        - ❌
17589        - ❌
17590        - ❌
17591      * - **browsertime-tp6-firefox-paypal-fis-e10s**
17592        - ✅
17593        - ✅
17594        - ✅
17595        - ✅
17596      * - **browsertime-tp6-live-chrome-paypal-e10s**
17597        - ❌
17598        - ❌
17599        - ❌
17600        - ❌
17601      * - **browsertime-tp6-live-chromium-paypal-e10s**
17602        - ❌
17603        - ❌
17604        - ❌
17605        - ❌
17606      * - **browsertime-tp6-live-firefox-paypal-e10s**
17607        - ❌
17608        - ❌
17609        - ❌
17610        - ❌
17611      * - **browsertime-tp6-live-firefox-paypal-fis-e10s**
17612        - ❌
17613        - ❌
17614        - ❌
17615        - ❌
17616
17617
17618
17619.. dropdown:: pinterest
17620   :container: + anchor-id-pinterest-d
17621
17622   **Owner**: PerfTest Team
17623
17624   * **alert on**: fcp, loadtime
17625   * **alert threshold**: 2.0
17626   * **apps**: firefox, chrome, chromium
17627   * **browser cycles**: 25
17628   * **expected**: pass
17629   * **gecko profile entries**: 14000000
17630   * **gecko profile interval**: 1
17631   * **lower is better**: true
17632   * **measure**: fnbpaint, fcp, dcf, loadtime
17633   * **page cycles**: 25
17634   * **page timeout**: 60000
17635   * **playback**: mitmproxy
17636   * **playback pageset manifest**: mitm6-linux-firefox-pinterest.manifest
17637   * **playback version**: 6.0.2
17638   * **secondary url**: `<https://www.pinterest.com/today/best/halloween-costumes-for-your-furry-friends/75787/>`__
17639   * **test url**: `<https://pinterest.com/>`__
17640   * **type**: pageload
17641   * **unit**: ms
17642   * **use live sites**: false
17643   * **Test Task**:
17644
17645   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
17646      :widths: 30 15 15 15 15
17647      :header-rows: 1
17648
17649      * - **Test Name**
17650        - mozilla-central
17651        - autoland
17652        - mozilla-release
17653        - mozilla-beta
17654      * - **browsertime-tp6-firefox-pinterest-e10s**
17655        - ❌
17656        - ❌
17657        - ❌
17658        - ❌
17659      * - **browsertime-tp6-firefox-pinterest-fis-e10s**
17660        - ❌
17661        - ❌
17662        - ❌
17663        - ❌
17664      * - **browsertime-tp6-live-firefox-pinterest-e10s**
17665        - ❌
17666        - ❌
17667        - ❌
17668        - ❌
17669      * - **browsertime-tp6-live-firefox-pinterest-fis-e10s**
17670        - ❌
17671        - ❌
17672        - ❌
17673        - ❌
17674
17675
17676   .. list-table:: **test-linux1804-64-qr/opt**
17677      :widths: 30 15 15 15 15
17678      :header-rows: 1
17679
17680      * - **Test Name**
17681        - mozilla-central
17682        - autoland
17683        - mozilla-release
17684        - mozilla-beta
17685      * - **browsertime-tp6-firefox-pinterest-e10s**
17686        - ❌
17687        - ❌
17688        - ❌
17689        - ❌
17690      * - **browsertime-tp6-firefox-pinterest-fis-e10s**
17691        - ❌
17692        - ❌
17693        - ❌
17694        - ❌
17695      * - **browsertime-tp6-live-firefox-pinterest-e10s**
17696        - ❌
17697        - ❌
17698        - ❌
17699        - ❌
17700      * - **browsertime-tp6-live-firefox-pinterest-fis-e10s**
17701        - ❌
17702        - ❌
17703        - ❌
17704        - ❌
17705
17706
17707   .. list-table:: **test-linux1804-64-shippable-qr/opt**
17708      :widths: 30 15 15 15 15
17709      :header-rows: 1
17710
17711      * - **Test Name**
17712        - mozilla-central
17713        - autoland
17714        - mozilla-release
17715        - mozilla-beta
17716      * - **browsertime-tp6-chrome-pinterest-e10s**
17717        - ❌
17718        - ❌
17719        - ❌
17720        - ❌
17721      * - **browsertime-tp6-chromium-pinterest-e10s**
17722        - ❌
17723        - ❌
17724        - ❌
17725        - ❌
17726      * - **browsertime-tp6-firefox-pinterest-e10s**
17727        - ❌
17728        - ❌
17729        - ❌
17730        - ❌
17731      * - **browsertime-tp6-firefox-pinterest-fis-e10s**
17732        - ✅
17733        - ✅
17734        - ✅
17735        - ✅
17736      * - **browsertime-tp6-live-chrome-pinterest-e10s**
17737        - ❌
17738        - ❌
17739        - ❌
17740        - ❌
17741      * - **browsertime-tp6-live-chromium-pinterest-e10s**
17742        - ❌
17743        - ❌
17744        - ❌
17745        - ❌
17746      * - **browsertime-tp6-live-firefox-pinterest-e10s**
17747        - ❌
17748        - ❌
17749        - ❌
17750        - ❌
17751      * - **browsertime-tp6-live-firefox-pinterest-fis-e10s**
17752        - ❌
17753        - ❌
17754        - ❌
17755        - ❌
17756
17757
17758   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
17759      :widths: 30 15 15 15 15
17760      :header-rows: 1
17761
17762      * - **Test Name**
17763        - mozilla-central
17764        - autoland
17765        - mozilla-release
17766        - mozilla-beta
17767      * - **browsertime-tp6-chrome-pinterest-e10s**
17768        - ❌
17769        - ❌
17770        - ❌
17771        - ❌
17772      * - **browsertime-tp6-chromium-pinterest-e10s**
17773        - ❌
17774        - ❌
17775        - ❌
17776        - ❌
17777      * - **browsertime-tp6-firefox-pinterest-e10s**
17778        - ❌
17779        - ❌
17780        - ❌
17781        - ❌
17782      * - **browsertime-tp6-firefox-pinterest-fis-e10s**
17783        - ✅
17784        - ✅
17785        - ✅
17786        - ✅
17787      * - **browsertime-tp6-live-chrome-pinterest-e10s**
17788        - ❌
17789        - ❌
17790        - ❌
17791        - ❌
17792      * - **browsertime-tp6-live-chromium-pinterest-e10s**
17793        - ❌
17794        - ❌
17795        - ❌
17796        - ❌
17797      * - **browsertime-tp6-live-firefox-pinterest-e10s**
17798        - ❌
17799        - ❌
17800        - ❌
17801        - ❌
17802      * - **browsertime-tp6-live-firefox-pinterest-fis-e10s**
17803        - ❌
17804        - ❌
17805        - ❌
17806        - ❌
17807
17808
17809   .. list-table:: **test-windows10-32-qr/opt**
17810      :widths: 30 15 15 15 15
17811      :header-rows: 1
17812
17813      * - **Test Name**
17814        - mozilla-central
17815        - autoland
17816        - mozilla-release
17817        - mozilla-beta
17818      * - **browsertime-tp6-firefox-pinterest-e10s**
17819        - ❌
17820        - ❌
17821        - ❌
17822        - ❌
17823      * - **browsertime-tp6-firefox-pinterest-fis-e10s**
17824        - ❌
17825        - ❌
17826        - ❌
17827        - ❌
17828      * - **browsertime-tp6-live-firefox-pinterest-e10s**
17829        - ❌
17830        - ❌
17831        - ❌
17832        - ❌
17833      * - **browsertime-tp6-live-firefox-pinterest-fis-e10s**
17834        - ❌
17835        - ❌
17836        - ❌
17837        - ❌
17838
17839
17840   .. list-table:: **test-windows10-32-shippable-qr/opt**
17841      :widths: 30 15 15 15 15
17842      :header-rows: 1
17843
17844      * - **Test Name**
17845        - mozilla-central
17846        - autoland
17847        - mozilla-release
17848        - mozilla-beta
17849      * - **browsertime-tp6-chrome-pinterest-e10s**
17850        - ❌
17851        - ❌
17852        - ❌
17853        - ❌
17854      * - **browsertime-tp6-chromium-pinterest-e10s**
17855        - ❌
17856        - ❌
17857        - ❌
17858        - ❌
17859      * - **browsertime-tp6-firefox-pinterest-e10s**
17860        - ❌
17861        - ❌
17862        - ❌
17863        - ❌
17864      * - **browsertime-tp6-firefox-pinterest-fis-e10s**
17865        - ❌
17866        - ❌
17867        - ❌
17868        - ❌
17869      * - **browsertime-tp6-live-chrome-pinterest-e10s**
17870        - ❌
17871        - ❌
17872        - ❌
17873        - ❌
17874      * - **browsertime-tp6-live-chromium-pinterest-e10s**
17875        - ❌
17876        - ❌
17877        - ❌
17878        - ❌
17879      * - **browsertime-tp6-live-firefox-pinterest-e10s**
17880        - ❌
17881        - ❌
17882        - ❌
17883        - ❌
17884      * - **browsertime-tp6-live-firefox-pinterest-fis-e10s**
17885        - ❌
17886        - ❌
17887        - ❌
17888        - ❌
17889
17890
17891   .. list-table:: **test-windows10-64-qr/opt**
17892      :widths: 30 15 15 15 15
17893      :header-rows: 1
17894
17895      * - **Test Name**
17896        - mozilla-central
17897        - autoland
17898        - mozilla-release
17899        - mozilla-beta
17900      * - **browsertime-tp6-firefox-pinterest-e10s**
17901        - ❌
17902        - ❌
17903        - ❌
17904        - ❌
17905      * - **browsertime-tp6-firefox-pinterest-fis-e10s**
17906        - ❌
17907        - ❌
17908        - ❌
17909        - ❌
17910      * - **browsertime-tp6-live-firefox-pinterest-e10s**
17911        - ❌
17912        - ❌
17913        - ❌
17914        - ❌
17915      * - **browsertime-tp6-live-firefox-pinterest-fis-e10s**
17916        - ❌
17917        - ❌
17918        - ❌
17919        - ❌
17920
17921
17922   .. list-table:: **test-windows10-64-shippable-qr/opt**
17923      :widths: 30 15 15 15 15
17924      :header-rows: 1
17925
17926      * - **Test Name**
17927        - mozilla-central
17928        - autoland
17929        - mozilla-release
17930        - mozilla-beta
17931      * - **browsertime-tp6-chrome-pinterest-e10s**
17932        - ❌
17933        - ❌
17934        - ❌
17935        - ❌
17936      * - **browsertime-tp6-chromium-pinterest-e10s**
17937        - ❌
17938        - ❌
17939        - ❌
17940        - ❌
17941      * - **browsertime-tp6-firefox-pinterest-e10s**
17942        - ❌
17943        - ❌
17944        - ❌
17945        - ❌
17946      * - **browsertime-tp6-firefox-pinterest-fis-e10s**
17947        - ✅
17948        - ✅
17949        - ✅
17950        - ✅
17951      * - **browsertime-tp6-live-chrome-pinterest-e10s**
17952        - ❌
17953        - ❌
17954        - ❌
17955        - ❌
17956      * - **browsertime-tp6-live-chromium-pinterest-e10s**
17957        - ❌
17958        - ❌
17959        - ❌
17960        - ❌
17961      * - **browsertime-tp6-live-firefox-pinterest-e10s**
17962        - ❌
17963        - ❌
17964        - ❌
17965        - ❌
17966      * - **browsertime-tp6-live-firefox-pinterest-fis-e10s**
17967        - ❌
17968        - ❌
17969        - ❌
17970        - ❌
17971
17972
17973
17974.. dropdown:: reddit
17975   :container: + anchor-id-reddit-d
17976
17977   **Owner**: PerfTest Team
17978
17979   * **alert on**: fcp, loadtime
17980   * **alert threshold**: 2.0
17981   * **apps**: firefox, chrome, chromium
17982   * **browser cycles**: 25
17983   * **expected**: pass
17984   * **gecko profile entries**: 14000000
17985   * **gecko profile interval**: 1
17986   * **lower is better**: true
17987   * **measure**: fnbpaint, fcp, dcf, loadtime
17988   * **page cycles**: 25
17989   * **page timeout**: 60000
17990   * **playback**: mitmproxy
17991   * **playback pageset manifest**: mitm6-linux-firefox-reddit.manifest
17992   * **playback version**: 6.0.2
17993   * **secondary url**: `<https://www.reddit.com/r/technology/>`__
17994   * **test url**: `<https://www.reddit.com/r/technology/comments/9sqwyh/we_posed_as_100_senators_to_run_ads_on_facebook/>`__
17995   * **type**: pageload
17996   * **unit**: ms
17997   * **use live sites**: false
17998   * **Test Task**:
17999
18000   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
18001      :widths: 30 15 15 15 15
18002      :header-rows: 1
18003
18004      * - **Test Name**
18005        - mozilla-central
18006        - autoland
18007        - mozilla-release
18008        - mozilla-beta
18009      * - **browsertime-tp6m-fenix-reddit-e10s**
18010        - ❌
18011        - ❌
18012        - ❌
18013        - ❌
18014      * - **browsertime-tp6m-geckoview-reddit-e10s**
18015        - ❌
18016        - ❌
18017        - ❌
18018        - ❌
18019      * - **browsertime-tp6m-live-fenix-reddit-e10s**
18020        - ❌
18021        - ❌
18022        - ❌
18023        - ❌
18024      * - **browsertime-tp6m-live-geckoview-reddit-e10s**
18025        - ❌
18026        - ❌
18027        - ❌
18028        - ❌
18029      * - **browsertime-tp6m-refbrow-reddit-e10s**
18030        - ❌
18031        - ❌
18032        - ❌
18033        - ❌
18034
18035
18036   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
18037      :widths: 30 15 15 15 15
18038      :header-rows: 1
18039
18040      * - **Test Name**
18041        - mozilla-central
18042        - autoland
18043        - mozilla-release
18044        - mozilla-beta
18045      * - **browsertime-tp6m-chrome-m-reddit-e10s**
18046        - ❌
18047        - ❌
18048        - ❌
18049        - ❌
18050      * - **browsertime-tp6m-fenix-reddit-e10s**
18051        - ❌
18052        - ❌
18053        - ❌
18054        - ❌
18055      * - **browsertime-tp6m-geckoview-reddit-e10s**
18056        - ✅
18057        - ✅
18058        - ✅
18059        - ✅
18060      * - **browsertime-tp6m-live-chrome-m-reddit-e10s**
18061        - ❌
18062        - ❌
18063        - ❌
18064        - ❌
18065      * - **browsertime-tp6m-live-fenix-reddit-e10s**
18066        - ❌
18067        - ❌
18068        - ❌
18069        - ❌
18070      * - **browsertime-tp6m-live-geckoview-reddit-e10s**
18071        - ❌
18072        - ❌
18073        - ❌
18074        - ❌
18075      * - **browsertime-tp6m-refbrow-reddit-e10s**
18076        - ❌
18077        - ❌
18078        - ❌
18079        - ❌
18080
18081
18082   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
18083      :widths: 30 15 15 15 15
18084      :header-rows: 1
18085
18086      * - **Test Name**
18087        - mozilla-central
18088        - autoland
18089        - mozilla-release
18090        - mozilla-beta
18091      * - **browsertime-tp6m-fenix-reddit-e10s**
18092        - ❌
18093        - ❌
18094        - ❌
18095        - ❌
18096      * - **browsertime-tp6m-geckoview-reddit-e10s**
18097        - ❌
18098        - ❌
18099        - ❌
18100        - ❌
18101      * - **browsertime-tp6m-live-fenix-reddit-e10s**
18102        - ❌
18103        - ❌
18104        - ❌
18105        - ❌
18106      * - **browsertime-tp6m-live-geckoview-reddit-e10s**
18107        - ❌
18108        - ❌
18109        - ❌
18110        - ❌
18111      * - **browsertime-tp6m-refbrow-reddit-e10s**
18112        - ❌
18113        - ❌
18114        - ❌
18115        - ❌
18116
18117
18118   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
18119      :widths: 30 15 15 15 15
18120      :header-rows: 1
18121
18122      * - **Test Name**
18123        - mozilla-central
18124        - autoland
18125        - mozilla-release
18126        - mozilla-beta
18127      * - **browsertime-tp6m-chrome-m-reddit-e10s**
18128        - ❌
18129        - ❌
18130        - ❌
18131        - ❌
18132      * - **browsertime-tp6m-fenix-reddit-e10s**
18133        - ❌
18134        - ❌
18135        - ❌
18136        - ❌
18137      * - **browsertime-tp6m-geckoview-reddit-e10s**
18138        - ✅
18139        - ✅
18140        - ✅
18141        - ✅
18142      * - **browsertime-tp6m-live-chrome-m-reddit-e10s**
18143        - ❌
18144        - ❌
18145        - ❌
18146        - ❌
18147      * - **browsertime-tp6m-live-fenix-reddit-e10s**
18148        - ❌
18149        - ❌
18150        - ❌
18151        - ❌
18152      * - **browsertime-tp6m-live-geckoview-reddit-e10s**
18153        - ❌
18154        - ❌
18155        - ❌
18156        - ❌
18157      * - **browsertime-tp6m-refbrow-reddit-e10s**
18158        - ❌
18159        - ❌
18160        - ❌
18161        - ❌
18162
18163
18164   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
18165      :widths: 30 15 15 15 15
18166      :header-rows: 1
18167
18168      * - **Test Name**
18169        - mozilla-central
18170        - autoland
18171        - mozilla-release
18172        - mozilla-beta
18173      * - **browsertime-tp6m-fenix-reddit-e10s**
18174        - ❌
18175        - ❌
18176        - ❌
18177        - ❌
18178      * - **browsertime-tp6m-geckoview-reddit-e10s**
18179        - ❌
18180        - ❌
18181        - ❌
18182        - ❌
18183      * - **browsertime-tp6m-live-fenix-reddit-e10s**
18184        - ❌
18185        - ❌
18186        - ❌
18187        - ❌
18188      * - **browsertime-tp6m-live-geckoview-reddit-e10s**
18189        - ❌
18190        - ❌
18191        - ❌
18192        - ❌
18193      * - **browsertime-tp6m-refbrow-reddit-e10s**
18194        - ❌
18195        - ❌
18196        - ❌
18197        - ❌
18198
18199
18200   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
18201      :widths: 30 15 15 15 15
18202      :header-rows: 1
18203
18204      * - **Test Name**
18205        - mozilla-central
18206        - autoland
18207        - mozilla-release
18208        - mozilla-beta
18209      * - **browsertime-tp6m-chrome-m-reddit-e10s**
18210        - ❌
18211        - ❌
18212        - ❌
18213        - ❌
18214      * - **browsertime-tp6m-fenix-reddit-e10s**
18215        - ❌
18216        - ❌
18217        - ❌
18218        - ❌
18219      * - **browsertime-tp6m-geckoview-reddit-e10s**
18220        - ❌
18221        - ❌
18222        - ❌
18223        - ❌
18224      * - **browsertime-tp6m-live-chrome-m-reddit-e10s**
18225        - ❌
18226        - ❌
18227        - ❌
18228        - ❌
18229      * - **browsertime-tp6m-live-fenix-reddit-e10s**
18230        - ❌
18231        - ❌
18232        - ❌
18233        - ❌
18234      * - **browsertime-tp6m-live-geckoview-reddit-e10s**
18235        - ❌
18236        - ❌
18237        - ❌
18238        - ❌
18239      * - **browsertime-tp6m-refbrow-reddit-e10s**
18240        - ❌
18241        - ❌
18242        - ❌
18243        - ❌
18244
18245
18246   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
18247      :widths: 30 15 15 15 15
18248      :header-rows: 1
18249
18250      * - **Test Name**
18251        - mozilla-central
18252        - autoland
18253        - mozilla-release
18254        - mozilla-beta
18255      * - **browsertime-tp6m-fenix-reddit-e10s**
18256        - ❌
18257        - ❌
18258        - ❌
18259        - ❌
18260      * - **browsertime-tp6m-geckoview-reddit-e10s**
18261        - ❌
18262        - ❌
18263        - ❌
18264        - ❌
18265      * - **browsertime-tp6m-live-fenix-reddit-e10s**
18266        - ❌
18267        - ❌
18268        - ❌
18269        - ❌
18270      * - **browsertime-tp6m-live-geckoview-reddit-e10s**
18271        - ❌
18272        - ❌
18273        - ❌
18274        - ❌
18275      * - **browsertime-tp6m-refbrow-reddit-e10s**
18276        - ❌
18277        - ❌
18278        - ❌
18279        - ❌
18280
18281
18282   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
18283      :widths: 30 15 15 15 15
18284      :header-rows: 1
18285
18286      * - **Test Name**
18287        - mozilla-central
18288        - autoland
18289        - mozilla-release
18290        - mozilla-beta
18291      * - **browsertime-tp6m-chrome-m-reddit-e10s**
18292        - ❌
18293        - ❌
18294        - ❌
18295        - ❌
18296      * - **browsertime-tp6m-fenix-reddit-e10s**
18297        - ❌
18298        - ❌
18299        - ❌
18300        - ❌
18301      * - **browsertime-tp6m-geckoview-reddit-e10s**
18302        - ❌
18303        - ❌
18304        - ❌
18305        - ❌
18306      * - **browsertime-tp6m-live-chrome-m-reddit-e10s**
18307        - ❌
18308        - ❌
18309        - ❌
18310        - ❌
18311      * - **browsertime-tp6m-live-fenix-reddit-e10s**
18312        - ❌
18313        - ❌
18314        - ❌
18315        - ❌
18316      * - **browsertime-tp6m-live-geckoview-reddit-e10s**
18317        - ❌
18318        - ❌
18319        - ❌
18320        - ❌
18321      * - **browsertime-tp6m-refbrow-reddit-e10s**
18322        - ❌
18323        - ❌
18324        - ❌
18325        - ❌
18326
18327
18328   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
18329      :widths: 30 15 15 15 15
18330      :header-rows: 1
18331
18332      * - **Test Name**
18333        - mozilla-central
18334        - autoland
18335        - mozilla-release
18336        - mozilla-beta
18337      * - **browsertime-tp6-firefox-reddit-e10s**
18338        - ❌
18339        - ❌
18340        - ❌
18341        - ❌
18342      * - **browsertime-tp6-firefox-reddit-fis-e10s**
18343        - ❌
18344        - ❌
18345        - ❌
18346        - ❌
18347      * - **browsertime-tp6-live-firefox-reddit-e10s**
18348        - ❌
18349        - ❌
18350        - ❌
18351        - ❌
18352      * - **browsertime-tp6-live-firefox-reddit-fis-e10s**
18353        - ❌
18354        - ❌
18355        - ❌
18356        - ❌
18357
18358
18359   .. list-table:: **test-linux1804-64-qr/opt**
18360      :widths: 30 15 15 15 15
18361      :header-rows: 1
18362
18363      * - **Test Name**
18364        - mozilla-central
18365        - autoland
18366        - mozilla-release
18367        - mozilla-beta
18368      * - **browsertime-tp6-firefox-reddit-e10s**
18369        - ❌
18370        - ❌
18371        - ❌
18372        - ❌
18373      * - **browsertime-tp6-firefox-reddit-fis-e10s**
18374        - ❌
18375        - ❌
18376        - ❌
18377        - ❌
18378      * - **browsertime-tp6-live-firefox-reddit-e10s**
18379        - ❌
18380        - ❌
18381        - ❌
18382        - ❌
18383      * - **browsertime-tp6-live-firefox-reddit-fis-e10s**
18384        - ❌
18385        - ❌
18386        - ❌
18387        - ❌
18388
18389
18390   .. list-table:: **test-linux1804-64-shippable-qr/opt**
18391      :widths: 30 15 15 15 15
18392      :header-rows: 1
18393
18394      * - **Test Name**
18395        - mozilla-central
18396        - autoland
18397        - mozilla-release
18398        - mozilla-beta
18399      * - **browsertime-tp6-chrome-reddit-e10s**
18400        - ❌
18401        - ❌
18402        - ❌
18403        - ❌
18404      * - **browsertime-tp6-chromium-reddit-e10s**
18405        - ❌
18406        - ❌
18407        - ❌
18408        - ❌
18409      * - **browsertime-tp6-firefox-reddit-e10s**
18410        - ❌
18411        - ❌
18412        - ❌
18413        - ❌
18414      * - **browsertime-tp6-firefox-reddit-fis-e10s**
18415        - ✅
18416        - ✅
18417        - ✅
18418        - ✅
18419      * - **browsertime-tp6-live-chrome-reddit-e10s**
18420        - ❌
18421        - ❌
18422        - ❌
18423        - ❌
18424      * - **browsertime-tp6-live-chromium-reddit-e10s**
18425        - ❌
18426        - ❌
18427        - ❌
18428        - ❌
18429      * - **browsertime-tp6-live-firefox-reddit-e10s**
18430        - ❌
18431        - ❌
18432        - ❌
18433        - ❌
18434      * - **browsertime-tp6-live-firefox-reddit-fis-e10s**
18435        - ❌
18436        - ❌
18437        - ❌
18438        - ❌
18439
18440
18441   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
18442      :widths: 30 15 15 15 15
18443      :header-rows: 1
18444
18445      * - **Test Name**
18446        - mozilla-central
18447        - autoland
18448        - mozilla-release
18449        - mozilla-beta
18450      * - **browsertime-tp6-chrome-reddit-e10s**
18451        - ❌
18452        - ❌
18453        - ❌
18454        - ❌
18455      * - **browsertime-tp6-chromium-reddit-e10s**
18456        - ❌
18457        - ❌
18458        - ❌
18459        - ❌
18460      * - **browsertime-tp6-firefox-reddit-e10s**
18461        - ❌
18462        - ❌
18463        - ❌
18464        - ❌
18465      * - **browsertime-tp6-firefox-reddit-fis-e10s**
18466        - ✅
18467        - ✅
18468        - ✅
18469        - ✅
18470      * - **browsertime-tp6-live-chrome-reddit-e10s**
18471        - ❌
18472        - ❌
18473        - ❌
18474        - ❌
18475      * - **browsertime-tp6-live-chromium-reddit-e10s**
18476        - ❌
18477        - ❌
18478        - ❌
18479        - ❌
18480      * - **browsertime-tp6-live-firefox-reddit-e10s**
18481        - ❌
18482        - ❌
18483        - ❌
18484        - ❌
18485      * - **browsertime-tp6-live-firefox-reddit-fis-e10s**
18486        - ❌
18487        - ❌
18488        - ❌
18489        - ❌
18490
18491
18492   .. list-table:: **test-windows10-32-qr/opt**
18493      :widths: 30 15 15 15 15
18494      :header-rows: 1
18495
18496      * - **Test Name**
18497        - mozilla-central
18498        - autoland
18499        - mozilla-release
18500        - mozilla-beta
18501      * - **browsertime-tp6-firefox-reddit-e10s**
18502        - ❌
18503        - ❌
18504        - ❌
18505        - ❌
18506      * - **browsertime-tp6-firefox-reddit-fis-e10s**
18507        - ❌
18508        - ❌
18509        - ❌
18510        - ❌
18511      * - **browsertime-tp6-live-firefox-reddit-e10s**
18512        - ❌
18513        - ❌
18514        - ❌
18515        - ❌
18516      * - **browsertime-tp6-live-firefox-reddit-fis-e10s**
18517        - ❌
18518        - ❌
18519        - ❌
18520        - ❌
18521
18522
18523   .. list-table:: **test-windows10-32-shippable-qr/opt**
18524      :widths: 30 15 15 15 15
18525      :header-rows: 1
18526
18527      * - **Test Name**
18528        - mozilla-central
18529        - autoland
18530        - mozilla-release
18531        - mozilla-beta
18532      * - **browsertime-tp6-chrome-reddit-e10s**
18533        - ❌
18534        - ❌
18535        - ❌
18536        - ❌
18537      * - **browsertime-tp6-chromium-reddit-e10s**
18538        - ❌
18539        - ❌
18540        - ❌
18541        - ❌
18542      * - **browsertime-tp6-firefox-reddit-e10s**
18543        - ❌
18544        - ❌
18545        - ❌
18546        - ❌
18547      * - **browsertime-tp6-firefox-reddit-fis-e10s**
18548        - ❌
18549        - ❌
18550        - ❌
18551        - ❌
18552      * - **browsertime-tp6-live-chrome-reddit-e10s**
18553        - ❌
18554        - ❌
18555        - ❌
18556        - ❌
18557      * - **browsertime-tp6-live-chromium-reddit-e10s**
18558        - ❌
18559        - ❌
18560        - ❌
18561        - ❌
18562      * - **browsertime-tp6-live-firefox-reddit-e10s**
18563        - ❌
18564        - ❌
18565        - ❌
18566        - ❌
18567      * - **browsertime-tp6-live-firefox-reddit-fis-e10s**
18568        - ❌
18569        - ❌
18570        - ❌
18571        - ❌
18572
18573
18574   .. list-table:: **test-windows10-64-qr/opt**
18575      :widths: 30 15 15 15 15
18576      :header-rows: 1
18577
18578      * - **Test Name**
18579        - mozilla-central
18580        - autoland
18581        - mozilla-release
18582        - mozilla-beta
18583      * - **browsertime-tp6-firefox-reddit-e10s**
18584        - ❌
18585        - ❌
18586        - ❌
18587        - ❌
18588      * - **browsertime-tp6-firefox-reddit-fis-e10s**
18589        - ❌
18590        - ❌
18591        - ❌
18592        - ❌
18593      * - **browsertime-tp6-live-firefox-reddit-e10s**
18594        - ❌
18595        - ❌
18596        - ❌
18597        - ❌
18598      * - **browsertime-tp6-live-firefox-reddit-fis-e10s**
18599        - ❌
18600        - ❌
18601        - ❌
18602        - ❌
18603
18604
18605   .. list-table:: **test-windows10-64-shippable-qr/opt**
18606      :widths: 30 15 15 15 15
18607      :header-rows: 1
18608
18609      * - **Test Name**
18610        - mozilla-central
18611        - autoland
18612        - mozilla-release
18613        - mozilla-beta
18614      * - **browsertime-tp6-chrome-reddit-e10s**
18615        - ❌
18616        - ❌
18617        - ❌
18618        - ❌
18619      * - **browsertime-tp6-chromium-reddit-e10s**
18620        - ❌
18621        - ❌
18622        - ❌
18623        - ❌
18624      * - **browsertime-tp6-firefox-reddit-e10s**
18625        - ❌
18626        - ❌
18627        - ❌
18628        - ❌
18629      * - **browsertime-tp6-firefox-reddit-fis-e10s**
18630        - ✅
18631        - ✅
18632        - ✅
18633        - ✅
18634      * - **browsertime-tp6-live-chrome-reddit-e10s**
18635        - ❌
18636        - ❌
18637        - ❌
18638        - ❌
18639      * - **browsertime-tp6-live-chromium-reddit-e10s**
18640        - ❌
18641        - ❌
18642        - ❌
18643        - ❌
18644      * - **browsertime-tp6-live-firefox-reddit-e10s**
18645        - ❌
18646        - ❌
18647        - ❌
18648        - ❌
18649      * - **browsertime-tp6-live-firefox-reddit-fis-e10s**
18650        - ❌
18651        - ❌
18652        - ❌
18653        - ❌
18654
18655
18656
18657.. dropdown:: tumblr
18658   :container: + anchor-id-tumblr-d
18659
18660   **Owner**: PerfTest Team
18661
18662   * **alert on**: fcp, loadtime
18663   * **alert threshold**: 2.0
18664   * **apps**: firefox, chrome, chromium
18665   * **browser cycles**: 25
18666   * **expected**: pass
18667   * **gecko profile entries**: 14000000
18668   * **gecko profile interval**: 1
18669   * **lower is better**: true
18670   * **measure**: fnbpaint, fcp, dcf, loadtime
18671   * **page cycles**: 25
18672   * **page timeout**: 60000
18673   * **playback**: mitmproxy
18674   * **playback pageset manifest**: mitm6-linux-firefox-tumblr.manifest
18675   * **playback version**: 6.0.2
18676   * **secondary url**: `<https://www.tumblr.com/tagged/funny+cats?sort=top>`__
18677   * **test url**: `<https://www.tumblr.com/dashboard>`__
18678   * **type**: pageload
18679   * **unit**: ms
18680   * **use live sites**: false
18681   * **Test Task**:
18682
18683   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
18684      :widths: 30 15 15 15 15
18685      :header-rows: 1
18686
18687      * - **Test Name**
18688        - mozilla-central
18689        - autoland
18690        - mozilla-release
18691        - mozilla-beta
18692      * - **browsertime-tp6-firefox-tumblr-e10s**
18693        - ❌
18694        - ❌
18695        - ❌
18696        - ❌
18697      * - **browsertime-tp6-firefox-tumblr-fis-e10s**
18698        - ❌
18699        - ❌
18700        - ❌
18701        - ❌
18702      * - **browsertime-tp6-live-firefox-tumblr-e10s**
18703        - ❌
18704        - ❌
18705        - ❌
18706        - ❌
18707      * - **browsertime-tp6-live-firefox-tumblr-fis-e10s**
18708        - ❌
18709        - ❌
18710        - ❌
18711        - ❌
18712
18713
18714   .. list-table:: **test-linux1804-64-qr/opt**
18715      :widths: 30 15 15 15 15
18716      :header-rows: 1
18717
18718      * - **Test Name**
18719        - mozilla-central
18720        - autoland
18721        - mozilla-release
18722        - mozilla-beta
18723      * - **browsertime-tp6-firefox-tumblr-e10s**
18724        - ❌
18725        - ❌
18726        - ❌
18727        - ❌
18728      * - **browsertime-tp6-firefox-tumblr-fis-e10s**
18729        - ❌
18730        - ❌
18731        - ❌
18732        - ❌
18733      * - **browsertime-tp6-live-firefox-tumblr-e10s**
18734        - ❌
18735        - ❌
18736        - ❌
18737        - ❌
18738      * - **browsertime-tp6-live-firefox-tumblr-fis-e10s**
18739        - ❌
18740        - ❌
18741        - ❌
18742        - ❌
18743
18744
18745   .. list-table:: **test-linux1804-64-shippable-qr/opt**
18746      :widths: 30 15 15 15 15
18747      :header-rows: 1
18748
18749      * - **Test Name**
18750        - mozilla-central
18751        - autoland
18752        - mozilla-release
18753        - mozilla-beta
18754      * - **browsertime-tp6-chrome-tumblr-e10s**
18755        - ❌
18756        - ❌
18757        - ❌
18758        - ❌
18759      * - **browsertime-tp6-chromium-tumblr-e10s**
18760        - ❌
18761        - ❌
18762        - ❌
18763        - ❌
18764      * - **browsertime-tp6-firefox-tumblr-e10s**
18765        - ❌
18766        - ❌
18767        - ❌
18768        - ❌
18769      * - **browsertime-tp6-firefox-tumblr-fis-e10s**
18770        - ✅
18771        - ✅
18772        - ✅
18773        - ✅
18774      * - **browsertime-tp6-live-chrome-tumblr-e10s**
18775        - ❌
18776        - ❌
18777        - ❌
18778        - ❌
18779      * - **browsertime-tp6-live-chromium-tumblr-e10s**
18780        - ❌
18781        - ❌
18782        - ❌
18783        - ❌
18784      * - **browsertime-tp6-live-firefox-tumblr-e10s**
18785        - ❌
18786        - ❌
18787        - ❌
18788        - ❌
18789      * - **browsertime-tp6-live-firefox-tumblr-fis-e10s**
18790        - ❌
18791        - ❌
18792        - ❌
18793        - ❌
18794
18795
18796   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
18797      :widths: 30 15 15 15 15
18798      :header-rows: 1
18799
18800      * - **Test Name**
18801        - mozilla-central
18802        - autoland
18803        - mozilla-release
18804        - mozilla-beta
18805      * - **browsertime-tp6-chrome-tumblr-e10s**
18806        - ❌
18807        - ❌
18808        - ❌
18809        - ❌
18810      * - **browsertime-tp6-chromium-tumblr-e10s**
18811        - ❌
18812        - ❌
18813        - ❌
18814        - ❌
18815      * - **browsertime-tp6-firefox-tumblr-e10s**
18816        - ❌
18817        - ❌
18818        - ❌
18819        - ❌
18820      * - **browsertime-tp6-firefox-tumblr-fis-e10s**
18821        - ✅
18822        - ✅
18823        - ✅
18824        - ✅
18825      * - **browsertime-tp6-live-chrome-tumblr-e10s**
18826        - ❌
18827        - ❌
18828        - ❌
18829        - ❌
18830      * - **browsertime-tp6-live-chromium-tumblr-e10s**
18831        - ❌
18832        - ❌
18833        - ❌
18834        - ❌
18835      * - **browsertime-tp6-live-firefox-tumblr-e10s**
18836        - ❌
18837        - ❌
18838        - ❌
18839        - ❌
18840      * - **browsertime-tp6-live-firefox-tumblr-fis-e10s**
18841        - ❌
18842        - ❌
18843        - ❌
18844        - ❌
18845
18846
18847   .. list-table:: **test-windows10-32-qr/opt**
18848      :widths: 30 15 15 15 15
18849      :header-rows: 1
18850
18851      * - **Test Name**
18852        - mozilla-central
18853        - autoland
18854        - mozilla-release
18855        - mozilla-beta
18856      * - **browsertime-tp6-firefox-tumblr-e10s**
18857        - ❌
18858        - ❌
18859        - ❌
18860        - ❌
18861      * - **browsertime-tp6-firefox-tumblr-fis-e10s**
18862        - ❌
18863        - ❌
18864        - ❌
18865        - ❌
18866      * - **browsertime-tp6-live-firefox-tumblr-e10s**
18867        - ❌
18868        - ❌
18869        - ❌
18870        - ❌
18871      * - **browsertime-tp6-live-firefox-tumblr-fis-e10s**
18872        - ❌
18873        - ❌
18874        - ❌
18875        - ❌
18876
18877
18878   .. list-table:: **test-windows10-32-shippable-qr/opt**
18879      :widths: 30 15 15 15 15
18880      :header-rows: 1
18881
18882      * - **Test Name**
18883        - mozilla-central
18884        - autoland
18885        - mozilla-release
18886        - mozilla-beta
18887      * - **browsertime-tp6-chrome-tumblr-e10s**
18888        - ❌
18889        - ❌
18890        - ❌
18891        - ❌
18892      * - **browsertime-tp6-chromium-tumblr-e10s**
18893        - ❌
18894        - ❌
18895        - ❌
18896        - ❌
18897      * - **browsertime-tp6-firefox-tumblr-e10s**
18898        - ❌
18899        - ❌
18900        - ❌
18901        - ❌
18902      * - **browsertime-tp6-firefox-tumblr-fis-e10s**
18903        - ❌
18904        - ❌
18905        - ❌
18906        - ❌
18907      * - **browsertime-tp6-live-chrome-tumblr-e10s**
18908        - ❌
18909        - ❌
18910        - ❌
18911        - ❌
18912      * - **browsertime-tp6-live-chromium-tumblr-e10s**
18913        - ❌
18914        - ❌
18915        - ❌
18916        - ❌
18917      * - **browsertime-tp6-live-firefox-tumblr-e10s**
18918        - ❌
18919        - ❌
18920        - ❌
18921        - ❌
18922      * - **browsertime-tp6-live-firefox-tumblr-fis-e10s**
18923        - ❌
18924        - ❌
18925        - ❌
18926        - ❌
18927
18928
18929   .. list-table:: **test-windows10-64-qr/opt**
18930      :widths: 30 15 15 15 15
18931      :header-rows: 1
18932
18933      * - **Test Name**
18934        - mozilla-central
18935        - autoland
18936        - mozilla-release
18937        - mozilla-beta
18938      * - **browsertime-tp6-firefox-tumblr-e10s**
18939        - ❌
18940        - ❌
18941        - ❌
18942        - ❌
18943      * - **browsertime-tp6-firefox-tumblr-fis-e10s**
18944        - ❌
18945        - ❌
18946        - ❌
18947        - ❌
18948      * - **browsertime-tp6-live-firefox-tumblr-e10s**
18949        - ❌
18950        - ❌
18951        - ❌
18952        - ❌
18953      * - **browsertime-tp6-live-firefox-tumblr-fis-e10s**
18954        - ❌
18955        - ❌
18956        - ❌
18957        - ❌
18958
18959
18960   .. list-table:: **test-windows10-64-shippable-qr/opt**
18961      :widths: 30 15 15 15 15
18962      :header-rows: 1
18963
18964      * - **Test Name**
18965        - mozilla-central
18966        - autoland
18967        - mozilla-release
18968        - mozilla-beta
18969      * - **browsertime-tp6-chrome-tumblr-e10s**
18970        - ❌
18971        - ❌
18972        - ❌
18973        - ❌
18974      * - **browsertime-tp6-chromium-tumblr-e10s**
18975        - ❌
18976        - ❌
18977        - ❌
18978        - ❌
18979      * - **browsertime-tp6-firefox-tumblr-e10s**
18980        - ❌
18981        - ❌
18982        - ❌
18983        - ❌
18984      * - **browsertime-tp6-firefox-tumblr-fis-e10s**
18985        - ✅
18986        - ✅
18987        - ✅
18988        - ✅
18989      * - **browsertime-tp6-live-chrome-tumblr-e10s**
18990        - ❌
18991        - ❌
18992        - ❌
18993        - ❌
18994      * - **browsertime-tp6-live-chromium-tumblr-e10s**
18995        - ❌
18996        - ❌
18997        - ❌
18998        - ❌
18999      * - **browsertime-tp6-live-firefox-tumblr-e10s**
19000        - ❌
19001        - ❌
19002        - ❌
19003        - ❌
19004      * - **browsertime-tp6-live-firefox-tumblr-fis-e10s**
19005        - ❌
19006        - ❌
19007        - ❌
19008        - ❌
19009
19010
19011
19012.. dropdown:: twitch
19013   :container: + anchor-id-twitch-d
19014
19015   **Owner**: PerfTest Team
19016
19017   * **alert on**: fcp, loadtime
19018   * **alert threshold**: 2.0
19019   * **apps**: firefox, chrome, chromium
19020   * **browser cycles**: 25
19021   * **expected**: pass
19022   * **gecko profile entries**: 14000000
19023   * **gecko profile interval**: 1
19024   * **lower is better**: true
19025   * **measure**: fnbpaint, fcp, dcf, loadtime
19026   * **page cycles**: 25
19027   * **page timeout**: 60000
19028   * **playback**: mitmproxy
19029   * **playback pageset manifest**: mitm7-linux-firefox-twitch.manifest
19030   * **playback version**: 7.0.4
19031   * **preferences**: {"media.autoplay.default": 5, "media.autoplay.ask-permission": true, "media.autoplay.blocking_policy": 1, "media.autoplay.block-webaudio": true, "media.allowed-to-play.enabled": false, "media.block-autoplay-until-in-foreground": true}
19032   * **secondary url**: `<https://www.twitch.tv/gmashley>`__
19033   * **test url**: `<https://www.twitch.tv/videos/894226211>`__
19034   * **type**: pageload
19035   * **unit**: ms
19036   * **use live sites**: false
19037   * **Test Task**:
19038
19039   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
19040      :widths: 30 15 15 15 15
19041      :header-rows: 1
19042
19043      * - **Test Name**
19044        - mozilla-central
19045        - autoland
19046        - mozilla-release
19047        - mozilla-beta
19048      * - **browsertime-tp6-firefox-twitch-e10s**
19049        - ❌
19050        - ❌
19051        - ❌
19052        - ❌
19053      * - **browsertime-tp6-firefox-twitch-fis-e10s**
19054        - ❌
19055        - ❌
19056        - ❌
19057        - ❌
19058      * - **browsertime-tp6-live-firefox-twitch-e10s**
19059        - ❌
19060        - ❌
19061        - ❌
19062        - ❌
19063      * - **browsertime-tp6-live-firefox-twitch-fis-e10s**
19064        - ❌
19065        - ❌
19066        - ❌
19067        - ❌
19068
19069
19070   .. list-table:: **test-linux1804-64-qr/opt**
19071      :widths: 30 15 15 15 15
19072      :header-rows: 1
19073
19074      * - **Test Name**
19075        - mozilla-central
19076        - autoland
19077        - mozilla-release
19078        - mozilla-beta
19079      * - **browsertime-tp6-firefox-twitch-e10s**
19080        - ❌
19081        - ❌
19082        - ❌
19083        - ❌
19084      * - **browsertime-tp6-firefox-twitch-fis-e10s**
19085        - ❌
19086        - ❌
19087        - ❌
19088        - ❌
19089      * - **browsertime-tp6-live-firefox-twitch-e10s**
19090        - ❌
19091        - ❌
19092        - ❌
19093        - ❌
19094      * - **browsertime-tp6-live-firefox-twitch-fis-e10s**
19095        - ❌
19096        - ❌
19097        - ❌
19098        - ❌
19099
19100
19101   .. list-table:: **test-linux1804-64-shippable-qr/opt**
19102      :widths: 30 15 15 15 15
19103      :header-rows: 1
19104
19105      * - **Test Name**
19106        - mozilla-central
19107        - autoland
19108        - mozilla-release
19109        - mozilla-beta
19110      * - **browsertime-tp6-chrome-twitch-e10s**
19111        - ❌
19112        - ❌
19113        - ❌
19114        - ❌
19115      * - **browsertime-tp6-chromium-twitch-e10s**
19116        - ❌
19117        - ❌
19118        - ❌
19119        - ❌
19120      * - **browsertime-tp6-firefox-twitch-e10s**
19121        - ❌
19122        - ❌
19123        - ❌
19124        - ❌
19125      * - **browsertime-tp6-firefox-twitch-fis-e10s**
19126        - ✅
19127        - ✅
19128        - ✅
19129        - ✅
19130      * - **browsertime-tp6-live-chrome-twitch-e10s**
19131        - ❌
19132        - ❌
19133        - ❌
19134        - ❌
19135      * - **browsertime-tp6-live-chromium-twitch-e10s**
19136        - ❌
19137        - ❌
19138        - ❌
19139        - ❌
19140      * - **browsertime-tp6-live-firefox-twitch-e10s**
19141        - ❌
19142        - ❌
19143        - ❌
19144        - ❌
19145      * - **browsertime-tp6-live-firefox-twitch-fis-e10s**
19146        - ❌
19147        - ❌
19148        - ❌
19149        - ❌
19150
19151
19152   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
19153      :widths: 30 15 15 15 15
19154      :header-rows: 1
19155
19156      * - **Test Name**
19157        - mozilla-central
19158        - autoland
19159        - mozilla-release
19160        - mozilla-beta
19161      * - **browsertime-tp6-chrome-twitch-e10s**
19162        - ❌
19163        - ❌
19164        - ❌
19165        - ❌
19166      * - **browsertime-tp6-chromium-twitch-e10s**
19167        - ❌
19168        - ❌
19169        - ❌
19170        - ❌
19171      * - **browsertime-tp6-firefox-twitch-e10s**
19172        - ❌
19173        - ❌
19174        - ❌
19175        - ❌
19176      * - **browsertime-tp6-firefox-twitch-fis-e10s**
19177        - ✅
19178        - ✅
19179        - ✅
19180        - ✅
19181      * - **browsertime-tp6-live-chrome-twitch-e10s**
19182        - ❌
19183        - ❌
19184        - ❌
19185        - ❌
19186      * - **browsertime-tp6-live-chromium-twitch-e10s**
19187        - ❌
19188        - ❌
19189        - ❌
19190        - ❌
19191      * - **browsertime-tp6-live-firefox-twitch-e10s**
19192        - ❌
19193        - ❌
19194        - ❌
19195        - ❌
19196      * - **browsertime-tp6-live-firefox-twitch-fis-e10s**
19197        - ❌
19198        - ❌
19199        - ❌
19200        - ❌
19201
19202
19203   .. list-table:: **test-windows10-32-qr/opt**
19204      :widths: 30 15 15 15 15
19205      :header-rows: 1
19206
19207      * - **Test Name**
19208        - mozilla-central
19209        - autoland
19210        - mozilla-release
19211        - mozilla-beta
19212      * - **browsertime-tp6-firefox-twitch-e10s**
19213        - ❌
19214        - ❌
19215        - ❌
19216        - ❌
19217      * - **browsertime-tp6-firefox-twitch-fis-e10s**
19218        - ❌
19219        - ❌
19220        - ❌
19221        - ❌
19222      * - **browsertime-tp6-live-firefox-twitch-e10s**
19223        - ❌
19224        - ❌
19225        - ❌
19226        - ❌
19227      * - **browsertime-tp6-live-firefox-twitch-fis-e10s**
19228        - ❌
19229        - ❌
19230        - ❌
19231        - ❌
19232
19233
19234   .. list-table:: **test-windows10-32-shippable-qr/opt**
19235      :widths: 30 15 15 15 15
19236      :header-rows: 1
19237
19238      * - **Test Name**
19239        - mozilla-central
19240        - autoland
19241        - mozilla-release
19242        - mozilla-beta
19243      * - **browsertime-tp6-chrome-twitch-e10s**
19244        - ❌
19245        - ❌
19246        - ❌
19247        - ❌
19248      * - **browsertime-tp6-chromium-twitch-e10s**
19249        - ❌
19250        - ❌
19251        - ❌
19252        - ❌
19253      * - **browsertime-tp6-firefox-twitch-e10s**
19254        - ❌
19255        - ❌
19256        - ❌
19257        - ❌
19258      * - **browsertime-tp6-firefox-twitch-fis-e10s**
19259        - ❌
19260        - ❌
19261        - ❌
19262        - ❌
19263      * - **browsertime-tp6-live-chrome-twitch-e10s**
19264        - ❌
19265        - ❌
19266        - ❌
19267        - ❌
19268      * - **browsertime-tp6-live-chromium-twitch-e10s**
19269        - ❌
19270        - ❌
19271        - ❌
19272        - ❌
19273      * - **browsertime-tp6-live-firefox-twitch-e10s**
19274        - ❌
19275        - ❌
19276        - ❌
19277        - ❌
19278      * - **browsertime-tp6-live-firefox-twitch-fis-e10s**
19279        - ❌
19280        - ❌
19281        - ❌
19282        - ❌
19283
19284
19285   .. list-table:: **test-windows10-64-qr/opt**
19286      :widths: 30 15 15 15 15
19287      :header-rows: 1
19288
19289      * - **Test Name**
19290        - mozilla-central
19291        - autoland
19292        - mozilla-release
19293        - mozilla-beta
19294      * - **browsertime-tp6-firefox-twitch-e10s**
19295        - ❌
19296        - ❌
19297        - ❌
19298        - ❌
19299      * - **browsertime-tp6-firefox-twitch-fis-e10s**
19300        - ❌
19301        - ❌
19302        - ❌
19303        - ❌
19304      * - **browsertime-tp6-live-firefox-twitch-e10s**
19305        - ❌
19306        - ❌
19307        - ❌
19308        - ❌
19309      * - **browsertime-tp6-live-firefox-twitch-fis-e10s**
19310        - ❌
19311        - ❌
19312        - ❌
19313        - ❌
19314
19315
19316   .. list-table:: **test-windows10-64-shippable-qr/opt**
19317      :widths: 30 15 15 15 15
19318      :header-rows: 1
19319
19320      * - **Test Name**
19321        - mozilla-central
19322        - autoland
19323        - mozilla-release
19324        - mozilla-beta
19325      * - **browsertime-tp6-chrome-twitch-e10s**
19326        - ❌
19327        - ❌
19328        - ❌
19329        - ❌
19330      * - **browsertime-tp6-chromium-twitch-e10s**
19331        - ❌
19332        - ❌
19333        - ❌
19334        - ❌
19335      * - **browsertime-tp6-firefox-twitch-e10s**
19336        - ❌
19337        - ❌
19338        - ❌
19339        - ❌
19340      * - **browsertime-tp6-firefox-twitch-fis-e10s**
19341        - ✅
19342        - ✅
19343        - ✅
19344        - ✅
19345      * - **browsertime-tp6-live-chrome-twitch-e10s**
19346        - ❌
19347        - ❌
19348        - ❌
19349        - ❌
19350      * - **browsertime-tp6-live-chromium-twitch-e10s**
19351        - ❌
19352        - ❌
19353        - ❌
19354        - ❌
19355      * - **browsertime-tp6-live-firefox-twitch-e10s**
19356        - ❌
19357        - ❌
19358        - ❌
19359        - ❌
19360      * - **browsertime-tp6-live-firefox-twitch-fis-e10s**
19361        - ❌
19362        - ❌
19363        - ❌
19364        - ❌
19365
19366
19367
19368.. dropdown:: twitter
19369   :container: + anchor-id-twitter-d
19370
19371   **Owner**: PerfTest Team
19372
19373   * **alert on**: fcp, loadtime
19374   * **alert threshold**: 2.0
19375   * **apps**: firefox, chrome, chromium
19376   * **browser cycles**: 25
19377   * **expected**: pass
19378   * **gecko profile entries**: 14000000
19379   * **gecko profile interval**: 1
19380   * **lower is better**: true
19381   * **measure**: fnbpaint, fcp, dcf, loadtime
19382   * **page cycles**: 25
19383   * **page timeout**: 60000
19384   * **playback**: mitmproxy
19385   * **playback pageset manifest**: mitm5-linux-firefox-twitter.manifest
19386   * **playback version**: 5.1.1
19387   * **test url**: `<https://twitter.com/BarackObama>`__
19388   * **type**: pageload
19389   * **unit**: ms
19390   * **use live sites**: false
19391   * **Test Task**:
19392
19393   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
19394      :widths: 30 15 15 15 15
19395      :header-rows: 1
19396
19397      * - **Test Name**
19398        - mozilla-central
19399        - autoland
19400        - mozilla-release
19401        - mozilla-beta
19402      * - **browsertime-tp6-essential-firefox-twitter-e10s**
19403        - ❌
19404        - ❌
19405        - ❌
19406        - ❌
19407      * - **browsertime-tp6-essential-firefox-twitter-fis-e10s**
19408        - ❌
19409        - ❌
19410        - ❌
19411        - ❌
19412      * - **browsertime-tp6-live-firefox-twitter-e10s**
19413        - ❌
19414        - ❌
19415        - ❌
19416        - ❌
19417      * - **browsertime-tp6-live-firefox-twitter-fis-e10s**
19418        - ❌
19419        - ❌
19420        - ❌
19421        - ❌
19422
19423
19424   .. list-table:: **test-linux1804-64-qr/opt**
19425      :widths: 30 15 15 15 15
19426      :header-rows: 1
19427
19428      * - **Test Name**
19429        - mozilla-central
19430        - autoland
19431        - mozilla-release
19432        - mozilla-beta
19433      * - **browsertime-tp6-essential-firefox-twitter-e10s**
19434        - ❌
19435        - ❌
19436        - ❌
19437        - ❌
19438      * - **browsertime-tp6-essential-firefox-twitter-fis-e10s**
19439        - ❌
19440        - ❌
19441        - ❌
19442        - ❌
19443      * - **browsertime-tp6-live-firefox-twitter-e10s**
19444        - ❌
19445        - ❌
19446        - ❌
19447        - ❌
19448      * - **browsertime-tp6-live-firefox-twitter-fis-e10s**
19449        - ❌
19450        - ❌
19451        - ❌
19452        - ❌
19453
19454
19455   .. list-table:: **test-linux1804-64-shippable-qr/opt**
19456      :widths: 30 15 15 15 15
19457      :header-rows: 1
19458
19459      * - **Test Name**
19460        - mozilla-central
19461        - autoland
19462        - mozilla-release
19463        - mozilla-beta
19464      * - **browsertime-tp6-essential-chrome-twitter-e10s**
19465        - ❌
19466        - ❌
19467        - ❌
19468        - ❌
19469      * - **browsertime-tp6-essential-chromium-twitter-e10s**
19470        - ❌
19471        - ❌
19472        - ❌
19473        - ❌
19474      * - **browsertime-tp6-essential-firefox-twitter-e10s**
19475        - ❌
19476        - ❌
19477        - ❌
19478        - ❌
19479      * - **browsertime-tp6-essential-firefox-twitter-fis-e10s**
19480        - ✅
19481        - ✅
19482        - ✅
19483        - ✅
19484      * - **browsertime-tp6-live-chrome-twitter-e10s**
19485        - ❌
19486        - ❌
19487        - ❌
19488        - ❌
19489      * - **browsertime-tp6-live-chromium-twitter-e10s**
19490        - ❌
19491        - ❌
19492        - ❌
19493        - ❌
19494      * - **browsertime-tp6-live-firefox-twitter-e10s**
19495        - ❌
19496        - ❌
19497        - ❌
19498        - ❌
19499      * - **browsertime-tp6-live-firefox-twitter-fis-e10s**
19500        - ❌
19501        - ❌
19502        - ❌
19503        - ❌
19504
19505
19506   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
19507      :widths: 30 15 15 15 15
19508      :header-rows: 1
19509
19510      * - **Test Name**
19511        - mozilla-central
19512        - autoland
19513        - mozilla-release
19514        - mozilla-beta
19515      * - **browsertime-tp6-essential-chrome-twitter-e10s**
19516        - ❌
19517        - ❌
19518        - ❌
19519        - ❌
19520      * - **browsertime-tp6-essential-chromium-twitter-e10s**
19521        - ❌
19522        - ❌
19523        - ❌
19524        - ❌
19525      * - **browsertime-tp6-essential-firefox-twitter-e10s**
19526        - ❌
19527        - ❌
19528        - ❌
19529        - ❌
19530      * - **browsertime-tp6-essential-firefox-twitter-fis-e10s**
19531        - ✅
19532        - ✅
19533        - ✅
19534        - ✅
19535      * - **browsertime-tp6-live-chrome-twitter-e10s**
19536        - ❌
19537        - ❌
19538        - ❌
19539        - ❌
19540      * - **browsertime-tp6-live-chromium-twitter-e10s**
19541        - ❌
19542        - ❌
19543        - ❌
19544        - ❌
19545      * - **browsertime-tp6-live-firefox-twitter-e10s**
19546        - ❌
19547        - ❌
19548        - ❌
19549        - ❌
19550      * - **browsertime-tp6-live-firefox-twitter-fis-e10s**
19551        - ❌
19552        - ❌
19553        - ❌
19554        - ❌
19555
19556
19557   .. list-table:: **test-windows10-32-qr/opt**
19558      :widths: 30 15 15 15 15
19559      :header-rows: 1
19560
19561      * - **Test Name**
19562        - mozilla-central
19563        - autoland
19564        - mozilla-release
19565        - mozilla-beta
19566      * - **browsertime-tp6-essential-firefox-twitter-e10s**
19567        - ❌
19568        - ❌
19569        - ❌
19570        - ❌
19571      * - **browsertime-tp6-essential-firefox-twitter-fis-e10s**
19572        - ❌
19573        - ❌
19574        - ❌
19575        - ❌
19576      * - **browsertime-tp6-live-firefox-twitter-e10s**
19577        - ❌
19578        - ❌
19579        - ❌
19580        - ❌
19581      * - **browsertime-tp6-live-firefox-twitter-fis-e10s**
19582        - ❌
19583        - ❌
19584        - ❌
19585        - ❌
19586
19587
19588   .. list-table:: **test-windows10-32-shippable-qr/opt**
19589      :widths: 30 15 15 15 15
19590      :header-rows: 1
19591
19592      * - **Test Name**
19593        - mozilla-central
19594        - autoland
19595        - mozilla-release
19596        - mozilla-beta
19597      * - **browsertime-tp6-essential-chrome-twitter-e10s**
19598        - ❌
19599        - ❌
19600        - ❌
19601        - ❌
19602      * - **browsertime-tp6-essential-chromium-twitter-e10s**
19603        - ❌
19604        - ❌
19605        - ❌
19606        - ❌
19607      * - **browsertime-tp6-essential-firefox-twitter-e10s**
19608        - ❌
19609        - ❌
19610        - ❌
19611        - ❌
19612      * - **browsertime-tp6-essential-firefox-twitter-fis-e10s**
19613        - ❌
19614        - ❌
19615        - ❌
19616        - ❌
19617      * - **browsertime-tp6-live-chrome-twitter-e10s**
19618        - ❌
19619        - ❌
19620        - ❌
19621        - ❌
19622      * - **browsertime-tp6-live-chromium-twitter-e10s**
19623        - ❌
19624        - ❌
19625        - ❌
19626        - ❌
19627      * - **browsertime-tp6-live-firefox-twitter-e10s**
19628        - ❌
19629        - ❌
19630        - ❌
19631        - ❌
19632      * - **browsertime-tp6-live-firefox-twitter-fis-e10s**
19633        - ❌
19634        - ❌
19635        - ❌
19636        - ❌
19637
19638
19639   .. list-table:: **test-windows10-64-qr/opt**
19640      :widths: 30 15 15 15 15
19641      :header-rows: 1
19642
19643      * - **Test Name**
19644        - mozilla-central
19645        - autoland
19646        - mozilla-release
19647        - mozilla-beta
19648      * - **browsertime-tp6-essential-firefox-twitter-e10s**
19649        - ❌
19650        - ❌
19651        - ❌
19652        - ❌
19653      * - **browsertime-tp6-essential-firefox-twitter-fis-e10s**
19654        - ❌
19655        - ❌
19656        - ❌
19657        - ❌
19658      * - **browsertime-tp6-live-firefox-twitter-e10s**
19659        - ❌
19660        - ❌
19661        - ❌
19662        - ❌
19663      * - **browsertime-tp6-live-firefox-twitter-fis-e10s**
19664        - ❌
19665        - ❌
19666        - ❌
19667        - ❌
19668
19669
19670   .. list-table:: **test-windows10-64-shippable-qr/opt**
19671      :widths: 30 15 15 15 15
19672      :header-rows: 1
19673
19674      * - **Test Name**
19675        - mozilla-central
19676        - autoland
19677        - mozilla-release
19678        - mozilla-beta
19679      * - **browsertime-tp6-essential-chrome-twitter-e10s**
19680        - ❌
19681        - ❌
19682        - ❌
19683        - ❌
19684      * - **browsertime-tp6-essential-chromium-twitter-e10s**
19685        - ❌
19686        - ❌
19687        - ❌
19688        - ❌
19689      * - **browsertime-tp6-essential-firefox-twitter-e10s**
19690        - ❌
19691        - ❌
19692        - ❌
19693        - ❌
19694      * - **browsertime-tp6-essential-firefox-twitter-fis-e10s**
19695        - ✅
19696        - ✅
19697        - ✅
19698        - ✅
19699      * - **browsertime-tp6-live-chrome-twitter-e10s**
19700        - ❌
19701        - ❌
19702        - ❌
19703        - ❌
19704      * - **browsertime-tp6-live-chromium-twitter-e10s**
19705        - ❌
19706        - ❌
19707        - ❌
19708        - ❌
19709      * - **browsertime-tp6-live-firefox-twitter-e10s**
19710        - ❌
19711        - ❌
19712        - ❌
19713        - ❌
19714      * - **browsertime-tp6-live-firefox-twitter-fis-e10s**
19715        - ❌
19716        - ❌
19717        - ❌
19718        - ❌
19719
19720
19721
19722.. dropdown:: wikia
19723   :container: + anchor-id-wikia-d
19724
19725   **Owner**: PerfTest Team
19726
19727   * **alert on**: fcp, loadtime
19728   * **alert threshold**: 2.0
19729   * **apps**: firefox, chrome, chromium
19730   * **browser cycles**: 25
19731   * **expected**: pass
19732   * **gecko profile entries**: 14000000
19733   * **gecko profile interval**: 1
19734   * **lower is better**: true
19735   * **measure**: fnbpaint, fcp, dcf, loadtime
19736   * **page cycles**: 25
19737   * **page timeout**: 60000
19738   * **playback**: mitmproxy
19739   * **playback pageset manifest**: mitm7-linux-firefox-wikia.manifest
19740   * **playback version**: 7.0.4
19741   * **secondary url**: `<https://marvel.fandom.com/wiki/Celestials>`__
19742   * **test url**: `<https://marvel.fandom.com/wiki/Black_Panther>`__
19743   * **type**: pageload
19744   * **unit**: ms
19745   * **use live sites**: false
19746   * **Test Task**:
19747
19748   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
19749      :widths: 30 15 15 15 15
19750      :header-rows: 1
19751
19752      * - **Test Name**
19753        - mozilla-central
19754        - autoland
19755        - mozilla-release
19756        - mozilla-beta
19757      * - **browsertime-tp6-firefox-wikia-e10s**
19758        - ❌
19759        - ❌
19760        - ❌
19761        - ❌
19762      * - **browsertime-tp6-firefox-wikia-fis-e10s**
19763        - ❌
19764        - ❌
19765        - ❌
19766        - ❌
19767
19768
19769   .. list-table:: **test-linux1804-64-qr/opt**
19770      :widths: 30 15 15 15 15
19771      :header-rows: 1
19772
19773      * - **Test Name**
19774        - mozilla-central
19775        - autoland
19776        - mozilla-release
19777        - mozilla-beta
19778      * - **browsertime-tp6-firefox-wikia-e10s**
19779        - ❌
19780        - ❌
19781        - ❌
19782        - ❌
19783      * - **browsertime-tp6-firefox-wikia-fis-e10s**
19784        - ❌
19785        - ❌
19786        - ❌
19787        - ❌
19788
19789
19790   .. list-table:: **test-linux1804-64-shippable-qr/opt**
19791      :widths: 30 15 15 15 15
19792      :header-rows: 1
19793
19794      * - **Test Name**
19795        - mozilla-central
19796        - autoland
19797        - mozilla-release
19798        - mozilla-beta
19799      * - **browsertime-tp6-chrome-wikia-e10s**
19800        - ❌
19801        - ❌
19802        - ❌
19803        - ❌
19804      * - **browsertime-tp6-chromium-wikia-e10s**
19805        - ❌
19806        - ❌
19807        - ❌
19808        - ❌
19809      * - **browsertime-tp6-firefox-wikia-e10s**
19810        - ❌
19811        - ❌
19812        - ❌
19813        - ❌
19814      * - **browsertime-tp6-firefox-wikia-fis-e10s**
19815        - ✅
19816        - ✅
19817        - ✅
19818        - ✅
19819
19820
19821   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
19822      :widths: 30 15 15 15 15
19823      :header-rows: 1
19824
19825      * - **Test Name**
19826        - mozilla-central
19827        - autoland
19828        - mozilla-release
19829        - mozilla-beta
19830      * - **browsertime-tp6-chrome-wikia-e10s**
19831        - ❌
19832        - ❌
19833        - ❌
19834        - ❌
19835      * - **browsertime-tp6-chromium-wikia-e10s**
19836        - ❌
19837        - ❌
19838        - ❌
19839        - ❌
19840      * - **browsertime-tp6-firefox-wikia-e10s**
19841        - ❌
19842        - ❌
19843        - ❌
19844        - ❌
19845      * - **browsertime-tp6-firefox-wikia-fis-e10s**
19846        - ✅
19847        - ✅
19848        - ✅
19849        - ✅
19850
19851
19852   .. list-table:: **test-windows10-32-qr/opt**
19853      :widths: 30 15 15 15 15
19854      :header-rows: 1
19855
19856      * - **Test Name**
19857        - mozilla-central
19858        - autoland
19859        - mozilla-release
19860        - mozilla-beta
19861      * - **browsertime-tp6-firefox-wikia-e10s**
19862        - ❌
19863        - ❌
19864        - ❌
19865        - ❌
19866      * - **browsertime-tp6-firefox-wikia-fis-e10s**
19867        - ❌
19868        - ❌
19869        - ❌
19870        - ❌
19871
19872
19873   .. list-table:: **test-windows10-32-shippable-qr/opt**
19874      :widths: 30 15 15 15 15
19875      :header-rows: 1
19876
19877      * - **Test Name**
19878        - mozilla-central
19879        - autoland
19880        - mozilla-release
19881        - mozilla-beta
19882      * - **browsertime-tp6-chrome-wikia-e10s**
19883        - ❌
19884        - ❌
19885        - ❌
19886        - ❌
19887      * - **browsertime-tp6-chromium-wikia-e10s**
19888        - ❌
19889        - ❌
19890        - ❌
19891        - ❌
19892      * - **browsertime-tp6-firefox-wikia-e10s**
19893        - ❌
19894        - ❌
19895        - ❌
19896        - ❌
19897      * - **browsertime-tp6-firefox-wikia-fis-e10s**
19898        - ❌
19899        - ❌
19900        - ❌
19901        - ❌
19902
19903
19904   .. list-table:: **test-windows10-64-qr/opt**
19905      :widths: 30 15 15 15 15
19906      :header-rows: 1
19907
19908      * - **Test Name**
19909        - mozilla-central
19910        - autoland
19911        - mozilla-release
19912        - mozilla-beta
19913      * - **browsertime-tp6-firefox-wikia-e10s**
19914        - ❌
19915        - ❌
19916        - ❌
19917        - ❌
19918      * - **browsertime-tp6-firefox-wikia-fis-e10s**
19919        - ❌
19920        - ❌
19921        - ❌
19922        - ❌
19923
19924
19925   .. list-table:: **test-windows10-64-shippable-qr/opt**
19926      :widths: 30 15 15 15 15
19927      :header-rows: 1
19928
19929      * - **Test Name**
19930        - mozilla-central
19931        - autoland
19932        - mozilla-release
19933        - mozilla-beta
19934      * - **browsertime-tp6-chrome-wikia-e10s**
19935        - ❌
19936        - ❌
19937        - ❌
19938        - ❌
19939      * - **browsertime-tp6-chromium-wikia-e10s**
19940        - ❌
19941        - ❌
19942        - ❌
19943        - ❌
19944      * - **browsertime-tp6-firefox-wikia-e10s**
19945        - ❌
19946        - ❌
19947        - ❌
19948        - ❌
19949      * - **browsertime-tp6-firefox-wikia-fis-e10s**
19950        - ✅
19951        - ✅
19952        - ✅
19953        - ✅
19954
19955
19956
19957.. dropdown:: wikipedia
19958   :container: + anchor-id-wikipedia-d
19959
19960   **Owner**: PerfTest Team
19961
19962   * **alert on**: fcp, loadtime
19963   * **alert threshold**: 2.0
19964   * **apps**: firefox, chrome, chromium
19965   * **browser cycles**: 25
19966   * **expected**: pass
19967   * **gecko profile entries**: 14000000
19968   * **gecko profile interval**: 1
19969   * **lower is better**: true
19970   * **measure**: fnbpaint, fcp, dcf, loadtime
19971   * **page cycles**: 25
19972   * **page timeout**: 60000
19973   * **playback**: mitmproxy
19974   * **playback pageset manifest**: mitm7-linux-firefox-wikipedia.manifest
19975   * **playback version**: 7.0.4
19976   * **secondary url**: `<https://en.wikipedia.org/wiki/Joe_Biden>`__
19977   * **test url**: `<https://en.wikipedia.org/wiki/Barack_Obama>`__
19978   * **type**: pageload
19979   * **unit**: ms
19980   * **use live sites**: false
19981   * **Test Task**:
19982
19983   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
19984      :widths: 30 15 15 15 15
19985      :header-rows: 1
19986
19987      * - **Test Name**
19988        - mozilla-central
19989        - autoland
19990        - mozilla-release
19991        - mozilla-beta
19992      * - **browsertime-tp6m-fenix-wikipedia-e10s**
19993        - ❌
19994        - ❌
19995        - ❌
19996        - ❌
19997      * - **browsertime-tp6m-geckoview-wikipedia-e10s**
19998        - ❌
19999        - ❌
20000        - ❌
20001        - ❌
20002      * - **browsertime-tp6m-live-fenix-wikipedia-e10s**
20003        - ❌
20004        - ❌
20005        - ❌
20006        - ❌
20007      * - **browsertime-tp6m-live-geckoview-wikipedia-e10s**
20008        - ❌
20009        - ❌
20010        - ❌
20011        - ❌
20012      * - **browsertime-tp6m-refbrow-wikipedia-e10s**
20013        - ❌
20014        - ❌
20015        - ❌
20016        - ❌
20017
20018
20019   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
20020      :widths: 30 15 15 15 15
20021      :header-rows: 1
20022
20023      * - **Test Name**
20024        - mozilla-central
20025        - autoland
20026        - mozilla-release
20027        - mozilla-beta
20028      * - **browsertime-tp6m-chrome-m-wikipedia-e10s**
20029        - ❌
20030        - ❌
20031        - ❌
20032        - ❌
20033      * - **browsertime-tp6m-fenix-wikipedia-e10s**
20034        - ❌
20035        - ❌
20036        - ❌
20037        - ❌
20038      * - **browsertime-tp6m-geckoview-wikipedia-e10s**
20039        - ✅
20040        - ✅
20041        - ✅
20042        - ✅
20043      * - **browsertime-tp6m-live-chrome-m-wikipedia-e10s**
20044        - ❌
20045        - ❌
20046        - ❌
20047        - ❌
20048      * - **browsertime-tp6m-live-fenix-wikipedia-e10s**
20049        - ❌
20050        - ❌
20051        - ❌
20052        - ❌
20053      * - **browsertime-tp6m-live-geckoview-wikipedia-e10s**
20054        - ❌
20055        - ❌
20056        - ❌
20057        - ❌
20058      * - **browsertime-tp6m-refbrow-wikipedia-e10s**
20059        - ❌
20060        - ❌
20061        - ❌
20062        - ❌
20063
20064
20065   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
20066      :widths: 30 15 15 15 15
20067      :header-rows: 1
20068
20069      * - **Test Name**
20070        - mozilla-central
20071        - autoland
20072        - mozilla-release
20073        - mozilla-beta
20074      * - **browsertime-tp6m-fenix-wikipedia-e10s**
20075        - ❌
20076        - ❌
20077        - ❌
20078        - ❌
20079      * - **browsertime-tp6m-geckoview-wikipedia-e10s**
20080        - ❌
20081        - ❌
20082        - ❌
20083        - ❌
20084      * - **browsertime-tp6m-live-fenix-wikipedia-e10s**
20085        - ❌
20086        - ❌
20087        - ❌
20088        - ❌
20089      * - **browsertime-tp6m-live-geckoview-wikipedia-e10s**
20090        - ❌
20091        - ❌
20092        - ❌
20093        - ❌
20094      * - **browsertime-tp6m-refbrow-wikipedia-e10s**
20095        - ❌
20096        - ❌
20097        - ❌
20098        - ❌
20099
20100
20101   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
20102      :widths: 30 15 15 15 15
20103      :header-rows: 1
20104
20105      * - **Test Name**
20106        - mozilla-central
20107        - autoland
20108        - mozilla-release
20109        - mozilla-beta
20110      * - **browsertime-tp6m-chrome-m-wikipedia-e10s**
20111        - ❌
20112        - ❌
20113        - ❌
20114        - ❌
20115      * - **browsertime-tp6m-fenix-wikipedia-e10s**
20116        - ❌
20117        - ❌
20118        - ❌
20119        - ❌
20120      * - **browsertime-tp6m-geckoview-wikipedia-e10s**
20121        - ✅
20122        - ✅
20123        - ✅
20124        - ✅
20125      * - **browsertime-tp6m-live-chrome-m-wikipedia-e10s**
20126        - ❌
20127        - ❌
20128        - ❌
20129        - ❌
20130      * - **browsertime-tp6m-live-fenix-wikipedia-e10s**
20131        - ❌
20132        - ❌
20133        - ❌
20134        - ❌
20135      * - **browsertime-tp6m-live-geckoview-wikipedia-e10s**
20136        - ❌
20137        - ❌
20138        - ❌
20139        - ❌
20140      * - **browsertime-tp6m-refbrow-wikipedia-e10s**
20141        - ❌
20142        - ❌
20143        - ❌
20144        - ❌
20145
20146
20147   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
20148      :widths: 30 15 15 15 15
20149      :header-rows: 1
20150
20151      * - **Test Name**
20152        - mozilla-central
20153        - autoland
20154        - mozilla-release
20155        - mozilla-beta
20156      * - **browsertime-tp6m-fenix-wikipedia-e10s**
20157        - ❌
20158        - ❌
20159        - ❌
20160        - ❌
20161      * - **browsertime-tp6m-geckoview-wikipedia-e10s**
20162        - ❌
20163        - ❌
20164        - ❌
20165        - ❌
20166      * - **browsertime-tp6m-live-fenix-wikipedia-e10s**
20167        - ❌
20168        - ❌
20169        - ❌
20170        - ❌
20171      * - **browsertime-tp6m-live-geckoview-wikipedia-e10s**
20172        - ❌
20173        - ❌
20174        - ❌
20175        - ❌
20176      * - **browsertime-tp6m-refbrow-wikipedia-e10s**
20177        - ❌
20178        - ❌
20179        - ❌
20180        - ❌
20181
20182
20183   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
20184      :widths: 30 15 15 15 15
20185      :header-rows: 1
20186
20187      * - **Test Name**
20188        - mozilla-central
20189        - autoland
20190        - mozilla-release
20191        - mozilla-beta
20192      * - **browsertime-tp6m-chrome-m-wikipedia-e10s**
20193        - ❌
20194        - ❌
20195        - ❌
20196        - ❌
20197      * - **browsertime-tp6m-fenix-wikipedia-e10s**
20198        - ❌
20199        - ❌
20200        - ❌
20201        - ❌
20202      * - **browsertime-tp6m-geckoview-wikipedia-e10s**
20203        - ❌
20204        - ❌
20205        - ❌
20206        - ❌
20207      * - **browsertime-tp6m-live-chrome-m-wikipedia-e10s**
20208        - ❌
20209        - ❌
20210        - ❌
20211        - ❌
20212      * - **browsertime-tp6m-live-fenix-wikipedia-e10s**
20213        - ❌
20214        - ❌
20215        - ❌
20216        - ❌
20217      * - **browsertime-tp6m-live-geckoview-wikipedia-e10s**
20218        - ❌
20219        - ❌
20220        - ❌
20221        - ❌
20222      * - **browsertime-tp6m-refbrow-wikipedia-e10s**
20223        - ❌
20224        - ❌
20225        - ❌
20226        - ❌
20227
20228
20229   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
20230      :widths: 30 15 15 15 15
20231      :header-rows: 1
20232
20233      * - **Test Name**
20234        - mozilla-central
20235        - autoland
20236        - mozilla-release
20237        - mozilla-beta
20238      * - **browsertime-tp6m-fenix-wikipedia-e10s**
20239        - ❌
20240        - ❌
20241        - ❌
20242        - ❌
20243      * - **browsertime-tp6m-geckoview-wikipedia-e10s**
20244        - ❌
20245        - ❌
20246        - ❌
20247        - ❌
20248      * - **browsertime-tp6m-live-fenix-wikipedia-e10s**
20249        - ❌
20250        - ❌
20251        - ❌
20252        - ❌
20253      * - **browsertime-tp6m-live-geckoview-wikipedia-e10s**
20254        - ❌
20255        - ❌
20256        - ❌
20257        - ❌
20258      * - **browsertime-tp6m-refbrow-wikipedia-e10s**
20259        - ❌
20260        - ❌
20261        - ❌
20262        - ❌
20263
20264
20265   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
20266      :widths: 30 15 15 15 15
20267      :header-rows: 1
20268
20269      * - **Test Name**
20270        - mozilla-central
20271        - autoland
20272        - mozilla-release
20273        - mozilla-beta
20274      * - **browsertime-tp6m-chrome-m-wikipedia-e10s**
20275        - ❌
20276        - ❌
20277        - ❌
20278        - ❌
20279      * - **browsertime-tp6m-fenix-wikipedia-e10s**
20280        - ❌
20281        - ❌
20282        - ❌
20283        - ❌
20284      * - **browsertime-tp6m-geckoview-wikipedia-e10s**
20285        - ❌
20286        - ❌
20287        - ❌
20288        - ❌
20289      * - **browsertime-tp6m-live-chrome-m-wikipedia-e10s**
20290        - ❌
20291        - ❌
20292        - ❌
20293        - ❌
20294      * - **browsertime-tp6m-live-fenix-wikipedia-e10s**
20295        - ❌
20296        - ❌
20297        - ❌
20298        - ❌
20299      * - **browsertime-tp6m-live-geckoview-wikipedia-e10s**
20300        - ❌
20301        - ❌
20302        - ❌
20303        - ❌
20304      * - **browsertime-tp6m-refbrow-wikipedia-e10s**
20305        - ❌
20306        - ❌
20307        - ❌
20308        - ❌
20309
20310
20311   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
20312      :widths: 30 15 15 15 15
20313      :header-rows: 1
20314
20315      * - **Test Name**
20316        - mozilla-central
20317        - autoland
20318        - mozilla-release
20319        - mozilla-beta
20320      * - **browsertime-tp6-essential-firefox-wikipedia-e10s**
20321        - ❌
20322        - ❌
20323        - ❌
20324        - ❌
20325      * - **browsertime-tp6-essential-firefox-wikipedia-fis-e10s**
20326        - ❌
20327        - ❌
20328        - ❌
20329        - ❌
20330      * - **browsertime-tp6-live-firefox-wikipedia-e10s**
20331        - ❌
20332        - ❌
20333        - ❌
20334        - ❌
20335      * - **browsertime-tp6-live-firefox-wikipedia-fis-e10s**
20336        - ❌
20337        - ❌
20338        - ❌
20339        - ❌
20340
20341
20342   .. list-table:: **test-linux1804-64-qr/opt**
20343      :widths: 30 15 15 15 15
20344      :header-rows: 1
20345
20346      * - **Test Name**
20347        - mozilla-central
20348        - autoland
20349        - mozilla-release
20350        - mozilla-beta
20351      * - **browsertime-tp6-essential-firefox-wikipedia-e10s**
20352        - ❌
20353        - ❌
20354        - ❌
20355        - ❌
20356      * - **browsertime-tp6-essential-firefox-wikipedia-fis-e10s**
20357        - ❌
20358        - ❌
20359        - ❌
20360        - ❌
20361      * - **browsertime-tp6-live-firefox-wikipedia-e10s**
20362        - ❌
20363        - ❌
20364        - ❌
20365        - ❌
20366      * - **browsertime-tp6-live-firefox-wikipedia-fis-e10s**
20367        - ❌
20368        - ❌
20369        - ❌
20370        - ❌
20371
20372
20373   .. list-table:: **test-linux1804-64-shippable-qr/opt**
20374      :widths: 30 15 15 15 15
20375      :header-rows: 1
20376
20377      * - **Test Name**
20378        - mozilla-central
20379        - autoland
20380        - mozilla-release
20381        - mozilla-beta
20382      * - **browsertime-tp6-essential-chrome-wikipedia-e10s**
20383        - ❌
20384        - ❌
20385        - ❌
20386        - ❌
20387      * - **browsertime-tp6-essential-chromium-wikipedia-e10s**
20388        - ❌
20389        - ❌
20390        - ❌
20391        - ❌
20392      * - **browsertime-tp6-essential-firefox-wikipedia-e10s**
20393        - ❌
20394        - ❌
20395        - ❌
20396        - ❌
20397      * - **browsertime-tp6-essential-firefox-wikipedia-fis-e10s**
20398        - ✅
20399        - ✅
20400        - ✅
20401        - ✅
20402      * - **browsertime-tp6-live-chrome-wikipedia-e10s**
20403        - ❌
20404        - ❌
20405        - ❌
20406        - ❌
20407      * - **browsertime-tp6-live-chromium-wikipedia-e10s**
20408        - ❌
20409        - ❌
20410        - ❌
20411        - ❌
20412      * - **browsertime-tp6-live-firefox-wikipedia-e10s**
20413        - ❌
20414        - ❌
20415        - ❌
20416        - ❌
20417      * - **browsertime-tp6-live-firefox-wikipedia-fis-e10s**
20418        - ❌
20419        - ❌
20420        - ❌
20421        - ❌
20422
20423
20424   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
20425      :widths: 30 15 15 15 15
20426      :header-rows: 1
20427
20428      * - **Test Name**
20429        - mozilla-central
20430        - autoland
20431        - mozilla-release
20432        - mozilla-beta
20433      * - **browsertime-tp6-essential-chrome-wikipedia-e10s**
20434        - ❌
20435        - ❌
20436        - ❌
20437        - ❌
20438      * - **browsertime-tp6-essential-chromium-wikipedia-e10s**
20439        - ❌
20440        - ❌
20441        - ❌
20442        - ❌
20443      * - **browsertime-tp6-essential-firefox-wikipedia-e10s**
20444        - ❌
20445        - ❌
20446        - ❌
20447        - ❌
20448      * - **browsertime-tp6-essential-firefox-wikipedia-fis-e10s**
20449        - ✅
20450        - ✅
20451        - ✅
20452        - ✅
20453      * - **browsertime-tp6-live-chrome-wikipedia-e10s**
20454        - ❌
20455        - ❌
20456        - ❌
20457        - ❌
20458      * - **browsertime-tp6-live-chromium-wikipedia-e10s**
20459        - ❌
20460        - ❌
20461        - ❌
20462        - ❌
20463      * - **browsertime-tp6-live-firefox-wikipedia-e10s**
20464        - ❌
20465        - ❌
20466        - ❌
20467        - ❌
20468      * - **browsertime-tp6-live-firefox-wikipedia-fis-e10s**
20469        - ❌
20470        - ❌
20471        - ❌
20472        - ❌
20473
20474
20475   .. list-table:: **test-windows10-32-qr/opt**
20476      :widths: 30 15 15 15 15
20477      :header-rows: 1
20478
20479      * - **Test Name**
20480        - mozilla-central
20481        - autoland
20482        - mozilla-release
20483        - mozilla-beta
20484      * - **browsertime-tp6-essential-firefox-wikipedia-e10s**
20485        - ❌
20486        - ❌
20487        - ❌
20488        - ❌
20489      * - **browsertime-tp6-essential-firefox-wikipedia-fis-e10s**
20490        - ❌
20491        - ❌
20492        - ❌
20493        - ❌
20494      * - **browsertime-tp6-live-firefox-wikipedia-e10s**
20495        - ❌
20496        - ❌
20497        - ❌
20498        - ❌
20499      * - **browsertime-tp6-live-firefox-wikipedia-fis-e10s**
20500        - ❌
20501        - ❌
20502        - ❌
20503        - ❌
20504
20505
20506   .. list-table:: **test-windows10-32-shippable-qr/opt**
20507      :widths: 30 15 15 15 15
20508      :header-rows: 1
20509
20510      * - **Test Name**
20511        - mozilla-central
20512        - autoland
20513        - mozilla-release
20514        - mozilla-beta
20515      * - **browsertime-tp6-essential-chrome-wikipedia-e10s**
20516        - ❌
20517        - ❌
20518        - ❌
20519        - ❌
20520      * - **browsertime-tp6-essential-chromium-wikipedia-e10s**
20521        - ❌
20522        - ❌
20523        - ❌
20524        - ❌
20525      * - **browsertime-tp6-essential-firefox-wikipedia-e10s**
20526        - ❌
20527        - ❌
20528        - ❌
20529        - ❌
20530      * - **browsertime-tp6-essential-firefox-wikipedia-fis-e10s**
20531        - ❌
20532        - ❌
20533        - ❌
20534        - ❌
20535      * - **browsertime-tp6-live-chrome-wikipedia-e10s**
20536        - ❌
20537        - ❌
20538        - ❌
20539        - ❌
20540      * - **browsertime-tp6-live-chromium-wikipedia-e10s**
20541        - ❌
20542        - ❌
20543        - ❌
20544        - ❌
20545      * - **browsertime-tp6-live-firefox-wikipedia-e10s**
20546        - ❌
20547        - ❌
20548        - ❌
20549        - ❌
20550      * - **browsertime-tp6-live-firefox-wikipedia-fis-e10s**
20551        - ❌
20552        - ❌
20553        - ❌
20554        - ❌
20555
20556
20557   .. list-table:: **test-windows10-64-qr/opt**
20558      :widths: 30 15 15 15 15
20559      :header-rows: 1
20560
20561      * - **Test Name**
20562        - mozilla-central
20563        - autoland
20564        - mozilla-release
20565        - mozilla-beta
20566      * - **browsertime-tp6-essential-firefox-wikipedia-e10s**
20567        - ❌
20568        - ❌
20569        - ❌
20570        - ❌
20571      * - **browsertime-tp6-essential-firefox-wikipedia-fis-e10s**
20572        - ❌
20573        - ❌
20574        - ❌
20575        - ❌
20576      * - **browsertime-tp6-live-firefox-wikipedia-e10s**
20577        - ❌
20578        - ❌
20579        - ❌
20580        - ❌
20581      * - **browsertime-tp6-live-firefox-wikipedia-fis-e10s**
20582        - ❌
20583        - ❌
20584        - ❌
20585        - ❌
20586
20587
20588   .. list-table:: **test-windows10-64-shippable-qr/opt**
20589      :widths: 30 15 15 15 15
20590      :header-rows: 1
20591
20592      * - **Test Name**
20593        - mozilla-central
20594        - autoland
20595        - mozilla-release
20596        - mozilla-beta
20597      * - **browsertime-tp6-essential-chrome-wikipedia-e10s**
20598        - ❌
20599        - ❌
20600        - ❌
20601        - ❌
20602      * - **browsertime-tp6-essential-chromium-wikipedia-e10s**
20603        - ❌
20604        - ❌
20605        - ❌
20606        - ❌
20607      * - **browsertime-tp6-essential-firefox-wikipedia-e10s**
20608        - ❌
20609        - ❌
20610        - ❌
20611        - ❌
20612      * - **browsertime-tp6-essential-firefox-wikipedia-fis-e10s**
20613        - ✅
20614        - ✅
20615        - ✅
20616        - ✅
20617      * - **browsertime-tp6-live-chrome-wikipedia-e10s**
20618        - ❌
20619        - ❌
20620        - ❌
20621        - ❌
20622      * - **browsertime-tp6-live-chromium-wikipedia-e10s**
20623        - ❌
20624        - ❌
20625        - ❌
20626        - ❌
20627      * - **browsertime-tp6-live-firefox-wikipedia-e10s**
20628        - ❌
20629        - ❌
20630        - ❌
20631        - ❌
20632      * - **browsertime-tp6-live-firefox-wikipedia-fis-e10s**
20633        - ❌
20634        - ❌
20635        - ❌
20636        - ❌
20637
20638
20639
20640.. dropdown:: yahoo-mail
20641   :container: + anchor-id-yahoo-mail-d
20642
20643   **Owner**: PerfTest Team
20644
20645   * **alert on**: fcp, loadtime
20646   * **alert threshold**: 2.0
20647   * **apps**: firefox, chrome, chromium
20648   * **browser cycles**: 25
20649   * **expected**: pass
20650   * **gecko profile entries**: 14000000
20651   * **gecko profile interval**: 1
20652   * **lower is better**: true
20653   * **measure**: fnbpaint, fcp, dcf, loadtime
20654   * **page cycles**: 25
20655   * **page timeout**: 60000
20656   * **playback**: mitmproxy
20657   * **playback pageset manifest**: mitm5-linux-firefox-yahoo-mail.manifest
20658   * **playback version**: 5.1.1
20659   * **test url**: `<https://mail.yahoo.com/>`__
20660   * **type**: pageload
20661   * **unit**: ms
20662   * **use live sites**: false
20663   * **Test Task**:
20664
20665   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
20666      :widths: 30 15 15 15 15
20667      :header-rows: 1
20668
20669      * - **Test Name**
20670        - mozilla-central
20671        - autoland
20672        - mozilla-release
20673        - mozilla-beta
20674      * - **browsertime-tp6-essential-firefox-yahoo-mail-e10s**
20675        - ❌
20676        - ❌
20677        - ❌
20678        - ❌
20679      * - **browsertime-tp6-essential-firefox-yahoo-mail-fis-e10s**
20680        - ❌
20681        - ❌
20682        - ❌
20683        - ❌
20684      * - **browsertime-tp6-live-firefox-yahoo-mail-e10s**
20685        - ❌
20686        - ❌
20687        - ❌
20688        - ❌
20689      * - **browsertime-tp6-live-firefox-yahoo-mail-fis-e10s**
20690        - ❌
20691        - ❌
20692        - ❌
20693        - ❌
20694
20695
20696   .. list-table:: **test-linux1804-64-qr/opt**
20697      :widths: 30 15 15 15 15
20698      :header-rows: 1
20699
20700      * - **Test Name**
20701        - mozilla-central
20702        - autoland
20703        - mozilla-release
20704        - mozilla-beta
20705      * - **browsertime-tp6-essential-firefox-yahoo-mail-e10s**
20706        - ❌
20707        - ❌
20708        - ❌
20709        - ❌
20710      * - **browsertime-tp6-essential-firefox-yahoo-mail-fis-e10s**
20711        - ❌
20712        - ❌
20713        - ❌
20714        - ❌
20715      * - **browsertime-tp6-live-firefox-yahoo-mail-e10s**
20716        - ❌
20717        - ❌
20718        - ❌
20719        - ❌
20720      * - **browsertime-tp6-live-firefox-yahoo-mail-fis-e10s**
20721        - ❌
20722        - ❌
20723        - ❌
20724        - ❌
20725
20726
20727   .. list-table:: **test-linux1804-64-shippable-qr/opt**
20728      :widths: 30 15 15 15 15
20729      :header-rows: 1
20730
20731      * - **Test Name**
20732        - mozilla-central
20733        - autoland
20734        - mozilla-release
20735        - mozilla-beta
20736      * - **browsertime-tp6-essential-chrome-yahoo-mail-e10s**
20737        - ❌
20738        - ❌
20739        - ❌
20740        - ❌
20741      * - **browsertime-tp6-essential-chromium-yahoo-mail-e10s**
20742        - ❌
20743        - ❌
20744        - ❌
20745        - ❌
20746      * - **browsertime-tp6-essential-firefox-yahoo-mail-e10s**
20747        - ❌
20748        - ❌
20749        - ❌
20750        - ❌
20751      * - **browsertime-tp6-essential-firefox-yahoo-mail-fis-e10s**
20752        - ✅
20753        - ✅
20754        - ✅
20755        - ✅
20756      * - **browsertime-tp6-live-chrome-yahoo-mail-e10s**
20757        - ❌
20758        - ❌
20759        - ❌
20760        - ❌
20761      * - **browsertime-tp6-live-chromium-yahoo-mail-e10s**
20762        - ❌
20763        - ❌
20764        - ❌
20765        - ❌
20766      * - **browsertime-tp6-live-firefox-yahoo-mail-e10s**
20767        - ❌
20768        - ❌
20769        - ❌
20770        - ❌
20771      * - **browsertime-tp6-live-firefox-yahoo-mail-fis-e10s**
20772        - ❌
20773        - ❌
20774        - ❌
20775        - ❌
20776
20777
20778   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
20779      :widths: 30 15 15 15 15
20780      :header-rows: 1
20781
20782      * - **Test Name**
20783        - mozilla-central
20784        - autoland
20785        - mozilla-release
20786        - mozilla-beta
20787      * - **browsertime-tp6-essential-chrome-yahoo-mail-e10s**
20788        - ❌
20789        - ❌
20790        - ❌
20791        - ❌
20792      * - **browsertime-tp6-essential-chromium-yahoo-mail-e10s**
20793        - ❌
20794        - ❌
20795        - ❌
20796        - ❌
20797      * - **browsertime-tp6-essential-firefox-yahoo-mail-e10s**
20798        - ❌
20799        - ❌
20800        - ❌
20801        - ❌
20802      * - **browsertime-tp6-essential-firefox-yahoo-mail-fis-e10s**
20803        - ✅
20804        - ✅
20805        - ✅
20806        - ✅
20807      * - **browsertime-tp6-live-chrome-yahoo-mail-e10s**
20808        - ❌
20809        - ❌
20810        - ❌
20811        - ❌
20812      * - **browsertime-tp6-live-chromium-yahoo-mail-e10s**
20813        - ❌
20814        - ❌
20815        - ❌
20816        - ❌
20817      * - **browsertime-tp6-live-firefox-yahoo-mail-e10s**
20818        - ❌
20819        - ❌
20820        - ❌
20821        - ❌
20822      * - **browsertime-tp6-live-firefox-yahoo-mail-fis-e10s**
20823        - ❌
20824        - ❌
20825        - ❌
20826        - ❌
20827
20828
20829   .. list-table:: **test-windows10-32-qr/opt**
20830      :widths: 30 15 15 15 15
20831      :header-rows: 1
20832
20833      * - **Test Name**
20834        - mozilla-central
20835        - autoland
20836        - mozilla-release
20837        - mozilla-beta
20838      * - **browsertime-tp6-essential-firefox-yahoo-mail-e10s**
20839        - ❌
20840        - ❌
20841        - ❌
20842        - ❌
20843      * - **browsertime-tp6-essential-firefox-yahoo-mail-fis-e10s**
20844        - ❌
20845        - ❌
20846        - ❌
20847        - ❌
20848      * - **browsertime-tp6-live-firefox-yahoo-mail-e10s**
20849        - ❌
20850        - ❌
20851        - ❌
20852        - ❌
20853      * - **browsertime-tp6-live-firefox-yahoo-mail-fis-e10s**
20854        - ❌
20855        - ❌
20856        - ❌
20857        - ❌
20858
20859
20860   .. list-table:: **test-windows10-32-shippable-qr/opt**
20861      :widths: 30 15 15 15 15
20862      :header-rows: 1
20863
20864      * - **Test Name**
20865        - mozilla-central
20866        - autoland
20867        - mozilla-release
20868        - mozilla-beta
20869      * - **browsertime-tp6-essential-chrome-yahoo-mail-e10s**
20870        - ❌
20871        - ❌
20872        - ❌
20873        - ❌
20874      * - **browsertime-tp6-essential-chromium-yahoo-mail-e10s**
20875        - ❌
20876        - ❌
20877        - ❌
20878        - ❌
20879      * - **browsertime-tp6-essential-firefox-yahoo-mail-e10s**
20880        - ❌
20881        - ❌
20882        - ❌
20883        - ❌
20884      * - **browsertime-tp6-essential-firefox-yahoo-mail-fis-e10s**
20885        - ❌
20886        - ❌
20887        - ❌
20888        - ❌
20889      * - **browsertime-tp6-live-chrome-yahoo-mail-e10s**
20890        - ❌
20891        - ❌
20892        - ❌
20893        - ❌
20894      * - **browsertime-tp6-live-chromium-yahoo-mail-e10s**
20895        - ❌
20896        - ❌
20897        - ❌
20898        - ❌
20899      * - **browsertime-tp6-live-firefox-yahoo-mail-e10s**
20900        - ❌
20901        - ❌
20902        - ❌
20903        - ❌
20904      * - **browsertime-tp6-live-firefox-yahoo-mail-fis-e10s**
20905        - ❌
20906        - ❌
20907        - ❌
20908        - ❌
20909
20910
20911   .. list-table:: **test-windows10-64-qr/opt**
20912      :widths: 30 15 15 15 15
20913      :header-rows: 1
20914
20915      * - **Test Name**
20916        - mozilla-central
20917        - autoland
20918        - mozilla-release
20919        - mozilla-beta
20920      * - **browsertime-tp6-essential-firefox-yahoo-mail-e10s**
20921        - ❌
20922        - ❌
20923        - ❌
20924        - ❌
20925      * - **browsertime-tp6-essential-firefox-yahoo-mail-fis-e10s**
20926        - ❌
20927        - ❌
20928        - ❌
20929        - ❌
20930      * - **browsertime-tp6-live-firefox-yahoo-mail-e10s**
20931        - ❌
20932        - ❌
20933        - ❌
20934        - ❌
20935      * - **browsertime-tp6-live-firefox-yahoo-mail-fis-e10s**
20936        - ❌
20937        - ❌
20938        - ❌
20939        - ❌
20940
20941
20942   .. list-table:: **test-windows10-64-shippable-qr/opt**
20943      :widths: 30 15 15 15 15
20944      :header-rows: 1
20945
20946      * - **Test Name**
20947        - mozilla-central
20948        - autoland
20949        - mozilla-release
20950        - mozilla-beta
20951      * - **browsertime-tp6-essential-chrome-yahoo-mail-e10s**
20952        - ❌
20953        - ❌
20954        - ❌
20955        - ❌
20956      * - **browsertime-tp6-essential-chromium-yahoo-mail-e10s**
20957        - ❌
20958        - ❌
20959        - ❌
20960        - ❌
20961      * - **browsertime-tp6-essential-firefox-yahoo-mail-e10s**
20962        - ❌
20963        - ❌
20964        - ❌
20965        - ❌
20966      * - **browsertime-tp6-essential-firefox-yahoo-mail-fis-e10s**
20967        - ✅
20968        - ✅
20969        - ✅
20970        - ✅
20971      * - **browsertime-tp6-live-chrome-yahoo-mail-e10s**
20972        - ❌
20973        - ❌
20974        - ❌
20975        - ❌
20976      * - **browsertime-tp6-live-chromium-yahoo-mail-e10s**
20977        - ❌
20978        - ❌
20979        - ❌
20980        - ❌
20981      * - **browsertime-tp6-live-firefox-yahoo-mail-e10s**
20982        - ❌
20983        - ❌
20984        - ❌
20985        - ❌
20986      * - **browsertime-tp6-live-firefox-yahoo-mail-fis-e10s**
20987        - ❌
20988        - ❌
20989        - ❌
20990        - ❌
20991
20992
20993
20994.. dropdown:: youtube
20995   :container: + anchor-id-youtube-d
20996
20997   **Owner**: PerfTest Team
20998
20999   * **alert on**: fcp, loadtime
21000   * **alert threshold**: 2.0
21001   * **apps**: firefox, chrome, chromium
21002   * **browser cycles**: 25
21003   * **expected**: pass
21004   * **gecko profile entries**: 14000000
21005   * **gecko profile interval**: 1
21006   * **lower is better**: true
21007   * **measure**: fnbpaint, fcp, dcf, loadtime
21008   * **page cycles**: 25
21009   * **page timeout**: 60000
21010   * **playback**: mitmproxy
21011   * **playback pageset manifest**: mitm7-linux-firefox-youtube.manifest
21012   * **playback version**: 7.0.4
21013   * **secondary url**: `<https://www.youtube.com/watch?v=JrdEMERq8MA>`__
21014   * **test url**: `<https://www.youtube.com>`__
21015   * **type**: pageload
21016   * **unit**: ms
21017   * **use live sites**: false
21018   * **Test Task**:
21019
21020   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
21021      :widths: 30 15 15 15 15
21022      :header-rows: 1
21023
21024      * - **Test Name**
21025        - mozilla-central
21026        - autoland
21027        - mozilla-release
21028        - mozilla-beta
21029      * - **browsertime-tp6m-fenix-youtube-e10s**
21030        - ❌
21031        - ❌
21032        - ❌
21033        - ❌
21034      * - **browsertime-tp6m-geckoview-youtube-e10s**
21035        - ❌
21036        - ❌
21037        - ❌
21038        - ❌
21039      * - **browsertime-tp6m-live-fenix-youtube-e10s**
21040        - ❌
21041        - ❌
21042        - ❌
21043        - ❌
21044      * - **browsertime-tp6m-live-geckoview-youtube-e10s**
21045        - ❌
21046        - ❌
21047        - ❌
21048        - ❌
21049      * - **browsertime-tp6m-refbrow-youtube-e10s**
21050        - ❌
21051        - ❌
21052        - ❌
21053        - ❌
21054
21055
21056   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
21057      :widths: 30 15 15 15 15
21058      :header-rows: 1
21059
21060      * - **Test Name**
21061        - mozilla-central
21062        - autoland
21063        - mozilla-release
21064        - mozilla-beta
21065      * - **browsertime-tp6m-chrome-m-youtube-e10s**
21066        - ❌
21067        - ❌
21068        - ❌
21069        - ❌
21070      * - **browsertime-tp6m-fenix-youtube-e10s**
21071        - ❌
21072        - ❌
21073        - ❌
21074        - ❌
21075      * - **browsertime-tp6m-geckoview-youtube-e10s**
21076        - ✅
21077        - ✅
21078        - ✅
21079        - ✅
21080      * - **browsertime-tp6m-live-chrome-m-youtube-e10s**
21081        - ❌
21082        - ❌
21083        - ❌
21084        - ❌
21085      * - **browsertime-tp6m-live-fenix-youtube-e10s**
21086        - ❌
21087        - ❌
21088        - ❌
21089        - ❌
21090      * - **browsertime-tp6m-live-geckoview-youtube-e10s**
21091        - ❌
21092        - ❌
21093        - ❌
21094        - ❌
21095      * - **browsertime-tp6m-refbrow-youtube-e10s**
21096        - ❌
21097        - ❌
21098        - ❌
21099        - ❌
21100
21101
21102   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
21103      :widths: 30 15 15 15 15
21104      :header-rows: 1
21105
21106      * - **Test Name**
21107        - mozilla-central
21108        - autoland
21109        - mozilla-release
21110        - mozilla-beta
21111      * - **browsertime-tp6m-fenix-youtube-e10s**
21112        - ❌
21113        - ❌
21114        - ❌
21115        - ❌
21116      * - **browsertime-tp6m-geckoview-youtube-e10s**
21117        - ❌
21118        - ❌
21119        - ❌
21120        - ❌
21121      * - **browsertime-tp6m-live-fenix-youtube-e10s**
21122        - ❌
21123        - ❌
21124        - ❌
21125        - ❌
21126      * - **browsertime-tp6m-live-geckoview-youtube-e10s**
21127        - ❌
21128        - ❌
21129        - ❌
21130        - ❌
21131      * - **browsertime-tp6m-refbrow-youtube-e10s**
21132        - ❌
21133        - ❌
21134        - ❌
21135        - ❌
21136
21137
21138   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
21139      :widths: 30 15 15 15 15
21140      :header-rows: 1
21141
21142      * - **Test Name**
21143        - mozilla-central
21144        - autoland
21145        - mozilla-release
21146        - mozilla-beta
21147      * - **browsertime-tp6m-chrome-m-youtube-e10s**
21148        - ❌
21149        - ❌
21150        - ❌
21151        - ❌
21152      * - **browsertime-tp6m-fenix-youtube-e10s**
21153        - ❌
21154        - ❌
21155        - ❌
21156        - ❌
21157      * - **browsertime-tp6m-geckoview-youtube-e10s**
21158        - ✅
21159        - ✅
21160        - ✅
21161        - ✅
21162      * - **browsertime-tp6m-live-chrome-m-youtube-e10s**
21163        - ❌
21164        - ❌
21165        - ❌
21166        - ❌
21167      * - **browsertime-tp6m-live-fenix-youtube-e10s**
21168        - ❌
21169        - ❌
21170        - ❌
21171        - ❌
21172      * - **browsertime-tp6m-live-geckoview-youtube-e10s**
21173        - ❌
21174        - ❌
21175        - ❌
21176        - ❌
21177      * - **browsertime-tp6m-profiling-geckoview-youtube-e10s**
21178        - ✅
21179        - ❌
21180        - ❌
21181        - ❌
21182      * - **browsertime-tp6m-refbrow-youtube-e10s**
21183        - ❌
21184        - ❌
21185        - ❌
21186        - ❌
21187
21188
21189   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
21190      :widths: 30 15 15 15 15
21191      :header-rows: 1
21192
21193      * - **Test Name**
21194        - mozilla-central
21195        - autoland
21196        - mozilla-release
21197        - mozilla-beta
21198      * - **browsertime-tp6m-fenix-youtube-e10s**
21199        - ❌
21200        - ❌
21201        - ❌
21202        - ❌
21203      * - **browsertime-tp6m-geckoview-youtube-e10s**
21204        - ❌
21205        - ❌
21206        - ❌
21207        - ❌
21208      * - **browsertime-tp6m-live-fenix-youtube-e10s**
21209        - ❌
21210        - ❌
21211        - ❌
21212        - ❌
21213      * - **browsertime-tp6m-live-geckoview-youtube-e10s**
21214        - ❌
21215        - ❌
21216        - ❌
21217        - ❌
21218      * - **browsertime-tp6m-refbrow-youtube-e10s**
21219        - ❌
21220        - ❌
21221        - ❌
21222        - ❌
21223
21224
21225   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
21226      :widths: 30 15 15 15 15
21227      :header-rows: 1
21228
21229      * - **Test Name**
21230        - mozilla-central
21231        - autoland
21232        - mozilla-release
21233        - mozilla-beta
21234      * - **browsertime-tp6m-chrome-m-youtube-e10s**
21235        - ❌
21236        - ❌
21237        - ❌
21238        - ❌
21239      * - **browsertime-tp6m-fenix-youtube-e10s**
21240        - ❌
21241        - ❌
21242        - ❌
21243        - ❌
21244      * - **browsertime-tp6m-geckoview-youtube-e10s**
21245        - ❌
21246        - ❌
21247        - ❌
21248        - ❌
21249      * - **browsertime-tp6m-live-chrome-m-youtube-e10s**
21250        - ❌
21251        - ❌
21252        - ❌
21253        - ❌
21254      * - **browsertime-tp6m-live-fenix-youtube-e10s**
21255        - ❌
21256        - ❌
21257        - ❌
21258        - ❌
21259      * - **browsertime-tp6m-live-geckoview-youtube-e10s**
21260        - ❌
21261        - ❌
21262        - ❌
21263        - ❌
21264      * - **browsertime-tp6m-refbrow-youtube-e10s**
21265        - ❌
21266        - ❌
21267        - ❌
21268        - ❌
21269
21270
21271   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
21272      :widths: 30 15 15 15 15
21273      :header-rows: 1
21274
21275      * - **Test Name**
21276        - mozilla-central
21277        - autoland
21278        - mozilla-release
21279        - mozilla-beta
21280      * - **browsertime-tp6m-fenix-youtube-e10s**
21281        - ❌
21282        - ❌
21283        - ❌
21284        - ❌
21285      * - **browsertime-tp6m-geckoview-youtube-e10s**
21286        - ❌
21287        - ❌
21288        - ❌
21289        - ❌
21290      * - **browsertime-tp6m-live-fenix-youtube-e10s**
21291        - ❌
21292        - ❌
21293        - ❌
21294        - ❌
21295      * - **browsertime-tp6m-live-geckoview-youtube-e10s**
21296        - ❌
21297        - ❌
21298        - ❌
21299        - ❌
21300      * - **browsertime-tp6m-refbrow-youtube-e10s**
21301        - ❌
21302        - ❌
21303        - ❌
21304        - ❌
21305
21306
21307   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
21308      :widths: 30 15 15 15 15
21309      :header-rows: 1
21310
21311      * - **Test Name**
21312        - mozilla-central
21313        - autoland
21314        - mozilla-release
21315        - mozilla-beta
21316      * - **browsertime-tp6m-chrome-m-youtube-e10s**
21317        - ❌
21318        - ❌
21319        - ❌
21320        - ❌
21321      * - **browsertime-tp6m-fenix-youtube-e10s**
21322        - ❌
21323        - ❌
21324        - ❌
21325        - ❌
21326      * - **browsertime-tp6m-geckoview-youtube-e10s**
21327        - ❌
21328        - ❌
21329        - ❌
21330        - ❌
21331      * - **browsertime-tp6m-live-chrome-m-youtube-e10s**
21332        - ❌
21333        - ❌
21334        - ❌
21335        - ❌
21336      * - **browsertime-tp6m-live-fenix-youtube-e10s**
21337        - ❌
21338        - ❌
21339        - ❌
21340        - ❌
21341      * - **browsertime-tp6m-live-geckoview-youtube-e10s**
21342        - ❌
21343        - ❌
21344        - ❌
21345        - ❌
21346      * - **browsertime-tp6m-refbrow-youtube-e10s**
21347        - ❌
21348        - ❌
21349        - ❌
21350        - ❌
21351
21352
21353   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
21354      :widths: 30 15 15 15 15
21355      :header-rows: 1
21356
21357      * - **Test Name**
21358        - mozilla-central
21359        - autoland
21360        - mozilla-release
21361        - mozilla-beta
21362      * - **browsertime-tp6-firefox-youtube-e10s**
21363        - ❌
21364        - ❌
21365        - ❌
21366        - ❌
21367      * - **browsertime-tp6-firefox-youtube-fis-e10s**
21368        - ❌
21369        - ❌
21370        - ❌
21371        - ❌
21372      * - **browsertime-tp6-live-firefox-youtube-e10s**
21373        - ❌
21374        - ❌
21375        - ❌
21376        - ❌
21377      * - **browsertime-tp6-live-firefox-youtube-fis-e10s**
21378        - ❌
21379        - ❌
21380        - ❌
21381        - ❌
21382
21383
21384   .. list-table:: **test-linux1804-64-qr/opt**
21385      :widths: 30 15 15 15 15
21386      :header-rows: 1
21387
21388      * - **Test Name**
21389        - mozilla-central
21390        - autoland
21391        - mozilla-release
21392        - mozilla-beta
21393      * - **browsertime-tp6-firefox-youtube-e10s**
21394        - ❌
21395        - ❌
21396        - ❌
21397        - ❌
21398      * - **browsertime-tp6-firefox-youtube-fis-e10s**
21399        - ❌
21400        - ❌
21401        - ❌
21402        - ❌
21403      * - **browsertime-tp6-live-firefox-youtube-e10s**
21404        - ❌
21405        - ❌
21406        - ❌
21407        - ❌
21408      * - **browsertime-tp6-live-firefox-youtube-fis-e10s**
21409        - ❌
21410        - ❌
21411        - ❌
21412        - ❌
21413
21414
21415   .. list-table:: **test-linux1804-64-shippable-qr/opt**
21416      :widths: 30 15 15 15 15
21417      :header-rows: 1
21418
21419      * - **Test Name**
21420        - mozilla-central
21421        - autoland
21422        - mozilla-release
21423        - mozilla-beta
21424      * - **browsertime-tp6-chrome-youtube-e10s**
21425        - ❌
21426        - ❌
21427        - ❌
21428        - ❌
21429      * - **browsertime-tp6-chromium-youtube-e10s**
21430        - ❌
21431        - ❌
21432        - ❌
21433        - ❌
21434      * - **browsertime-tp6-firefox-youtube-e10s**
21435        - ❌
21436        - ❌
21437        - ❌
21438        - ❌
21439      * - **browsertime-tp6-firefox-youtube-fis-e10s**
21440        - ✅
21441        - ✅
21442        - ✅
21443        - ✅
21444      * - **browsertime-tp6-live-chrome-youtube-e10s**
21445        - ❌
21446        - ❌
21447        - ❌
21448        - ❌
21449      * - **browsertime-tp6-live-chromium-youtube-e10s**
21450        - ❌
21451        - ❌
21452        - ❌
21453        - ❌
21454      * - **browsertime-tp6-live-firefox-youtube-e10s**
21455        - ❌
21456        - ❌
21457        - ❌
21458        - ❌
21459      * - **browsertime-tp6-live-firefox-youtube-fis-e10s**
21460        - ❌
21461        - ❌
21462        - ❌
21463        - ❌
21464
21465
21466   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
21467      :widths: 30 15 15 15 15
21468      :header-rows: 1
21469
21470      * - **Test Name**
21471        - mozilla-central
21472        - autoland
21473        - mozilla-release
21474        - mozilla-beta
21475      * - **browsertime-tp6-chrome-youtube-e10s**
21476        - ❌
21477        - ❌
21478        - ❌
21479        - ❌
21480      * - **browsertime-tp6-chromium-youtube-e10s**
21481        - ❌
21482        - ❌
21483        - ❌
21484        - ❌
21485      * - **browsertime-tp6-firefox-youtube-e10s**
21486        - ❌
21487        - ❌
21488        - ❌
21489        - ❌
21490      * - **browsertime-tp6-firefox-youtube-fis-e10s**
21491        - ✅
21492        - ✅
21493        - ✅
21494        - ✅
21495      * - **browsertime-tp6-live-chrome-youtube-e10s**
21496        - ❌
21497        - ❌
21498        - ❌
21499        - ❌
21500      * - **browsertime-tp6-live-chromium-youtube-e10s**
21501        - ❌
21502        - ❌
21503        - ❌
21504        - ❌
21505      * - **browsertime-tp6-live-firefox-youtube-e10s**
21506        - ❌
21507        - ❌
21508        - ❌
21509        - ❌
21510      * - **browsertime-tp6-live-firefox-youtube-fis-e10s**
21511        - ❌
21512        - ❌
21513        - ❌
21514        - ❌
21515
21516
21517   .. list-table:: **test-windows10-32-qr/opt**
21518      :widths: 30 15 15 15 15
21519      :header-rows: 1
21520
21521      * - **Test Name**
21522        - mozilla-central
21523        - autoland
21524        - mozilla-release
21525        - mozilla-beta
21526      * - **browsertime-tp6-firefox-youtube-e10s**
21527        - ❌
21528        - ❌
21529        - ❌
21530        - ❌
21531      * - **browsertime-tp6-firefox-youtube-fis-e10s**
21532        - ❌
21533        - ❌
21534        - ❌
21535        - ❌
21536      * - **browsertime-tp6-live-firefox-youtube-e10s**
21537        - ❌
21538        - ❌
21539        - ❌
21540        - ❌
21541      * - **browsertime-tp6-live-firefox-youtube-fis-e10s**
21542        - ❌
21543        - ❌
21544        - ❌
21545        - ❌
21546
21547
21548   .. list-table:: **test-windows10-32-shippable-qr/opt**
21549      :widths: 30 15 15 15 15
21550      :header-rows: 1
21551
21552      * - **Test Name**
21553        - mozilla-central
21554        - autoland
21555        - mozilla-release
21556        - mozilla-beta
21557      * - **browsertime-tp6-chrome-youtube-e10s**
21558        - ❌
21559        - ❌
21560        - ❌
21561        - ❌
21562      * - **browsertime-tp6-chromium-youtube-e10s**
21563        - ❌
21564        - ❌
21565        - ❌
21566        - ❌
21567      * - **browsertime-tp6-firefox-youtube-e10s**
21568        - ❌
21569        - ❌
21570        - ❌
21571        - ❌
21572      * - **browsertime-tp6-firefox-youtube-fis-e10s**
21573        - ❌
21574        - ❌
21575        - ❌
21576        - ❌
21577      * - **browsertime-tp6-live-chrome-youtube-e10s**
21578        - ❌
21579        - ❌
21580        - ❌
21581        - ❌
21582      * - **browsertime-tp6-live-chromium-youtube-e10s**
21583        - ❌
21584        - ❌
21585        - ❌
21586        - ❌
21587      * - **browsertime-tp6-live-firefox-youtube-e10s**
21588        - ❌
21589        - ❌
21590        - ❌
21591        - ❌
21592      * - **browsertime-tp6-live-firefox-youtube-fis-e10s**
21593        - ❌
21594        - ❌
21595        - ❌
21596        - ❌
21597
21598
21599   .. list-table:: **test-windows10-64-qr/opt**
21600      :widths: 30 15 15 15 15
21601      :header-rows: 1
21602
21603      * - **Test Name**
21604        - mozilla-central
21605        - autoland
21606        - mozilla-release
21607        - mozilla-beta
21608      * - **browsertime-tp6-firefox-youtube-e10s**
21609        - ❌
21610        - ❌
21611        - ❌
21612        - ❌
21613      * - **browsertime-tp6-firefox-youtube-fis-e10s**
21614        - ❌
21615        - ❌
21616        - ❌
21617        - ❌
21618      * - **browsertime-tp6-live-firefox-youtube-e10s**
21619        - ❌
21620        - ❌
21621        - ❌
21622        - ❌
21623      * - **browsertime-tp6-live-firefox-youtube-fis-e10s**
21624        - ❌
21625        - ❌
21626        - ❌
21627        - ❌
21628
21629
21630   .. list-table:: **test-windows10-64-shippable-qr/opt**
21631      :widths: 30 15 15 15 15
21632      :header-rows: 1
21633
21634      * - **Test Name**
21635        - mozilla-central
21636        - autoland
21637        - mozilla-release
21638        - mozilla-beta
21639      * - **browsertime-tp6-chrome-youtube-e10s**
21640        - ❌
21641        - ❌
21642        - ❌
21643        - ❌
21644      * - **browsertime-tp6-chromium-youtube-e10s**
21645        - ❌
21646        - ❌
21647        - ❌
21648        - ❌
21649      * - **browsertime-tp6-firefox-youtube-e10s**
21650        - ❌
21651        - ❌
21652        - ❌
21653        - ❌
21654      * - **browsertime-tp6-firefox-youtube-fis-e10s**
21655        - ✅
21656        - ✅
21657        - ✅
21658        - ✅
21659      * - **browsertime-tp6-live-chrome-youtube-e10s**
21660        - ❌
21661        - ❌
21662        - ❌
21663        - ❌
21664      * - **browsertime-tp6-live-chromium-youtube-e10s**
21665        - ❌
21666        - ❌
21667        - ❌
21668        - ❌
21669      * - **browsertime-tp6-live-firefox-youtube-e10s**
21670        - ❌
21671        - ❌
21672        - ❌
21673        - ❌
21674      * - **browsertime-tp6-live-firefox-youtube-fis-e10s**
21675        - ❌
21676        - ❌
21677        - ❌
21678        - ❌
21679
21680
21681
21682
21683Interactive
21684-----------
21685Browsertime tests that interact with the webpage. Includes responsiveness tests as they make use of this support for navigation. These form of tests allow the specification of browsertime commands through the test manifest.
21686
21687.. dropdown:: cnn-nav
21688   :container: + anchor-id-cnn-nav-i
21689
21690   **Owner**: PerfTest Team
21691
21692   * **accept zero vismet**: true
21693   * **alert on**: fcp, loadtime
21694   * **alert threshold**: 2.0
21695   * **apps**: firefox, chrome, chromium
21696   * **browser cycles**: 10
21697   * **expected**: pass
21698   * **gecko profile entries**: 14000000
21699   * **gecko profile interval**: 1
21700   * **interactive**: true
21701   * **lower is better**: true
21702   * **measure**: fnbpaint, fcp, dcf, loadtime
21703   * **page cycles**: 25
21704   * **page timeout**: 60000
21705   * **playback**: mitmproxy
21706   * **playback pageset manifest**: mitm7-linux-firefox-cnn-nav.manifest
21707   * **playback version**: 7.0.4
21708   * **test cmds**:  ["measure.start", "landing"], ["navigate", "https://www.cnn.com"], ["wait.byTime", 4000], ["measure.stop", ""], ["measure.start", "world"], ["click.byXpathAndWait", "/html/body/div[5]/div/div/header/div/div[1]/div/div[2]/nav/ul/li[2]/a"], ["wait.byTime", 1000], ["measure.stop", ""],
21709   * **test url**: `<https://www.cnn.com/>`__
21710   * **type**: pageload
21711   * **unit**: ms
21712   * **use live sites**: false
21713   * **Test Task**:
21714
21715   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
21716      :widths: 30 15 15 15 15
21717      :header-rows: 1
21718
21719      * - **Test Name**
21720        - mozilla-central
21721        - autoland
21722        - mozilla-release
21723        - mozilla-beta
21724      * - **browsertime-responsiveness-firefox-cnn-nav-e10s**
21725        - ❌
21726        - ❌
21727        - ❌
21728        - ❌
21729      * - **browsertime-responsiveness-firefox-cnn-nav-fis-e10s**
21730        - ❌
21731        - ❌
21732        - ❌
21733        - ❌
21734
21735
21736   .. list-table:: **test-linux1804-64-qr/opt**
21737      :widths: 30 15 15 15 15
21738      :header-rows: 1
21739
21740      * - **Test Name**
21741        - mozilla-central
21742        - autoland
21743        - mozilla-release
21744        - mozilla-beta
21745      * - **browsertime-responsiveness-firefox-cnn-nav-e10s**
21746        - ❌
21747        - ❌
21748        - ❌
21749        - ❌
21750      * - **browsertime-responsiveness-firefox-cnn-nav-fis-e10s**
21751        - ❌
21752        - ❌
21753        - ❌
21754        - ❌
21755
21756
21757   .. list-table:: **test-linux1804-64-shippable-qr/opt**
21758      :widths: 30 15 15 15 15
21759      :header-rows: 1
21760
21761      * - **Test Name**
21762        - mozilla-central
21763        - autoland
21764        - mozilla-release
21765        - mozilla-beta
21766      * - **browsertime-responsiveness-chrome-cnn-nav-e10s**
21767        - ❌
21768        - ❌
21769        - ❌
21770        - ❌
21771      * - **browsertime-responsiveness-chromium-cnn-nav-e10s**
21772        - ❌
21773        - ❌
21774        - ❌
21775        - ❌
21776      * - **browsertime-responsiveness-firefox-cnn-nav-e10s**
21777        - ❌
21778        - ❌
21779        - ❌
21780        - ❌
21781      * - **browsertime-responsiveness-firefox-cnn-nav-fis-e10s**
21782        - ✅
21783        - ✅
21784        - ❌
21785        - ❌
21786
21787
21788   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
21789      :widths: 30 15 15 15 15
21790      :header-rows: 1
21791
21792      * - **Test Name**
21793        - mozilla-central
21794        - autoland
21795        - mozilla-release
21796        - mozilla-beta
21797      * - **browsertime-responsiveness-chrome-cnn-nav-e10s**
21798        - ❌
21799        - ❌
21800        - ❌
21801        - ❌
21802      * - **browsertime-responsiveness-chromium-cnn-nav-e10s**
21803        - ❌
21804        - ❌
21805        - ❌
21806        - ❌
21807      * - **browsertime-responsiveness-firefox-cnn-nav-e10s**
21808        - ❌
21809        - ❌
21810        - ❌
21811        - ❌
21812      * - **browsertime-responsiveness-firefox-cnn-nav-fis-e10s**
21813        - ✅
21814        - ✅
21815        - ❌
21816        - ❌
21817
21818
21819   .. list-table:: **test-windows10-32-qr/opt**
21820      :widths: 30 15 15 15 15
21821      :header-rows: 1
21822
21823      * - **Test Name**
21824        - mozilla-central
21825        - autoland
21826        - mozilla-release
21827        - mozilla-beta
21828      * - **browsertime-responsiveness-firefox-cnn-nav-e10s**
21829        - ❌
21830        - ❌
21831        - ❌
21832        - ❌
21833      * - **browsertime-responsiveness-firefox-cnn-nav-fis-e10s**
21834        - ❌
21835        - ❌
21836        - ❌
21837        - ❌
21838
21839
21840   .. list-table:: **test-windows10-32-shippable-qr/opt**
21841      :widths: 30 15 15 15 15
21842      :header-rows: 1
21843
21844      * - **Test Name**
21845        - mozilla-central
21846        - autoland
21847        - mozilla-release
21848        - mozilla-beta
21849      * - **browsertime-responsiveness-chrome-cnn-nav-e10s**
21850        - ❌
21851        - ❌
21852        - ❌
21853        - ❌
21854      * - **browsertime-responsiveness-chromium-cnn-nav-e10s**
21855        - ❌
21856        - ❌
21857        - ❌
21858        - ❌
21859      * - **browsertime-responsiveness-firefox-cnn-nav-e10s**
21860        - ❌
21861        - ❌
21862        - ❌
21863        - ❌
21864      * - **browsertime-responsiveness-firefox-cnn-nav-fis-e10s**
21865        - ❌
21866        - ❌
21867        - ❌
21868        - ❌
21869
21870
21871   .. list-table:: **test-windows10-64-qr/opt**
21872      :widths: 30 15 15 15 15
21873      :header-rows: 1
21874
21875      * - **Test Name**
21876        - mozilla-central
21877        - autoland
21878        - mozilla-release
21879        - mozilla-beta
21880      * - **browsertime-responsiveness-firefox-cnn-nav-e10s**
21881        - ❌
21882        - ❌
21883        - ❌
21884        - ❌
21885      * - **browsertime-responsiveness-firefox-cnn-nav-fis-e10s**
21886        - ❌
21887        - ❌
21888        - ❌
21889        - ❌
21890
21891
21892   .. list-table:: **test-windows10-64-shippable-qr/opt**
21893      :widths: 30 15 15 15 15
21894      :header-rows: 1
21895
21896      * - **Test Name**
21897        - mozilla-central
21898        - autoland
21899        - mozilla-release
21900        - mozilla-beta
21901      * - **browsertime-responsiveness-chrome-cnn-nav-e10s**
21902        - ❌
21903        - ❌
21904        - ❌
21905        - ❌
21906      * - **browsertime-responsiveness-chromium-cnn-nav-e10s**
21907        - ❌
21908        - ❌
21909        - ❌
21910        - ❌
21911      * - **browsertime-responsiveness-firefox-cnn-nav-e10s**
21912        - ❌
21913        - ❌
21914        - ❌
21915        - ❌
21916      * - **browsertime-responsiveness-firefox-cnn-nav-fis-e10s**
21917        - ✅
21918        - ✅
21919        - ❌
21920        - ❌
21921
21922
21923
21924.. dropdown:: facebook-nav
21925   :container: + anchor-id-facebook-nav-i
21926
21927   **Owner**: PerfTest Team
21928
21929   * **accept zero vismet**: true
21930   * **alert on**: fcp, loadtime
21931   * **alert threshold**: 2.0
21932   * **apps**: firefox, chrome, chromium
21933   * **browser cycles**: 10
21934   * **expected**: pass
21935   * **gecko profile entries**: 14000000
21936   * **gecko profile interval**: 1
21937   * **interactive**: true
21938   * **lower is better**: true
21939   * **measure**: fnbpaint, fcp, dcf, loadtime
21940   * **page cycles**: 25
21941   * **page timeout**: 90000
21942   * **playback**: mitmproxy
21943   * **playback pageset manifest**: mitm6-windows-firefox-facebook-nav.manifest
21944   * **playback version**: 6.0.2
21945   * **test cmds**:  ["measure.start", "landing"], ["navigate", "https://www.facebook.com/"], ["wait.byTime", 5000], ["measure.stop", ""], ["measure.start", "marketplace"], ["navigate", "https://www.facebook.com/marketplace"], ["wait.byTime", 5000], ["measure.stop", ""], ["measure.start", "groups"], ["navigate", "https://www.facebook.com/groups/discover/"], ["wait.byTime", 5000], ["measure.stop", ""], ["measure.start", "friends"], ["navigate", "https://www.facebook.com/friends/"], ["wait.byTime", 5000], ["measure.stop", ""],
21946   * **test url**: `<https://www.facebook.com>`__
21947   * **type**: pageload
21948   * **unit**: ms
21949   * **use live sites**: false
21950   * **Test Task**:
21951
21952   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
21953      :widths: 30 15 15 15 15
21954      :header-rows: 1
21955
21956      * - **Test Name**
21957        - mozilla-central
21958        - autoland
21959        - mozilla-release
21960        - mozilla-beta
21961      * - **browsertime-responsiveness-firefox-facebook-nav-e10s**
21962        - ❌
21963        - ❌
21964        - ❌
21965        - ❌
21966      * - **browsertime-responsiveness-firefox-facebook-nav-fis-e10s**
21967        - ❌
21968        - ❌
21969        - ❌
21970        - ❌
21971
21972
21973   .. list-table:: **test-linux1804-64-qr/opt**
21974      :widths: 30 15 15 15 15
21975      :header-rows: 1
21976
21977      * - **Test Name**
21978        - mozilla-central
21979        - autoland
21980        - mozilla-release
21981        - mozilla-beta
21982      * - **browsertime-responsiveness-firefox-facebook-nav-e10s**
21983        - ❌
21984        - ❌
21985        - ❌
21986        - ❌
21987      * - **browsertime-responsiveness-firefox-facebook-nav-fis-e10s**
21988        - ❌
21989        - ❌
21990        - ❌
21991        - ❌
21992
21993
21994   .. list-table:: **test-linux1804-64-shippable-qr/opt**
21995      :widths: 30 15 15 15 15
21996      :header-rows: 1
21997
21998      * - **Test Name**
21999        - mozilla-central
22000        - autoland
22001        - mozilla-release
22002        - mozilla-beta
22003      * - **browsertime-responsiveness-chrome-facebook-nav-e10s**
22004        - ❌
22005        - ❌
22006        - ❌
22007        - ❌
22008      * - **browsertime-responsiveness-chromium-facebook-nav-e10s**
22009        - ❌
22010        - ❌
22011        - ❌
22012        - ❌
22013      * - **browsertime-responsiveness-firefox-facebook-nav-e10s**
22014        - ❌
22015        - ❌
22016        - ❌
22017        - ❌
22018      * - **browsertime-responsiveness-firefox-facebook-nav-fis-e10s**
22019        - ✅
22020        - ✅
22021        - ❌
22022        - ❌
22023
22024
22025   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
22026      :widths: 30 15 15 15 15
22027      :header-rows: 1
22028
22029      * - **Test Name**
22030        - mozilla-central
22031        - autoland
22032        - mozilla-release
22033        - mozilla-beta
22034      * - **browsertime-responsiveness-chrome-facebook-nav-e10s**
22035        - ❌
22036        - ❌
22037        - ❌
22038        - ❌
22039      * - **browsertime-responsiveness-chromium-facebook-nav-e10s**
22040        - ❌
22041        - ❌
22042        - ❌
22043        - ❌
22044      * - **browsertime-responsiveness-firefox-facebook-nav-e10s**
22045        - ❌
22046        - ❌
22047        - ❌
22048        - ❌
22049      * - **browsertime-responsiveness-firefox-facebook-nav-fis-e10s**
22050        - ✅
22051        - ✅
22052        - ❌
22053        - ❌
22054
22055
22056   .. list-table:: **test-windows10-32-qr/opt**
22057      :widths: 30 15 15 15 15
22058      :header-rows: 1
22059
22060      * - **Test Name**
22061        - mozilla-central
22062        - autoland
22063        - mozilla-release
22064        - mozilla-beta
22065      * - **browsertime-responsiveness-firefox-facebook-nav-e10s**
22066        - ❌
22067        - ❌
22068        - ❌
22069        - ❌
22070      * - **browsertime-responsiveness-firefox-facebook-nav-fis-e10s**
22071        - ❌
22072        - ❌
22073        - ❌
22074        - ❌
22075
22076
22077   .. list-table:: **test-windows10-32-shippable-qr/opt**
22078      :widths: 30 15 15 15 15
22079      :header-rows: 1
22080
22081      * - **Test Name**
22082        - mozilla-central
22083        - autoland
22084        - mozilla-release
22085        - mozilla-beta
22086      * - **browsertime-responsiveness-chrome-facebook-nav-e10s**
22087        - ❌
22088        - ❌
22089        - ❌
22090        - ❌
22091      * - **browsertime-responsiveness-chromium-facebook-nav-e10s**
22092        - ❌
22093        - ❌
22094        - ❌
22095        - ❌
22096      * - **browsertime-responsiveness-firefox-facebook-nav-e10s**
22097        - ❌
22098        - ❌
22099        - ❌
22100        - ❌
22101      * - **browsertime-responsiveness-firefox-facebook-nav-fis-e10s**
22102        - ❌
22103        - ❌
22104        - ❌
22105        - ❌
22106
22107
22108   .. list-table:: **test-windows10-64-qr/opt**
22109      :widths: 30 15 15 15 15
22110      :header-rows: 1
22111
22112      * - **Test Name**
22113        - mozilla-central
22114        - autoland
22115        - mozilla-release
22116        - mozilla-beta
22117      * - **browsertime-responsiveness-firefox-facebook-nav-e10s**
22118        - ❌
22119        - ❌
22120        - ❌
22121        - ❌
22122      * - **browsertime-responsiveness-firefox-facebook-nav-fis-e10s**
22123        - ❌
22124        - ❌
22125        - ❌
22126        - ❌
22127
22128
22129   .. list-table:: **test-windows10-64-shippable-qr/opt**
22130      :widths: 30 15 15 15 15
22131      :header-rows: 1
22132
22133      * - **Test Name**
22134        - mozilla-central
22135        - autoland
22136        - mozilla-release
22137        - mozilla-beta
22138      * - **browsertime-responsiveness-chrome-facebook-nav-e10s**
22139        - ❌
22140        - ❌
22141        - ❌
22142        - ❌
22143      * - **browsertime-responsiveness-chromium-facebook-nav-e10s**
22144        - ❌
22145        - ❌
22146        - ❌
22147        - ❌
22148      * - **browsertime-responsiveness-firefox-facebook-nav-e10s**
22149        - ❌
22150        - ❌
22151        - ❌
22152        - ❌
22153      * - **browsertime-responsiveness-firefox-facebook-nav-fis-e10s**
22154        - ✅
22155        - ✅
22156        - ❌
22157        - ❌
22158
22159
22160
22161.. dropdown:: reddit-billgates-ama
22162   :container: + anchor-id-reddit-billgates-ama-i
22163
22164   **Owner**: PerfTest Team
22165
22166   * **accept zero vismet**: true
22167   * **alert on**: fcp, loadtime
22168   * **alert threshold**: 2.0
22169   * **apps**: firefox, chrome, chromium
22170   * **browser cycles**: 10
22171   * **expected**: pass
22172   * **gecko profile entries**: 14000000
22173   * **gecko profile interval**: 1
22174   * **interactive**: true
22175   * **lower is better**: true
22176   * **measure**: fnbpaint, fcp, dcf, loadtime
22177   * **page cycles**: 25
22178   * **page timeout**: 60000
22179   * **playback**: mitmproxy
22180   * **playback pageset manifest**: mitm6-windows-firefox-reddit-billgates-ama.manifest
22181   * **playback version**: 6.0.2
22182   * **test cmds**:  ["measure.start", "billg-ama"], ["navigate", "https://www.reddit.com/r/IAmA/comments/m8n4vt/im_bill_gates_cochair_of_the_bill_and_melinda/"], ["wait.byTime", 5000], ["measure.stop", ""], ["measure.start", "members"], ["click.byXpathAndWait", "/html/body/div[1]/div/div[2]/div[2]/div/div[3]/div[2]/div/div[1]/div/div[4]/div[1]/div"], ["wait.byTime", 1000], ["measure.stop", ""],
22183   * **test url**: `<https://www.reddit.com/>`__
22184   * **type**: pageload
22185   * **unit**: ms
22186   * **use live sites**: false
22187   * **Test Task**:
22188
22189   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
22190      :widths: 30 15 15 15 15
22191      :header-rows: 1
22192
22193      * - **Test Name**
22194        - mozilla-central
22195        - autoland
22196        - mozilla-release
22197        - mozilla-beta
22198      * - **browsertime-responsiveness-firefox-reddit-billgates-ama-e10s**
22199        - ❌
22200        - ❌
22201        - ❌
22202        - ❌
22203      * - **browsertime-responsiveness-firefox-reddit-billgates-ama-fis-e10s**
22204        - ❌
22205        - ❌
22206        - ❌
22207        - ❌
22208
22209
22210   .. list-table:: **test-linux1804-64-qr/opt**
22211      :widths: 30 15 15 15 15
22212      :header-rows: 1
22213
22214      * - **Test Name**
22215        - mozilla-central
22216        - autoland
22217        - mozilla-release
22218        - mozilla-beta
22219      * - **browsertime-responsiveness-firefox-reddit-billgates-ama-e10s**
22220        - ❌
22221        - ❌
22222        - ❌
22223        - ❌
22224      * - **browsertime-responsiveness-firefox-reddit-billgates-ama-fis-e10s**
22225        - ❌
22226        - ❌
22227        - ❌
22228        - ❌
22229
22230
22231   .. list-table:: **test-linux1804-64-shippable-qr/opt**
22232      :widths: 30 15 15 15 15
22233      :header-rows: 1
22234
22235      * - **Test Name**
22236        - mozilla-central
22237        - autoland
22238        - mozilla-release
22239        - mozilla-beta
22240      * - **browsertime-responsiveness-chrome-reddit-billgates-ama-e10s**
22241        - ❌
22242        - ❌
22243        - ❌
22244        - ❌
22245      * - **browsertime-responsiveness-chromium-reddit-billgates-ama-e10s**
22246        - ❌
22247        - ❌
22248        - ❌
22249        - ❌
22250      * - **browsertime-responsiveness-firefox-reddit-billgates-ama-e10s**
22251        - ❌
22252        - ❌
22253        - ❌
22254        - ❌
22255      * - **browsertime-responsiveness-firefox-reddit-billgates-ama-fis-e10s**
22256        - ✅
22257        - ✅
22258        - ❌
22259        - ❌
22260
22261
22262   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
22263      :widths: 30 15 15 15 15
22264      :header-rows: 1
22265
22266      * - **Test Name**
22267        - mozilla-central
22268        - autoland
22269        - mozilla-release
22270        - mozilla-beta
22271      * - **browsertime-responsiveness-chrome-reddit-billgates-ama-e10s**
22272        - ❌
22273        - ❌
22274        - ❌
22275        - ❌
22276      * - **browsertime-responsiveness-chromium-reddit-billgates-ama-e10s**
22277        - ❌
22278        - ❌
22279        - ❌
22280        - ❌
22281      * - **browsertime-responsiveness-firefox-reddit-billgates-ama-e10s**
22282        - ❌
22283        - ❌
22284        - ❌
22285        - ❌
22286      * - **browsertime-responsiveness-firefox-reddit-billgates-ama-fis-e10s**
22287        - ✅
22288        - ✅
22289        - ❌
22290        - ❌
22291
22292
22293   .. list-table:: **test-windows10-32-qr/opt**
22294      :widths: 30 15 15 15 15
22295      :header-rows: 1
22296
22297      * - **Test Name**
22298        - mozilla-central
22299        - autoland
22300        - mozilla-release
22301        - mozilla-beta
22302      * - **browsertime-responsiveness-firefox-reddit-billgates-ama-e10s**
22303        - ❌
22304        - ❌
22305        - ❌
22306        - ❌
22307      * - **browsertime-responsiveness-firefox-reddit-billgates-ama-fis-e10s**
22308        - ❌
22309        - ❌
22310        - ❌
22311        - ❌
22312
22313
22314   .. list-table:: **test-windows10-32-shippable-qr/opt**
22315      :widths: 30 15 15 15 15
22316      :header-rows: 1
22317
22318      * - **Test Name**
22319        - mozilla-central
22320        - autoland
22321        - mozilla-release
22322        - mozilla-beta
22323      * - **browsertime-responsiveness-chrome-reddit-billgates-ama-e10s**
22324        - ❌
22325        - ❌
22326        - ❌
22327        - ❌
22328      * - **browsertime-responsiveness-chromium-reddit-billgates-ama-e10s**
22329        - ❌
22330        - ❌
22331        - ❌
22332        - ❌
22333      * - **browsertime-responsiveness-firefox-reddit-billgates-ama-e10s**
22334        - ❌
22335        - ❌
22336        - ❌
22337        - ❌
22338      * - **browsertime-responsiveness-firefox-reddit-billgates-ama-fis-e10s**
22339        - ❌
22340        - ❌
22341        - ❌
22342        - ❌
22343
22344
22345   .. list-table:: **test-windows10-64-qr/opt**
22346      :widths: 30 15 15 15 15
22347      :header-rows: 1
22348
22349      * - **Test Name**
22350        - mozilla-central
22351        - autoland
22352        - mozilla-release
22353        - mozilla-beta
22354      * - **browsertime-responsiveness-firefox-reddit-billgates-ama-e10s**
22355        - ❌
22356        - ❌
22357        - ❌
22358        - ❌
22359      * - **browsertime-responsiveness-firefox-reddit-billgates-ama-fis-e10s**
22360        - ❌
22361        - ❌
22362        - ❌
22363        - ❌
22364
22365
22366   .. list-table:: **test-windows10-64-shippable-qr/opt**
22367      :widths: 30 15 15 15 15
22368      :header-rows: 1
22369
22370      * - **Test Name**
22371        - mozilla-central
22372        - autoland
22373        - mozilla-release
22374        - mozilla-beta
22375      * - **browsertime-responsiveness-chrome-reddit-billgates-ama-e10s**
22376        - ❌
22377        - ❌
22378        - ❌
22379        - ❌
22380      * - **browsertime-responsiveness-chromium-reddit-billgates-ama-e10s**
22381        - ❌
22382        - ❌
22383        - ❌
22384        - ❌
22385      * - **browsertime-responsiveness-firefox-reddit-billgates-ama-e10s**
22386        - ❌
22387        - ❌
22388        - ❌
22389        - ❌
22390      * - **browsertime-responsiveness-firefox-reddit-billgates-ama-fis-e10s**
22391        - ✅
22392        - ✅
22393        - ❌
22394        - ❌
22395
22396
22397
22398.. dropdown:: reddit-billgates-post-1
22399   :container: + anchor-id-reddit-billgates-post-1-i
22400
22401   **Owner**: PerfTest Team
22402
22403   * **accept zero vismet**: true
22404   * **alert on**: fcp, loadtime
22405   * **alert threshold**: 2.0
22406   * **apps**: firefox, chrome, chromium
22407   * **browser cycles**: 10
22408   * **expected**: pass
22409   * **gecko profile entries**: 14000000
22410   * **gecko profile interval**: 1
22411   * **interactive**: true
22412   * **lower is better**: true
22413   * **measure**: fnbpaint, fcp, dcf, loadtime
22414   * **page cycles**: 25
22415   * **page timeout**: 90000
22416   * **playback**: mitmproxy
22417   * **playback pageset manifest**: mitm6-windows-firefox-reddit-billgates-post.manifest
22418   * **playback version**: 6.0.2
22419   * **test cmds**:  ["measure.start", "billg"], ["navigate", "https://www.reddit.com/user/thisisbillgates/"], ["wait.byTime", 500], ["measure.stop", ""], ["measure.start", "posts"], ["click.byXpathAndWait", "/html/body/div[1]/div/div[2]/div[2]/div/div/div/div[2]/div[2]/div/div/div/a[2]"], ["wait.byTime", 500], ["measure.stop", ""], ["measure.start", "comments"], ["click.byXpathAndWait", "/html/body/div[1]/div/div[2]/div[2]/div/div/div/div[2]/div[2]/div/div/div/a[3]"], ["wait.byTime", 500], ["measure.stop", ""], ["wait.byTime", 500],
22420   * **test url**: `<https://www.reddit.com/user/thisisbillgates/>`__
22421   * **type**: pageload
22422   * **unit**: ms
22423   * **use live sites**: false
22424   * **Test Task**:
22425
22426   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
22427      :widths: 30 15 15 15 15
22428      :header-rows: 1
22429
22430      * - **Test Name**
22431        - mozilla-central
22432        - autoland
22433        - mozilla-release
22434        - mozilla-beta
22435      * - **browsertime-responsiveness-firefox-reddit-billgates-post-1-e10s**
22436        - ❌
22437        - ❌
22438        - ❌
22439        - ❌
22440      * - **browsertime-responsiveness-firefox-reddit-billgates-post-1-fis-e10s**
22441        - ❌
22442        - ❌
22443        - ❌
22444        - ❌
22445
22446
22447   .. list-table:: **test-linux1804-64-qr/opt**
22448      :widths: 30 15 15 15 15
22449      :header-rows: 1
22450
22451      * - **Test Name**
22452        - mozilla-central
22453        - autoland
22454        - mozilla-release
22455        - mozilla-beta
22456      * - **browsertime-responsiveness-firefox-reddit-billgates-post-1-e10s**
22457        - ❌
22458        - ❌
22459        - ❌
22460        - ❌
22461      * - **browsertime-responsiveness-firefox-reddit-billgates-post-1-fis-e10s**
22462        - ❌
22463        - ❌
22464        - ❌
22465        - ❌
22466
22467
22468   .. list-table:: **test-linux1804-64-shippable-qr/opt**
22469      :widths: 30 15 15 15 15
22470      :header-rows: 1
22471
22472      * - **Test Name**
22473        - mozilla-central
22474        - autoland
22475        - mozilla-release
22476        - mozilla-beta
22477      * - **browsertime-responsiveness-chrome-reddit-billgates-post-1-e10s**
22478        - ❌
22479        - ❌
22480        - ❌
22481        - ❌
22482      * - **browsertime-responsiveness-chromium-reddit-billgates-post-1-e10s**
22483        - ❌
22484        - ❌
22485        - ❌
22486        - ❌
22487      * - **browsertime-responsiveness-firefox-reddit-billgates-post-1-e10s**
22488        - ❌
22489        - ❌
22490        - ❌
22491        - ❌
22492      * - **browsertime-responsiveness-firefox-reddit-billgates-post-1-fis-e10s**
22493        - ✅
22494        - ✅
22495        - ❌
22496        - ❌
22497
22498
22499   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
22500      :widths: 30 15 15 15 15
22501      :header-rows: 1
22502
22503      * - **Test Name**
22504        - mozilla-central
22505        - autoland
22506        - mozilla-release
22507        - mozilla-beta
22508      * - **browsertime-responsiveness-chrome-reddit-billgates-post-1-e10s**
22509        - ❌
22510        - ❌
22511        - ❌
22512        - ❌
22513      * - **browsertime-responsiveness-chromium-reddit-billgates-post-1-e10s**
22514        - ❌
22515        - ❌
22516        - ❌
22517        - ❌
22518      * - **browsertime-responsiveness-firefox-reddit-billgates-post-1-e10s**
22519        - ❌
22520        - ❌
22521        - ❌
22522        - ❌
22523      * - **browsertime-responsiveness-firefox-reddit-billgates-post-1-fis-e10s**
22524        - ✅
22525        - ✅
22526        - ❌
22527        - ❌
22528
22529
22530   .. list-table:: **test-windows10-32-qr/opt**
22531      :widths: 30 15 15 15 15
22532      :header-rows: 1
22533
22534      * - **Test Name**
22535        - mozilla-central
22536        - autoland
22537        - mozilla-release
22538        - mozilla-beta
22539      * - **browsertime-responsiveness-firefox-reddit-billgates-post-1-e10s**
22540        - ❌
22541        - ❌
22542        - ❌
22543        - ❌
22544      * - **browsertime-responsiveness-firefox-reddit-billgates-post-1-fis-e10s**
22545        - ❌
22546        - ❌
22547        - ❌
22548        - ❌
22549
22550
22551   .. list-table:: **test-windows10-32-shippable-qr/opt**
22552      :widths: 30 15 15 15 15
22553      :header-rows: 1
22554
22555      * - **Test Name**
22556        - mozilla-central
22557        - autoland
22558        - mozilla-release
22559        - mozilla-beta
22560      * - **browsertime-responsiveness-chrome-reddit-billgates-post-1-e10s**
22561        - ❌
22562        - ❌
22563        - ❌
22564        - ❌
22565      * - **browsertime-responsiveness-chromium-reddit-billgates-post-1-e10s**
22566        - ❌
22567        - ❌
22568        - ❌
22569        - ❌
22570      * - **browsertime-responsiveness-firefox-reddit-billgates-post-1-e10s**
22571        - ❌
22572        - ❌
22573        - ❌
22574        - ❌
22575      * - **browsertime-responsiveness-firefox-reddit-billgates-post-1-fis-e10s**
22576        - ❌
22577        - ❌
22578        - ❌
22579        - ❌
22580
22581
22582   .. list-table:: **test-windows10-64-qr/opt**
22583      :widths: 30 15 15 15 15
22584      :header-rows: 1
22585
22586      * - **Test Name**
22587        - mozilla-central
22588        - autoland
22589        - mozilla-release
22590        - mozilla-beta
22591      * - **browsertime-responsiveness-firefox-reddit-billgates-post-1-e10s**
22592        - ❌
22593        - ❌
22594        - ❌
22595        - ❌
22596      * - **browsertime-responsiveness-firefox-reddit-billgates-post-1-fis-e10s**
22597        - ❌
22598        - ❌
22599        - ❌
22600        - ❌
22601
22602
22603   .. list-table:: **test-windows10-64-shippable-qr/opt**
22604      :widths: 30 15 15 15 15
22605      :header-rows: 1
22606
22607      * - **Test Name**
22608        - mozilla-central
22609        - autoland
22610        - mozilla-release
22611        - mozilla-beta
22612      * - **browsertime-responsiveness-chrome-reddit-billgates-post-1-e10s**
22613        - ❌
22614        - ❌
22615        - ❌
22616        - ❌
22617      * - **browsertime-responsiveness-chromium-reddit-billgates-post-1-e10s**
22618        - ❌
22619        - ❌
22620        - ❌
22621        - ❌
22622      * - **browsertime-responsiveness-firefox-reddit-billgates-post-1-e10s**
22623        - ❌
22624        - ❌
22625        - ❌
22626        - ❌
22627      * - **browsertime-responsiveness-firefox-reddit-billgates-post-1-fis-e10s**
22628        - ✅
22629        - ✅
22630        - ❌
22631        - ❌
22632
22633
22634
22635.. dropdown:: reddit-billgates-post-2
22636   :container: + anchor-id-reddit-billgates-post-2-i
22637
22638   **Owner**: PerfTest Team
22639
22640   * **accept zero vismet**: true
22641   * **alert on**: fcp, loadtime
22642   * **alert threshold**: 2.0
22643   * **apps**: firefox, chrome, chromium
22644   * **browser cycles**: 10
22645   * **expected**: pass
22646   * **gecko profile entries**: 14000000
22647   * **gecko profile interval**: 1
22648   * **interactive**: true
22649   * **lower is better**: true
22650   * **measure**: fnbpaint, fcp, dcf, loadtime
22651   * **page cycles**: 25
22652   * **page timeout**: 90000
22653   * **playback**: mitmproxy
22654   * **playback pageset manifest**: mitm6-windows-firefox-reddit-billgates-post.manifest
22655   * **playback version**: 6.0.2
22656   * **test cmds**:  ["measure.start", "billg"], ["navigate", "https://www.reddit.com/user/thisisbillgates/"], ["wait.byTime", 500], ["measure.stop", ""], ["click.byXpathAndWait", "/html/body/div[1]/div/div[2]/div[2]/div/div/div/div[2]/div[2]/div/div/div/a[3]"], ["wait.byTime", 500], ["measure.start", "hot"], ["click.byXpathAndWait", "/html/body/div[1]/div/div[2]/div[2]/div/div/div/div[2]/div[4]/div[1]/div[1]/div[2]/a[2]"], ["wait.byTime", 500], ["measure.stop", ""], ["measure.start", "top"], ["click.byXpathAndWait", "/html/body/div[1]/div/div[2]/div[2]/div/div/div/div[2]/div[4]/div[1]/div[1]/div[2]/a[3]"], ["wait.byTime", 500], ["measure.stop", ""], ["wait.byTime", 500],
22657   * **test url**: `<https://www.reddit.com/user/thisisbillgates/>`__
22658   * **type**: pageload
22659   * **unit**: ms
22660   * **use live sites**: false
22661   * **Test Task**:
22662
22663   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
22664      :widths: 30 15 15 15 15
22665      :header-rows: 1
22666
22667      * - **Test Name**
22668        - mozilla-central
22669        - autoland
22670        - mozilla-release
22671        - mozilla-beta
22672      * - **browsertime-responsiveness-firefox-reddit-billgates-post-2-e10s**
22673        - ❌
22674        - ❌
22675        - ❌
22676        - ❌
22677      * - **browsertime-responsiveness-firefox-reddit-billgates-post-2-fis-e10s**
22678        - ❌
22679        - ❌
22680        - ❌
22681        - ❌
22682
22683
22684   .. list-table:: **test-linux1804-64-qr/opt**
22685      :widths: 30 15 15 15 15
22686      :header-rows: 1
22687
22688      * - **Test Name**
22689        - mozilla-central
22690        - autoland
22691        - mozilla-release
22692        - mozilla-beta
22693      * - **browsertime-responsiveness-firefox-reddit-billgates-post-2-e10s**
22694        - ❌
22695        - ❌
22696        - ❌
22697        - ❌
22698      * - **browsertime-responsiveness-firefox-reddit-billgates-post-2-fis-e10s**
22699        - ❌
22700        - ❌
22701        - ❌
22702        - ❌
22703
22704
22705   .. list-table:: **test-linux1804-64-shippable-qr/opt**
22706      :widths: 30 15 15 15 15
22707      :header-rows: 1
22708
22709      * - **Test Name**
22710        - mozilla-central
22711        - autoland
22712        - mozilla-release
22713        - mozilla-beta
22714      * - **browsertime-responsiveness-chrome-reddit-billgates-post-2-e10s**
22715        - ❌
22716        - ❌
22717        - ❌
22718        - ❌
22719      * - **browsertime-responsiveness-chromium-reddit-billgates-post-2-e10s**
22720        - ❌
22721        - ❌
22722        - ❌
22723        - ❌
22724      * - **browsertime-responsiveness-firefox-reddit-billgates-post-2-e10s**
22725        - ❌
22726        - ❌
22727        - ❌
22728        - ❌
22729      * - **browsertime-responsiveness-firefox-reddit-billgates-post-2-fis-e10s**
22730        - ✅
22731        - ✅
22732        - ❌
22733        - ❌
22734
22735
22736   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
22737      :widths: 30 15 15 15 15
22738      :header-rows: 1
22739
22740      * - **Test Name**
22741        - mozilla-central
22742        - autoland
22743        - mozilla-release
22744        - mozilla-beta
22745      * - **browsertime-responsiveness-chrome-reddit-billgates-post-2-e10s**
22746        - ❌
22747        - ❌
22748        - ❌
22749        - ❌
22750      * - **browsertime-responsiveness-chromium-reddit-billgates-post-2-e10s**
22751        - ❌
22752        - ❌
22753        - ❌
22754        - ❌
22755      * - **browsertime-responsiveness-firefox-reddit-billgates-post-2-e10s**
22756        - ❌
22757        - ❌
22758        - ❌
22759        - ❌
22760      * - **browsertime-responsiveness-firefox-reddit-billgates-post-2-fis-e10s**
22761        - ✅
22762        - ✅
22763        - ❌
22764        - ❌
22765
22766
22767   .. list-table:: **test-windows10-32-qr/opt**
22768      :widths: 30 15 15 15 15
22769      :header-rows: 1
22770
22771      * - **Test Name**
22772        - mozilla-central
22773        - autoland
22774        - mozilla-release
22775        - mozilla-beta
22776      * - **browsertime-responsiveness-firefox-reddit-billgates-post-2-e10s**
22777        - ❌
22778        - ❌
22779        - ❌
22780        - ❌
22781      * - **browsertime-responsiveness-firefox-reddit-billgates-post-2-fis-e10s**
22782        - ❌
22783        - ❌
22784        - ❌
22785        - ❌
22786
22787
22788   .. list-table:: **test-windows10-32-shippable-qr/opt**
22789      :widths: 30 15 15 15 15
22790      :header-rows: 1
22791
22792      * - **Test Name**
22793        - mozilla-central
22794        - autoland
22795        - mozilla-release
22796        - mozilla-beta
22797      * - **browsertime-responsiveness-chrome-reddit-billgates-post-2-e10s**
22798        - ❌
22799        - ❌
22800        - ❌
22801        - ❌
22802      * - **browsertime-responsiveness-chromium-reddit-billgates-post-2-e10s**
22803        - ❌
22804        - ❌
22805        - ❌
22806        - ❌
22807      * - **browsertime-responsiveness-firefox-reddit-billgates-post-2-e10s**
22808        - ❌
22809        - ❌
22810        - ❌
22811        - ❌
22812      * - **browsertime-responsiveness-firefox-reddit-billgates-post-2-fis-e10s**
22813        - ❌
22814        - ❌
22815        - ❌
22816        - ❌
22817
22818
22819   .. list-table:: **test-windows10-64-qr/opt**
22820      :widths: 30 15 15 15 15
22821      :header-rows: 1
22822
22823      * - **Test Name**
22824        - mozilla-central
22825        - autoland
22826        - mozilla-release
22827        - mozilla-beta
22828      * - **browsertime-responsiveness-firefox-reddit-billgates-post-2-e10s**
22829        - ❌
22830        - ❌
22831        - ❌
22832        - ❌
22833      * - **browsertime-responsiveness-firefox-reddit-billgates-post-2-fis-e10s**
22834        - ❌
22835        - ❌
22836        - ❌
22837        - ❌
22838
22839
22840   .. list-table:: **test-windows10-64-shippable-qr/opt**
22841      :widths: 30 15 15 15 15
22842      :header-rows: 1
22843
22844      * - **Test Name**
22845        - mozilla-central
22846        - autoland
22847        - mozilla-release
22848        - mozilla-beta
22849      * - **browsertime-responsiveness-chrome-reddit-billgates-post-2-e10s**
22850        - ❌
22851        - ❌
22852        - ❌
22853        - ❌
22854      * - **browsertime-responsiveness-chromium-reddit-billgates-post-2-e10s**
22855        - ❌
22856        - ❌
22857        - ❌
22858        - ❌
22859      * - **browsertime-responsiveness-firefox-reddit-billgates-post-2-e10s**
22860        - ❌
22861        - ❌
22862        - ❌
22863        - ❌
22864      * - **browsertime-responsiveness-firefox-reddit-billgates-post-2-fis-e10s**
22865        - ✅
22866        - ✅
22867        - ❌
22868        - ❌
22869
22870
22871
22872
22873Live
22874----
22875A set of test pages that are run as live sites instead of recorded versions. These tests are available on all browsers, on all platforms.
22876
22877.. dropdown:: booking-sf
22878   :container: + anchor-id-booking-sf-l
22879
22880   **Owner**: PerfTest Team
22881
22882   * **alert on**: fcp, loadtime
22883   * **alert threshold**: 2.0
22884   * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome, chromium
22885   * **browser cycles**: 15
22886   * **expected**: pass
22887   * **lower is better**: true
22888   * **page cycles**: 25
22889   * **page timeout**: 60000
22890   * **test url**: `<https://www.booking.com/hotel/us/edwardian-san-francisco.html>`__
22891   * **type**: pageload
22892   * **unit**: ms
22893   * **use live sites**: true
22894   * **Test Task**:
22895
22896   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
22897      :widths: 30 15 15 15 15
22898      :header-rows: 1
22899
22900      * - **Test Name**
22901        - mozilla-central
22902        - autoland
22903        - mozilla-release
22904        - mozilla-beta
22905      * - **browsertime-tp6m-live-fenix-booking-sf-e10s**
22906        - ❌
22907        - ❌
22908        - ❌
22909        - ❌
22910      * - **browsertime-tp6m-live-geckoview-booking-sf-e10s**
22911        - ❌
22912        - ❌
22913        - ❌
22914        - ❌
22915
22916
22917   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
22918      :widths: 30 15 15 15 15
22919      :header-rows: 1
22920
22921      * - **Test Name**
22922        - mozilla-central
22923        - autoland
22924        - mozilla-release
22925        - mozilla-beta
22926      * - **browsertime-tp6m-live-chrome-m-booking-sf-e10s**
22927        - ❌
22928        - ❌
22929        - ❌
22930        - ❌
22931      * - **browsertime-tp6m-live-fenix-booking-sf-e10s**
22932        - ❌
22933        - ❌
22934        - ❌
22935        - ❌
22936      * - **browsertime-tp6m-live-geckoview-booking-sf-e10s**
22937        - ❌
22938        - ❌
22939        - ❌
22940        - ❌
22941
22942
22943   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
22944      :widths: 30 15 15 15 15
22945      :header-rows: 1
22946
22947      * - **Test Name**
22948        - mozilla-central
22949        - autoland
22950        - mozilla-release
22951        - mozilla-beta
22952      * - **browsertime-tp6m-live-fenix-booking-sf-e10s**
22953        - ❌
22954        - ❌
22955        - ❌
22956        - ❌
22957      * - **browsertime-tp6m-live-geckoview-booking-sf-e10s**
22958        - ❌
22959        - ❌
22960        - ❌
22961        - ❌
22962
22963
22964   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
22965      :widths: 30 15 15 15 15
22966      :header-rows: 1
22967
22968      * - **Test Name**
22969        - mozilla-central
22970        - autoland
22971        - mozilla-release
22972        - mozilla-beta
22973      * - **browsertime-tp6m-live-chrome-m-booking-sf-e10s**
22974        - ❌
22975        - ❌
22976        - ❌
22977        - ❌
22978      * - **browsertime-tp6m-live-fenix-booking-sf-e10s**
22979        - ❌
22980        - ❌
22981        - ❌
22982        - ❌
22983      * - **browsertime-tp6m-live-geckoview-booking-sf-e10s**
22984        - ❌
22985        - ❌
22986        - ❌
22987        - ❌
22988
22989
22990   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
22991      :widths: 30 15 15 15 15
22992      :header-rows: 1
22993
22994      * - **Test Name**
22995        - mozilla-central
22996        - autoland
22997        - mozilla-release
22998        - mozilla-beta
22999      * - **browsertime-tp6m-live-fenix-booking-sf-e10s**
23000        - ❌
23001        - ❌
23002        - ❌
23003        - ❌
23004      * - **browsertime-tp6m-live-geckoview-booking-sf-e10s**
23005        - ❌
23006        - ❌
23007        - ❌
23008        - ❌
23009
23010
23011   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
23012      :widths: 30 15 15 15 15
23013      :header-rows: 1
23014
23015      * - **Test Name**
23016        - mozilla-central
23017        - autoland
23018        - mozilla-release
23019        - mozilla-beta
23020      * - **browsertime-tp6m-live-chrome-m-booking-sf-e10s**
23021        - ❌
23022        - ❌
23023        - ❌
23024        - ❌
23025      * - **browsertime-tp6m-live-fenix-booking-sf-e10s**
23026        - ❌
23027        - ❌
23028        - ❌
23029        - ❌
23030      * - **browsertime-tp6m-live-geckoview-booking-sf-e10s**
23031        - ❌
23032        - ❌
23033        - ❌
23034        - ❌
23035
23036
23037   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
23038      :widths: 30 15 15 15 15
23039      :header-rows: 1
23040
23041      * - **Test Name**
23042        - mozilla-central
23043        - autoland
23044        - mozilla-release
23045        - mozilla-beta
23046      * - **browsertime-tp6m-live-fenix-booking-sf-e10s**
23047        - ❌
23048        - ❌
23049        - ❌
23050        - ❌
23051      * - **browsertime-tp6m-live-geckoview-booking-sf-e10s**
23052        - ❌
23053        - ❌
23054        - ❌
23055        - ❌
23056
23057
23058   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
23059      :widths: 30 15 15 15 15
23060      :header-rows: 1
23061
23062      * - **Test Name**
23063        - mozilla-central
23064        - autoland
23065        - mozilla-release
23066        - mozilla-beta
23067      * - **browsertime-tp6m-live-chrome-m-booking-sf-e10s**
23068        - ❌
23069        - ❌
23070        - ❌
23071        - ❌
23072      * - **browsertime-tp6m-live-fenix-booking-sf-e10s**
23073        - ❌
23074        - ❌
23075        - ❌
23076        - ❌
23077      * - **browsertime-tp6m-live-geckoview-booking-sf-e10s**
23078        - ❌
23079        - ❌
23080        - ❌
23081        - ❌
23082
23083
23084
23085.. dropdown:: cnn
23086   :container: + anchor-id-cnn-l
23087
23088   **Owner**: PerfTest Team
23089
23090   * **alert on**: fcp, loadtime
23091   * **alert threshold**: 2.0
23092   * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome, chromium
23093   * **browser cycles**: 15
23094   * **expected**: pass
23095   * **lower is better**: true
23096   * **page cycles**: 25
23097   * **page timeout**: 60000
23098   * **test url**: `<https://www.cnn.com/2021/03/22/weather/climate-change-warm-waters-lake-michigan/index.html>`__
23099   * **type**: pageload
23100   * **unit**: ms
23101   * **use live sites**: true
23102   * **Test Task**:
23103
23104   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
23105      :widths: 30 15 15 15 15
23106      :header-rows: 1
23107
23108      * - **Test Name**
23109        - mozilla-central
23110        - autoland
23111        - mozilla-release
23112        - mozilla-beta
23113      * - **browsertime-tp6m-fenix-cnn-e10s**
23114        - ❌
23115        - ❌
23116        - ❌
23117        - ❌
23118      * - **browsertime-tp6m-geckoview-cnn-e10s**
23119        - ❌
23120        - ❌
23121        - ❌
23122        - ❌
23123      * - **browsertime-tp6m-live-fenix-cnn-e10s**
23124        - ❌
23125        - ❌
23126        - ❌
23127        - ❌
23128      * - **browsertime-tp6m-live-geckoview-cnn-e10s**
23129        - ❌
23130        - ❌
23131        - ❌
23132        - ❌
23133      * - **browsertime-tp6m-refbrow-cnn-e10s**
23134        - ❌
23135        - ❌
23136        - ❌
23137        - ❌
23138
23139
23140   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
23141      :widths: 30 15 15 15 15
23142      :header-rows: 1
23143
23144      * - **Test Name**
23145        - mozilla-central
23146        - autoland
23147        - mozilla-release
23148        - mozilla-beta
23149      * - **browsertime-tp6m-chrome-m-cnn-e10s**
23150        - ❌
23151        - ❌
23152        - ❌
23153        - ❌
23154      * - **browsertime-tp6m-fenix-cnn-e10s**
23155        - ❌
23156        - ❌
23157        - ❌
23158        - ❌
23159      * - **browsertime-tp6m-geckoview-cnn-e10s**
23160        - ✅
23161        - ✅
23162        - ✅
23163        - ✅
23164      * - **browsertime-tp6m-live-chrome-m-cnn-e10s**
23165        - ❌
23166        - ❌
23167        - ❌
23168        - ❌
23169      * - **browsertime-tp6m-live-fenix-cnn-e10s**
23170        - ❌
23171        - ❌
23172        - ❌
23173        - ❌
23174      * - **browsertime-tp6m-live-geckoview-cnn-e10s**
23175        - ❌
23176        - ❌
23177        - ❌
23178        - ❌
23179      * - **browsertime-tp6m-refbrow-cnn-e10s**
23180        - ❌
23181        - ❌
23182        - ❌
23183        - ❌
23184
23185
23186   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
23187      :widths: 30 15 15 15 15
23188      :header-rows: 1
23189
23190      * - **Test Name**
23191        - mozilla-central
23192        - autoland
23193        - mozilla-release
23194        - mozilla-beta
23195      * - **browsertime-tp6m-fenix-cnn-e10s**
23196        - ❌
23197        - ❌
23198        - ❌
23199        - ❌
23200      * - **browsertime-tp6m-geckoview-cnn-e10s**
23201        - ❌
23202        - ❌
23203        - ❌
23204        - ❌
23205      * - **browsertime-tp6m-live-fenix-cnn-e10s**
23206        - ❌
23207        - ❌
23208        - ❌
23209        - ❌
23210      * - **browsertime-tp6m-live-geckoview-cnn-e10s**
23211        - ❌
23212        - ❌
23213        - ❌
23214        - ❌
23215      * - **browsertime-tp6m-refbrow-cnn-e10s**
23216        - ❌
23217        - ❌
23218        - ❌
23219        - ❌
23220
23221
23222   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
23223      :widths: 30 15 15 15 15
23224      :header-rows: 1
23225
23226      * - **Test Name**
23227        - mozilla-central
23228        - autoland
23229        - mozilla-release
23230        - mozilla-beta
23231      * - **browsertime-tp6m-chrome-m-cnn-e10s**
23232        - ❌
23233        - ❌
23234        - ❌
23235        - ❌
23236      * - **browsertime-tp6m-fenix-cnn-e10s**
23237        - ❌
23238        - ❌
23239        - ❌
23240        - ❌
23241      * - **browsertime-tp6m-geckoview-cnn-e10s**
23242        - ✅
23243        - ✅
23244        - ✅
23245        - ✅
23246      * - **browsertime-tp6m-live-chrome-m-cnn-e10s**
23247        - ❌
23248        - ❌
23249        - ❌
23250        - ❌
23251      * - **browsertime-tp6m-live-fenix-cnn-e10s**
23252        - ❌
23253        - ❌
23254        - ❌
23255        - ❌
23256      * - **browsertime-tp6m-live-geckoview-cnn-e10s**
23257        - ❌
23258        - ❌
23259        - ❌
23260        - ❌
23261      * - **browsertime-tp6m-refbrow-cnn-e10s**
23262        - ❌
23263        - ❌
23264        - ❌
23265        - ❌
23266
23267
23268   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
23269      :widths: 30 15 15 15 15
23270      :header-rows: 1
23271
23272      * - **Test Name**
23273        - mozilla-central
23274        - autoland
23275        - mozilla-release
23276        - mozilla-beta
23277      * - **browsertime-tp6m-fenix-cnn-e10s**
23278        - ❌
23279        - ❌
23280        - ❌
23281        - ❌
23282      * - **browsertime-tp6m-geckoview-cnn-e10s**
23283        - ❌
23284        - ❌
23285        - ❌
23286        - ❌
23287      * - **browsertime-tp6m-live-fenix-cnn-e10s**
23288        - ❌
23289        - ❌
23290        - ❌
23291        - ❌
23292      * - **browsertime-tp6m-live-geckoview-cnn-e10s**
23293        - ❌
23294        - ❌
23295        - ❌
23296        - ❌
23297      * - **browsertime-tp6m-refbrow-cnn-e10s**
23298        - ❌
23299        - ❌
23300        - ❌
23301        - ❌
23302
23303
23304   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
23305      :widths: 30 15 15 15 15
23306      :header-rows: 1
23307
23308      * - **Test Name**
23309        - mozilla-central
23310        - autoland
23311        - mozilla-release
23312        - mozilla-beta
23313      * - **browsertime-tp6m-chrome-m-cnn-e10s**
23314        - ❌
23315        - ❌
23316        - ❌
23317        - ❌
23318      * - **browsertime-tp6m-fenix-cnn-e10s**
23319        - ❌
23320        - ❌
23321        - ❌
23322        - ❌
23323      * - **browsertime-tp6m-geckoview-cnn-e10s**
23324        - ❌
23325        - ❌
23326        - ❌
23327        - ❌
23328      * - **browsertime-tp6m-live-chrome-m-cnn-e10s**
23329        - ❌
23330        - ❌
23331        - ❌
23332        - ❌
23333      * - **browsertime-tp6m-live-fenix-cnn-e10s**
23334        - ❌
23335        - ❌
23336        - ❌
23337        - ❌
23338      * - **browsertime-tp6m-live-geckoview-cnn-e10s**
23339        - ❌
23340        - ❌
23341        - ❌
23342        - ❌
23343      * - **browsertime-tp6m-refbrow-cnn-e10s**
23344        - ❌
23345        - ❌
23346        - ❌
23347        - ❌
23348
23349
23350   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
23351      :widths: 30 15 15 15 15
23352      :header-rows: 1
23353
23354      * - **Test Name**
23355        - mozilla-central
23356        - autoland
23357        - mozilla-release
23358        - mozilla-beta
23359      * - **browsertime-tp6m-fenix-cnn-e10s**
23360        - ❌
23361        - ❌
23362        - ❌
23363        - ❌
23364      * - **browsertime-tp6m-geckoview-cnn-e10s**
23365        - ❌
23366        - ❌
23367        - ❌
23368        - ❌
23369      * - **browsertime-tp6m-live-fenix-cnn-e10s**
23370        - ❌
23371        - ❌
23372        - ❌
23373        - ❌
23374      * - **browsertime-tp6m-live-geckoview-cnn-e10s**
23375        - ❌
23376        - ❌
23377        - ❌
23378        - ❌
23379      * - **browsertime-tp6m-refbrow-cnn-e10s**
23380        - ❌
23381        - ❌
23382        - ❌
23383        - ❌
23384
23385
23386   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
23387      :widths: 30 15 15 15 15
23388      :header-rows: 1
23389
23390      * - **Test Name**
23391        - mozilla-central
23392        - autoland
23393        - mozilla-release
23394        - mozilla-beta
23395      * - **browsertime-tp6m-chrome-m-cnn-e10s**
23396        - ❌
23397        - ❌
23398        - ❌
23399        - ❌
23400      * - **browsertime-tp6m-fenix-cnn-e10s**
23401        - ❌
23402        - ❌
23403        - ❌
23404        - ❌
23405      * - **browsertime-tp6m-geckoview-cnn-e10s**
23406        - ❌
23407        - ❌
23408        - ❌
23409        - ❌
23410      * - **browsertime-tp6m-live-chrome-m-cnn-e10s**
23411        - ❌
23412        - ❌
23413        - ❌
23414        - ❌
23415      * - **browsertime-tp6m-live-fenix-cnn-e10s**
23416        - ❌
23417        - ❌
23418        - ❌
23419        - ❌
23420      * - **browsertime-tp6m-live-geckoview-cnn-e10s**
23421        - ❌
23422        - ❌
23423        - ❌
23424        - ❌
23425      * - **browsertime-tp6m-refbrow-cnn-e10s**
23426        - ❌
23427        - ❌
23428        - ❌
23429        - ❌
23430
23431
23432   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
23433      :widths: 30 15 15 15 15
23434      :header-rows: 1
23435
23436      * - **Test Name**
23437        - mozilla-central
23438        - autoland
23439        - mozilla-release
23440        - mozilla-beta
23441      * - **browsertime-tp6-essential-firefox-cnn-e10s**
23442        - ❌
23443        - ❌
23444        - ❌
23445        - ❌
23446      * - **browsertime-tp6-essential-firefox-cnn-fis-e10s**
23447        - ❌
23448        - ❌
23449        - ❌
23450        - ❌
23451      * - **browsertime-tp6-live-sheriffed-firefox-cnn-e10s**
23452        - ❌
23453        - ❌
23454        - ❌
23455        - ❌
23456      * - **browsertime-tp6-live-sheriffed-firefox-cnn-fis-e10s**
23457        - ❌
23458        - ❌
23459        - ❌
23460        - ❌
23461
23462
23463   .. list-table:: **test-linux1804-64-qr/opt**
23464      :widths: 30 15 15 15 15
23465      :header-rows: 1
23466
23467      * - **Test Name**
23468        - mozilla-central
23469        - autoland
23470        - mozilla-release
23471        - mozilla-beta
23472      * - **browsertime-tp6-essential-firefox-cnn-e10s**
23473        - ❌
23474        - ❌
23475        - ❌
23476        - ❌
23477      * - **browsertime-tp6-essential-firefox-cnn-fis-e10s**
23478        - ❌
23479        - ❌
23480        - ❌
23481        - ❌
23482      * - **browsertime-tp6-live-sheriffed-firefox-cnn-e10s**
23483        - ❌
23484        - ❌
23485        - ❌
23486        - ❌
23487      * - **browsertime-tp6-live-sheriffed-firefox-cnn-fis-e10s**
23488        - ❌
23489        - ❌
23490        - ❌
23491        - ❌
23492
23493
23494   .. list-table:: **test-linux1804-64-shippable-qr/opt**
23495      :widths: 30 15 15 15 15
23496      :header-rows: 1
23497
23498      * - **Test Name**
23499        - mozilla-central
23500        - autoland
23501        - mozilla-release
23502        - mozilla-beta
23503      * - **browsertime-tp6-essential-chrome-cnn-e10s**
23504        - ❌
23505        - ❌
23506        - ❌
23507        - ❌
23508      * - **browsertime-tp6-essential-chromium-cnn-e10s**
23509        - ❌
23510        - ❌
23511        - ❌
23512        - ❌
23513      * - **browsertime-tp6-essential-firefox-cnn-e10s**
23514        - ❌
23515        - ❌
23516        - ❌
23517        - ❌
23518      * - **browsertime-tp6-essential-firefox-cnn-fis-e10s**
23519        - ✅
23520        - ✅
23521        - ✅
23522        - ✅
23523      * - **browsertime-tp6-live-sheriffed-firefox-cnn-e10s**
23524        - ❌
23525        - ❌
23526        - ❌
23527        - ❌
23528      * - **browsertime-tp6-live-sheriffed-firefox-cnn-fis-e10s**
23529        - ❌
23530        - ❌
23531        - ❌
23532        - ❌
23533
23534
23535   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
23536      :widths: 30 15 15 15 15
23537      :header-rows: 1
23538
23539      * - **Test Name**
23540        - mozilla-central
23541        - autoland
23542        - mozilla-release
23543        - mozilla-beta
23544      * - **browsertime-tp6-essential-chrome-cnn-e10s**
23545        - ❌
23546        - ❌
23547        - ❌
23548        - ❌
23549      * - **browsertime-tp6-essential-chromium-cnn-e10s**
23550        - ❌
23551        - ❌
23552        - ❌
23553        - ❌
23554      * - **browsertime-tp6-essential-firefox-cnn-e10s**
23555        - ❌
23556        - ❌
23557        - ❌
23558        - ❌
23559      * - **browsertime-tp6-essential-firefox-cnn-fis-e10s**
23560        - ✅
23561        - ✅
23562        - ✅
23563        - ✅
23564      * - **browsertime-tp6-live-sheriffed-firefox-cnn-e10s**
23565        - ❌
23566        - ❌
23567        - ❌
23568        - ❌
23569      * - **browsertime-tp6-live-sheriffed-firefox-cnn-fis-e10s**
23570        - ❌
23571        - ❌
23572        - ❌
23573        - ❌
23574
23575
23576   .. list-table:: **test-windows10-32-qr/opt**
23577      :widths: 30 15 15 15 15
23578      :header-rows: 1
23579
23580      * - **Test Name**
23581        - mozilla-central
23582        - autoland
23583        - mozilla-release
23584        - mozilla-beta
23585      * - **browsertime-tp6-essential-firefox-cnn-e10s**
23586        - ❌
23587        - ❌
23588        - ❌
23589        - ❌
23590      * - **browsertime-tp6-essential-firefox-cnn-fis-e10s**
23591        - ❌
23592        - ❌
23593        - ❌
23594        - ❌
23595      * - **browsertime-tp6-live-sheriffed-firefox-cnn-e10s**
23596        - ❌
23597        - ❌
23598        - ❌
23599        - ❌
23600      * - **browsertime-tp6-live-sheriffed-firefox-cnn-fis-e10s**
23601        - ❌
23602        - ❌
23603        - ❌
23604        - ❌
23605
23606
23607   .. list-table:: **test-windows10-32-shippable-qr/opt**
23608      :widths: 30 15 15 15 15
23609      :header-rows: 1
23610
23611      * - **Test Name**
23612        - mozilla-central
23613        - autoland
23614        - mozilla-release
23615        - mozilla-beta
23616      * - **browsertime-tp6-essential-chrome-cnn-e10s**
23617        - ❌
23618        - ❌
23619        - ❌
23620        - ❌
23621      * - **browsertime-tp6-essential-chromium-cnn-e10s**
23622        - ❌
23623        - ❌
23624        - ❌
23625        - ❌
23626      * - **browsertime-tp6-essential-firefox-cnn-e10s**
23627        - ❌
23628        - ❌
23629        - ❌
23630        - ❌
23631      * - **browsertime-tp6-essential-firefox-cnn-fis-e10s**
23632        - ❌
23633        - ❌
23634        - ❌
23635        - ❌
23636      * - **browsertime-tp6-live-sheriffed-firefox-cnn-e10s**
23637        - ❌
23638        - ❌
23639        - ❌
23640        - ❌
23641      * - **browsertime-tp6-live-sheriffed-firefox-cnn-fis-e10s**
23642        - ❌
23643        - ❌
23644        - ❌
23645        - ❌
23646
23647
23648   .. list-table:: **test-windows10-64-qr/opt**
23649      :widths: 30 15 15 15 15
23650      :header-rows: 1
23651
23652      * - **Test Name**
23653        - mozilla-central
23654        - autoland
23655        - mozilla-release
23656        - mozilla-beta
23657      * - **browsertime-tp6-essential-firefox-cnn-e10s**
23658        - ❌
23659        - ❌
23660        - ❌
23661        - ❌
23662      * - **browsertime-tp6-essential-firefox-cnn-fis-e10s**
23663        - ❌
23664        - ❌
23665        - ❌
23666        - ❌
23667      * - **browsertime-tp6-live-sheriffed-firefox-cnn-e10s**
23668        - ❌
23669        - ❌
23670        - ❌
23671        - ❌
23672      * - **browsertime-tp6-live-sheriffed-firefox-cnn-fis-e10s**
23673        - ❌
23674        - ❌
23675        - ❌
23676        - ❌
23677
23678
23679   .. list-table:: **test-windows10-64-shippable-qr/opt**
23680      :widths: 30 15 15 15 15
23681      :header-rows: 1
23682
23683      * - **Test Name**
23684        - mozilla-central
23685        - autoland
23686        - mozilla-release
23687        - mozilla-beta
23688      * - **browsertime-tp6-essential-chrome-cnn-e10s**
23689        - ❌
23690        - ❌
23691        - ❌
23692        - ❌
23693      * - **browsertime-tp6-essential-chromium-cnn-e10s**
23694        - ❌
23695        - ❌
23696        - ❌
23697        - ❌
23698      * - **browsertime-tp6-essential-firefox-cnn-e10s**
23699        - ❌
23700        - ❌
23701        - ❌
23702        - ❌
23703      * - **browsertime-tp6-essential-firefox-cnn-fis-e10s**
23704        - ✅
23705        - ✅
23706        - ✅
23707        - ✅
23708      * - **browsertime-tp6-live-sheriffed-firefox-cnn-e10s**
23709        - ❌
23710        - ❌
23711        - ❌
23712        - ❌
23713      * - **browsertime-tp6-live-sheriffed-firefox-cnn-fis-e10s**
23714        - ❌
23715        - ❌
23716        - ❌
23717        - ❌
23718
23719
23720
23721.. dropdown:: cnn-ampstories
23722   :container: + anchor-id-cnn-ampstories-l
23723
23724   **Owner**: PerfTest Team
23725
23726   * **alert on**: fcp, loadtime
23727   * **alert threshold**: 2.0
23728   * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome, chromium
23729   * **browser cycles**: 15
23730   * **expected**: pass
23731   * **lower is better**: true
23732   * **page cycles**: 25
23733   * **page timeout**: 60000
23734   * **test url**: `<https://cnn.com/ampstories/us/why-hurricane-michael-is-a-monster-unlike-any-other>`__
23735   * **type**: pageload
23736   * **unit**: ms
23737   * **use live sites**: true
23738   * **Test Task**:
23739
23740   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
23741      :widths: 30 15 15 15 15
23742      :header-rows: 1
23743
23744      * - **Test Name**
23745        - mozilla-central
23746        - autoland
23747        - mozilla-release
23748        - mozilla-beta
23749      * - **browsertime-tp6m-fenix-cnn-ampstories-e10s**
23750        - ❌
23751        - ❌
23752        - ❌
23753        - ❌
23754      * - **browsertime-tp6m-geckoview-cnn-ampstories-e10s**
23755        - ❌
23756        - ❌
23757        - ❌
23758        - ❌
23759      * - **browsertime-tp6m-live-fenix-cnn-ampstories-e10s**
23760        - ❌
23761        - ❌
23762        - ❌
23763        - ❌
23764      * - **browsertime-tp6m-live-geckoview-cnn-ampstories-e10s**
23765        - ❌
23766        - ❌
23767        - ❌
23768        - ❌
23769      * - **browsertime-tp6m-refbrow-cnn-ampstories-e10s**
23770        - ❌
23771        - ❌
23772        - ❌
23773        - ❌
23774
23775
23776   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
23777      :widths: 30 15 15 15 15
23778      :header-rows: 1
23779
23780      * - **Test Name**
23781        - mozilla-central
23782        - autoland
23783        - mozilla-release
23784        - mozilla-beta
23785      * - **browsertime-tp6m-chrome-m-cnn-ampstories-e10s**
23786        - ❌
23787        - ❌
23788        - ❌
23789        - ❌
23790      * - **browsertime-tp6m-fenix-cnn-ampstories-e10s**
23791        - ❌
23792        - ❌
23793        - ❌
23794        - ❌
23795      * - **browsertime-tp6m-geckoview-cnn-ampstories-e10s**
23796        - ✅
23797        - ✅
23798        - ✅
23799        - ✅
23800      * - **browsertime-tp6m-live-chrome-m-cnn-ampstories-e10s**
23801        - ❌
23802        - ❌
23803        - ❌
23804        - ❌
23805      * - **browsertime-tp6m-live-fenix-cnn-ampstories-e10s**
23806        - ❌
23807        - ❌
23808        - ❌
23809        - ❌
23810      * - **browsertime-tp6m-live-geckoview-cnn-ampstories-e10s**
23811        - ❌
23812        - ✅
23813        - ❌
23814        - ❌
23815      * - **browsertime-tp6m-refbrow-cnn-ampstories-e10s**
23816        - ❌
23817        - ❌
23818        - ❌
23819        - ❌
23820
23821
23822   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
23823      :widths: 30 15 15 15 15
23824      :header-rows: 1
23825
23826      * - **Test Name**
23827        - mozilla-central
23828        - autoland
23829        - mozilla-release
23830        - mozilla-beta
23831      * - **browsertime-tp6m-fenix-cnn-ampstories-e10s**
23832        - ❌
23833        - ❌
23834        - ❌
23835        - ❌
23836      * - **browsertime-tp6m-geckoview-cnn-ampstories-e10s**
23837        - ❌
23838        - ❌
23839        - ❌
23840        - ❌
23841      * - **browsertime-tp6m-live-fenix-cnn-ampstories-e10s**
23842        - ❌
23843        - ❌
23844        - ❌
23845        - ❌
23846      * - **browsertime-tp6m-live-geckoview-cnn-ampstories-e10s**
23847        - ❌
23848        - ❌
23849        - ❌
23850        - ❌
23851      * - **browsertime-tp6m-refbrow-cnn-ampstories-e10s**
23852        - ❌
23853        - ❌
23854        - ❌
23855        - ❌
23856
23857
23858   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
23859      :widths: 30 15 15 15 15
23860      :header-rows: 1
23861
23862      * - **Test Name**
23863        - mozilla-central
23864        - autoland
23865        - mozilla-release
23866        - mozilla-beta
23867      * - **browsertime-tp6m-chrome-m-cnn-ampstories-e10s**
23868        - ❌
23869        - ❌
23870        - ❌
23871        - ❌
23872      * - **browsertime-tp6m-fenix-cnn-ampstories-e10s**
23873        - ❌
23874        - ❌
23875        - ❌
23876        - ❌
23877      * - **browsertime-tp6m-geckoview-cnn-ampstories-e10s**
23878        - ✅
23879        - ✅
23880        - ✅
23881        - ✅
23882      * - **browsertime-tp6m-live-chrome-m-cnn-ampstories-e10s**
23883        - ❌
23884        - ❌
23885        - ❌
23886        - ❌
23887      * - **browsertime-tp6m-live-fenix-cnn-ampstories-e10s**
23888        - ❌
23889        - ❌
23890        - ❌
23891        - ❌
23892      * - **browsertime-tp6m-live-geckoview-cnn-ampstories-e10s**
23893        - ❌
23894        - ✅
23895        - ❌
23896        - ❌
23897      * - **browsertime-tp6m-refbrow-cnn-ampstories-e10s**
23898        - ❌
23899        - ❌
23900        - ❌
23901        - ❌
23902
23903
23904   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
23905      :widths: 30 15 15 15 15
23906      :header-rows: 1
23907
23908      * - **Test Name**
23909        - mozilla-central
23910        - autoland
23911        - mozilla-release
23912        - mozilla-beta
23913      * - **browsertime-tp6m-fenix-cnn-ampstories-e10s**
23914        - ❌
23915        - ❌
23916        - ❌
23917        - ❌
23918      * - **browsertime-tp6m-geckoview-cnn-ampstories-e10s**
23919        - ❌
23920        - ❌
23921        - ❌
23922        - ❌
23923      * - **browsertime-tp6m-live-fenix-cnn-ampstories-e10s**
23924        - ❌
23925        - ❌
23926        - ❌
23927        - ❌
23928      * - **browsertime-tp6m-live-geckoview-cnn-ampstories-e10s**
23929        - ❌
23930        - ❌
23931        - ❌
23932        - ❌
23933      * - **browsertime-tp6m-refbrow-cnn-ampstories-e10s**
23934        - ❌
23935        - ❌
23936        - ❌
23937        - ❌
23938
23939
23940   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
23941      :widths: 30 15 15 15 15
23942      :header-rows: 1
23943
23944      * - **Test Name**
23945        - mozilla-central
23946        - autoland
23947        - mozilla-release
23948        - mozilla-beta
23949      * - **browsertime-tp6m-chrome-m-cnn-ampstories-e10s**
23950        - ❌
23951        - ❌
23952        - ❌
23953        - ❌
23954      * - **browsertime-tp6m-fenix-cnn-ampstories-e10s**
23955        - ❌
23956        - ❌
23957        - ❌
23958        - ❌
23959      * - **browsertime-tp6m-geckoview-cnn-ampstories-e10s**
23960        - ❌
23961        - ❌
23962        - ❌
23963        - ❌
23964      * - **browsertime-tp6m-live-chrome-m-cnn-ampstories-e10s**
23965        - ❌
23966        - ❌
23967        - ❌
23968        - ❌
23969      * - **browsertime-tp6m-live-fenix-cnn-ampstories-e10s**
23970        - ❌
23971        - ❌
23972        - ❌
23973        - ❌
23974      * - **browsertime-tp6m-live-geckoview-cnn-ampstories-e10s**
23975        - ❌
23976        - ❌
23977        - ❌
23978        - ❌
23979      * - **browsertime-tp6m-refbrow-cnn-ampstories-e10s**
23980        - ❌
23981        - ❌
23982        - ❌
23983        - ❌
23984
23985
23986   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
23987      :widths: 30 15 15 15 15
23988      :header-rows: 1
23989
23990      * - **Test Name**
23991        - mozilla-central
23992        - autoland
23993        - mozilla-release
23994        - mozilla-beta
23995      * - **browsertime-tp6m-fenix-cnn-ampstories-e10s**
23996        - ❌
23997        - ❌
23998        - ❌
23999        - ❌
24000      * - **browsertime-tp6m-geckoview-cnn-ampstories-e10s**
24001        - ❌
24002        - ❌
24003        - ❌
24004        - ❌
24005      * - **browsertime-tp6m-live-fenix-cnn-ampstories-e10s**
24006        - ❌
24007        - ❌
24008        - ❌
24009        - ❌
24010      * - **browsertime-tp6m-live-geckoview-cnn-ampstories-e10s**
24011        - ❌
24012        - ❌
24013        - ❌
24014        - ❌
24015      * - **browsertime-tp6m-refbrow-cnn-ampstories-e10s**
24016        - ❌
24017        - ❌
24018        - ❌
24019        - ❌
24020
24021
24022   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
24023      :widths: 30 15 15 15 15
24024      :header-rows: 1
24025
24026      * - **Test Name**
24027        - mozilla-central
24028        - autoland
24029        - mozilla-release
24030        - mozilla-beta
24031      * - **browsertime-tp6m-chrome-m-cnn-ampstories-e10s**
24032        - ❌
24033        - ❌
24034        - ❌
24035        - ❌
24036      * - **browsertime-tp6m-fenix-cnn-ampstories-e10s**
24037        - ❌
24038        - ❌
24039        - ❌
24040        - ❌
24041      * - **browsertime-tp6m-geckoview-cnn-ampstories-e10s**
24042        - ❌
24043        - ❌
24044        - ❌
24045        - ❌
24046      * - **browsertime-tp6m-live-chrome-m-cnn-ampstories-e10s**
24047        - ❌
24048        - ❌
24049        - ❌
24050        - ❌
24051      * - **browsertime-tp6m-live-fenix-cnn-ampstories-e10s**
24052        - ❌
24053        - ❌
24054        - ❌
24055        - ❌
24056      * - **browsertime-tp6m-live-geckoview-cnn-ampstories-e10s**
24057        - ❌
24058        - ❌
24059        - ❌
24060        - ❌
24061      * - **browsertime-tp6m-refbrow-cnn-ampstories-e10s**
24062        - ❌
24063        - ❌
24064        - ❌
24065        - ❌
24066
24067
24068
24069.. dropdown:: discord
24070   :container: + anchor-id-discord-l
24071
24072   **Owner**: PerfTest Team
24073
24074   * **alert on**: fcp, loadtime
24075   * **alert threshold**: 2.0
24076   * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome, chromium
24077   * **browser cycles**: 15
24078   * **expected**: pass
24079   * **lower is better**: true
24080   * **page cycles**: 25
24081   * **page timeout**: 60000
24082   * **test url**: `<https://discordapp.com/>`__
24083   * **type**: pageload
24084   * **unit**: ms
24085   * **use live sites**: true
24086   * **Test Task**:
24087
24088   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
24089      :widths: 30 15 15 15 15
24090      :header-rows: 1
24091
24092      * - **Test Name**
24093        - mozilla-central
24094        - autoland
24095        - mozilla-release
24096        - mozilla-beta
24097      * - **browsertime-tp6m-live-fenix-discord-e10s**
24098        - ❌
24099        - ❌
24100        - ❌
24101        - ❌
24102      * - **browsertime-tp6m-live-geckoview-discord-e10s**
24103        - ❌
24104        - ❌
24105        - ❌
24106        - ❌
24107
24108
24109   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
24110      :widths: 30 15 15 15 15
24111      :header-rows: 1
24112
24113      * - **Test Name**
24114        - mozilla-central
24115        - autoland
24116        - mozilla-release
24117        - mozilla-beta
24118      * - **browsertime-tp6m-live-chrome-m-discord-e10s**
24119        - ❌
24120        - ❌
24121        - ❌
24122        - ❌
24123      * - **browsertime-tp6m-live-fenix-discord-e10s**
24124        - ❌
24125        - ❌
24126        - ❌
24127        - ❌
24128      * - **browsertime-tp6m-live-geckoview-discord-e10s**
24129        - ❌
24130        - ❌
24131        - ❌
24132        - ❌
24133
24134
24135   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
24136      :widths: 30 15 15 15 15
24137      :header-rows: 1
24138
24139      * - **Test Name**
24140        - mozilla-central
24141        - autoland
24142        - mozilla-release
24143        - mozilla-beta
24144      * - **browsertime-tp6m-live-fenix-discord-e10s**
24145        - ❌
24146        - ❌
24147        - ❌
24148        - ❌
24149      * - **browsertime-tp6m-live-geckoview-discord-e10s**
24150        - ❌
24151        - ❌
24152        - ❌
24153        - ❌
24154
24155
24156   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
24157      :widths: 30 15 15 15 15
24158      :header-rows: 1
24159
24160      * - **Test Name**
24161        - mozilla-central
24162        - autoland
24163        - mozilla-release
24164        - mozilla-beta
24165      * - **browsertime-tp6m-live-chrome-m-discord-e10s**
24166        - ❌
24167        - ❌
24168        - ❌
24169        - ❌
24170      * - **browsertime-tp6m-live-fenix-discord-e10s**
24171        - ❌
24172        - ❌
24173        - ❌
24174        - ❌
24175      * - **browsertime-tp6m-live-geckoview-discord-e10s**
24176        - ❌
24177        - ❌
24178        - ❌
24179        - ❌
24180
24181
24182   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
24183      :widths: 30 15 15 15 15
24184      :header-rows: 1
24185
24186      * - **Test Name**
24187        - mozilla-central
24188        - autoland
24189        - mozilla-release
24190        - mozilla-beta
24191      * - **browsertime-tp6m-live-fenix-discord-e10s**
24192        - ❌
24193        - ❌
24194        - ❌
24195        - ❌
24196      * - **browsertime-tp6m-live-geckoview-discord-e10s**
24197        - ❌
24198        - ❌
24199        - ❌
24200        - ❌
24201
24202
24203   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
24204      :widths: 30 15 15 15 15
24205      :header-rows: 1
24206
24207      * - **Test Name**
24208        - mozilla-central
24209        - autoland
24210        - mozilla-release
24211        - mozilla-beta
24212      * - **browsertime-tp6m-live-chrome-m-discord-e10s**
24213        - ❌
24214        - ❌
24215        - ❌
24216        - ❌
24217      * - **browsertime-tp6m-live-fenix-discord-e10s**
24218        - ❌
24219        - ❌
24220        - ❌
24221        - ❌
24222      * - **browsertime-tp6m-live-geckoview-discord-e10s**
24223        - ❌
24224        - ❌
24225        - ❌
24226        - ❌
24227
24228
24229   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
24230      :widths: 30 15 15 15 15
24231      :header-rows: 1
24232
24233      * - **Test Name**
24234        - mozilla-central
24235        - autoland
24236        - mozilla-release
24237        - mozilla-beta
24238      * - **browsertime-tp6m-live-fenix-discord-e10s**
24239        - ❌
24240        - ❌
24241        - ❌
24242        - ❌
24243      * - **browsertime-tp6m-live-geckoview-discord-e10s**
24244        - ❌
24245        - ❌
24246        - ❌
24247        - ❌
24248
24249
24250   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
24251      :widths: 30 15 15 15 15
24252      :header-rows: 1
24253
24254      * - **Test Name**
24255        - mozilla-central
24256        - autoland
24257        - mozilla-release
24258        - mozilla-beta
24259      * - **browsertime-tp6m-live-chrome-m-discord-e10s**
24260        - ❌
24261        - ❌
24262        - ❌
24263        - ❌
24264      * - **browsertime-tp6m-live-fenix-discord-e10s**
24265        - ❌
24266        - ❌
24267        - ❌
24268        - ❌
24269      * - **browsertime-tp6m-live-geckoview-discord-e10s**
24270        - ❌
24271        - ❌
24272        - ❌
24273        - ❌
24274
24275
24276
24277.. dropdown:: expedia
24278   :container: + anchor-id-expedia-l
24279
24280   **Owner**: PerfTest Team
24281
24282   * **alert on**: fcp, loadtime
24283   * **alert threshold**: 2.0
24284   * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome, chromium
24285   * **browser cycles**: 15
24286   * **expected**: pass
24287   * **lower is better**: true
24288   * **page cycles**: 25
24289   * **page timeout**: 60000
24290   * **test url**: `<https://expedia.com/Hotel-Search?destination=New+York%2C+New+York&latLong=40.756680%2C-73.986470&regionId=178293&startDate=&endDate=&rooms=1&_xpid=11905%7C1&adults=2>`__
24291   * **type**: pageload
24292   * **unit**: ms
24293   * **use live sites**: true
24294   * **Test Task**:
24295
24296   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
24297      :widths: 30 15 15 15 15
24298      :header-rows: 1
24299
24300      * - **Test Name**
24301        - mozilla-central
24302        - autoland
24303        - mozilla-release
24304        - mozilla-beta
24305      * - **browsertime-tp6m-live-fenix-expedia-e10s**
24306        - ❌
24307        - ❌
24308        - ❌
24309        - ❌
24310      * - **browsertime-tp6m-live-geckoview-expedia-e10s**
24311        - ❌
24312        - ❌
24313        - ❌
24314        - ❌
24315
24316
24317   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
24318      :widths: 30 15 15 15 15
24319      :header-rows: 1
24320
24321      * - **Test Name**
24322        - mozilla-central
24323        - autoland
24324        - mozilla-release
24325        - mozilla-beta
24326      * - **browsertime-tp6m-live-chrome-m-expedia-e10s**
24327        - ❌
24328        - ❌
24329        - ❌
24330        - ❌
24331      * - **browsertime-tp6m-live-fenix-expedia-e10s**
24332        - ❌
24333        - ❌
24334        - ❌
24335        - ❌
24336      * - **browsertime-tp6m-live-geckoview-expedia-e10s**
24337        - ❌
24338        - ❌
24339        - ❌
24340        - ❌
24341
24342
24343   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
24344      :widths: 30 15 15 15 15
24345      :header-rows: 1
24346
24347      * - **Test Name**
24348        - mozilla-central
24349        - autoland
24350        - mozilla-release
24351        - mozilla-beta
24352      * - **browsertime-tp6m-live-fenix-expedia-e10s**
24353        - ❌
24354        - ❌
24355        - ❌
24356        - ❌
24357      * - **browsertime-tp6m-live-geckoview-expedia-e10s**
24358        - ❌
24359        - ❌
24360        - ❌
24361        - ❌
24362
24363
24364   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
24365      :widths: 30 15 15 15 15
24366      :header-rows: 1
24367
24368      * - **Test Name**
24369        - mozilla-central
24370        - autoland
24371        - mozilla-release
24372        - mozilla-beta
24373      * - **browsertime-tp6m-live-chrome-m-expedia-e10s**
24374        - ❌
24375        - ❌
24376        - ❌
24377        - ❌
24378      * - **browsertime-tp6m-live-fenix-expedia-e10s**
24379        - ❌
24380        - ❌
24381        - ❌
24382        - ❌
24383      * - **browsertime-tp6m-live-geckoview-expedia-e10s**
24384        - ❌
24385        - ❌
24386        - ❌
24387        - ❌
24388
24389
24390   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
24391      :widths: 30 15 15 15 15
24392      :header-rows: 1
24393
24394      * - **Test Name**
24395        - mozilla-central
24396        - autoland
24397        - mozilla-release
24398        - mozilla-beta
24399      * - **browsertime-tp6m-live-fenix-expedia-e10s**
24400        - ❌
24401        - ❌
24402        - ❌
24403        - ❌
24404      * - **browsertime-tp6m-live-geckoview-expedia-e10s**
24405        - ❌
24406        - ❌
24407        - ❌
24408        - ❌
24409
24410
24411   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
24412      :widths: 30 15 15 15 15
24413      :header-rows: 1
24414
24415      * - **Test Name**
24416        - mozilla-central
24417        - autoland
24418        - mozilla-release
24419        - mozilla-beta
24420      * - **browsertime-tp6m-live-chrome-m-expedia-e10s**
24421        - ❌
24422        - ❌
24423        - ❌
24424        - ❌
24425      * - **browsertime-tp6m-live-fenix-expedia-e10s**
24426        - ❌
24427        - ❌
24428        - ❌
24429        - ❌
24430      * - **browsertime-tp6m-live-geckoview-expedia-e10s**
24431        - ❌
24432        - ❌
24433        - ❌
24434        - ❌
24435
24436
24437   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
24438      :widths: 30 15 15 15 15
24439      :header-rows: 1
24440
24441      * - **Test Name**
24442        - mozilla-central
24443        - autoland
24444        - mozilla-release
24445        - mozilla-beta
24446      * - **browsertime-tp6m-live-fenix-expedia-e10s**
24447        - ❌
24448        - ❌
24449        - ❌
24450        - ❌
24451      * - **browsertime-tp6m-live-geckoview-expedia-e10s**
24452        - ❌
24453        - ❌
24454        - ❌
24455        - ❌
24456
24457
24458   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
24459      :widths: 30 15 15 15 15
24460      :header-rows: 1
24461
24462      * - **Test Name**
24463        - mozilla-central
24464        - autoland
24465        - mozilla-release
24466        - mozilla-beta
24467      * - **browsertime-tp6m-live-chrome-m-expedia-e10s**
24468        - ❌
24469        - ❌
24470        - ❌
24471        - ❌
24472      * - **browsertime-tp6m-live-fenix-expedia-e10s**
24473        - ❌
24474        - ❌
24475        - ❌
24476        - ❌
24477      * - **browsertime-tp6m-live-geckoview-expedia-e10s**
24478        - ❌
24479        - ❌
24480        - ❌
24481        - ❌
24482
24483
24484   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
24485      :widths: 30 15 15 15 15
24486      :header-rows: 1
24487
24488      * - **Test Name**
24489        - mozilla-central
24490        - autoland
24491        - mozilla-release
24492        - mozilla-beta
24493      * - **browsertime-tp6-firefox-expedia-e10s**
24494        - ❌
24495        - ❌
24496        - ❌
24497        - ❌
24498      * - **browsertime-tp6-firefox-expedia-fis-e10s**
24499        - ❌
24500        - ❌
24501        - ❌
24502        - ❌
24503
24504
24505   .. list-table:: **test-linux1804-64-qr/opt**
24506      :widths: 30 15 15 15 15
24507      :header-rows: 1
24508
24509      * - **Test Name**
24510        - mozilla-central
24511        - autoland
24512        - mozilla-release
24513        - mozilla-beta
24514      * - **browsertime-tp6-firefox-expedia-e10s**
24515        - ❌
24516        - ❌
24517        - ❌
24518        - ❌
24519      * - **browsertime-tp6-firefox-expedia-fis-e10s**
24520        - ❌
24521        - ❌
24522        - ❌
24523        - ❌
24524
24525
24526   .. list-table:: **test-linux1804-64-shippable-qr/opt**
24527      :widths: 30 15 15 15 15
24528      :header-rows: 1
24529
24530      * - **Test Name**
24531        - mozilla-central
24532        - autoland
24533        - mozilla-release
24534        - mozilla-beta
24535      * - **browsertime-tp6-chrome-expedia-e10s**
24536        - ❌
24537        - ❌
24538        - ❌
24539        - ❌
24540      * - **browsertime-tp6-chromium-expedia-e10s**
24541        - ❌
24542        - ❌
24543        - ❌
24544        - ❌
24545      * - **browsertime-tp6-firefox-expedia-e10s**
24546        - ❌
24547        - ❌
24548        - ❌
24549        - ❌
24550      * - **browsertime-tp6-firefox-expedia-fis-e10s**
24551        - ✅
24552        - ✅
24553        - ✅
24554        - ✅
24555
24556
24557   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
24558      :widths: 30 15 15 15 15
24559      :header-rows: 1
24560
24561      * - **Test Name**
24562        - mozilla-central
24563        - autoland
24564        - mozilla-release
24565        - mozilla-beta
24566      * - **browsertime-tp6-chrome-expedia-e10s**
24567        - ❌
24568        - ❌
24569        - ❌
24570        - ❌
24571      * - **browsertime-tp6-chromium-expedia-e10s**
24572        - ❌
24573        - ❌
24574        - ❌
24575        - ❌
24576      * - **browsertime-tp6-firefox-expedia-e10s**
24577        - ❌
24578        - ❌
24579        - ❌
24580        - ❌
24581      * - **browsertime-tp6-firefox-expedia-fis-e10s**
24582        - ✅
24583        - ✅
24584        - ✅
24585        - ✅
24586
24587
24588   .. list-table:: **test-windows10-32-qr/opt**
24589      :widths: 30 15 15 15 15
24590      :header-rows: 1
24591
24592      * - **Test Name**
24593        - mozilla-central
24594        - autoland
24595        - mozilla-release
24596        - mozilla-beta
24597      * - **browsertime-tp6-firefox-expedia-e10s**
24598        - ❌
24599        - ❌
24600        - ❌
24601        - ❌
24602      * - **browsertime-tp6-firefox-expedia-fis-e10s**
24603        - ❌
24604        - ❌
24605        - ❌
24606        - ❌
24607
24608
24609   .. list-table:: **test-windows10-32-shippable-qr/opt**
24610      :widths: 30 15 15 15 15
24611      :header-rows: 1
24612
24613      * - **Test Name**
24614        - mozilla-central
24615        - autoland
24616        - mozilla-release
24617        - mozilla-beta
24618      * - **browsertime-tp6-chrome-expedia-e10s**
24619        - ❌
24620        - ❌
24621        - ❌
24622        - ❌
24623      * - **browsertime-tp6-chromium-expedia-e10s**
24624        - ❌
24625        - ❌
24626        - ❌
24627        - ❌
24628      * - **browsertime-tp6-firefox-expedia-e10s**
24629        - ❌
24630        - ❌
24631        - ❌
24632        - ❌
24633      * - **browsertime-tp6-firefox-expedia-fis-e10s**
24634        - ❌
24635        - ❌
24636        - ❌
24637        - ❌
24638
24639
24640   .. list-table:: **test-windows10-64-qr/opt**
24641      :widths: 30 15 15 15 15
24642      :header-rows: 1
24643
24644      * - **Test Name**
24645        - mozilla-central
24646        - autoland
24647        - mozilla-release
24648        - mozilla-beta
24649      * - **browsertime-tp6-firefox-expedia-e10s**
24650        - ❌
24651        - ❌
24652        - ❌
24653        - ❌
24654      * - **browsertime-tp6-firefox-expedia-fis-e10s**
24655        - ❌
24656        - ❌
24657        - ❌
24658        - ❌
24659
24660
24661   .. list-table:: **test-windows10-64-shippable-qr/opt**
24662      :widths: 30 15 15 15 15
24663      :header-rows: 1
24664
24665      * - **Test Name**
24666        - mozilla-central
24667        - autoland
24668        - mozilla-release
24669        - mozilla-beta
24670      * - **browsertime-tp6-chrome-expedia-e10s**
24671        - ❌
24672        - ❌
24673        - ❌
24674        - ❌
24675      * - **browsertime-tp6-chromium-expedia-e10s**
24676        - ❌
24677        - ❌
24678        - ❌
24679        - ❌
24680      * - **browsertime-tp6-firefox-expedia-e10s**
24681        - ❌
24682        - ❌
24683        - ❌
24684        - ❌
24685      * - **browsertime-tp6-firefox-expedia-fis-e10s**
24686        - ✅
24687        - ✅
24688        - ✅
24689        - ✅
24690
24691
24692
24693.. dropdown:: fashionbeans
24694   :container: + anchor-id-fashionbeans-l
24695
24696   **Owner**: PerfTest Team
24697
24698   * **alert on**: fcp, loadtime
24699   * **alert threshold**: 2.0
24700   * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome, chromium
24701   * **browser cycles**: 15
24702   * **expected**: pass
24703   * **lower is better**: true
24704   * **page cycles**: 25
24705   * **page timeout**: 60000
24706   * **test url**: `<https://fashionbeans.com/article/coolest-menswear-stores-in-the-world>`__
24707   * **type**: pageload
24708   * **unit**: ms
24709   * **use live sites**: true
24710   * **Test Task**:
24711
24712   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
24713      :widths: 30 15 15 15 15
24714      :header-rows: 1
24715
24716      * - **Test Name**
24717        - mozilla-central
24718        - autoland
24719        - mozilla-release
24720        - mozilla-beta
24721      * - **browsertime-tp6m-live-fenix-fashionbeans-e10s**
24722        - ❌
24723        - ❌
24724        - ❌
24725        - ❌
24726      * - **browsertime-tp6m-live-geckoview-fashionbeans-e10s**
24727        - ❌
24728        - ❌
24729        - ❌
24730        - ❌
24731
24732
24733   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
24734      :widths: 30 15 15 15 15
24735      :header-rows: 1
24736
24737      * - **Test Name**
24738        - mozilla-central
24739        - autoland
24740        - mozilla-release
24741        - mozilla-beta
24742      * - **browsertime-tp6m-live-chrome-m-fashionbeans-e10s**
24743        - ❌
24744        - ❌
24745        - ❌
24746        - ❌
24747      * - **browsertime-tp6m-live-fenix-fashionbeans-e10s**
24748        - ❌
24749        - ❌
24750        - ❌
24751        - ❌
24752      * - **browsertime-tp6m-live-geckoview-fashionbeans-e10s**
24753        - ❌
24754        - ❌
24755        - ❌
24756        - ❌
24757
24758
24759   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
24760      :widths: 30 15 15 15 15
24761      :header-rows: 1
24762
24763      * - **Test Name**
24764        - mozilla-central
24765        - autoland
24766        - mozilla-release
24767        - mozilla-beta
24768      * - **browsertime-tp6m-live-fenix-fashionbeans-e10s**
24769        - ❌
24770        - ❌
24771        - ❌
24772        - ❌
24773      * - **browsertime-tp6m-live-geckoview-fashionbeans-e10s**
24774        - ❌
24775        - ❌
24776        - ❌
24777        - ❌
24778
24779
24780   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
24781      :widths: 30 15 15 15 15
24782      :header-rows: 1
24783
24784      * - **Test Name**
24785        - mozilla-central
24786        - autoland
24787        - mozilla-release
24788        - mozilla-beta
24789      * - **browsertime-tp6m-live-chrome-m-fashionbeans-e10s**
24790        - ❌
24791        - ❌
24792        - ❌
24793        - ❌
24794      * - **browsertime-tp6m-live-fenix-fashionbeans-e10s**
24795        - ❌
24796        - ❌
24797        - ❌
24798        - ❌
24799      * - **browsertime-tp6m-live-geckoview-fashionbeans-e10s**
24800        - ❌
24801        - ❌
24802        - ❌
24803        - ❌
24804
24805
24806   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
24807      :widths: 30 15 15 15 15
24808      :header-rows: 1
24809
24810      * - **Test Name**
24811        - mozilla-central
24812        - autoland
24813        - mozilla-release
24814        - mozilla-beta
24815      * - **browsertime-tp6m-live-fenix-fashionbeans-e10s**
24816        - ❌
24817        - ❌
24818        - ❌
24819        - ❌
24820      * - **browsertime-tp6m-live-geckoview-fashionbeans-e10s**
24821        - ❌
24822        - ❌
24823        - ❌
24824        - ❌
24825
24826
24827   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
24828      :widths: 30 15 15 15 15
24829      :header-rows: 1
24830
24831      * - **Test Name**
24832        - mozilla-central
24833        - autoland
24834        - mozilla-release
24835        - mozilla-beta
24836      * - **browsertime-tp6m-live-chrome-m-fashionbeans-e10s**
24837        - ❌
24838        - ❌
24839        - ❌
24840        - ❌
24841      * - **browsertime-tp6m-live-fenix-fashionbeans-e10s**
24842        - ❌
24843        - ❌
24844        - ❌
24845        - ❌
24846      * - **browsertime-tp6m-live-geckoview-fashionbeans-e10s**
24847        - ❌
24848        - ❌
24849        - ❌
24850        - ❌
24851
24852
24853   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
24854      :widths: 30 15 15 15 15
24855      :header-rows: 1
24856
24857      * - **Test Name**
24858        - mozilla-central
24859        - autoland
24860        - mozilla-release
24861        - mozilla-beta
24862      * - **browsertime-tp6m-live-fenix-fashionbeans-e10s**
24863        - ❌
24864        - ❌
24865        - ❌
24866        - ❌
24867      * - **browsertime-tp6m-live-geckoview-fashionbeans-e10s**
24868        - ❌
24869        - ❌
24870        - ❌
24871        - ❌
24872
24873
24874   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
24875      :widths: 30 15 15 15 15
24876      :header-rows: 1
24877
24878      * - **Test Name**
24879        - mozilla-central
24880        - autoland
24881        - mozilla-release
24882        - mozilla-beta
24883      * - **browsertime-tp6m-live-chrome-m-fashionbeans-e10s**
24884        - ❌
24885        - ❌
24886        - ❌
24887        - ❌
24888      * - **browsertime-tp6m-live-fenix-fashionbeans-e10s**
24889        - ❌
24890        - ❌
24891        - ❌
24892        - ❌
24893      * - **browsertime-tp6m-live-geckoview-fashionbeans-e10s**
24894        - ❌
24895        - ❌
24896        - ❌
24897        - ❌
24898
24899
24900
24901.. dropdown:: google-accounts
24902   :container: + anchor-id-google-accounts-l
24903
24904   **Owner**: PerfTest Team
24905
24906   * **alert on**: fcp, loadtime
24907   * **alert threshold**: 2.0
24908   * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome, chromium
24909   * **browser cycles**: 15
24910   * **expected**: pass
24911   * **lower is better**: true
24912   * **page cycles**: 25
24913   * **page timeout**: 60000
24914   * **test url**: `<https://accounts.google.com>`__
24915   * **type**: pageload
24916   * **unit**: ms
24917   * **use live sites**: true
24918   * **Test Task**:
24919
24920   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
24921      :widths: 30 15 15 15 15
24922      :header-rows: 1
24923
24924      * - **Test Name**
24925        - mozilla-central
24926        - autoland
24927        - mozilla-release
24928        - mozilla-beta
24929      * - **browsertime-tp6m-live-fenix-google-accounts-e10s**
24930        - ❌
24931        - ❌
24932        - ❌
24933        - ❌
24934      * - **browsertime-tp6m-live-geckoview-google-accounts-e10s**
24935        - ❌
24936        - ❌
24937        - ❌
24938        - ❌
24939
24940
24941   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
24942      :widths: 30 15 15 15 15
24943      :header-rows: 1
24944
24945      * - **Test Name**
24946        - mozilla-central
24947        - autoland
24948        - mozilla-release
24949        - mozilla-beta
24950      * - **browsertime-tp6m-live-chrome-m-google-accounts-e10s**
24951        - ❌
24952        - ❌
24953        - ❌
24954        - ❌
24955      * - **browsertime-tp6m-live-fenix-google-accounts-e10s**
24956        - ❌
24957        - ❌
24958        - ❌
24959        - ❌
24960      * - **browsertime-tp6m-live-geckoview-google-accounts-e10s**
24961        - ❌
24962        - ❌
24963        - ❌
24964        - ❌
24965
24966
24967   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
24968      :widths: 30 15 15 15 15
24969      :header-rows: 1
24970
24971      * - **Test Name**
24972        - mozilla-central
24973        - autoland
24974        - mozilla-release
24975        - mozilla-beta
24976      * - **browsertime-tp6m-live-fenix-google-accounts-e10s**
24977        - ❌
24978        - ❌
24979        - ❌
24980        - ❌
24981      * - **browsertime-tp6m-live-geckoview-google-accounts-e10s**
24982        - ❌
24983        - ❌
24984        - ❌
24985        - ❌
24986
24987
24988   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
24989      :widths: 30 15 15 15 15
24990      :header-rows: 1
24991
24992      * - **Test Name**
24993        - mozilla-central
24994        - autoland
24995        - mozilla-release
24996        - mozilla-beta
24997      * - **browsertime-tp6m-live-chrome-m-google-accounts-e10s**
24998        - ❌
24999        - ❌
25000        - ❌
25001        - ❌
25002      * - **browsertime-tp6m-live-fenix-google-accounts-e10s**
25003        - ❌
25004        - ❌
25005        - ❌
25006        - ❌
25007      * - **browsertime-tp6m-live-geckoview-google-accounts-e10s**
25008        - ❌
25009        - ❌
25010        - ❌
25011        - ❌
25012
25013
25014   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
25015      :widths: 30 15 15 15 15
25016      :header-rows: 1
25017
25018      * - **Test Name**
25019        - mozilla-central
25020        - autoland
25021        - mozilla-release
25022        - mozilla-beta
25023      * - **browsertime-tp6m-live-fenix-google-accounts-e10s**
25024        - ❌
25025        - ❌
25026        - ❌
25027        - ❌
25028      * - **browsertime-tp6m-live-geckoview-google-accounts-e10s**
25029        - ❌
25030        - ❌
25031        - ❌
25032        - ❌
25033
25034
25035   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
25036      :widths: 30 15 15 15 15
25037      :header-rows: 1
25038
25039      * - **Test Name**
25040        - mozilla-central
25041        - autoland
25042        - mozilla-release
25043        - mozilla-beta
25044      * - **browsertime-tp6m-live-chrome-m-google-accounts-e10s**
25045        - ❌
25046        - ❌
25047        - ❌
25048        - ❌
25049      * - **browsertime-tp6m-live-fenix-google-accounts-e10s**
25050        - ❌
25051        - ❌
25052        - ❌
25053        - ❌
25054      * - **browsertime-tp6m-live-geckoview-google-accounts-e10s**
25055        - ❌
25056        - ❌
25057        - ❌
25058        - ❌
25059
25060
25061   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
25062      :widths: 30 15 15 15 15
25063      :header-rows: 1
25064
25065      * - **Test Name**
25066        - mozilla-central
25067        - autoland
25068        - mozilla-release
25069        - mozilla-beta
25070      * - **browsertime-tp6m-live-fenix-google-accounts-e10s**
25071        - ❌
25072        - ❌
25073        - ❌
25074        - ❌
25075      * - **browsertime-tp6m-live-geckoview-google-accounts-e10s**
25076        - ❌
25077        - ❌
25078        - ❌
25079        - ❌
25080
25081
25082   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
25083      :widths: 30 15 15 15 15
25084      :header-rows: 1
25085
25086      * - **Test Name**
25087        - mozilla-central
25088        - autoland
25089        - mozilla-release
25090        - mozilla-beta
25091      * - **browsertime-tp6m-live-chrome-m-google-accounts-e10s**
25092        - ❌
25093        - ❌
25094        - ❌
25095        - ❌
25096      * - **browsertime-tp6m-live-fenix-google-accounts-e10s**
25097        - ❌
25098        - ❌
25099        - ❌
25100        - ❌
25101      * - **browsertime-tp6m-live-geckoview-google-accounts-e10s**
25102        - ❌
25103        - ❌
25104        - ❌
25105        - ❌
25106
25107
25108
25109.. dropdown:: imdb-firefox
25110   :container: + anchor-id-imdb-firefox-l
25111
25112   **Owner**: PerfTest Team
25113
25114   * **alert on**: fcp, loadtime
25115   * **alert threshold**: 2.0
25116   * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome, chromium
25117   * **browser cycles**: 15
25118   * **expected**: pass
25119   * **lower is better**: true
25120   * **page cycles**: 25
25121   * **page timeout**: 60000
25122   * **test url**: `<https://m.imdb.com/title/tt0083943/>`__
25123   * **type**: pageload
25124   * **unit**: ms
25125   * **use live sites**: true
25126   * **Test Task**:
25127
25128   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
25129      :widths: 30 15 15 15 15
25130      :header-rows: 1
25131
25132      * - **Test Name**
25133        - mozilla-central
25134        - autoland
25135        - mozilla-release
25136        - mozilla-beta
25137      * - **browsertime-tp6m-live-fenix-imdb-firefox-e10s**
25138        - ❌
25139        - ❌
25140        - ❌
25141        - ❌
25142      * - **browsertime-tp6m-live-geckoview-imdb-firefox-e10s**
25143        - ❌
25144        - ❌
25145        - ❌
25146        - ❌
25147
25148
25149   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
25150      :widths: 30 15 15 15 15
25151      :header-rows: 1
25152
25153      * - **Test Name**
25154        - mozilla-central
25155        - autoland
25156        - mozilla-release
25157        - mozilla-beta
25158      * - **browsertime-tp6m-live-chrome-m-imdb-firefox-e10s**
25159        - ❌
25160        - ❌
25161        - ❌
25162        - ❌
25163      * - **browsertime-tp6m-live-fenix-imdb-firefox-e10s**
25164        - ❌
25165        - ❌
25166        - ❌
25167        - ❌
25168      * - **browsertime-tp6m-live-geckoview-imdb-firefox-e10s**
25169        - ❌
25170        - ❌
25171        - ❌
25172        - ❌
25173
25174
25175   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
25176      :widths: 30 15 15 15 15
25177      :header-rows: 1
25178
25179      * - **Test Name**
25180        - mozilla-central
25181        - autoland
25182        - mozilla-release
25183        - mozilla-beta
25184      * - **browsertime-tp6m-live-fenix-imdb-firefox-e10s**
25185        - ❌
25186        - ❌
25187        - ❌
25188        - ❌
25189      * - **browsertime-tp6m-live-geckoview-imdb-firefox-e10s**
25190        - ❌
25191        - ❌
25192        - ❌
25193        - ❌
25194
25195
25196   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
25197      :widths: 30 15 15 15 15
25198      :header-rows: 1
25199
25200      * - **Test Name**
25201        - mozilla-central
25202        - autoland
25203        - mozilla-release
25204        - mozilla-beta
25205      * - **browsertime-tp6m-live-chrome-m-imdb-firefox-e10s**
25206        - ❌
25207        - ❌
25208        - ❌
25209        - ❌
25210      * - **browsertime-tp6m-live-fenix-imdb-firefox-e10s**
25211        - ❌
25212        - ❌
25213        - ❌
25214        - ❌
25215      * - **browsertime-tp6m-live-geckoview-imdb-firefox-e10s**
25216        - ❌
25217        - ❌
25218        - ❌
25219        - ❌
25220
25221
25222   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
25223      :widths: 30 15 15 15 15
25224      :header-rows: 1
25225
25226      * - **Test Name**
25227        - mozilla-central
25228        - autoland
25229        - mozilla-release
25230        - mozilla-beta
25231      * - **browsertime-tp6m-live-fenix-imdb-firefox-e10s**
25232        - ❌
25233        - ❌
25234        - ❌
25235        - ❌
25236      * - **browsertime-tp6m-live-geckoview-imdb-firefox-e10s**
25237        - ❌
25238        - ❌
25239        - ❌
25240        - ❌
25241
25242
25243   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
25244      :widths: 30 15 15 15 15
25245      :header-rows: 1
25246
25247      * - **Test Name**
25248        - mozilla-central
25249        - autoland
25250        - mozilla-release
25251        - mozilla-beta
25252      * - **browsertime-tp6m-live-chrome-m-imdb-firefox-e10s**
25253        - ❌
25254        - ❌
25255        - ❌
25256        - ❌
25257      * - **browsertime-tp6m-live-fenix-imdb-firefox-e10s**
25258        - ❌
25259        - ❌
25260        - ❌
25261        - ❌
25262      * - **browsertime-tp6m-live-geckoview-imdb-firefox-e10s**
25263        - ❌
25264        - ❌
25265        - ❌
25266        - ❌
25267
25268
25269   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
25270      :widths: 30 15 15 15 15
25271      :header-rows: 1
25272
25273      * - **Test Name**
25274        - mozilla-central
25275        - autoland
25276        - mozilla-release
25277        - mozilla-beta
25278      * - **browsertime-tp6m-live-fenix-imdb-firefox-e10s**
25279        - ❌
25280        - ❌
25281        - ❌
25282        - ❌
25283      * - **browsertime-tp6m-live-geckoview-imdb-firefox-e10s**
25284        - ❌
25285        - ❌
25286        - ❌
25287        - ❌
25288
25289
25290   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
25291      :widths: 30 15 15 15 15
25292      :header-rows: 1
25293
25294      * - **Test Name**
25295        - mozilla-central
25296        - autoland
25297        - mozilla-release
25298        - mozilla-beta
25299      * - **browsertime-tp6m-live-chrome-m-imdb-firefox-e10s**
25300        - ❌
25301        - ❌
25302        - ❌
25303        - ❌
25304      * - **browsertime-tp6m-live-fenix-imdb-firefox-e10s**
25305        - ❌
25306        - ❌
25307        - ❌
25308        - ❌
25309      * - **browsertime-tp6m-live-geckoview-imdb-firefox-e10s**
25310        - ❌
25311        - ❌
25312        - ❌
25313        - ❌
25314
25315
25316
25317.. dropdown:: medium-article
25318   :container: + anchor-id-medium-article-l
25319
25320   **Owner**: PerfTest Team
25321
25322   * **alert on**: fcp, loadtime
25323   * **alert threshold**: 2.0
25324   * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome, chromium
25325   * **browser cycles**: 15
25326   * **expected**: pass
25327   * **lower is better**: true
25328   * **page cycles**: 25
25329   * **page timeout**: 60000
25330   * **test url**: `<https://medium.com/s/coincidences-are-a-lie/could-america-have-also-been-the-birthplace-of-impressionism-cb3d31a2e22d>`__
25331   * **type**: pageload
25332   * **unit**: ms
25333   * **use live sites**: true
25334   * **Test Task**:
25335
25336   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
25337      :widths: 30 15 15 15 15
25338      :header-rows: 1
25339
25340      * - **Test Name**
25341        - mozilla-central
25342        - autoland
25343        - mozilla-release
25344        - mozilla-beta
25345      * - **browsertime-tp6m-live-fenix-medium-article-e10s**
25346        - ❌
25347        - ❌
25348        - ❌
25349        - ❌
25350      * - **browsertime-tp6m-live-geckoview-medium-article-e10s**
25351        - ❌
25352        - ❌
25353        - ❌
25354        - ❌
25355
25356
25357   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
25358      :widths: 30 15 15 15 15
25359      :header-rows: 1
25360
25361      * - **Test Name**
25362        - mozilla-central
25363        - autoland
25364        - mozilla-release
25365        - mozilla-beta
25366      * - **browsertime-tp6m-live-chrome-m-medium-article-e10s**
25367        - ❌
25368        - ❌
25369        - ❌
25370        - ❌
25371      * - **browsertime-tp6m-live-fenix-medium-article-e10s**
25372        - ❌
25373        - ❌
25374        - ❌
25375        - ❌
25376      * - **browsertime-tp6m-live-geckoview-medium-article-e10s**
25377        - ❌
25378        - ❌
25379        - ❌
25380        - ❌
25381
25382
25383   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
25384      :widths: 30 15 15 15 15
25385      :header-rows: 1
25386
25387      * - **Test Name**
25388        - mozilla-central
25389        - autoland
25390        - mozilla-release
25391        - mozilla-beta
25392      * - **browsertime-tp6m-live-fenix-medium-article-e10s**
25393        - ❌
25394        - ❌
25395        - ❌
25396        - ❌
25397      * - **browsertime-tp6m-live-geckoview-medium-article-e10s**
25398        - ❌
25399        - ❌
25400        - ❌
25401        - ❌
25402
25403
25404   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
25405      :widths: 30 15 15 15 15
25406      :header-rows: 1
25407
25408      * - **Test Name**
25409        - mozilla-central
25410        - autoland
25411        - mozilla-release
25412        - mozilla-beta
25413      * - **browsertime-tp6m-live-chrome-m-medium-article-e10s**
25414        - ❌
25415        - ❌
25416        - ❌
25417        - ❌
25418      * - **browsertime-tp6m-live-fenix-medium-article-e10s**
25419        - ❌
25420        - ❌
25421        - ❌
25422        - ❌
25423      * - **browsertime-tp6m-live-geckoview-medium-article-e10s**
25424        - ❌
25425        - ❌
25426        - ❌
25427        - ❌
25428
25429
25430   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
25431      :widths: 30 15 15 15 15
25432      :header-rows: 1
25433
25434      * - **Test Name**
25435        - mozilla-central
25436        - autoland
25437        - mozilla-release
25438        - mozilla-beta
25439      * - **browsertime-tp6m-live-fenix-medium-article-e10s**
25440        - ❌
25441        - ❌
25442        - ❌
25443        - ❌
25444      * - **browsertime-tp6m-live-geckoview-medium-article-e10s**
25445        - ❌
25446        - ❌
25447        - ❌
25448        - ❌
25449
25450
25451   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
25452      :widths: 30 15 15 15 15
25453      :header-rows: 1
25454
25455      * - **Test Name**
25456        - mozilla-central
25457        - autoland
25458        - mozilla-release
25459        - mozilla-beta
25460      * - **browsertime-tp6m-live-chrome-m-medium-article-e10s**
25461        - ❌
25462        - ❌
25463        - ❌
25464        - ❌
25465      * - **browsertime-tp6m-live-fenix-medium-article-e10s**
25466        - ❌
25467        - ❌
25468        - ❌
25469        - ❌
25470      * - **browsertime-tp6m-live-geckoview-medium-article-e10s**
25471        - ❌
25472        - ❌
25473        - ❌
25474        - ❌
25475
25476
25477   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
25478      :widths: 30 15 15 15 15
25479      :header-rows: 1
25480
25481      * - **Test Name**
25482        - mozilla-central
25483        - autoland
25484        - mozilla-release
25485        - mozilla-beta
25486      * - **browsertime-tp6m-live-fenix-medium-article-e10s**
25487        - ❌
25488        - ❌
25489        - ❌
25490        - ❌
25491      * - **browsertime-tp6m-live-geckoview-medium-article-e10s**
25492        - ❌
25493        - ❌
25494        - ❌
25495        - ❌
25496
25497
25498   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
25499      :widths: 30 15 15 15 15
25500      :header-rows: 1
25501
25502      * - **Test Name**
25503        - mozilla-central
25504        - autoland
25505        - mozilla-release
25506        - mozilla-beta
25507      * - **browsertime-tp6m-live-chrome-m-medium-article-e10s**
25508        - ❌
25509        - ❌
25510        - ❌
25511        - ❌
25512      * - **browsertime-tp6m-live-fenix-medium-article-e10s**
25513        - ❌
25514        - ❌
25515        - ❌
25516        - ❌
25517      * - **browsertime-tp6m-live-geckoview-medium-article-e10s**
25518        - ❌
25519        - ❌
25520        - ❌
25521        - ❌
25522
25523
25524
25525.. dropdown:: nytimes
25526   :container: + anchor-id-nytimes-l
25527
25528   **Owner**: PerfTest Team
25529
25530   * **alert on**: fcp, loadtime
25531   * **alert threshold**: 2.0
25532   * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome, chromium
25533   * **browser cycles**: 15
25534   * **expected**: pass
25535   * **lower is better**: true
25536   * **page cycles**: 25
25537   * **page timeout**: 60000
25538   * **test url**: `<https://www.nytimes.com/2020/02/19/opinion/surprise-medical-bill.html>`__
25539   * **type**: pageload
25540   * **unit**: ms
25541   * **use live sites**: true
25542   * **Test Task**:
25543
25544   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
25545      :widths: 30 15 15 15 15
25546      :header-rows: 1
25547
25548      * - **Test Name**
25549        - mozilla-central
25550        - autoland
25551        - mozilla-release
25552        - mozilla-beta
25553      * - **browsertime-tp6m-live-fenix-nytimes-e10s**
25554        - ❌
25555        - ❌
25556        - ❌
25557        - ❌
25558      * - **browsertime-tp6m-live-geckoview-nytimes-e10s**
25559        - ❌
25560        - ❌
25561        - ❌
25562        - ❌
25563
25564
25565   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
25566      :widths: 30 15 15 15 15
25567      :header-rows: 1
25568
25569      * - **Test Name**
25570        - mozilla-central
25571        - autoland
25572        - mozilla-release
25573        - mozilla-beta
25574      * - **browsertime-tp6m-live-chrome-m-nytimes-e10s**
25575        - ❌
25576        - ❌
25577        - ❌
25578        - ❌
25579      * - **browsertime-tp6m-live-fenix-nytimes-e10s**
25580        - ❌
25581        - ❌
25582        - ❌
25583        - ❌
25584      * - **browsertime-tp6m-live-geckoview-nytimes-e10s**
25585        - ❌
25586        - ❌
25587        - ❌
25588        - ❌
25589
25590
25591   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
25592      :widths: 30 15 15 15 15
25593      :header-rows: 1
25594
25595      * - **Test Name**
25596        - mozilla-central
25597        - autoland
25598        - mozilla-release
25599        - mozilla-beta
25600      * - **browsertime-tp6m-live-fenix-nytimes-e10s**
25601        - ❌
25602        - ❌
25603        - ❌
25604        - ❌
25605      * - **browsertime-tp6m-live-geckoview-nytimes-e10s**
25606        - ❌
25607        - ❌
25608        - ❌
25609        - ❌
25610
25611
25612   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
25613      :widths: 30 15 15 15 15
25614      :header-rows: 1
25615
25616      * - **Test Name**
25617        - mozilla-central
25618        - autoland
25619        - mozilla-release
25620        - mozilla-beta
25621      * - **browsertime-tp6m-live-chrome-m-nytimes-e10s**
25622        - ❌
25623        - ❌
25624        - ❌
25625        - ❌
25626      * - **browsertime-tp6m-live-fenix-nytimes-e10s**
25627        - ❌
25628        - ❌
25629        - ❌
25630        - ❌
25631      * - **browsertime-tp6m-live-geckoview-nytimes-e10s**
25632        - ❌
25633        - ❌
25634        - ❌
25635        - ❌
25636
25637
25638   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
25639      :widths: 30 15 15 15 15
25640      :header-rows: 1
25641
25642      * - **Test Name**
25643        - mozilla-central
25644        - autoland
25645        - mozilla-release
25646        - mozilla-beta
25647      * - **browsertime-tp6m-live-fenix-nytimes-e10s**
25648        - ❌
25649        - ❌
25650        - ❌
25651        - ❌
25652      * - **browsertime-tp6m-live-geckoview-nytimes-e10s**
25653        - ❌
25654        - ❌
25655        - ❌
25656        - ❌
25657
25658
25659   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
25660      :widths: 30 15 15 15 15
25661      :header-rows: 1
25662
25663      * - **Test Name**
25664        - mozilla-central
25665        - autoland
25666        - mozilla-release
25667        - mozilla-beta
25668      * - **browsertime-tp6m-live-chrome-m-nytimes-e10s**
25669        - ❌
25670        - ❌
25671        - ❌
25672        - ❌
25673      * - **browsertime-tp6m-live-fenix-nytimes-e10s**
25674        - ❌
25675        - ❌
25676        - ❌
25677        - ❌
25678      * - **browsertime-tp6m-live-geckoview-nytimes-e10s**
25679        - ❌
25680        - ❌
25681        - ❌
25682        - ❌
25683
25684
25685   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
25686      :widths: 30 15 15 15 15
25687      :header-rows: 1
25688
25689      * - **Test Name**
25690        - mozilla-central
25691        - autoland
25692        - mozilla-release
25693        - mozilla-beta
25694      * - **browsertime-tp6m-live-fenix-nytimes-e10s**
25695        - ❌
25696        - ❌
25697        - ❌
25698        - ❌
25699      * - **browsertime-tp6m-live-geckoview-nytimes-e10s**
25700        - ❌
25701        - ❌
25702        - ❌
25703        - ❌
25704
25705
25706   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
25707      :widths: 30 15 15 15 15
25708      :header-rows: 1
25709
25710      * - **Test Name**
25711        - mozilla-central
25712        - autoland
25713        - mozilla-release
25714        - mozilla-beta
25715      * - **browsertime-tp6m-live-chrome-m-nytimes-e10s**
25716        - ❌
25717        - ❌
25718        - ❌
25719        - ❌
25720      * - **browsertime-tp6m-live-fenix-nytimes-e10s**
25721        - ❌
25722        - ❌
25723        - ❌
25724        - ❌
25725      * - **browsertime-tp6m-live-geckoview-nytimes-e10s**
25726        - ❌
25727        - ❌
25728        - ❌
25729        - ❌
25730
25731
25732   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
25733      :widths: 30 15 15 15 15
25734      :header-rows: 1
25735
25736      * - **Test Name**
25737        - mozilla-central
25738        - autoland
25739        - mozilla-release
25740        - mozilla-beta
25741      * - **browsertime-tp6-firefox-nytimes-e10s**
25742        - ❌
25743        - ❌
25744        - ❌
25745        - ❌
25746      * - **browsertime-tp6-firefox-nytimes-fis-e10s**
25747        - ❌
25748        - ❌
25749        - ❌
25750        - ❌
25751
25752
25753   .. list-table:: **test-linux1804-64-qr/opt**
25754      :widths: 30 15 15 15 15
25755      :header-rows: 1
25756
25757      * - **Test Name**
25758        - mozilla-central
25759        - autoland
25760        - mozilla-release
25761        - mozilla-beta
25762      * - **browsertime-tp6-firefox-nytimes-e10s**
25763        - ❌
25764        - ❌
25765        - ❌
25766        - ❌
25767      * - **browsertime-tp6-firefox-nytimes-fis-e10s**
25768        - ❌
25769        - ❌
25770        - ❌
25771        - ❌
25772
25773
25774   .. list-table:: **test-linux1804-64-shippable-qr/opt**
25775      :widths: 30 15 15 15 15
25776      :header-rows: 1
25777
25778      * - **Test Name**
25779        - mozilla-central
25780        - autoland
25781        - mozilla-release
25782        - mozilla-beta
25783      * - **browsertime-tp6-chrome-nytimes-e10s**
25784        - ❌
25785        - ❌
25786        - ❌
25787        - ❌
25788      * - **browsertime-tp6-chromium-nytimes-e10s**
25789        - ❌
25790        - ❌
25791        - ❌
25792        - ❌
25793      * - **browsertime-tp6-firefox-nytimes-e10s**
25794        - ❌
25795        - ❌
25796        - ❌
25797        - ❌
25798      * - **browsertime-tp6-firefox-nytimes-fis-e10s**
25799        - ✅
25800        - ✅
25801        - ✅
25802        - ✅
25803
25804
25805   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
25806      :widths: 30 15 15 15 15
25807      :header-rows: 1
25808
25809      * - **Test Name**
25810        - mozilla-central
25811        - autoland
25812        - mozilla-release
25813        - mozilla-beta
25814      * - **browsertime-tp6-chrome-nytimes-e10s**
25815        - ❌
25816        - ❌
25817        - ❌
25818        - ❌
25819      * - **browsertime-tp6-chromium-nytimes-e10s**
25820        - ❌
25821        - ❌
25822        - ❌
25823        - ❌
25824      * - **browsertime-tp6-firefox-nytimes-e10s**
25825        - ❌
25826        - ❌
25827        - ❌
25828        - ❌
25829      * - **browsertime-tp6-firefox-nytimes-fis-e10s**
25830        - ✅
25831        - ✅
25832        - ✅
25833        - ✅
25834
25835
25836   .. list-table:: **test-windows10-32-qr/opt**
25837      :widths: 30 15 15 15 15
25838      :header-rows: 1
25839
25840      * - **Test Name**
25841        - mozilla-central
25842        - autoland
25843        - mozilla-release
25844        - mozilla-beta
25845      * - **browsertime-tp6-firefox-nytimes-e10s**
25846        - ❌
25847        - ❌
25848        - ❌
25849        - ❌
25850      * - **browsertime-tp6-firefox-nytimes-fis-e10s**
25851        - ❌
25852        - ❌
25853        - ❌
25854        - ❌
25855
25856
25857   .. list-table:: **test-windows10-32-shippable-qr/opt**
25858      :widths: 30 15 15 15 15
25859      :header-rows: 1
25860
25861      * - **Test Name**
25862        - mozilla-central
25863        - autoland
25864        - mozilla-release
25865        - mozilla-beta
25866      * - **browsertime-tp6-chrome-nytimes-e10s**
25867        - ❌
25868        - ❌
25869        - ❌
25870        - ❌
25871      * - **browsertime-tp6-chromium-nytimes-e10s**
25872        - ❌
25873        - ❌
25874        - ❌
25875        - ❌
25876      * - **browsertime-tp6-firefox-nytimes-e10s**
25877        - ❌
25878        - ❌
25879        - ❌
25880        - ❌
25881      * - **browsertime-tp6-firefox-nytimes-fis-e10s**
25882        - ❌
25883        - ❌
25884        - ❌
25885        - ❌
25886
25887
25888   .. list-table:: **test-windows10-64-qr/opt**
25889      :widths: 30 15 15 15 15
25890      :header-rows: 1
25891
25892      * - **Test Name**
25893        - mozilla-central
25894        - autoland
25895        - mozilla-release
25896        - mozilla-beta
25897      * - **browsertime-tp6-firefox-nytimes-e10s**
25898        - ❌
25899        - ❌
25900        - ❌
25901        - ❌
25902      * - **browsertime-tp6-firefox-nytimes-fis-e10s**
25903        - ❌
25904        - ❌
25905        - ❌
25906        - ❌
25907
25908
25909   .. list-table:: **test-windows10-64-shippable-qr/opt**
25910      :widths: 30 15 15 15 15
25911      :header-rows: 1
25912
25913      * - **Test Name**
25914        - mozilla-central
25915        - autoland
25916        - mozilla-release
25917        - mozilla-beta
25918      * - **browsertime-tp6-chrome-nytimes-e10s**
25919        - ❌
25920        - ❌
25921        - ❌
25922        - ❌
25923      * - **browsertime-tp6-chromium-nytimes-e10s**
25924        - ❌
25925        - ❌
25926        - ❌
25927        - ❌
25928      * - **browsertime-tp6-firefox-nytimes-e10s**
25929        - ❌
25930        - ❌
25931        - ❌
25932        - ❌
25933      * - **browsertime-tp6-firefox-nytimes-fis-e10s**
25934        - ✅
25935        - ✅
25936        - ✅
25937        - ✅
25938
25939
25940
25941.. dropdown:: people-article
25942   :container: + anchor-id-people-article-l
25943
25944   **Owner**: PerfTest Team
25945
25946   * **alert on**: fcp, loadtime
25947   * **alert threshold**: 2.0
25948   * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome, chromium
25949   * **browser cycles**: 15
25950   * **expected**: pass
25951   * **lower is better**: true
25952   * **page cycles**: 25
25953   * **page timeout**: 60000
25954   * **test url**: `<https://people.com/amp-stories/royal-a-to-z/>`__
25955   * **type**: pageload
25956   * **unit**: ms
25957   * **use live sites**: true
25958   * **Test Task**:
25959
25960   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
25961      :widths: 30 15 15 15 15
25962      :header-rows: 1
25963
25964      * - **Test Name**
25965        - mozilla-central
25966        - autoland
25967        - mozilla-release
25968        - mozilla-beta
25969      * - **browsertime-tp6m-live-fenix-people-article-e10s**
25970        - ❌
25971        - ❌
25972        - ❌
25973        - ❌
25974      * - **browsertime-tp6m-live-geckoview-people-article-e10s**
25975        - ❌
25976        - ❌
25977        - ❌
25978        - ❌
25979
25980
25981   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
25982      :widths: 30 15 15 15 15
25983      :header-rows: 1
25984
25985      * - **Test Name**
25986        - mozilla-central
25987        - autoland
25988        - mozilla-release
25989        - mozilla-beta
25990      * - **browsertime-tp6m-live-chrome-m-people-article-e10s**
25991        - ❌
25992        - ❌
25993        - ❌
25994        - ❌
25995      * - **browsertime-tp6m-live-fenix-people-article-e10s**
25996        - ❌
25997        - ❌
25998        - ❌
25999        - ❌
26000      * - **browsertime-tp6m-live-geckoview-people-article-e10s**
26001        - ❌
26002        - ❌
26003        - ❌
26004        - ❌
26005
26006
26007   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
26008      :widths: 30 15 15 15 15
26009      :header-rows: 1
26010
26011      * - **Test Name**
26012        - mozilla-central
26013        - autoland
26014        - mozilla-release
26015        - mozilla-beta
26016      * - **browsertime-tp6m-live-fenix-people-article-e10s**
26017        - ❌
26018        - ❌
26019        - ❌
26020        - ❌
26021      * - **browsertime-tp6m-live-geckoview-people-article-e10s**
26022        - ❌
26023        - ❌
26024        - ❌
26025        - ❌
26026
26027
26028   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
26029      :widths: 30 15 15 15 15
26030      :header-rows: 1
26031
26032      * - **Test Name**
26033        - mozilla-central
26034        - autoland
26035        - mozilla-release
26036        - mozilla-beta
26037      * - **browsertime-tp6m-live-chrome-m-people-article-e10s**
26038        - ❌
26039        - ❌
26040        - ❌
26041        - ❌
26042      * - **browsertime-tp6m-live-fenix-people-article-e10s**
26043        - ❌
26044        - ❌
26045        - ❌
26046        - ❌
26047      * - **browsertime-tp6m-live-geckoview-people-article-e10s**
26048        - ❌
26049        - ❌
26050        - ❌
26051        - ❌
26052
26053
26054   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
26055      :widths: 30 15 15 15 15
26056      :header-rows: 1
26057
26058      * - **Test Name**
26059        - mozilla-central
26060        - autoland
26061        - mozilla-release
26062        - mozilla-beta
26063      * - **browsertime-tp6m-live-fenix-people-article-e10s**
26064        - ❌
26065        - ❌
26066        - ❌
26067        - ❌
26068      * - **browsertime-tp6m-live-geckoview-people-article-e10s**
26069        - ❌
26070        - ❌
26071        - ❌
26072        - ❌
26073
26074
26075   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
26076      :widths: 30 15 15 15 15
26077      :header-rows: 1
26078
26079      * - **Test Name**
26080        - mozilla-central
26081        - autoland
26082        - mozilla-release
26083        - mozilla-beta
26084      * - **browsertime-tp6m-live-chrome-m-people-article-e10s**
26085        - ❌
26086        - ❌
26087        - ❌
26088        - ❌
26089      * - **browsertime-tp6m-live-fenix-people-article-e10s**
26090        - ❌
26091        - ❌
26092        - ❌
26093        - ❌
26094      * - **browsertime-tp6m-live-geckoview-people-article-e10s**
26095        - ❌
26096        - ❌
26097        - ❌
26098        - ❌
26099
26100
26101   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
26102      :widths: 30 15 15 15 15
26103      :header-rows: 1
26104
26105      * - **Test Name**
26106        - mozilla-central
26107        - autoland
26108        - mozilla-release
26109        - mozilla-beta
26110      * - **browsertime-tp6m-live-fenix-people-article-e10s**
26111        - ❌
26112        - ❌
26113        - ❌
26114        - ❌
26115      * - **browsertime-tp6m-live-geckoview-people-article-e10s**
26116        - ❌
26117        - ❌
26118        - ❌
26119        - ❌
26120
26121
26122   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
26123      :widths: 30 15 15 15 15
26124      :header-rows: 1
26125
26126      * - **Test Name**
26127        - mozilla-central
26128        - autoland
26129        - mozilla-release
26130        - mozilla-beta
26131      * - **browsertime-tp6m-live-chrome-m-people-article-e10s**
26132        - ❌
26133        - ❌
26134        - ❌
26135        - ❌
26136      * - **browsertime-tp6m-live-fenix-people-article-e10s**
26137        - ❌
26138        - ❌
26139        - ❌
26140        - ❌
26141      * - **browsertime-tp6m-live-geckoview-people-article-e10s**
26142        - ❌
26143        - ❌
26144        - ❌
26145        - ❌
26146
26147
26148
26149.. dropdown:: reddit-thread
26150   :container: + anchor-id-reddit-thread-l
26151
26152   **Owner**: PerfTest Team
26153
26154   * **alert on**: fcp, loadtime
26155   * **alert threshold**: 2.0
26156   * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome, chromium
26157   * **browser cycles**: 15
26158   * **expected**: pass
26159   * **lower is better**: true
26160   * **page cycles**: 25
26161   * **page timeout**: 60000
26162   * **test url**: `<https://www.reddit.com/r/firefox/comments/7dkq03/its_been_a_while/>`__
26163   * **type**: pageload
26164   * **unit**: ms
26165   * **use live sites**: true
26166   * **Test Task**:
26167
26168   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
26169      :widths: 30 15 15 15 15
26170      :header-rows: 1
26171
26172      * - **Test Name**
26173        - mozilla-central
26174        - autoland
26175        - mozilla-release
26176        - mozilla-beta
26177      * - **browsertime-tp6m-live-fenix-reddit-thread-e10s**
26178        - ❌
26179        - ❌
26180        - ❌
26181        - ❌
26182      * - **browsertime-tp6m-live-geckoview-reddit-thread-e10s**
26183        - ❌
26184        - ❌
26185        - ❌
26186        - ❌
26187
26188
26189   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
26190      :widths: 30 15 15 15 15
26191      :header-rows: 1
26192
26193      * - **Test Name**
26194        - mozilla-central
26195        - autoland
26196        - mozilla-release
26197        - mozilla-beta
26198      * - **browsertime-tp6m-live-chrome-m-reddit-thread-e10s**
26199        - ❌
26200        - ❌
26201        - ❌
26202        - ❌
26203      * - **browsertime-tp6m-live-fenix-reddit-thread-e10s**
26204        - ❌
26205        - ❌
26206        - ❌
26207        - ❌
26208      * - **browsertime-tp6m-live-geckoview-reddit-thread-e10s**
26209        - ❌
26210        - ❌
26211        - ❌
26212        - ❌
26213
26214
26215   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
26216      :widths: 30 15 15 15 15
26217      :header-rows: 1
26218
26219      * - **Test Name**
26220        - mozilla-central
26221        - autoland
26222        - mozilla-release
26223        - mozilla-beta
26224      * - **browsertime-tp6m-live-fenix-reddit-thread-e10s**
26225        - ❌
26226        - ❌
26227        - ❌
26228        - ❌
26229      * - **browsertime-tp6m-live-geckoview-reddit-thread-e10s**
26230        - ❌
26231        - ❌
26232        - ❌
26233        - ❌
26234
26235
26236   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
26237      :widths: 30 15 15 15 15
26238      :header-rows: 1
26239
26240      * - **Test Name**
26241        - mozilla-central
26242        - autoland
26243        - mozilla-release
26244        - mozilla-beta
26245      * - **browsertime-tp6m-live-chrome-m-reddit-thread-e10s**
26246        - ❌
26247        - ❌
26248        - ❌
26249        - ❌
26250      * - **browsertime-tp6m-live-fenix-reddit-thread-e10s**
26251        - ❌
26252        - ❌
26253        - ❌
26254        - ❌
26255      * - **browsertime-tp6m-live-geckoview-reddit-thread-e10s**
26256        - ❌
26257        - ❌
26258        - ❌
26259        - ❌
26260
26261
26262   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
26263      :widths: 30 15 15 15 15
26264      :header-rows: 1
26265
26266      * - **Test Name**
26267        - mozilla-central
26268        - autoland
26269        - mozilla-release
26270        - mozilla-beta
26271      * - **browsertime-tp6m-live-fenix-reddit-thread-e10s**
26272        - ❌
26273        - ❌
26274        - ❌
26275        - ❌
26276      * - **browsertime-tp6m-live-geckoview-reddit-thread-e10s**
26277        - ❌
26278        - ❌
26279        - ❌
26280        - ❌
26281
26282
26283   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
26284      :widths: 30 15 15 15 15
26285      :header-rows: 1
26286
26287      * - **Test Name**
26288        - mozilla-central
26289        - autoland
26290        - mozilla-release
26291        - mozilla-beta
26292      * - **browsertime-tp6m-live-chrome-m-reddit-thread-e10s**
26293        - ❌
26294        - ❌
26295        - ❌
26296        - ❌
26297      * - **browsertime-tp6m-live-fenix-reddit-thread-e10s**
26298        - ❌
26299        - ❌
26300        - ❌
26301        - ❌
26302      * - **browsertime-tp6m-live-geckoview-reddit-thread-e10s**
26303        - ❌
26304        - ❌
26305        - ❌
26306        - ❌
26307
26308
26309   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
26310      :widths: 30 15 15 15 15
26311      :header-rows: 1
26312
26313      * - **Test Name**
26314        - mozilla-central
26315        - autoland
26316        - mozilla-release
26317        - mozilla-beta
26318      * - **browsertime-tp6m-live-fenix-reddit-thread-e10s**
26319        - ❌
26320        - ❌
26321        - ❌
26322        - ❌
26323      * - **browsertime-tp6m-live-geckoview-reddit-thread-e10s**
26324        - ❌
26325        - ❌
26326        - ❌
26327        - ❌
26328
26329
26330   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
26331      :widths: 30 15 15 15 15
26332      :header-rows: 1
26333
26334      * - **Test Name**
26335        - mozilla-central
26336        - autoland
26337        - mozilla-release
26338        - mozilla-beta
26339      * - **browsertime-tp6m-live-chrome-m-reddit-thread-e10s**
26340        - ❌
26341        - ❌
26342        - ❌
26343        - ❌
26344      * - **browsertime-tp6m-live-fenix-reddit-thread-e10s**
26345        - ❌
26346        - ❌
26347        - ❌
26348        - ❌
26349      * - **browsertime-tp6m-live-geckoview-reddit-thread-e10s**
26350        - ❌
26351        - ❌
26352        - ❌
26353        - ❌
26354
26355
26356
26357.. dropdown:: rumble-fox
26358   :container: + anchor-id-rumble-fox-l
26359
26360   **Owner**: PerfTest Team
26361
26362   * **alert on**: fcp, loadtime
26363   * **alert threshold**: 2.0
26364   * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome, chromium
26365   * **browser cycles**: 15
26366   * **expected**: pass
26367   * **lower is better**: true
26368   * **page cycles**: 25
26369   * **page timeout**: 60000
26370   * **test url**: `<https://rumble.com/v3c44t-foxes-jumping-on-my-trampoline.html>`__
26371   * **type**: pageload
26372   * **unit**: ms
26373   * **use live sites**: true
26374   * **Test Task**:
26375
26376   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
26377      :widths: 30 15 15 15 15
26378      :header-rows: 1
26379
26380      * - **Test Name**
26381        - mozilla-central
26382        - autoland
26383        - mozilla-release
26384        - mozilla-beta
26385      * - **browsertime-tp6m-live-fenix-rumble-fox-e10s**
26386        - ❌
26387        - ❌
26388        - ❌
26389        - ❌
26390      * - **browsertime-tp6m-live-geckoview-rumble-fox-e10s**
26391        - ❌
26392        - ❌
26393        - ❌
26394        - ❌
26395
26396
26397   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
26398      :widths: 30 15 15 15 15
26399      :header-rows: 1
26400
26401      * - **Test Name**
26402        - mozilla-central
26403        - autoland
26404        - mozilla-release
26405        - mozilla-beta
26406      * - **browsertime-tp6m-live-chrome-m-rumble-fox-e10s**
26407        - ❌
26408        - ❌
26409        - ❌
26410        - ❌
26411      * - **browsertime-tp6m-live-fenix-rumble-fox-e10s**
26412        - ❌
26413        - ❌
26414        - ❌
26415        - ❌
26416      * - **browsertime-tp6m-live-geckoview-rumble-fox-e10s**
26417        - ❌
26418        - ❌
26419        - ❌
26420        - ❌
26421
26422
26423   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
26424      :widths: 30 15 15 15 15
26425      :header-rows: 1
26426
26427      * - **Test Name**
26428        - mozilla-central
26429        - autoland
26430        - mozilla-release
26431        - mozilla-beta
26432      * - **browsertime-tp6m-live-fenix-rumble-fox-e10s**
26433        - ❌
26434        - ❌
26435        - ❌
26436        - ❌
26437      * - **browsertime-tp6m-live-geckoview-rumble-fox-e10s**
26438        - ❌
26439        - ❌
26440        - ❌
26441        - ❌
26442
26443
26444   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
26445      :widths: 30 15 15 15 15
26446      :header-rows: 1
26447
26448      * - **Test Name**
26449        - mozilla-central
26450        - autoland
26451        - mozilla-release
26452        - mozilla-beta
26453      * - **browsertime-tp6m-live-chrome-m-rumble-fox-e10s**
26454        - ❌
26455        - ❌
26456        - ❌
26457        - ❌
26458      * - **browsertime-tp6m-live-fenix-rumble-fox-e10s**
26459        - ❌
26460        - ❌
26461        - ❌
26462        - ❌
26463      * - **browsertime-tp6m-live-geckoview-rumble-fox-e10s**
26464        - ❌
26465        - ❌
26466        - ❌
26467        - ❌
26468
26469
26470   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
26471      :widths: 30 15 15 15 15
26472      :header-rows: 1
26473
26474      * - **Test Name**
26475        - mozilla-central
26476        - autoland
26477        - mozilla-release
26478        - mozilla-beta
26479      * - **browsertime-tp6m-live-fenix-rumble-fox-e10s**
26480        - ❌
26481        - ❌
26482        - ❌
26483        - ❌
26484      * - **browsertime-tp6m-live-geckoview-rumble-fox-e10s**
26485        - ❌
26486        - ❌
26487        - ❌
26488        - ❌
26489
26490
26491   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
26492      :widths: 30 15 15 15 15
26493      :header-rows: 1
26494
26495      * - **Test Name**
26496        - mozilla-central
26497        - autoland
26498        - mozilla-release
26499        - mozilla-beta
26500      * - **browsertime-tp6m-live-chrome-m-rumble-fox-e10s**
26501        - ❌
26502        - ❌
26503        - ❌
26504        - ❌
26505      * - **browsertime-tp6m-live-fenix-rumble-fox-e10s**
26506        - ❌
26507        - ❌
26508        - ❌
26509        - ❌
26510      * - **browsertime-tp6m-live-geckoview-rumble-fox-e10s**
26511        - ❌
26512        - ❌
26513        - ❌
26514        - ❌
26515
26516
26517   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
26518      :widths: 30 15 15 15 15
26519      :header-rows: 1
26520
26521      * - **Test Name**
26522        - mozilla-central
26523        - autoland
26524        - mozilla-release
26525        - mozilla-beta
26526      * - **browsertime-tp6m-live-fenix-rumble-fox-e10s**
26527        - ❌
26528        - ❌
26529        - ❌
26530        - ❌
26531      * - **browsertime-tp6m-live-geckoview-rumble-fox-e10s**
26532        - ❌
26533        - ❌
26534        - ❌
26535        - ❌
26536
26537
26538   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
26539      :widths: 30 15 15 15 15
26540      :header-rows: 1
26541
26542      * - **Test Name**
26543        - mozilla-central
26544        - autoland
26545        - mozilla-release
26546        - mozilla-beta
26547      * - **browsertime-tp6m-live-chrome-m-rumble-fox-e10s**
26548        - ❌
26549        - ❌
26550        - ❌
26551        - ❌
26552      * - **browsertime-tp6m-live-fenix-rumble-fox-e10s**
26553        - ❌
26554        - ❌
26555        - ❌
26556        - ❌
26557      * - **browsertime-tp6m-live-geckoview-rumble-fox-e10s**
26558        - ❌
26559        - ❌
26560        - ❌
26561        - ❌
26562
26563
26564
26565.. dropdown:: stackoverflow-question
26566   :container: + anchor-id-stackoverflow-question-l
26567
26568   **Owner**: PerfTest Team
26569
26570   * **alert on**: fcp, loadtime
26571   * **alert threshold**: 2.0
26572   * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome, chromium
26573   * **browser cycles**: 15
26574   * **expected**: pass
26575   * **lower is better**: true
26576   * **page cycles**: 25
26577   * **page timeout**: 60000
26578   * **test url**: `<https://stackoverflow.com/questions/927358/how-do-i-undo-the-most-recent-commits-in-git>`__
26579   * **type**: pageload
26580   * **unit**: ms
26581   * **use live sites**: true
26582   * **Test Task**:
26583
26584   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
26585      :widths: 30 15 15 15 15
26586      :header-rows: 1
26587
26588      * - **Test Name**
26589        - mozilla-central
26590        - autoland
26591        - mozilla-release
26592        - mozilla-beta
26593      * - **browsertime-tp6m-live-fenix-stackoverflow-question-e10s**
26594        - ❌
26595        - ❌
26596        - ❌
26597        - ❌
26598      * - **browsertime-tp6m-live-geckoview-stackoverflow-question-e10s**
26599        - ❌
26600        - ❌
26601        - ❌
26602        - ❌
26603
26604
26605   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
26606      :widths: 30 15 15 15 15
26607      :header-rows: 1
26608
26609      * - **Test Name**
26610        - mozilla-central
26611        - autoland
26612        - mozilla-release
26613        - mozilla-beta
26614      * - **browsertime-tp6m-live-chrome-m-stackoverflow-question-e10s**
26615        - ❌
26616        - ❌
26617        - ❌
26618        - ❌
26619      * - **browsertime-tp6m-live-fenix-stackoverflow-question-e10s**
26620        - ❌
26621        - ❌
26622        - ❌
26623        - ❌
26624      * - **browsertime-tp6m-live-geckoview-stackoverflow-question-e10s**
26625        - ❌
26626        - ❌
26627        - ❌
26628        - ❌
26629
26630
26631   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
26632      :widths: 30 15 15 15 15
26633      :header-rows: 1
26634
26635      * - **Test Name**
26636        - mozilla-central
26637        - autoland
26638        - mozilla-release
26639        - mozilla-beta
26640      * - **browsertime-tp6m-live-fenix-stackoverflow-question-e10s**
26641        - ❌
26642        - ❌
26643        - ❌
26644        - ❌
26645      * - **browsertime-tp6m-live-geckoview-stackoverflow-question-e10s**
26646        - ❌
26647        - ❌
26648        - ❌
26649        - ❌
26650
26651
26652   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
26653      :widths: 30 15 15 15 15
26654      :header-rows: 1
26655
26656      * - **Test Name**
26657        - mozilla-central
26658        - autoland
26659        - mozilla-release
26660        - mozilla-beta
26661      * - **browsertime-tp6m-live-chrome-m-stackoverflow-question-e10s**
26662        - ❌
26663        - ❌
26664        - ❌
26665        - ❌
26666      * - **browsertime-tp6m-live-fenix-stackoverflow-question-e10s**
26667        - ❌
26668        - ❌
26669        - ❌
26670        - ❌
26671      * - **browsertime-tp6m-live-geckoview-stackoverflow-question-e10s**
26672        - ❌
26673        - ❌
26674        - ❌
26675        - ❌
26676
26677
26678   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
26679      :widths: 30 15 15 15 15
26680      :header-rows: 1
26681
26682      * - **Test Name**
26683        - mozilla-central
26684        - autoland
26685        - mozilla-release
26686        - mozilla-beta
26687      * - **browsertime-tp6m-live-fenix-stackoverflow-question-e10s**
26688        - ❌
26689        - ❌
26690        - ❌
26691        - ❌
26692      * - **browsertime-tp6m-live-geckoview-stackoverflow-question-e10s**
26693        - ❌
26694        - ❌
26695        - ❌
26696        - ❌
26697
26698
26699   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
26700      :widths: 30 15 15 15 15
26701      :header-rows: 1
26702
26703      * - **Test Name**
26704        - mozilla-central
26705        - autoland
26706        - mozilla-release
26707        - mozilla-beta
26708      * - **browsertime-tp6m-live-chrome-m-stackoverflow-question-e10s**
26709        - ❌
26710        - ❌
26711        - ❌
26712        - ❌
26713      * - **browsertime-tp6m-live-fenix-stackoverflow-question-e10s**
26714        - ❌
26715        - ❌
26716        - ❌
26717        - ❌
26718      * - **browsertime-tp6m-live-geckoview-stackoverflow-question-e10s**
26719        - ❌
26720        - ❌
26721        - ❌
26722        - ❌
26723
26724
26725   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
26726      :widths: 30 15 15 15 15
26727      :header-rows: 1
26728
26729      * - **Test Name**
26730        - mozilla-central
26731        - autoland
26732        - mozilla-release
26733        - mozilla-beta
26734      * - **browsertime-tp6m-live-fenix-stackoverflow-question-e10s**
26735        - ❌
26736        - ❌
26737        - ❌
26738        - ❌
26739      * - **browsertime-tp6m-live-geckoview-stackoverflow-question-e10s**
26740        - ❌
26741        - ❌
26742        - ❌
26743        - ❌
26744
26745
26746   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
26747      :widths: 30 15 15 15 15
26748      :header-rows: 1
26749
26750      * - **Test Name**
26751        - mozilla-central
26752        - autoland
26753        - mozilla-release
26754        - mozilla-beta
26755      * - **browsertime-tp6m-live-chrome-m-stackoverflow-question-e10s**
26756        - ❌
26757        - ❌
26758        - ❌
26759        - ❌
26760      * - **browsertime-tp6m-live-fenix-stackoverflow-question-e10s**
26761        - ❌
26762        - ❌
26763        - ❌
26764        - ❌
26765      * - **browsertime-tp6m-live-geckoview-stackoverflow-question-e10s**
26766        - ❌
26767        - ❌
26768        - ❌
26769        - ❌
26770
26771
26772
26773.. dropdown:: urbandictionary-define
26774   :container: + anchor-id-urbandictionary-define-l
26775
26776   **Owner**: PerfTest Team
26777
26778   * **alert on**: fcp, loadtime
26779   * **alert threshold**: 2.0
26780   * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome, chromium
26781   * **browser cycles**: 15
26782   * **expected**: pass
26783   * **lower is better**: true
26784   * **page cycles**: 25
26785   * **page timeout**: 60000
26786   * **test url**: `<https://urbandictionary.com/define.php?term=awesome%20sauce>`__
26787   * **type**: pageload
26788   * **unit**: ms
26789   * **use live sites**: true
26790   * **Test Task**:
26791
26792   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
26793      :widths: 30 15 15 15 15
26794      :header-rows: 1
26795
26796      * - **Test Name**
26797        - mozilla-central
26798        - autoland
26799        - mozilla-release
26800        - mozilla-beta
26801      * - **browsertime-tp6m-live-fenix-urbandictionary-define-e10s**
26802        - ❌
26803        - ❌
26804        - ❌
26805        - ❌
26806      * - **browsertime-tp6m-live-geckoview-urbandictionary-define-e10s**
26807        - ❌
26808        - ❌
26809        - ❌
26810        - ❌
26811
26812
26813   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
26814      :widths: 30 15 15 15 15
26815      :header-rows: 1
26816
26817      * - **Test Name**
26818        - mozilla-central
26819        - autoland
26820        - mozilla-release
26821        - mozilla-beta
26822      * - **browsertime-tp6m-live-chrome-m-urbandictionary-define-e10s**
26823        - ❌
26824        - ❌
26825        - ❌
26826        - ❌
26827      * - **browsertime-tp6m-live-fenix-urbandictionary-define-e10s**
26828        - ❌
26829        - ❌
26830        - ❌
26831        - ❌
26832      * - **browsertime-tp6m-live-geckoview-urbandictionary-define-e10s**
26833        - ❌
26834        - ❌
26835        - ❌
26836        - ❌
26837
26838
26839   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
26840      :widths: 30 15 15 15 15
26841      :header-rows: 1
26842
26843      * - **Test Name**
26844        - mozilla-central
26845        - autoland
26846        - mozilla-release
26847        - mozilla-beta
26848      * - **browsertime-tp6m-live-fenix-urbandictionary-define-e10s**
26849        - ❌
26850        - ❌
26851        - ❌
26852        - ❌
26853      * - **browsertime-tp6m-live-geckoview-urbandictionary-define-e10s**
26854        - ❌
26855        - ❌
26856        - ❌
26857        - ❌
26858
26859
26860   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
26861      :widths: 30 15 15 15 15
26862      :header-rows: 1
26863
26864      * - **Test Name**
26865        - mozilla-central
26866        - autoland
26867        - mozilla-release
26868        - mozilla-beta
26869      * - **browsertime-tp6m-live-chrome-m-urbandictionary-define-e10s**
26870        - ❌
26871        - ❌
26872        - ❌
26873        - ❌
26874      * - **browsertime-tp6m-live-fenix-urbandictionary-define-e10s**
26875        - ❌
26876        - ❌
26877        - ❌
26878        - ❌
26879      * - **browsertime-tp6m-live-geckoview-urbandictionary-define-e10s**
26880        - ❌
26881        - ❌
26882        - ❌
26883        - ❌
26884
26885
26886   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
26887      :widths: 30 15 15 15 15
26888      :header-rows: 1
26889
26890      * - **Test Name**
26891        - mozilla-central
26892        - autoland
26893        - mozilla-release
26894        - mozilla-beta
26895      * - **browsertime-tp6m-live-fenix-urbandictionary-define-e10s**
26896        - ❌
26897        - ❌
26898        - ❌
26899        - ❌
26900      * - **browsertime-tp6m-live-geckoview-urbandictionary-define-e10s**
26901        - ❌
26902        - ❌
26903        - ❌
26904        - ❌
26905
26906
26907   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
26908      :widths: 30 15 15 15 15
26909      :header-rows: 1
26910
26911      * - **Test Name**
26912        - mozilla-central
26913        - autoland
26914        - mozilla-release
26915        - mozilla-beta
26916      * - **browsertime-tp6m-live-chrome-m-urbandictionary-define-e10s**
26917        - ❌
26918        - ❌
26919        - ❌
26920        - ❌
26921      * - **browsertime-tp6m-live-fenix-urbandictionary-define-e10s**
26922        - ❌
26923        - ❌
26924        - ❌
26925        - ❌
26926      * - **browsertime-tp6m-live-geckoview-urbandictionary-define-e10s**
26927        - ❌
26928        - ❌
26929        - ❌
26930        - ❌
26931
26932
26933   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
26934      :widths: 30 15 15 15 15
26935      :header-rows: 1
26936
26937      * - **Test Name**
26938        - mozilla-central
26939        - autoland
26940        - mozilla-release
26941        - mozilla-beta
26942      * - **browsertime-tp6m-live-fenix-urbandictionary-define-e10s**
26943        - ❌
26944        - ❌
26945        - ❌
26946        - ❌
26947      * - **browsertime-tp6m-live-geckoview-urbandictionary-define-e10s**
26948        - ❌
26949        - ❌
26950        - ❌
26951        - ❌
26952
26953
26954   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
26955      :widths: 30 15 15 15 15
26956      :header-rows: 1
26957
26958      * - **Test Name**
26959        - mozilla-central
26960        - autoland
26961        - mozilla-release
26962        - mozilla-beta
26963      * - **browsertime-tp6m-live-chrome-m-urbandictionary-define-e10s**
26964        - ❌
26965        - ❌
26966        - ❌
26967        - ❌
26968      * - **browsertime-tp6m-live-fenix-urbandictionary-define-e10s**
26969        - ❌
26970        - ❌
26971        - ❌
26972        - ❌
26973      * - **browsertime-tp6m-live-geckoview-urbandictionary-define-e10s**
26974        - ❌
26975        - ❌
26976        - ❌
26977        - ❌
26978
26979
26980
26981.. dropdown:: wikia-marvel
26982   :container: + anchor-id-wikia-marvel-l
26983
26984   **Owner**: PerfTest Team
26985
26986   * **alert on**: fcp, loadtime
26987   * **alert threshold**: 2.0
26988   * **apps**: geckoview, fenix, refbrow, chrome-m, firefox, chrome, chromium
26989   * **browser cycles**: 15
26990   * **expected**: pass
26991   * **lower is better**: true
26992   * **page cycles**: 25
26993   * **page timeout**: 60000
26994   * **test url**: `<https://marvel.wikia.com/wiki/Black_Panther>`__
26995   * **type**: pageload
26996   * **unit**: ms
26997   * **use live sites**: true
26998   * **Test Task**:
26999
27000   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
27001      :widths: 30 15 15 15 15
27002      :header-rows: 1
27003
27004      * - **Test Name**
27005        - mozilla-central
27006        - autoland
27007        - mozilla-release
27008        - mozilla-beta
27009      * - **browsertime-tp6m-live-fenix-wikia-marvel-e10s**
27010        - ❌
27011        - ❌
27012        - ❌
27013        - ❌
27014      * - **browsertime-tp6m-live-geckoview-wikia-marvel-e10s**
27015        - ❌
27016        - ❌
27017        - ❌
27018        - ❌
27019
27020
27021   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
27022      :widths: 30 15 15 15 15
27023      :header-rows: 1
27024
27025      * - **Test Name**
27026        - mozilla-central
27027        - autoland
27028        - mozilla-release
27029        - mozilla-beta
27030      * - **browsertime-tp6m-live-chrome-m-wikia-marvel-e10s**
27031        - ❌
27032        - ❌
27033        - ❌
27034        - ❌
27035      * - **browsertime-tp6m-live-fenix-wikia-marvel-e10s**
27036        - ❌
27037        - ❌
27038        - ❌
27039        - ❌
27040      * - **browsertime-tp6m-live-geckoview-wikia-marvel-e10s**
27041        - ❌
27042        - ❌
27043        - ❌
27044        - ❌
27045
27046
27047   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
27048      :widths: 30 15 15 15 15
27049      :header-rows: 1
27050
27051      * - **Test Name**
27052        - mozilla-central
27053        - autoland
27054        - mozilla-release
27055        - mozilla-beta
27056      * - **browsertime-tp6m-live-fenix-wikia-marvel-e10s**
27057        - ❌
27058        - ❌
27059        - ❌
27060        - ❌
27061      * - **browsertime-tp6m-live-geckoview-wikia-marvel-e10s**
27062        - ❌
27063        - ❌
27064        - ❌
27065        - ❌
27066
27067
27068   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
27069      :widths: 30 15 15 15 15
27070      :header-rows: 1
27071
27072      * - **Test Name**
27073        - mozilla-central
27074        - autoland
27075        - mozilla-release
27076        - mozilla-beta
27077      * - **browsertime-tp6m-live-chrome-m-wikia-marvel-e10s**
27078        - ❌
27079        - ❌
27080        - ❌
27081        - ❌
27082      * - **browsertime-tp6m-live-fenix-wikia-marvel-e10s**
27083        - ❌
27084        - ❌
27085        - ❌
27086        - ❌
27087      * - **browsertime-tp6m-live-geckoview-wikia-marvel-e10s**
27088        - ❌
27089        - ❌
27090        - ❌
27091        - ❌
27092
27093
27094   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
27095      :widths: 30 15 15 15 15
27096      :header-rows: 1
27097
27098      * - **Test Name**
27099        - mozilla-central
27100        - autoland
27101        - mozilla-release
27102        - mozilla-beta
27103      * - **browsertime-tp6m-live-fenix-wikia-marvel-e10s**
27104        - ❌
27105        - ❌
27106        - ❌
27107        - ❌
27108      * - **browsertime-tp6m-live-geckoview-wikia-marvel-e10s**
27109        - ❌
27110        - ❌
27111        - ❌
27112        - ❌
27113
27114
27115   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
27116      :widths: 30 15 15 15 15
27117      :header-rows: 1
27118
27119      * - **Test Name**
27120        - mozilla-central
27121        - autoland
27122        - mozilla-release
27123        - mozilla-beta
27124      * - **browsertime-tp6m-live-chrome-m-wikia-marvel-e10s**
27125        - ❌
27126        - ❌
27127        - ❌
27128        - ❌
27129      * - **browsertime-tp6m-live-fenix-wikia-marvel-e10s**
27130        - ❌
27131        - ❌
27132        - ❌
27133        - ❌
27134      * - **browsertime-tp6m-live-geckoview-wikia-marvel-e10s**
27135        - ❌
27136        - ❌
27137        - ❌
27138        - ❌
27139
27140
27141   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
27142      :widths: 30 15 15 15 15
27143      :header-rows: 1
27144
27145      * - **Test Name**
27146        - mozilla-central
27147        - autoland
27148        - mozilla-release
27149        - mozilla-beta
27150      * - **browsertime-tp6m-live-fenix-wikia-marvel-e10s**
27151        - ❌
27152        - ❌
27153        - ❌
27154        - ❌
27155      * - **browsertime-tp6m-live-geckoview-wikia-marvel-e10s**
27156        - ❌
27157        - ❌
27158        - ❌
27159        - ❌
27160
27161
27162   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
27163      :widths: 30 15 15 15 15
27164      :header-rows: 1
27165
27166      * - **Test Name**
27167        - mozilla-central
27168        - autoland
27169        - mozilla-release
27170        - mozilla-beta
27171      * - **browsertime-tp6m-live-chrome-m-wikia-marvel-e10s**
27172        - ❌
27173        - ❌
27174        - ❌
27175        - ❌
27176      * - **browsertime-tp6m-live-fenix-wikia-marvel-e10s**
27177        - ❌
27178        - ❌
27179        - ❌
27180        - ❌
27181      * - **browsertime-tp6m-live-geckoview-wikia-marvel-e10s**
27182        - ❌
27183        - ❌
27184        - ❌
27185        - ❌
27186
27187
27188
27189
27190Mobile
27191------
27192Page-load performance test suite on Android. The links direct to the actual websites that are being tested.
27193
27194.. dropdown:: allrecipes
27195   :container: + anchor-id-allrecipes-m
27196
27197   **Owner**: PerfTest Team
27198
27199   * **alert on**: fcp, loadtime
27200   * **alert threshold**: 2.0
27201   * **apps**: geckoview, fenix, refbrow, chrome-m
27202   * **browser cycles**: 15
27203   * **expected**: pass
27204   * **lower is better**: true
27205   * **page cycles**: 25
27206   * **page timeout**: 60000
27207   * **playback**: mitmproxy-android
27208   * **playback pageset manifest**: mitm6-android-fenix-allrecipes.manifest
27209   * **playback version**: 6.0.2
27210   * **test url**: `<https://www.allrecipes.com/>`__
27211   * **type**: pageload
27212   * **unit**: ms
27213   * **use live sites**: false
27214   * **Test Task**:
27215
27216   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
27217      :widths: 30 15 15 15 15
27218      :header-rows: 1
27219
27220      * - **Test Name**
27221        - mozilla-central
27222        - autoland
27223        - mozilla-release
27224        - mozilla-beta
27225      * - **browsertime-tp6m-essential-fenix-allrecipes-e10s**
27226        - ❌
27227        - ❌
27228        - ❌
27229        - ❌
27230      * - **browsertime-tp6m-essential-geckoview-allrecipes-e10s**
27231        - ❌
27232        - ❌
27233        - ❌
27234        - ❌
27235      * - **browsertime-tp6m-essential-refbrow-allrecipes-e10s**
27236        - ❌
27237        - ❌
27238        - ❌
27239        - ❌
27240      * - **browsertime-tp6m-live-fenix-allrecipes-e10s**
27241        - ❌
27242        - ❌
27243        - ❌
27244        - ❌
27245      * - **browsertime-tp6m-live-geckoview-allrecipes-e10s**
27246        - ❌
27247        - ❌
27248        - ❌
27249        - ❌
27250
27251
27252   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
27253      :widths: 30 15 15 15 15
27254      :header-rows: 1
27255
27256      * - **Test Name**
27257        - mozilla-central
27258        - autoland
27259        - mozilla-release
27260        - mozilla-beta
27261      * - **browsertime-tp6m-essential-chrome-m-allrecipes-e10s**
27262        - ❌
27263        - ❌
27264        - ❌
27265        - ❌
27266      * - **browsertime-tp6m-essential-fenix-allrecipes-e10s**
27267        - ❌
27268        - ❌
27269        - ❌
27270        - ❌
27271      * - **browsertime-tp6m-essential-geckoview-allrecipes-e10s**
27272        - ✅
27273        - ✅
27274        - ✅
27275        - ✅
27276      * - **browsertime-tp6m-essential-refbrow-allrecipes-e10s**
27277        - ❌
27278        - ❌
27279        - ❌
27280        - ❌
27281      * - **browsertime-tp6m-live-chrome-m-allrecipes-e10s**
27282        - ❌
27283        - ❌
27284        - ❌
27285        - ❌
27286      * - **browsertime-tp6m-live-fenix-allrecipes-e10s**
27287        - ❌
27288        - ❌
27289        - ❌
27290        - ❌
27291      * - **browsertime-tp6m-live-geckoview-allrecipes-e10s**
27292        - ❌
27293        - ❌
27294        - ❌
27295        - ❌
27296
27297
27298   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
27299      :widths: 30 15 15 15 15
27300      :header-rows: 1
27301
27302      * - **Test Name**
27303        - mozilla-central
27304        - autoland
27305        - mozilla-release
27306        - mozilla-beta
27307      * - **browsertime-tp6m-essential-fenix-allrecipes-e10s**
27308        - ❌
27309        - ❌
27310        - ❌
27311        - ❌
27312      * - **browsertime-tp6m-essential-geckoview-allrecipes-e10s**
27313        - ❌
27314        - ❌
27315        - ❌
27316        - ❌
27317      * - **browsertime-tp6m-essential-refbrow-allrecipes-e10s**
27318        - ❌
27319        - ❌
27320        - ❌
27321        - ❌
27322      * - **browsertime-tp6m-live-fenix-allrecipes-e10s**
27323        - ❌
27324        - ❌
27325        - ❌
27326        - ❌
27327      * - **browsertime-tp6m-live-geckoview-allrecipes-e10s**
27328        - ❌
27329        - ❌
27330        - ❌
27331        - ❌
27332
27333
27334   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
27335      :widths: 30 15 15 15 15
27336      :header-rows: 1
27337
27338      * - **Test Name**
27339        - mozilla-central
27340        - autoland
27341        - mozilla-release
27342        - mozilla-beta
27343      * - **browsertime-tp6m-essential-chrome-m-allrecipes-e10s**
27344        - ❌
27345        - ❌
27346        - ❌
27347        - ❌
27348      * - **browsertime-tp6m-essential-fenix-allrecipes-e10s**
27349        - ❌
27350        - ❌
27351        - ❌
27352        - ❌
27353      * - **browsertime-tp6m-essential-geckoview-allrecipes-e10s**
27354        - ✅
27355        - ✅
27356        - ✅
27357        - ✅
27358      * - **browsertime-tp6m-essential-refbrow-allrecipes-e10s**
27359        - ❌
27360        - ❌
27361        - ❌
27362        - ❌
27363      * - **browsertime-tp6m-live-chrome-m-allrecipes-e10s**
27364        - ❌
27365        - ❌
27366        - ❌
27367        - ❌
27368      * - **browsertime-tp6m-live-fenix-allrecipes-e10s**
27369        - ❌
27370        - ❌
27371        - ❌
27372        - ❌
27373      * - **browsertime-tp6m-live-geckoview-allrecipes-e10s**
27374        - ❌
27375        - ❌
27376        - ❌
27377        - ❌
27378
27379
27380   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
27381      :widths: 30 15 15 15 15
27382      :header-rows: 1
27383
27384      * - **Test Name**
27385        - mozilla-central
27386        - autoland
27387        - mozilla-release
27388        - mozilla-beta
27389      * - **browsertime-tp6m-essential-fenix-allrecipes-e10s**
27390        - ❌
27391        - ❌
27392        - ❌
27393        - ❌
27394      * - **browsertime-tp6m-essential-geckoview-allrecipes-e10s**
27395        - ❌
27396        - ❌
27397        - ❌
27398        - ❌
27399      * - **browsertime-tp6m-essential-refbrow-allrecipes-e10s**
27400        - ❌
27401        - ❌
27402        - ❌
27403        - ❌
27404      * - **browsertime-tp6m-live-fenix-allrecipes-e10s**
27405        - ❌
27406        - ❌
27407        - ❌
27408        - ❌
27409      * - **browsertime-tp6m-live-geckoview-allrecipes-e10s**
27410        - ❌
27411        - ❌
27412        - ❌
27413        - ❌
27414
27415
27416   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
27417      :widths: 30 15 15 15 15
27418      :header-rows: 1
27419
27420      * - **Test Name**
27421        - mozilla-central
27422        - autoland
27423        - mozilla-release
27424        - mozilla-beta
27425      * - **browsertime-tp6m-essential-chrome-m-allrecipes-e10s**
27426        - ❌
27427        - ❌
27428        - ❌
27429        - ❌
27430      * - **browsertime-tp6m-essential-fenix-allrecipes-e10s**
27431        - ❌
27432        - ❌
27433        - ❌
27434        - ❌
27435      * - **browsertime-tp6m-essential-geckoview-allrecipes-e10s**
27436        - ❌
27437        - ❌
27438        - ❌
27439        - ❌
27440      * - **browsertime-tp6m-essential-refbrow-allrecipes-e10s**
27441        - ❌
27442        - ❌
27443        - ❌
27444        - ❌
27445      * - **browsertime-tp6m-live-chrome-m-allrecipes-e10s**
27446        - ❌
27447        - ❌
27448        - ❌
27449        - ❌
27450      * - **browsertime-tp6m-live-fenix-allrecipes-e10s**
27451        - ❌
27452        - ❌
27453        - ❌
27454        - ❌
27455      * - **browsertime-tp6m-live-geckoview-allrecipes-e10s**
27456        - ❌
27457        - ❌
27458        - ❌
27459        - ❌
27460
27461
27462   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
27463      :widths: 30 15 15 15 15
27464      :header-rows: 1
27465
27466      * - **Test Name**
27467        - mozilla-central
27468        - autoland
27469        - mozilla-release
27470        - mozilla-beta
27471      * - **browsertime-tp6m-essential-fenix-allrecipes-e10s**
27472        - ❌
27473        - ❌
27474        - ❌
27475        - ❌
27476      * - **browsertime-tp6m-essential-geckoview-allrecipes-e10s**
27477        - ❌
27478        - ❌
27479        - ❌
27480        - ❌
27481      * - **browsertime-tp6m-essential-refbrow-allrecipes-e10s**
27482        - ❌
27483        - ❌
27484        - ❌
27485        - ❌
27486      * - **browsertime-tp6m-live-fenix-allrecipes-e10s**
27487        - ❌
27488        - ❌
27489        - ❌
27490        - ❌
27491      * - **browsertime-tp6m-live-geckoview-allrecipes-e10s**
27492        - ❌
27493        - ❌
27494        - ❌
27495        - ❌
27496
27497
27498   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
27499      :widths: 30 15 15 15 15
27500      :header-rows: 1
27501
27502      * - **Test Name**
27503        - mozilla-central
27504        - autoland
27505        - mozilla-release
27506        - mozilla-beta
27507      * - **browsertime-tp6m-essential-chrome-m-allrecipes-e10s**
27508        - ❌
27509        - ❌
27510        - ❌
27511        - ❌
27512      * - **browsertime-tp6m-essential-fenix-allrecipes-e10s**
27513        - ❌
27514        - ❌
27515        - ❌
27516        - ❌
27517      * - **browsertime-tp6m-essential-geckoview-allrecipes-e10s**
27518        - ❌
27519        - ❌
27520        - ❌
27521        - ❌
27522      * - **browsertime-tp6m-essential-refbrow-allrecipes-e10s**
27523        - ❌
27524        - ❌
27525        - ❌
27526        - ❌
27527      * - **browsertime-tp6m-live-chrome-m-allrecipes-e10s**
27528        - ❌
27529        - ❌
27530        - ❌
27531        - ❌
27532      * - **browsertime-tp6m-live-fenix-allrecipes-e10s**
27533        - ❌
27534        - ❌
27535        - ❌
27536        - ❌
27537      * - **browsertime-tp6m-live-geckoview-allrecipes-e10s**
27538        - ❌
27539        - ❌
27540        - ❌
27541        - ❌
27542
27543
27544
27545.. dropdown:: amazon
27546   :container: + anchor-id-amazon-m
27547
27548   **Owner**: PerfTest Team
27549
27550   * **alert on**: fcp, loadtime
27551   * **alert threshold**: 2.0
27552   * **apps**: geckoview, fenix, refbrow, chrome-m
27553   * **browser cycles**: 15
27554   * **expected**: pass
27555   * **lower is better**: true
27556   * **page cycles**: 25
27557   * **page timeout**: 60000
27558   * **playback**: mitmproxy-android
27559   * **playback pageset manifest**: mitm6-android-fenix-amazon.manifest
27560   * **playback version**: 6.0.2
27561   * **test url**: `<https://www.amazon.com>`__
27562   * **type**: pageload
27563   * **unit**: ms
27564   * **use live sites**: false
27565   * **Test Task**:
27566
27567   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
27568      :widths: 30 15 15 15 15
27569      :header-rows: 1
27570
27571      * - **Test Name**
27572        - mozilla-central
27573        - autoland
27574        - mozilla-release
27575        - mozilla-beta
27576      * - **browsertime-tp6m-fenix-amazon-e10s**
27577        - ❌
27578        - ❌
27579        - ❌
27580        - ❌
27581      * - **browsertime-tp6m-geckoview-amazon-e10s**
27582        - ❌
27583        - ❌
27584        - ❌
27585        - ❌
27586      * - **browsertime-tp6m-live-fenix-amazon-e10s**
27587        - ❌
27588        - ❌
27589        - ❌
27590        - ❌
27591      * - **browsertime-tp6m-live-geckoview-amazon-e10s**
27592        - ❌
27593        - ❌
27594        - ❌
27595        - ❌
27596      * - **browsertime-tp6m-refbrow-amazon-e10s**
27597        - ❌
27598        - ❌
27599        - ❌
27600        - ❌
27601
27602
27603   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
27604      :widths: 30 15 15 15 15
27605      :header-rows: 1
27606
27607      * - **Test Name**
27608        - mozilla-central
27609        - autoland
27610        - mozilla-release
27611        - mozilla-beta
27612      * - **browsertime-tp6m-chrome-m-amazon-e10s**
27613        - ❌
27614        - ❌
27615        - ❌
27616        - ❌
27617      * - **browsertime-tp6m-fenix-amazon-e10s**
27618        - ❌
27619        - ❌
27620        - ❌
27621        - ❌
27622      * - **browsertime-tp6m-geckoview-amazon-e10s**
27623        - ✅
27624        - ✅
27625        - ✅
27626        - ✅
27627      * - **browsertime-tp6m-live-chrome-m-amazon-e10s**
27628        - ❌
27629        - ❌
27630        - ❌
27631        - ❌
27632      * - **browsertime-tp6m-live-fenix-amazon-e10s**
27633        - ❌
27634        - ❌
27635        - ❌
27636        - ❌
27637      * - **browsertime-tp6m-live-geckoview-amazon-e10s**
27638        - ❌
27639        - ❌
27640        - ❌
27641        - ❌
27642      * - **browsertime-tp6m-refbrow-amazon-e10s**
27643        - ❌
27644        - ❌
27645        - ❌
27646        - ❌
27647
27648
27649   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
27650      :widths: 30 15 15 15 15
27651      :header-rows: 1
27652
27653      * - **Test Name**
27654        - mozilla-central
27655        - autoland
27656        - mozilla-release
27657        - mozilla-beta
27658      * - **browsertime-tp6m-fenix-amazon-e10s**
27659        - ❌
27660        - ❌
27661        - ❌
27662        - ❌
27663      * - **browsertime-tp6m-geckoview-amazon-e10s**
27664        - ❌
27665        - ❌
27666        - ❌
27667        - ❌
27668      * - **browsertime-tp6m-live-fenix-amazon-e10s**
27669        - ❌
27670        - ❌
27671        - ❌
27672        - ❌
27673      * - **browsertime-tp6m-live-geckoview-amazon-e10s**
27674        - ❌
27675        - ❌
27676        - ❌
27677        - ❌
27678      * - **browsertime-tp6m-refbrow-amazon-e10s**
27679        - ❌
27680        - ❌
27681        - ❌
27682        - ❌
27683
27684
27685   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
27686      :widths: 30 15 15 15 15
27687      :header-rows: 1
27688
27689      * - **Test Name**
27690        - mozilla-central
27691        - autoland
27692        - mozilla-release
27693        - mozilla-beta
27694      * - **browsertime-tp6m-chrome-m-amazon-e10s**
27695        - ❌
27696        - ❌
27697        - ❌
27698        - ❌
27699      * - **browsertime-tp6m-fenix-amazon-e10s**
27700        - ❌
27701        - ❌
27702        - ❌
27703        - ❌
27704      * - **browsertime-tp6m-geckoview-amazon-e10s**
27705        - ✅
27706        - ✅
27707        - ✅
27708        - ✅
27709      * - **browsertime-tp6m-live-chrome-m-amazon-e10s**
27710        - ❌
27711        - ❌
27712        - ❌
27713        - ❌
27714      * - **browsertime-tp6m-live-fenix-amazon-e10s**
27715        - ❌
27716        - ❌
27717        - ❌
27718        - ❌
27719      * - **browsertime-tp6m-live-geckoview-amazon-e10s**
27720        - ❌
27721        - ❌
27722        - ❌
27723        - ❌
27724      * - **browsertime-tp6m-profiling-geckoview-amazon-e10s**
27725        - ✅
27726        - ❌
27727        - ❌
27728        - ❌
27729      * - **browsertime-tp6m-refbrow-amazon-e10s**
27730        - ❌
27731        - ❌
27732        - ❌
27733        - ❌
27734
27735
27736   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
27737      :widths: 30 15 15 15 15
27738      :header-rows: 1
27739
27740      * - **Test Name**
27741        - mozilla-central
27742        - autoland
27743        - mozilla-release
27744        - mozilla-beta
27745      * - **browsertime-tp6m-fenix-amazon-e10s**
27746        - ❌
27747        - ❌
27748        - ❌
27749        - ❌
27750      * - **browsertime-tp6m-geckoview-amazon-e10s**
27751        - ❌
27752        - ❌
27753        - ❌
27754        - ❌
27755      * - **browsertime-tp6m-live-fenix-amazon-e10s**
27756        - ❌
27757        - ❌
27758        - ❌
27759        - ❌
27760      * - **browsertime-tp6m-live-geckoview-amazon-e10s**
27761        - ❌
27762        - ❌
27763        - ❌
27764        - ❌
27765      * - **browsertime-tp6m-refbrow-amazon-e10s**
27766        - ❌
27767        - ❌
27768        - ❌
27769        - ❌
27770
27771
27772   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
27773      :widths: 30 15 15 15 15
27774      :header-rows: 1
27775
27776      * - **Test Name**
27777        - mozilla-central
27778        - autoland
27779        - mozilla-release
27780        - mozilla-beta
27781      * - **browsertime-tp6m-chrome-m-amazon-e10s**
27782        - ❌
27783        - ❌
27784        - ❌
27785        - ❌
27786      * - **browsertime-tp6m-fenix-amazon-e10s**
27787        - ❌
27788        - ❌
27789        - ❌
27790        - ❌
27791      * - **browsertime-tp6m-geckoview-amazon-e10s**
27792        - ❌
27793        - ❌
27794        - ❌
27795        - ❌
27796      * - **browsertime-tp6m-live-chrome-m-amazon-e10s**
27797        - ❌
27798        - ❌
27799        - ❌
27800        - ❌
27801      * - **browsertime-tp6m-live-fenix-amazon-e10s**
27802        - ❌
27803        - ❌
27804        - ❌
27805        - ❌
27806      * - **browsertime-tp6m-live-geckoview-amazon-e10s**
27807        - ❌
27808        - ❌
27809        - ❌
27810        - ❌
27811      * - **browsertime-tp6m-refbrow-amazon-e10s**
27812        - ❌
27813        - ❌
27814        - ❌
27815        - ❌
27816
27817
27818   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
27819      :widths: 30 15 15 15 15
27820      :header-rows: 1
27821
27822      * - **Test Name**
27823        - mozilla-central
27824        - autoland
27825        - mozilla-release
27826        - mozilla-beta
27827      * - **browsertime-tp6m-fenix-amazon-e10s**
27828        - ❌
27829        - ❌
27830        - ❌
27831        - ❌
27832      * - **browsertime-tp6m-geckoview-amazon-e10s**
27833        - ❌
27834        - ❌
27835        - ❌
27836        - ❌
27837      * - **browsertime-tp6m-live-fenix-amazon-e10s**
27838        - ❌
27839        - ❌
27840        - ❌
27841        - ❌
27842      * - **browsertime-tp6m-live-geckoview-amazon-e10s**
27843        - ❌
27844        - ❌
27845        - ❌
27846        - ❌
27847      * - **browsertime-tp6m-refbrow-amazon-e10s**
27848        - ❌
27849        - ❌
27850        - ❌
27851        - ❌
27852
27853
27854   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
27855      :widths: 30 15 15 15 15
27856      :header-rows: 1
27857
27858      * - **Test Name**
27859        - mozilla-central
27860        - autoland
27861        - mozilla-release
27862        - mozilla-beta
27863      * - **browsertime-tp6m-chrome-m-amazon-e10s**
27864        - ❌
27865        - ❌
27866        - ❌
27867        - ❌
27868      * - **browsertime-tp6m-fenix-amazon-e10s**
27869        - ❌
27870        - ❌
27871        - ❌
27872        - ❌
27873      * - **browsertime-tp6m-geckoview-amazon-e10s**
27874        - ❌
27875        - ❌
27876        - ❌
27877        - ❌
27878      * - **browsertime-tp6m-live-chrome-m-amazon-e10s**
27879        - ❌
27880        - ❌
27881        - ❌
27882        - ❌
27883      * - **browsertime-tp6m-live-fenix-amazon-e10s**
27884        - ❌
27885        - ❌
27886        - ❌
27887        - ❌
27888      * - **browsertime-tp6m-live-geckoview-amazon-e10s**
27889        - ❌
27890        - ❌
27891        - ❌
27892        - ❌
27893      * - **browsertime-tp6m-refbrow-amazon-e10s**
27894        - ❌
27895        - ❌
27896        - ❌
27897        - ❌
27898
27899
27900   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
27901      :widths: 30 15 15 15 15
27902      :header-rows: 1
27903
27904      * - **Test Name**
27905        - mozilla-central
27906        - autoland
27907        - mozilla-release
27908        - mozilla-beta
27909      * - **browsertime-tp6-essential-firefox-amazon-e10s**
27910        - ❌
27911        - ❌
27912        - ❌
27913        - ❌
27914      * - **browsertime-tp6-essential-firefox-amazon-fis-e10s**
27915        - ❌
27916        - ❌
27917        - ❌
27918        - ❌
27919      * - **browsertime-tp6-live-firefox-amazon-e10s**
27920        - ❌
27921        - ❌
27922        - ❌
27923        - ❌
27924      * - **browsertime-tp6-live-firefox-amazon-fis-e10s**
27925        - ❌
27926        - ❌
27927        - ❌
27928        - ❌
27929
27930
27931   .. list-table:: **test-linux1804-64-qr/opt**
27932      :widths: 30 15 15 15 15
27933      :header-rows: 1
27934
27935      * - **Test Name**
27936        - mozilla-central
27937        - autoland
27938        - mozilla-release
27939        - mozilla-beta
27940      * - **browsertime-tp6-essential-firefox-amazon-e10s**
27941        - ❌
27942        - ❌
27943        - ❌
27944        - ❌
27945      * - **browsertime-tp6-essential-firefox-amazon-fis-e10s**
27946        - ❌
27947        - ❌
27948        - ❌
27949        - ❌
27950      * - **browsertime-tp6-live-firefox-amazon-e10s**
27951        - ❌
27952        - ❌
27953        - ❌
27954        - ❌
27955      * - **browsertime-tp6-live-firefox-amazon-fis-e10s**
27956        - ❌
27957        - ❌
27958        - ❌
27959        - ❌
27960
27961
27962   .. list-table:: **test-linux1804-64-shippable-qr/opt**
27963      :widths: 30 15 15 15 15
27964      :header-rows: 1
27965
27966      * - **Test Name**
27967        - mozilla-central
27968        - autoland
27969        - mozilla-release
27970        - mozilla-beta
27971      * - **browsertime-tp6-essential-chrome-amazon-e10s**
27972        - ❌
27973        - ❌
27974        - ❌
27975        - ❌
27976      * - **browsertime-tp6-essential-chromium-amazon-e10s**
27977        - ❌
27978        - ❌
27979        - ❌
27980        - ❌
27981      * - **browsertime-tp6-essential-firefox-amazon-e10s**
27982        - ❌
27983        - ❌
27984        - ❌
27985        - ❌
27986      * - **browsertime-tp6-essential-firefox-amazon-fis-e10s**
27987        - ✅
27988        - ✅
27989        - ✅
27990        - ✅
27991      * - **browsertime-tp6-live-chrome-amazon-e10s**
27992        - ❌
27993        - ❌
27994        - ❌
27995        - ❌
27996      * - **browsertime-tp6-live-chromium-amazon-e10s**
27997        - ❌
27998        - ❌
27999        - ❌
28000        - ❌
28001      * - **browsertime-tp6-live-firefox-amazon-e10s**
28002        - ❌
28003        - ❌
28004        - ❌
28005        - ❌
28006      * - **browsertime-tp6-live-firefox-amazon-fis-e10s**
28007        - ❌
28008        - ❌
28009        - ❌
28010        - ❌
28011      * - **browsertime-tp6-profiling-firefox-amazon-e10s**
28012        - ✅
28013        - ❌
28014        - ❌
28015        - ❌
28016      * - **browsertime-tp6-profiling-firefox-amazon-fis-e10s**
28017        - ❌
28018        - ❌
28019        - ❌
28020        - ❌
28021
28022
28023   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
28024      :widths: 30 15 15 15 15
28025      :header-rows: 1
28026
28027      * - **Test Name**
28028        - mozilla-central
28029        - autoland
28030        - mozilla-release
28031        - mozilla-beta
28032      * - **browsertime-tp6-essential-chrome-amazon-e10s**
28033        - ❌
28034        - ❌
28035        - ❌
28036        - ❌
28037      * - **browsertime-tp6-essential-chromium-amazon-e10s**
28038        - ❌
28039        - ❌
28040        - ❌
28041        - ❌
28042      * - **browsertime-tp6-essential-firefox-amazon-e10s**
28043        - ❌
28044        - ❌
28045        - ❌
28046        - ❌
28047      * - **browsertime-tp6-essential-firefox-amazon-fis-e10s**
28048        - ✅
28049        - ✅
28050        - ✅
28051        - ✅
28052      * - **browsertime-tp6-live-chrome-amazon-e10s**
28053        - ❌
28054        - ❌
28055        - ❌
28056        - ❌
28057      * - **browsertime-tp6-live-chromium-amazon-e10s**
28058        - ❌
28059        - ❌
28060        - ❌
28061        - ❌
28062      * - **browsertime-tp6-live-firefox-amazon-e10s**
28063        - ❌
28064        - ❌
28065        - ❌
28066        - ❌
28067      * - **browsertime-tp6-live-firefox-amazon-fis-e10s**
28068        - ❌
28069        - ❌
28070        - ❌
28071        - ❌
28072      * - **browsertime-tp6-profiling-firefox-amazon-e10s**
28073        - ✅
28074        - ❌
28075        - ❌
28076        - ❌
28077      * - **browsertime-tp6-profiling-firefox-amazon-fis-e10s**
28078        - ❌
28079        - ❌
28080        - ❌
28081        - ❌
28082
28083
28084   .. list-table:: **test-windows10-32-qr/opt**
28085      :widths: 30 15 15 15 15
28086      :header-rows: 1
28087
28088      * - **Test Name**
28089        - mozilla-central
28090        - autoland
28091        - mozilla-release
28092        - mozilla-beta
28093      * - **browsertime-tp6-essential-firefox-amazon-e10s**
28094        - ❌
28095        - ❌
28096        - ❌
28097        - ❌
28098      * - **browsertime-tp6-essential-firefox-amazon-fis-e10s**
28099        - ❌
28100        - ❌
28101        - ❌
28102        - ❌
28103      * - **browsertime-tp6-live-firefox-amazon-e10s**
28104        - ❌
28105        - ❌
28106        - ❌
28107        - ❌
28108      * - **browsertime-tp6-live-firefox-amazon-fis-e10s**
28109        - ❌
28110        - ❌
28111        - ❌
28112        - ❌
28113
28114
28115   .. list-table:: **test-windows10-32-shippable-qr/opt**
28116      :widths: 30 15 15 15 15
28117      :header-rows: 1
28118
28119      * - **Test Name**
28120        - mozilla-central
28121        - autoland
28122        - mozilla-release
28123        - mozilla-beta
28124      * - **browsertime-tp6-essential-chrome-amazon-e10s**
28125        - ❌
28126        - ❌
28127        - ❌
28128        - ❌
28129      * - **browsertime-tp6-essential-chromium-amazon-e10s**
28130        - ❌
28131        - ❌
28132        - ❌
28133        - ❌
28134      * - **browsertime-tp6-essential-firefox-amazon-e10s**
28135        - ❌
28136        - ❌
28137        - ❌
28138        - ❌
28139      * - **browsertime-tp6-essential-firefox-amazon-fis-e10s**
28140        - ❌
28141        - ❌
28142        - ❌
28143        - ❌
28144      * - **browsertime-tp6-live-chrome-amazon-e10s**
28145        - ❌
28146        - ❌
28147        - ❌
28148        - ❌
28149      * - **browsertime-tp6-live-chromium-amazon-e10s**
28150        - ❌
28151        - ❌
28152        - ❌
28153        - ❌
28154      * - **browsertime-tp6-live-firefox-amazon-e10s**
28155        - ❌
28156        - ❌
28157        - ❌
28158        - ❌
28159      * - **browsertime-tp6-live-firefox-amazon-fis-e10s**
28160        - ❌
28161        - ❌
28162        - ❌
28163        - ❌
28164
28165
28166   .. list-table:: **test-windows10-64-qr/opt**
28167      :widths: 30 15 15 15 15
28168      :header-rows: 1
28169
28170      * - **Test Name**
28171        - mozilla-central
28172        - autoland
28173        - mozilla-release
28174        - mozilla-beta
28175      * - **browsertime-tp6-essential-firefox-amazon-e10s**
28176        - ❌
28177        - ❌
28178        - ❌
28179        - ❌
28180      * - **browsertime-tp6-essential-firefox-amazon-fis-e10s**
28181        - ❌
28182        - ❌
28183        - ❌
28184        - ❌
28185      * - **browsertime-tp6-live-firefox-amazon-e10s**
28186        - ❌
28187        - ❌
28188        - ❌
28189        - ❌
28190      * - **browsertime-tp6-live-firefox-amazon-fis-e10s**
28191        - ❌
28192        - ❌
28193        - ❌
28194        - ❌
28195
28196
28197   .. list-table:: **test-windows10-64-shippable-qr/opt**
28198      :widths: 30 15 15 15 15
28199      :header-rows: 1
28200
28201      * - **Test Name**
28202        - mozilla-central
28203        - autoland
28204        - mozilla-release
28205        - mozilla-beta
28206      * - **browsertime-tp6-essential-chrome-amazon-e10s**
28207        - ❌
28208        - ❌
28209        - ❌
28210        - ❌
28211      * - **browsertime-tp6-essential-chromium-amazon-e10s**
28212        - ❌
28213        - ❌
28214        - ❌
28215        - ❌
28216      * - **browsertime-tp6-essential-firefox-amazon-e10s**
28217        - ❌
28218        - ❌
28219        - ❌
28220        - ❌
28221      * - **browsertime-tp6-essential-firefox-amazon-fis-e10s**
28222        - ✅
28223        - ✅
28224        - ✅
28225        - ✅
28226      * - **browsertime-tp6-live-chrome-amazon-e10s**
28227        - ❌
28228        - ❌
28229        - ❌
28230        - ❌
28231      * - **browsertime-tp6-live-chromium-amazon-e10s**
28232        - ❌
28233        - ❌
28234        - ❌
28235        - ❌
28236      * - **browsertime-tp6-live-firefox-amazon-e10s**
28237        - ❌
28238        - ❌
28239        - ❌
28240        - ❌
28241      * - **browsertime-tp6-live-firefox-amazon-fis-e10s**
28242        - ❌
28243        - ❌
28244        - ❌
28245        - ❌
28246
28247
28248
28249.. dropdown:: amazon-search
28250   :container: + anchor-id-amazon-search-m
28251
28252   **Owner**: PerfTest Team
28253
28254   * **alert on**: fcp, loadtime
28255   * **alert threshold**: 2.0
28256   * **apps**: geckoview, fenix, refbrow, chrome-m
28257   * **browser cycles**: 15
28258   * **expected**: pass
28259   * **lower is better**: true
28260   * **page cycles**: 25
28261   * **page timeout**: 60000
28262   * **playback**: mitmproxy-android
28263   * **playback pageset manifest**: mitm6-android-fenix-amazon-search.manifest
28264   * **playback version**: 6.0.2
28265   * **test url**: `<https://www.amazon.com/s/ref=nb_sb_noss_2/139-6317191-5622045?url=search-alias%3Daps&field-keywords=mobile+phone>`__
28266   * **type**: pageload
28267   * **unit**: ms
28268   * **use live sites**: false
28269   * **Test Task**:
28270
28271   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
28272      :widths: 30 15 15 15 15
28273      :header-rows: 1
28274
28275      * - **Test Name**
28276        - mozilla-central
28277        - autoland
28278        - mozilla-release
28279        - mozilla-beta
28280      * - **browsertime-tp6m-essential-fenix-amazon-search-e10s**
28281        - ❌
28282        - ❌
28283        - ❌
28284        - ❌
28285      * - **browsertime-tp6m-essential-geckoview-amazon-search-e10s**
28286        - ❌
28287        - ❌
28288        - ❌
28289        - ❌
28290      * - **browsertime-tp6m-essential-refbrow-amazon-search-e10s**
28291        - ❌
28292        - ❌
28293        - ❌
28294        - ❌
28295      * - **browsertime-tp6m-live-fenix-amazon-search-e10s**
28296        - ❌
28297        - ❌
28298        - ❌
28299        - ❌
28300      * - **browsertime-tp6m-live-geckoview-amazon-search-e10s**
28301        - ❌
28302        - ❌
28303        - ❌
28304        - ❌
28305
28306
28307   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
28308      :widths: 30 15 15 15 15
28309      :header-rows: 1
28310
28311      * - **Test Name**
28312        - mozilla-central
28313        - autoland
28314        - mozilla-release
28315        - mozilla-beta
28316      * - **browsertime-tp6m-essential-chrome-m-amazon-search-e10s**
28317        - ❌
28318        - ❌
28319        - ❌
28320        - ❌
28321      * - **browsertime-tp6m-essential-fenix-amazon-search-e10s**
28322        - ❌
28323        - ❌
28324        - ❌
28325        - ❌
28326      * - **browsertime-tp6m-essential-geckoview-amazon-search-e10s**
28327        - ✅
28328        - ✅
28329        - ✅
28330        - ✅
28331      * - **browsertime-tp6m-essential-refbrow-amazon-search-e10s**
28332        - ❌
28333        - ❌
28334        - ❌
28335        - ❌
28336      * - **browsertime-tp6m-live-chrome-m-amazon-search-e10s**
28337        - ❌
28338        - ❌
28339        - ❌
28340        - ❌
28341      * - **browsertime-tp6m-live-fenix-amazon-search-e10s**
28342        - ❌
28343        - ❌
28344        - ❌
28345        - ❌
28346      * - **browsertime-tp6m-live-geckoview-amazon-search-e10s**
28347        - ❌
28348        - ❌
28349        - ❌
28350        - ❌
28351
28352
28353   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
28354      :widths: 30 15 15 15 15
28355      :header-rows: 1
28356
28357      * - **Test Name**
28358        - mozilla-central
28359        - autoland
28360        - mozilla-release
28361        - mozilla-beta
28362      * - **browsertime-tp6m-essential-fenix-amazon-search-e10s**
28363        - ❌
28364        - ❌
28365        - ❌
28366        - ❌
28367      * - **browsertime-tp6m-essential-geckoview-amazon-search-e10s**
28368        - ❌
28369        - ❌
28370        - ❌
28371        - ❌
28372      * - **browsertime-tp6m-essential-refbrow-amazon-search-e10s**
28373        - ❌
28374        - ❌
28375        - ❌
28376        - ❌
28377      * - **browsertime-tp6m-live-fenix-amazon-search-e10s**
28378        - ❌
28379        - ❌
28380        - ❌
28381        - ❌
28382      * - **browsertime-tp6m-live-geckoview-amazon-search-e10s**
28383        - ❌
28384        - ❌
28385        - ❌
28386        - ❌
28387
28388
28389   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
28390      :widths: 30 15 15 15 15
28391      :header-rows: 1
28392
28393      * - **Test Name**
28394        - mozilla-central
28395        - autoland
28396        - mozilla-release
28397        - mozilla-beta
28398      * - **browsertime-tp6m-essential-chrome-m-amazon-search-e10s**
28399        - ❌
28400        - ❌
28401        - ❌
28402        - ❌
28403      * - **browsertime-tp6m-essential-fenix-amazon-search-e10s**
28404        - ❌
28405        - ❌
28406        - ❌
28407        - ❌
28408      * - **browsertime-tp6m-essential-geckoview-amazon-search-e10s**
28409        - ✅
28410        - ✅
28411        - ✅
28412        - ✅
28413      * - **browsertime-tp6m-essential-refbrow-amazon-search-e10s**
28414        - ❌
28415        - ❌
28416        - ❌
28417        - ❌
28418      * - **browsertime-tp6m-live-chrome-m-amazon-search-e10s**
28419        - ❌
28420        - ❌
28421        - ❌
28422        - ❌
28423      * - **browsertime-tp6m-live-fenix-amazon-search-e10s**
28424        - ❌
28425        - ❌
28426        - ❌
28427        - ❌
28428      * - **browsertime-tp6m-live-geckoview-amazon-search-e10s**
28429        - ❌
28430        - ❌
28431        - ❌
28432        - ❌
28433
28434
28435   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
28436      :widths: 30 15 15 15 15
28437      :header-rows: 1
28438
28439      * - **Test Name**
28440        - mozilla-central
28441        - autoland
28442        - mozilla-release
28443        - mozilla-beta
28444      * - **browsertime-tp6m-essential-fenix-amazon-search-e10s**
28445        - ❌
28446        - ❌
28447        - ❌
28448        - ❌
28449      * - **browsertime-tp6m-essential-geckoview-amazon-search-e10s**
28450        - ❌
28451        - ❌
28452        - ❌
28453        - ❌
28454      * - **browsertime-tp6m-essential-refbrow-amazon-search-e10s**
28455        - ❌
28456        - ❌
28457        - ❌
28458        - ❌
28459      * - **browsertime-tp6m-live-fenix-amazon-search-e10s**
28460        - ❌
28461        - ❌
28462        - ❌
28463        - ❌
28464      * - **browsertime-tp6m-live-geckoview-amazon-search-e10s**
28465        - ❌
28466        - ❌
28467        - ❌
28468        - ❌
28469
28470
28471   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
28472      :widths: 30 15 15 15 15
28473      :header-rows: 1
28474
28475      * - **Test Name**
28476        - mozilla-central
28477        - autoland
28478        - mozilla-release
28479        - mozilla-beta
28480      * - **browsertime-tp6m-essential-chrome-m-amazon-search-e10s**
28481        - ❌
28482        - ❌
28483        - ❌
28484        - ❌
28485      * - **browsertime-tp6m-essential-fenix-amazon-search-e10s**
28486        - ❌
28487        - ❌
28488        - ❌
28489        - ❌
28490      * - **browsertime-tp6m-essential-geckoview-amazon-search-e10s**
28491        - ❌
28492        - ❌
28493        - ❌
28494        - ❌
28495      * - **browsertime-tp6m-essential-refbrow-amazon-search-e10s**
28496        - ❌
28497        - ❌
28498        - ❌
28499        - ❌
28500      * - **browsertime-tp6m-live-chrome-m-amazon-search-e10s**
28501        - ❌
28502        - ❌
28503        - ❌
28504        - ❌
28505      * - **browsertime-tp6m-live-fenix-amazon-search-e10s**
28506        - ❌
28507        - ❌
28508        - ❌
28509        - ❌
28510      * - **browsertime-tp6m-live-geckoview-amazon-search-e10s**
28511        - ❌
28512        - ❌
28513        - ❌
28514        - ❌
28515
28516
28517   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
28518      :widths: 30 15 15 15 15
28519      :header-rows: 1
28520
28521      * - **Test Name**
28522        - mozilla-central
28523        - autoland
28524        - mozilla-release
28525        - mozilla-beta
28526      * - **browsertime-tp6m-essential-fenix-amazon-search-e10s**
28527        - ❌
28528        - ❌
28529        - ❌
28530        - ❌
28531      * - **browsertime-tp6m-essential-geckoview-amazon-search-e10s**
28532        - ❌
28533        - ❌
28534        - ❌
28535        - ❌
28536      * - **browsertime-tp6m-essential-refbrow-amazon-search-e10s**
28537        - ❌
28538        - ❌
28539        - ❌
28540        - ❌
28541      * - **browsertime-tp6m-live-fenix-amazon-search-e10s**
28542        - ❌
28543        - ❌
28544        - ❌
28545        - ❌
28546      * - **browsertime-tp6m-live-geckoview-amazon-search-e10s**
28547        - ❌
28548        - ❌
28549        - ❌
28550        - ❌
28551
28552
28553   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
28554      :widths: 30 15 15 15 15
28555      :header-rows: 1
28556
28557      * - **Test Name**
28558        - mozilla-central
28559        - autoland
28560        - mozilla-release
28561        - mozilla-beta
28562      * - **browsertime-tp6m-essential-chrome-m-amazon-search-e10s**
28563        - ❌
28564        - ❌
28565        - ❌
28566        - ❌
28567      * - **browsertime-tp6m-essential-fenix-amazon-search-e10s**
28568        - ❌
28569        - ❌
28570        - ❌
28571        - ❌
28572      * - **browsertime-tp6m-essential-geckoview-amazon-search-e10s**
28573        - ❌
28574        - ❌
28575        - ❌
28576        - ❌
28577      * - **browsertime-tp6m-essential-refbrow-amazon-search-e10s**
28578        - ❌
28579        - ❌
28580        - ❌
28581        - ❌
28582      * - **browsertime-tp6m-live-chrome-m-amazon-search-e10s**
28583        - ❌
28584        - ❌
28585        - ❌
28586        - ❌
28587      * - **browsertime-tp6m-live-fenix-amazon-search-e10s**
28588        - ❌
28589        - ❌
28590        - ❌
28591        - ❌
28592      * - **browsertime-tp6m-live-geckoview-amazon-search-e10s**
28593        - ❌
28594        - ❌
28595        - ❌
28596        - ❌
28597
28598
28599
28600.. dropdown:: bing
28601   :container: + anchor-id-bing-m
28602
28603   **Owner**: PerfTest Team
28604
28605   * **alert on**: fcp, loadtime
28606   * **alert threshold**: 2.0
28607   * **apps**: geckoview, fenix, refbrow, chrome-m
28608   * **browser cycles**: 15
28609   * **expected**: pass
28610   * **lower is better**: true
28611   * **page cycles**: 25
28612   * **page timeout**: 60000
28613   * **playback**: mitmproxy-android
28614   * **playback pageset manifest**: mitm6-android-fenix-bing.manifest
28615   * **playback version**: 6.0.2
28616   * **test url**: `<https://www.bing.com/>`__
28617   * **type**: pageload
28618   * **unit**: ms
28619   * **use live sites**: false
28620   * **Test Task**:
28621
28622   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
28623      :widths: 30 15 15 15 15
28624      :header-rows: 1
28625
28626      * - **Test Name**
28627        - mozilla-central
28628        - autoland
28629        - mozilla-release
28630        - mozilla-beta
28631      * - **browsertime-tp6m-fenix-bing-e10s**
28632        - ❌
28633        - ❌
28634        - ❌
28635        - ❌
28636      * - **browsertime-tp6m-geckoview-bing-e10s**
28637        - ❌
28638        - ❌
28639        - ❌
28640        - ❌
28641      * - **browsertime-tp6m-live-fenix-bing-e10s**
28642        - ❌
28643        - ❌
28644        - ❌
28645        - ❌
28646      * - **browsertime-tp6m-live-geckoview-bing-e10s**
28647        - ❌
28648        - ❌
28649        - ❌
28650        - ❌
28651      * - **browsertime-tp6m-refbrow-bing-e10s**
28652        - ❌
28653        - ❌
28654        - ❌
28655        - ❌
28656
28657
28658   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
28659      :widths: 30 15 15 15 15
28660      :header-rows: 1
28661
28662      * - **Test Name**
28663        - mozilla-central
28664        - autoland
28665        - mozilla-release
28666        - mozilla-beta
28667      * - **browsertime-tp6m-chrome-m-bing-e10s**
28668        - ❌
28669        - ❌
28670        - ❌
28671        - ❌
28672      * - **browsertime-tp6m-fenix-bing-e10s**
28673        - ❌
28674        - ❌
28675        - ❌
28676        - ❌
28677      * - **browsertime-tp6m-geckoview-bing-e10s**
28678        - ✅
28679        - ✅
28680        - ✅
28681        - ✅
28682      * - **browsertime-tp6m-live-chrome-m-bing-e10s**
28683        - ❌
28684        - ❌
28685        - ❌
28686        - ❌
28687      * - **browsertime-tp6m-live-fenix-bing-e10s**
28688        - ❌
28689        - ❌
28690        - ❌
28691        - ❌
28692      * - **browsertime-tp6m-live-geckoview-bing-e10s**
28693        - ❌
28694        - ❌
28695        - ❌
28696        - ❌
28697      * - **browsertime-tp6m-refbrow-bing-e10s**
28698        - ❌
28699        - ❌
28700        - ❌
28701        - ❌
28702
28703
28704   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
28705      :widths: 30 15 15 15 15
28706      :header-rows: 1
28707
28708      * - **Test Name**
28709        - mozilla-central
28710        - autoland
28711        - mozilla-release
28712        - mozilla-beta
28713      * - **browsertime-tp6m-fenix-bing-e10s**
28714        - ❌
28715        - ❌
28716        - ❌
28717        - ❌
28718      * - **browsertime-tp6m-geckoview-bing-e10s**
28719        - ❌
28720        - ❌
28721        - ❌
28722        - ❌
28723      * - **browsertime-tp6m-live-fenix-bing-e10s**
28724        - ❌
28725        - ❌
28726        - ❌
28727        - ❌
28728      * - **browsertime-tp6m-live-geckoview-bing-e10s**
28729        - ❌
28730        - ❌
28731        - ❌
28732        - ❌
28733      * - **browsertime-tp6m-refbrow-bing-e10s**
28734        - ❌
28735        - ❌
28736        - ❌
28737        - ❌
28738
28739
28740   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
28741      :widths: 30 15 15 15 15
28742      :header-rows: 1
28743
28744      * - **Test Name**
28745        - mozilla-central
28746        - autoland
28747        - mozilla-release
28748        - mozilla-beta
28749      * - **browsertime-tp6m-chrome-m-bing-e10s**
28750        - ❌
28751        - ❌
28752        - ❌
28753        - ❌
28754      * - **browsertime-tp6m-fenix-bing-e10s**
28755        - ❌
28756        - ❌
28757        - ❌
28758        - ❌
28759      * - **browsertime-tp6m-geckoview-bing-e10s**
28760        - ✅
28761        - ✅
28762        - ✅
28763        - ✅
28764      * - **browsertime-tp6m-live-chrome-m-bing-e10s**
28765        - ❌
28766        - ❌
28767        - ❌
28768        - ❌
28769      * - **browsertime-tp6m-live-fenix-bing-e10s**
28770        - ❌
28771        - ❌
28772        - ❌
28773        - ❌
28774      * - **browsertime-tp6m-live-geckoview-bing-e10s**
28775        - ❌
28776        - ❌
28777        - ❌
28778        - ❌
28779      * - **browsertime-tp6m-refbrow-bing-e10s**
28780        - ❌
28781        - ❌
28782        - ❌
28783        - ❌
28784
28785
28786   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
28787      :widths: 30 15 15 15 15
28788      :header-rows: 1
28789
28790      * - **Test Name**
28791        - mozilla-central
28792        - autoland
28793        - mozilla-release
28794        - mozilla-beta
28795      * - **browsertime-tp6m-fenix-bing-e10s**
28796        - ❌
28797        - ❌
28798        - ❌
28799        - ❌
28800      * - **browsertime-tp6m-geckoview-bing-e10s**
28801        - ❌
28802        - ❌
28803        - ❌
28804        - ❌
28805      * - **browsertime-tp6m-live-fenix-bing-e10s**
28806        - ❌
28807        - ❌
28808        - ❌
28809        - ❌
28810      * - **browsertime-tp6m-live-geckoview-bing-e10s**
28811        - ❌
28812        - ❌
28813        - ❌
28814        - ❌
28815      * - **browsertime-tp6m-refbrow-bing-e10s**
28816        - ❌
28817        - ❌
28818        - ❌
28819        - ❌
28820
28821
28822   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
28823      :widths: 30 15 15 15 15
28824      :header-rows: 1
28825
28826      * - **Test Name**
28827        - mozilla-central
28828        - autoland
28829        - mozilla-release
28830        - mozilla-beta
28831      * - **browsertime-tp6m-chrome-m-bing-e10s**
28832        - ❌
28833        - ❌
28834        - ❌
28835        - ❌
28836      * - **browsertime-tp6m-fenix-bing-e10s**
28837        - ❌
28838        - ❌
28839        - ❌
28840        - ❌
28841      * - **browsertime-tp6m-geckoview-bing-e10s**
28842        - ❌
28843        - ❌
28844        - ❌
28845        - ❌
28846      * - **browsertime-tp6m-live-chrome-m-bing-e10s**
28847        - ❌
28848        - ❌
28849        - ❌
28850        - ❌
28851      * - **browsertime-tp6m-live-fenix-bing-e10s**
28852        - ❌
28853        - ❌
28854        - ❌
28855        - ❌
28856      * - **browsertime-tp6m-live-geckoview-bing-e10s**
28857        - ❌
28858        - ❌
28859        - ❌
28860        - ❌
28861      * - **browsertime-tp6m-refbrow-bing-e10s**
28862        - ❌
28863        - ❌
28864        - ❌
28865        - ❌
28866
28867
28868   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
28869      :widths: 30 15 15 15 15
28870      :header-rows: 1
28871
28872      * - **Test Name**
28873        - mozilla-central
28874        - autoland
28875        - mozilla-release
28876        - mozilla-beta
28877      * - **browsertime-tp6m-fenix-bing-e10s**
28878        - ❌
28879        - ❌
28880        - ❌
28881        - ❌
28882      * - **browsertime-tp6m-geckoview-bing-e10s**
28883        - ❌
28884        - ❌
28885        - ❌
28886        - ❌
28887      * - **browsertime-tp6m-live-fenix-bing-e10s**
28888        - ❌
28889        - ❌
28890        - ❌
28891        - ❌
28892      * - **browsertime-tp6m-live-geckoview-bing-e10s**
28893        - ❌
28894        - ❌
28895        - ❌
28896        - ❌
28897      * - **browsertime-tp6m-refbrow-bing-e10s**
28898        - ❌
28899        - ❌
28900        - ❌
28901        - ❌
28902
28903
28904   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
28905      :widths: 30 15 15 15 15
28906      :header-rows: 1
28907
28908      * - **Test Name**
28909        - mozilla-central
28910        - autoland
28911        - mozilla-release
28912        - mozilla-beta
28913      * - **browsertime-tp6m-chrome-m-bing-e10s**
28914        - ❌
28915        - ❌
28916        - ❌
28917        - ❌
28918      * - **browsertime-tp6m-fenix-bing-e10s**
28919        - ❌
28920        - ❌
28921        - ❌
28922        - ❌
28923      * - **browsertime-tp6m-geckoview-bing-e10s**
28924        - ❌
28925        - ❌
28926        - ❌
28927        - ❌
28928      * - **browsertime-tp6m-live-chrome-m-bing-e10s**
28929        - ❌
28930        - ❌
28931        - ❌
28932        - ❌
28933      * - **browsertime-tp6m-live-fenix-bing-e10s**
28934        - ❌
28935        - ❌
28936        - ❌
28937        - ❌
28938      * - **browsertime-tp6m-live-geckoview-bing-e10s**
28939        - ❌
28940        - ❌
28941        - ❌
28942        - ❌
28943      * - **browsertime-tp6m-refbrow-bing-e10s**
28944        - ❌
28945        - ❌
28946        - ❌
28947        - ❌
28948
28949
28950
28951.. dropdown:: bing-search-restaurants
28952   :container: + anchor-id-bing-search-restaurants-m
28953
28954   **Owner**: PerfTest Team
28955
28956   * **alert on**: fcp, loadtime
28957   * **alert threshold**: 2.0
28958   * **apps**: geckoview, fenix, refbrow, chrome-m
28959   * **browser cycles**: 15
28960   * **expected**: pass
28961   * **lower is better**: true
28962   * **page cycles**: 25
28963   * **page timeout**: 60000
28964   * **playback**: mitmproxy-android
28965   * **playback pageset manifest**: mitm6-android-fenix-bing-search-restaurants.manifest
28966   * **playback version**: 6.0.2
28967   * **test url**: `<https://www.bing.com/search?q=restaurants+in+exton+pa+19341>`__
28968   * **type**: pageload
28969   * **unit**: ms
28970   * **use live sites**: false
28971   * **Test Task**:
28972
28973   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
28974      :widths: 30 15 15 15 15
28975      :header-rows: 1
28976
28977      * - **Test Name**
28978        - mozilla-central
28979        - autoland
28980        - mozilla-release
28981        - mozilla-beta
28982      * - **browsertime-tp6m-fenix-bing-search-restaurants-e10s**
28983        - ❌
28984        - ❌
28985        - ❌
28986        - ❌
28987      * - **browsertime-tp6m-geckoview-bing-search-restaurants-e10s**
28988        - ❌
28989        - ❌
28990        - ❌
28991        - ❌
28992      * - **browsertime-tp6m-live-fenix-bing-search-restaurants-e10s**
28993        - ❌
28994        - ❌
28995        - ❌
28996        - ❌
28997      * - **browsertime-tp6m-live-geckoview-bing-search-restaurants-e10s**
28998        - ❌
28999        - ❌
29000        - ❌
29001        - ❌
29002      * - **browsertime-tp6m-refbrow-bing-search-restaurants-e10s**
29003        - ❌
29004        - ❌
29005        - ❌
29006        - ❌
29007
29008
29009   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
29010      :widths: 30 15 15 15 15
29011      :header-rows: 1
29012
29013      * - **Test Name**
29014        - mozilla-central
29015        - autoland
29016        - mozilla-release
29017        - mozilla-beta
29018      * - **browsertime-tp6m-chrome-m-bing-search-restaurants-e10s**
29019        - ❌
29020        - ❌
29021        - ❌
29022        - ❌
29023      * - **browsertime-tp6m-fenix-bing-search-restaurants-e10s**
29024        - ❌
29025        - ❌
29026        - ❌
29027        - ❌
29028      * - **browsertime-tp6m-geckoview-bing-search-restaurants-e10s**
29029        - ✅
29030        - ✅
29031        - ✅
29032        - ✅
29033      * - **browsertime-tp6m-live-chrome-m-bing-search-restaurants-e10s**
29034        - ❌
29035        - ❌
29036        - ❌
29037        - ❌
29038      * - **browsertime-tp6m-live-fenix-bing-search-restaurants-e10s**
29039        - ❌
29040        - ❌
29041        - ❌
29042        - ❌
29043      * - **browsertime-tp6m-live-geckoview-bing-search-restaurants-e10s**
29044        - ❌
29045        - ❌
29046        - ❌
29047        - ❌
29048      * - **browsertime-tp6m-refbrow-bing-search-restaurants-e10s**
29049        - ❌
29050        - ❌
29051        - ❌
29052        - ❌
29053
29054
29055   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
29056      :widths: 30 15 15 15 15
29057      :header-rows: 1
29058
29059      * - **Test Name**
29060        - mozilla-central
29061        - autoland
29062        - mozilla-release
29063        - mozilla-beta
29064      * - **browsertime-tp6m-fenix-bing-search-restaurants-e10s**
29065        - ❌
29066        - ❌
29067        - ❌
29068        - ❌
29069      * - **browsertime-tp6m-geckoview-bing-search-restaurants-e10s**
29070        - ❌
29071        - ❌
29072        - ❌
29073        - ❌
29074      * - **browsertime-tp6m-live-fenix-bing-search-restaurants-e10s**
29075        - ❌
29076        - ❌
29077        - ❌
29078        - ❌
29079      * - **browsertime-tp6m-live-geckoview-bing-search-restaurants-e10s**
29080        - ❌
29081        - ❌
29082        - ❌
29083        - ❌
29084      * - **browsertime-tp6m-refbrow-bing-search-restaurants-e10s**
29085        - ❌
29086        - ❌
29087        - ❌
29088        - ❌
29089
29090
29091   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
29092      :widths: 30 15 15 15 15
29093      :header-rows: 1
29094
29095      * - **Test Name**
29096        - mozilla-central
29097        - autoland
29098        - mozilla-release
29099        - mozilla-beta
29100      * - **browsertime-tp6m-chrome-m-bing-search-restaurants-e10s**
29101        - ❌
29102        - ❌
29103        - ❌
29104        - ❌
29105      * - **browsertime-tp6m-fenix-bing-search-restaurants-e10s**
29106        - ❌
29107        - ❌
29108        - ❌
29109        - ❌
29110      * - **browsertime-tp6m-geckoview-bing-search-restaurants-e10s**
29111        - ✅
29112        - ✅
29113        - ✅
29114        - ✅
29115      * - **browsertime-tp6m-live-chrome-m-bing-search-restaurants-e10s**
29116        - ❌
29117        - ❌
29118        - ❌
29119        - ❌
29120      * - **browsertime-tp6m-live-fenix-bing-search-restaurants-e10s**
29121        - ❌
29122        - ❌
29123        - ❌
29124        - ❌
29125      * - **browsertime-tp6m-live-geckoview-bing-search-restaurants-e10s**
29126        - ❌
29127        - ❌
29128        - ❌
29129        - ❌
29130      * - **browsertime-tp6m-refbrow-bing-search-restaurants-e10s**
29131        - ❌
29132        - ❌
29133        - ❌
29134        - ❌
29135
29136
29137   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
29138      :widths: 30 15 15 15 15
29139      :header-rows: 1
29140
29141      * - **Test Name**
29142        - mozilla-central
29143        - autoland
29144        - mozilla-release
29145        - mozilla-beta
29146      * - **browsertime-tp6m-fenix-bing-search-restaurants-e10s**
29147        - ❌
29148        - ❌
29149        - ❌
29150        - ❌
29151      * - **browsertime-tp6m-geckoview-bing-search-restaurants-e10s**
29152        - ❌
29153        - ❌
29154        - ❌
29155        - ❌
29156      * - **browsertime-tp6m-live-fenix-bing-search-restaurants-e10s**
29157        - ❌
29158        - ❌
29159        - ❌
29160        - ❌
29161      * - **browsertime-tp6m-live-geckoview-bing-search-restaurants-e10s**
29162        - ❌
29163        - ❌
29164        - ❌
29165        - ❌
29166      * - **browsertime-tp6m-refbrow-bing-search-restaurants-e10s**
29167        - ❌
29168        - ❌
29169        - ❌
29170        - ❌
29171
29172
29173   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
29174      :widths: 30 15 15 15 15
29175      :header-rows: 1
29176
29177      * - **Test Name**
29178        - mozilla-central
29179        - autoland
29180        - mozilla-release
29181        - mozilla-beta
29182      * - **browsertime-tp6m-chrome-m-bing-search-restaurants-e10s**
29183        - ❌
29184        - ❌
29185        - ❌
29186        - ❌
29187      * - **browsertime-tp6m-fenix-bing-search-restaurants-e10s**
29188        - ❌
29189        - ❌
29190        - ❌
29191        - ❌
29192      * - **browsertime-tp6m-geckoview-bing-search-restaurants-e10s**
29193        - ❌
29194        - ❌
29195        - ❌
29196        - ❌
29197      * - **browsertime-tp6m-live-chrome-m-bing-search-restaurants-e10s**
29198        - ❌
29199        - ❌
29200        - ❌
29201        - ❌
29202      * - **browsertime-tp6m-live-fenix-bing-search-restaurants-e10s**
29203        - ❌
29204        - ❌
29205        - ❌
29206        - ❌
29207      * - **browsertime-tp6m-live-geckoview-bing-search-restaurants-e10s**
29208        - ❌
29209        - ❌
29210        - ❌
29211        - ❌
29212      * - **browsertime-tp6m-refbrow-bing-search-restaurants-e10s**
29213        - ❌
29214        - ❌
29215        - ❌
29216        - ❌
29217
29218
29219   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
29220      :widths: 30 15 15 15 15
29221      :header-rows: 1
29222
29223      * - **Test Name**
29224        - mozilla-central
29225        - autoland
29226        - mozilla-release
29227        - mozilla-beta
29228      * - **browsertime-tp6m-fenix-bing-search-restaurants-e10s**
29229        - ❌
29230        - ❌
29231        - ❌
29232        - ❌
29233      * - **browsertime-tp6m-geckoview-bing-search-restaurants-e10s**
29234        - ❌
29235        - ❌
29236        - ❌
29237        - ❌
29238      * - **browsertime-tp6m-live-fenix-bing-search-restaurants-e10s**
29239        - ❌
29240        - ❌
29241        - ❌
29242        - ❌
29243      * - **browsertime-tp6m-live-geckoview-bing-search-restaurants-e10s**
29244        - ❌
29245        - ❌
29246        - ❌
29247        - ❌
29248      * - **browsertime-tp6m-refbrow-bing-search-restaurants-e10s**
29249        - ❌
29250        - ❌
29251        - ❌
29252        - ❌
29253
29254
29255   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
29256      :widths: 30 15 15 15 15
29257      :header-rows: 1
29258
29259      * - **Test Name**
29260        - mozilla-central
29261        - autoland
29262        - mozilla-release
29263        - mozilla-beta
29264      * - **browsertime-tp6m-chrome-m-bing-search-restaurants-e10s**
29265        - ❌
29266        - ❌
29267        - ❌
29268        - ❌
29269      * - **browsertime-tp6m-fenix-bing-search-restaurants-e10s**
29270        - ❌
29271        - ❌
29272        - ❌
29273        - ❌
29274      * - **browsertime-tp6m-geckoview-bing-search-restaurants-e10s**
29275        - ❌
29276        - ❌
29277        - ❌
29278        - ❌
29279      * - **browsertime-tp6m-live-chrome-m-bing-search-restaurants-e10s**
29280        - ❌
29281        - ❌
29282        - ❌
29283        - ❌
29284      * - **browsertime-tp6m-live-fenix-bing-search-restaurants-e10s**
29285        - ❌
29286        - ❌
29287        - ❌
29288        - ❌
29289      * - **browsertime-tp6m-live-geckoview-bing-search-restaurants-e10s**
29290        - ❌
29291        - ❌
29292        - ❌
29293        - ❌
29294      * - **browsertime-tp6m-refbrow-bing-search-restaurants-e10s**
29295        - ❌
29296        - ❌
29297        - ❌
29298        - ❌
29299
29300
29301
29302.. dropdown:: booking
29303   :container: + anchor-id-booking-m
29304
29305   **Owner**: PerfTest Team
29306
29307   * **alert on**: fcp, loadtime
29308   * **alert threshold**: 2.0
29309   * **apps**: geckoview, fenix, refbrow, chrome-m
29310   * **browser cycles**: 15
29311   * **expected**: pass
29312   * **lower is better**: true
29313   * **page cycles**: 25
29314   * **page timeout**: 60000
29315   * **playback**: mitmproxy-android
29316   * **playback pageset manifest**: mitm6-android-fenix-booking.manifest
29317   * **playback version**: 6.0.2
29318   * **test url**: `<https://www.booking.com/>`__
29319   * **type**: pageload
29320   * **unit**: ms
29321   * **use live sites**: false
29322   * **Test Task**:
29323
29324   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
29325      :widths: 30 15 15 15 15
29326      :header-rows: 1
29327
29328      * - **Test Name**
29329        - mozilla-central
29330        - autoland
29331        - mozilla-release
29332        - mozilla-beta
29333      * - **browsertime-tp6m-fenix-booking-e10s**
29334        - ❌
29335        - ❌
29336        - ❌
29337        - ❌
29338      * - **browsertime-tp6m-geckoview-booking-e10s**
29339        - ❌
29340        - ❌
29341        - ❌
29342        - ❌
29343      * - **browsertime-tp6m-live-fenix-booking-e10s**
29344        - ❌
29345        - ❌
29346        - ❌
29347        - ❌
29348      * - **browsertime-tp6m-live-geckoview-booking-e10s**
29349        - ❌
29350        - ❌
29351        - ❌
29352        - ❌
29353      * - **browsertime-tp6m-refbrow-booking-e10s**
29354        - ❌
29355        - ❌
29356        - ❌
29357        - ❌
29358
29359
29360   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
29361      :widths: 30 15 15 15 15
29362      :header-rows: 1
29363
29364      * - **Test Name**
29365        - mozilla-central
29366        - autoland
29367        - mozilla-release
29368        - mozilla-beta
29369      * - **browsertime-tp6m-chrome-m-booking-e10s**
29370        - ❌
29371        - ❌
29372        - ❌
29373        - ❌
29374      * - **browsertime-tp6m-fenix-booking-e10s**
29375        - ❌
29376        - ❌
29377        - ❌
29378        - ❌
29379      * - **browsertime-tp6m-geckoview-booking-e10s**
29380        - ✅
29381        - ✅
29382        - ✅
29383        - ✅
29384      * - **browsertime-tp6m-live-chrome-m-booking-e10s**
29385        - ❌
29386        - ❌
29387        - ❌
29388        - ❌
29389      * - **browsertime-tp6m-live-fenix-booking-e10s**
29390        - ❌
29391        - ❌
29392        - ❌
29393        - ❌
29394      * - **browsertime-tp6m-live-geckoview-booking-e10s**
29395        - ❌
29396        - ❌
29397        - ❌
29398        - ❌
29399      * - **browsertime-tp6m-refbrow-booking-e10s**
29400        - ❌
29401        - ❌
29402        - ❌
29403        - ❌
29404
29405
29406   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
29407      :widths: 30 15 15 15 15
29408      :header-rows: 1
29409
29410      * - **Test Name**
29411        - mozilla-central
29412        - autoland
29413        - mozilla-release
29414        - mozilla-beta
29415      * - **browsertime-tp6m-fenix-booking-e10s**
29416        - ❌
29417        - ❌
29418        - ❌
29419        - ❌
29420      * - **browsertime-tp6m-geckoview-booking-e10s**
29421        - ❌
29422        - ❌
29423        - ❌
29424        - ❌
29425      * - **browsertime-tp6m-live-fenix-booking-e10s**
29426        - ❌
29427        - ❌
29428        - ❌
29429        - ❌
29430      * - **browsertime-tp6m-live-geckoview-booking-e10s**
29431        - ❌
29432        - ❌
29433        - ❌
29434        - ❌
29435      * - **browsertime-tp6m-refbrow-booking-e10s**
29436        - ❌
29437        - ❌
29438        - ❌
29439        - ❌
29440
29441
29442   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
29443      :widths: 30 15 15 15 15
29444      :header-rows: 1
29445
29446      * - **Test Name**
29447        - mozilla-central
29448        - autoland
29449        - mozilla-release
29450        - mozilla-beta
29451      * - **browsertime-tp6m-chrome-m-booking-e10s**
29452        - ❌
29453        - ❌
29454        - ❌
29455        - ❌
29456      * - **browsertime-tp6m-fenix-booking-e10s**
29457        - ❌
29458        - ❌
29459        - ❌
29460        - ❌
29461      * - **browsertime-tp6m-geckoview-booking-e10s**
29462        - ✅
29463        - ✅
29464        - ✅
29465        - ✅
29466      * - **browsertime-tp6m-live-chrome-m-booking-e10s**
29467        - ❌
29468        - ❌
29469        - ❌
29470        - ❌
29471      * - **browsertime-tp6m-live-fenix-booking-e10s**
29472        - ❌
29473        - ❌
29474        - ❌
29475        - ❌
29476      * - **browsertime-tp6m-live-geckoview-booking-e10s**
29477        - ❌
29478        - ❌
29479        - ❌
29480        - ❌
29481      * - **browsertime-tp6m-refbrow-booking-e10s**
29482        - ❌
29483        - ❌
29484        - ❌
29485        - ❌
29486
29487
29488   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
29489      :widths: 30 15 15 15 15
29490      :header-rows: 1
29491
29492      * - **Test Name**
29493        - mozilla-central
29494        - autoland
29495        - mozilla-release
29496        - mozilla-beta
29497      * - **browsertime-tp6m-fenix-booking-e10s**
29498        - ❌
29499        - ❌
29500        - ❌
29501        - ❌
29502      * - **browsertime-tp6m-geckoview-booking-e10s**
29503        - ❌
29504        - ❌
29505        - ❌
29506        - ❌
29507      * - **browsertime-tp6m-live-fenix-booking-e10s**
29508        - ❌
29509        - ❌
29510        - ❌
29511        - ❌
29512      * - **browsertime-tp6m-live-geckoview-booking-e10s**
29513        - ❌
29514        - ❌
29515        - ❌
29516        - ❌
29517      * - **browsertime-tp6m-refbrow-booking-e10s**
29518        - ❌
29519        - ❌
29520        - ❌
29521        - ❌
29522
29523
29524   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
29525      :widths: 30 15 15 15 15
29526      :header-rows: 1
29527
29528      * - **Test Name**
29529        - mozilla-central
29530        - autoland
29531        - mozilla-release
29532        - mozilla-beta
29533      * - **browsertime-tp6m-chrome-m-booking-e10s**
29534        - ❌
29535        - ❌
29536        - ❌
29537        - ❌
29538      * - **browsertime-tp6m-fenix-booking-e10s**
29539        - ❌
29540        - ❌
29541        - ❌
29542        - ❌
29543      * - **browsertime-tp6m-geckoview-booking-e10s**
29544        - ❌
29545        - ❌
29546        - ❌
29547        - ❌
29548      * - **browsertime-tp6m-live-chrome-m-booking-e10s**
29549        - ❌
29550        - ❌
29551        - ❌
29552        - ❌
29553      * - **browsertime-tp6m-live-fenix-booking-e10s**
29554        - ❌
29555        - ❌
29556        - ❌
29557        - ❌
29558      * - **browsertime-tp6m-live-geckoview-booking-e10s**
29559        - ❌
29560        - ❌
29561        - ❌
29562        - ❌
29563      * - **browsertime-tp6m-refbrow-booking-e10s**
29564        - ❌
29565        - ❌
29566        - ❌
29567        - ❌
29568
29569
29570   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
29571      :widths: 30 15 15 15 15
29572      :header-rows: 1
29573
29574      * - **Test Name**
29575        - mozilla-central
29576        - autoland
29577        - mozilla-release
29578        - mozilla-beta
29579      * - **browsertime-tp6m-fenix-booking-e10s**
29580        - ❌
29581        - ❌
29582        - ❌
29583        - ❌
29584      * - **browsertime-tp6m-geckoview-booking-e10s**
29585        - ❌
29586        - ❌
29587        - ❌
29588        - ❌
29589      * - **browsertime-tp6m-live-fenix-booking-e10s**
29590        - ❌
29591        - ❌
29592        - ❌
29593        - ❌
29594      * - **browsertime-tp6m-live-geckoview-booking-e10s**
29595        - ❌
29596        - ❌
29597        - ❌
29598        - ❌
29599      * - **browsertime-tp6m-refbrow-booking-e10s**
29600        - ❌
29601        - ❌
29602        - ❌
29603        - ❌
29604
29605
29606   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
29607      :widths: 30 15 15 15 15
29608      :header-rows: 1
29609
29610      * - **Test Name**
29611        - mozilla-central
29612        - autoland
29613        - mozilla-release
29614        - mozilla-beta
29615      * - **browsertime-tp6m-chrome-m-booking-e10s**
29616        - ❌
29617        - ❌
29618        - ❌
29619        - ❌
29620      * - **browsertime-tp6m-fenix-booking-e10s**
29621        - ❌
29622        - ❌
29623        - ❌
29624        - ❌
29625      * - **browsertime-tp6m-geckoview-booking-e10s**
29626        - ❌
29627        - ❌
29628        - ❌
29629        - ❌
29630      * - **browsertime-tp6m-live-chrome-m-booking-e10s**
29631        - ❌
29632        - ❌
29633        - ❌
29634        - ❌
29635      * - **browsertime-tp6m-live-fenix-booking-e10s**
29636        - ❌
29637        - ❌
29638        - ❌
29639        - ❌
29640      * - **browsertime-tp6m-live-geckoview-booking-e10s**
29641        - ❌
29642        - ❌
29643        - ❌
29644        - ❌
29645      * - **browsertime-tp6m-refbrow-booking-e10s**
29646        - ❌
29647        - ❌
29648        - ❌
29649        - ❌
29650
29651
29652
29653.. dropdown:: cnn
29654   :container: + anchor-id-cnn-m
29655
29656   **Owner**: PerfTest Team
29657
29658   * **alert on**: fcp, loadtime
29659   * **alert threshold**: 2.0
29660   * **apps**: geckoview, fenix, refbrow, chrome-m
29661   * **browser cycles**: 15
29662   * **expected**: pass
29663   * **lower is better**: true
29664   * **page cycles**: 25
29665   * **page timeout**: 60000
29666   * **playback**: mitmproxy-android
29667   * **playback pageset manifest**: mitm6-android-fenix-cnn.manifest
29668   * **playback version**: 6.0.2
29669   * **test url**: `<https://cnn.com>`__
29670   * **type**: pageload
29671   * **unit**: ms
29672   * **use live sites**: false
29673   * **Test Task**:
29674
29675   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
29676      :widths: 30 15 15 15 15
29677      :header-rows: 1
29678
29679      * - **Test Name**
29680        - mozilla-central
29681        - autoland
29682        - mozilla-release
29683        - mozilla-beta
29684      * - **browsertime-tp6m-fenix-cnn-e10s**
29685        - ❌
29686        - ❌
29687        - ❌
29688        - ❌
29689      * - **browsertime-tp6m-geckoview-cnn-e10s**
29690        - ❌
29691        - ❌
29692        - ❌
29693        - ❌
29694      * - **browsertime-tp6m-live-fenix-cnn-e10s**
29695        - ❌
29696        - ❌
29697        - ❌
29698        - ❌
29699      * - **browsertime-tp6m-live-geckoview-cnn-e10s**
29700        - ❌
29701        - ❌
29702        - ❌
29703        - ❌
29704      * - **browsertime-tp6m-refbrow-cnn-e10s**
29705        - ❌
29706        - ❌
29707        - ❌
29708        - ❌
29709
29710
29711   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
29712      :widths: 30 15 15 15 15
29713      :header-rows: 1
29714
29715      * - **Test Name**
29716        - mozilla-central
29717        - autoland
29718        - mozilla-release
29719        - mozilla-beta
29720      * - **browsertime-tp6m-chrome-m-cnn-e10s**
29721        - ❌
29722        - ❌
29723        - ❌
29724        - ❌
29725      * - **browsertime-tp6m-fenix-cnn-e10s**
29726        - ❌
29727        - ❌
29728        - ❌
29729        - ❌
29730      * - **browsertime-tp6m-geckoview-cnn-e10s**
29731        - ✅
29732        - ✅
29733        - ✅
29734        - ✅
29735      * - **browsertime-tp6m-live-chrome-m-cnn-e10s**
29736        - ❌
29737        - ❌
29738        - ❌
29739        - ❌
29740      * - **browsertime-tp6m-live-fenix-cnn-e10s**
29741        - ❌
29742        - ❌
29743        - ❌
29744        - ❌
29745      * - **browsertime-tp6m-live-geckoview-cnn-e10s**
29746        - ❌
29747        - ❌
29748        - ❌
29749        - ❌
29750      * - **browsertime-tp6m-refbrow-cnn-e10s**
29751        - ❌
29752        - ❌
29753        - ❌
29754        - ❌
29755
29756
29757   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
29758      :widths: 30 15 15 15 15
29759      :header-rows: 1
29760
29761      * - **Test Name**
29762        - mozilla-central
29763        - autoland
29764        - mozilla-release
29765        - mozilla-beta
29766      * - **browsertime-tp6m-fenix-cnn-e10s**
29767        - ❌
29768        - ❌
29769        - ❌
29770        - ❌
29771      * - **browsertime-tp6m-geckoview-cnn-e10s**
29772        - ❌
29773        - ❌
29774        - ❌
29775        - ❌
29776      * - **browsertime-tp6m-live-fenix-cnn-e10s**
29777        - ❌
29778        - ❌
29779        - ❌
29780        - ❌
29781      * - **browsertime-tp6m-live-geckoview-cnn-e10s**
29782        - ❌
29783        - ❌
29784        - ❌
29785        - ❌
29786      * - **browsertime-tp6m-refbrow-cnn-e10s**
29787        - ❌
29788        - ❌
29789        - ❌
29790        - ❌
29791
29792
29793   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
29794      :widths: 30 15 15 15 15
29795      :header-rows: 1
29796
29797      * - **Test Name**
29798        - mozilla-central
29799        - autoland
29800        - mozilla-release
29801        - mozilla-beta
29802      * - **browsertime-tp6m-chrome-m-cnn-e10s**
29803        - ❌
29804        - ❌
29805        - ❌
29806        - ❌
29807      * - **browsertime-tp6m-fenix-cnn-e10s**
29808        - ❌
29809        - ❌
29810        - ❌
29811        - ❌
29812      * - **browsertime-tp6m-geckoview-cnn-e10s**
29813        - ✅
29814        - ✅
29815        - ✅
29816        - ✅
29817      * - **browsertime-tp6m-live-chrome-m-cnn-e10s**
29818        - ❌
29819        - ❌
29820        - ❌
29821        - ❌
29822      * - **browsertime-tp6m-live-fenix-cnn-e10s**
29823        - ❌
29824        - ❌
29825        - ❌
29826        - ❌
29827      * - **browsertime-tp6m-live-geckoview-cnn-e10s**
29828        - ❌
29829        - ❌
29830        - ❌
29831        - ❌
29832      * - **browsertime-tp6m-refbrow-cnn-e10s**
29833        - ❌
29834        - ❌
29835        - ❌
29836        - ❌
29837
29838
29839   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
29840      :widths: 30 15 15 15 15
29841      :header-rows: 1
29842
29843      * - **Test Name**
29844        - mozilla-central
29845        - autoland
29846        - mozilla-release
29847        - mozilla-beta
29848      * - **browsertime-tp6m-fenix-cnn-e10s**
29849        - ❌
29850        - ❌
29851        - ❌
29852        - ❌
29853      * - **browsertime-tp6m-geckoview-cnn-e10s**
29854        - ❌
29855        - ❌
29856        - ❌
29857        - ❌
29858      * - **browsertime-tp6m-live-fenix-cnn-e10s**
29859        - ❌
29860        - ❌
29861        - ❌
29862        - ❌
29863      * - **browsertime-tp6m-live-geckoview-cnn-e10s**
29864        - ❌
29865        - ❌
29866        - ❌
29867        - ❌
29868      * - **browsertime-tp6m-refbrow-cnn-e10s**
29869        - ❌
29870        - ❌
29871        - ❌
29872        - ❌
29873
29874
29875   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
29876      :widths: 30 15 15 15 15
29877      :header-rows: 1
29878
29879      * - **Test Name**
29880        - mozilla-central
29881        - autoland
29882        - mozilla-release
29883        - mozilla-beta
29884      * - **browsertime-tp6m-chrome-m-cnn-e10s**
29885        - ❌
29886        - ❌
29887        - ❌
29888        - ❌
29889      * - **browsertime-tp6m-fenix-cnn-e10s**
29890        - ❌
29891        - ❌
29892        - ❌
29893        - ❌
29894      * - **browsertime-tp6m-geckoview-cnn-e10s**
29895        - ❌
29896        - ❌
29897        - ❌
29898        - ❌
29899      * - **browsertime-tp6m-live-chrome-m-cnn-e10s**
29900        - ❌
29901        - ❌
29902        - ❌
29903        - ❌
29904      * - **browsertime-tp6m-live-fenix-cnn-e10s**
29905        - ❌
29906        - ❌
29907        - ❌
29908        - ❌
29909      * - **browsertime-tp6m-live-geckoview-cnn-e10s**
29910        - ❌
29911        - ❌
29912        - ❌
29913        - ❌
29914      * - **browsertime-tp6m-refbrow-cnn-e10s**
29915        - ❌
29916        - ❌
29917        - ❌
29918        - ❌
29919
29920
29921   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
29922      :widths: 30 15 15 15 15
29923      :header-rows: 1
29924
29925      * - **Test Name**
29926        - mozilla-central
29927        - autoland
29928        - mozilla-release
29929        - mozilla-beta
29930      * - **browsertime-tp6m-fenix-cnn-e10s**
29931        - ❌
29932        - ❌
29933        - ❌
29934        - ❌
29935      * - **browsertime-tp6m-geckoview-cnn-e10s**
29936        - ❌
29937        - ❌
29938        - ❌
29939        - ❌
29940      * - **browsertime-tp6m-live-fenix-cnn-e10s**
29941        - ❌
29942        - ❌
29943        - ❌
29944        - ❌
29945      * - **browsertime-tp6m-live-geckoview-cnn-e10s**
29946        - ❌
29947        - ❌
29948        - ❌
29949        - ❌
29950      * - **browsertime-tp6m-refbrow-cnn-e10s**
29951        - ❌
29952        - ❌
29953        - ❌
29954        - ❌
29955
29956
29957   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
29958      :widths: 30 15 15 15 15
29959      :header-rows: 1
29960
29961      * - **Test Name**
29962        - mozilla-central
29963        - autoland
29964        - mozilla-release
29965        - mozilla-beta
29966      * - **browsertime-tp6m-chrome-m-cnn-e10s**
29967        - ❌
29968        - ❌
29969        - ❌
29970        - ❌
29971      * - **browsertime-tp6m-fenix-cnn-e10s**
29972        - ❌
29973        - ❌
29974        - ❌
29975        - ❌
29976      * - **browsertime-tp6m-geckoview-cnn-e10s**
29977        - ❌
29978        - ❌
29979        - ❌
29980        - ❌
29981      * - **browsertime-tp6m-live-chrome-m-cnn-e10s**
29982        - ❌
29983        - ❌
29984        - ❌
29985        - ❌
29986      * - **browsertime-tp6m-live-fenix-cnn-e10s**
29987        - ❌
29988        - ❌
29989        - ❌
29990        - ❌
29991      * - **browsertime-tp6m-live-geckoview-cnn-e10s**
29992        - ❌
29993        - ❌
29994        - ❌
29995        - ❌
29996      * - **browsertime-tp6m-refbrow-cnn-e10s**
29997        - ❌
29998        - ❌
29999        - ❌
30000        - ❌
30001
30002
30003   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
30004      :widths: 30 15 15 15 15
30005      :header-rows: 1
30006
30007      * - **Test Name**
30008        - mozilla-central
30009        - autoland
30010        - mozilla-release
30011        - mozilla-beta
30012      * - **browsertime-tp6-essential-firefox-cnn-e10s**
30013        - ❌
30014        - ❌
30015        - ❌
30016        - ❌
30017      * - **browsertime-tp6-essential-firefox-cnn-fis-e10s**
30018        - ❌
30019        - ❌
30020        - ❌
30021        - ❌
30022      * - **browsertime-tp6-live-sheriffed-firefox-cnn-e10s**
30023        - ❌
30024        - ❌
30025        - ❌
30026        - ❌
30027      * - **browsertime-tp6-live-sheriffed-firefox-cnn-fis-e10s**
30028        - ❌
30029        - ❌
30030        - ❌
30031        - ❌
30032
30033
30034   .. list-table:: **test-linux1804-64-qr/opt**
30035      :widths: 30 15 15 15 15
30036      :header-rows: 1
30037
30038      * - **Test Name**
30039        - mozilla-central
30040        - autoland
30041        - mozilla-release
30042        - mozilla-beta
30043      * - **browsertime-tp6-essential-firefox-cnn-e10s**
30044        - ❌
30045        - ❌
30046        - ❌
30047        - ❌
30048      * - **browsertime-tp6-essential-firefox-cnn-fis-e10s**
30049        - ❌
30050        - ❌
30051        - ❌
30052        - ❌
30053      * - **browsertime-tp6-live-sheriffed-firefox-cnn-e10s**
30054        - ❌
30055        - ❌
30056        - ❌
30057        - ❌
30058      * - **browsertime-tp6-live-sheriffed-firefox-cnn-fis-e10s**
30059        - ❌
30060        - ❌
30061        - ❌
30062        - ❌
30063
30064
30065   .. list-table:: **test-linux1804-64-shippable-qr/opt**
30066      :widths: 30 15 15 15 15
30067      :header-rows: 1
30068
30069      * - **Test Name**
30070        - mozilla-central
30071        - autoland
30072        - mozilla-release
30073        - mozilla-beta
30074      * - **browsertime-tp6-essential-chrome-cnn-e10s**
30075        - ❌
30076        - ❌
30077        - ❌
30078        - ❌
30079      * - **browsertime-tp6-essential-chromium-cnn-e10s**
30080        - ❌
30081        - ❌
30082        - ❌
30083        - ❌
30084      * - **browsertime-tp6-essential-firefox-cnn-e10s**
30085        - ❌
30086        - ❌
30087        - ❌
30088        - ❌
30089      * - **browsertime-tp6-essential-firefox-cnn-fis-e10s**
30090        - ✅
30091        - ✅
30092        - ✅
30093        - ✅
30094      * - **browsertime-tp6-live-sheriffed-firefox-cnn-e10s**
30095        - ❌
30096        - ❌
30097        - ❌
30098        - ❌
30099      * - **browsertime-tp6-live-sheriffed-firefox-cnn-fis-e10s**
30100        - ❌
30101        - ❌
30102        - ❌
30103        - ❌
30104
30105
30106   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
30107      :widths: 30 15 15 15 15
30108      :header-rows: 1
30109
30110      * - **Test Name**
30111        - mozilla-central
30112        - autoland
30113        - mozilla-release
30114        - mozilla-beta
30115      * - **browsertime-tp6-essential-chrome-cnn-e10s**
30116        - ❌
30117        - ❌
30118        - ❌
30119        - ❌
30120      * - **browsertime-tp6-essential-chromium-cnn-e10s**
30121        - ❌
30122        - ❌
30123        - ❌
30124        - ❌
30125      * - **browsertime-tp6-essential-firefox-cnn-e10s**
30126        - ❌
30127        - ❌
30128        - ❌
30129        - ❌
30130      * - **browsertime-tp6-essential-firefox-cnn-fis-e10s**
30131        - ✅
30132        - ✅
30133        - ✅
30134        - ✅
30135      * - **browsertime-tp6-live-sheriffed-firefox-cnn-e10s**
30136        - ❌
30137        - ❌
30138        - ❌
30139        - ❌
30140      * - **browsertime-tp6-live-sheriffed-firefox-cnn-fis-e10s**
30141        - ❌
30142        - ❌
30143        - ❌
30144        - ❌
30145
30146
30147   .. list-table:: **test-windows10-32-qr/opt**
30148      :widths: 30 15 15 15 15
30149      :header-rows: 1
30150
30151      * - **Test Name**
30152        - mozilla-central
30153        - autoland
30154        - mozilla-release
30155        - mozilla-beta
30156      * - **browsertime-tp6-essential-firefox-cnn-e10s**
30157        - ❌
30158        - ❌
30159        - ❌
30160        - ❌
30161      * - **browsertime-tp6-essential-firefox-cnn-fis-e10s**
30162        - ❌
30163        - ❌
30164        - ❌
30165        - ❌
30166      * - **browsertime-tp6-live-sheriffed-firefox-cnn-e10s**
30167        - ❌
30168        - ❌
30169        - ❌
30170        - ❌
30171      * - **browsertime-tp6-live-sheriffed-firefox-cnn-fis-e10s**
30172        - ❌
30173        - ❌
30174        - ❌
30175        - ❌
30176
30177
30178   .. list-table:: **test-windows10-32-shippable-qr/opt**
30179      :widths: 30 15 15 15 15
30180      :header-rows: 1
30181
30182      * - **Test Name**
30183        - mozilla-central
30184        - autoland
30185        - mozilla-release
30186        - mozilla-beta
30187      * - **browsertime-tp6-essential-chrome-cnn-e10s**
30188        - ❌
30189        - ❌
30190        - ❌
30191        - ❌
30192      * - **browsertime-tp6-essential-chromium-cnn-e10s**
30193        - ❌
30194        - ❌
30195        - ❌
30196        - ❌
30197      * - **browsertime-tp6-essential-firefox-cnn-e10s**
30198        - ❌
30199        - ❌
30200        - ❌
30201        - ❌
30202      * - **browsertime-tp6-essential-firefox-cnn-fis-e10s**
30203        - ❌
30204        - ❌
30205        - ❌
30206        - ❌
30207      * - **browsertime-tp6-live-sheriffed-firefox-cnn-e10s**
30208        - ❌
30209        - ❌
30210        - ❌
30211        - ❌
30212      * - **browsertime-tp6-live-sheriffed-firefox-cnn-fis-e10s**
30213        - ❌
30214        - ❌
30215        - ❌
30216        - ❌
30217
30218
30219   .. list-table:: **test-windows10-64-qr/opt**
30220      :widths: 30 15 15 15 15
30221      :header-rows: 1
30222
30223      * - **Test Name**
30224        - mozilla-central
30225        - autoland
30226        - mozilla-release
30227        - mozilla-beta
30228      * - **browsertime-tp6-essential-firefox-cnn-e10s**
30229        - ❌
30230        - ❌
30231        - ❌
30232        - ❌
30233      * - **browsertime-tp6-essential-firefox-cnn-fis-e10s**
30234        - ❌
30235        - ❌
30236        - ❌
30237        - ❌
30238      * - **browsertime-tp6-live-sheriffed-firefox-cnn-e10s**
30239        - ❌
30240        - ❌
30241        - ❌
30242        - ❌
30243      * - **browsertime-tp6-live-sheriffed-firefox-cnn-fis-e10s**
30244        - ❌
30245        - ❌
30246        - ❌
30247        - ❌
30248
30249
30250   .. list-table:: **test-windows10-64-shippable-qr/opt**
30251      :widths: 30 15 15 15 15
30252      :header-rows: 1
30253
30254      * - **Test Name**
30255        - mozilla-central
30256        - autoland
30257        - mozilla-release
30258        - mozilla-beta
30259      * - **browsertime-tp6-essential-chrome-cnn-e10s**
30260        - ❌
30261        - ❌
30262        - ❌
30263        - ❌
30264      * - **browsertime-tp6-essential-chromium-cnn-e10s**
30265        - ❌
30266        - ❌
30267        - ❌
30268        - ❌
30269      * - **browsertime-tp6-essential-firefox-cnn-e10s**
30270        - ❌
30271        - ❌
30272        - ❌
30273        - ❌
30274      * - **browsertime-tp6-essential-firefox-cnn-fis-e10s**
30275        - ✅
30276        - ✅
30277        - ✅
30278        - ✅
30279      * - **browsertime-tp6-live-sheriffed-firefox-cnn-e10s**
30280        - ❌
30281        - ❌
30282        - ❌
30283        - ❌
30284      * - **browsertime-tp6-live-sheriffed-firefox-cnn-fis-e10s**
30285        - ❌
30286        - ❌
30287        - ❌
30288        - ❌
30289
30290
30291
30292.. dropdown:: cnn-ampstories
30293   :container: + anchor-id-cnn-ampstories-m
30294
30295   **Owner**: PerfTest Team
30296
30297   * **alert on**: fcp, loadtime
30298   * **alert threshold**: 2.0
30299   * **apps**: geckoview, fenix, refbrow, chrome-m
30300   * **browser cycles**: 15
30301   * **expected**: pass
30302   * **lower is better**: true
30303   * **page cycles**: 25
30304   * **page timeout**: 60000
30305   * **playback**: mitmproxy-android
30306   * **playback pageset manifest**: mitm6-android-fenix-cnn-ampstories.manifest
30307   * **playback version**: 6.0.2
30308   * **test url**: `<https://cnn.com/ampstories/us/why-hurricane-michael-is-a-monster-unlike-any-other>`__
30309   * **type**: pageload
30310   * **unit**: ms
30311   * **use live sites**: false
30312   * **Test Task**:
30313
30314   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
30315      :widths: 30 15 15 15 15
30316      :header-rows: 1
30317
30318      * - **Test Name**
30319        - mozilla-central
30320        - autoland
30321        - mozilla-release
30322        - mozilla-beta
30323      * - **browsertime-tp6m-fenix-cnn-ampstories-e10s**
30324        - ❌
30325        - ❌
30326        - ❌
30327        - ❌
30328      * - **browsertime-tp6m-geckoview-cnn-ampstories-e10s**
30329        - ❌
30330        - ❌
30331        - ❌
30332        - ❌
30333      * - **browsertime-tp6m-live-fenix-cnn-ampstories-e10s**
30334        - ❌
30335        - ❌
30336        - ❌
30337        - ❌
30338      * - **browsertime-tp6m-live-geckoview-cnn-ampstories-e10s**
30339        - ❌
30340        - ❌
30341        - ❌
30342        - ❌
30343      * - **browsertime-tp6m-refbrow-cnn-ampstories-e10s**
30344        - ❌
30345        - ❌
30346        - ❌
30347        - ❌
30348
30349
30350   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
30351      :widths: 30 15 15 15 15
30352      :header-rows: 1
30353
30354      * - **Test Name**
30355        - mozilla-central
30356        - autoland
30357        - mozilla-release
30358        - mozilla-beta
30359      * - **browsertime-tp6m-chrome-m-cnn-ampstories-e10s**
30360        - ❌
30361        - ❌
30362        - ❌
30363        - ❌
30364      * - **browsertime-tp6m-fenix-cnn-ampstories-e10s**
30365        - ❌
30366        - ❌
30367        - ❌
30368        - ❌
30369      * - **browsertime-tp6m-geckoview-cnn-ampstories-e10s**
30370        - ✅
30371        - ✅
30372        - ✅
30373        - ✅
30374      * - **browsertime-tp6m-live-chrome-m-cnn-ampstories-e10s**
30375        - ❌
30376        - ❌
30377        - ❌
30378        - ❌
30379      * - **browsertime-tp6m-live-fenix-cnn-ampstories-e10s**
30380        - ❌
30381        - ❌
30382        - ❌
30383        - ❌
30384      * - **browsertime-tp6m-live-geckoview-cnn-ampstories-e10s**
30385        - ❌
30386        - ✅
30387        - ❌
30388        - ❌
30389      * - **browsertime-tp6m-refbrow-cnn-ampstories-e10s**
30390        - ❌
30391        - ❌
30392        - ❌
30393        - ❌
30394
30395
30396   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
30397      :widths: 30 15 15 15 15
30398      :header-rows: 1
30399
30400      * - **Test Name**
30401        - mozilla-central
30402        - autoland
30403        - mozilla-release
30404        - mozilla-beta
30405      * - **browsertime-tp6m-fenix-cnn-ampstories-e10s**
30406        - ❌
30407        - ❌
30408        - ❌
30409        - ❌
30410      * - **browsertime-tp6m-geckoview-cnn-ampstories-e10s**
30411        - ❌
30412        - ❌
30413        - ❌
30414        - ❌
30415      * - **browsertime-tp6m-live-fenix-cnn-ampstories-e10s**
30416        - ❌
30417        - ❌
30418        - ❌
30419        - ❌
30420      * - **browsertime-tp6m-live-geckoview-cnn-ampstories-e10s**
30421        - ❌
30422        - ❌
30423        - ❌
30424        - ❌
30425      * - **browsertime-tp6m-refbrow-cnn-ampstories-e10s**
30426        - ❌
30427        - ❌
30428        - ❌
30429        - ❌
30430
30431
30432   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
30433      :widths: 30 15 15 15 15
30434      :header-rows: 1
30435
30436      * - **Test Name**
30437        - mozilla-central
30438        - autoland
30439        - mozilla-release
30440        - mozilla-beta
30441      * - **browsertime-tp6m-chrome-m-cnn-ampstories-e10s**
30442        - ❌
30443        - ❌
30444        - ❌
30445        - ❌
30446      * - **browsertime-tp6m-fenix-cnn-ampstories-e10s**
30447        - ❌
30448        - ❌
30449        - ❌
30450        - ❌
30451      * - **browsertime-tp6m-geckoview-cnn-ampstories-e10s**
30452        - ✅
30453        - ✅
30454        - ✅
30455        - ✅
30456      * - **browsertime-tp6m-live-chrome-m-cnn-ampstories-e10s**
30457        - ❌
30458        - ❌
30459        - ❌
30460        - ❌
30461      * - **browsertime-tp6m-live-fenix-cnn-ampstories-e10s**
30462        - ❌
30463        - ❌
30464        - ❌
30465        - ❌
30466      * - **browsertime-tp6m-live-geckoview-cnn-ampstories-e10s**
30467        - ❌
30468        - ✅
30469        - ❌
30470        - ❌
30471      * - **browsertime-tp6m-refbrow-cnn-ampstories-e10s**
30472        - ❌
30473        - ❌
30474        - ❌
30475        - ❌
30476
30477
30478   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
30479      :widths: 30 15 15 15 15
30480      :header-rows: 1
30481
30482      * - **Test Name**
30483        - mozilla-central
30484        - autoland
30485        - mozilla-release
30486        - mozilla-beta
30487      * - **browsertime-tp6m-fenix-cnn-ampstories-e10s**
30488        - ❌
30489        - ❌
30490        - ❌
30491        - ❌
30492      * - **browsertime-tp6m-geckoview-cnn-ampstories-e10s**
30493        - ❌
30494        - ❌
30495        - ❌
30496        - ❌
30497      * - **browsertime-tp6m-live-fenix-cnn-ampstories-e10s**
30498        - ❌
30499        - ❌
30500        - ❌
30501        - ❌
30502      * - **browsertime-tp6m-live-geckoview-cnn-ampstories-e10s**
30503        - ❌
30504        - ❌
30505        - ❌
30506        - ❌
30507      * - **browsertime-tp6m-refbrow-cnn-ampstories-e10s**
30508        - ❌
30509        - ❌
30510        - ❌
30511        - ❌
30512
30513
30514   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
30515      :widths: 30 15 15 15 15
30516      :header-rows: 1
30517
30518      * - **Test Name**
30519        - mozilla-central
30520        - autoland
30521        - mozilla-release
30522        - mozilla-beta
30523      * - **browsertime-tp6m-chrome-m-cnn-ampstories-e10s**
30524        - ❌
30525        - ❌
30526        - ❌
30527        - ❌
30528      * - **browsertime-tp6m-fenix-cnn-ampstories-e10s**
30529        - ❌
30530        - ❌
30531        - ❌
30532        - ❌
30533      * - **browsertime-tp6m-geckoview-cnn-ampstories-e10s**
30534        - ❌
30535        - ❌
30536        - ❌
30537        - ❌
30538      * - **browsertime-tp6m-live-chrome-m-cnn-ampstories-e10s**
30539        - ❌
30540        - ❌
30541        - ❌
30542        - ❌
30543      * - **browsertime-tp6m-live-fenix-cnn-ampstories-e10s**
30544        - ❌
30545        - ❌
30546        - ❌
30547        - ❌
30548      * - **browsertime-tp6m-live-geckoview-cnn-ampstories-e10s**
30549        - ❌
30550        - ❌
30551        - ❌
30552        - ❌
30553      * - **browsertime-tp6m-refbrow-cnn-ampstories-e10s**
30554        - ❌
30555        - ❌
30556        - ❌
30557        - ❌
30558
30559
30560   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
30561      :widths: 30 15 15 15 15
30562      :header-rows: 1
30563
30564      * - **Test Name**
30565        - mozilla-central
30566        - autoland
30567        - mozilla-release
30568        - mozilla-beta
30569      * - **browsertime-tp6m-fenix-cnn-ampstories-e10s**
30570        - ❌
30571        - ❌
30572        - ❌
30573        - ❌
30574      * - **browsertime-tp6m-geckoview-cnn-ampstories-e10s**
30575        - ❌
30576        - ❌
30577        - ❌
30578        - ❌
30579      * - **browsertime-tp6m-live-fenix-cnn-ampstories-e10s**
30580        - ❌
30581        - ❌
30582        - ❌
30583        - ❌
30584      * - **browsertime-tp6m-live-geckoview-cnn-ampstories-e10s**
30585        - ❌
30586        - ❌
30587        - ❌
30588        - ❌
30589      * - **browsertime-tp6m-refbrow-cnn-ampstories-e10s**
30590        - ❌
30591        - ❌
30592        - ❌
30593        - ❌
30594
30595
30596   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
30597      :widths: 30 15 15 15 15
30598      :header-rows: 1
30599
30600      * - **Test Name**
30601        - mozilla-central
30602        - autoland
30603        - mozilla-release
30604        - mozilla-beta
30605      * - **browsertime-tp6m-chrome-m-cnn-ampstories-e10s**
30606        - ❌
30607        - ❌
30608        - ❌
30609        - ❌
30610      * - **browsertime-tp6m-fenix-cnn-ampstories-e10s**
30611        - ❌
30612        - ❌
30613        - ❌
30614        - ❌
30615      * - **browsertime-tp6m-geckoview-cnn-ampstories-e10s**
30616        - ❌
30617        - ❌
30618        - ❌
30619        - ❌
30620      * - **browsertime-tp6m-live-chrome-m-cnn-ampstories-e10s**
30621        - ❌
30622        - ❌
30623        - ❌
30624        - ❌
30625      * - **browsertime-tp6m-live-fenix-cnn-ampstories-e10s**
30626        - ❌
30627        - ❌
30628        - ❌
30629        - ❌
30630      * - **browsertime-tp6m-live-geckoview-cnn-ampstories-e10s**
30631        - ❌
30632        - ❌
30633        - ❌
30634        - ❌
30635      * - **browsertime-tp6m-refbrow-cnn-ampstories-e10s**
30636        - ❌
30637        - ❌
30638        - ❌
30639        - ❌
30640
30641
30642
30643.. dropdown:: dailymail
30644   :container: + anchor-id-dailymail-m
30645
30646   **Owner**: PerfTest Team
30647
30648   * **alert on**: fcp, loadtime
30649   * **alert threshold**: 2.0
30650   * **apps**: geckoview, fenix, refbrow, chrome-m
30651   * **browser cycles**: 15
30652   * **expected**: pass
30653   * **lower is better**: true
30654   * **page cycles**: 25
30655   * **page timeout**: 60000
30656   * **playback**: mitmproxy-android
30657   * **playback pageset manifest**: mitm6-android-fenix-dailymail.manifest
30658   * **playback version**: 6.0.2
30659   * **test url**: `<https://www.dailymail.co.uk/sciencetech/article-9749081/Experts-say-Hubble-repair-despite-NASA-insisting-multiple-options-fix.html>`__
30660   * **type**: pageload
30661   * **unit**: ms
30662   * **use live sites**: false
30663   * **Test Task**:
30664
30665   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
30666      :widths: 30 15 15 15 15
30667      :header-rows: 1
30668
30669      * - **Test Name**
30670        - mozilla-central
30671        - autoland
30672        - mozilla-release
30673        - mozilla-beta
30674      * - **browsertime-tp6m-fenix-dailymail-e10s**
30675        - ❌
30676        - ❌
30677        - ❌
30678        - ❌
30679      * - **browsertime-tp6m-geckoview-dailymail-e10s**
30680        - ❌
30681        - ❌
30682        - ❌
30683        - ❌
30684      * - **browsertime-tp6m-live-fenix-dailymail-e10s**
30685        - ❌
30686        - ❌
30687        - ❌
30688        - ❌
30689      * - **browsertime-tp6m-live-geckoview-dailymail-e10s**
30690        - ❌
30691        - ❌
30692        - ❌
30693        - ❌
30694      * - **browsertime-tp6m-refbrow-dailymail-e10s**
30695        - ❌
30696        - ❌
30697        - ❌
30698        - ❌
30699
30700
30701   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
30702      :widths: 30 15 15 15 15
30703      :header-rows: 1
30704
30705      * - **Test Name**
30706        - mozilla-central
30707        - autoland
30708        - mozilla-release
30709        - mozilla-beta
30710      * - **browsertime-tp6m-chrome-m-dailymail-e10s**
30711        - ❌
30712        - ❌
30713        - ❌
30714        - ❌
30715      * - **browsertime-tp6m-fenix-dailymail-e10s**
30716        - ❌
30717        - ❌
30718        - ❌
30719        - ❌
30720      * - **browsertime-tp6m-geckoview-dailymail-e10s**
30721        - ✅
30722        - ✅
30723        - ✅
30724        - ✅
30725      * - **browsertime-tp6m-live-chrome-m-dailymail-e10s**
30726        - ❌
30727        - ❌
30728        - ❌
30729        - ❌
30730      * - **browsertime-tp6m-live-fenix-dailymail-e10s**
30731        - ❌
30732        - ❌
30733        - ❌
30734        - ❌
30735      * - **browsertime-tp6m-live-geckoview-dailymail-e10s**
30736        - ❌
30737        - ❌
30738        - ❌
30739        - ❌
30740      * - **browsertime-tp6m-refbrow-dailymail-e10s**
30741        - ❌
30742        - ❌
30743        - ❌
30744        - ❌
30745
30746
30747   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
30748      :widths: 30 15 15 15 15
30749      :header-rows: 1
30750
30751      * - **Test Name**
30752        - mozilla-central
30753        - autoland
30754        - mozilla-release
30755        - mozilla-beta
30756      * - **browsertime-tp6m-fenix-dailymail-e10s**
30757        - ❌
30758        - ❌
30759        - ❌
30760        - ❌
30761      * - **browsertime-tp6m-geckoview-dailymail-e10s**
30762        - ❌
30763        - ❌
30764        - ❌
30765        - ❌
30766      * - **browsertime-tp6m-live-fenix-dailymail-e10s**
30767        - ❌
30768        - ❌
30769        - ❌
30770        - ❌
30771      * - **browsertime-tp6m-live-geckoview-dailymail-e10s**
30772        - ❌
30773        - ❌
30774        - ❌
30775        - ❌
30776      * - **browsertime-tp6m-refbrow-dailymail-e10s**
30777        - ❌
30778        - ❌
30779        - ❌
30780        - ❌
30781
30782
30783   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
30784      :widths: 30 15 15 15 15
30785      :header-rows: 1
30786
30787      * - **Test Name**
30788        - mozilla-central
30789        - autoland
30790        - mozilla-release
30791        - mozilla-beta
30792      * - **browsertime-tp6m-chrome-m-dailymail-e10s**
30793        - ❌
30794        - ❌
30795        - ❌
30796        - ❌
30797      * - **browsertime-tp6m-fenix-dailymail-e10s**
30798        - ❌
30799        - ❌
30800        - ❌
30801        - ❌
30802      * - **browsertime-tp6m-geckoview-dailymail-e10s**
30803        - ✅
30804        - ✅
30805        - ✅
30806        - ✅
30807      * - **browsertime-tp6m-live-chrome-m-dailymail-e10s**
30808        - ❌
30809        - ❌
30810        - ❌
30811        - ❌
30812      * - **browsertime-tp6m-live-fenix-dailymail-e10s**
30813        - ❌
30814        - ❌
30815        - ❌
30816        - ❌
30817      * - **browsertime-tp6m-live-geckoview-dailymail-e10s**
30818        - ❌
30819        - ❌
30820        - ❌
30821        - ❌
30822      * - **browsertime-tp6m-refbrow-dailymail-e10s**
30823        - ❌
30824        - ❌
30825        - ❌
30826        - ❌
30827
30828
30829   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
30830      :widths: 30 15 15 15 15
30831      :header-rows: 1
30832
30833      * - **Test Name**
30834        - mozilla-central
30835        - autoland
30836        - mozilla-release
30837        - mozilla-beta
30838      * - **browsertime-tp6m-fenix-dailymail-e10s**
30839        - ❌
30840        - ❌
30841        - ❌
30842        - ❌
30843      * - **browsertime-tp6m-geckoview-dailymail-e10s**
30844        - ❌
30845        - ❌
30846        - ❌
30847        - ❌
30848      * - **browsertime-tp6m-live-fenix-dailymail-e10s**
30849        - ❌
30850        - ❌
30851        - ❌
30852        - ❌
30853      * - **browsertime-tp6m-live-geckoview-dailymail-e10s**
30854        - ❌
30855        - ❌
30856        - ❌
30857        - ❌
30858      * - **browsertime-tp6m-refbrow-dailymail-e10s**
30859        - ❌
30860        - ❌
30861        - ❌
30862        - ❌
30863
30864
30865   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
30866      :widths: 30 15 15 15 15
30867      :header-rows: 1
30868
30869      * - **Test Name**
30870        - mozilla-central
30871        - autoland
30872        - mozilla-release
30873        - mozilla-beta
30874      * - **browsertime-tp6m-chrome-m-dailymail-e10s**
30875        - ❌
30876        - ❌
30877        - ❌
30878        - ❌
30879      * - **browsertime-tp6m-fenix-dailymail-e10s**
30880        - ❌
30881        - ❌
30882        - ❌
30883        - ❌
30884      * - **browsertime-tp6m-geckoview-dailymail-e10s**
30885        - ❌
30886        - ❌
30887        - ❌
30888        - ❌
30889      * - **browsertime-tp6m-live-chrome-m-dailymail-e10s**
30890        - ❌
30891        - ❌
30892        - ❌
30893        - ❌
30894      * - **browsertime-tp6m-live-fenix-dailymail-e10s**
30895        - ❌
30896        - ❌
30897        - ❌
30898        - ❌
30899      * - **browsertime-tp6m-live-geckoview-dailymail-e10s**
30900        - ❌
30901        - ❌
30902        - ❌
30903        - ❌
30904      * - **browsertime-tp6m-refbrow-dailymail-e10s**
30905        - ❌
30906        - ❌
30907        - ❌
30908        - ❌
30909
30910
30911   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
30912      :widths: 30 15 15 15 15
30913      :header-rows: 1
30914
30915      * - **Test Name**
30916        - mozilla-central
30917        - autoland
30918        - mozilla-release
30919        - mozilla-beta
30920      * - **browsertime-tp6m-fenix-dailymail-e10s**
30921        - ❌
30922        - ❌
30923        - ❌
30924        - ❌
30925      * - **browsertime-tp6m-geckoview-dailymail-e10s**
30926        - ❌
30927        - ❌
30928        - ❌
30929        - ❌
30930      * - **browsertime-tp6m-live-fenix-dailymail-e10s**
30931        - ❌
30932        - ❌
30933        - ❌
30934        - ❌
30935      * - **browsertime-tp6m-live-geckoview-dailymail-e10s**
30936        - ❌
30937        - ❌
30938        - ❌
30939        - ❌
30940      * - **browsertime-tp6m-refbrow-dailymail-e10s**
30941        - ❌
30942        - ❌
30943        - ❌
30944        - ❌
30945
30946
30947   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
30948      :widths: 30 15 15 15 15
30949      :header-rows: 1
30950
30951      * - **Test Name**
30952        - mozilla-central
30953        - autoland
30954        - mozilla-release
30955        - mozilla-beta
30956      * - **browsertime-tp6m-chrome-m-dailymail-e10s**
30957        - ❌
30958        - ❌
30959        - ❌
30960        - ❌
30961      * - **browsertime-tp6m-fenix-dailymail-e10s**
30962        - ❌
30963        - ❌
30964        - ❌
30965        - ❌
30966      * - **browsertime-tp6m-geckoview-dailymail-e10s**
30967        - ❌
30968        - ❌
30969        - ❌
30970        - ❌
30971      * - **browsertime-tp6m-live-chrome-m-dailymail-e10s**
30972        - ❌
30973        - ❌
30974        - ❌
30975        - ❌
30976      * - **browsertime-tp6m-live-fenix-dailymail-e10s**
30977        - ❌
30978        - ❌
30979        - ❌
30980        - ❌
30981      * - **browsertime-tp6m-live-geckoview-dailymail-e10s**
30982        - ❌
30983        - ❌
30984        - ❌
30985        - ❌
30986      * - **browsertime-tp6m-refbrow-dailymail-e10s**
30987        - ❌
30988        - ❌
30989        - ❌
30990        - ❌
30991
30992
30993
30994.. dropdown:: ebay-kleinanzeigen
30995   :container: + anchor-id-ebay-kleinanzeigen-m
30996
30997   **Owner**: PerfTest Team
30998
30999   * **alert on**: fcp, loadtime
31000   * **alert threshold**: 2.0
31001   * **apps**: geckoview, fenix, refbrow, chrome-m
31002   * **browser cycles**: 15
31003   * **expected**: pass
31004   * **lower is better**: true
31005   * **page cycles**: 25
31006   * **page timeout**: 60000
31007   * **playback**: mitmproxy-android
31008   * **playback pageset manifest**: mitm6-android-fenix-ebay-kleinanzeigen.manifest
31009   * **playback version**: 6.0.2
31010   * **test url**: `<https://m.ebay-kleinanzeigen.de>`__
31011   * **type**: pageload
31012   * **unit**: ms
31013   * **use live sites**: false
31014   * **Test Task**:
31015
31016   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
31017      :widths: 30 15 15 15 15
31018      :header-rows: 1
31019
31020      * - **Test Name**
31021        - mozilla-central
31022        - autoland
31023        - mozilla-release
31024        - mozilla-beta
31025      * - **browsertime-tp6m-fenix-ebay-kleinanzeigen-e10s**
31026        - ❌
31027        - ❌
31028        - ❌
31029        - ❌
31030      * - **browsertime-tp6m-geckoview-ebay-kleinanzeigen-e10s**
31031        - ❌
31032        - ❌
31033        - ❌
31034        - ❌
31035      * - **browsertime-tp6m-live-fenix-ebay-kleinanzeigen-e10s**
31036        - ❌
31037        - ❌
31038        - ❌
31039        - ❌
31040      * - **browsertime-tp6m-live-geckoview-ebay-kleinanzeigen-e10s**
31041        - ❌
31042        - ❌
31043        - ❌
31044        - ❌
31045      * - **browsertime-tp6m-refbrow-ebay-kleinanzeigen-e10s**
31046        - ❌
31047        - ❌
31048        - ❌
31049        - ❌
31050
31051
31052   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
31053      :widths: 30 15 15 15 15
31054      :header-rows: 1
31055
31056      * - **Test Name**
31057        - mozilla-central
31058        - autoland
31059        - mozilla-release
31060        - mozilla-beta
31061      * - **browsertime-tp6m-chrome-m-ebay-kleinanzeigen-e10s**
31062        - ❌
31063        - ❌
31064        - ❌
31065        - ❌
31066      * - **browsertime-tp6m-fenix-ebay-kleinanzeigen-e10s**
31067        - ❌
31068        - ❌
31069        - ❌
31070        - ❌
31071      * - **browsertime-tp6m-geckoview-ebay-kleinanzeigen-e10s**
31072        - ✅
31073        - ✅
31074        - ✅
31075        - ✅
31076      * - **browsertime-tp6m-live-chrome-m-ebay-kleinanzeigen-e10s**
31077        - ❌
31078        - ❌
31079        - ❌
31080        - ❌
31081      * - **browsertime-tp6m-live-fenix-ebay-kleinanzeigen-e10s**
31082        - ❌
31083        - ❌
31084        - ❌
31085        - ❌
31086      * - **browsertime-tp6m-live-geckoview-ebay-kleinanzeigen-e10s**
31087        - ❌
31088        - ❌
31089        - ❌
31090        - ❌
31091      * - **browsertime-tp6m-refbrow-ebay-kleinanzeigen-e10s**
31092        - ❌
31093        - ❌
31094        - ❌
31095        - ❌
31096
31097
31098   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
31099      :widths: 30 15 15 15 15
31100      :header-rows: 1
31101
31102      * - **Test Name**
31103        - mozilla-central
31104        - autoland
31105        - mozilla-release
31106        - mozilla-beta
31107      * - **browsertime-tp6m-fenix-ebay-kleinanzeigen-e10s**
31108        - ❌
31109        - ❌
31110        - ❌
31111        - ❌
31112      * - **browsertime-tp6m-geckoview-ebay-kleinanzeigen-e10s**
31113        - ❌
31114        - ❌
31115        - ❌
31116        - ❌
31117      * - **browsertime-tp6m-live-fenix-ebay-kleinanzeigen-e10s**
31118        - ❌
31119        - ❌
31120        - ❌
31121        - ❌
31122      * - **browsertime-tp6m-live-geckoview-ebay-kleinanzeigen-e10s**
31123        - ❌
31124        - ❌
31125        - ❌
31126        - ❌
31127      * - **browsertime-tp6m-refbrow-ebay-kleinanzeigen-e10s**
31128        - ❌
31129        - ❌
31130        - ❌
31131        - ❌
31132
31133
31134   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
31135      :widths: 30 15 15 15 15
31136      :header-rows: 1
31137
31138      * - **Test Name**
31139        - mozilla-central
31140        - autoland
31141        - mozilla-release
31142        - mozilla-beta
31143      * - **browsertime-tp6m-chrome-m-ebay-kleinanzeigen-e10s**
31144        - ❌
31145        - ❌
31146        - ❌
31147        - ❌
31148      * - **browsertime-tp6m-fenix-ebay-kleinanzeigen-e10s**
31149        - ❌
31150        - ❌
31151        - ❌
31152        - ❌
31153      * - **browsertime-tp6m-geckoview-ebay-kleinanzeigen-e10s**
31154        - ✅
31155        - ✅
31156        - ✅
31157        - ✅
31158      * - **browsertime-tp6m-live-chrome-m-ebay-kleinanzeigen-e10s**
31159        - ❌
31160        - ❌
31161        - ❌
31162        - ❌
31163      * - **browsertime-tp6m-live-fenix-ebay-kleinanzeigen-e10s**
31164        - ❌
31165        - ❌
31166        - ❌
31167        - ❌
31168      * - **browsertime-tp6m-live-geckoview-ebay-kleinanzeigen-e10s**
31169        - ❌
31170        - ❌
31171        - ❌
31172        - ❌
31173      * - **browsertime-tp6m-refbrow-ebay-kleinanzeigen-e10s**
31174        - ❌
31175        - ❌
31176        - ❌
31177        - ❌
31178
31179
31180   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
31181      :widths: 30 15 15 15 15
31182      :header-rows: 1
31183
31184      * - **Test Name**
31185        - mozilla-central
31186        - autoland
31187        - mozilla-release
31188        - mozilla-beta
31189      * - **browsertime-tp6m-fenix-ebay-kleinanzeigen-e10s**
31190        - ❌
31191        - ❌
31192        - ❌
31193        - ❌
31194      * - **browsertime-tp6m-geckoview-ebay-kleinanzeigen-e10s**
31195        - ❌
31196        - ❌
31197        - ❌
31198        - ❌
31199      * - **browsertime-tp6m-live-fenix-ebay-kleinanzeigen-e10s**
31200        - ❌
31201        - ❌
31202        - ❌
31203        - ❌
31204      * - **browsertime-tp6m-live-geckoview-ebay-kleinanzeigen-e10s**
31205        - ❌
31206        - ❌
31207        - ❌
31208        - ❌
31209      * - **browsertime-tp6m-refbrow-ebay-kleinanzeigen-e10s**
31210        - ❌
31211        - ❌
31212        - ❌
31213        - ❌
31214
31215
31216   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
31217      :widths: 30 15 15 15 15
31218      :header-rows: 1
31219
31220      * - **Test Name**
31221        - mozilla-central
31222        - autoland
31223        - mozilla-release
31224        - mozilla-beta
31225      * - **browsertime-tp6m-chrome-m-ebay-kleinanzeigen-e10s**
31226        - ❌
31227        - ❌
31228        - ❌
31229        - ❌
31230      * - **browsertime-tp6m-fenix-ebay-kleinanzeigen-e10s**
31231        - ❌
31232        - ❌
31233        - ❌
31234        - ❌
31235      * - **browsertime-tp6m-geckoview-ebay-kleinanzeigen-e10s**
31236        - ❌
31237        - ❌
31238        - ❌
31239        - ❌
31240      * - **browsertime-tp6m-live-chrome-m-ebay-kleinanzeigen-e10s**
31241        - ❌
31242        - ❌
31243        - ❌
31244        - ❌
31245      * - **browsertime-tp6m-live-fenix-ebay-kleinanzeigen-e10s**
31246        - ❌
31247        - ❌
31248        - ❌
31249        - ❌
31250      * - **browsertime-tp6m-live-geckoview-ebay-kleinanzeigen-e10s**
31251        - ❌
31252        - ❌
31253        - ❌
31254        - ❌
31255      * - **browsertime-tp6m-refbrow-ebay-kleinanzeigen-e10s**
31256        - ❌
31257        - ❌
31258        - ❌
31259        - ❌
31260
31261
31262   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
31263      :widths: 30 15 15 15 15
31264      :header-rows: 1
31265
31266      * - **Test Name**
31267        - mozilla-central
31268        - autoland
31269        - mozilla-release
31270        - mozilla-beta
31271      * - **browsertime-tp6m-fenix-ebay-kleinanzeigen-e10s**
31272        - ❌
31273        - ❌
31274        - ❌
31275        - ❌
31276      * - **browsertime-tp6m-geckoview-ebay-kleinanzeigen-e10s**
31277        - ❌
31278        - ❌
31279        - ❌
31280        - ❌
31281      * - **browsertime-tp6m-live-fenix-ebay-kleinanzeigen-e10s**
31282        - ❌
31283        - ❌
31284        - ❌
31285        - ❌
31286      * - **browsertime-tp6m-live-geckoview-ebay-kleinanzeigen-e10s**
31287        - ❌
31288        - ❌
31289        - ❌
31290        - ❌
31291      * - **browsertime-tp6m-refbrow-ebay-kleinanzeigen-e10s**
31292        - ❌
31293        - ❌
31294        - ❌
31295        - ❌
31296
31297
31298   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
31299      :widths: 30 15 15 15 15
31300      :header-rows: 1
31301
31302      * - **Test Name**
31303        - mozilla-central
31304        - autoland
31305        - mozilla-release
31306        - mozilla-beta
31307      * - **browsertime-tp6m-chrome-m-ebay-kleinanzeigen-e10s**
31308        - ❌
31309        - ❌
31310        - ❌
31311        - ❌
31312      * - **browsertime-tp6m-fenix-ebay-kleinanzeigen-e10s**
31313        - ❌
31314        - ❌
31315        - ❌
31316        - ❌
31317      * - **browsertime-tp6m-geckoview-ebay-kleinanzeigen-e10s**
31318        - ❌
31319        - ❌
31320        - ❌
31321        - ❌
31322      * - **browsertime-tp6m-live-chrome-m-ebay-kleinanzeigen-e10s**
31323        - ❌
31324        - ❌
31325        - ❌
31326        - ❌
31327      * - **browsertime-tp6m-live-fenix-ebay-kleinanzeigen-e10s**
31328        - ❌
31329        - ❌
31330        - ❌
31331        - ❌
31332      * - **browsertime-tp6m-live-geckoview-ebay-kleinanzeigen-e10s**
31333        - ❌
31334        - ❌
31335        - ❌
31336        - ❌
31337      * - **browsertime-tp6m-refbrow-ebay-kleinanzeigen-e10s**
31338        - ❌
31339        - ❌
31340        - ❌
31341        - ❌
31342
31343
31344
31345.. dropdown:: ebay-kleinanzeigen-search
31346   :container: + anchor-id-ebay-kleinanzeigen-search-m
31347
31348   **Owner**: PerfTest Team
31349
31350   * **alert on**: fcp, loadtime
31351   * **alert threshold**: 2.0
31352   * **apps**: geckoview, fenix, refbrow, chrome-m
31353   * **browser cycles**: 15
31354   * **expected**: pass
31355   * **lower is better**: true
31356   * **page cycles**: 25
31357   * **page timeout**: 60000
31358   * **playback**: mitmproxy-android
31359   * **playback pageset manifest**: mitm6-android-fenix-ebay-kleinanzeigen-search.manifest
31360   * **playback version**: 6.0.2
31361   * **test url**: `<https://m.ebay-kleinanzeigen.de/s-anzeigen/auf-zeit-wg-berlin/zimmer/c199-l3331>`__
31362   * **type**: pageload
31363   * **unit**: ms
31364   * **use live sites**: false
31365   * **Test Task**:
31366
31367   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
31368      :widths: 30 15 15 15 15
31369      :header-rows: 1
31370
31371      * - **Test Name**
31372        - mozilla-central
31373        - autoland
31374        - mozilla-release
31375        - mozilla-beta
31376      * - **browsertime-tp6m-fenix-ebay-kleinanzeigen-search-e10s**
31377        - ❌
31378        - ❌
31379        - ❌
31380        - ❌
31381      * - **browsertime-tp6m-geckoview-ebay-kleinanzeigen-search-e10s**
31382        - ❌
31383        - ❌
31384        - ❌
31385        - ❌
31386      * - **browsertime-tp6m-live-fenix-ebay-kleinanzeigen-search-e10s**
31387        - ❌
31388        - ❌
31389        - ❌
31390        - ❌
31391      * - **browsertime-tp6m-live-geckoview-ebay-kleinanzeigen-search-e10s**
31392        - ❌
31393        - ❌
31394        - ❌
31395        - ❌
31396      * - **browsertime-tp6m-refbrow-ebay-kleinanzeigen-search-e10s**
31397        - ❌
31398        - ❌
31399        - ❌
31400        - ❌
31401
31402
31403   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
31404      :widths: 30 15 15 15 15
31405      :header-rows: 1
31406
31407      * - **Test Name**
31408        - mozilla-central
31409        - autoland
31410        - mozilla-release
31411        - mozilla-beta
31412      * - **browsertime-tp6m-chrome-m-ebay-kleinanzeigen-search-e10s**
31413        - ❌
31414        - ❌
31415        - ❌
31416        - ❌
31417      * - **browsertime-tp6m-fenix-ebay-kleinanzeigen-search-e10s**
31418        - ❌
31419        - ❌
31420        - ❌
31421        - ❌
31422      * - **browsertime-tp6m-geckoview-ebay-kleinanzeigen-search-e10s**
31423        - ✅
31424        - ✅
31425        - ✅
31426        - ✅
31427      * - **browsertime-tp6m-live-chrome-m-ebay-kleinanzeigen-search-e10s**
31428        - ❌
31429        - ❌
31430        - ❌
31431        - ❌
31432      * - **browsertime-tp6m-live-fenix-ebay-kleinanzeigen-search-e10s**
31433        - ❌
31434        - ❌
31435        - ❌
31436        - ❌
31437      * - **browsertime-tp6m-live-geckoview-ebay-kleinanzeigen-search-e10s**
31438        - ❌
31439        - ❌
31440        - ❌
31441        - ❌
31442      * - **browsertime-tp6m-refbrow-ebay-kleinanzeigen-search-e10s**
31443        - ❌
31444        - ❌
31445        - ❌
31446        - ❌
31447
31448
31449   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
31450      :widths: 30 15 15 15 15
31451      :header-rows: 1
31452
31453      * - **Test Name**
31454        - mozilla-central
31455        - autoland
31456        - mozilla-release
31457        - mozilla-beta
31458      * - **browsertime-tp6m-fenix-ebay-kleinanzeigen-search-e10s**
31459        - ❌
31460        - ❌
31461        - ❌
31462        - ❌
31463      * - **browsertime-tp6m-geckoview-ebay-kleinanzeigen-search-e10s**
31464        - ❌
31465        - ❌
31466        - ❌
31467        - ❌
31468      * - **browsertime-tp6m-live-fenix-ebay-kleinanzeigen-search-e10s**
31469        - ❌
31470        - ❌
31471        - ❌
31472        - ❌
31473      * - **browsertime-tp6m-live-geckoview-ebay-kleinanzeigen-search-e10s**
31474        - ❌
31475        - ❌
31476        - ❌
31477        - ❌
31478      * - **browsertime-tp6m-refbrow-ebay-kleinanzeigen-search-e10s**
31479        - ❌
31480        - ❌
31481        - ❌
31482        - ❌
31483
31484
31485   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
31486      :widths: 30 15 15 15 15
31487      :header-rows: 1
31488
31489      * - **Test Name**
31490        - mozilla-central
31491        - autoland
31492        - mozilla-release
31493        - mozilla-beta
31494      * - **browsertime-tp6m-chrome-m-ebay-kleinanzeigen-search-e10s**
31495        - ❌
31496        - ❌
31497        - ❌
31498        - ❌
31499      * - **browsertime-tp6m-fenix-ebay-kleinanzeigen-search-e10s**
31500        - ❌
31501        - ❌
31502        - ❌
31503        - ❌
31504      * - **browsertime-tp6m-geckoview-ebay-kleinanzeigen-search-e10s**
31505        - ✅
31506        - ✅
31507        - ✅
31508        - ✅
31509      * - **browsertime-tp6m-live-chrome-m-ebay-kleinanzeigen-search-e10s**
31510        - ❌
31511        - ❌
31512        - ❌
31513        - ❌
31514      * - **browsertime-tp6m-live-fenix-ebay-kleinanzeigen-search-e10s**
31515        - ❌
31516        - ❌
31517        - ❌
31518        - ❌
31519      * - **browsertime-tp6m-live-geckoview-ebay-kleinanzeigen-search-e10s**
31520        - ❌
31521        - ❌
31522        - ❌
31523        - ❌
31524      * - **browsertime-tp6m-refbrow-ebay-kleinanzeigen-search-e10s**
31525        - ❌
31526        - ❌
31527        - ❌
31528        - ❌
31529
31530
31531   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
31532      :widths: 30 15 15 15 15
31533      :header-rows: 1
31534
31535      * - **Test Name**
31536        - mozilla-central
31537        - autoland
31538        - mozilla-release
31539        - mozilla-beta
31540      * - **browsertime-tp6m-fenix-ebay-kleinanzeigen-search-e10s**
31541        - ❌
31542        - ❌
31543        - ❌
31544        - ❌
31545      * - **browsertime-tp6m-geckoview-ebay-kleinanzeigen-search-e10s**
31546        - ❌
31547        - ❌
31548        - ❌
31549        - ❌
31550      * - **browsertime-tp6m-live-fenix-ebay-kleinanzeigen-search-e10s**
31551        - ❌
31552        - ❌
31553        - ❌
31554        - ❌
31555      * - **browsertime-tp6m-live-geckoview-ebay-kleinanzeigen-search-e10s**
31556        - ❌
31557        - ❌
31558        - ❌
31559        - ❌
31560      * - **browsertime-tp6m-refbrow-ebay-kleinanzeigen-search-e10s**
31561        - ❌
31562        - ❌
31563        - ❌
31564        - ❌
31565
31566
31567   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
31568      :widths: 30 15 15 15 15
31569      :header-rows: 1
31570
31571      * - **Test Name**
31572        - mozilla-central
31573        - autoland
31574        - mozilla-release
31575        - mozilla-beta
31576      * - **browsertime-tp6m-chrome-m-ebay-kleinanzeigen-search-e10s**
31577        - ❌
31578        - ❌
31579        - ❌
31580        - ❌
31581      * - **browsertime-tp6m-fenix-ebay-kleinanzeigen-search-e10s**
31582        - ❌
31583        - ❌
31584        - ❌
31585        - ❌
31586      * - **browsertime-tp6m-geckoview-ebay-kleinanzeigen-search-e10s**
31587        - ❌
31588        - ❌
31589        - ❌
31590        - ❌
31591      * - **browsertime-tp6m-live-chrome-m-ebay-kleinanzeigen-search-e10s**
31592        - ❌
31593        - ❌
31594        - ❌
31595        - ❌
31596      * - **browsertime-tp6m-live-fenix-ebay-kleinanzeigen-search-e10s**
31597        - ❌
31598        - ❌
31599        - ❌
31600        - ❌
31601      * - **browsertime-tp6m-live-geckoview-ebay-kleinanzeigen-search-e10s**
31602        - ❌
31603        - ❌
31604        - ❌
31605        - ❌
31606      * - **browsertime-tp6m-refbrow-ebay-kleinanzeigen-search-e10s**
31607        - ❌
31608        - ❌
31609        - ❌
31610        - ❌
31611
31612
31613   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
31614      :widths: 30 15 15 15 15
31615      :header-rows: 1
31616
31617      * - **Test Name**
31618        - mozilla-central
31619        - autoland
31620        - mozilla-release
31621        - mozilla-beta
31622      * - **browsertime-tp6m-fenix-ebay-kleinanzeigen-search-e10s**
31623        - ❌
31624        - ❌
31625        - ❌
31626        - ❌
31627      * - **browsertime-tp6m-geckoview-ebay-kleinanzeigen-search-e10s**
31628        - ❌
31629        - ❌
31630        - ❌
31631        - ❌
31632      * - **browsertime-tp6m-live-fenix-ebay-kleinanzeigen-search-e10s**
31633        - ❌
31634        - ❌
31635        - ❌
31636        - ❌
31637      * - **browsertime-tp6m-live-geckoview-ebay-kleinanzeigen-search-e10s**
31638        - ❌
31639        - ❌
31640        - ❌
31641        - ❌
31642      * - **browsertime-tp6m-refbrow-ebay-kleinanzeigen-search-e10s**
31643        - ❌
31644        - ❌
31645        - ❌
31646        - ❌
31647
31648
31649   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
31650      :widths: 30 15 15 15 15
31651      :header-rows: 1
31652
31653      * - **Test Name**
31654        - mozilla-central
31655        - autoland
31656        - mozilla-release
31657        - mozilla-beta
31658      * - **browsertime-tp6m-chrome-m-ebay-kleinanzeigen-search-e10s**
31659        - ❌
31660        - ❌
31661        - ❌
31662        - ❌
31663      * - **browsertime-tp6m-fenix-ebay-kleinanzeigen-search-e10s**
31664        - ❌
31665        - ❌
31666        - ❌
31667        - ❌
31668      * - **browsertime-tp6m-geckoview-ebay-kleinanzeigen-search-e10s**
31669        - ❌
31670        - ❌
31671        - ❌
31672        - ❌
31673      * - **browsertime-tp6m-live-chrome-m-ebay-kleinanzeigen-search-e10s**
31674        - ❌
31675        - ❌
31676        - ❌
31677        - ❌
31678      * - **browsertime-tp6m-live-fenix-ebay-kleinanzeigen-search-e10s**
31679        - ❌
31680        - ❌
31681        - ❌
31682        - ❌
31683      * - **browsertime-tp6m-live-geckoview-ebay-kleinanzeigen-search-e10s**
31684        - ❌
31685        - ❌
31686        - ❌
31687        - ❌
31688      * - **browsertime-tp6m-refbrow-ebay-kleinanzeigen-search-e10s**
31689        - ❌
31690        - ❌
31691        - ❌
31692        - ❌
31693
31694
31695
31696.. dropdown:: espn
31697   :container: + anchor-id-espn-m
31698
31699   **Owner**: PerfTest Team
31700
31701   * **alert on**: fcp, loadtime
31702   * **alert threshold**: 2.0
31703   * **apps**: geckoview, fenix, refbrow, chrome-m
31704   * **browser cycles**: 15
31705   * **expected**: pass
31706   * **lower is better**: true
31707   * **page cycles**: 25
31708   * **page timeout**: 60000
31709   * **playback**: mitmproxy-android
31710   * **playback pageset manifest**: mitm6-android-fenix-espn.manifest
31711   * **playback version**: 6.0.2
31712   * **test url**: `<http://www.espn.com/nba/story/_/page/allstarweekend25788027/the-comparison-lebron-james-michael-jordan-their-own-words>`__
31713   * **type**: pageload
31714   * **unit**: ms
31715   * **use live sites**: false
31716   * **Test Task**:
31717
31718   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
31719      :widths: 30 15 15 15 15
31720      :header-rows: 1
31721
31722      * - **Test Name**
31723        - mozilla-central
31724        - autoland
31725        - mozilla-release
31726        - mozilla-beta
31727      * - **browsertime-tp6m-essential-fenix-espn-e10s**
31728        - ❌
31729        - ❌
31730        - ❌
31731        - ❌
31732      * - **browsertime-tp6m-essential-geckoview-espn-e10s**
31733        - ❌
31734        - ❌
31735        - ❌
31736        - ❌
31737      * - **browsertime-tp6m-essential-refbrow-espn-e10s**
31738        - ❌
31739        - ❌
31740        - ❌
31741        - ❌
31742      * - **browsertime-tp6m-live-fenix-espn-e10s**
31743        - ❌
31744        - ❌
31745        - ❌
31746        - ❌
31747      * - **browsertime-tp6m-live-geckoview-espn-e10s**
31748        - ❌
31749        - ❌
31750        - ❌
31751        - ❌
31752
31753
31754   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
31755      :widths: 30 15 15 15 15
31756      :header-rows: 1
31757
31758      * - **Test Name**
31759        - mozilla-central
31760        - autoland
31761        - mozilla-release
31762        - mozilla-beta
31763      * - **browsertime-tp6m-essential-chrome-m-espn-e10s**
31764        - ❌
31765        - ❌
31766        - ❌
31767        - ❌
31768      * - **browsertime-tp6m-essential-fenix-espn-e10s**
31769        - ❌
31770        - ❌
31771        - ❌
31772        - ❌
31773      * - **browsertime-tp6m-essential-geckoview-espn-e10s**
31774        - ✅
31775        - ✅
31776        - ✅
31777        - ✅
31778      * - **browsertime-tp6m-essential-refbrow-espn-e10s**
31779        - ❌
31780        - ❌
31781        - ❌
31782        - ❌
31783      * - **browsertime-tp6m-live-chrome-m-espn-e10s**
31784        - ❌
31785        - ❌
31786        - ❌
31787        - ❌
31788      * - **browsertime-tp6m-live-fenix-espn-e10s**
31789        - ❌
31790        - ❌
31791        - ❌
31792        - ❌
31793      * - **browsertime-tp6m-live-geckoview-espn-e10s**
31794        - ❌
31795        - ❌
31796        - ❌
31797        - ❌
31798
31799
31800   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
31801      :widths: 30 15 15 15 15
31802      :header-rows: 1
31803
31804      * - **Test Name**
31805        - mozilla-central
31806        - autoland
31807        - mozilla-release
31808        - mozilla-beta
31809      * - **browsertime-tp6m-essential-fenix-espn-e10s**
31810        - ❌
31811        - ❌
31812        - ❌
31813        - ❌
31814      * - **browsertime-tp6m-essential-geckoview-espn-e10s**
31815        - ❌
31816        - ❌
31817        - ❌
31818        - ❌
31819      * - **browsertime-tp6m-essential-refbrow-espn-e10s**
31820        - ❌
31821        - ❌
31822        - ❌
31823        - ❌
31824      * - **browsertime-tp6m-live-fenix-espn-e10s**
31825        - ❌
31826        - ❌
31827        - ❌
31828        - ❌
31829      * - **browsertime-tp6m-live-geckoview-espn-e10s**
31830        - ❌
31831        - ❌
31832        - ❌
31833        - ❌
31834
31835
31836   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
31837      :widths: 30 15 15 15 15
31838      :header-rows: 1
31839
31840      * - **Test Name**
31841        - mozilla-central
31842        - autoland
31843        - mozilla-release
31844        - mozilla-beta
31845      * - **browsertime-tp6m-essential-chrome-m-espn-e10s**
31846        - ❌
31847        - ❌
31848        - ❌
31849        - ❌
31850      * - **browsertime-tp6m-essential-fenix-espn-e10s**
31851        - ❌
31852        - ❌
31853        - ❌
31854        - ❌
31855      * - **browsertime-tp6m-essential-geckoview-espn-e10s**
31856        - ✅
31857        - ✅
31858        - ✅
31859        - ✅
31860      * - **browsertime-tp6m-essential-refbrow-espn-e10s**
31861        - ❌
31862        - ❌
31863        - ❌
31864        - ❌
31865      * - **browsertime-tp6m-live-chrome-m-espn-e10s**
31866        - ❌
31867        - ❌
31868        - ❌
31869        - ❌
31870      * - **browsertime-tp6m-live-fenix-espn-e10s**
31871        - ❌
31872        - ❌
31873        - ❌
31874        - ❌
31875      * - **browsertime-tp6m-live-geckoview-espn-e10s**
31876        - ❌
31877        - ❌
31878        - ❌
31879        - ❌
31880
31881
31882   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
31883      :widths: 30 15 15 15 15
31884      :header-rows: 1
31885
31886      * - **Test Name**
31887        - mozilla-central
31888        - autoland
31889        - mozilla-release
31890        - mozilla-beta
31891      * - **browsertime-tp6m-essential-fenix-espn-e10s**
31892        - ❌
31893        - ❌
31894        - ❌
31895        - ❌
31896      * - **browsertime-tp6m-essential-geckoview-espn-e10s**
31897        - ❌
31898        - ❌
31899        - ❌
31900        - ❌
31901      * - **browsertime-tp6m-essential-refbrow-espn-e10s**
31902        - ❌
31903        - ❌
31904        - ❌
31905        - ❌
31906      * - **browsertime-tp6m-live-fenix-espn-e10s**
31907        - ❌
31908        - ❌
31909        - ❌
31910        - ❌
31911      * - **browsertime-tp6m-live-geckoview-espn-e10s**
31912        - ❌
31913        - ❌
31914        - ❌
31915        - ❌
31916
31917
31918   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
31919      :widths: 30 15 15 15 15
31920      :header-rows: 1
31921
31922      * - **Test Name**
31923        - mozilla-central
31924        - autoland
31925        - mozilla-release
31926        - mozilla-beta
31927      * - **browsertime-tp6m-essential-chrome-m-espn-e10s**
31928        - ❌
31929        - ❌
31930        - ❌
31931        - ❌
31932      * - **browsertime-tp6m-essential-fenix-espn-e10s**
31933        - ❌
31934        - ❌
31935        - ❌
31936        - ❌
31937      * - **browsertime-tp6m-essential-geckoview-espn-e10s**
31938        - ❌
31939        - ❌
31940        - ❌
31941        - ❌
31942      * - **browsertime-tp6m-essential-refbrow-espn-e10s**
31943        - ❌
31944        - ❌
31945        - ❌
31946        - ❌
31947      * - **browsertime-tp6m-live-chrome-m-espn-e10s**
31948        - ❌
31949        - ❌
31950        - ❌
31951        - ❌
31952      * - **browsertime-tp6m-live-fenix-espn-e10s**
31953        - ❌
31954        - ❌
31955        - ❌
31956        - ❌
31957      * - **browsertime-tp6m-live-geckoview-espn-e10s**
31958        - ❌
31959        - ❌
31960        - ❌
31961        - ❌
31962
31963
31964   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
31965      :widths: 30 15 15 15 15
31966      :header-rows: 1
31967
31968      * - **Test Name**
31969        - mozilla-central
31970        - autoland
31971        - mozilla-release
31972        - mozilla-beta
31973      * - **browsertime-tp6m-essential-fenix-espn-e10s**
31974        - ❌
31975        - ❌
31976        - ❌
31977        - ❌
31978      * - **browsertime-tp6m-essential-geckoview-espn-e10s**
31979        - ❌
31980        - ❌
31981        - ❌
31982        - ❌
31983      * - **browsertime-tp6m-essential-refbrow-espn-e10s**
31984        - ❌
31985        - ❌
31986        - ❌
31987        - ❌
31988      * - **browsertime-tp6m-live-fenix-espn-e10s**
31989        - ❌
31990        - ❌
31991        - ❌
31992        - ❌
31993      * - **browsertime-tp6m-live-geckoview-espn-e10s**
31994        - ❌
31995        - ❌
31996        - ❌
31997        - ❌
31998
31999
32000   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
32001      :widths: 30 15 15 15 15
32002      :header-rows: 1
32003
32004      * - **Test Name**
32005        - mozilla-central
32006        - autoland
32007        - mozilla-release
32008        - mozilla-beta
32009      * - **browsertime-tp6m-essential-chrome-m-espn-e10s**
32010        - ❌
32011        - ❌
32012        - ❌
32013        - ❌
32014      * - **browsertime-tp6m-essential-fenix-espn-e10s**
32015        - ❌
32016        - ❌
32017        - ❌
32018        - ❌
32019      * - **browsertime-tp6m-essential-geckoview-espn-e10s**
32020        - ❌
32021        - ❌
32022        - ❌
32023        - ❌
32024      * - **browsertime-tp6m-essential-refbrow-espn-e10s**
32025        - ❌
32026        - ❌
32027        - ❌
32028        - ❌
32029      * - **browsertime-tp6m-live-chrome-m-espn-e10s**
32030        - ❌
32031        - ❌
32032        - ❌
32033        - ❌
32034      * - **browsertime-tp6m-live-fenix-espn-e10s**
32035        - ❌
32036        - ❌
32037        - ❌
32038        - ❌
32039      * - **browsertime-tp6m-live-geckoview-espn-e10s**
32040        - ❌
32041        - ❌
32042        - ❌
32043        - ❌
32044
32045
32046   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
32047      :widths: 30 15 15 15 15
32048      :header-rows: 1
32049
32050      * - **Test Name**
32051        - mozilla-central
32052        - autoland
32053        - mozilla-release
32054        - mozilla-beta
32055      * - **browsertime-tp6-firefox-espn-e10s**
32056        - ❌
32057        - ❌
32058        - ❌
32059        - ❌
32060      * - **browsertime-tp6-firefox-espn-fis-e10s**
32061        - ❌
32062        - ❌
32063        - ❌
32064        - ❌
32065
32066
32067   .. list-table:: **test-linux1804-64-qr/opt**
32068      :widths: 30 15 15 15 15
32069      :header-rows: 1
32070
32071      * - **Test Name**
32072        - mozilla-central
32073        - autoland
32074        - mozilla-release
32075        - mozilla-beta
32076      * - **browsertime-tp6-firefox-espn-e10s**
32077        - ❌
32078        - ❌
32079        - ❌
32080        - ❌
32081      * - **browsertime-tp6-firefox-espn-fis-e10s**
32082        - ❌
32083        - ❌
32084        - ❌
32085        - ❌
32086
32087
32088   .. list-table:: **test-linux1804-64-shippable-qr/opt**
32089      :widths: 30 15 15 15 15
32090      :header-rows: 1
32091
32092      * - **Test Name**
32093        - mozilla-central
32094        - autoland
32095        - mozilla-release
32096        - mozilla-beta
32097      * - **browsertime-tp6-chrome-espn-e10s**
32098        - ❌
32099        - ❌
32100        - ❌
32101        - ❌
32102      * - **browsertime-tp6-chromium-espn-e10s**
32103        - ❌
32104        - ❌
32105        - ❌
32106        - ❌
32107      * - **browsertime-tp6-firefox-espn-e10s**
32108        - ❌
32109        - ❌
32110        - ❌
32111        - ❌
32112      * - **browsertime-tp6-firefox-espn-fis-e10s**
32113        - ✅
32114        - ✅
32115        - ✅
32116        - ✅
32117
32118
32119   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
32120      :widths: 30 15 15 15 15
32121      :header-rows: 1
32122
32123      * - **Test Name**
32124        - mozilla-central
32125        - autoland
32126        - mozilla-release
32127        - mozilla-beta
32128      * - **browsertime-tp6-chrome-espn-e10s**
32129        - ❌
32130        - ❌
32131        - ❌
32132        - ❌
32133      * - **browsertime-tp6-chromium-espn-e10s**
32134        - ❌
32135        - ❌
32136        - ❌
32137        - ❌
32138      * - **browsertime-tp6-firefox-espn-e10s**
32139        - ❌
32140        - ❌
32141        - ❌
32142        - ❌
32143      * - **browsertime-tp6-firefox-espn-fis-e10s**
32144        - ✅
32145        - ✅
32146        - ✅
32147        - ✅
32148
32149
32150   .. list-table:: **test-windows10-32-qr/opt**
32151      :widths: 30 15 15 15 15
32152      :header-rows: 1
32153
32154      * - **Test Name**
32155        - mozilla-central
32156        - autoland
32157        - mozilla-release
32158        - mozilla-beta
32159      * - **browsertime-tp6-firefox-espn-e10s**
32160        - ❌
32161        - ❌
32162        - ❌
32163        - ❌
32164      * - **browsertime-tp6-firefox-espn-fis-e10s**
32165        - ❌
32166        - ❌
32167        - ❌
32168        - ❌
32169
32170
32171   .. list-table:: **test-windows10-32-shippable-qr/opt**
32172      :widths: 30 15 15 15 15
32173      :header-rows: 1
32174
32175      * - **Test Name**
32176        - mozilla-central
32177        - autoland
32178        - mozilla-release
32179        - mozilla-beta
32180      * - **browsertime-tp6-chrome-espn-e10s**
32181        - ❌
32182        - ❌
32183        - ❌
32184        - ❌
32185      * - **browsertime-tp6-chromium-espn-e10s**
32186        - ❌
32187        - ❌
32188        - ❌
32189        - ❌
32190      * - **browsertime-tp6-firefox-espn-e10s**
32191        - ❌
32192        - ❌
32193        - ❌
32194        - ❌
32195      * - **browsertime-tp6-firefox-espn-fis-e10s**
32196        - ❌
32197        - ❌
32198        - ❌
32199        - ❌
32200
32201
32202   .. list-table:: **test-windows10-64-qr/opt**
32203      :widths: 30 15 15 15 15
32204      :header-rows: 1
32205
32206      * - **Test Name**
32207        - mozilla-central
32208        - autoland
32209        - mozilla-release
32210        - mozilla-beta
32211      * - **browsertime-tp6-firefox-espn-e10s**
32212        - ❌
32213        - ❌
32214        - ❌
32215        - ❌
32216      * - **browsertime-tp6-firefox-espn-fis-e10s**
32217        - ❌
32218        - ❌
32219        - ❌
32220        - ❌
32221
32222
32223   .. list-table:: **test-windows10-64-shippable-qr/opt**
32224      :widths: 30 15 15 15 15
32225      :header-rows: 1
32226
32227      * - **Test Name**
32228        - mozilla-central
32229        - autoland
32230        - mozilla-release
32231        - mozilla-beta
32232      * - **browsertime-tp6-chrome-espn-e10s**
32233        - ❌
32234        - ❌
32235        - ❌
32236        - ❌
32237      * - **browsertime-tp6-chromium-espn-e10s**
32238        - ❌
32239        - ❌
32240        - ❌
32241        - ❌
32242      * - **browsertime-tp6-firefox-espn-e10s**
32243        - ❌
32244        - ❌
32245        - ❌
32246        - ❌
32247      * - **browsertime-tp6-firefox-espn-fis-e10s**
32248        - ✅
32249        - ✅
32250        - ✅
32251        - ✅
32252
32253
32254
32255.. dropdown:: facebook
32256   :container: + anchor-id-facebook-m
32257
32258   **Owner**: PerfTest Team
32259
32260   * **alert on**: fcp, loadtime
32261   * **alert threshold**: 2.0
32262   * **apps**: geckoview, fenix, refbrow, chrome-m
32263   * **browser cycles**: 15
32264   * **expected**: pass
32265   * **login**: true
32266   * **lower is better**: true
32267   * **page cycles**: 25
32268   * **page timeout**: 60000
32269   * **playback**: mitmproxy-android
32270   * **playback pageset manifest**: mitm6-g5-fenix-facebook.manifest
32271   * **playback version**: 6.0.2
32272   * **test url**: `<https://m.facebook.com>`__
32273   * **type**: pageload
32274   * **unit**: ms
32275   * **use live sites**: false
32276   * **Test Task**:
32277
32278   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
32279      :widths: 30 15 15 15 15
32280      :header-rows: 1
32281
32282      * - **Test Name**
32283        - mozilla-central
32284        - autoland
32285        - mozilla-release
32286        - mozilla-beta
32287      * - **browsertime-tp6m-essential-fenix-facebook-e10s**
32288        - ❌
32289        - ❌
32290        - ❌
32291        - ❌
32292      * - **browsertime-tp6m-essential-geckoview-facebook-e10s**
32293        - ❌
32294        - ❌
32295        - ❌
32296        - ❌
32297      * - **browsertime-tp6m-essential-refbrow-facebook-e10s**
32298        - ❌
32299        - ❌
32300        - ❌
32301        - ❌
32302      * - **browsertime-tp6m-live-fenix-facebook-e10s**
32303        - ❌
32304        - ❌
32305        - ❌
32306        - ❌
32307      * - **browsertime-tp6m-live-geckoview-facebook-e10s**
32308        - ❌
32309        - ❌
32310        - ❌
32311        - ❌
32312
32313
32314   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
32315      :widths: 30 15 15 15 15
32316      :header-rows: 1
32317
32318      * - **Test Name**
32319        - mozilla-central
32320        - autoland
32321        - mozilla-release
32322        - mozilla-beta
32323      * - **browsertime-tp6m-essential-chrome-m-facebook-e10s**
32324        - ❌
32325        - ❌
32326        - ❌
32327        - ❌
32328      * - **browsertime-tp6m-essential-fenix-facebook-e10s**
32329        - ❌
32330        - ❌
32331        - ❌
32332        - ❌
32333      * - **browsertime-tp6m-essential-geckoview-facebook-e10s**
32334        - ✅
32335        - ✅
32336        - ✅
32337        - ✅
32338      * - **browsertime-tp6m-essential-refbrow-facebook-e10s**
32339        - ❌
32340        - ❌
32341        - ❌
32342        - ❌
32343      * - **browsertime-tp6m-live-chrome-m-facebook-e10s**
32344        - ❌
32345        - ❌
32346        - ❌
32347        - ❌
32348      * - **browsertime-tp6m-live-fenix-facebook-e10s**
32349        - ❌
32350        - ❌
32351        - ❌
32352        - ❌
32353      * - **browsertime-tp6m-live-geckoview-facebook-e10s**
32354        - ❌
32355        - ❌
32356        - ❌
32357        - ❌
32358
32359
32360   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
32361      :widths: 30 15 15 15 15
32362      :header-rows: 1
32363
32364      * - **Test Name**
32365        - mozilla-central
32366        - autoland
32367        - mozilla-release
32368        - mozilla-beta
32369      * - **browsertime-tp6m-essential-fenix-facebook-e10s**
32370        - ❌
32371        - ❌
32372        - ❌
32373        - ❌
32374      * - **browsertime-tp6m-essential-geckoview-facebook-e10s**
32375        - ❌
32376        - ❌
32377        - ❌
32378        - ❌
32379      * - **browsertime-tp6m-essential-refbrow-facebook-e10s**
32380        - ❌
32381        - ❌
32382        - ❌
32383        - ❌
32384      * - **browsertime-tp6m-live-fenix-facebook-e10s**
32385        - ❌
32386        - ❌
32387        - ❌
32388        - ❌
32389      * - **browsertime-tp6m-live-geckoview-facebook-e10s**
32390        - ❌
32391        - ❌
32392        - ❌
32393        - ❌
32394
32395
32396   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
32397      :widths: 30 15 15 15 15
32398      :header-rows: 1
32399
32400      * - **Test Name**
32401        - mozilla-central
32402        - autoland
32403        - mozilla-release
32404        - mozilla-beta
32405      * - **browsertime-tp6m-essential-chrome-m-facebook-e10s**
32406        - ❌
32407        - ❌
32408        - ❌
32409        - ❌
32410      * - **browsertime-tp6m-essential-fenix-facebook-e10s**
32411        - ❌
32412        - ❌
32413        - ❌
32414        - ❌
32415      * - **browsertime-tp6m-essential-geckoview-facebook-e10s**
32416        - ✅
32417        - ✅
32418        - ✅
32419        - ✅
32420      * - **browsertime-tp6m-essential-refbrow-facebook-e10s**
32421        - ❌
32422        - ❌
32423        - ❌
32424        - ❌
32425      * - **browsertime-tp6m-live-chrome-m-facebook-e10s**
32426        - ❌
32427        - ❌
32428        - ❌
32429        - ❌
32430      * - **browsertime-tp6m-live-fenix-facebook-e10s**
32431        - ❌
32432        - ❌
32433        - ❌
32434        - ❌
32435      * - **browsertime-tp6m-live-geckoview-facebook-e10s**
32436        - ❌
32437        - ❌
32438        - ❌
32439        - ❌
32440
32441
32442   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
32443      :widths: 30 15 15 15 15
32444      :header-rows: 1
32445
32446      * - **Test Name**
32447        - mozilla-central
32448        - autoland
32449        - mozilla-release
32450        - mozilla-beta
32451      * - **browsertime-tp6m-essential-fenix-facebook-e10s**
32452        - ❌
32453        - ❌
32454        - ❌
32455        - ❌
32456      * - **browsertime-tp6m-essential-geckoview-facebook-e10s**
32457        - ❌
32458        - ❌
32459        - ❌
32460        - ❌
32461      * - **browsertime-tp6m-essential-refbrow-facebook-e10s**
32462        - ❌
32463        - ❌
32464        - ❌
32465        - ❌
32466      * - **browsertime-tp6m-live-fenix-facebook-e10s**
32467        - ❌
32468        - ❌
32469        - ❌
32470        - ❌
32471      * - **browsertime-tp6m-live-geckoview-facebook-e10s**
32472        - ❌
32473        - ❌
32474        - ❌
32475        - ❌
32476
32477
32478   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
32479      :widths: 30 15 15 15 15
32480      :header-rows: 1
32481
32482      * - **Test Name**
32483        - mozilla-central
32484        - autoland
32485        - mozilla-release
32486        - mozilla-beta
32487      * - **browsertime-tp6m-essential-chrome-m-facebook-e10s**
32488        - ❌
32489        - ❌
32490        - ❌
32491        - ❌
32492      * - **browsertime-tp6m-essential-fenix-facebook-e10s**
32493        - ❌
32494        - ❌
32495        - ❌
32496        - ❌
32497      * - **browsertime-tp6m-essential-geckoview-facebook-e10s**
32498        - ❌
32499        - ❌
32500        - ❌
32501        - ❌
32502      * - **browsertime-tp6m-essential-refbrow-facebook-e10s**
32503        - ❌
32504        - ❌
32505        - ❌
32506        - ❌
32507      * - **browsertime-tp6m-live-chrome-m-facebook-e10s**
32508        - ❌
32509        - ❌
32510        - ❌
32511        - ❌
32512      * - **browsertime-tp6m-live-fenix-facebook-e10s**
32513        - ❌
32514        - ❌
32515        - ❌
32516        - ❌
32517      * - **browsertime-tp6m-live-geckoview-facebook-e10s**
32518        - ❌
32519        - ❌
32520        - ❌
32521        - ❌
32522
32523
32524   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
32525      :widths: 30 15 15 15 15
32526      :header-rows: 1
32527
32528      * - **Test Name**
32529        - mozilla-central
32530        - autoland
32531        - mozilla-release
32532        - mozilla-beta
32533      * - **browsertime-tp6m-essential-fenix-facebook-e10s**
32534        - ❌
32535        - ❌
32536        - ❌
32537        - ❌
32538      * - **browsertime-tp6m-essential-geckoview-facebook-e10s**
32539        - ❌
32540        - ❌
32541        - ❌
32542        - ❌
32543      * - **browsertime-tp6m-essential-refbrow-facebook-e10s**
32544        - ❌
32545        - ❌
32546        - ❌
32547        - ❌
32548      * - **browsertime-tp6m-live-fenix-facebook-e10s**
32549        - ❌
32550        - ❌
32551        - ❌
32552        - ❌
32553      * - **browsertime-tp6m-live-geckoview-facebook-e10s**
32554        - ❌
32555        - ❌
32556        - ❌
32557        - ❌
32558
32559
32560   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
32561      :widths: 30 15 15 15 15
32562      :header-rows: 1
32563
32564      * - **Test Name**
32565        - mozilla-central
32566        - autoland
32567        - mozilla-release
32568        - mozilla-beta
32569      * - **browsertime-tp6m-essential-chrome-m-facebook-e10s**
32570        - ❌
32571        - ❌
32572        - ❌
32573        - ❌
32574      * - **browsertime-tp6m-essential-fenix-facebook-e10s**
32575        - ❌
32576        - ❌
32577        - ❌
32578        - ❌
32579      * - **browsertime-tp6m-essential-geckoview-facebook-e10s**
32580        - ❌
32581        - ❌
32582        - ❌
32583        - ❌
32584      * - **browsertime-tp6m-essential-refbrow-facebook-e10s**
32585        - ❌
32586        - ❌
32587        - ❌
32588        - ❌
32589      * - **browsertime-tp6m-live-chrome-m-facebook-e10s**
32590        - ❌
32591        - ❌
32592        - ❌
32593        - ❌
32594      * - **browsertime-tp6m-live-fenix-facebook-e10s**
32595        - ❌
32596        - ❌
32597        - ❌
32598        - ❌
32599      * - **browsertime-tp6m-live-geckoview-facebook-e10s**
32600        - ❌
32601        - ❌
32602        - ❌
32603        - ❌
32604
32605
32606   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
32607      :widths: 30 15 15 15 15
32608      :header-rows: 1
32609
32610      * - **Test Name**
32611        - mozilla-central
32612        - autoland
32613        - mozilla-release
32614        - mozilla-beta
32615      * - **browsertime-tp6-firefox-facebook-e10s**
32616        - ❌
32617        - ❌
32618        - ❌
32619        - ❌
32620      * - **browsertime-tp6-firefox-facebook-fis-e10s**
32621        - ❌
32622        - ❌
32623        - ❌
32624        - ❌
32625      * - **browsertime-tp6-live-firefox-facebook-e10s**
32626        - ❌
32627        - ❌
32628        - ❌
32629        - ❌
32630      * - **browsertime-tp6-live-firefox-facebook-fis-e10s**
32631        - ❌
32632        - ❌
32633        - ❌
32634        - ❌
32635
32636
32637   .. list-table:: **test-linux1804-64-qr/opt**
32638      :widths: 30 15 15 15 15
32639      :header-rows: 1
32640
32641      * - **Test Name**
32642        - mozilla-central
32643        - autoland
32644        - mozilla-release
32645        - mozilla-beta
32646      * - **browsertime-tp6-firefox-facebook-e10s**
32647        - ❌
32648        - ❌
32649        - ❌
32650        - ❌
32651      * - **browsertime-tp6-firefox-facebook-fis-e10s**
32652        - ❌
32653        - ❌
32654        - ❌
32655        - ❌
32656      * - **browsertime-tp6-live-firefox-facebook-e10s**
32657        - ❌
32658        - ❌
32659        - ❌
32660        - ❌
32661      * - **browsertime-tp6-live-firefox-facebook-fis-e10s**
32662        - ❌
32663        - ❌
32664        - ❌
32665        - ❌
32666
32667
32668   .. list-table:: **test-linux1804-64-shippable-qr/opt**
32669      :widths: 30 15 15 15 15
32670      :header-rows: 1
32671
32672      * - **Test Name**
32673        - mozilla-central
32674        - autoland
32675        - mozilla-release
32676        - mozilla-beta
32677      * - **browsertime-tp6-chrome-facebook-e10s**
32678        - ❌
32679        - ❌
32680        - ❌
32681        - ❌
32682      * - **browsertime-tp6-chromium-facebook-e10s**
32683        - ❌
32684        - ❌
32685        - ❌
32686        - ❌
32687      * - **browsertime-tp6-firefox-facebook-e10s**
32688        - ❌
32689        - ❌
32690        - ❌
32691        - ❌
32692      * - **browsertime-tp6-firefox-facebook-fis-e10s**
32693        - ✅
32694        - ✅
32695        - ✅
32696        - ✅
32697      * - **browsertime-tp6-live-chrome-facebook-e10s**
32698        - ❌
32699        - ❌
32700        - ❌
32701        - ❌
32702      * - **browsertime-tp6-live-chromium-facebook-e10s**
32703        - ❌
32704        - ❌
32705        - ❌
32706        - ❌
32707      * - **browsertime-tp6-live-firefox-facebook-e10s**
32708        - ❌
32709        - ❌
32710        - ❌
32711        - ❌
32712      * - **browsertime-tp6-live-firefox-facebook-fis-e10s**
32713        - ❌
32714        - ❌
32715        - ❌
32716        - ❌
32717
32718
32719   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
32720      :widths: 30 15 15 15 15
32721      :header-rows: 1
32722
32723      * - **Test Name**
32724        - mozilla-central
32725        - autoland
32726        - mozilla-release
32727        - mozilla-beta
32728      * - **browsertime-tp6-chrome-facebook-e10s**
32729        - ❌
32730        - ❌
32731        - ❌
32732        - ❌
32733      * - **browsertime-tp6-chromium-facebook-e10s**
32734        - ❌
32735        - ❌
32736        - ❌
32737        - ❌
32738      * - **browsertime-tp6-firefox-facebook-e10s**
32739        - ❌
32740        - ❌
32741        - ❌
32742        - ❌
32743      * - **browsertime-tp6-firefox-facebook-fis-e10s**
32744        - ✅
32745        - ✅
32746        - ✅
32747        - ✅
32748      * - **browsertime-tp6-live-chrome-facebook-e10s**
32749        - ❌
32750        - ❌
32751        - ❌
32752        - ❌
32753      * - **browsertime-tp6-live-chromium-facebook-e10s**
32754        - ❌
32755        - ❌
32756        - ❌
32757        - ❌
32758      * - **browsertime-tp6-live-firefox-facebook-e10s**
32759        - ❌
32760        - ❌
32761        - ❌
32762        - ❌
32763      * - **browsertime-tp6-live-firefox-facebook-fis-e10s**
32764        - ❌
32765        - ❌
32766        - ❌
32767        - ❌
32768
32769
32770   .. list-table:: **test-windows10-32-qr/opt**
32771      :widths: 30 15 15 15 15
32772      :header-rows: 1
32773
32774      * - **Test Name**
32775        - mozilla-central
32776        - autoland
32777        - mozilla-release
32778        - mozilla-beta
32779      * - **browsertime-tp6-firefox-facebook-e10s**
32780        - ❌
32781        - ❌
32782        - ❌
32783        - ❌
32784      * - **browsertime-tp6-firefox-facebook-fis-e10s**
32785        - ❌
32786        - ❌
32787        - ❌
32788        - ❌
32789      * - **browsertime-tp6-live-firefox-facebook-e10s**
32790        - ❌
32791        - ❌
32792        - ❌
32793        - ❌
32794      * - **browsertime-tp6-live-firefox-facebook-fis-e10s**
32795        - ❌
32796        - ❌
32797        - ❌
32798        - ❌
32799
32800
32801   .. list-table:: **test-windows10-32-shippable-qr/opt**
32802      :widths: 30 15 15 15 15
32803      :header-rows: 1
32804
32805      * - **Test Name**
32806        - mozilla-central
32807        - autoland
32808        - mozilla-release
32809        - mozilla-beta
32810      * - **browsertime-tp6-chrome-facebook-e10s**
32811        - ❌
32812        - ❌
32813        - ❌
32814        - ❌
32815      * - **browsertime-tp6-chromium-facebook-e10s**
32816        - ❌
32817        - ❌
32818        - ❌
32819        - ❌
32820      * - **browsertime-tp6-firefox-facebook-e10s**
32821        - ❌
32822        - ❌
32823        - ❌
32824        - ❌
32825      * - **browsertime-tp6-firefox-facebook-fis-e10s**
32826        - ❌
32827        - ❌
32828        - ❌
32829        - ❌
32830      * - **browsertime-tp6-live-chrome-facebook-e10s**
32831        - ❌
32832        - ❌
32833        - ❌
32834        - ❌
32835      * - **browsertime-tp6-live-chromium-facebook-e10s**
32836        - ❌
32837        - ❌
32838        - ❌
32839        - ❌
32840      * - **browsertime-tp6-live-firefox-facebook-e10s**
32841        - ❌
32842        - ❌
32843        - ❌
32844        - ❌
32845      * - **browsertime-tp6-live-firefox-facebook-fis-e10s**
32846        - ❌
32847        - ❌
32848        - ❌
32849        - ❌
32850
32851
32852   .. list-table:: **test-windows10-64-qr/opt**
32853      :widths: 30 15 15 15 15
32854      :header-rows: 1
32855
32856      * - **Test Name**
32857        - mozilla-central
32858        - autoland
32859        - mozilla-release
32860        - mozilla-beta
32861      * - **browsertime-tp6-firefox-facebook-e10s**
32862        - ❌
32863        - ❌
32864        - ❌
32865        - ❌
32866      * - **browsertime-tp6-firefox-facebook-fis-e10s**
32867        - ❌
32868        - ❌
32869        - ❌
32870        - ❌
32871      * - **browsertime-tp6-live-firefox-facebook-e10s**
32872        - ❌
32873        - ❌
32874        - ❌
32875        - ❌
32876      * - **browsertime-tp6-live-firefox-facebook-fis-e10s**
32877        - ❌
32878        - ❌
32879        - ❌
32880        - ❌
32881
32882
32883   .. list-table:: **test-windows10-64-shippable-qr/opt**
32884      :widths: 30 15 15 15 15
32885      :header-rows: 1
32886
32887      * - **Test Name**
32888        - mozilla-central
32889        - autoland
32890        - mozilla-release
32891        - mozilla-beta
32892      * - **browsertime-tp6-chrome-facebook-e10s**
32893        - ❌
32894        - ❌
32895        - ❌
32896        - ❌
32897      * - **browsertime-tp6-chromium-facebook-e10s**
32898        - ❌
32899        - ❌
32900        - ❌
32901        - ❌
32902      * - **browsertime-tp6-firefox-facebook-e10s**
32903        - ❌
32904        - ❌
32905        - ❌
32906        - ❌
32907      * - **browsertime-tp6-firefox-facebook-fis-e10s**
32908        - ✅
32909        - ✅
32910        - ✅
32911        - ✅
32912      * - **browsertime-tp6-live-chrome-facebook-e10s**
32913        - ❌
32914        - ❌
32915        - ❌
32916        - ❌
32917      * - **browsertime-tp6-live-chromium-facebook-e10s**
32918        - ❌
32919        - ❌
32920        - ❌
32921        - ❌
32922      * - **browsertime-tp6-live-firefox-facebook-e10s**
32923        - ❌
32924        - ❌
32925        - ❌
32926        - ❌
32927      * - **browsertime-tp6-live-firefox-facebook-fis-e10s**
32928        - ❌
32929        - ❌
32930        - ❌
32931        - ❌
32932
32933
32934
32935.. dropdown:: facebook-cristiano
32936   :container: + anchor-id-facebook-cristiano-m
32937
32938   **Owner**: PerfTest Team
32939
32940   * **alert on**: fcp, loadtime
32941   * **alert threshold**: 2.0
32942   * **apps**: geckoview, fenix, refbrow, chrome-m
32943   * **browser cycles**: 15
32944   * **expected**: pass
32945   * **lower is better**: true
32946   * **page cycles**: 25
32947   * **page timeout**: 60000
32948   * **playback**: mitmproxy-android
32949   * **playback pageset manifest**: mitm6-android-fenix-facebook-cristiano.manifest
32950   * **playback version**: 6.0.2
32951   * **test url**: `<https://m.facebook.com/Cristiano>`__
32952   * **type**: pageload
32953   * **unit**: ms
32954   * **use live sites**: false
32955   * **Test Task**:
32956
32957   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
32958      :widths: 30 15 15 15 15
32959      :header-rows: 1
32960
32961      * - **Test Name**
32962        - mozilla-central
32963        - autoland
32964        - mozilla-release
32965        - mozilla-beta
32966      * - **browsertime-tp6m-fenix-facebook-cristiano-e10s**
32967        - ❌
32968        - ❌
32969        - ❌
32970        - ❌
32971      * - **browsertime-tp6m-geckoview-facebook-cristiano-e10s**
32972        - ❌
32973        - ❌
32974        - ❌
32975        - ❌
32976      * - **browsertime-tp6m-live-fenix-facebook-cristiano-e10s**
32977        - ❌
32978        - ❌
32979        - ❌
32980        - ❌
32981      * - **browsertime-tp6m-live-geckoview-facebook-cristiano-e10s**
32982        - ❌
32983        - ❌
32984        - ❌
32985        - ❌
32986      * - **browsertime-tp6m-refbrow-facebook-cristiano-e10s**
32987        - ❌
32988        - ❌
32989        - ❌
32990        - ❌
32991
32992
32993   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
32994      :widths: 30 15 15 15 15
32995      :header-rows: 1
32996
32997      * - **Test Name**
32998        - mozilla-central
32999        - autoland
33000        - mozilla-release
33001        - mozilla-beta
33002      * - **browsertime-tp6m-chrome-m-facebook-cristiano-e10s**
33003        - ❌
33004        - ❌
33005        - ❌
33006        - ❌
33007      * - **browsertime-tp6m-fenix-facebook-cristiano-e10s**
33008        - ❌
33009        - ❌
33010        - ❌
33011        - ❌
33012      * - **browsertime-tp6m-geckoview-facebook-cristiano-e10s**
33013        - ✅
33014        - ✅
33015        - ✅
33016        - ✅
33017      * - **browsertime-tp6m-live-chrome-m-facebook-cristiano-e10s**
33018        - ❌
33019        - ❌
33020        - ❌
33021        - ❌
33022      * - **browsertime-tp6m-live-fenix-facebook-cristiano-e10s**
33023        - ❌
33024        - ❌
33025        - ❌
33026        - ❌
33027      * - **browsertime-tp6m-live-geckoview-facebook-cristiano-e10s**
33028        - ❌
33029        - ❌
33030        - ❌
33031        - ❌
33032      * - **browsertime-tp6m-refbrow-facebook-cristiano-e10s**
33033        - ❌
33034        - ❌
33035        - ❌
33036        - ❌
33037
33038
33039   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
33040      :widths: 30 15 15 15 15
33041      :header-rows: 1
33042
33043      * - **Test Name**
33044        - mozilla-central
33045        - autoland
33046        - mozilla-release
33047        - mozilla-beta
33048      * - **browsertime-tp6m-fenix-facebook-cristiano-e10s**
33049        - ❌
33050        - ❌
33051        - ❌
33052        - ❌
33053      * - **browsertime-tp6m-geckoview-facebook-cristiano-e10s**
33054        - ❌
33055        - ❌
33056        - ❌
33057        - ❌
33058      * - **browsertime-tp6m-live-fenix-facebook-cristiano-e10s**
33059        - ❌
33060        - ❌
33061        - ❌
33062        - ❌
33063      * - **browsertime-tp6m-live-geckoview-facebook-cristiano-e10s**
33064        - ❌
33065        - ❌
33066        - ❌
33067        - ❌
33068      * - **browsertime-tp6m-refbrow-facebook-cristiano-e10s**
33069        - ❌
33070        - ❌
33071        - ❌
33072        - ❌
33073
33074
33075   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
33076      :widths: 30 15 15 15 15
33077      :header-rows: 1
33078
33079      * - **Test Name**
33080        - mozilla-central
33081        - autoland
33082        - mozilla-release
33083        - mozilla-beta
33084      * - **browsertime-tp6m-chrome-m-facebook-cristiano-e10s**
33085        - ❌
33086        - ❌
33087        - ❌
33088        - ❌
33089      * - **browsertime-tp6m-fenix-facebook-cristiano-e10s**
33090        - ❌
33091        - ❌
33092        - ❌
33093        - ❌
33094      * - **browsertime-tp6m-geckoview-facebook-cristiano-e10s**
33095        - ✅
33096        - ✅
33097        - ✅
33098        - ✅
33099      * - **browsertime-tp6m-live-chrome-m-facebook-cristiano-e10s**
33100        - ❌
33101        - ❌
33102        - ❌
33103        - ❌
33104      * - **browsertime-tp6m-live-fenix-facebook-cristiano-e10s**
33105        - ❌
33106        - ❌
33107        - ❌
33108        - ❌
33109      * - **browsertime-tp6m-live-geckoview-facebook-cristiano-e10s**
33110        - ❌
33111        - ❌
33112        - ❌
33113        - ❌
33114      * - **browsertime-tp6m-refbrow-facebook-cristiano-e10s**
33115        - ❌
33116        - ❌
33117        - ❌
33118        - ❌
33119
33120
33121   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
33122      :widths: 30 15 15 15 15
33123      :header-rows: 1
33124
33125      * - **Test Name**
33126        - mozilla-central
33127        - autoland
33128        - mozilla-release
33129        - mozilla-beta
33130      * - **browsertime-tp6m-fenix-facebook-cristiano-e10s**
33131        - ❌
33132        - ❌
33133        - ❌
33134        - ❌
33135      * - **browsertime-tp6m-geckoview-facebook-cristiano-e10s**
33136        - ❌
33137        - ❌
33138        - ❌
33139        - ❌
33140      * - **browsertime-tp6m-live-fenix-facebook-cristiano-e10s**
33141        - ❌
33142        - ❌
33143        - ❌
33144        - ❌
33145      * - **browsertime-tp6m-live-geckoview-facebook-cristiano-e10s**
33146        - ❌
33147        - ❌
33148        - ❌
33149        - ❌
33150      * - **browsertime-tp6m-refbrow-facebook-cristiano-e10s**
33151        - ❌
33152        - ❌
33153        - ❌
33154        - ❌
33155
33156
33157   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
33158      :widths: 30 15 15 15 15
33159      :header-rows: 1
33160
33161      * - **Test Name**
33162        - mozilla-central
33163        - autoland
33164        - mozilla-release
33165        - mozilla-beta
33166      * - **browsertime-tp6m-chrome-m-facebook-cristiano-e10s**
33167        - ❌
33168        - ❌
33169        - ❌
33170        - ❌
33171      * - **browsertime-tp6m-fenix-facebook-cristiano-e10s**
33172        - ❌
33173        - ❌
33174        - ❌
33175        - ❌
33176      * - **browsertime-tp6m-geckoview-facebook-cristiano-e10s**
33177        - ❌
33178        - ❌
33179        - ❌
33180        - ❌
33181      * - **browsertime-tp6m-live-chrome-m-facebook-cristiano-e10s**
33182        - ❌
33183        - ❌
33184        - ❌
33185        - ❌
33186      * - **browsertime-tp6m-live-fenix-facebook-cristiano-e10s**
33187        - ❌
33188        - ❌
33189        - ❌
33190        - ❌
33191      * - **browsertime-tp6m-live-geckoview-facebook-cristiano-e10s**
33192        - ❌
33193        - ❌
33194        - ❌
33195        - ❌
33196      * - **browsertime-tp6m-refbrow-facebook-cristiano-e10s**
33197        - ❌
33198        - ❌
33199        - ❌
33200        - ❌
33201
33202
33203   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
33204      :widths: 30 15 15 15 15
33205      :header-rows: 1
33206
33207      * - **Test Name**
33208        - mozilla-central
33209        - autoland
33210        - mozilla-release
33211        - mozilla-beta
33212      * - **browsertime-tp6m-fenix-facebook-cristiano-e10s**
33213        - ❌
33214        - ❌
33215        - ❌
33216        - ❌
33217      * - **browsertime-tp6m-geckoview-facebook-cristiano-e10s**
33218        - ❌
33219        - ❌
33220        - ❌
33221        - ❌
33222      * - **browsertime-tp6m-live-fenix-facebook-cristiano-e10s**
33223        - ❌
33224        - ❌
33225        - ❌
33226        - ❌
33227      * - **browsertime-tp6m-live-geckoview-facebook-cristiano-e10s**
33228        - ❌
33229        - ❌
33230        - ❌
33231        - ❌
33232      * - **browsertime-tp6m-refbrow-facebook-cristiano-e10s**
33233        - ❌
33234        - ❌
33235        - ❌
33236        - ❌
33237
33238
33239   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
33240      :widths: 30 15 15 15 15
33241      :header-rows: 1
33242
33243      * - **Test Name**
33244        - mozilla-central
33245        - autoland
33246        - mozilla-release
33247        - mozilla-beta
33248      * - **browsertime-tp6m-chrome-m-facebook-cristiano-e10s**
33249        - ❌
33250        - ❌
33251        - ❌
33252        - ❌
33253      * - **browsertime-tp6m-fenix-facebook-cristiano-e10s**
33254        - ❌
33255        - ❌
33256        - ❌
33257        - ❌
33258      * - **browsertime-tp6m-geckoview-facebook-cristiano-e10s**
33259        - ❌
33260        - ❌
33261        - ❌
33262        - ❌
33263      * - **browsertime-tp6m-live-chrome-m-facebook-cristiano-e10s**
33264        - ❌
33265        - ❌
33266        - ❌
33267        - ❌
33268      * - **browsertime-tp6m-live-fenix-facebook-cristiano-e10s**
33269        - ❌
33270        - ❌
33271        - ❌
33272        - ❌
33273      * - **browsertime-tp6m-live-geckoview-facebook-cristiano-e10s**
33274        - ❌
33275        - ❌
33276        - ❌
33277        - ❌
33278      * - **browsertime-tp6m-refbrow-facebook-cristiano-e10s**
33279        - ❌
33280        - ❌
33281        - ❌
33282        - ❌
33283
33284
33285
33286.. dropdown:: google
33287   :container: + anchor-id-google-m
33288
33289   **Owner**: PerfTest Team
33290
33291   * **alert on**: fcp, loadtime
33292   * **alert threshold**: 2.0
33293   * **apps**: geckoview, fenix, refbrow, chrome-m
33294   * **browser cycles**: 15
33295   * **expected**: pass
33296   * **login**: true
33297   * **lower is better**: true
33298   * **page cycles**: 25
33299   * **page timeout**: 60000
33300   * **playback**: mitmproxy-android
33301   * **playback pageset manifest**: mitm6-g5-fenix-google.manifest
33302   * **playback version**: 6.0.2
33303   * **test url**: `<https://www.google.com>`__
33304   * **type**: pageload
33305   * **unit**: ms
33306   * **use live sites**: false
33307   * **Test Task**:
33308
33309   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
33310      :widths: 30 15 15 15 15
33311      :header-rows: 1
33312
33313      * - **Test Name**
33314        - mozilla-central
33315        - autoland
33316        - mozilla-release
33317        - mozilla-beta
33318      * - **browsertime-tp6m-essential-fenix-google-e10s**
33319        - ❌
33320        - ❌
33321        - ❌
33322        - ❌
33323      * - **browsertime-tp6m-essential-geckoview-google-e10s**
33324        - ❌
33325        - ❌
33326        - ❌
33327        - ❌
33328      * - **browsertime-tp6m-essential-refbrow-google-e10s**
33329        - ❌
33330        - ❌
33331        - ❌
33332        - ❌
33333      * - **browsertime-tp6m-live-fenix-google-e10s**
33334        - ❌
33335        - ❌
33336        - ❌
33337        - ❌
33338      * - **browsertime-tp6m-live-geckoview-google-e10s**
33339        - ❌
33340        - ❌
33341        - ❌
33342        - ❌
33343
33344
33345   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
33346      :widths: 30 15 15 15 15
33347      :header-rows: 1
33348
33349      * - **Test Name**
33350        - mozilla-central
33351        - autoland
33352        - mozilla-release
33353        - mozilla-beta
33354      * - **browsertime-tp6m-essential-chrome-m-google-e10s**
33355        - ❌
33356        - ❌
33357        - ❌
33358        - ❌
33359      * - **browsertime-tp6m-essential-fenix-google-e10s**
33360        - ❌
33361        - ❌
33362        - ❌
33363        - ❌
33364      * - **browsertime-tp6m-essential-geckoview-google-e10s**
33365        - ✅
33366        - ✅
33367        - ✅
33368        - ✅
33369      * - **browsertime-tp6m-essential-refbrow-google-e10s**
33370        - ❌
33371        - ❌
33372        - ❌
33373        - ❌
33374      * - **browsertime-tp6m-live-chrome-m-google-e10s**
33375        - ❌
33376        - ❌
33377        - ❌
33378        - ❌
33379      * - **browsertime-tp6m-live-fenix-google-e10s**
33380        - ❌
33381        - ❌
33382        - ❌
33383        - ❌
33384      * - **browsertime-tp6m-live-geckoview-google-e10s**
33385        - ❌
33386        - ❌
33387        - ❌
33388        - ❌
33389
33390
33391   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
33392      :widths: 30 15 15 15 15
33393      :header-rows: 1
33394
33395      * - **Test Name**
33396        - mozilla-central
33397        - autoland
33398        - mozilla-release
33399        - mozilla-beta
33400      * - **browsertime-tp6m-essential-fenix-google-e10s**
33401        - ❌
33402        - ❌
33403        - ❌
33404        - ❌
33405      * - **browsertime-tp6m-essential-geckoview-google-e10s**
33406        - ❌
33407        - ❌
33408        - ❌
33409        - ❌
33410      * - **browsertime-tp6m-essential-refbrow-google-e10s**
33411        - ❌
33412        - ❌
33413        - ❌
33414        - ❌
33415      * - **browsertime-tp6m-live-fenix-google-e10s**
33416        - ❌
33417        - ❌
33418        - ❌
33419        - ❌
33420      * - **browsertime-tp6m-live-geckoview-google-e10s**
33421        - ❌
33422        - ❌
33423        - ❌
33424        - ❌
33425
33426
33427   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
33428      :widths: 30 15 15 15 15
33429      :header-rows: 1
33430
33431      * - **Test Name**
33432        - mozilla-central
33433        - autoland
33434        - mozilla-release
33435        - mozilla-beta
33436      * - **browsertime-tp6m-essential-chrome-m-google-e10s**
33437        - ❌
33438        - ❌
33439        - ❌
33440        - ❌
33441      * - **browsertime-tp6m-essential-fenix-google-e10s**
33442        - ❌
33443        - ❌
33444        - ❌
33445        - ❌
33446      * - **browsertime-tp6m-essential-geckoview-google-e10s**
33447        - ✅
33448        - ✅
33449        - ✅
33450        - ✅
33451      * - **browsertime-tp6m-essential-refbrow-google-e10s**
33452        - ❌
33453        - ❌
33454        - ❌
33455        - ❌
33456      * - **browsertime-tp6m-live-chrome-m-google-e10s**
33457        - ❌
33458        - ❌
33459        - ❌
33460        - ❌
33461      * - **browsertime-tp6m-live-fenix-google-e10s**
33462        - ❌
33463        - ❌
33464        - ❌
33465        - ❌
33466      * - **browsertime-tp6m-live-geckoview-google-e10s**
33467        - ❌
33468        - ❌
33469        - ❌
33470        - ❌
33471
33472
33473   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
33474      :widths: 30 15 15 15 15
33475      :header-rows: 1
33476
33477      * - **Test Name**
33478        - mozilla-central
33479        - autoland
33480        - mozilla-release
33481        - mozilla-beta
33482      * - **browsertime-tp6m-essential-fenix-google-e10s**
33483        - ❌
33484        - ❌
33485        - ❌
33486        - ❌
33487      * - **browsertime-tp6m-essential-geckoview-google-e10s**
33488        - ❌
33489        - ❌
33490        - ❌
33491        - ❌
33492      * - **browsertime-tp6m-essential-refbrow-google-e10s**
33493        - ❌
33494        - ❌
33495        - ❌
33496        - ❌
33497      * - **browsertime-tp6m-live-fenix-google-e10s**
33498        - ❌
33499        - ❌
33500        - ❌
33501        - ❌
33502      * - **browsertime-tp6m-live-geckoview-google-e10s**
33503        - ❌
33504        - ❌
33505        - ❌
33506        - ❌
33507
33508
33509   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
33510      :widths: 30 15 15 15 15
33511      :header-rows: 1
33512
33513      * - **Test Name**
33514        - mozilla-central
33515        - autoland
33516        - mozilla-release
33517        - mozilla-beta
33518      * - **browsertime-tp6m-essential-chrome-m-google-e10s**
33519        - ❌
33520        - ❌
33521        - ❌
33522        - ❌
33523      * - **browsertime-tp6m-essential-fenix-google-e10s**
33524        - ❌
33525        - ❌
33526        - ❌
33527        - ❌
33528      * - **browsertime-tp6m-essential-geckoview-google-e10s**
33529        - ❌
33530        - ❌
33531        - ❌
33532        - ❌
33533      * - **browsertime-tp6m-essential-refbrow-google-e10s**
33534        - ❌
33535        - ❌
33536        - ❌
33537        - ❌
33538      * - **browsertime-tp6m-live-chrome-m-google-e10s**
33539        - ❌
33540        - ❌
33541        - ❌
33542        - ❌
33543      * - **browsertime-tp6m-live-fenix-google-e10s**
33544        - ❌
33545        - ❌
33546        - ❌
33547        - ❌
33548      * - **browsertime-tp6m-live-geckoview-google-e10s**
33549        - ❌
33550        - ❌
33551        - ❌
33552        - ❌
33553
33554
33555   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
33556      :widths: 30 15 15 15 15
33557      :header-rows: 1
33558
33559      * - **Test Name**
33560        - mozilla-central
33561        - autoland
33562        - mozilla-release
33563        - mozilla-beta
33564      * - **browsertime-tp6m-essential-fenix-google-e10s**
33565        - ❌
33566        - ❌
33567        - ❌
33568        - ❌
33569      * - **browsertime-tp6m-essential-geckoview-google-e10s**
33570        - ❌
33571        - ❌
33572        - ❌
33573        - ❌
33574      * - **browsertime-tp6m-essential-refbrow-google-e10s**
33575        - ❌
33576        - ❌
33577        - ❌
33578        - ❌
33579      * - **browsertime-tp6m-live-fenix-google-e10s**
33580        - ❌
33581        - ❌
33582        - ❌
33583        - ❌
33584      * - **browsertime-tp6m-live-geckoview-google-e10s**
33585        - ❌
33586        - ❌
33587        - ❌
33588        - ❌
33589
33590
33591   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
33592      :widths: 30 15 15 15 15
33593      :header-rows: 1
33594
33595      * - **Test Name**
33596        - mozilla-central
33597        - autoland
33598        - mozilla-release
33599        - mozilla-beta
33600      * - **browsertime-tp6m-essential-chrome-m-google-e10s**
33601        - ❌
33602        - ❌
33603        - ❌
33604        - ❌
33605      * - **browsertime-tp6m-essential-fenix-google-e10s**
33606        - ❌
33607        - ❌
33608        - ❌
33609        - ❌
33610      * - **browsertime-tp6m-essential-geckoview-google-e10s**
33611        - ❌
33612        - ❌
33613        - ❌
33614        - ❌
33615      * - **browsertime-tp6m-essential-refbrow-google-e10s**
33616        - ❌
33617        - ❌
33618        - ❌
33619        - ❌
33620      * - **browsertime-tp6m-live-chrome-m-google-e10s**
33621        - ❌
33622        - ❌
33623        - ❌
33624        - ❌
33625      * - **browsertime-tp6m-live-fenix-google-e10s**
33626        - ❌
33627        - ❌
33628        - ❌
33629        - ❌
33630      * - **browsertime-tp6m-live-geckoview-google-e10s**
33631        - ❌
33632        - ❌
33633        - ❌
33634        - ❌
33635
33636
33637
33638.. dropdown:: google-maps
33639   :container: + anchor-id-google-maps-m
33640
33641   **Owner**: PerfTest Team
33642
33643   * **alert on**: fcp, loadtime
33644   * **alert threshold**: 2.0
33645   * **apps**: geckoview, fenix, refbrow, chrome-m
33646   * **browser cycles**: 15
33647   * **expected**: pass
33648   * **lower is better**: true
33649   * **page cycles**: 25
33650   * **page timeout**: 60000
33651   * **playback**: mitmproxy-android
33652   * **playback pageset manifest**: mitm6-android-fenix-google-maps.manifest
33653   * **playback version**: 6.0.2
33654   * **test url**: `<https://www.google.com/maps?force=pwa>`__
33655   * **type**: pageload
33656   * **unit**: ms
33657   * **use live sites**: false
33658   * **Test Task**:
33659
33660   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
33661      :widths: 30 15 15 15 15
33662      :header-rows: 1
33663
33664      * - **Test Name**
33665        - mozilla-central
33666        - autoland
33667        - mozilla-release
33668        - mozilla-beta
33669      * - **browsertime-tp6m-fenix-google-maps-e10s**
33670        - ❌
33671        - ❌
33672        - ❌
33673        - ❌
33674      * - **browsertime-tp6m-geckoview-google-maps-e10s**
33675        - ❌
33676        - ❌
33677        - ❌
33678        - ❌
33679      * - **browsertime-tp6m-live-fenix-google-maps-e10s**
33680        - ❌
33681        - ❌
33682        - ❌
33683        - ❌
33684      * - **browsertime-tp6m-live-geckoview-google-maps-e10s**
33685        - ❌
33686        - ❌
33687        - ❌
33688        - ❌
33689      * - **browsertime-tp6m-refbrow-google-maps-e10s**
33690        - ❌
33691        - ❌
33692        - ❌
33693        - ❌
33694
33695
33696   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
33697      :widths: 30 15 15 15 15
33698      :header-rows: 1
33699
33700      * - **Test Name**
33701        - mozilla-central
33702        - autoland
33703        - mozilla-release
33704        - mozilla-beta
33705      * - **browsertime-tp6m-chrome-m-google-maps-e10s**
33706        - ❌
33707        - ❌
33708        - ❌
33709        - ❌
33710      * - **browsertime-tp6m-fenix-google-maps-e10s**
33711        - ❌
33712        - ❌
33713        - ❌
33714        - ❌
33715      * - **browsertime-tp6m-geckoview-google-maps-e10s**
33716        - ✅
33717        - ✅
33718        - ✅
33719        - ✅
33720      * - **browsertime-tp6m-live-chrome-m-google-maps-e10s**
33721        - ❌
33722        - ❌
33723        - ❌
33724        - ❌
33725      * - **browsertime-tp6m-live-fenix-google-maps-e10s**
33726        - ❌
33727        - ❌
33728        - ❌
33729        - ❌
33730      * - **browsertime-tp6m-live-geckoview-google-maps-e10s**
33731        - ❌
33732        - ❌
33733        - ❌
33734        - ❌
33735      * - **browsertime-tp6m-refbrow-google-maps-e10s**
33736        - ❌
33737        - ❌
33738        - ❌
33739        - ❌
33740
33741
33742   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
33743      :widths: 30 15 15 15 15
33744      :header-rows: 1
33745
33746      * - **Test Name**
33747        - mozilla-central
33748        - autoland
33749        - mozilla-release
33750        - mozilla-beta
33751      * - **browsertime-tp6m-fenix-google-maps-e10s**
33752        - ❌
33753        - ❌
33754        - ❌
33755        - ❌
33756      * - **browsertime-tp6m-geckoview-google-maps-e10s**
33757        - ❌
33758        - ❌
33759        - ❌
33760        - ❌
33761      * - **browsertime-tp6m-live-fenix-google-maps-e10s**
33762        - ❌
33763        - ❌
33764        - ❌
33765        - ❌
33766      * - **browsertime-tp6m-live-geckoview-google-maps-e10s**
33767        - ❌
33768        - ❌
33769        - ❌
33770        - ❌
33771      * - **browsertime-tp6m-refbrow-google-maps-e10s**
33772        - ❌
33773        - ❌
33774        - ❌
33775        - ❌
33776
33777
33778   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
33779      :widths: 30 15 15 15 15
33780      :header-rows: 1
33781
33782      * - **Test Name**
33783        - mozilla-central
33784        - autoland
33785        - mozilla-release
33786        - mozilla-beta
33787      * - **browsertime-tp6m-chrome-m-google-maps-e10s**
33788        - ❌
33789        - ❌
33790        - ❌
33791        - ❌
33792      * - **browsertime-tp6m-fenix-google-maps-e10s**
33793        - ❌
33794        - ❌
33795        - ❌
33796        - ❌
33797      * - **browsertime-tp6m-geckoview-google-maps-e10s**
33798        - ✅
33799        - ✅
33800        - ✅
33801        - ✅
33802      * - **browsertime-tp6m-live-chrome-m-google-maps-e10s**
33803        - ❌
33804        - ❌
33805        - ❌
33806        - ❌
33807      * - **browsertime-tp6m-live-fenix-google-maps-e10s**
33808        - ❌
33809        - ❌
33810        - ❌
33811        - ❌
33812      * - **browsertime-tp6m-live-geckoview-google-maps-e10s**
33813        - ❌
33814        - ❌
33815        - ❌
33816        - ❌
33817      * - **browsertime-tp6m-refbrow-google-maps-e10s**
33818        - ❌
33819        - ❌
33820        - ❌
33821        - ❌
33822
33823
33824   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
33825      :widths: 30 15 15 15 15
33826      :header-rows: 1
33827
33828      * - **Test Name**
33829        - mozilla-central
33830        - autoland
33831        - mozilla-release
33832        - mozilla-beta
33833      * - **browsertime-tp6m-fenix-google-maps-e10s**
33834        - ❌
33835        - ❌
33836        - ❌
33837        - ❌
33838      * - **browsertime-tp6m-geckoview-google-maps-e10s**
33839        - ❌
33840        - ❌
33841        - ❌
33842        - ❌
33843      * - **browsertime-tp6m-live-fenix-google-maps-e10s**
33844        - ❌
33845        - ❌
33846        - ❌
33847        - ❌
33848      * - **browsertime-tp6m-live-geckoview-google-maps-e10s**
33849        - ❌
33850        - ❌
33851        - ❌
33852        - ❌
33853      * - **browsertime-tp6m-refbrow-google-maps-e10s**
33854        - ❌
33855        - ❌
33856        - ❌
33857        - ❌
33858
33859
33860   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
33861      :widths: 30 15 15 15 15
33862      :header-rows: 1
33863
33864      * - **Test Name**
33865        - mozilla-central
33866        - autoland
33867        - mozilla-release
33868        - mozilla-beta
33869      * - **browsertime-tp6m-chrome-m-google-maps-e10s**
33870        - ❌
33871        - ❌
33872        - ❌
33873        - ❌
33874      * - **browsertime-tp6m-fenix-google-maps-e10s**
33875        - ❌
33876        - ❌
33877        - ❌
33878        - ❌
33879      * - **browsertime-tp6m-geckoview-google-maps-e10s**
33880        - ❌
33881        - ❌
33882        - ❌
33883        - ❌
33884      * - **browsertime-tp6m-live-chrome-m-google-maps-e10s**
33885        - ❌
33886        - ❌
33887        - ❌
33888        - ❌
33889      * - **browsertime-tp6m-live-fenix-google-maps-e10s**
33890        - ❌
33891        - ❌
33892        - ❌
33893        - ❌
33894      * - **browsertime-tp6m-live-geckoview-google-maps-e10s**
33895        - ❌
33896        - ❌
33897        - ❌
33898        - ❌
33899      * - **browsertime-tp6m-refbrow-google-maps-e10s**
33900        - ❌
33901        - ❌
33902        - ❌
33903        - ❌
33904
33905
33906   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
33907      :widths: 30 15 15 15 15
33908      :header-rows: 1
33909
33910      * - **Test Name**
33911        - mozilla-central
33912        - autoland
33913        - mozilla-release
33914        - mozilla-beta
33915      * - **browsertime-tp6m-fenix-google-maps-e10s**
33916        - ❌
33917        - ❌
33918        - ❌
33919        - ❌
33920      * - **browsertime-tp6m-geckoview-google-maps-e10s**
33921        - ❌
33922        - ❌
33923        - ❌
33924        - ❌
33925      * - **browsertime-tp6m-live-fenix-google-maps-e10s**
33926        - ❌
33927        - ❌
33928        - ❌
33929        - ❌
33930      * - **browsertime-tp6m-live-geckoview-google-maps-e10s**
33931        - ❌
33932        - ❌
33933        - ❌
33934        - ❌
33935      * - **browsertime-tp6m-refbrow-google-maps-e10s**
33936        - ❌
33937        - ❌
33938        - ❌
33939        - ❌
33940
33941
33942   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
33943      :widths: 30 15 15 15 15
33944      :header-rows: 1
33945
33946      * - **Test Name**
33947        - mozilla-central
33948        - autoland
33949        - mozilla-release
33950        - mozilla-beta
33951      * - **browsertime-tp6m-chrome-m-google-maps-e10s**
33952        - ❌
33953        - ❌
33954        - ❌
33955        - ❌
33956      * - **browsertime-tp6m-fenix-google-maps-e10s**
33957        - ❌
33958        - ❌
33959        - ❌
33960        - ❌
33961      * - **browsertime-tp6m-geckoview-google-maps-e10s**
33962        - ❌
33963        - ❌
33964        - ❌
33965        - ❌
33966      * - **browsertime-tp6m-live-chrome-m-google-maps-e10s**
33967        - ❌
33968        - ❌
33969        - ❌
33970        - ❌
33971      * - **browsertime-tp6m-live-fenix-google-maps-e10s**
33972        - ❌
33973        - ❌
33974        - ❌
33975        - ❌
33976      * - **browsertime-tp6m-live-geckoview-google-maps-e10s**
33977        - ❌
33978        - ❌
33979        - ❌
33980        - ❌
33981      * - **browsertime-tp6m-refbrow-google-maps-e10s**
33982        - ❌
33983        - ❌
33984        - ❌
33985        - ❌
33986
33987
33988
33989.. dropdown:: google-search-restaurants
33990   :container: + anchor-id-google-search-restaurants-m
33991
33992   **Owner**: PerfTest Team
33993
33994   * **alert on**: fcp, loadtime
33995   * **alert threshold**: 2.0
33996   * **apps**: geckoview, fenix, refbrow, chrome-m
33997   * **browser cycles**: 15
33998   * **expected**: pass
33999   * **login**: true
34000   * **lower is better**: true
34001   * **page cycles**: 25
34002   * **page timeout**: 60000
34003   * **playback**: mitmproxy-android
34004   * **playback pageset manifest**: mitm6-g5-fenix-google-search-restaurants.manifest
34005   * **playback version**: 6.0.2
34006   * **test url**: `<https://www.google.com/search?q=restaurants+near+me>`__
34007   * **type**: pageload
34008   * **unit**: ms
34009   * **use live sites**: false
34010   * **Test Task**:
34011
34012   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
34013      :widths: 30 15 15 15 15
34014      :header-rows: 1
34015
34016      * - **Test Name**
34017        - mozilla-central
34018        - autoland
34019        - mozilla-release
34020        - mozilla-beta
34021      * - **browsertime-tp6m-fenix-google-search-restaurants-e10s**
34022        - ❌
34023        - ❌
34024        - ❌
34025        - ❌
34026      * - **browsertime-tp6m-geckoview-google-search-restaurants-e10s**
34027        - ❌
34028        - ❌
34029        - ❌
34030        - ❌
34031      * - **browsertime-tp6m-live-fenix-google-search-restaurants-e10s**
34032        - ❌
34033        - ❌
34034        - ❌
34035        - ❌
34036      * - **browsertime-tp6m-live-geckoview-google-search-restaurants-e10s**
34037        - ❌
34038        - ❌
34039        - ❌
34040        - ❌
34041      * - **browsertime-tp6m-refbrow-google-search-restaurants-e10s**
34042        - ❌
34043        - ❌
34044        - ❌
34045        - ❌
34046
34047
34048   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
34049      :widths: 30 15 15 15 15
34050      :header-rows: 1
34051
34052      * - **Test Name**
34053        - mozilla-central
34054        - autoland
34055        - mozilla-release
34056        - mozilla-beta
34057      * - **browsertime-tp6m-chrome-m-google-search-restaurants-e10s**
34058        - ❌
34059        - ❌
34060        - ❌
34061        - ❌
34062      * - **browsertime-tp6m-fenix-google-search-restaurants-e10s**
34063        - ❌
34064        - ❌
34065        - ❌
34066        - ❌
34067      * - **browsertime-tp6m-geckoview-google-search-restaurants-e10s**
34068        - ✅
34069        - ✅
34070        - ✅
34071        - ✅
34072      * - **browsertime-tp6m-live-chrome-m-google-search-restaurants-e10s**
34073        - ❌
34074        - ❌
34075        - ❌
34076        - ❌
34077      * - **browsertime-tp6m-live-fenix-google-search-restaurants-e10s**
34078        - ❌
34079        - ❌
34080        - ❌
34081        - ❌
34082      * - **browsertime-tp6m-live-geckoview-google-search-restaurants-e10s**
34083        - ❌
34084        - ❌
34085        - ❌
34086        - ❌
34087      * - **browsertime-tp6m-refbrow-google-search-restaurants-e10s**
34088        - ❌
34089        - ❌
34090        - ❌
34091        - ❌
34092
34093
34094   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
34095      :widths: 30 15 15 15 15
34096      :header-rows: 1
34097
34098      * - **Test Name**
34099        - mozilla-central
34100        - autoland
34101        - mozilla-release
34102        - mozilla-beta
34103      * - **browsertime-tp6m-fenix-google-search-restaurants-e10s**
34104        - ❌
34105        - ❌
34106        - ❌
34107        - ❌
34108      * - **browsertime-tp6m-geckoview-google-search-restaurants-e10s**
34109        - ❌
34110        - ❌
34111        - ❌
34112        - ❌
34113      * - **browsertime-tp6m-live-fenix-google-search-restaurants-e10s**
34114        - ❌
34115        - ❌
34116        - ❌
34117        - ❌
34118      * - **browsertime-tp6m-live-geckoview-google-search-restaurants-e10s**
34119        - ❌
34120        - ❌
34121        - ❌
34122        - ❌
34123      * - **browsertime-tp6m-refbrow-google-search-restaurants-e10s**
34124        - ❌
34125        - ❌
34126        - ❌
34127        - ❌
34128
34129
34130   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
34131      :widths: 30 15 15 15 15
34132      :header-rows: 1
34133
34134      * - **Test Name**
34135        - mozilla-central
34136        - autoland
34137        - mozilla-release
34138        - mozilla-beta
34139      * - **browsertime-tp6m-chrome-m-google-search-restaurants-e10s**
34140        - ❌
34141        - ❌
34142        - ❌
34143        - ❌
34144      * - **browsertime-tp6m-fenix-google-search-restaurants-e10s**
34145        - ❌
34146        - ❌
34147        - ❌
34148        - ❌
34149      * - **browsertime-tp6m-geckoview-google-search-restaurants-e10s**
34150        - ✅
34151        - ✅
34152        - ✅
34153        - ✅
34154      * - **browsertime-tp6m-live-chrome-m-google-search-restaurants-e10s**
34155        - ❌
34156        - ❌
34157        - ❌
34158        - ❌
34159      * - **browsertime-tp6m-live-fenix-google-search-restaurants-e10s**
34160        - ❌
34161        - ❌
34162        - ❌
34163        - ❌
34164      * - **browsertime-tp6m-live-geckoview-google-search-restaurants-e10s**
34165        - ❌
34166        - ❌
34167        - ❌
34168        - ❌
34169      * - **browsertime-tp6m-refbrow-google-search-restaurants-e10s**
34170        - ❌
34171        - ❌
34172        - ❌
34173        - ❌
34174
34175
34176   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
34177      :widths: 30 15 15 15 15
34178      :header-rows: 1
34179
34180      * - **Test Name**
34181        - mozilla-central
34182        - autoland
34183        - mozilla-release
34184        - mozilla-beta
34185      * - **browsertime-tp6m-fenix-google-search-restaurants-e10s**
34186        - ❌
34187        - ❌
34188        - ❌
34189        - ❌
34190      * - **browsertime-tp6m-geckoview-google-search-restaurants-e10s**
34191        - ❌
34192        - ❌
34193        - ❌
34194        - ❌
34195      * - **browsertime-tp6m-live-fenix-google-search-restaurants-e10s**
34196        - ❌
34197        - ❌
34198        - ❌
34199        - ❌
34200      * - **browsertime-tp6m-live-geckoview-google-search-restaurants-e10s**
34201        - ❌
34202        - ❌
34203        - ❌
34204        - ❌
34205      * - **browsertime-tp6m-refbrow-google-search-restaurants-e10s**
34206        - ❌
34207        - ❌
34208        - ❌
34209        - ❌
34210
34211
34212   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
34213      :widths: 30 15 15 15 15
34214      :header-rows: 1
34215
34216      * - **Test Name**
34217        - mozilla-central
34218        - autoland
34219        - mozilla-release
34220        - mozilla-beta
34221      * - **browsertime-tp6m-chrome-m-google-search-restaurants-e10s**
34222        - ❌
34223        - ❌
34224        - ❌
34225        - ❌
34226      * - **browsertime-tp6m-fenix-google-search-restaurants-e10s**
34227        - ❌
34228        - ❌
34229        - ❌
34230        - ❌
34231      * - **browsertime-tp6m-geckoview-google-search-restaurants-e10s**
34232        - ❌
34233        - ❌
34234        - ❌
34235        - ❌
34236      * - **browsertime-tp6m-live-chrome-m-google-search-restaurants-e10s**
34237        - ❌
34238        - ❌
34239        - ❌
34240        - ❌
34241      * - **browsertime-tp6m-live-fenix-google-search-restaurants-e10s**
34242        - ❌
34243        - ❌
34244        - ❌
34245        - ❌
34246      * - **browsertime-tp6m-live-geckoview-google-search-restaurants-e10s**
34247        - ❌
34248        - ❌
34249        - ❌
34250        - ❌
34251      * - **browsertime-tp6m-refbrow-google-search-restaurants-e10s**
34252        - ❌
34253        - ❌
34254        - ❌
34255        - ❌
34256
34257
34258   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
34259      :widths: 30 15 15 15 15
34260      :header-rows: 1
34261
34262      * - **Test Name**
34263        - mozilla-central
34264        - autoland
34265        - mozilla-release
34266        - mozilla-beta
34267      * - **browsertime-tp6m-fenix-google-search-restaurants-e10s**
34268        - ❌
34269        - ❌
34270        - ❌
34271        - ❌
34272      * - **browsertime-tp6m-geckoview-google-search-restaurants-e10s**
34273        - ❌
34274        - ❌
34275        - ❌
34276        - ❌
34277      * - **browsertime-tp6m-live-fenix-google-search-restaurants-e10s**
34278        - ❌
34279        - ❌
34280        - ❌
34281        - ❌
34282      * - **browsertime-tp6m-live-geckoview-google-search-restaurants-e10s**
34283        - ❌
34284        - ❌
34285        - ❌
34286        - ❌
34287      * - **browsertime-tp6m-refbrow-google-search-restaurants-e10s**
34288        - ❌
34289        - ❌
34290        - ❌
34291        - ❌
34292
34293
34294   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
34295      :widths: 30 15 15 15 15
34296      :header-rows: 1
34297
34298      * - **Test Name**
34299        - mozilla-central
34300        - autoland
34301        - mozilla-release
34302        - mozilla-beta
34303      * - **browsertime-tp6m-chrome-m-google-search-restaurants-e10s**
34304        - ❌
34305        - ❌
34306        - ❌
34307        - ❌
34308      * - **browsertime-tp6m-fenix-google-search-restaurants-e10s**
34309        - ❌
34310        - ❌
34311        - ❌
34312        - ❌
34313      * - **browsertime-tp6m-geckoview-google-search-restaurants-e10s**
34314        - ❌
34315        - ❌
34316        - ❌
34317        - ❌
34318      * - **browsertime-tp6m-live-chrome-m-google-search-restaurants-e10s**
34319        - ❌
34320        - ❌
34321        - ❌
34322        - ❌
34323      * - **browsertime-tp6m-live-fenix-google-search-restaurants-e10s**
34324        - ❌
34325        - ❌
34326        - ❌
34327        - ❌
34328      * - **browsertime-tp6m-live-geckoview-google-search-restaurants-e10s**
34329        - ❌
34330        - ❌
34331        - ❌
34332        - ❌
34333      * - **browsertime-tp6m-refbrow-google-search-restaurants-e10s**
34334        - ❌
34335        - ❌
34336        - ❌
34337        - ❌
34338
34339
34340
34341.. dropdown:: imdb
34342   :container: + anchor-id-imdb-m
34343
34344   **Owner**: PerfTest Team
34345
34346   * **alert on**: fcp, loadtime
34347   * **alert threshold**: 2.0
34348   * **apps**: geckoview, fenix, refbrow, chrome-m
34349   * **browser cycles**: 15
34350   * **expected**: pass
34351   * **lower is better**: true
34352   * **page cycles**: 25
34353   * **page timeout**: 60000
34354   * **playback**: mitmproxy-android
34355   * **playback pageset manifest**: mitm6-android-fenix-imdb.manifest
34356   * **playback version**: 6.0.2
34357   * **test url**: `<https://m.imdb.com/>`__
34358   * **type**: pageload
34359   * **unit**: ms
34360   * **use live sites**: false
34361   * **Test Task**:
34362
34363   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
34364      :widths: 30 15 15 15 15
34365      :header-rows: 1
34366
34367      * - **Test Name**
34368        - mozilla-central
34369        - autoland
34370        - mozilla-release
34371        - mozilla-beta
34372      * - **browsertime-tp6m-fenix-imdb-e10s**
34373        - ❌
34374        - ❌
34375        - ❌
34376        - ❌
34377      * - **browsertime-tp6m-geckoview-imdb-e10s**
34378        - ❌
34379        - ❌
34380        - ❌
34381        - ❌
34382      * - **browsertime-tp6m-live-fenix-imdb-e10s**
34383        - ❌
34384        - ❌
34385        - ❌
34386        - ❌
34387      * - **browsertime-tp6m-live-geckoview-imdb-e10s**
34388        - ❌
34389        - ❌
34390        - ❌
34391        - ❌
34392      * - **browsertime-tp6m-refbrow-imdb-e10s**
34393        - ❌
34394        - ❌
34395        - ❌
34396        - ❌
34397
34398
34399   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
34400      :widths: 30 15 15 15 15
34401      :header-rows: 1
34402
34403      * - **Test Name**
34404        - mozilla-central
34405        - autoland
34406        - mozilla-release
34407        - mozilla-beta
34408      * - **browsertime-tp6m-chrome-m-imdb-e10s**
34409        - ❌
34410        - ❌
34411        - ❌
34412        - ❌
34413      * - **browsertime-tp6m-fenix-imdb-e10s**
34414        - ❌
34415        - ❌
34416        - ❌
34417        - ❌
34418      * - **browsertime-tp6m-geckoview-imdb-e10s**
34419        - ✅
34420        - ✅
34421        - ✅
34422        - ✅
34423      * - **browsertime-tp6m-live-chrome-m-imdb-e10s**
34424        - ❌
34425        - ❌
34426        - ❌
34427        - ❌
34428      * - **browsertime-tp6m-live-fenix-imdb-e10s**
34429        - ❌
34430        - ❌
34431        - ❌
34432        - ❌
34433      * - **browsertime-tp6m-live-geckoview-imdb-e10s**
34434        - ❌
34435        - ❌
34436        - ❌
34437        - ❌
34438      * - **browsertime-tp6m-refbrow-imdb-e10s**
34439        - ❌
34440        - ❌
34441        - ❌
34442        - ❌
34443
34444
34445   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
34446      :widths: 30 15 15 15 15
34447      :header-rows: 1
34448
34449      * - **Test Name**
34450        - mozilla-central
34451        - autoland
34452        - mozilla-release
34453        - mozilla-beta
34454      * - **browsertime-tp6m-fenix-imdb-e10s**
34455        - ❌
34456        - ❌
34457        - ❌
34458        - ❌
34459      * - **browsertime-tp6m-geckoview-imdb-e10s**
34460        - ❌
34461        - ❌
34462        - ❌
34463        - ❌
34464      * - **browsertime-tp6m-live-fenix-imdb-e10s**
34465        - ❌
34466        - ❌
34467        - ❌
34468        - ❌
34469      * - **browsertime-tp6m-live-geckoview-imdb-e10s**
34470        - ❌
34471        - ❌
34472        - ❌
34473        - ❌
34474      * - **browsertime-tp6m-refbrow-imdb-e10s**
34475        - ❌
34476        - ❌
34477        - ❌
34478        - ❌
34479
34480
34481   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
34482      :widths: 30 15 15 15 15
34483      :header-rows: 1
34484
34485      * - **Test Name**
34486        - mozilla-central
34487        - autoland
34488        - mozilla-release
34489        - mozilla-beta
34490      * - **browsertime-tp6m-chrome-m-imdb-e10s**
34491        - ❌
34492        - ❌
34493        - ❌
34494        - ❌
34495      * - **browsertime-tp6m-fenix-imdb-e10s**
34496        - ❌
34497        - ❌
34498        - ❌
34499        - ❌
34500      * - **browsertime-tp6m-geckoview-imdb-e10s**
34501        - ✅
34502        - ✅
34503        - ✅
34504        - ✅
34505      * - **browsertime-tp6m-live-chrome-m-imdb-e10s**
34506        - ❌
34507        - ❌
34508        - ❌
34509        - ❌
34510      * - **browsertime-tp6m-live-fenix-imdb-e10s**
34511        - ❌
34512        - ❌
34513        - ❌
34514        - ❌
34515      * - **browsertime-tp6m-live-geckoview-imdb-e10s**
34516        - ❌
34517        - ❌
34518        - ❌
34519        - ❌
34520      * - **browsertime-tp6m-refbrow-imdb-e10s**
34521        - ❌
34522        - ❌
34523        - ❌
34524        - ❌
34525
34526
34527   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
34528      :widths: 30 15 15 15 15
34529      :header-rows: 1
34530
34531      * - **Test Name**
34532        - mozilla-central
34533        - autoland
34534        - mozilla-release
34535        - mozilla-beta
34536      * - **browsertime-tp6m-fenix-imdb-e10s**
34537        - ❌
34538        - ❌
34539        - ❌
34540        - ❌
34541      * - **browsertime-tp6m-geckoview-imdb-e10s**
34542        - ❌
34543        - ❌
34544        - ❌
34545        - ❌
34546      * - **browsertime-tp6m-live-fenix-imdb-e10s**
34547        - ❌
34548        - ❌
34549        - ❌
34550        - ❌
34551      * - **browsertime-tp6m-live-geckoview-imdb-e10s**
34552        - ❌
34553        - ❌
34554        - ❌
34555        - ❌
34556      * - **browsertime-tp6m-refbrow-imdb-e10s**
34557        - ❌
34558        - ❌
34559        - ❌
34560        - ❌
34561
34562
34563   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
34564      :widths: 30 15 15 15 15
34565      :header-rows: 1
34566
34567      * - **Test Name**
34568        - mozilla-central
34569        - autoland
34570        - mozilla-release
34571        - mozilla-beta
34572      * - **browsertime-tp6m-chrome-m-imdb-e10s**
34573        - ❌
34574        - ❌
34575        - ❌
34576        - ❌
34577      * - **browsertime-tp6m-fenix-imdb-e10s**
34578        - ❌
34579        - ❌
34580        - ❌
34581        - ❌
34582      * - **browsertime-tp6m-geckoview-imdb-e10s**
34583        - ❌
34584        - ❌
34585        - ❌
34586        - ❌
34587      * - **browsertime-tp6m-live-chrome-m-imdb-e10s**
34588        - ❌
34589        - ❌
34590        - ❌
34591        - ❌
34592      * - **browsertime-tp6m-live-fenix-imdb-e10s**
34593        - ❌
34594        - ❌
34595        - ❌
34596        - ❌
34597      * - **browsertime-tp6m-live-geckoview-imdb-e10s**
34598        - ❌
34599        - ❌
34600        - ❌
34601        - ❌
34602      * - **browsertime-tp6m-refbrow-imdb-e10s**
34603        - ❌
34604        - ❌
34605        - ❌
34606        - ❌
34607
34608
34609   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
34610      :widths: 30 15 15 15 15
34611      :header-rows: 1
34612
34613      * - **Test Name**
34614        - mozilla-central
34615        - autoland
34616        - mozilla-release
34617        - mozilla-beta
34618      * - **browsertime-tp6m-fenix-imdb-e10s**
34619        - ❌
34620        - ❌
34621        - ❌
34622        - ❌
34623      * - **browsertime-tp6m-geckoview-imdb-e10s**
34624        - ❌
34625        - ❌
34626        - ❌
34627        - ❌
34628      * - **browsertime-tp6m-live-fenix-imdb-e10s**
34629        - ❌
34630        - ❌
34631        - ❌
34632        - ❌
34633      * - **browsertime-tp6m-live-geckoview-imdb-e10s**
34634        - ❌
34635        - ❌
34636        - ❌
34637        - ❌
34638      * - **browsertime-tp6m-refbrow-imdb-e10s**
34639        - ❌
34640        - ❌
34641        - ❌
34642        - ❌
34643
34644
34645   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
34646      :widths: 30 15 15 15 15
34647      :header-rows: 1
34648
34649      * - **Test Name**
34650        - mozilla-central
34651        - autoland
34652        - mozilla-release
34653        - mozilla-beta
34654      * - **browsertime-tp6m-chrome-m-imdb-e10s**
34655        - ❌
34656        - ❌
34657        - ❌
34658        - ❌
34659      * - **browsertime-tp6m-fenix-imdb-e10s**
34660        - ❌
34661        - ❌
34662        - ❌
34663        - ❌
34664      * - **browsertime-tp6m-geckoview-imdb-e10s**
34665        - ❌
34666        - ❌
34667        - ❌
34668        - ❌
34669      * - **browsertime-tp6m-live-chrome-m-imdb-e10s**
34670        - ❌
34671        - ❌
34672        - ❌
34673        - ❌
34674      * - **browsertime-tp6m-live-fenix-imdb-e10s**
34675        - ❌
34676        - ❌
34677        - ❌
34678        - ❌
34679      * - **browsertime-tp6m-live-geckoview-imdb-e10s**
34680        - ❌
34681        - ❌
34682        - ❌
34683        - ❌
34684      * - **browsertime-tp6m-refbrow-imdb-e10s**
34685        - ❌
34686        - ❌
34687        - ❌
34688        - ❌
34689
34690
34691   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
34692      :widths: 30 15 15 15 15
34693      :header-rows: 1
34694
34695      * - **Test Name**
34696        - mozilla-central
34697        - autoland
34698        - mozilla-release
34699        - mozilla-beta
34700      * - **browsertime-tp6-firefox-imdb-e10s**
34701        - ❌
34702        - ❌
34703        - ❌
34704        - ❌
34705      * - **browsertime-tp6-firefox-imdb-fis-e10s**
34706        - ❌
34707        - ❌
34708        - ❌
34709        - ❌
34710      * - **browsertime-tp6-live-firefox-imdb-e10s**
34711        - ❌
34712        - ❌
34713        - ❌
34714        - ❌
34715      * - **browsertime-tp6-live-firefox-imdb-fis-e10s**
34716        - ❌
34717        - ❌
34718        - ❌
34719        - ❌
34720
34721
34722   .. list-table:: **test-linux1804-64-qr/opt**
34723      :widths: 30 15 15 15 15
34724      :header-rows: 1
34725
34726      * - **Test Name**
34727        - mozilla-central
34728        - autoland
34729        - mozilla-release
34730        - mozilla-beta
34731      * - **browsertime-tp6-firefox-imdb-e10s**
34732        - ❌
34733        - ❌
34734        - ❌
34735        - ❌
34736      * - **browsertime-tp6-firefox-imdb-fis-e10s**
34737        - ❌
34738        - ❌
34739        - ❌
34740        - ❌
34741      * - **browsertime-tp6-live-firefox-imdb-e10s**
34742        - ❌
34743        - ❌
34744        - ❌
34745        - ❌
34746      * - **browsertime-tp6-live-firefox-imdb-fis-e10s**
34747        - ❌
34748        - ❌
34749        - ❌
34750        - ❌
34751
34752
34753   .. list-table:: **test-linux1804-64-shippable-qr/opt**
34754      :widths: 30 15 15 15 15
34755      :header-rows: 1
34756
34757      * - **Test Name**
34758        - mozilla-central
34759        - autoland
34760        - mozilla-release
34761        - mozilla-beta
34762      * - **browsertime-tp6-chrome-imdb-e10s**
34763        - ❌
34764        - ❌
34765        - ❌
34766        - ❌
34767      * - **browsertime-tp6-chromium-imdb-e10s**
34768        - ❌
34769        - ❌
34770        - ❌
34771        - ❌
34772      * - **browsertime-tp6-firefox-imdb-e10s**
34773        - ❌
34774        - ❌
34775        - ❌
34776        - ❌
34777      * - **browsertime-tp6-firefox-imdb-fis-e10s**
34778        - ✅
34779        - ✅
34780        - ✅
34781        - ✅
34782      * - **browsertime-tp6-live-chrome-imdb-e10s**
34783        - ❌
34784        - ❌
34785        - ❌
34786        - ❌
34787      * - **browsertime-tp6-live-chromium-imdb-e10s**
34788        - ❌
34789        - ❌
34790        - ❌
34791        - ❌
34792      * - **browsertime-tp6-live-firefox-imdb-e10s**
34793        - ❌
34794        - ❌
34795        - ❌
34796        - ❌
34797      * - **browsertime-tp6-live-firefox-imdb-fis-e10s**
34798        - ❌
34799        - ❌
34800        - ❌
34801        - ❌
34802
34803
34804   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
34805      :widths: 30 15 15 15 15
34806      :header-rows: 1
34807
34808      * - **Test Name**
34809        - mozilla-central
34810        - autoland
34811        - mozilla-release
34812        - mozilla-beta
34813      * - **browsertime-tp6-chrome-imdb-e10s**
34814        - ❌
34815        - ❌
34816        - ❌
34817        - ❌
34818      * - **browsertime-tp6-chromium-imdb-e10s**
34819        - ❌
34820        - ❌
34821        - ❌
34822        - ❌
34823      * - **browsertime-tp6-firefox-imdb-e10s**
34824        - ❌
34825        - ❌
34826        - ❌
34827        - ❌
34828      * - **browsertime-tp6-firefox-imdb-fis-e10s**
34829        - ✅
34830        - ✅
34831        - ✅
34832        - ✅
34833      * - **browsertime-tp6-live-chrome-imdb-e10s**
34834        - ❌
34835        - ❌
34836        - ❌
34837        - ❌
34838      * - **browsertime-tp6-live-chromium-imdb-e10s**
34839        - ❌
34840        - ❌
34841        - ❌
34842        - ❌
34843      * - **browsertime-tp6-live-firefox-imdb-e10s**
34844        - ❌
34845        - ❌
34846        - ❌
34847        - ❌
34848      * - **browsertime-tp6-live-firefox-imdb-fis-e10s**
34849        - ❌
34850        - ❌
34851        - ❌
34852        - ❌
34853
34854
34855   .. list-table:: **test-windows10-32-qr/opt**
34856      :widths: 30 15 15 15 15
34857      :header-rows: 1
34858
34859      * - **Test Name**
34860        - mozilla-central
34861        - autoland
34862        - mozilla-release
34863        - mozilla-beta
34864      * - **browsertime-tp6-firefox-imdb-e10s**
34865        - ❌
34866        - ❌
34867        - ❌
34868        - ❌
34869      * - **browsertime-tp6-firefox-imdb-fis-e10s**
34870        - ❌
34871        - ❌
34872        - ❌
34873        - ❌
34874      * - **browsertime-tp6-live-firefox-imdb-e10s**
34875        - ❌
34876        - ❌
34877        - ❌
34878        - ❌
34879      * - **browsertime-tp6-live-firefox-imdb-fis-e10s**
34880        - ❌
34881        - ❌
34882        - ❌
34883        - ❌
34884
34885
34886   .. list-table:: **test-windows10-32-shippable-qr/opt**
34887      :widths: 30 15 15 15 15
34888      :header-rows: 1
34889
34890      * - **Test Name**
34891        - mozilla-central
34892        - autoland
34893        - mozilla-release
34894        - mozilla-beta
34895      * - **browsertime-tp6-chrome-imdb-e10s**
34896        - ❌
34897        - ❌
34898        - ❌
34899        - ❌
34900      * - **browsertime-tp6-chromium-imdb-e10s**
34901        - ❌
34902        - ❌
34903        - ❌
34904        - ❌
34905      * - **browsertime-tp6-firefox-imdb-e10s**
34906        - ❌
34907        - ❌
34908        - ❌
34909        - ❌
34910      * - **browsertime-tp6-firefox-imdb-fis-e10s**
34911        - ❌
34912        - ❌
34913        - ❌
34914        - ❌
34915      * - **browsertime-tp6-live-chrome-imdb-e10s**
34916        - ❌
34917        - ❌
34918        - ❌
34919        - ❌
34920      * - **browsertime-tp6-live-chromium-imdb-e10s**
34921        - ❌
34922        - ❌
34923        - ❌
34924        - ❌
34925      * - **browsertime-tp6-live-firefox-imdb-e10s**
34926        - ❌
34927        - ❌
34928        - ❌
34929        - ❌
34930      * - **browsertime-tp6-live-firefox-imdb-fis-e10s**
34931        - ❌
34932        - ❌
34933        - ❌
34934        - ❌
34935
34936
34937   .. list-table:: **test-windows10-64-qr/opt**
34938      :widths: 30 15 15 15 15
34939      :header-rows: 1
34940
34941      * - **Test Name**
34942        - mozilla-central
34943        - autoland
34944        - mozilla-release
34945        - mozilla-beta
34946      * - **browsertime-tp6-firefox-imdb-e10s**
34947        - ❌
34948        - ❌
34949        - ❌
34950        - ❌
34951      * - **browsertime-tp6-firefox-imdb-fis-e10s**
34952        - ❌
34953        - ❌
34954        - ❌
34955        - ❌
34956      * - **browsertime-tp6-live-firefox-imdb-e10s**
34957        - ❌
34958        - ❌
34959        - ❌
34960        - ❌
34961      * - **browsertime-tp6-live-firefox-imdb-fis-e10s**
34962        - ❌
34963        - ❌
34964        - ❌
34965        - ❌
34966
34967
34968   .. list-table:: **test-windows10-64-shippable-qr/opt**
34969      :widths: 30 15 15 15 15
34970      :header-rows: 1
34971
34972      * - **Test Name**
34973        - mozilla-central
34974        - autoland
34975        - mozilla-release
34976        - mozilla-beta
34977      * - **browsertime-tp6-chrome-imdb-e10s**
34978        - ❌
34979        - ❌
34980        - ❌
34981        - ❌
34982      * - **browsertime-tp6-chromium-imdb-e10s**
34983        - ❌
34984        - ❌
34985        - ❌
34986        - ❌
34987      * - **browsertime-tp6-firefox-imdb-e10s**
34988        - ❌
34989        - ❌
34990        - ❌
34991        - ❌
34992      * - **browsertime-tp6-firefox-imdb-fis-e10s**
34993        - ✅
34994        - ✅
34995        - ✅
34996        - ✅
34997      * - **browsertime-tp6-live-chrome-imdb-e10s**
34998        - ❌
34999        - ❌
35000        - ❌
35001        - ❌
35002      * - **browsertime-tp6-live-chromium-imdb-e10s**
35003        - ❌
35004        - ❌
35005        - ❌
35006        - ❌
35007      * - **browsertime-tp6-live-firefox-imdb-e10s**
35008        - ❌
35009        - ❌
35010        - ❌
35011        - ❌
35012      * - **browsertime-tp6-live-firefox-imdb-fis-e10s**
35013        - ❌
35014        - ❌
35015        - ❌
35016        - ❌
35017
35018
35019
35020.. dropdown:: instagram
35021   :container: + anchor-id-instagram-m
35022
35023   **Owner**: PerfTest Team
35024
35025   * **alert on**: fcp, loadtime
35026   * **alert threshold**: 2.0
35027   * **apps**: geckoview, fenix, refbrow, chrome-m
35028   * **browser cycles**: 15
35029   * **expected**: pass
35030   * **login**: true
35031   * **lower is better**: true
35032   * **page cycles**: 25
35033   * **page timeout**: 60000
35034   * **playback**: mitmproxy-android
35035   * **playback pageset manifest**: mitm6-g5-fenix-instagram.manifest
35036   * **playback version**: 6.0.2
35037   * **test url**: `<https://www.instagram.com>`__
35038   * **type**: pageload
35039   * **unit**: ms
35040   * **use live sites**: false
35041   * **Test Task**:
35042
35043   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
35044      :widths: 30 15 15 15 15
35045      :header-rows: 1
35046
35047      * - **Test Name**
35048        - mozilla-central
35049        - autoland
35050        - mozilla-release
35051        - mozilla-beta
35052      * - **browsertime-tp6m-fenix-instagram-e10s**
35053        - ❌
35054        - ❌
35055        - ❌
35056        - ❌
35057      * - **browsertime-tp6m-geckoview-instagram-e10s**
35058        - ❌
35059        - ❌
35060        - ❌
35061        - ❌
35062      * - **browsertime-tp6m-live-fenix-instagram-e10s**
35063        - ❌
35064        - ❌
35065        - ❌
35066        - ❌
35067      * - **browsertime-tp6m-live-geckoview-instagram-e10s**
35068        - ❌
35069        - ❌
35070        - ❌
35071        - ❌
35072      * - **browsertime-tp6m-refbrow-instagram-e10s**
35073        - ❌
35074        - ❌
35075        - ❌
35076        - ❌
35077
35078
35079   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
35080      :widths: 30 15 15 15 15
35081      :header-rows: 1
35082
35083      * - **Test Name**
35084        - mozilla-central
35085        - autoland
35086        - mozilla-release
35087        - mozilla-beta
35088      * - **browsertime-tp6m-chrome-m-instagram-e10s**
35089        - ❌
35090        - ❌
35091        - ❌
35092        - ❌
35093      * - **browsertime-tp6m-fenix-instagram-e10s**
35094        - ❌
35095        - ❌
35096        - ❌
35097        - ❌
35098      * - **browsertime-tp6m-geckoview-instagram-e10s**
35099        - ✅
35100        - ✅
35101        - ✅
35102        - ✅
35103      * - **browsertime-tp6m-live-chrome-m-instagram-e10s**
35104        - ❌
35105        - ❌
35106        - ❌
35107        - ❌
35108      * - **browsertime-tp6m-live-fenix-instagram-e10s**
35109        - ❌
35110        - ❌
35111        - ❌
35112        - ❌
35113      * - **browsertime-tp6m-live-geckoview-instagram-e10s**
35114        - ❌
35115        - ❌
35116        - ❌
35117        - ❌
35118      * - **browsertime-tp6m-refbrow-instagram-e10s**
35119        - ❌
35120        - ❌
35121        - ❌
35122        - ❌
35123
35124
35125   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
35126      :widths: 30 15 15 15 15
35127      :header-rows: 1
35128
35129      * - **Test Name**
35130        - mozilla-central
35131        - autoland
35132        - mozilla-release
35133        - mozilla-beta
35134      * - **browsertime-tp6m-fenix-instagram-e10s**
35135        - ❌
35136        - ❌
35137        - ❌
35138        - ❌
35139      * - **browsertime-tp6m-geckoview-instagram-e10s**
35140        - ❌
35141        - ❌
35142        - ❌
35143        - ❌
35144      * - **browsertime-tp6m-live-fenix-instagram-e10s**
35145        - ❌
35146        - ❌
35147        - ❌
35148        - ❌
35149      * - **browsertime-tp6m-live-geckoview-instagram-e10s**
35150        - ❌
35151        - ❌
35152        - ❌
35153        - ❌
35154      * - **browsertime-tp6m-refbrow-instagram-e10s**
35155        - ❌
35156        - ❌
35157        - ❌
35158        - ❌
35159
35160
35161   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
35162      :widths: 30 15 15 15 15
35163      :header-rows: 1
35164
35165      * - **Test Name**
35166        - mozilla-central
35167        - autoland
35168        - mozilla-release
35169        - mozilla-beta
35170      * - **browsertime-tp6m-chrome-m-instagram-e10s**
35171        - ❌
35172        - ❌
35173        - ❌
35174        - ❌
35175      * - **browsertime-tp6m-fenix-instagram-e10s**
35176        - ❌
35177        - ❌
35178        - ❌
35179        - ❌
35180      * - **browsertime-tp6m-geckoview-instagram-e10s**
35181        - ✅
35182        - ✅
35183        - ✅
35184        - ✅
35185      * - **browsertime-tp6m-live-chrome-m-instagram-e10s**
35186        - ❌
35187        - ❌
35188        - ❌
35189        - ❌
35190      * - **browsertime-tp6m-live-fenix-instagram-e10s**
35191        - ❌
35192        - ❌
35193        - ❌
35194        - ❌
35195      * - **browsertime-tp6m-live-geckoview-instagram-e10s**
35196        - ❌
35197        - ❌
35198        - ❌
35199        - ❌
35200      * - **browsertime-tp6m-refbrow-instagram-e10s**
35201        - ❌
35202        - ❌
35203        - ❌
35204        - ❌
35205
35206
35207   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
35208      :widths: 30 15 15 15 15
35209      :header-rows: 1
35210
35211      * - **Test Name**
35212        - mozilla-central
35213        - autoland
35214        - mozilla-release
35215        - mozilla-beta
35216      * - **browsertime-tp6m-fenix-instagram-e10s**
35217        - ❌
35218        - ❌
35219        - ❌
35220        - ❌
35221      * - **browsertime-tp6m-geckoview-instagram-e10s**
35222        - ❌
35223        - ❌
35224        - ❌
35225        - ❌
35226      * - **browsertime-tp6m-live-fenix-instagram-e10s**
35227        - ❌
35228        - ❌
35229        - ❌
35230        - ❌
35231      * - **browsertime-tp6m-live-geckoview-instagram-e10s**
35232        - ❌
35233        - ❌
35234        - ❌
35235        - ❌
35236      * - **browsertime-tp6m-refbrow-instagram-e10s**
35237        - ❌
35238        - ❌
35239        - ❌
35240        - ❌
35241
35242
35243   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
35244      :widths: 30 15 15 15 15
35245      :header-rows: 1
35246
35247      * - **Test Name**
35248        - mozilla-central
35249        - autoland
35250        - mozilla-release
35251        - mozilla-beta
35252      * - **browsertime-tp6m-chrome-m-instagram-e10s**
35253        - ❌
35254        - ❌
35255        - ❌
35256        - ❌
35257      * - **browsertime-tp6m-fenix-instagram-e10s**
35258        - ❌
35259        - ❌
35260        - ❌
35261        - ❌
35262      * - **browsertime-tp6m-geckoview-instagram-e10s**
35263        - ❌
35264        - ❌
35265        - ❌
35266        - ❌
35267      * - **browsertime-tp6m-live-chrome-m-instagram-e10s**
35268        - ❌
35269        - ❌
35270        - ❌
35271        - ❌
35272      * - **browsertime-tp6m-live-fenix-instagram-e10s**
35273        - ❌
35274        - ❌
35275        - ❌
35276        - ❌
35277      * - **browsertime-tp6m-live-geckoview-instagram-e10s**
35278        - ❌
35279        - ❌
35280        - ❌
35281        - ❌
35282      * - **browsertime-tp6m-refbrow-instagram-e10s**
35283        - ❌
35284        - ❌
35285        - ❌
35286        - ❌
35287
35288
35289   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
35290      :widths: 30 15 15 15 15
35291      :header-rows: 1
35292
35293      * - **Test Name**
35294        - mozilla-central
35295        - autoland
35296        - mozilla-release
35297        - mozilla-beta
35298      * - **browsertime-tp6m-fenix-instagram-e10s**
35299        - ❌
35300        - ❌
35301        - ❌
35302        - ❌
35303      * - **browsertime-tp6m-geckoview-instagram-e10s**
35304        - ❌
35305        - ❌
35306        - ❌
35307        - ❌
35308      * - **browsertime-tp6m-live-fenix-instagram-e10s**
35309        - ❌
35310        - ❌
35311        - ❌
35312        - ❌
35313      * - **browsertime-tp6m-live-geckoview-instagram-e10s**
35314        - ❌
35315        - ❌
35316        - ❌
35317        - ❌
35318      * - **browsertime-tp6m-refbrow-instagram-e10s**
35319        - ❌
35320        - ❌
35321        - ❌
35322        - ❌
35323
35324
35325   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
35326      :widths: 30 15 15 15 15
35327      :header-rows: 1
35328
35329      * - **Test Name**
35330        - mozilla-central
35331        - autoland
35332        - mozilla-release
35333        - mozilla-beta
35334      * - **browsertime-tp6m-chrome-m-instagram-e10s**
35335        - ❌
35336        - ❌
35337        - ❌
35338        - ❌
35339      * - **browsertime-tp6m-fenix-instagram-e10s**
35340        - ❌
35341        - ❌
35342        - ❌
35343        - ❌
35344      * - **browsertime-tp6m-geckoview-instagram-e10s**
35345        - ❌
35346        - ❌
35347        - ❌
35348        - ❌
35349      * - **browsertime-tp6m-live-chrome-m-instagram-e10s**
35350        - ❌
35351        - ❌
35352        - ❌
35353        - ❌
35354      * - **browsertime-tp6m-live-fenix-instagram-e10s**
35355        - ❌
35356        - ❌
35357        - ❌
35358        - ❌
35359      * - **browsertime-tp6m-live-geckoview-instagram-e10s**
35360        - ❌
35361        - ❌
35362        - ❌
35363        - ❌
35364      * - **browsertime-tp6m-refbrow-instagram-e10s**
35365        - ❌
35366        - ❌
35367        - ❌
35368        - ❌
35369
35370
35371   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
35372      :widths: 30 15 15 15 15
35373      :header-rows: 1
35374
35375      * - **Test Name**
35376        - mozilla-central
35377        - autoland
35378        - mozilla-release
35379        - mozilla-beta
35380      * - **browsertime-tp6-essential-firefox-instagram-e10s**
35381        - ❌
35382        - ❌
35383        - ❌
35384        - ❌
35385      * - **browsertime-tp6-essential-firefox-instagram-fis-e10s**
35386        - ❌
35387        - ❌
35388        - ❌
35389        - ❌
35390
35391
35392   .. list-table:: **test-linux1804-64-qr/opt**
35393      :widths: 30 15 15 15 15
35394      :header-rows: 1
35395
35396      * - **Test Name**
35397        - mozilla-central
35398        - autoland
35399        - mozilla-release
35400        - mozilla-beta
35401      * - **browsertime-tp6-essential-firefox-instagram-e10s**
35402        - ❌
35403        - ❌
35404        - ❌
35405        - ❌
35406      * - **browsertime-tp6-essential-firefox-instagram-fis-e10s**
35407        - ❌
35408        - ❌
35409        - ❌
35410        - ❌
35411
35412
35413   .. list-table:: **test-linux1804-64-shippable-qr/opt**
35414      :widths: 30 15 15 15 15
35415      :header-rows: 1
35416
35417      * - **Test Name**
35418        - mozilla-central
35419        - autoland
35420        - mozilla-release
35421        - mozilla-beta
35422      * - **browsertime-tp6-essential-chrome-instagram-e10s**
35423        - ❌
35424        - ❌
35425        - ❌
35426        - ❌
35427      * - **browsertime-tp6-essential-chromium-instagram-e10s**
35428        - ❌
35429        - ❌
35430        - ❌
35431        - ❌
35432      * - **browsertime-tp6-essential-firefox-instagram-e10s**
35433        - ❌
35434        - ❌
35435        - ❌
35436        - ❌
35437      * - **browsertime-tp6-essential-firefox-instagram-fis-e10s**
35438        - ✅
35439        - ✅
35440        - ✅
35441        - ✅
35442
35443
35444   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
35445      :widths: 30 15 15 15 15
35446      :header-rows: 1
35447
35448      * - **Test Name**
35449        - mozilla-central
35450        - autoland
35451        - mozilla-release
35452        - mozilla-beta
35453      * - **browsertime-tp6-essential-chrome-instagram-e10s**
35454        - ❌
35455        - ❌
35456        - ❌
35457        - ❌
35458      * - **browsertime-tp6-essential-chromium-instagram-e10s**
35459        - ❌
35460        - ❌
35461        - ❌
35462        - ❌
35463      * - **browsertime-tp6-essential-firefox-instagram-e10s**
35464        - ❌
35465        - ❌
35466        - ❌
35467        - ❌
35468      * - **browsertime-tp6-essential-firefox-instagram-fis-e10s**
35469        - ✅
35470        - ✅
35471        - ✅
35472        - ✅
35473
35474
35475   .. list-table:: **test-windows10-32-qr/opt**
35476      :widths: 30 15 15 15 15
35477      :header-rows: 1
35478
35479      * - **Test Name**
35480        - mozilla-central
35481        - autoland
35482        - mozilla-release
35483        - mozilla-beta
35484      * - **browsertime-tp6-essential-firefox-instagram-e10s**
35485        - ❌
35486        - ❌
35487        - ❌
35488        - ❌
35489      * - **browsertime-tp6-essential-firefox-instagram-fis-e10s**
35490        - ❌
35491        - ❌
35492        - ❌
35493        - ❌
35494
35495
35496   .. list-table:: **test-windows10-32-shippable-qr/opt**
35497      :widths: 30 15 15 15 15
35498      :header-rows: 1
35499
35500      * - **Test Name**
35501        - mozilla-central
35502        - autoland
35503        - mozilla-release
35504        - mozilla-beta
35505      * - **browsertime-tp6-essential-chrome-instagram-e10s**
35506        - ❌
35507        - ❌
35508        - ❌
35509        - ❌
35510      * - **browsertime-tp6-essential-chromium-instagram-e10s**
35511        - ❌
35512        - ❌
35513        - ❌
35514        - ❌
35515      * - **browsertime-tp6-essential-firefox-instagram-e10s**
35516        - ❌
35517        - ❌
35518        - ❌
35519        - ❌
35520      * - **browsertime-tp6-essential-firefox-instagram-fis-e10s**
35521        - ❌
35522        - ❌
35523        - ❌
35524        - ❌
35525
35526
35527   .. list-table:: **test-windows10-64-qr/opt**
35528      :widths: 30 15 15 15 15
35529      :header-rows: 1
35530
35531      * - **Test Name**
35532        - mozilla-central
35533        - autoland
35534        - mozilla-release
35535        - mozilla-beta
35536      * - **browsertime-tp6-essential-firefox-instagram-e10s**
35537        - ❌
35538        - ❌
35539        - ❌
35540        - ❌
35541      * - **browsertime-tp6-essential-firefox-instagram-fis-e10s**
35542        - ❌
35543        - ❌
35544        - ❌
35545        - ❌
35546
35547
35548   .. list-table:: **test-windows10-64-shippable-qr/opt**
35549      :widths: 30 15 15 15 15
35550      :header-rows: 1
35551
35552      * - **Test Name**
35553        - mozilla-central
35554        - autoland
35555        - mozilla-release
35556        - mozilla-beta
35557      * - **browsertime-tp6-essential-chrome-instagram-e10s**
35558        - ❌
35559        - ❌
35560        - ❌
35561        - ❌
35562      * - **browsertime-tp6-essential-chromium-instagram-e10s**
35563        - ❌
35564        - ❌
35565        - ❌
35566        - ❌
35567      * - **browsertime-tp6-essential-firefox-instagram-e10s**
35568        - ❌
35569        - ❌
35570        - ❌
35571        - ❌
35572      * - **browsertime-tp6-essential-firefox-instagram-fis-e10s**
35573        - ✅
35574        - ✅
35575        - ✅
35576        - ✅
35577
35578
35579
35580.. dropdown:: microsoft-support
35581   :container: + anchor-id-microsoft-support-m
35582
35583   **Owner**: PerfTest Team
35584
35585   * **alert on**: fcp, loadtime
35586   * **alert threshold**: 2.0
35587   * **apps**: geckoview, fenix, refbrow, chrome-m
35588   * **browser cycles**: 15
35589   * **expected**: pass
35590   * **lower is better**: true
35591   * **page cycles**: 25
35592   * **page timeout**: 60000
35593   * **playback**: mitmproxy-android
35594   * **playback pageset manifest**: mitm6-android-fenix-microsoft-support.manifest
35595   * **playback version**: 6.0.2
35596   * **test url**: `<https://support.microsoft.com/en-us>`__
35597   * **type**: pageload
35598   * **unit**: ms
35599   * **use live sites**: false
35600   * **Test Task**:
35601
35602   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
35603      :widths: 30 15 15 15 15
35604      :header-rows: 1
35605
35606      * - **Test Name**
35607        - mozilla-central
35608        - autoland
35609        - mozilla-release
35610        - mozilla-beta
35611      * - **browsertime-tp6m-essential-fenix-microsoft-support-e10s**
35612        - ❌
35613        - ❌
35614        - ❌
35615        - ❌
35616      * - **browsertime-tp6m-essential-geckoview-microsoft-support-e10s**
35617        - ❌
35618        - ❌
35619        - ❌
35620        - ❌
35621      * - **browsertime-tp6m-essential-refbrow-microsoft-support-e10s**
35622        - ❌
35623        - ❌
35624        - ❌
35625        - ❌
35626      * - **browsertime-tp6m-live-fenix-microsoft-support-e10s**
35627        - ❌
35628        - ❌
35629        - ❌
35630        - ❌
35631      * - **browsertime-tp6m-live-geckoview-microsoft-support-e10s**
35632        - ❌
35633        - ❌
35634        - ❌
35635        - ❌
35636
35637
35638   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
35639      :widths: 30 15 15 15 15
35640      :header-rows: 1
35641
35642      * - **Test Name**
35643        - mozilla-central
35644        - autoland
35645        - mozilla-release
35646        - mozilla-beta
35647      * - **browsertime-tp6m-essential-chrome-m-microsoft-support-e10s**
35648        - ❌
35649        - ❌
35650        - ❌
35651        - ❌
35652      * - **browsertime-tp6m-essential-fenix-microsoft-support-e10s**
35653        - ❌
35654        - ❌
35655        - ❌
35656        - ❌
35657      * - **browsertime-tp6m-essential-geckoview-microsoft-support-e10s**
35658        - ✅
35659        - ✅
35660        - ✅
35661        - ✅
35662      * - **browsertime-tp6m-essential-refbrow-microsoft-support-e10s**
35663        - ❌
35664        - ❌
35665        - ❌
35666        - ❌
35667      * - **browsertime-tp6m-live-chrome-m-microsoft-support-e10s**
35668        - ❌
35669        - ❌
35670        - ❌
35671        - ❌
35672      * - **browsertime-tp6m-live-fenix-microsoft-support-e10s**
35673        - ❌
35674        - ❌
35675        - ❌
35676        - ❌
35677      * - **browsertime-tp6m-live-geckoview-microsoft-support-e10s**
35678        - ❌
35679        - ❌
35680        - ❌
35681        - ❌
35682
35683
35684   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
35685      :widths: 30 15 15 15 15
35686      :header-rows: 1
35687
35688      * - **Test Name**
35689        - mozilla-central
35690        - autoland
35691        - mozilla-release
35692        - mozilla-beta
35693      * - **browsertime-tp6m-essential-fenix-microsoft-support-e10s**
35694        - ❌
35695        - ❌
35696        - ❌
35697        - ❌
35698      * - **browsertime-tp6m-essential-geckoview-microsoft-support-e10s**
35699        - ❌
35700        - ❌
35701        - ❌
35702        - ❌
35703      * - **browsertime-tp6m-essential-refbrow-microsoft-support-e10s**
35704        - ❌
35705        - ❌
35706        - ❌
35707        - ❌
35708      * - **browsertime-tp6m-live-fenix-microsoft-support-e10s**
35709        - ❌
35710        - ❌
35711        - ❌
35712        - ❌
35713      * - **browsertime-tp6m-live-geckoview-microsoft-support-e10s**
35714        - ❌
35715        - ❌
35716        - ❌
35717        - ❌
35718
35719
35720   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
35721      :widths: 30 15 15 15 15
35722      :header-rows: 1
35723
35724      * - **Test Name**
35725        - mozilla-central
35726        - autoland
35727        - mozilla-release
35728        - mozilla-beta
35729      * - **browsertime-tp6m-essential-chrome-m-microsoft-support-e10s**
35730        - ❌
35731        - ❌
35732        - ❌
35733        - ❌
35734      * - **browsertime-tp6m-essential-fenix-microsoft-support-e10s**
35735        - ❌
35736        - ❌
35737        - ❌
35738        - ❌
35739      * - **browsertime-tp6m-essential-geckoview-microsoft-support-e10s**
35740        - ✅
35741        - ✅
35742        - ✅
35743        - ✅
35744      * - **browsertime-tp6m-essential-refbrow-microsoft-support-e10s**
35745        - ❌
35746        - ❌
35747        - ❌
35748        - ❌
35749      * - **browsertime-tp6m-live-chrome-m-microsoft-support-e10s**
35750        - ❌
35751        - ❌
35752        - ❌
35753        - ❌
35754      * - **browsertime-tp6m-live-fenix-microsoft-support-e10s**
35755        - ❌
35756        - ❌
35757        - ❌
35758        - ❌
35759      * - **browsertime-tp6m-live-geckoview-microsoft-support-e10s**
35760        - ❌
35761        - ❌
35762        - ❌
35763        - ❌
35764
35765
35766   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
35767      :widths: 30 15 15 15 15
35768      :header-rows: 1
35769
35770      * - **Test Name**
35771        - mozilla-central
35772        - autoland
35773        - mozilla-release
35774        - mozilla-beta
35775      * - **browsertime-tp6m-essential-fenix-microsoft-support-e10s**
35776        - ❌
35777        - ❌
35778        - ❌
35779        - ❌
35780      * - **browsertime-tp6m-essential-geckoview-microsoft-support-e10s**
35781        - ❌
35782        - ❌
35783        - ❌
35784        - ❌
35785      * - **browsertime-tp6m-essential-refbrow-microsoft-support-e10s**
35786        - ❌
35787        - ❌
35788        - ❌
35789        - ❌
35790      * - **browsertime-tp6m-live-fenix-microsoft-support-e10s**
35791        - ❌
35792        - ❌
35793        - ❌
35794        - ❌
35795      * - **browsertime-tp6m-live-geckoview-microsoft-support-e10s**
35796        - ❌
35797        - ❌
35798        - ❌
35799        - ❌
35800
35801
35802   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
35803      :widths: 30 15 15 15 15
35804      :header-rows: 1
35805
35806      * - **Test Name**
35807        - mozilla-central
35808        - autoland
35809        - mozilla-release
35810        - mozilla-beta
35811      * - **browsertime-tp6m-essential-chrome-m-microsoft-support-e10s**
35812        - ❌
35813        - ❌
35814        - ❌
35815        - ❌
35816      * - **browsertime-tp6m-essential-fenix-microsoft-support-e10s**
35817        - ❌
35818        - ❌
35819        - ❌
35820        - ❌
35821      * - **browsertime-tp6m-essential-geckoview-microsoft-support-e10s**
35822        - ❌
35823        - ❌
35824        - ❌
35825        - ❌
35826      * - **browsertime-tp6m-essential-refbrow-microsoft-support-e10s**
35827        - ❌
35828        - ❌
35829        - ❌
35830        - ❌
35831      * - **browsertime-tp6m-live-chrome-m-microsoft-support-e10s**
35832        - ❌
35833        - ❌
35834        - ❌
35835        - ❌
35836      * - **browsertime-tp6m-live-fenix-microsoft-support-e10s**
35837        - ❌
35838        - ❌
35839        - ❌
35840        - ❌
35841      * - **browsertime-tp6m-live-geckoview-microsoft-support-e10s**
35842        - ❌
35843        - ❌
35844        - ❌
35845        - ❌
35846
35847
35848   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
35849      :widths: 30 15 15 15 15
35850      :header-rows: 1
35851
35852      * - **Test Name**
35853        - mozilla-central
35854        - autoland
35855        - mozilla-release
35856        - mozilla-beta
35857      * - **browsertime-tp6m-essential-fenix-microsoft-support-e10s**
35858        - ❌
35859        - ❌
35860        - ❌
35861        - ❌
35862      * - **browsertime-tp6m-essential-geckoview-microsoft-support-e10s**
35863        - ❌
35864        - ❌
35865        - ❌
35866        - ❌
35867      * - **browsertime-tp6m-essential-refbrow-microsoft-support-e10s**
35868        - ❌
35869        - ❌
35870        - ❌
35871        - ❌
35872      * - **browsertime-tp6m-live-fenix-microsoft-support-e10s**
35873        - ❌
35874        - ❌
35875        - ❌
35876        - ❌
35877      * - **browsertime-tp6m-live-geckoview-microsoft-support-e10s**
35878        - ❌
35879        - ❌
35880        - ❌
35881        - ❌
35882
35883
35884   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
35885      :widths: 30 15 15 15 15
35886      :header-rows: 1
35887
35888      * - **Test Name**
35889        - mozilla-central
35890        - autoland
35891        - mozilla-release
35892        - mozilla-beta
35893      * - **browsertime-tp6m-essential-chrome-m-microsoft-support-e10s**
35894        - ❌
35895        - ❌
35896        - ❌
35897        - ❌
35898      * - **browsertime-tp6m-essential-fenix-microsoft-support-e10s**
35899        - ❌
35900        - ❌
35901        - ❌
35902        - ❌
35903      * - **browsertime-tp6m-essential-geckoview-microsoft-support-e10s**
35904        - ❌
35905        - ❌
35906        - ❌
35907        - ❌
35908      * - **browsertime-tp6m-essential-refbrow-microsoft-support-e10s**
35909        - ❌
35910        - ❌
35911        - ❌
35912        - ❌
35913      * - **browsertime-tp6m-live-chrome-m-microsoft-support-e10s**
35914        - ❌
35915        - ❌
35916        - ❌
35917        - ❌
35918      * - **browsertime-tp6m-live-fenix-microsoft-support-e10s**
35919        - ❌
35920        - ❌
35921        - ❌
35922        - ❌
35923      * - **browsertime-tp6m-live-geckoview-microsoft-support-e10s**
35924        - ❌
35925        - ❌
35926        - ❌
35927        - ❌
35928
35929
35930
35931.. dropdown:: reddit
35932   :container: + anchor-id-reddit-m
35933
35934   **Owner**: PerfTest Team
35935
35936   * **alert on**: fcp, loadtime
35937   * **alert threshold**: 2.0
35938   * **apps**: geckoview, fenix, refbrow, chrome-m
35939   * **browser cycles**: 15
35940   * **expected**: pass
35941   * **lower is better**: true
35942   * **page cycles**: 25
35943   * **page timeout**: 60000
35944   * **playback**: mitmproxy-android
35945   * **playback pageset manifest**: mitm6-android-fenix-reddit.manifest
35946   * **playback version**: 6.0.2
35947   * **test url**: `<https://www.reddit.com>`__
35948   * **type**: pageload
35949   * **unit**: ms
35950   * **use live sites**: false
35951   * **Test Task**:
35952
35953   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
35954      :widths: 30 15 15 15 15
35955      :header-rows: 1
35956
35957      * - **Test Name**
35958        - mozilla-central
35959        - autoland
35960        - mozilla-release
35961        - mozilla-beta
35962      * - **browsertime-tp6m-fenix-reddit-e10s**
35963        - ❌
35964        - ❌
35965        - ❌
35966        - ❌
35967      * - **browsertime-tp6m-geckoview-reddit-e10s**
35968        - ❌
35969        - ❌
35970        - ❌
35971        - ❌
35972      * - **browsertime-tp6m-live-fenix-reddit-e10s**
35973        - ❌
35974        - ❌
35975        - ❌
35976        - ❌
35977      * - **browsertime-tp6m-live-geckoview-reddit-e10s**
35978        - ❌
35979        - ❌
35980        - ❌
35981        - ❌
35982      * - **browsertime-tp6m-refbrow-reddit-e10s**
35983        - ❌
35984        - ❌
35985        - ❌
35986        - ❌
35987
35988
35989   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
35990      :widths: 30 15 15 15 15
35991      :header-rows: 1
35992
35993      * - **Test Name**
35994        - mozilla-central
35995        - autoland
35996        - mozilla-release
35997        - mozilla-beta
35998      * - **browsertime-tp6m-chrome-m-reddit-e10s**
35999        - ❌
36000        - ❌
36001        - ❌
36002        - ❌
36003      * - **browsertime-tp6m-fenix-reddit-e10s**
36004        - ❌
36005        - ❌
36006        - ❌
36007        - ❌
36008      * - **browsertime-tp6m-geckoview-reddit-e10s**
36009        - ✅
36010        - ✅
36011        - ✅
36012        - ✅
36013      * - **browsertime-tp6m-live-chrome-m-reddit-e10s**
36014        - ❌
36015        - ❌
36016        - ❌
36017        - ❌
36018      * - **browsertime-tp6m-live-fenix-reddit-e10s**
36019        - ❌
36020        - ❌
36021        - ❌
36022        - ❌
36023      * - **browsertime-tp6m-live-geckoview-reddit-e10s**
36024        - ❌
36025        - ❌
36026        - ❌
36027        - ❌
36028      * - **browsertime-tp6m-refbrow-reddit-e10s**
36029        - ❌
36030        - ❌
36031        - ❌
36032        - ❌
36033
36034
36035   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
36036      :widths: 30 15 15 15 15
36037      :header-rows: 1
36038
36039      * - **Test Name**
36040        - mozilla-central
36041        - autoland
36042        - mozilla-release
36043        - mozilla-beta
36044      * - **browsertime-tp6m-fenix-reddit-e10s**
36045        - ❌
36046        - ❌
36047        - ❌
36048        - ❌
36049      * - **browsertime-tp6m-geckoview-reddit-e10s**
36050        - ❌
36051        - ❌
36052        - ❌
36053        - ❌
36054      * - **browsertime-tp6m-live-fenix-reddit-e10s**
36055        - ❌
36056        - ❌
36057        - ❌
36058        - ❌
36059      * - **browsertime-tp6m-live-geckoview-reddit-e10s**
36060        - ❌
36061        - ❌
36062        - ❌
36063        - ❌
36064      * - **browsertime-tp6m-refbrow-reddit-e10s**
36065        - ❌
36066        - ❌
36067        - ❌
36068        - ❌
36069
36070
36071   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
36072      :widths: 30 15 15 15 15
36073      :header-rows: 1
36074
36075      * - **Test Name**
36076        - mozilla-central
36077        - autoland
36078        - mozilla-release
36079        - mozilla-beta
36080      * - **browsertime-tp6m-chrome-m-reddit-e10s**
36081        - ❌
36082        - ❌
36083        - ❌
36084        - ❌
36085      * - **browsertime-tp6m-fenix-reddit-e10s**
36086        - ❌
36087        - ❌
36088        - ❌
36089        - ❌
36090      * - **browsertime-tp6m-geckoview-reddit-e10s**
36091        - ✅
36092        - ✅
36093        - ✅
36094        - ✅
36095      * - **browsertime-tp6m-live-chrome-m-reddit-e10s**
36096        - ❌
36097        - ❌
36098        - ❌
36099        - ❌
36100      * - **browsertime-tp6m-live-fenix-reddit-e10s**
36101        - ❌
36102        - ❌
36103        - ❌
36104        - ❌
36105      * - **browsertime-tp6m-live-geckoview-reddit-e10s**
36106        - ❌
36107        - ❌
36108        - ❌
36109        - ❌
36110      * - **browsertime-tp6m-refbrow-reddit-e10s**
36111        - ❌
36112        - ❌
36113        - ❌
36114        - ❌
36115
36116
36117   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
36118      :widths: 30 15 15 15 15
36119      :header-rows: 1
36120
36121      * - **Test Name**
36122        - mozilla-central
36123        - autoland
36124        - mozilla-release
36125        - mozilla-beta
36126      * - **browsertime-tp6m-fenix-reddit-e10s**
36127        - ❌
36128        - ❌
36129        - ❌
36130        - ❌
36131      * - **browsertime-tp6m-geckoview-reddit-e10s**
36132        - ❌
36133        - ❌
36134        - ❌
36135        - ❌
36136      * - **browsertime-tp6m-live-fenix-reddit-e10s**
36137        - ❌
36138        - ❌
36139        - ❌
36140        - ❌
36141      * - **browsertime-tp6m-live-geckoview-reddit-e10s**
36142        - ❌
36143        - ❌
36144        - ❌
36145        - ❌
36146      * - **browsertime-tp6m-refbrow-reddit-e10s**
36147        - ❌
36148        - ❌
36149        - ❌
36150        - ❌
36151
36152
36153   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
36154      :widths: 30 15 15 15 15
36155      :header-rows: 1
36156
36157      * - **Test Name**
36158        - mozilla-central
36159        - autoland
36160        - mozilla-release
36161        - mozilla-beta
36162      * - **browsertime-tp6m-chrome-m-reddit-e10s**
36163        - ❌
36164        - ❌
36165        - ❌
36166        - ❌
36167      * - **browsertime-tp6m-fenix-reddit-e10s**
36168        - ❌
36169        - ❌
36170        - ❌
36171        - ❌
36172      * - **browsertime-tp6m-geckoview-reddit-e10s**
36173        - ❌
36174        - ❌
36175        - ❌
36176        - ❌
36177      * - **browsertime-tp6m-live-chrome-m-reddit-e10s**
36178        - ❌
36179        - ❌
36180        - ❌
36181        - ❌
36182      * - **browsertime-tp6m-live-fenix-reddit-e10s**
36183        - ❌
36184        - ❌
36185        - ❌
36186        - ❌
36187      * - **browsertime-tp6m-live-geckoview-reddit-e10s**
36188        - ❌
36189        - ❌
36190        - ❌
36191        - ❌
36192      * - **browsertime-tp6m-refbrow-reddit-e10s**
36193        - ❌
36194        - ❌
36195        - ❌
36196        - ❌
36197
36198
36199   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
36200      :widths: 30 15 15 15 15
36201      :header-rows: 1
36202
36203      * - **Test Name**
36204        - mozilla-central
36205        - autoland
36206        - mozilla-release
36207        - mozilla-beta
36208      * - **browsertime-tp6m-fenix-reddit-e10s**
36209        - ❌
36210        - ❌
36211        - ❌
36212        - ❌
36213      * - **browsertime-tp6m-geckoview-reddit-e10s**
36214        - ❌
36215        - ❌
36216        - ❌
36217        - ❌
36218      * - **browsertime-tp6m-live-fenix-reddit-e10s**
36219        - ❌
36220        - ❌
36221        - ❌
36222        - ❌
36223      * - **browsertime-tp6m-live-geckoview-reddit-e10s**
36224        - ❌
36225        - ❌
36226        - ❌
36227        - ❌
36228      * - **browsertime-tp6m-refbrow-reddit-e10s**
36229        - ❌
36230        - ❌
36231        - ❌
36232        - ❌
36233
36234
36235   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
36236      :widths: 30 15 15 15 15
36237      :header-rows: 1
36238
36239      * - **Test Name**
36240        - mozilla-central
36241        - autoland
36242        - mozilla-release
36243        - mozilla-beta
36244      * - **browsertime-tp6m-chrome-m-reddit-e10s**
36245        - ❌
36246        - ❌
36247        - ❌
36248        - ❌
36249      * - **browsertime-tp6m-fenix-reddit-e10s**
36250        - ❌
36251        - ❌
36252        - ❌
36253        - ❌
36254      * - **browsertime-tp6m-geckoview-reddit-e10s**
36255        - ❌
36256        - ❌
36257        - ❌
36258        - ❌
36259      * - **browsertime-tp6m-live-chrome-m-reddit-e10s**
36260        - ❌
36261        - ❌
36262        - ❌
36263        - ❌
36264      * - **browsertime-tp6m-live-fenix-reddit-e10s**
36265        - ❌
36266        - ❌
36267        - ❌
36268        - ❌
36269      * - **browsertime-tp6m-live-geckoview-reddit-e10s**
36270        - ❌
36271        - ❌
36272        - ❌
36273        - ❌
36274      * - **browsertime-tp6m-refbrow-reddit-e10s**
36275        - ❌
36276        - ❌
36277        - ❌
36278        - ❌
36279
36280
36281   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
36282      :widths: 30 15 15 15 15
36283      :header-rows: 1
36284
36285      * - **Test Name**
36286        - mozilla-central
36287        - autoland
36288        - mozilla-release
36289        - mozilla-beta
36290      * - **browsertime-tp6-firefox-reddit-e10s**
36291        - ❌
36292        - ❌
36293        - ❌
36294        - ❌
36295      * - **browsertime-tp6-firefox-reddit-fis-e10s**
36296        - ❌
36297        - ❌
36298        - ❌
36299        - ❌
36300      * - **browsertime-tp6-live-firefox-reddit-e10s**
36301        - ❌
36302        - ❌
36303        - ❌
36304        - ❌
36305      * - **browsertime-tp6-live-firefox-reddit-fis-e10s**
36306        - ❌
36307        - ❌
36308        - ❌
36309        - ❌
36310
36311
36312   .. list-table:: **test-linux1804-64-qr/opt**
36313      :widths: 30 15 15 15 15
36314      :header-rows: 1
36315
36316      * - **Test Name**
36317        - mozilla-central
36318        - autoland
36319        - mozilla-release
36320        - mozilla-beta
36321      * - **browsertime-tp6-firefox-reddit-e10s**
36322        - ❌
36323        - ❌
36324        - ❌
36325        - ❌
36326      * - **browsertime-tp6-firefox-reddit-fis-e10s**
36327        - ❌
36328        - ❌
36329        - ❌
36330        - ❌
36331      * - **browsertime-tp6-live-firefox-reddit-e10s**
36332        - ❌
36333        - ❌
36334        - ❌
36335        - ❌
36336      * - **browsertime-tp6-live-firefox-reddit-fis-e10s**
36337        - ❌
36338        - ❌
36339        - ❌
36340        - ❌
36341
36342
36343   .. list-table:: **test-linux1804-64-shippable-qr/opt**
36344      :widths: 30 15 15 15 15
36345      :header-rows: 1
36346
36347      * - **Test Name**
36348        - mozilla-central
36349        - autoland
36350        - mozilla-release
36351        - mozilla-beta
36352      * - **browsertime-tp6-chrome-reddit-e10s**
36353        - ❌
36354        - ❌
36355        - ❌
36356        - ❌
36357      * - **browsertime-tp6-chromium-reddit-e10s**
36358        - ❌
36359        - ❌
36360        - ❌
36361        - ❌
36362      * - **browsertime-tp6-firefox-reddit-e10s**
36363        - ❌
36364        - ❌
36365        - ❌
36366        - ❌
36367      * - **browsertime-tp6-firefox-reddit-fis-e10s**
36368        - ✅
36369        - ✅
36370        - ✅
36371        - ✅
36372      * - **browsertime-tp6-live-chrome-reddit-e10s**
36373        - ❌
36374        - ❌
36375        - ❌
36376        - ❌
36377      * - **browsertime-tp6-live-chromium-reddit-e10s**
36378        - ❌
36379        - ❌
36380        - ❌
36381        - ❌
36382      * - **browsertime-tp6-live-firefox-reddit-e10s**
36383        - ❌
36384        - ❌
36385        - ❌
36386        - ❌
36387      * - **browsertime-tp6-live-firefox-reddit-fis-e10s**
36388        - ❌
36389        - ❌
36390        - ❌
36391        - ❌
36392
36393
36394   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
36395      :widths: 30 15 15 15 15
36396      :header-rows: 1
36397
36398      * - **Test Name**
36399        - mozilla-central
36400        - autoland
36401        - mozilla-release
36402        - mozilla-beta
36403      * - **browsertime-tp6-chrome-reddit-e10s**
36404        - ❌
36405        - ❌
36406        - ❌
36407        - ❌
36408      * - **browsertime-tp6-chromium-reddit-e10s**
36409        - ❌
36410        - ❌
36411        - ❌
36412        - ❌
36413      * - **browsertime-tp6-firefox-reddit-e10s**
36414        - ❌
36415        - ❌
36416        - ❌
36417        - ❌
36418      * - **browsertime-tp6-firefox-reddit-fis-e10s**
36419        - ✅
36420        - ✅
36421        - ✅
36422        - ✅
36423      * - **browsertime-tp6-live-chrome-reddit-e10s**
36424        - ❌
36425        - ❌
36426        - ❌
36427        - ❌
36428      * - **browsertime-tp6-live-chromium-reddit-e10s**
36429        - ❌
36430        - ❌
36431        - ❌
36432        - ❌
36433      * - **browsertime-tp6-live-firefox-reddit-e10s**
36434        - ❌
36435        - ❌
36436        - ❌
36437        - ❌
36438      * - **browsertime-tp6-live-firefox-reddit-fis-e10s**
36439        - ❌
36440        - ❌
36441        - ❌
36442        - ❌
36443
36444
36445   .. list-table:: **test-windows10-32-qr/opt**
36446      :widths: 30 15 15 15 15
36447      :header-rows: 1
36448
36449      * - **Test Name**
36450        - mozilla-central
36451        - autoland
36452        - mozilla-release
36453        - mozilla-beta
36454      * - **browsertime-tp6-firefox-reddit-e10s**
36455        - ❌
36456        - ❌
36457        - ❌
36458        - ❌
36459      * - **browsertime-tp6-firefox-reddit-fis-e10s**
36460        - ❌
36461        - ❌
36462        - ❌
36463        - ❌
36464      * - **browsertime-tp6-live-firefox-reddit-e10s**
36465        - ❌
36466        - ❌
36467        - ❌
36468        - ❌
36469      * - **browsertime-tp6-live-firefox-reddit-fis-e10s**
36470        - ❌
36471        - ❌
36472        - ❌
36473        - ❌
36474
36475
36476   .. list-table:: **test-windows10-32-shippable-qr/opt**
36477      :widths: 30 15 15 15 15
36478      :header-rows: 1
36479
36480      * - **Test Name**
36481        - mozilla-central
36482        - autoland
36483        - mozilla-release
36484        - mozilla-beta
36485      * - **browsertime-tp6-chrome-reddit-e10s**
36486        - ❌
36487        - ❌
36488        - ❌
36489        - ❌
36490      * - **browsertime-tp6-chromium-reddit-e10s**
36491        - ❌
36492        - ❌
36493        - ❌
36494        - ❌
36495      * - **browsertime-tp6-firefox-reddit-e10s**
36496        - ❌
36497        - ❌
36498        - ❌
36499        - ❌
36500      * - **browsertime-tp6-firefox-reddit-fis-e10s**
36501        - ❌
36502        - ❌
36503        - ❌
36504        - ❌
36505      * - **browsertime-tp6-live-chrome-reddit-e10s**
36506        - ❌
36507        - ❌
36508        - ❌
36509        - ❌
36510      * - **browsertime-tp6-live-chromium-reddit-e10s**
36511        - ❌
36512        - ❌
36513        - ❌
36514        - ❌
36515      * - **browsertime-tp6-live-firefox-reddit-e10s**
36516        - ❌
36517        - ❌
36518        - ❌
36519        - ❌
36520      * - **browsertime-tp6-live-firefox-reddit-fis-e10s**
36521        - ❌
36522        - ❌
36523        - ❌
36524        - ❌
36525
36526
36527   .. list-table:: **test-windows10-64-qr/opt**
36528      :widths: 30 15 15 15 15
36529      :header-rows: 1
36530
36531      * - **Test Name**
36532        - mozilla-central
36533        - autoland
36534        - mozilla-release
36535        - mozilla-beta
36536      * - **browsertime-tp6-firefox-reddit-e10s**
36537        - ❌
36538        - ❌
36539        - ❌
36540        - ❌
36541      * - **browsertime-tp6-firefox-reddit-fis-e10s**
36542        - ❌
36543        - ❌
36544        - ❌
36545        - ❌
36546      * - **browsertime-tp6-live-firefox-reddit-e10s**
36547        - ❌
36548        - ❌
36549        - ❌
36550        - ❌
36551      * - **browsertime-tp6-live-firefox-reddit-fis-e10s**
36552        - ❌
36553        - ❌
36554        - ❌
36555        - ❌
36556
36557
36558   .. list-table:: **test-windows10-64-shippable-qr/opt**
36559      :widths: 30 15 15 15 15
36560      :header-rows: 1
36561
36562      * - **Test Name**
36563        - mozilla-central
36564        - autoland
36565        - mozilla-release
36566        - mozilla-beta
36567      * - **browsertime-tp6-chrome-reddit-e10s**
36568        - ❌
36569        - ❌
36570        - ❌
36571        - ❌
36572      * - **browsertime-tp6-chromium-reddit-e10s**
36573        - ❌
36574        - ❌
36575        - ❌
36576        - ❌
36577      * - **browsertime-tp6-firefox-reddit-e10s**
36578        - ❌
36579        - ❌
36580        - ❌
36581        - ❌
36582      * - **browsertime-tp6-firefox-reddit-fis-e10s**
36583        - ✅
36584        - ✅
36585        - ✅
36586        - ✅
36587      * - **browsertime-tp6-live-chrome-reddit-e10s**
36588        - ❌
36589        - ❌
36590        - ❌
36591        - ❌
36592      * - **browsertime-tp6-live-chromium-reddit-e10s**
36593        - ❌
36594        - ❌
36595        - ❌
36596        - ❌
36597      * - **browsertime-tp6-live-firefox-reddit-e10s**
36598        - ❌
36599        - ❌
36600        - ❌
36601        - ❌
36602      * - **browsertime-tp6-live-firefox-reddit-fis-e10s**
36603        - ❌
36604        - ❌
36605        - ❌
36606        - ❌
36607
36608
36609
36610.. dropdown:: sina
36611   :container: + anchor-id-sina-m
36612
36613   **Owner**: PerfTest Team
36614
36615   * **alert on**: fcp, loadtime
36616   * **alert threshold**: 2.0
36617   * **apps**: geckoview, fenix, refbrow, chrome-m
36618   * **browser cycles**: 15
36619   * **expected**: pass
36620   * **lower is better**: true
36621   * **page cycles**: 25
36622   * **page timeout**: 60000
36623   * **playback**: mitmproxy-android
36624   * **playback pageset manifest**: mitm6-android-fenix-sina.manifest
36625   * **playback version**: 6.0.2
36626   * **test url**: `<https://www.sina.com.cn/>`__
36627   * **type**: pageload
36628   * **unit**: ms
36629   * **use live sites**: false
36630   * **Test Task**:
36631
36632   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
36633      :widths: 30 15 15 15 15
36634      :header-rows: 1
36635
36636      * - **Test Name**
36637        - mozilla-central
36638        - autoland
36639        - mozilla-release
36640        - mozilla-beta
36641      * - **browsertime-tp6m-fenix-sina-e10s**
36642        - ❌
36643        - ❌
36644        - ❌
36645        - ❌
36646      * - **browsertime-tp6m-geckoview-sina-e10s**
36647        - ❌
36648        - ❌
36649        - ❌
36650        - ❌
36651      * - **browsertime-tp6m-refbrow-sina-e10s**
36652        - ❌
36653        - ❌
36654        - ❌
36655        - ❌
36656
36657
36658   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
36659      :widths: 30 15 15 15 15
36660      :header-rows: 1
36661
36662      * - **Test Name**
36663        - mozilla-central
36664        - autoland
36665        - mozilla-release
36666        - mozilla-beta
36667      * - **browsertime-tp6m-chrome-m-sina-e10s**
36668        - ❌
36669        - ❌
36670        - ❌
36671        - ❌
36672      * - **browsertime-tp6m-fenix-sina-e10s**
36673        - ❌
36674        - ❌
36675        - ❌
36676        - ❌
36677      * - **browsertime-tp6m-geckoview-sina-e10s**
36678        - ✅
36679        - ✅
36680        - ✅
36681        - ✅
36682      * - **browsertime-tp6m-refbrow-sina-e10s**
36683        - ❌
36684        - ❌
36685        - ❌
36686        - ❌
36687
36688
36689   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
36690      :widths: 30 15 15 15 15
36691      :header-rows: 1
36692
36693      * - **Test Name**
36694        - mozilla-central
36695        - autoland
36696        - mozilla-release
36697        - mozilla-beta
36698      * - **browsertime-tp6m-fenix-sina-e10s**
36699        - ❌
36700        - ❌
36701        - ❌
36702        - ❌
36703      * - **browsertime-tp6m-geckoview-sina-e10s**
36704        - ❌
36705        - ❌
36706        - ❌
36707        - ❌
36708      * - **browsertime-tp6m-refbrow-sina-e10s**
36709        - ❌
36710        - ❌
36711        - ❌
36712        - ❌
36713
36714
36715   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
36716      :widths: 30 15 15 15 15
36717      :header-rows: 1
36718
36719      * - **Test Name**
36720        - mozilla-central
36721        - autoland
36722        - mozilla-release
36723        - mozilla-beta
36724      * - **browsertime-tp6m-chrome-m-sina-e10s**
36725        - ❌
36726        - ❌
36727        - ❌
36728        - ❌
36729      * - **browsertime-tp6m-fenix-sina-e10s**
36730        - ❌
36731        - ❌
36732        - ❌
36733        - ❌
36734      * - **browsertime-tp6m-geckoview-sina-e10s**
36735        - ✅
36736        - ✅
36737        - ✅
36738        - ✅
36739      * - **browsertime-tp6m-refbrow-sina-e10s**
36740        - ❌
36741        - ❌
36742        - ❌
36743        - ❌
36744
36745
36746   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
36747      :widths: 30 15 15 15 15
36748      :header-rows: 1
36749
36750      * - **Test Name**
36751        - mozilla-central
36752        - autoland
36753        - mozilla-release
36754        - mozilla-beta
36755      * - **browsertime-tp6m-fenix-sina-e10s**
36756        - ❌
36757        - ❌
36758        - ❌
36759        - ❌
36760      * - **browsertime-tp6m-geckoview-sina-e10s**
36761        - ❌
36762        - ❌
36763        - ❌
36764        - ❌
36765      * - **browsertime-tp6m-refbrow-sina-e10s**
36766        - ❌
36767        - ❌
36768        - ❌
36769        - ❌
36770
36771
36772   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
36773      :widths: 30 15 15 15 15
36774      :header-rows: 1
36775
36776      * - **Test Name**
36777        - mozilla-central
36778        - autoland
36779        - mozilla-release
36780        - mozilla-beta
36781      * - **browsertime-tp6m-chrome-m-sina-e10s**
36782        - ❌
36783        - ❌
36784        - ❌
36785        - ❌
36786      * - **browsertime-tp6m-fenix-sina-e10s**
36787        - ❌
36788        - ❌
36789        - ❌
36790        - ❌
36791      * - **browsertime-tp6m-geckoview-sina-e10s**
36792        - ❌
36793        - ❌
36794        - ❌
36795        - ❌
36796      * - **browsertime-tp6m-refbrow-sina-e10s**
36797        - ❌
36798        - ❌
36799        - ❌
36800        - ❌
36801
36802
36803   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
36804      :widths: 30 15 15 15 15
36805      :header-rows: 1
36806
36807      * - **Test Name**
36808        - mozilla-central
36809        - autoland
36810        - mozilla-release
36811        - mozilla-beta
36812      * - **browsertime-tp6m-fenix-sina-e10s**
36813        - ❌
36814        - ❌
36815        - ❌
36816        - ❌
36817      * - **browsertime-tp6m-geckoview-sina-e10s**
36818        - ❌
36819        - ❌
36820        - ❌
36821        - ❌
36822      * - **browsertime-tp6m-refbrow-sina-e10s**
36823        - ❌
36824        - ❌
36825        - ❌
36826        - ❌
36827
36828
36829   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
36830      :widths: 30 15 15 15 15
36831      :header-rows: 1
36832
36833      * - **Test Name**
36834        - mozilla-central
36835        - autoland
36836        - mozilla-release
36837        - mozilla-beta
36838      * - **browsertime-tp6m-chrome-m-sina-e10s**
36839        - ❌
36840        - ❌
36841        - ❌
36842        - ❌
36843      * - **browsertime-tp6m-fenix-sina-e10s**
36844        - ❌
36845        - ❌
36846        - ❌
36847        - ❌
36848      * - **browsertime-tp6m-geckoview-sina-e10s**
36849        - ❌
36850        - ❌
36851        - ❌
36852        - ❌
36853      * - **browsertime-tp6m-refbrow-sina-e10s**
36854        - ❌
36855        - ❌
36856        - ❌
36857        - ❌
36858
36859
36860
36861.. dropdown:: stackoverflow
36862   :container: + anchor-id-stackoverflow-m
36863
36864   **Owner**: PerfTest Team
36865
36866   * **alert on**: fcp, loadtime
36867   * **alert threshold**: 2.0
36868   * **apps**: geckoview, fenix, refbrow, chrome-m
36869   * **browser cycles**: 15
36870   * **expected**: pass
36871   * **lower is better**: true
36872   * **page cycles**: 25
36873   * **page timeout**: 60000
36874   * **playback**: mitmproxy-android
36875   * **playback pageset manifest**: mitm6-android-fenix-stackoverflow.manifest
36876   * **playback version**: 6.0.2
36877   * **test url**: `<https://stackoverflow.com/>`__
36878   * **type**: pageload
36879   * **unit**: ms
36880   * **use live sites**: false
36881   * **Test Task**:
36882
36883   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
36884      :widths: 30 15 15 15 15
36885      :header-rows: 1
36886
36887      * - **Test Name**
36888        - mozilla-central
36889        - autoland
36890        - mozilla-release
36891        - mozilla-beta
36892      * - **browsertime-tp6m-fenix-stackoverflow-e10s**
36893        - ❌
36894        - ❌
36895        - ❌
36896        - ❌
36897      * - **browsertime-tp6m-geckoview-stackoverflow-e10s**
36898        - ❌
36899        - ❌
36900        - ❌
36901        - ❌
36902      * - **browsertime-tp6m-live-fenix-stackoverflow-e10s**
36903        - ❌
36904        - ❌
36905        - ❌
36906        - ❌
36907      * - **browsertime-tp6m-live-geckoview-stackoverflow-e10s**
36908        - ❌
36909        - ❌
36910        - ❌
36911        - ❌
36912      * - **browsertime-tp6m-refbrow-stackoverflow-e10s**
36913        - ❌
36914        - ❌
36915        - ❌
36916        - ❌
36917
36918
36919   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
36920      :widths: 30 15 15 15 15
36921      :header-rows: 1
36922
36923      * - **Test Name**
36924        - mozilla-central
36925        - autoland
36926        - mozilla-release
36927        - mozilla-beta
36928      * - **browsertime-tp6m-chrome-m-stackoverflow-e10s**
36929        - ❌
36930        - ❌
36931        - ❌
36932        - ❌
36933      * - **browsertime-tp6m-fenix-stackoverflow-e10s**
36934        - ❌
36935        - ❌
36936        - ❌
36937        - ❌
36938      * - **browsertime-tp6m-geckoview-stackoverflow-e10s**
36939        - ✅
36940        - ✅
36941        - ✅
36942        - ✅
36943      * - **browsertime-tp6m-live-chrome-m-stackoverflow-e10s**
36944        - ❌
36945        - ❌
36946        - ❌
36947        - ❌
36948      * - **browsertime-tp6m-live-fenix-stackoverflow-e10s**
36949        - ❌
36950        - ❌
36951        - ❌
36952        - ❌
36953      * - **browsertime-tp6m-live-geckoview-stackoverflow-e10s**
36954        - ❌
36955        - ❌
36956        - ❌
36957        - ❌
36958      * - **browsertime-tp6m-refbrow-stackoverflow-e10s**
36959        - ❌
36960        - ❌
36961        - ❌
36962        - ❌
36963
36964
36965   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
36966      :widths: 30 15 15 15 15
36967      :header-rows: 1
36968
36969      * - **Test Name**
36970        - mozilla-central
36971        - autoland
36972        - mozilla-release
36973        - mozilla-beta
36974      * - **browsertime-tp6m-fenix-stackoverflow-e10s**
36975        - ❌
36976        - ❌
36977        - ❌
36978        - ❌
36979      * - **browsertime-tp6m-geckoview-stackoverflow-e10s**
36980        - ❌
36981        - ❌
36982        - ❌
36983        - ❌
36984      * - **browsertime-tp6m-live-fenix-stackoverflow-e10s**
36985        - ❌
36986        - ❌
36987        - ❌
36988        - ❌
36989      * - **browsertime-tp6m-live-geckoview-stackoverflow-e10s**
36990        - ❌
36991        - ❌
36992        - ❌
36993        - ❌
36994      * - **browsertime-tp6m-refbrow-stackoverflow-e10s**
36995        - ❌
36996        - ❌
36997        - ❌
36998        - ❌
36999
37000
37001   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
37002      :widths: 30 15 15 15 15
37003      :header-rows: 1
37004
37005      * - **Test Name**
37006        - mozilla-central
37007        - autoland
37008        - mozilla-release
37009        - mozilla-beta
37010      * - **browsertime-tp6m-chrome-m-stackoverflow-e10s**
37011        - ❌
37012        - ❌
37013        - ❌
37014        - ❌
37015      * - **browsertime-tp6m-fenix-stackoverflow-e10s**
37016        - ❌
37017        - ❌
37018        - ❌
37019        - ❌
37020      * - **browsertime-tp6m-geckoview-stackoverflow-e10s**
37021        - ✅
37022        - ✅
37023        - ✅
37024        - ✅
37025      * - **browsertime-tp6m-live-chrome-m-stackoverflow-e10s**
37026        - ❌
37027        - ❌
37028        - ❌
37029        - ❌
37030      * - **browsertime-tp6m-live-fenix-stackoverflow-e10s**
37031        - ❌
37032        - ❌
37033        - ❌
37034        - ❌
37035      * - **browsertime-tp6m-live-geckoview-stackoverflow-e10s**
37036        - ❌
37037        - ❌
37038        - ❌
37039        - ❌
37040      * - **browsertime-tp6m-refbrow-stackoverflow-e10s**
37041        - ❌
37042        - ❌
37043        - ❌
37044        - ❌
37045
37046
37047   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
37048      :widths: 30 15 15 15 15
37049      :header-rows: 1
37050
37051      * - **Test Name**
37052        - mozilla-central
37053        - autoland
37054        - mozilla-release
37055        - mozilla-beta
37056      * - **browsertime-tp6m-fenix-stackoverflow-e10s**
37057        - ❌
37058        - ❌
37059        - ❌
37060        - ❌
37061      * - **browsertime-tp6m-geckoview-stackoverflow-e10s**
37062        - ❌
37063        - ❌
37064        - ❌
37065        - ❌
37066      * - **browsertime-tp6m-live-fenix-stackoverflow-e10s**
37067        - ❌
37068        - ❌
37069        - ❌
37070        - ❌
37071      * - **browsertime-tp6m-live-geckoview-stackoverflow-e10s**
37072        - ❌
37073        - ❌
37074        - ❌
37075        - ❌
37076      * - **browsertime-tp6m-refbrow-stackoverflow-e10s**
37077        - ❌
37078        - ❌
37079        - ❌
37080        - ❌
37081
37082
37083   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
37084      :widths: 30 15 15 15 15
37085      :header-rows: 1
37086
37087      * - **Test Name**
37088        - mozilla-central
37089        - autoland
37090        - mozilla-release
37091        - mozilla-beta
37092      * - **browsertime-tp6m-chrome-m-stackoverflow-e10s**
37093        - ❌
37094        - ❌
37095        - ❌
37096        - ❌
37097      * - **browsertime-tp6m-fenix-stackoverflow-e10s**
37098        - ❌
37099        - ❌
37100        - ❌
37101        - ❌
37102      * - **browsertime-tp6m-geckoview-stackoverflow-e10s**
37103        - ❌
37104        - ❌
37105        - ❌
37106        - ❌
37107      * - **browsertime-tp6m-live-chrome-m-stackoverflow-e10s**
37108        - ❌
37109        - ❌
37110        - ❌
37111        - ❌
37112      * - **browsertime-tp6m-live-fenix-stackoverflow-e10s**
37113        - ❌
37114        - ❌
37115        - ❌
37116        - ❌
37117      * - **browsertime-tp6m-live-geckoview-stackoverflow-e10s**
37118        - ❌
37119        - ❌
37120        - ❌
37121        - ❌
37122      * - **browsertime-tp6m-refbrow-stackoverflow-e10s**
37123        - ❌
37124        - ❌
37125        - ❌
37126        - ❌
37127
37128
37129   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
37130      :widths: 30 15 15 15 15
37131      :header-rows: 1
37132
37133      * - **Test Name**
37134        - mozilla-central
37135        - autoland
37136        - mozilla-release
37137        - mozilla-beta
37138      * - **browsertime-tp6m-fenix-stackoverflow-e10s**
37139        - ❌
37140        - ❌
37141        - ❌
37142        - ❌
37143      * - **browsertime-tp6m-geckoview-stackoverflow-e10s**
37144        - ❌
37145        - ❌
37146        - ❌
37147        - ❌
37148      * - **browsertime-tp6m-live-fenix-stackoverflow-e10s**
37149        - ❌
37150        - ❌
37151        - ❌
37152        - ❌
37153      * - **browsertime-tp6m-live-geckoview-stackoverflow-e10s**
37154        - ❌
37155        - ❌
37156        - ❌
37157        - ❌
37158      * - **browsertime-tp6m-refbrow-stackoverflow-e10s**
37159        - ❌
37160        - ❌
37161        - ❌
37162        - ❌
37163
37164
37165   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
37166      :widths: 30 15 15 15 15
37167      :header-rows: 1
37168
37169      * - **Test Name**
37170        - mozilla-central
37171        - autoland
37172        - mozilla-release
37173        - mozilla-beta
37174      * - **browsertime-tp6m-chrome-m-stackoverflow-e10s**
37175        - ❌
37176        - ❌
37177        - ❌
37178        - ❌
37179      * - **browsertime-tp6m-fenix-stackoverflow-e10s**
37180        - ❌
37181        - ❌
37182        - ❌
37183        - ❌
37184      * - **browsertime-tp6m-geckoview-stackoverflow-e10s**
37185        - ❌
37186        - ❌
37187        - ❌
37188        - ❌
37189      * - **browsertime-tp6m-live-chrome-m-stackoverflow-e10s**
37190        - ❌
37191        - ❌
37192        - ❌
37193        - ❌
37194      * - **browsertime-tp6m-live-fenix-stackoverflow-e10s**
37195        - ❌
37196        - ❌
37197        - ❌
37198        - ❌
37199      * - **browsertime-tp6m-live-geckoview-stackoverflow-e10s**
37200        - ❌
37201        - ❌
37202        - ❌
37203        - ❌
37204      * - **browsertime-tp6m-refbrow-stackoverflow-e10s**
37205        - ❌
37206        - ❌
37207        - ❌
37208        - ❌
37209
37210
37211
37212.. dropdown:: web-de
37213   :container: + anchor-id-web-de-m
37214
37215   **Owner**: PerfTest Team
37216
37217   * **alert on**: fcp, loadtime
37218   * **alert threshold**: 2.0
37219   * **apps**: geckoview, fenix, refbrow, chrome-m
37220   * **browser cycles**: 15
37221   * **expected**: pass
37222   * **lower is better**: true
37223   * **page cycles**: 25
37224   * **page timeout**: 60000
37225   * **playback**: mitmproxy-android
37226   * **playback pageset manifest**: mitm6-android-fenix-web-de.manifest
37227   * **playback version**: 6.0.2
37228   * **test url**: `<https://web.de/magazine/politik/politologe-glaubt-grossen-koalition-herbst-knallen-33563566>`__
37229   * **type**: pageload
37230   * **unit**: ms
37231   * **use live sites**: false
37232   * **Test Task**:
37233
37234   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
37235      :widths: 30 15 15 15 15
37236      :header-rows: 1
37237
37238      * - **Test Name**
37239        - mozilla-central
37240        - autoland
37241        - mozilla-release
37242        - mozilla-beta
37243      * - **browsertime-tp6m-fenix-web-de-e10s**
37244        - ❌
37245        - ❌
37246        - ❌
37247        - ❌
37248      * - **browsertime-tp6m-geckoview-web-de-e10s**
37249        - ❌
37250        - ❌
37251        - ❌
37252        - ❌
37253      * - **browsertime-tp6m-live-fenix-web-de-e10s**
37254        - ❌
37255        - ❌
37256        - ❌
37257        - ❌
37258      * - **browsertime-tp6m-live-geckoview-web-de-e10s**
37259        - ❌
37260        - ❌
37261        - ❌
37262        - ❌
37263      * - **browsertime-tp6m-refbrow-web-de-e10s**
37264        - ❌
37265        - ❌
37266        - ❌
37267        - ❌
37268
37269
37270   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
37271      :widths: 30 15 15 15 15
37272      :header-rows: 1
37273
37274      * - **Test Name**
37275        - mozilla-central
37276        - autoland
37277        - mozilla-release
37278        - mozilla-beta
37279      * - **browsertime-tp6m-chrome-m-web-de-e10s**
37280        - ❌
37281        - ❌
37282        - ❌
37283        - ❌
37284      * - **browsertime-tp6m-fenix-web-de-e10s**
37285        - ❌
37286        - ❌
37287        - ❌
37288        - ❌
37289      * - **browsertime-tp6m-geckoview-web-de-e10s**
37290        - ✅
37291        - ✅
37292        - ✅
37293        - ✅
37294      * - **browsertime-tp6m-live-chrome-m-web-de-e10s**
37295        - ❌
37296        - ❌
37297        - ❌
37298        - ❌
37299      * - **browsertime-tp6m-live-fenix-web-de-e10s**
37300        - ❌
37301        - ❌
37302        - ❌
37303        - ❌
37304      * - **browsertime-tp6m-live-geckoview-web-de-e10s**
37305        - ❌
37306        - ❌
37307        - ❌
37308        - ❌
37309      * - **browsertime-tp6m-refbrow-web-de-e10s**
37310        - ❌
37311        - ❌
37312        - ❌
37313        - ❌
37314
37315
37316   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
37317      :widths: 30 15 15 15 15
37318      :header-rows: 1
37319
37320      * - **Test Name**
37321        - mozilla-central
37322        - autoland
37323        - mozilla-release
37324        - mozilla-beta
37325      * - **browsertime-tp6m-fenix-web-de-e10s**
37326        - ❌
37327        - ❌
37328        - ❌
37329        - ❌
37330      * - **browsertime-tp6m-geckoview-web-de-e10s**
37331        - ❌
37332        - ❌
37333        - ❌
37334        - ❌
37335      * - **browsertime-tp6m-live-fenix-web-de-e10s**
37336        - ❌
37337        - ❌
37338        - ❌
37339        - ❌
37340      * - **browsertime-tp6m-live-geckoview-web-de-e10s**
37341        - ❌
37342        - ❌
37343        - ❌
37344        - ❌
37345      * - **browsertime-tp6m-refbrow-web-de-e10s**
37346        - ❌
37347        - ❌
37348        - ❌
37349        - ❌
37350
37351
37352   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
37353      :widths: 30 15 15 15 15
37354      :header-rows: 1
37355
37356      * - **Test Name**
37357        - mozilla-central
37358        - autoland
37359        - mozilla-release
37360        - mozilla-beta
37361      * - **browsertime-tp6m-chrome-m-web-de-e10s**
37362        - ❌
37363        - ❌
37364        - ❌
37365        - ❌
37366      * - **browsertime-tp6m-fenix-web-de-e10s**
37367        - ❌
37368        - ❌
37369        - ❌
37370        - ❌
37371      * - **browsertime-tp6m-geckoview-web-de-e10s**
37372        - ✅
37373        - ✅
37374        - ✅
37375        - ✅
37376      * - **browsertime-tp6m-live-chrome-m-web-de-e10s**
37377        - ❌
37378        - ❌
37379        - ❌
37380        - ❌
37381      * - **browsertime-tp6m-live-fenix-web-de-e10s**
37382        - ❌
37383        - ❌
37384        - ❌
37385        - ❌
37386      * - **browsertime-tp6m-live-geckoview-web-de-e10s**
37387        - ❌
37388        - ❌
37389        - ❌
37390        - ❌
37391      * - **browsertime-tp6m-refbrow-web-de-e10s**
37392        - ❌
37393        - ❌
37394        - ❌
37395        - ❌
37396
37397
37398   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
37399      :widths: 30 15 15 15 15
37400      :header-rows: 1
37401
37402      * - **Test Name**
37403        - mozilla-central
37404        - autoland
37405        - mozilla-release
37406        - mozilla-beta
37407      * - **browsertime-tp6m-fenix-web-de-e10s**
37408        - ❌
37409        - ❌
37410        - ❌
37411        - ❌
37412      * - **browsertime-tp6m-geckoview-web-de-e10s**
37413        - ❌
37414        - ❌
37415        - ❌
37416        - ❌
37417      * - **browsertime-tp6m-live-fenix-web-de-e10s**
37418        - ❌
37419        - ❌
37420        - ❌
37421        - ❌
37422      * - **browsertime-tp6m-live-geckoview-web-de-e10s**
37423        - ❌
37424        - ❌
37425        - ❌
37426        - ❌
37427      * - **browsertime-tp6m-refbrow-web-de-e10s**
37428        - ❌
37429        - ❌
37430        - ❌
37431        - ❌
37432
37433
37434   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
37435      :widths: 30 15 15 15 15
37436      :header-rows: 1
37437
37438      * - **Test Name**
37439        - mozilla-central
37440        - autoland
37441        - mozilla-release
37442        - mozilla-beta
37443      * - **browsertime-tp6m-chrome-m-web-de-e10s**
37444        - ❌
37445        - ❌
37446        - ❌
37447        - ❌
37448      * - **browsertime-tp6m-fenix-web-de-e10s**
37449        - ❌
37450        - ❌
37451        - ❌
37452        - ❌
37453      * - **browsertime-tp6m-geckoview-web-de-e10s**
37454        - ❌
37455        - ❌
37456        - ❌
37457        - ❌
37458      * - **browsertime-tp6m-live-chrome-m-web-de-e10s**
37459        - ❌
37460        - ❌
37461        - ❌
37462        - ❌
37463      * - **browsertime-tp6m-live-fenix-web-de-e10s**
37464        - ❌
37465        - ❌
37466        - ❌
37467        - ❌
37468      * - **browsertime-tp6m-live-geckoview-web-de-e10s**
37469        - ❌
37470        - ❌
37471        - ❌
37472        - ❌
37473      * - **browsertime-tp6m-refbrow-web-de-e10s**
37474        - ❌
37475        - ❌
37476        - ❌
37477        - ❌
37478
37479
37480   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
37481      :widths: 30 15 15 15 15
37482      :header-rows: 1
37483
37484      * - **Test Name**
37485        - mozilla-central
37486        - autoland
37487        - mozilla-release
37488        - mozilla-beta
37489      * - **browsertime-tp6m-fenix-web-de-e10s**
37490        - ❌
37491        - ❌
37492        - ❌
37493        - ❌
37494      * - **browsertime-tp6m-geckoview-web-de-e10s**
37495        - ❌
37496        - ❌
37497        - ❌
37498        - ❌
37499      * - **browsertime-tp6m-live-fenix-web-de-e10s**
37500        - ❌
37501        - ❌
37502        - ❌
37503        - ❌
37504      * - **browsertime-tp6m-live-geckoview-web-de-e10s**
37505        - ❌
37506        - ❌
37507        - ❌
37508        - ❌
37509      * - **browsertime-tp6m-refbrow-web-de-e10s**
37510        - ❌
37511        - ❌
37512        - ❌
37513        - ❌
37514
37515
37516   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
37517      :widths: 30 15 15 15 15
37518      :header-rows: 1
37519
37520      * - **Test Name**
37521        - mozilla-central
37522        - autoland
37523        - mozilla-release
37524        - mozilla-beta
37525      * - **browsertime-tp6m-chrome-m-web-de-e10s**
37526        - ❌
37527        - ❌
37528        - ❌
37529        - ❌
37530      * - **browsertime-tp6m-fenix-web-de-e10s**
37531        - ❌
37532        - ❌
37533        - ❌
37534        - ❌
37535      * - **browsertime-tp6m-geckoview-web-de-e10s**
37536        - ❌
37537        - ❌
37538        - ❌
37539        - ❌
37540      * - **browsertime-tp6m-live-chrome-m-web-de-e10s**
37541        - ❌
37542        - ❌
37543        - ❌
37544        - ❌
37545      * - **browsertime-tp6m-live-fenix-web-de-e10s**
37546        - ❌
37547        - ❌
37548        - ❌
37549        - ❌
37550      * - **browsertime-tp6m-live-geckoview-web-de-e10s**
37551        - ❌
37552        - ❌
37553        - ❌
37554        - ❌
37555      * - **browsertime-tp6m-refbrow-web-de-e10s**
37556        - ❌
37557        - ❌
37558        - ❌
37559        - ❌
37560
37561
37562
37563.. dropdown:: wikipedia
37564   :container: + anchor-id-wikipedia-m
37565
37566   **Owner**: PerfTest Team
37567
37568   * **alert on**: fcp, loadtime
37569   * **alert threshold**: 2.0
37570   * **apps**: geckoview, fenix, refbrow, chrome-m
37571   * **browser cycles**: 15
37572   * **expected**: pass
37573   * **lower is better**: true
37574   * **page cycles**: 25
37575   * **page timeout**: 60000
37576   * **playback**: mitmproxy-android
37577   * **playback pageset manifest**: mitm6-android-fenix-wikipedia.manifest
37578   * **playback version**: 6.0.2
37579   * **test url**: `<https://en.m.wikipedia.org/wiki/Main_Page>`__
37580   * **type**: pageload
37581   * **unit**: ms
37582   * **use live sites**: false
37583   * **Test Task**:
37584
37585   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
37586      :widths: 30 15 15 15 15
37587      :header-rows: 1
37588
37589      * - **Test Name**
37590        - mozilla-central
37591        - autoland
37592        - mozilla-release
37593        - mozilla-beta
37594      * - **browsertime-tp6m-fenix-wikipedia-e10s**
37595        - ❌
37596        - ❌
37597        - ❌
37598        - ❌
37599      * - **browsertime-tp6m-geckoview-wikipedia-e10s**
37600        - ❌
37601        - ❌
37602        - ❌
37603        - ❌
37604      * - **browsertime-tp6m-live-fenix-wikipedia-e10s**
37605        - ❌
37606        - ❌
37607        - ❌
37608        - ❌
37609      * - **browsertime-tp6m-live-geckoview-wikipedia-e10s**
37610        - ❌
37611        - ❌
37612        - ❌
37613        - ❌
37614      * - **browsertime-tp6m-refbrow-wikipedia-e10s**
37615        - ❌
37616        - ❌
37617        - ❌
37618        - ❌
37619
37620
37621   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
37622      :widths: 30 15 15 15 15
37623      :header-rows: 1
37624
37625      * - **Test Name**
37626        - mozilla-central
37627        - autoland
37628        - mozilla-release
37629        - mozilla-beta
37630      * - **browsertime-tp6m-chrome-m-wikipedia-e10s**
37631        - ❌
37632        - ❌
37633        - ❌
37634        - ❌
37635      * - **browsertime-tp6m-fenix-wikipedia-e10s**
37636        - ❌
37637        - ❌
37638        - ❌
37639        - ❌
37640      * - **browsertime-tp6m-geckoview-wikipedia-e10s**
37641        - ✅
37642        - ✅
37643        - ✅
37644        - ✅
37645      * - **browsertime-tp6m-live-chrome-m-wikipedia-e10s**
37646        - ❌
37647        - ❌
37648        - ❌
37649        - ❌
37650      * - **browsertime-tp6m-live-fenix-wikipedia-e10s**
37651        - ❌
37652        - ❌
37653        - ❌
37654        - ❌
37655      * - **browsertime-tp6m-live-geckoview-wikipedia-e10s**
37656        - ❌
37657        - ❌
37658        - ❌
37659        - ❌
37660      * - **browsertime-tp6m-refbrow-wikipedia-e10s**
37661        - ❌
37662        - ❌
37663        - ❌
37664        - ❌
37665
37666
37667   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
37668      :widths: 30 15 15 15 15
37669      :header-rows: 1
37670
37671      * - **Test Name**
37672        - mozilla-central
37673        - autoland
37674        - mozilla-release
37675        - mozilla-beta
37676      * - **browsertime-tp6m-fenix-wikipedia-e10s**
37677        - ❌
37678        - ❌
37679        - ❌
37680        - ❌
37681      * - **browsertime-tp6m-geckoview-wikipedia-e10s**
37682        - ❌
37683        - ❌
37684        - ❌
37685        - ❌
37686      * - **browsertime-tp6m-live-fenix-wikipedia-e10s**
37687        - ❌
37688        - ❌
37689        - ❌
37690        - ❌
37691      * - **browsertime-tp6m-live-geckoview-wikipedia-e10s**
37692        - ❌
37693        - ❌
37694        - ❌
37695        - ❌
37696      * - **browsertime-tp6m-refbrow-wikipedia-e10s**
37697        - ❌
37698        - ❌
37699        - ❌
37700        - ❌
37701
37702
37703   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
37704      :widths: 30 15 15 15 15
37705      :header-rows: 1
37706
37707      * - **Test Name**
37708        - mozilla-central
37709        - autoland
37710        - mozilla-release
37711        - mozilla-beta
37712      * - **browsertime-tp6m-chrome-m-wikipedia-e10s**
37713        - ❌
37714        - ❌
37715        - ❌
37716        - ❌
37717      * - **browsertime-tp6m-fenix-wikipedia-e10s**
37718        - ❌
37719        - ❌
37720        - ❌
37721        - ❌
37722      * - **browsertime-tp6m-geckoview-wikipedia-e10s**
37723        - ✅
37724        - ✅
37725        - ✅
37726        - ✅
37727      * - **browsertime-tp6m-live-chrome-m-wikipedia-e10s**
37728        - ❌
37729        - ❌
37730        - ❌
37731        - ❌
37732      * - **browsertime-tp6m-live-fenix-wikipedia-e10s**
37733        - ❌
37734        - ❌
37735        - ❌
37736        - ❌
37737      * - **browsertime-tp6m-live-geckoview-wikipedia-e10s**
37738        - ❌
37739        - ❌
37740        - ❌
37741        - ❌
37742      * - **browsertime-tp6m-refbrow-wikipedia-e10s**
37743        - ❌
37744        - ❌
37745        - ❌
37746        - ❌
37747
37748
37749   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
37750      :widths: 30 15 15 15 15
37751      :header-rows: 1
37752
37753      * - **Test Name**
37754        - mozilla-central
37755        - autoland
37756        - mozilla-release
37757        - mozilla-beta
37758      * - **browsertime-tp6m-fenix-wikipedia-e10s**
37759        - ❌
37760        - ❌
37761        - ❌
37762        - ❌
37763      * - **browsertime-tp6m-geckoview-wikipedia-e10s**
37764        - ❌
37765        - ❌
37766        - ❌
37767        - ❌
37768      * - **browsertime-tp6m-live-fenix-wikipedia-e10s**
37769        - ❌
37770        - ❌
37771        - ❌
37772        - ❌
37773      * - **browsertime-tp6m-live-geckoview-wikipedia-e10s**
37774        - ❌
37775        - ❌
37776        - ❌
37777        - ❌
37778      * - **browsertime-tp6m-refbrow-wikipedia-e10s**
37779        - ❌
37780        - ❌
37781        - ❌
37782        - ❌
37783
37784
37785   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
37786      :widths: 30 15 15 15 15
37787      :header-rows: 1
37788
37789      * - **Test Name**
37790        - mozilla-central
37791        - autoland
37792        - mozilla-release
37793        - mozilla-beta
37794      * - **browsertime-tp6m-chrome-m-wikipedia-e10s**
37795        - ❌
37796        - ❌
37797        - ❌
37798        - ❌
37799      * - **browsertime-tp6m-fenix-wikipedia-e10s**
37800        - ❌
37801        - ❌
37802        - ❌
37803        - ❌
37804      * - **browsertime-tp6m-geckoview-wikipedia-e10s**
37805        - ❌
37806        - ❌
37807        - ❌
37808        - ❌
37809      * - **browsertime-tp6m-live-chrome-m-wikipedia-e10s**
37810        - ❌
37811        - ❌
37812        - ❌
37813        - ❌
37814      * - **browsertime-tp6m-live-fenix-wikipedia-e10s**
37815        - ❌
37816        - ❌
37817        - ❌
37818        - ❌
37819      * - **browsertime-tp6m-live-geckoview-wikipedia-e10s**
37820        - ❌
37821        - ❌
37822        - ❌
37823        - ❌
37824      * - **browsertime-tp6m-refbrow-wikipedia-e10s**
37825        - ❌
37826        - ❌
37827        - ❌
37828        - ❌
37829
37830
37831   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
37832      :widths: 30 15 15 15 15
37833      :header-rows: 1
37834
37835      * - **Test Name**
37836        - mozilla-central
37837        - autoland
37838        - mozilla-release
37839        - mozilla-beta
37840      * - **browsertime-tp6m-fenix-wikipedia-e10s**
37841        - ❌
37842        - ❌
37843        - ❌
37844        - ❌
37845      * - **browsertime-tp6m-geckoview-wikipedia-e10s**
37846        - ❌
37847        - ❌
37848        - ❌
37849        - ❌
37850      * - **browsertime-tp6m-live-fenix-wikipedia-e10s**
37851        - ❌
37852        - ❌
37853        - ❌
37854        - ❌
37855      * - **browsertime-tp6m-live-geckoview-wikipedia-e10s**
37856        - ❌
37857        - ❌
37858        - ❌
37859        - ❌
37860      * - **browsertime-tp6m-refbrow-wikipedia-e10s**
37861        - ❌
37862        - ❌
37863        - ❌
37864        - ❌
37865
37866
37867   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
37868      :widths: 30 15 15 15 15
37869      :header-rows: 1
37870
37871      * - **Test Name**
37872        - mozilla-central
37873        - autoland
37874        - mozilla-release
37875        - mozilla-beta
37876      * - **browsertime-tp6m-chrome-m-wikipedia-e10s**
37877        - ❌
37878        - ❌
37879        - ❌
37880        - ❌
37881      * - **browsertime-tp6m-fenix-wikipedia-e10s**
37882        - ❌
37883        - ❌
37884        - ❌
37885        - ❌
37886      * - **browsertime-tp6m-geckoview-wikipedia-e10s**
37887        - ❌
37888        - ❌
37889        - ❌
37890        - ❌
37891      * - **browsertime-tp6m-live-chrome-m-wikipedia-e10s**
37892        - ❌
37893        - ❌
37894        - ❌
37895        - ❌
37896      * - **browsertime-tp6m-live-fenix-wikipedia-e10s**
37897        - ❌
37898        - ❌
37899        - ❌
37900        - ❌
37901      * - **browsertime-tp6m-live-geckoview-wikipedia-e10s**
37902        - ❌
37903        - ❌
37904        - ❌
37905        - ❌
37906      * - **browsertime-tp6m-refbrow-wikipedia-e10s**
37907        - ❌
37908        - ❌
37909        - ❌
37910        - ❌
37911
37912
37913   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
37914      :widths: 30 15 15 15 15
37915      :header-rows: 1
37916
37917      * - **Test Name**
37918        - mozilla-central
37919        - autoland
37920        - mozilla-release
37921        - mozilla-beta
37922      * - **browsertime-tp6-essential-firefox-wikipedia-e10s**
37923        - ❌
37924        - ❌
37925        - ❌
37926        - ❌
37927      * - **browsertime-tp6-essential-firefox-wikipedia-fis-e10s**
37928        - ❌
37929        - ❌
37930        - ❌
37931        - ❌
37932      * - **browsertime-tp6-live-firefox-wikipedia-e10s**
37933        - ❌
37934        - ❌
37935        - ❌
37936        - ❌
37937      * - **browsertime-tp6-live-firefox-wikipedia-fis-e10s**
37938        - ❌
37939        - ❌
37940        - ❌
37941        - ❌
37942
37943
37944   .. list-table:: **test-linux1804-64-qr/opt**
37945      :widths: 30 15 15 15 15
37946      :header-rows: 1
37947
37948      * - **Test Name**
37949        - mozilla-central
37950        - autoland
37951        - mozilla-release
37952        - mozilla-beta
37953      * - **browsertime-tp6-essential-firefox-wikipedia-e10s**
37954        - ❌
37955        - ❌
37956        - ❌
37957        - ❌
37958      * - **browsertime-tp6-essential-firefox-wikipedia-fis-e10s**
37959        - ❌
37960        - ❌
37961        - ❌
37962        - ❌
37963      * - **browsertime-tp6-live-firefox-wikipedia-e10s**
37964        - ❌
37965        - ❌
37966        - ❌
37967        - ❌
37968      * - **browsertime-tp6-live-firefox-wikipedia-fis-e10s**
37969        - ❌
37970        - ❌
37971        - ❌
37972        - ❌
37973
37974
37975   .. list-table:: **test-linux1804-64-shippable-qr/opt**
37976      :widths: 30 15 15 15 15
37977      :header-rows: 1
37978
37979      * - **Test Name**
37980        - mozilla-central
37981        - autoland
37982        - mozilla-release
37983        - mozilla-beta
37984      * - **browsertime-tp6-essential-chrome-wikipedia-e10s**
37985        - ❌
37986        - ❌
37987        - ❌
37988        - ❌
37989      * - **browsertime-tp6-essential-chromium-wikipedia-e10s**
37990        - ❌
37991        - ❌
37992        - ❌
37993        - ❌
37994      * - **browsertime-tp6-essential-firefox-wikipedia-e10s**
37995        - ❌
37996        - ❌
37997        - ❌
37998        - ❌
37999      * - **browsertime-tp6-essential-firefox-wikipedia-fis-e10s**
38000        - ✅
38001        - ✅
38002        - ✅
38003        - ✅
38004      * - **browsertime-tp6-live-chrome-wikipedia-e10s**
38005        - ❌
38006        - ❌
38007        - ❌
38008        - ❌
38009      * - **browsertime-tp6-live-chromium-wikipedia-e10s**
38010        - ❌
38011        - ❌
38012        - ❌
38013        - ❌
38014      * - **browsertime-tp6-live-firefox-wikipedia-e10s**
38015        - ❌
38016        - ❌
38017        - ❌
38018        - ❌
38019      * - **browsertime-tp6-live-firefox-wikipedia-fis-e10s**
38020        - ❌
38021        - ❌
38022        - ❌
38023        - ❌
38024
38025
38026   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
38027      :widths: 30 15 15 15 15
38028      :header-rows: 1
38029
38030      * - **Test Name**
38031        - mozilla-central
38032        - autoland
38033        - mozilla-release
38034        - mozilla-beta
38035      * - **browsertime-tp6-essential-chrome-wikipedia-e10s**
38036        - ❌
38037        - ❌
38038        - ❌
38039        - ❌
38040      * - **browsertime-tp6-essential-chromium-wikipedia-e10s**
38041        - ❌
38042        - ❌
38043        - ❌
38044        - ❌
38045      * - **browsertime-tp6-essential-firefox-wikipedia-e10s**
38046        - ❌
38047        - ❌
38048        - ❌
38049        - ❌
38050      * - **browsertime-tp6-essential-firefox-wikipedia-fis-e10s**
38051        - ✅
38052        - ✅
38053        - ✅
38054        - ✅
38055      * - **browsertime-tp6-live-chrome-wikipedia-e10s**
38056        - ❌
38057        - ❌
38058        - ❌
38059        - ❌
38060      * - **browsertime-tp6-live-chromium-wikipedia-e10s**
38061        - ❌
38062        - ❌
38063        - ❌
38064        - ❌
38065      * - **browsertime-tp6-live-firefox-wikipedia-e10s**
38066        - ❌
38067        - ❌
38068        - ❌
38069        - ❌
38070      * - **browsertime-tp6-live-firefox-wikipedia-fis-e10s**
38071        - ❌
38072        - ❌
38073        - ❌
38074        - ❌
38075
38076
38077   .. list-table:: **test-windows10-32-qr/opt**
38078      :widths: 30 15 15 15 15
38079      :header-rows: 1
38080
38081      * - **Test Name**
38082        - mozilla-central
38083        - autoland
38084        - mozilla-release
38085        - mozilla-beta
38086      * - **browsertime-tp6-essential-firefox-wikipedia-e10s**
38087        - ❌
38088        - ❌
38089        - ❌
38090        - ❌
38091      * - **browsertime-tp6-essential-firefox-wikipedia-fis-e10s**
38092        - ❌
38093        - ❌
38094        - ❌
38095        - ❌
38096      * - **browsertime-tp6-live-firefox-wikipedia-e10s**
38097        - ❌
38098        - ❌
38099        - ❌
38100        - ❌
38101      * - **browsertime-tp6-live-firefox-wikipedia-fis-e10s**
38102        - ❌
38103        - ❌
38104        - ❌
38105        - ❌
38106
38107
38108   .. list-table:: **test-windows10-32-shippable-qr/opt**
38109      :widths: 30 15 15 15 15
38110      :header-rows: 1
38111
38112      * - **Test Name**
38113        - mozilla-central
38114        - autoland
38115        - mozilla-release
38116        - mozilla-beta
38117      * - **browsertime-tp6-essential-chrome-wikipedia-e10s**
38118        - ❌
38119        - ❌
38120        - ❌
38121        - ❌
38122      * - **browsertime-tp6-essential-chromium-wikipedia-e10s**
38123        - ❌
38124        - ❌
38125        - ❌
38126        - ❌
38127      * - **browsertime-tp6-essential-firefox-wikipedia-e10s**
38128        - ❌
38129        - ❌
38130        - ❌
38131        - ❌
38132      * - **browsertime-tp6-essential-firefox-wikipedia-fis-e10s**
38133        - ❌
38134        - ❌
38135        - ❌
38136        - ❌
38137      * - **browsertime-tp6-live-chrome-wikipedia-e10s**
38138        - ❌
38139        - ❌
38140        - ❌
38141        - ❌
38142      * - **browsertime-tp6-live-chromium-wikipedia-e10s**
38143        - ❌
38144        - ❌
38145        - ❌
38146        - ❌
38147      * - **browsertime-tp6-live-firefox-wikipedia-e10s**
38148        - ❌
38149        - ❌
38150        - ❌
38151        - ❌
38152      * - **browsertime-tp6-live-firefox-wikipedia-fis-e10s**
38153        - ❌
38154        - ❌
38155        - ❌
38156        - ❌
38157
38158
38159   .. list-table:: **test-windows10-64-qr/opt**
38160      :widths: 30 15 15 15 15
38161      :header-rows: 1
38162
38163      * - **Test Name**
38164        - mozilla-central
38165        - autoland
38166        - mozilla-release
38167        - mozilla-beta
38168      * - **browsertime-tp6-essential-firefox-wikipedia-e10s**
38169        - ❌
38170        - ❌
38171        - ❌
38172        - ❌
38173      * - **browsertime-tp6-essential-firefox-wikipedia-fis-e10s**
38174        - ❌
38175        - ❌
38176        - ❌
38177        - ❌
38178      * - **browsertime-tp6-live-firefox-wikipedia-e10s**
38179        - ❌
38180        - ❌
38181        - ❌
38182        - ❌
38183      * - **browsertime-tp6-live-firefox-wikipedia-fis-e10s**
38184        - ❌
38185        - ❌
38186        - ❌
38187        - ❌
38188
38189
38190   .. list-table:: **test-windows10-64-shippable-qr/opt**
38191      :widths: 30 15 15 15 15
38192      :header-rows: 1
38193
38194      * - **Test Name**
38195        - mozilla-central
38196        - autoland
38197        - mozilla-release
38198        - mozilla-beta
38199      * - **browsertime-tp6-essential-chrome-wikipedia-e10s**
38200        - ❌
38201        - ❌
38202        - ❌
38203        - ❌
38204      * - **browsertime-tp6-essential-chromium-wikipedia-e10s**
38205        - ❌
38206        - ❌
38207        - ❌
38208        - ❌
38209      * - **browsertime-tp6-essential-firefox-wikipedia-e10s**
38210        - ❌
38211        - ❌
38212        - ❌
38213        - ❌
38214      * - **browsertime-tp6-essential-firefox-wikipedia-fis-e10s**
38215        - ✅
38216        - ✅
38217        - ✅
38218        - ✅
38219      * - **browsertime-tp6-live-chrome-wikipedia-e10s**
38220        - ❌
38221        - ❌
38222        - ❌
38223        - ❌
38224      * - **browsertime-tp6-live-chromium-wikipedia-e10s**
38225        - ❌
38226        - ❌
38227        - ❌
38228        - ❌
38229      * - **browsertime-tp6-live-firefox-wikipedia-e10s**
38230        - ❌
38231        - ❌
38232        - ❌
38233        - ❌
38234      * - **browsertime-tp6-live-firefox-wikipedia-fis-e10s**
38235        - ❌
38236        - ❌
38237        - ❌
38238        - ❌
38239
38240
38241
38242.. dropdown:: youtube
38243   :container: + anchor-id-youtube-m
38244
38245   **Owner**: PerfTest Team
38246
38247   * **alert on**: fcp, loadtime
38248   * **alert threshold**: 2.0
38249   * **apps**: geckoview, fenix, refbrow, chrome-m
38250   * **browser cycles**: 15
38251   * **expected**: pass
38252   * **lower is better**: true
38253   * **page cycles**: 25
38254   * **page timeout**: 60000
38255   * **playback**: mitmproxy-android
38256   * **playback pageset manifest**: mitm6-android-fenix-youtube.manifest
38257   * **playback version**: 6.0.2
38258   * **test url**: `<https://m.youtube.com>`__
38259   * **type**: pageload
38260   * **unit**: ms
38261   * **use live sites**: false
38262   * **Test Task**:
38263
38264   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
38265      :widths: 30 15 15 15 15
38266      :header-rows: 1
38267
38268      * - **Test Name**
38269        - mozilla-central
38270        - autoland
38271        - mozilla-release
38272        - mozilla-beta
38273      * - **browsertime-tp6m-fenix-youtube-e10s**
38274        - ❌
38275        - ❌
38276        - ❌
38277        - ❌
38278      * - **browsertime-tp6m-geckoview-youtube-e10s**
38279        - ❌
38280        - ❌
38281        - ❌
38282        - ❌
38283      * - **browsertime-tp6m-live-fenix-youtube-e10s**
38284        - ❌
38285        - ❌
38286        - ❌
38287        - ❌
38288      * - **browsertime-tp6m-live-geckoview-youtube-e10s**
38289        - ❌
38290        - ❌
38291        - ❌
38292        - ❌
38293      * - **browsertime-tp6m-refbrow-youtube-e10s**
38294        - ❌
38295        - ❌
38296        - ❌
38297        - ❌
38298
38299
38300   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
38301      :widths: 30 15 15 15 15
38302      :header-rows: 1
38303
38304      * - **Test Name**
38305        - mozilla-central
38306        - autoland
38307        - mozilla-release
38308        - mozilla-beta
38309      * - **browsertime-tp6m-chrome-m-youtube-e10s**
38310        - ❌
38311        - ❌
38312        - ❌
38313        - ❌
38314      * - **browsertime-tp6m-fenix-youtube-e10s**
38315        - ❌
38316        - ❌
38317        - ❌
38318        - ❌
38319      * - **browsertime-tp6m-geckoview-youtube-e10s**
38320        - ✅
38321        - ✅
38322        - ✅
38323        - ✅
38324      * - **browsertime-tp6m-live-chrome-m-youtube-e10s**
38325        - ❌
38326        - ❌
38327        - ❌
38328        - ❌
38329      * - **browsertime-tp6m-live-fenix-youtube-e10s**
38330        - ❌
38331        - ❌
38332        - ❌
38333        - ❌
38334      * - **browsertime-tp6m-live-geckoview-youtube-e10s**
38335        - ❌
38336        - ❌
38337        - ❌
38338        - ❌
38339      * - **browsertime-tp6m-refbrow-youtube-e10s**
38340        - ❌
38341        - ❌
38342        - ❌
38343        - ❌
38344
38345
38346   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
38347      :widths: 30 15 15 15 15
38348      :header-rows: 1
38349
38350      * - **Test Name**
38351        - mozilla-central
38352        - autoland
38353        - mozilla-release
38354        - mozilla-beta
38355      * - **browsertime-tp6m-fenix-youtube-e10s**
38356        - ❌
38357        - ❌
38358        - ❌
38359        - ❌
38360      * - **browsertime-tp6m-geckoview-youtube-e10s**
38361        - ❌
38362        - ❌
38363        - ❌
38364        - ❌
38365      * - **browsertime-tp6m-live-fenix-youtube-e10s**
38366        - ❌
38367        - ❌
38368        - ❌
38369        - ❌
38370      * - **browsertime-tp6m-live-geckoview-youtube-e10s**
38371        - ❌
38372        - ❌
38373        - ❌
38374        - ❌
38375      * - **browsertime-tp6m-refbrow-youtube-e10s**
38376        - ❌
38377        - ❌
38378        - ❌
38379        - ❌
38380
38381
38382   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
38383      :widths: 30 15 15 15 15
38384      :header-rows: 1
38385
38386      * - **Test Name**
38387        - mozilla-central
38388        - autoland
38389        - mozilla-release
38390        - mozilla-beta
38391      * - **browsertime-tp6m-chrome-m-youtube-e10s**
38392        - ❌
38393        - ❌
38394        - ❌
38395        - ❌
38396      * - **browsertime-tp6m-fenix-youtube-e10s**
38397        - ❌
38398        - ❌
38399        - ❌
38400        - ❌
38401      * - **browsertime-tp6m-geckoview-youtube-e10s**
38402        - ✅
38403        - ✅
38404        - ✅
38405        - ✅
38406      * - **browsertime-tp6m-live-chrome-m-youtube-e10s**
38407        - ❌
38408        - ❌
38409        - ❌
38410        - ❌
38411      * - **browsertime-tp6m-live-fenix-youtube-e10s**
38412        - ❌
38413        - ❌
38414        - ❌
38415        - ❌
38416      * - **browsertime-tp6m-live-geckoview-youtube-e10s**
38417        - ❌
38418        - ❌
38419        - ❌
38420        - ❌
38421      * - **browsertime-tp6m-profiling-geckoview-youtube-e10s**
38422        - ✅
38423        - ❌
38424        - ❌
38425        - ❌
38426      * - **browsertime-tp6m-refbrow-youtube-e10s**
38427        - ❌
38428        - ❌
38429        - ❌
38430        - ❌
38431
38432
38433   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
38434      :widths: 30 15 15 15 15
38435      :header-rows: 1
38436
38437      * - **Test Name**
38438        - mozilla-central
38439        - autoland
38440        - mozilla-release
38441        - mozilla-beta
38442      * - **browsertime-tp6m-fenix-youtube-e10s**
38443        - ❌
38444        - ❌
38445        - ❌
38446        - ❌
38447      * - **browsertime-tp6m-geckoview-youtube-e10s**
38448        - ❌
38449        - ❌
38450        - ❌
38451        - ❌
38452      * - **browsertime-tp6m-live-fenix-youtube-e10s**
38453        - ❌
38454        - ❌
38455        - ❌
38456        - ❌
38457      * - **browsertime-tp6m-live-geckoview-youtube-e10s**
38458        - ❌
38459        - ❌
38460        - ❌
38461        - ❌
38462      * - **browsertime-tp6m-refbrow-youtube-e10s**
38463        - ❌
38464        - ❌
38465        - ❌
38466        - ❌
38467
38468
38469   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
38470      :widths: 30 15 15 15 15
38471      :header-rows: 1
38472
38473      * - **Test Name**
38474        - mozilla-central
38475        - autoland
38476        - mozilla-release
38477        - mozilla-beta
38478      * - **browsertime-tp6m-chrome-m-youtube-e10s**
38479        - ❌
38480        - ❌
38481        - ❌
38482        - ❌
38483      * - **browsertime-tp6m-fenix-youtube-e10s**
38484        - ❌
38485        - ❌
38486        - ❌
38487        - ❌
38488      * - **browsertime-tp6m-geckoview-youtube-e10s**
38489        - ❌
38490        - ❌
38491        - ❌
38492        - ❌
38493      * - **browsertime-tp6m-live-chrome-m-youtube-e10s**
38494        - ❌
38495        - ❌
38496        - ❌
38497        - ❌
38498      * - **browsertime-tp6m-live-fenix-youtube-e10s**
38499        - ❌
38500        - ❌
38501        - ❌
38502        - ❌
38503      * - **browsertime-tp6m-live-geckoview-youtube-e10s**
38504        - ❌
38505        - ❌
38506        - ❌
38507        - ❌
38508      * - **browsertime-tp6m-refbrow-youtube-e10s**
38509        - ❌
38510        - ❌
38511        - ❌
38512        - ❌
38513
38514
38515   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
38516      :widths: 30 15 15 15 15
38517      :header-rows: 1
38518
38519      * - **Test Name**
38520        - mozilla-central
38521        - autoland
38522        - mozilla-release
38523        - mozilla-beta
38524      * - **browsertime-tp6m-fenix-youtube-e10s**
38525        - ❌
38526        - ❌
38527        - ❌
38528        - ❌
38529      * - **browsertime-tp6m-geckoview-youtube-e10s**
38530        - ❌
38531        - ❌
38532        - ❌
38533        - ❌
38534      * - **browsertime-tp6m-live-fenix-youtube-e10s**
38535        - ❌
38536        - ❌
38537        - ❌
38538        - ❌
38539      * - **browsertime-tp6m-live-geckoview-youtube-e10s**
38540        - ❌
38541        - ❌
38542        - ❌
38543        - ❌
38544      * - **browsertime-tp6m-refbrow-youtube-e10s**
38545        - ❌
38546        - ❌
38547        - ❌
38548        - ❌
38549
38550
38551   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
38552      :widths: 30 15 15 15 15
38553      :header-rows: 1
38554
38555      * - **Test Name**
38556        - mozilla-central
38557        - autoland
38558        - mozilla-release
38559        - mozilla-beta
38560      * - **browsertime-tp6m-chrome-m-youtube-e10s**
38561        - ❌
38562        - ❌
38563        - ❌
38564        - ❌
38565      * - **browsertime-tp6m-fenix-youtube-e10s**
38566        - ❌
38567        - ❌
38568        - ❌
38569        - ❌
38570      * - **browsertime-tp6m-geckoview-youtube-e10s**
38571        - ❌
38572        - ❌
38573        - ❌
38574        - ❌
38575      * - **browsertime-tp6m-live-chrome-m-youtube-e10s**
38576        - ❌
38577        - ❌
38578        - ❌
38579        - ❌
38580      * - **browsertime-tp6m-live-fenix-youtube-e10s**
38581        - ❌
38582        - ❌
38583        - ❌
38584        - ❌
38585      * - **browsertime-tp6m-live-geckoview-youtube-e10s**
38586        - ❌
38587        - ❌
38588        - ❌
38589        - ❌
38590      * - **browsertime-tp6m-refbrow-youtube-e10s**
38591        - ❌
38592        - ❌
38593        - ❌
38594        - ❌
38595
38596
38597   .. list-table:: **test-linux1804-64-clang-trunk-qr/opt**
38598      :widths: 30 15 15 15 15
38599      :header-rows: 1
38600
38601      * - **Test Name**
38602        - mozilla-central
38603        - autoland
38604        - mozilla-release
38605        - mozilla-beta
38606      * - **browsertime-tp6-firefox-youtube-e10s**
38607        - ❌
38608        - ❌
38609        - ❌
38610        - ❌
38611      * - **browsertime-tp6-firefox-youtube-fis-e10s**
38612        - ❌
38613        - ❌
38614        - ❌
38615        - ❌
38616      * - **browsertime-tp6-live-firefox-youtube-e10s**
38617        - ❌
38618        - ❌
38619        - ❌
38620        - ❌
38621      * - **browsertime-tp6-live-firefox-youtube-fis-e10s**
38622        - ❌
38623        - ❌
38624        - ❌
38625        - ❌
38626
38627
38628   .. list-table:: **test-linux1804-64-qr/opt**
38629      :widths: 30 15 15 15 15
38630      :header-rows: 1
38631
38632      * - **Test Name**
38633        - mozilla-central
38634        - autoland
38635        - mozilla-release
38636        - mozilla-beta
38637      * - **browsertime-tp6-firefox-youtube-e10s**
38638        - ❌
38639        - ❌
38640        - ❌
38641        - ❌
38642      * - **browsertime-tp6-firefox-youtube-fis-e10s**
38643        - ❌
38644        - ❌
38645        - ❌
38646        - ❌
38647      * - **browsertime-tp6-live-firefox-youtube-e10s**
38648        - ❌
38649        - ❌
38650        - ❌
38651        - ❌
38652      * - **browsertime-tp6-live-firefox-youtube-fis-e10s**
38653        - ❌
38654        - ❌
38655        - ❌
38656        - ❌
38657
38658
38659   .. list-table:: **test-linux1804-64-shippable-qr/opt**
38660      :widths: 30 15 15 15 15
38661      :header-rows: 1
38662
38663      * - **Test Name**
38664        - mozilla-central
38665        - autoland
38666        - mozilla-release
38667        - mozilla-beta
38668      * - **browsertime-tp6-chrome-youtube-e10s**
38669        - ❌
38670        - ❌
38671        - ❌
38672        - ❌
38673      * - **browsertime-tp6-chromium-youtube-e10s**
38674        - ❌
38675        - ❌
38676        - ❌
38677        - ❌
38678      * - **browsertime-tp6-firefox-youtube-e10s**
38679        - ❌
38680        - ❌
38681        - ❌
38682        - ❌
38683      * - **browsertime-tp6-firefox-youtube-fis-e10s**
38684        - ✅
38685        - ✅
38686        - ✅
38687        - ✅
38688      * - **browsertime-tp6-live-chrome-youtube-e10s**
38689        - ❌
38690        - ❌
38691        - ❌
38692        - ❌
38693      * - **browsertime-tp6-live-chromium-youtube-e10s**
38694        - ❌
38695        - ❌
38696        - ❌
38697        - ❌
38698      * - **browsertime-tp6-live-firefox-youtube-e10s**
38699        - ❌
38700        - ❌
38701        - ❌
38702        - ❌
38703      * - **browsertime-tp6-live-firefox-youtube-fis-e10s**
38704        - ❌
38705        - ❌
38706        - ❌
38707        - ❌
38708
38709
38710   .. list-table:: **test-macosx1015-64-shippable-qr/opt**
38711      :widths: 30 15 15 15 15
38712      :header-rows: 1
38713
38714      * - **Test Name**
38715        - mozilla-central
38716        - autoland
38717        - mozilla-release
38718        - mozilla-beta
38719      * - **browsertime-tp6-chrome-youtube-e10s**
38720        - ❌
38721        - ❌
38722        - ❌
38723        - ❌
38724      * - **browsertime-tp6-chromium-youtube-e10s**
38725        - ❌
38726        - ❌
38727        - ❌
38728        - ❌
38729      * - **browsertime-tp6-firefox-youtube-e10s**
38730        - ❌
38731        - ❌
38732        - ❌
38733        - ❌
38734      * - **browsertime-tp6-firefox-youtube-fis-e10s**
38735        - ✅
38736        - ✅
38737        - ✅
38738        - ✅
38739      * - **browsertime-tp6-live-chrome-youtube-e10s**
38740        - ❌
38741        - ❌
38742        - ❌
38743        - ❌
38744      * - **browsertime-tp6-live-chromium-youtube-e10s**
38745        - ❌
38746        - ❌
38747        - ❌
38748        - ❌
38749      * - **browsertime-tp6-live-firefox-youtube-e10s**
38750        - ❌
38751        - ❌
38752        - ❌
38753        - ❌
38754      * - **browsertime-tp6-live-firefox-youtube-fis-e10s**
38755        - ❌
38756        - ❌
38757        - ❌
38758        - ❌
38759
38760
38761   .. list-table:: **test-windows10-32-qr/opt**
38762      :widths: 30 15 15 15 15
38763      :header-rows: 1
38764
38765      * - **Test Name**
38766        - mozilla-central
38767        - autoland
38768        - mozilla-release
38769        - mozilla-beta
38770      * - **browsertime-tp6-firefox-youtube-e10s**
38771        - ❌
38772        - ❌
38773        - ❌
38774        - ❌
38775      * - **browsertime-tp6-firefox-youtube-fis-e10s**
38776        - ❌
38777        - ❌
38778        - ❌
38779        - ❌
38780      * - **browsertime-tp6-live-firefox-youtube-e10s**
38781        - ❌
38782        - ❌
38783        - ❌
38784        - ❌
38785      * - **browsertime-tp6-live-firefox-youtube-fis-e10s**
38786        - ❌
38787        - ❌
38788        - ❌
38789        - ❌
38790
38791
38792   .. list-table:: **test-windows10-32-shippable-qr/opt**
38793      :widths: 30 15 15 15 15
38794      :header-rows: 1
38795
38796      * - **Test Name**
38797        - mozilla-central
38798        - autoland
38799        - mozilla-release
38800        - mozilla-beta
38801      * - **browsertime-tp6-chrome-youtube-e10s**
38802        - ❌
38803        - ❌
38804        - ❌
38805        - ❌
38806      * - **browsertime-tp6-chromium-youtube-e10s**
38807        - ❌
38808        - ❌
38809        - ❌
38810        - ❌
38811      * - **browsertime-tp6-firefox-youtube-e10s**
38812        - ❌
38813        - ❌
38814        - ❌
38815        - ❌
38816      * - **browsertime-tp6-firefox-youtube-fis-e10s**
38817        - ❌
38818        - ❌
38819        - ❌
38820        - ❌
38821      * - **browsertime-tp6-live-chrome-youtube-e10s**
38822        - ❌
38823        - ❌
38824        - ❌
38825        - ❌
38826      * - **browsertime-tp6-live-chromium-youtube-e10s**
38827        - ❌
38828        - ❌
38829        - ❌
38830        - ❌
38831      * - **browsertime-tp6-live-firefox-youtube-e10s**
38832        - ❌
38833        - ❌
38834        - ❌
38835        - ❌
38836      * - **browsertime-tp6-live-firefox-youtube-fis-e10s**
38837        - ❌
38838        - ❌
38839        - ❌
38840        - ❌
38841
38842
38843   .. list-table:: **test-windows10-64-qr/opt**
38844      :widths: 30 15 15 15 15
38845      :header-rows: 1
38846
38847      * - **Test Name**
38848        - mozilla-central
38849        - autoland
38850        - mozilla-release
38851        - mozilla-beta
38852      * - **browsertime-tp6-firefox-youtube-e10s**
38853        - ❌
38854        - ❌
38855        - ❌
38856        - ❌
38857      * - **browsertime-tp6-firefox-youtube-fis-e10s**
38858        - ❌
38859        - ❌
38860        - ❌
38861        - ❌
38862      * - **browsertime-tp6-live-firefox-youtube-e10s**
38863        - ❌
38864        - ❌
38865        - ❌
38866        - ❌
38867      * - **browsertime-tp6-live-firefox-youtube-fis-e10s**
38868        - ❌
38869        - ❌
38870        - ❌
38871        - ❌
38872
38873
38874   .. list-table:: **test-windows10-64-shippable-qr/opt**
38875      :widths: 30 15 15 15 15
38876      :header-rows: 1
38877
38878      * - **Test Name**
38879        - mozilla-central
38880        - autoland
38881        - mozilla-release
38882        - mozilla-beta
38883      * - **browsertime-tp6-chrome-youtube-e10s**
38884        - ❌
38885        - ❌
38886        - ❌
38887        - ❌
38888      * - **browsertime-tp6-chromium-youtube-e10s**
38889        - ❌
38890        - ❌
38891        - ❌
38892        - ❌
38893      * - **browsertime-tp6-firefox-youtube-e10s**
38894        - ❌
38895        - ❌
38896        - ❌
38897        - ❌
38898      * - **browsertime-tp6-firefox-youtube-fis-e10s**
38899        - ✅
38900        - ✅
38901        - ✅
38902        - ✅
38903      * - **browsertime-tp6-live-chrome-youtube-e10s**
38904        - ❌
38905        - ❌
38906        - ❌
38907        - ❌
38908      * - **browsertime-tp6-live-chromium-youtube-e10s**
38909        - ❌
38910        - ❌
38911        - ❌
38912        - ❌
38913      * - **browsertime-tp6-live-firefox-youtube-e10s**
38914        - ❌
38915        - ❌
38916        - ❌
38917        - ❌
38918      * - **browsertime-tp6-live-firefox-youtube-fis-e10s**
38919        - ❌
38920        - ❌
38921        - ❌
38922        - ❌
38923
38924
38925
38926.. dropdown:: youtube-watch
38927   :container: + anchor-id-youtube-watch-m
38928
38929   **Owner**: PerfTest Team
38930
38931   * **alert on**: fcp, loadtime
38932   * **alert threshold**: 2.0
38933   * **apps**: geckoview, fenix, refbrow, chrome-m
38934   * **browser cycles**: 15
38935   * **expected**: pass
38936   * **lower is better**: true
38937   * **page cycles**: 25
38938   * **page timeout**: 60000
38939   * **playback**: mitmproxy-android
38940   * **playback pageset manifest**: mitm6-android-fenix-youtube-watch.manifest
38941   * **playback version**: 6.0.2
38942   * **test url**: `<https://www.youtube.com/watch?v=COU5T-Wafa4>`__
38943   * **type**: pageload
38944   * **unit**: ms
38945   * **use live sites**: false
38946   * **Test Task**:
38947
38948   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
38949      :widths: 30 15 15 15 15
38950      :header-rows: 1
38951
38952      * - **Test Name**
38953        - mozilla-central
38954        - autoland
38955        - mozilla-release
38956        - mozilla-beta
38957      * - **browsertime-tp6m-essential-fenix-youtube-watch-e10s**
38958        - ❌
38959        - ❌
38960        - ❌
38961        - ❌
38962      * - **browsertime-tp6m-essential-geckoview-youtube-watch-e10s**
38963        - ❌
38964        - ❌
38965        - ❌
38966        - ❌
38967      * - **browsertime-tp6m-essential-refbrow-youtube-watch-e10s**
38968        - ❌
38969        - ❌
38970        - ❌
38971        - ❌
38972      * - **browsertime-tp6m-live-fenix-youtube-watch-e10s**
38973        - ❌
38974        - ❌
38975        - ❌
38976        - ❌
38977      * - **browsertime-tp6m-live-geckoview-youtube-watch-e10s**
38978        - ❌
38979        - ❌
38980        - ❌
38981        - ❌
38982
38983
38984   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
38985      :widths: 30 15 15 15 15
38986      :header-rows: 1
38987
38988      * - **Test Name**
38989        - mozilla-central
38990        - autoland
38991        - mozilla-release
38992        - mozilla-beta
38993      * - **browsertime-tp6m-essential-chrome-m-youtube-watch-e10s**
38994        - ❌
38995        - ❌
38996        - ❌
38997        - ❌
38998      * - **browsertime-tp6m-essential-fenix-youtube-watch-e10s**
38999        - ❌
39000        - ❌
39001        - ❌
39002        - ❌
39003      * - **browsertime-tp6m-essential-geckoview-youtube-watch-e10s**
39004        - ✅
39005        - ✅
39006        - ✅
39007        - ✅
39008      * - **browsertime-tp6m-essential-refbrow-youtube-watch-e10s**
39009        - ❌
39010        - ❌
39011        - ❌
39012        - ❌
39013      * - **browsertime-tp6m-live-chrome-m-youtube-watch-e10s**
39014        - ❌
39015        - ❌
39016        - ❌
39017        - ❌
39018      * - **browsertime-tp6m-live-fenix-youtube-watch-e10s**
39019        - ❌
39020        - ❌
39021        - ❌
39022        - ❌
39023      * - **browsertime-tp6m-live-geckoview-youtube-watch-e10s**
39024        - ❌
39025        - ❌
39026        - ❌
39027        - ❌
39028
39029
39030   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
39031      :widths: 30 15 15 15 15
39032      :header-rows: 1
39033
39034      * - **Test Name**
39035        - mozilla-central
39036        - autoland
39037        - mozilla-release
39038        - mozilla-beta
39039      * - **browsertime-tp6m-essential-fenix-youtube-watch-e10s**
39040        - ❌
39041        - ❌
39042        - ❌
39043        - ❌
39044      * - **browsertime-tp6m-essential-geckoview-youtube-watch-e10s**
39045        - ❌
39046        - ❌
39047        - ❌
39048        - ❌
39049      * - **browsertime-tp6m-essential-refbrow-youtube-watch-e10s**
39050        - ❌
39051        - ❌
39052        - ❌
39053        - ❌
39054      * - **browsertime-tp6m-live-fenix-youtube-watch-e10s**
39055        - ❌
39056        - ❌
39057        - ❌
39058        - ❌
39059      * - **browsertime-tp6m-live-geckoview-youtube-watch-e10s**
39060        - ❌
39061        - ❌
39062        - ❌
39063        - ❌
39064
39065
39066   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
39067      :widths: 30 15 15 15 15
39068      :header-rows: 1
39069
39070      * - **Test Name**
39071        - mozilla-central
39072        - autoland
39073        - mozilla-release
39074        - mozilla-beta
39075      * - **browsertime-tp6m-essential-chrome-m-youtube-watch-e10s**
39076        - ❌
39077        - ❌
39078        - ❌
39079        - ❌
39080      * - **browsertime-tp6m-essential-fenix-youtube-watch-e10s**
39081        - ❌
39082        - ❌
39083        - ❌
39084        - ❌
39085      * - **browsertime-tp6m-essential-geckoview-youtube-watch-e10s**
39086        - ✅
39087        - ✅
39088        - ✅
39089        - ✅
39090      * - **browsertime-tp6m-essential-refbrow-youtube-watch-e10s**
39091        - ❌
39092        - ❌
39093        - ❌
39094        - ❌
39095      * - **browsertime-tp6m-live-chrome-m-youtube-watch-e10s**
39096        - ❌
39097        - ❌
39098        - ❌
39099        - ❌
39100      * - **browsertime-tp6m-live-fenix-youtube-watch-e10s**
39101        - ❌
39102        - ❌
39103        - ❌
39104        - ❌
39105      * - **browsertime-tp6m-live-geckoview-youtube-watch-e10s**
39106        - ❌
39107        - ❌
39108        - ❌
39109        - ❌
39110
39111
39112   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
39113      :widths: 30 15 15 15 15
39114      :header-rows: 1
39115
39116      * - **Test Name**
39117        - mozilla-central
39118        - autoland
39119        - mozilla-release
39120        - mozilla-beta
39121      * - **browsertime-tp6m-essential-fenix-youtube-watch-e10s**
39122        - ❌
39123        - ❌
39124        - ❌
39125        - ❌
39126      * - **browsertime-tp6m-essential-geckoview-youtube-watch-e10s**
39127        - ❌
39128        - ❌
39129        - ❌
39130        - ❌
39131      * - **browsertime-tp6m-essential-refbrow-youtube-watch-e10s**
39132        - ❌
39133        - ❌
39134        - ❌
39135        - ❌
39136      * - **browsertime-tp6m-live-fenix-youtube-watch-e10s**
39137        - ❌
39138        - ❌
39139        - ❌
39140        - ❌
39141      * - **browsertime-tp6m-live-geckoview-youtube-watch-e10s**
39142        - ❌
39143        - ❌
39144        - ❌
39145        - ❌
39146
39147
39148   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
39149      :widths: 30 15 15 15 15
39150      :header-rows: 1
39151
39152      * - **Test Name**
39153        - mozilla-central
39154        - autoland
39155        - mozilla-release
39156        - mozilla-beta
39157      * - **browsertime-tp6m-essential-chrome-m-youtube-watch-e10s**
39158        - ❌
39159        - ❌
39160        - ❌
39161        - ❌
39162      * - **browsertime-tp6m-essential-fenix-youtube-watch-e10s**
39163        - ❌
39164        - ❌
39165        - ❌
39166        - ❌
39167      * - **browsertime-tp6m-essential-geckoview-youtube-watch-e10s**
39168        - ❌
39169        - ❌
39170        - ❌
39171        - ❌
39172      * - **browsertime-tp6m-essential-refbrow-youtube-watch-e10s**
39173        - ❌
39174        - ❌
39175        - ❌
39176        - ❌
39177      * - **browsertime-tp6m-live-chrome-m-youtube-watch-e10s**
39178        - ❌
39179        - ❌
39180        - ❌
39181        - ❌
39182      * - **browsertime-tp6m-live-fenix-youtube-watch-e10s**
39183        - ❌
39184        - ❌
39185        - ❌
39186        - ❌
39187      * - **browsertime-tp6m-live-geckoview-youtube-watch-e10s**
39188        - ❌
39189        - ❌
39190        - ❌
39191        - ❌
39192
39193
39194   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-qr/opt**
39195      :widths: 30 15 15 15 15
39196      :header-rows: 1
39197
39198      * - **Test Name**
39199        - mozilla-central
39200        - autoland
39201        - mozilla-release
39202        - mozilla-beta
39203      * - **browsertime-tp6m-essential-fenix-youtube-watch-e10s**
39204        - ❌
39205        - ❌
39206        - ❌
39207        - ❌
39208      * - **browsertime-tp6m-essential-geckoview-youtube-watch-e10s**
39209        - ❌
39210        - ❌
39211        - ❌
39212        - ❌
39213      * - **browsertime-tp6m-essential-refbrow-youtube-watch-e10s**
39214        - ❌
39215        - ❌
39216        - ❌
39217        - ❌
39218      * - **browsertime-tp6m-live-fenix-youtube-watch-e10s**
39219        - ❌
39220        - ❌
39221        - ❌
39222        - ❌
39223      * - **browsertime-tp6m-live-geckoview-youtube-watch-e10s**
39224        - ❌
39225        - ❌
39226        - ❌
39227        - ❌
39228
39229
39230   .. list-table:: **test-android-hw-s7-8-0-android-aarch64-shippable-qr/opt**
39231      :widths: 30 15 15 15 15
39232      :header-rows: 1
39233
39234      * - **Test Name**
39235        - mozilla-central
39236        - autoland
39237        - mozilla-release
39238        - mozilla-beta
39239      * - **browsertime-tp6m-essential-chrome-m-youtube-watch-e10s**
39240        - ❌
39241        - ❌
39242        - ❌
39243        - ❌
39244      * - **browsertime-tp6m-essential-fenix-youtube-watch-e10s**
39245        - ❌
39246        - ❌
39247        - ❌
39248        - ❌
39249      * - **browsertime-tp6m-essential-geckoview-youtube-watch-e10s**
39250        - ❌
39251        - ❌
39252        - ❌
39253        - ❌
39254      * - **browsertime-tp6m-essential-refbrow-youtube-watch-e10s**
39255        - ❌
39256        - ❌
39257        - ❌
39258        - ❌
39259      * - **browsertime-tp6m-live-chrome-m-youtube-watch-e10s**
39260        - ❌
39261        - ❌
39262        - ❌
39263        - ❌
39264      * - **browsertime-tp6m-live-fenix-youtube-watch-e10s**
39265        - ❌
39266        - ❌
39267        - ❌
39268        - ❌
39269      * - **browsertime-tp6m-live-geckoview-youtube-watch-e10s**
39270        - ❌
39271        - ❌
39272        - ❌
39273        - ❌
39274
39275
39276
39277
39278Scenario
39279--------
39280Tests that perform a specific action (a scenario), i.e. idle application, idle application in background, etc.
39281
39282.. dropdown:: idle
39283   :container: + anchor-id-idle-s
39284
39285   **Owner**: PerfTest Team
39286
39287   * **alert threshold**: 2.0
39288   * **apps**: fenix, geckoview, refbrow
39289   * **expected**: pass
39290   * **lower is better**: true
39291   * **measure**: fakeMeasure
39292   * **page cycles**: 1
39293   * **page timeout**: 1320000
39294   * **scenario time**: 1200000
39295   * **test url**: `<about:blank>`__
39296   * **type**: scenario
39297   * **unit**: scenarioComplete
39298   * **Test Task**:
39299
39300   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
39301      :widths: 30 15 15 15 15
39302      :header-rows: 1
39303
39304      * - **Test Name**
39305        - mozilla-central
39306        - autoland
39307        - mozilla-release
39308        - mozilla-beta
39309      * - **browsertime-power-fenix-idle-e10s**
39310        - ❌
39311        - ❌
39312        - ❌
39313        - ❌
39314      * - **browsertime-power-geckoview-idle-e10s**
39315        - ❌
39316        - ❌
39317        - ❌
39318        - ❌
39319      * - **browsertime-power-refbrow-idle-e10s**
39320        - ❌
39321        - ❌
39322        - ❌
39323        - ❌
39324
39325
39326   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
39327      :widths: 30 15 15 15 15
39328      :header-rows: 1
39329
39330      * - **Test Name**
39331        - mozilla-central
39332        - autoland
39333        - mozilla-release
39334        - mozilla-beta
39335      * - **browsertime-power-fenix-idle-e10s**
39336        - ❌
39337        - ❌
39338        - ❌
39339        - ❌
39340      * - **browsertime-power-geckoview-idle-e10s**
39341        - ❌
39342        - ❌
39343        - ❌
39344        - ❌
39345      * - **browsertime-power-refbrow-idle-e10s**
39346        - ❌
39347        - ❌
39348        - ❌
39349        - ❌
39350
39351
39352   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
39353      :widths: 30 15 15 15 15
39354      :header-rows: 1
39355
39356      * - **Test Name**
39357        - mozilla-central
39358        - autoland
39359        - mozilla-release
39360        - mozilla-beta
39361      * - **browsertime-power-fenix-idle-e10s**
39362        - ❌
39363        - ❌
39364        - ❌
39365        - ❌
39366      * - **browsertime-power-geckoview-idle-e10s**
39367        - ❌
39368        - ❌
39369        - ❌
39370        - ❌
39371      * - **browsertime-power-refbrow-idle-e10s**
39372        - ❌
39373        - ❌
39374        - ❌
39375        - ❌
39376
39377
39378   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
39379      :widths: 30 15 15 15 15
39380      :header-rows: 1
39381
39382      * - **Test Name**
39383        - mozilla-central
39384        - autoland
39385        - mozilla-release
39386        - mozilla-beta
39387      * - **browsertime-power-fenix-idle-e10s**
39388        - ❌
39389        - ❌
39390        - ❌
39391        - ❌
39392      * - **browsertime-power-geckoview-idle-e10s**
39393        - ❌
39394        - ❌
39395        - ❌
39396        - ❌
39397      * - **browsertime-power-refbrow-idle-e10s**
39398        - ❌
39399        - ❌
39400        - ❌
39401        - ❌
39402
39403
39404   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
39405      :widths: 30 15 15 15 15
39406      :header-rows: 1
39407
39408      * - **Test Name**
39409        - mozilla-central
39410        - autoland
39411        - mozilla-release
39412        - mozilla-beta
39413      * - **browsertime-power-fenix-idle-e10s**
39414        - ❌
39415        - ❌
39416        - ❌
39417        - ❌
39418      * - **browsertime-power-geckoview-idle-e10s**
39419        - ❌
39420        - ❌
39421        - ❌
39422        - ❌
39423      * - **browsertime-power-refbrow-idle-e10s**
39424        - ❌
39425        - ❌
39426        - ❌
39427        - ❌
39428
39429
39430   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
39431      :widths: 30 15 15 15 15
39432      :header-rows: 1
39433
39434      * - **Test Name**
39435        - mozilla-central
39436        - autoland
39437        - mozilla-release
39438        - mozilla-beta
39439      * - **browsertime-power-fenix-idle-e10s**
39440        - ❌
39441        - ❌
39442        - ❌
39443        - ❌
39444      * - **browsertime-power-geckoview-idle-e10s**
39445        - ❌
39446        - ❌
39447        - ❌
39448        - ❌
39449      * - **browsertime-power-refbrow-idle-e10s**
39450        - ❌
39451        - ❌
39452        - ❌
39453        - ❌
39454
39455
39456
39457.. dropdown:: idle-bg
39458   :container: + anchor-id-idle-bg-s
39459
39460   **Owner**: PerfTest Team
39461
39462   * **alert threshold**: 2.0
39463   * **apps**: fenix, geckoview, refbrow
39464   * **browsertime args**: --browsertime.scenario_time=60000 --browsertime.background_app=false
39465   * **expected**: pass
39466   * **lower is better**: true
39467   * **measure**: fakeMeasure
39468   * **page cycles**: 1
39469   * **page timeout**: 1320000
39470   * **scenario time**: 1200000
39471   * **test url**: `<about:blank>`__
39472   * **type**: scenario
39473   * **unit**: scenarioComplete
39474   * **Test Task**:
39475
39476   .. list-table:: **test-android-hw-g5-7-0-arm7-qr/opt**
39477      :widths: 30 15 15 15 15
39478      :header-rows: 1
39479
39480      * - **Test Name**
39481        - mozilla-central
39482        - autoland
39483        - mozilla-release
39484        - mozilla-beta
39485      * - **browsertime-power-fenix-idle-bg-e10s**
39486        - ❌
39487        - ❌
39488        - ❌
39489        - ❌
39490      * - **browsertime-power-geckoview-idle-bg-e10s**
39491        - ❌
39492        - ❌
39493        - ❌
39494        - ❌
39495      * - **browsertime-power-refbrow-idle-bg-e10s**
39496        - ❌
39497        - ❌
39498        - ❌
39499        - ❌
39500
39501
39502   .. list-table:: **test-android-hw-g5-7-0-arm7-shippable-qr/opt**
39503      :widths: 30 15 15 15 15
39504      :header-rows: 1
39505
39506      * - **Test Name**
39507        - mozilla-central
39508        - autoland
39509        - mozilla-release
39510        - mozilla-beta
39511      * - **browsertime-power-fenix-idle-bg-e10s**
39512        - ❌
39513        - ❌
39514        - ❌
39515        - ❌
39516      * - **browsertime-power-geckoview-idle-bg-e10s**
39517        - ❌
39518        - ❌
39519        - ❌
39520        - ❌
39521      * - **browsertime-power-refbrow-idle-bg-e10s**
39522        - ❌
39523        - ❌
39524        - ❌
39525        - ❌
39526
39527
39528   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-qr/opt**
39529      :widths: 30 15 15 15 15
39530      :header-rows: 1
39531
39532      * - **Test Name**
39533        - mozilla-central
39534        - autoland
39535        - mozilla-release
39536        - mozilla-beta
39537      * - **browsertime-power-fenix-idle-bg-e10s**
39538        - ❌
39539        - ❌
39540        - ❌
39541        - ❌
39542      * - **browsertime-power-geckoview-idle-bg-e10s**
39543        - ❌
39544        - ❌
39545        - ❌
39546        - ❌
39547      * - **browsertime-power-refbrow-idle-bg-e10s**
39548        - ❌
39549        - ❌
39550        - ❌
39551        - ❌
39552
39553
39554   .. list-table:: **test-android-hw-p2-8-0-android-aarch64-shippable-qr/opt**
39555      :widths: 30 15 15 15 15
39556      :header-rows: 1
39557
39558      * - **Test Name**
39559        - mozilla-central
39560        - autoland
39561        - mozilla-release
39562        - mozilla-beta
39563      * - **browsertime-power-fenix-idle-bg-e10s**
39564        - ❌
39565        - ❌
39566        - ❌
39567        - ❌
39568      * - **browsertime-power-geckoview-idle-bg-e10s**
39569        - ❌
39570        - ❌
39571        - ❌
39572        - ❌
39573      * - **browsertime-power-refbrow-idle-bg-e10s**
39574        - ❌
39575        - ❌
39576        - ❌
39577        - ❌
39578
39579
39580   .. list-table:: **test-android-hw-p2-8-0-arm7-qr/opt**
39581      :widths: 30 15 15 15 15
39582      :header-rows: 1
39583
39584      * - **Test Name**
39585        - mozilla-central
39586        - autoland
39587        - mozilla-release
39588        - mozilla-beta
39589      * - **browsertime-power-fenix-idle-bg-e10s**
39590        - ❌
39591        - ❌
39592        - ❌
39593        - ❌
39594      * - **browsertime-power-geckoview-idle-bg-e10s**
39595        - ❌
39596        - ❌
39597        - ❌
39598        - ❌
39599      * - **browsertime-power-refbrow-idle-bg-e10s**
39600        - ❌
39601        - ❌
39602        - ❌
39603        - ❌
39604
39605
39606   .. list-table:: **test-android-hw-p2-8-0-arm7-shippable-qr/opt**
39607      :widths: 30 15 15 15 15
39608      :header-rows: 1
39609
39610      * - **Test Name**
39611        - mozilla-central
39612        - autoland
39613        - mozilla-release
39614        - mozilla-beta
39615      * - **browsertime-power-fenix-idle-bg-e10s**
39616        - ❌
39617        - ❌
39618        - ❌
39619        - ❌
39620      * - **browsertime-power-geckoview-idle-bg-e10s**
39621        - ❌
39622        - ❌
39623        - ❌
39624        - ❌
39625      * - **browsertime-power-refbrow-idle-bg-e10s**
39626        - ❌
39627        - ❌
39628        - ❌
39629        - ❌
39630
39631
39632
39633.. dropdown:: raptor-scn-power-idle-bg-fenix
39634   :container: + anchor-id-raptor-scn-power-idle-bg-fenix-s
39635
39636   **Owner**: PerfTest Team
39637
39638   * **alert threshold**: 2.0
39639   * **apps**: fenix
39640   * **background test**: true
39641   * **expected**: pass
39642   * **lower is better**: true
39643   * **measure**: fakeMeasure
39644   * **page cycles**: 1
39645   * **page timeout**: 660000
39646   * **scenario time**: 600000
39647   * **test url**: `<about:blank>`__
39648   * **type**: scenario
39649   * **unit**: scenarioComplete
39650
39651.. dropdown:: raptor-scn-power-idle-bg-geckoview
39652   :container: + anchor-id-raptor-scn-power-idle-bg-geckoview-s
39653
39654   **Owner**: PerfTest Team
39655
39656   * **alert threshold**: 2.0
39657   * **apps**: geckoview
39658   * **background test**: true
39659   * **expected**: pass
39660   * **lower is better**: true
39661   * **measure**: fakeMeasure
39662   * **page cycles**: 1
39663   * **page timeout**: 660000
39664   * **scenario time**: 600000
39665   * **test url**: `<about:blank>`__
39666   * **type**: scenario
39667   * **unit**: scenarioComplete
39668
39669.. dropdown:: raptor-scn-power-idle-bg-refbrow
39670   :container: + anchor-id-raptor-scn-power-idle-bg-refbrow-s
39671
39672   **Owner**: PerfTest Team
39673
39674   * **alert threshold**: 2.0
39675   * **apps**: refbrow
39676   * **background test**: true
39677   * **expected**: pass
39678   * **lower is better**: true
39679   * **measure**: fakeMeasure
39680   * **page cycles**: 1
39681   * **page timeout**: 660000
39682   * **scenario time**: 600000
39683   * **test url**: `<about:blank>`__
39684   * **type**: scenario
39685   * **unit**: scenarioComplete
39686
39687.. dropdown:: raptor-scn-power-idle-fenix
39688   :container: + anchor-id-raptor-scn-power-idle-fenix-s
39689
39690   **Owner**: PerfTest Team
39691
39692   * **alert threshold**: 2.0
39693   * **apps**: fenix
39694   * **expected**: pass
39695   * **lower is better**: true
39696   * **measure**: fakeMeasure
39697   * **page cycles**: 1
39698   * **page timeout**: 1320000
39699   * **scenario time**: 1200000
39700   * **test url**: `<about:blank>`__
39701   * **type**: scenario
39702   * **unit**: scenarioComplete
39703
39704.. dropdown:: raptor-scn-power-idle-geckoview
39705   :container: + anchor-id-raptor-scn-power-idle-geckoview-s
39706
39707   **Owner**: PerfTest Team
39708
39709   * **alert threshold**: 2.0
39710   * **apps**: geckoview
39711   * **expected**: pass
39712   * **lower is better**: true
39713   * **measure**: fakeMeasure
39714   * **page cycles**: 1
39715   * **page timeout**: 1320000
39716   * **scenario time**: 1200000
39717   * **test url**: `<about:blank>`__
39718   * **type**: scenario
39719   * **unit**: scenarioComplete
39720
39721.. dropdown:: raptor-scn-power-idle-refbrow
39722   :container: + anchor-id-raptor-scn-power-idle-refbrow-s
39723
39724   **Owner**: PerfTest Team
39725
39726   * **alert threshold**: 2.0
39727   * **apps**: refbrow
39728   * **expected**: pass
39729   * **lower is better**: true
39730   * **measure**: fakeMeasure
39731   * **page cycles**: 1
39732   * **page timeout**: 1320000
39733   * **scenario time**: 1200000
39734   * **test url**: `<about:blank>`__
39735   * **type**: scenario
39736   * **unit**: scenarioComplete
39737
39738
39739Unittests
39740---------
39741These tests aren't used in standard testing, they are only used in the Raptor unit tests (they are similar to raptor-tp6 tests though).
39742
39743.. dropdown:: raptor-tp6-unittest-amazon-firefox
39744   :container: + anchor-id-raptor-tp6-unittest-amazon-firefox-u
39745
39746   **Owner**: PerfTest Team
39747
39748   * **alert on**: fcp, loadtime
39749   * **alert threshold**: 2.0
39750   * **apps**: firefox
39751   * **expected**: pass
39752   * **gecko profile entries**: 14000000
39753   * **gecko profile interval**: 1
39754   * **lower is better**: true
39755   * **measure**: fnbpaint, fcp, dcf, loadtime
39756   * **page cycles**: 25
39757   * **page timeout**: 60000
39758   * **playback**: mitmproxy
39759   * **playback pageset manifest**: mitm5-linux-firefox-amazon.manifest
39760   * **test url**: `<https://www.amazon.com/s?k=laptop&ref=nb_sb_noss_1>`__
39761   * **type**: pageload
39762   * **unit**: ms
39763
39764.. dropdown:: raptor-tp6-unittest-facebook-firefox
39765   :container: + anchor-id-raptor-tp6-unittest-facebook-firefox-u
39766
39767   **Owner**: PerfTest Team
39768
39769   * **alert on**: fcp, loadtime
39770   * **alert threshold**: 2.0
39771   * **apps**: firefox
39772   * **expected**: pass
39773   * **gecko profile entries**: 14000000
39774   * **gecko profile interval**: 1
39775   * **lower is better**: true
39776   * **measure**: fnbpaint, fcp, dcf, loadtime
39777   * **page cycles**: 25
39778   * **page timeout**: 60000
39779   * **playback**: mitmproxy
39780   * **playback pageset manifest**: mitm5-linux-firefox-facebook.manifest
39781   * **test url**: `<https://www.facebook.com>`__
39782   * **type**: pageload
39783   * **unit**: ms
39784
39785.. dropdown:: raptor-tp6-unittest-google-firefox
39786   :container: + anchor-id-raptor-tp6-unittest-google-firefox-u
39787
39788   **Owner**: PerfTest Team
39789
39790   * **alert on**: fcp, loadtime
39791   * **alert threshold**: 2.0
39792   * **apps**: firefox
39793   * **expected**: pass
39794   * **gecko profile entries**: 14000000
39795   * **gecko profile interval**: 1
39796   * **lower is better**: true
39797   * **measure**: fnbpaint, fcp, dcf, loadtime
39798   * **page cycles**: 25
39799   * **page timeout**: 60000
39800   * **playback**: mitmproxy
39801   * **playback pageset manifest**: mitm5-linux-firefox-google-search.manifest
39802   * **test url**: `<https://www.google.com/search?hl=en&q=barack+obama&cad=h>`__
39803   * **type**: pageload
39804   * **unit**: ms
39805
39806.. dropdown:: raptor-tp6-unittest-youtube-firefox
39807   :container: + anchor-id-raptor-tp6-unittest-youtube-firefox-u
39808
39809   **Owner**: PerfTest Team
39810
39811   * **alert on**: fcp, loadtime
39812   * **alert threshold**: 2.0
39813   * **apps**: firefox
39814   * **expected**: pass
39815   * **gecko profile entries**: 14000000
39816   * **gecko profile interval**: 1
39817   * **lower is better**: true
39818   * **measure**: fnbpaint, fcp, dcf, loadtime
39819   * **page cycles**: 25
39820   * **page timeout**: 60000
39821   * **playback**: mitmproxy
39822   * **playback pageset manifest**: mitm5-linux-firefox-youtube.manifest
39823   * **test url**: `<https://www.youtube.com>`__
39824   * **type**: pageload
39825   * **unit**: ms
39826
39827
39828