summaryrefslogtreecommitdiffstats
path: root/testing/perfdocs/generated/raptor.rst
blob: 4a094da7650f2c4b3ce68930887cc8131e6384f2 (plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
######
Raptor
######

The following documents all testing we have for Raptor.

Benchmarks
----------
Standard benchmarks are third-party tests (i.e. Speedometer) that we have integrated into Raptor to run per-commit in our production CI. 


Desktop
-------
Tests for page-load performance. The links direct to the actual websites that are being tested. (WX: WebExtension, BT: Browsertime, FF: Firefox, CH: Chrome, CU: Chromium)

* `amazon (BT, FF, CH, CU) <https://www.amazon.com/s?k=laptop&ref=nb_sb_noss_1>`__
* `apple (BT, FF, CH, CU) <https://www.apple.com/macbook-pro/>`__
* `bing-search (BT, FF, CH, CU) <https://www.bing.com/search?q=barack+obama>`__
* `ebay (BT, FF, CH, CU) <https://www.ebay.com/>`__
* `facebook (BT, FF, CH, CU) <https://www.facebook.com>`__
* `facebook-redesign (BT, FF, CH, CU) <https://www.facebook.com>`__
* `fandom (BT, FF, CH, CU) <https://www.fandom.com/articles/fallout-76-will-live-and-die-on-the-creativity-of-its-playerbase>`__
* `google-docs (BT, FF, CH, CU) <https://docs.google.com/document/d/1US-07msg12slQtI_xchzYxcKlTs6Fp7WqIc6W5GK5M8/edit?usp=sharing>`__
* `google-mail (BT, FF, CH, CU) <https://mail.google.com/>`__
* `google-search (BT, FF, CH, CU) <https://www.google.com/search?hl=en&q=barack+obama&cad=h>`__
* `google-sheets (BT, FF, CH, CU) <https://docs.google.com/spreadsheets/d/1jT9qfZFAeqNoOK97gruc34Zb7y_Q-O_drZ8kSXT-4D4/edit?usp=sharing>`__
* `google-slides (BT, FF, CH, CU) <https://docs.google.com/presentation/d/1Ici0ceWwpFvmIb3EmKeWSq_vAQdmmdFcWqaiLqUkJng/edit?usp=sharing>`__
* `imdb (BT, FF, CH, CU) <https://www.imdb.com/title/tt0084967/?ref_=nv_sr_2>`__
* `imgur (BT, FF, CH, CU) <https://imgur.com/gallery/m5tYJL6>`__
* `instagram (BT, FF, CH, CU) <https://www.instagram.com/>`__
* `linkedin (BT, FF, CH, CU) <https://www.linkedin.com/in/thommy-harris-hk-385723106/>`__
* `microsoft (BT, FF, CH, CU) <https://www.microsoft.com/en-us/>`__
* `netflix (BT, FF, CH, CU) <https://www.netflix.com/title/80117263>`__
* `office (BT, FF, CH, CU) <https://office.live.com/start/Word.aspx?omkt=en-US>`__
* `outlook (BT, FF, CH, CU) <https://outlook.live.com/mail/inbox>`__
* `paypal (BT, FF, CH, CU) <https://www.paypal.com/myaccount/summary/>`__
* `pinterest (BT, FF, CH, CU) <https://pinterest.com/>`__
* `raptor-tp6-amazon (WX, FF, CH, CU) <https://www.amazon.com/s?k=laptop&ref=nb_sb_noss_1>`__
* `raptor-tp6-apple (WX, FF, CH, CU) <https://www.apple.com/macbook-pro/>`__
* `raptor-tp6-bing (WX, FF, CH, CU) <https://www.bing.com/search?q=barack+obama>`__
* `raptor-tp6-cnn-ampstories (WX, FF) <https://cnn.com/ampstories/us/why-hurricane-michael-is-a-monster-unlike-any-other>`__
* `raptor-tp6-docs (WX, FF, CH, CU) <https://docs.google.com/document/d/1US-07msg12slQtI_xchzYxcKlTs6Fp7WqIc6W5GK5M8/edit?usp=sharing>`__
* `raptor-tp6-ebay (WX, FF, CH, CU) <https://www.ebay.com/>`__
* `raptor-tp6-facebook (WX, CH, CU) <https://www.facebook.com>`__
* `raptor-tp6-fandom (WX, FF, CH, CU) <https://www.fandom.com/articles/fallout-76-will-live-and-die-on-the-creativity-of-its-playerbase>`__
* `raptor-tp6-google (WX, FF, CH, CU) <https://www.google.com/search?hl=en&q=barack+obama&cad=h>`__
* `raptor-tp6-google-mail (WX, FF, CH, CU) <https://mail.google.com/>`__
* `raptor-tp6-imdb (WX, FF, CH, CU) <https://www.imdb.com/title/tt0084967/?ref_=nv_sr_2>`__
* `raptor-tp6-imgur (WX, FF, CH, CU) <https://imgur.com/gallery/m5tYJL6>`__
* `raptor-tp6-instagram (WX, FF, CH, CU) <https://www.instagram.com/>`__
* `raptor-tp6-linkedin (WX, FF, CH, CU) <https://www.linkedin.com/in/thommy-harris-hk-385723106/>`__
* `raptor-tp6-microsoft (WX, FF, CH, CU) <https://www.microsoft.com/en-us/>`__
* `raptor-tp6-netflix (WX, FF, CH, CU) <https://www.netflix.com/title/80117263>`__
* `raptor-tp6-office (WX, FF, CH, CU) <https://office.live.com/start/Word.aspx?omkt=en-US>`__
* `raptor-tp6-outlook (WX, FF, CH, CU) <https://outlook.live.com/mail/inbox>`__
* `raptor-tp6-paypal (WX, FF, CH, CU) <https://www.paypal.com/myaccount/summary/>`__
* `raptor-tp6-pinterest (WX, FF, CH, CU) <https://pinterest.com/>`__
* `raptor-tp6-reddit (WX, FF, CH, CU) <https://www.reddit.com/r/technology/comments/9sqwyh/we_posed_as_100_senators_to_run_ads_on_facebook/>`__
* `raptor-tp6-sheets (WX, FF, CH, CU) <https://docs.google.com/spreadsheets/d/1jT9qfZFAeqNoOK97gruc34Zb7y_Q-O_drZ8kSXT-4D4/edit?usp=sharing>`__
* `raptor-tp6-slides (WX, FF, CH, CU) <https://docs.google.com/presentation/d/1Ici0ceWwpFvmIb3EmKeWSq_vAQdmmdFcWqaiLqUkJng/edit?usp=sharing>`__
* `raptor-tp6-tumblr (WX, FF, CH, CU) <https://www.tumblr.com/dashboard>`__
* `raptor-tp6-twitch (WX, FF, CH, CU) <https://www.twitch.tv/videos/326804629>`__
* `raptor-tp6-twitter (WX, FF, CH, CU) <https://twitter.com/BarackObama>`__
* `raptor-tp6-wikipedia (WX, FF, CH, CU) <https://en.wikipedia.org/wiki/Barack_Obama>`__
* `raptor-tp6-yahoo-mail (WX, FF, CH, CU) <https://mail.yahoo.com/>`__
* `raptor-tp6-yahoo-news (WX, FF, CH, CU) <https://www.yahoo.com/lifestyle/police-respond-noise-complaint-end-playing-video-games-respectful-tenants-002329963.html>`__
* `raptor-tp6-yandex (WX, FF, CH, CU) <https://yandex.ru/search/?text=barack%20obama&lr=10115>`__
* `raptor-tp6-youtube (WX, FF, CH, CU) <https://www.youtube.com>`__
* `reddit (BT, FF, CH, CU) <https://www.reddit.com/r/technology/comments/9sqwyh/we_posed_as_100_senators_to_run_ads_on_facebook/>`__
* `tumblr (BT, FF, CH, CU) <https://www.tumblr.com/dashboard>`__
* `twitch (BT, FF, CH, CU) <https://www.twitch.tv/videos/326804629>`__
* `twitter (BT, FF, CH, CU) <https://twitter.com/BarackObama>`__
* `wikipedia (BT, FF, CH, CU) <https://en.wikipedia.org/wiki/Barack_Obama>`__
* `yahoo-mail (BT, FF, CH, CU) <https://mail.yahoo.com/>`__
* `yahoo-news (BT, FF, CH, CU) <https://www.yahoo.com/lifestyle/police-respond-noise-complaint-end-playing-video-games-respectful-tenants-002329963.html>`__
* `yandex (BT, FF, CH, CU) <https://yandex.ru/search/?text=barack%20obama&lr=10115>`__
* `youtube (BT, FF, CH, CU) <https://www.youtube.com>`__

Live
----
A set of test pages that are run as live sites instead of recorded versions. These tests are available on all browsers, on all platforms.


Mobile
------
Page-load performance test suite on Android. The links direct to the actual websites that are being tested. (WX: WebExtension, BT: Browsertime, GV: Geckoview, RB: Refbrow, FE: Fenix, F68: Fennec68, CH-M: Chrome mobile)

* `allrecipes (BT, GV, FE, RB, F68, CH-M) <https://www.allrecipes.com/>`__
* `amazon (BT, GV, FE, RB, F68, CH-M) <https://www.amazon.com>`__
* `amazon-search (BT, GV, FE, RB, F68, CH-M) <https://www.amazon.com/s/ref=nb_sb_noss_2/139-6317191-5622045?url=search-alias%3Daps&field-keywords=mobile+phone>`__
* `bbc (BT, GV, FE, RB, F68, CH-M) <https://www.bbc.com/news/business-47245877>`__
* `bing (BT, GV, FE, RB, F68, CH-M) <https://www.bing.com/>`__
* `bing-search-restaurants (BT, GV, FE, RB, F68, CH-M) <https://www.bing.com/search?q=restaurants>`__
* `booking (BT, GV, FE, RB, F68, CH-M) <https://www.booking.com/>`__
* `cnn (BT, GV, FE, RB, F68, CH-M) <https://cnn.com>`__
* `cnn-ampstories (BT, GV, FE, RB, F68, CH-M) <https://cnn.com/ampstories/us/why-hurricane-michael-is-a-monster-unlike-any-other>`__
* `ebay-kleinanzeigen (BT, GV, FE, RB, F68, CH-M) <https://m.ebay-kleinanzeigen.de>`__
* `ebay-kleinanzeigen-search (BT, GV, FE, RB, F68, CH-M) <https://m.ebay-kleinanzeigen.de/s-anzeigen/auf-zeit-wg-berlin/zimmer/c199-l3331>`__
* `espn (BT, GV, FE, RB, F68, CH-M) <http://www.espn.com/nba/story/_/page/allstarweekend25788027/the-comparison-lebron-james-michael-jordan-their-own-words>`__
* `facebook (BT, GV, FE, RB, F68, CH-M) <https://m.facebook.com>`__
* `facebook-cristiano (BT, GV, FE, RB, F68, CH-M) <https://m.facebook.com/Cristiano>`__
* `google (BT, GV, FE, RB, F68, CH-M) <https://www.google.com>`__
* `google-maps (BT, GV, FE, RB, F68, CH-M) <https://www.google.com/maps?force=pwa>`__
* `google-search-restaurants (BT, GV, FE, RB, F68, CH-M) <https://www.google.com/search?q=restaurants+near+me>`__
* `imdb (BT, GV, FE, RB, F68, CH-M) <https://m.imdb.com/>`__
* `instagram (BT, GV, FE, RB, F68, CH-M) <https://www.instagram.com>`__
* `jianshu (BT, GV, FE, RB, F68, CH-M) <https://www.jianshu.com/>`__
* `microsoft-support (BT, GV, FE, RB, F68, CH-M) <https://support.microsoft.com/en-us>`__
* `reddit (BT, GV, FE, RB, F68, CH-M) <https://www.reddit.com>`__
* `stackoverflow (BT, GV, FE, RB, F68, CH-M) <https://stackoverflow.com/>`__
* `web-de (BT, GV, FE, RB, F68, CH-M) <https://web.de/magazine/politik/politologe-glaubt-grossen-koalition-herbst-knallen-33563566>`__
* `wikipedia (BT, GV, FE, RB, F68, CH-M) <https://en.m.wikipedia.org/wiki/Main_Page>`__
* `youtube (BT, GV, FE, RB, F68, CH-M) <https://m.youtube.com>`__
* `youtube-watch (BT, GV, FE, RB, F68, CH-M) <https://www.youtube.com/watch?v=COU5T-Wafa4>`__

Scenario
--------
Tests that perform a specific action (a scenario), i.e. idle application, idle application in background, etc.


Unittests
---------
These tests aren't used in standard testing, they are only used in the Raptor unit tests (they are similar to raptor-tp6 tests though).



The methods for calling the tests can be found in the `Raptor wiki page <https://wiki.mozilla.org/TestEngineering/Performance/Raptor>`_.