1737594 - 13 - 6.65% perf_reftest_singletons parent-basic-singleton.html / perf_reftest_singletons parent-basic-singleton.html + 1 more (OSX) regression on Wed October 20 2021

Status: RESOLVED WONTFIX

(Firefox Build System :: Toolchains, defect)

Description

[Andra Esanu (needinfo me)]

Perfherder has detected a talos performance regression from push dcb91b95f32bb7692169357bc6c8d1cfa81e34c1. As author of one of the patches included in that push, we need your help to address this regression.

Regressions:

Ratio	Test	Platform	Options	Absolute values (old vs new)
13%	perf_reftest_singletons parent-basic-singleton.html	macosx1014-64-shippable-qr	e10s stylo webrender	152.13 -> 171.90
12%	perf_reftest_singletons parent-basic-singleton.html	macosx1014-64-shippable-qr	e10s fission stylo webrender	152.99 -> 171.75
7%	perf_reftest_singletons parent-basic-singleton.html	macosx1015-64-shippable-qr	e10s stylo webrender	60.18 -> 64.19

Improvements:

Ratio	Test	Platform	Options	Absolute values (old vs new)
17%	perf_reftest some-descendants-1.html	macosx1015-64-shippable-qr	e10s stylo webrender-sw	5.95 -> 4.95
17%	perf_reftest some-descendants-1.html	macosx1015-64-shippable-qr	e10s stylo webrender	5.87 -> 4.90
16%	perf_reftest some-descendants-1.html	macosx1014-64-shippable-qr	e10s fission stylo webrender	7.01 -> 5.90
16%	perf_reftest_singletons bloom-basic-2.html	macosx1015-64-shippable-qr	e10s stylo webrender	43.64 -> 36.74
16%	perf_reftest_singletons bloom-basic-2.html	macosx1015-64-shippable-qr	e10s fission stylo webrender	43.73 -> 36.86
...	...	...	...	...
2%	displaylist_mutate	macosx1015-64-shippable-qr	e10s stylo webrender-sw	1,870.90 -> 1,832.26

Details of the alert can be found in the alert summary, including links to graphs and comparisons for each of the affected tests. Please follow our guide to handling regression bugs and let us know your plans within 3 business days, or the offending patch(es) will be backed out in accordance with our regression policy.

For more information on performance sheriffing please see our FAQ.

Comment 1

[Alexandru Ionescu (needinfo me) [:alexandrui]]

== Change summary for alert #32082 (as of Mon, 25 Oct 2021 11:29:05 GMT) ==

Regressions:

Ratio	Test	Platform	Options	Absolute values (old vs new)
0.49%	installer size	osx-shippable	instrumented	114,309,437.33 -> 114,871,395.67
0.47%	installer size	osx-shippable	instrumented	114,328,197.42 -> 114,867,156.00

For up to date results, see: https://treeherder.mozilla.org/perfherder/alerts?id=32082

Comment 2

[Alexandru Ionescu (needinfo me) [:alexandrui]]

== Change summary for alert #32036 (as of Fri, 22 Oct 2021 05:10:45 GMT) ==

Regressions:

Ratio	Test	Platform	Options	Absolute values (old vs new)
4%	webaudio	macosx1014-64-shippable-qr	webrender	122.42 -> 127.08

Improvements:

Ratio	Test	Platform	Options	Absolute values (old vs new)
3%	allrecipes fcp	android-hw-p2-8-0-android-aarch64-shippable-qr	warm webrender	597.35 -> 576.92
3%	imdb fcp	android-hw-g5-7-0-arm7-shippable-qr	warm webrender	809.73 -> 785.62
3%	allrecipes FirstVisualChange	android-hw-p2-8-0-android-aarch64-shippable-qr	warm webrender	777.17 -> 756.08
3%	imdb fnbpaint	android-hw-g5-7-0-arm7-shippable-qr	warm webrender	650.12 -> 633.42
2%	allrecipes fnbpaint	android-hw-p2-8-0-android-aarch64-shippable-qr	warm webrender	754.02 -> 735.21
...	...	...	...	...
2%	booking dcf	android-hw-g5-7-0-arm7-shippable-qr	warm webrender	1,214.23 -> 1,189.83

For up to date results, see: https://treeherder.mozilla.org/perfherder/alerts?id=32036

Comment 3

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 1731582

Comment 4

[Andi [:andi]]

The first regressions are strange can we retest this?

Comment 5

[Andra Esanu (needinfo me)]

Can you tell me what is the first regression for you? I did some retriggers and the graph is pretty clear.

Comment 6

[Andi [:andi]]

These can be ignored for now.