Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ci: Usemold linker on Linux, lld on Windows #2406

Merged
merged 6 commits into from
Feb 3, 2025

Conversation

larseggert
Copy link
Collaborator

Let's see if this speeds things up more.

Let's see if this speeds things up more.
Copy link

codecov bot commented Feb 3, 2025

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 95.26%. Comparing base (6cdbc0c) to head (630040e).
Report is 3 commits behind head on main.

Additional details and impacted files
@@           Coverage Diff           @@
##             main    #2406   +/-   ##
=======================================
  Coverage   95.26%   95.26%           
=======================================
  Files         114      114           
  Lines       36903    36903           
  Branches    36903    36903           
=======================================
  Hits        35155    35155           
  Misses       1742     1742           
  Partials        6        6           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@larseggert larseggert changed the title ci: Use the mold linker on linux ci: Usemold linker on Linux, lld on Windows Feb 3, 2025
Copy link

github-actions bot commented Feb 3, 2025

Failed Interop Tests

QUIC Interop Runner, client vs. server, differences relative to 108fb8d.

neqo-latest as client

neqo-latest as server

All results

Succeeded Interop Tests

QUIC Interop Runner, client vs. server

neqo-latest as client

neqo-latest as server

Unsupported Interop Tests

QUIC Interop Runner, client vs. server

neqo-latest as client

neqo-latest as server

@larseggert larseggert merged commit 6ff71f7 into mozilla:main Feb 3, 2025
64 of 67 checks passed
@larseggert larseggert deleted the ci-linux-mold branch February 3, 2025 10:04
Copy link

github-actions bot commented Feb 3, 2025

Benchmark results

Performance differences relative to 6cdbc0c.

decode 4096 bytes, mask ff: Change within noise threshold.
       time:   [11.794 µs 11.853 µs 11.937 µs]
       change: [-1.3283% -0.7899% -0.3079%] (p = 0.00 < 0.05)

Found 13 outliers among 100 measurements (13.00%)
2 (2.00%) low severe
4 (4.00%) low mild
7 (7.00%) high severe

decode 1048576 bytes, mask ff: 💚 Performance has improved.
       time:   [2.9032 ms 2.9128 ms 2.9241 ms]
       change: [-5.9187% -5.4857% -5.0739%] (p = 0.00 < 0.05)

Found 10 outliers among 100 measurements (10.00%)
1 (1.00%) low mild
9 (9.00%) high severe

decode 4096 bytes, mask 7f: Change within noise threshold.
       time:   [19.689 µs 19.742 µs 19.803 µs]
       change: [-1.0472% -0.6529% -0.1907%] (p = 0.00 < 0.05)

Found 21 outliers among 100 measurements (21.00%)
2 (2.00%) low severe
5 (5.00%) low mild
14 (14.00%) high severe

decode 1048576 bytes, mask 7f: 💚 Performance has improved.
       time:   [4.7116 ms 4.7226 ms 4.7343 ms]
       change: [-8.9848% -8.6846% -8.3794%] (p = 0.00 < 0.05)

Found 11 outliers among 100 measurements (11.00%)
11 (11.00%) high severe

decode 4096 bytes, mask 3f: 💚 Performance has improved.
       time:   [6.2149 µs 6.2393 µs 6.2717 µs]
       change: [-10.466% -10.016% -9.5795%] (p = 0.00 < 0.05)

Found 8 outliers among 100 measurements (8.00%)
4 (4.00%) high mild
4 (4.00%) high severe

decode 1048576 bytes, mask 3f: 💔 Performance has regressed.
       time:   [2.1137 ms 2.1206 ms 2.1289 ms]
       change: [+20.191% +20.589% +20.983%] (p = 0.00 < 0.05)

Found 13 outliers among 100 measurements (13.00%)
5 (5.00%) high mild
8 (8.00%) high severe

coalesce_acked_from_zero 1+1 entries: Change within noise threshold.
       time:   [93.399 ns 93.742 ns 94.083 ns]
       change: [+0.1097% +0.5462% +0.9861%] (p = 0.01 < 0.05)

Found 13 outliers among 100 measurements (13.00%)
11 (11.00%) high mild
2 (2.00%) high severe

coalesce_acked_from_zero 3+1 entries: No change in performance detected.
       time:   [110.92 ns 111.30 ns 111.70 ns]
       change: [+0.0402% +1.0033% +2.3482%] (p = 0.09 > 0.05)

Found 20 outliers among 100 measurements (20.00%)
3 (3.00%) low mild
17 (17.00%) high severe

coalesce_acked_from_zero 10+1 entries: No change in performance detected.
       time:   [110.36 ns 110.85 ns 111.43 ns]
       change: [-0.0671% +0.4468% +0.9374%] (p = 0.08 > 0.05)

Found 10 outliers among 100 measurements (10.00%)
3 (3.00%) low mild
1 (1.00%) high mild
6 (6.00%) high severe

coalesce_acked_from_zero 1000+1 entries: No change in performance detected.
       time:   [92.440 ns 92.559 ns 92.696 ns]
       change: [-0.2575% +0.6415% +1.5727%] (p = 0.19 > 0.05)

Found 10 outliers among 100 measurements (10.00%)
4 (4.00%) high mild
6 (6.00%) high severe

RxStreamOrderer::inbound_frame(): No change in performance detected.
       time:   [111.90 ms 112.03 ms 112.24 ms]
       change: [+0.0023% +0.1362% +0.3146%] (p = 0.11 > 0.05)

Found 14 outliers among 100 measurements (14.00%)
5 (5.00%) low mild
8 (8.00%) high mild
1 (1.00%) high severe

SentPackets::take_ranges: :broken_heart: Performance has regressed.
       time:   [5.2786 µs 5.4960 µs 5.7367 µs]
       change: [+2.3544% +5.2818% +8.3508%] (p = 0.00 < 0.05)

Found 9 outliers among 100 measurements (9.00%)
8 (8.00%) high mild
1 (1.00%) high severe

transfer/pacing-false/varying-seeds: Change within noise threshold.
       time:   [40.730 ms 40.809 ms 40.888 ms]
       change: [+0.2302% +0.4795% +0.7333%] (p = 0.00 < 0.05)
transfer/pacing-true/varying-seeds: Change within noise threshold.
       time:   [40.524 ms 40.599 ms 40.673 ms]
       change: [+0.0824% +0.3267% +0.5819%] (p = 0.01 < 0.05)

Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) low mild

transfer/pacing-false/same-seed: No change in performance detected.
       time:   [40.421 ms 40.501 ms 40.581 ms]
       change: [-0.4969% -0.1991% +0.0903%] (p = 0.20 > 0.05)

Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high mild

transfer/pacing-true/same-seed: Change within noise threshold.
       time:   [40.994 ms 41.063 ms 41.142 ms]
       change: [+0.9079% +1.1622% +1.4193%] (p = 0.00 < 0.05)

Found 3 outliers among 100 measurements (3.00%)
2 (2.00%) high mild
1 (1.00%) high severe

1-conn/1-100mb-resp/mtu-1504 (aka. Download)/client: 💚 Performance has improved.
       time:   [836.19 ms 844.79 ms 853.66 ms]
       thrpt:  [117.14 MiB/s 118.37 MiB/s 119.59 MiB/s]
change:
       time:   [-6.9105% -5.3637% -3.8528%] (p = 0.00 < 0.05)
       thrpt:  [+4.0072% +5.6677% +7.4235%]
1-conn/10_000-parallel-1b-resp/mtu-1504 (aka. RPS)/client: Change within noise threshold.
       time:   [310.50 ms 312.39 ms 314.30 ms]
       thrpt:  [31.817 Kelem/s 32.011 Kelem/s 32.206 Kelem/s]
change:
       time:   [-2.3275% -1.4559% -0.6035%] (p = 0.00 < 0.05)
       thrpt:  [+0.6071% +1.4774% +2.3829%]
1-conn/1-1b-resp/mtu-1504 (aka. HPS)/client: No change in performance detected.
       time:   [34.215 ms 34.380 ms 34.561 ms]
       thrpt:  [28.934  elem/s 29.086  elem/s 29.227  elem/s]
change:
       time:   [-0.6235% +0.1179% +0.8841%] (p = 0.75 > 0.05)
       thrpt:  [-0.8764% -0.1178% +0.6274%]

Found 9 outliers among 100 measurements (9.00%)
5 (5.00%) low mild
1 (1.00%) high mild
3 (3.00%) high severe

1-conn/1-100mb-resp/mtu-1504 (aka. Upload)/client: 💚 Performance has improved.
       time:   [1.5662 s 1.5797 s 1.5930 s]
       thrpt:  [62.773 MiB/s 63.303 MiB/s 63.848 MiB/s]
change:
       time:   [-3.8944% -2.6004% -1.3208%] (p = 0.00 < 0.05)
       thrpt:  [+1.3385% +2.6699% +4.0522%]

Client/server transfer results

Transfer of 33554432 bytes over loopback.

Client Server CC Pacing MTU Mean [ms] Min [ms] Max [ms]
gquiche gquiche 1504 513.5 ± 21.1 494.4 568.6
neqo gquiche reno on 1504 725.0 ± 17.6 686.2 749.0
neqo gquiche reno 1504 728.8 ± 26.4 692.0 791.0
neqo gquiche cubic on 1504 731.9 ± 10.1 718.3 748.0
neqo gquiche cubic 1504 737.4 ± 50.5 685.4 855.2
msquic msquic 1504 96.3 ± 6.6 90.3 113.4
neqo msquic reno on 1504 217.7 ± 14.9 195.7 245.8
neqo msquic reno 1504 212.3 ± 13.7 199.4 244.4
neqo msquic cubic on 1504 219.8 ± 21.6 195.0 258.7
neqo msquic cubic 1504 216.7 ± 13.1 201.9 239.1
gquiche neqo reno on 1504 656.0 ± 94.7 532.1 805.1
gquiche neqo reno 1504 665.1 ± 87.5 546.3 813.3
gquiche neqo cubic on 1504 653.9 ± 74.2 553.4 766.6
gquiche neqo cubic 1504 654.1 ± 72.5 550.4 759.7
msquic neqo reno on 1504 453.0 ± 12.3 441.3 474.0
msquic neqo reno 1504 485.1 ± 72.7 432.8 619.6
msquic neqo cubic on 1504 459.1 ± 38.5 435.1 565.2
msquic neqo cubic 1504 453.7 ± 10.3 440.8 471.6
neqo neqo reno on 1504 418.3 ± 10.6 407.7 440.0
neqo neqo reno 1504 421.5 ± 6.4 414.9 436.6
neqo neqo cubic on 1504 425.5 ± 13.1 398.7 442.8
neqo neqo cubic 1504 433.5 ± 14.3 422.1 466.1

⬇️ Download logs

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant