Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: Don't stop handler if there is no resumption token #2067

Merged
merged 1 commit into from
Aug 22, 2024

Conversation

larseggert
Copy link
Collaborator

s2n-quic doesn't send a resumption token for the second connection in the QNS resumption test, and this caused us to fail.

s2n-quic doesn't send a resumption token for the second connection in
the QNS `resumption` test, and this caused us to fail.
Copy link

Failed Interop Tests

QUIC Interop Runner, client vs. server

neqo-latest as client

neqo-latest as server

All results

Succeeded Interop Tests

QUIC Interop Runner, client vs. server

neqo-latest as client

neqo-latest as server

Unsupported Interop Tests

QUIC Interop Runner, client vs. server

neqo-latest as client

neqo-latest as server

Copy link

codecov bot commented Aug 21, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 95.32%. Comparing base (90d1585) to head (9c3e0fd).
Report is 2 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #2067      +/-   ##
==========================================
- Coverage   95.35%   95.32%   -0.04%     
==========================================
  Files         112      112              
  Lines       36505    36505              
==========================================
- Hits        34810    34799      -11     
- Misses       1695     1706      +11     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Copy link

Benchmark results

Performance differences relative to 13237c3.

coalesce_acked_from_zero 1+1 entries: No change in performance detected.
       time:   [99.294 ns 99.620 ns 99.948 ns]
       change: [-0.2860% +0.2655% +0.9013%] (p = 0.40 > 0.05)

Found 12 outliers among 100 measurements (12.00%)
9 (9.00%) high mild
3 (3.00%) high severe

coalesce_acked_from_zero 3+1 entries: No change in performance detected.
       time:   [117.41 ns 117.79 ns 118.18 ns]
       change: [-0.6693% -0.1025% +0.3712%] (p = 0.72 > 0.05)

Found 18 outliers among 100 measurements (18.00%)
1 (1.00%) low severe
2 (2.00%) low mild
2 (2.00%) high mild
13 (13.00%) high severe

coalesce_acked_from_zero 10+1 entries: No change in performance detected.
       time:   [117.13 ns 118.35 ns 120.27 ns]
       change: [+0.1024% +0.9123% +1.9533%] (p = 0.07 > 0.05)

Found 19 outliers among 100 measurements (19.00%)
7 (7.00%) low severe
2 (2.00%) low mild
10 (10.00%) high severe

coalesce_acked_from_zero 1000+1 entries: No change in performance detected.
       time:   [97.422 ns 97.547 ns 97.689 ns]
       change: [-0.1826% +0.4283% +1.0041%] (p = 0.17 > 0.05)

Found 11 outliers among 100 measurements (11.00%)
7 (7.00%) high mild
4 (4.00%) high severe

RxStreamOrderer::inbound_frame(): No change in performance detected.
       time:   [111.17 ms 111.31 ms 111.53 ms]
       change: [-0.0388% +0.1069% +0.3033%] (p = 0.29 > 0.05)

Found 8 outliers among 100 measurements (8.00%)
5 (5.00%) low mild
2 (2.00%) high mild
1 (1.00%) high severe

transfer/pacing-false/varying-seeds: No change in performance detected.
       time:   [26.596 ms 27.550 ms 28.484 ms]
       change: [-3.5720% +1.0238% +6.2261%] (p = 0.70 > 0.05)
transfer/pacing-true/varying-seeds: No change in performance detected.
       time:   [35.006 ms 36.638 ms 38.317 ms]
       change: [-6.6642% -0.9110% +4.9285%] (p = 0.77 > 0.05)

Found 3 outliers among 100 measurements (3.00%)
3 (3.00%) high mild

transfer/pacing-false/same-seed: No change in performance detected.
       time:   [32.376 ms 33.004 ms 33.621 ms]
       change: [-3.3432% -0.3427% +2.6651%] (p = 0.82 > 0.05)

Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) low mild

transfer/pacing-true/same-seed: Change within noise threshold.
       time:   [42.996 ms 45.679 ms 48.294 ms]
       change: [+0.9089% +11.530% +23.595%] (p = 0.03 < 0.05)

Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) low mild

1-conn/1-100mb-resp (aka. Download)/client: No change in performance detected.
       time:   [114.14 ms 114.49 ms 114.83 ms]
       thrpt:  [870.88 MiB/s 873.45 MiB/s 876.08 MiB/s]
change:
       time:   [-0.3733% +0.0293% +0.4672%] (p = 0.90 > 0.05)
       thrpt:  [-0.4650% -0.0293% +0.3746%]
1-conn/10_000-parallel-1b-resp (aka. RPS)/client: No change in performance detected.
       time:   [311.56 ms 315.05 ms 318.56 ms]
       thrpt:  [31.391 Kelem/s 31.741 Kelem/s 32.096 Kelem/s]
change:
       time:   [-1.0612% +0.4657% +2.0990%] (p = 0.57 > 0.05)
       thrpt:  [-2.0558% -0.4636% +1.0726%]
1-conn/1-1b-resp (aka. HPS)/client: No change in performance detected.
       time:   [40.029 ms 40.740 ms 41.460 ms]
       thrpt:  [24.120  elem/s 24.546  elem/s 24.982  elem/s]
change:
       time:   [-3.0652% -0.7598% +1.6723%] (p = 0.54 > 0.05)
       thrpt:  [-1.6448% +0.7656% +3.1621%]

Client/server transfer results

Transfer of 33554432 bytes over loopback.

Client Server CC Pacing Mean [ms] Min [ms] Max [ms] Relative
msquic msquic 160.9 ± 83.4 86.7 327.4 1.00
neqo msquic reno on 222.6 ± 12.5 204.7 241.5 1.00
neqo msquic reno 284.1 ± 95.2 208.0 477.0 1.00
neqo msquic cubic on 216.6 ± 11.3 203.9 237.2 1.00
neqo msquic cubic 219.7 ± 9.8 207.1 235.4 1.00
msquic neqo reno on 131.2 ± 85.7 76.5 409.1 1.00
msquic neqo reno 119.0 ± 65.6 77.6 330.1 1.00
msquic neqo cubic on 119.4 ± 60.6 79.2 316.0 1.00
msquic neqo cubic 103.8 ± 52.6 75.2 285.5 1.00
neqo neqo reno on 158.7 ± 19.6 127.2 193.3 1.00
neqo neqo reno 198.1 ± 111.4 128.7 463.1 1.00
neqo neqo cubic on 208.4 ± 111.4 130.9 466.3 1.00
neqo neqo cubic 285.6 ± 110.3 151.9 460.9 1.00

⬇️ Download logs

Copy link

Firefox builds for this PR

The following builds are available for testing. Crossed-out builds did not succeed.

@martinthomson martinthomson added this pull request to the merge queue Aug 22, 2024
Merged via the queue into mozilla:main with commit 43ce605 Aug 22, 2024
56 of 57 checks passed
@larseggert larseggert deleted the fix-resumption branch August 22, 2024 05:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants