Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update rust Docker tag to v1.86.0 #643

Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open

Conversation

renovate[bot]
Copy link
Contributor

@renovate renovate bot commented Apr 3, 2025

This PR contains the following updates:

Package Type Update Change
rust stage minor 1.85.1 -> 1.86.0

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.

Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.


  • If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

@renovate renovate bot added the dependencies Pull requests that update a dependency file label Apr 3, 2025
Copy link

github-actions bot commented Apr 3, 2025

Overview for: federation/constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 300 VUs over 30s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
cosmo 186 5801 total, 0 failed avg: 877ms, p95: 2194ms
grafbase 172 5311 total, 0 failed avg: 888ms, p95: 2267ms
apollo-router 160 4982 total, 0 failed avg: 1001ms, p95: 2612ms
hive-gateway-bun 80 2669 total, 0 failed avg: 3453ms, p95: 5552ms
apollo-server 78 2634 total, 0 failed avg: 3576ms, p95: 31555ms
hive-gateway 75 2528 total, 0 failed avg: 3734ms, p95: 23895ms
mercurius 64 2093 total, 0 failed avg: 4405ms, p95: 7580ms
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 17343      ✗ 0    
     data_received..................: 509 MB  16 MB/s
     data_sent......................: 6.9 MB  222 kB/s
     http_req_blocked...............: avg=1.46ms   min=1.48µs  med=3.24µs   max=1.3s     p(90)=5.59µs   p(95)=122.67µs
     http_req_connecting............: avg=1.08ms   min=0s      med=0s       max=868.59ms p(90)=0s       p(95)=74.49µs 
     http_req_duration..............: avg=877.41ms min=3.13ms  med=758.89ms max=4.5s     p(90)=1.71s    p(95)=2.19s   
       { expected_response:true }...: avg=877.41ms min=3.13ms  med=758.89ms max=4.5s     p(90)=1.71s    p(95)=2.19s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 5801 
     http_req_receiving.............: avg=254.23ms min=33.74µs med=83.78µs  max=3.96s    p(90)=1s       p(95)=1.54s   
     http_req_sending...............: avg=20.97ms  min=8.21µs  med=14.68µs  max=3.01s    p(90)=281.59µs p(95)=16.44ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=602.19ms min=3.05ms  med=587.59ms max=2.59s    p(90)=1.03s    p(95)=1.21s   
     http_reqs......................: 5801    186.791726/s
     iteration_duration.............: avg=1.57s    min=39.13ms med=1.37s    max=7.71s    p(90)=3.03s    p(95)=3.62s   
     iterations.....................: 5781    186.147728/s
     vus............................: 58      min=58       max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 15873      ✗ 0    
     data_received..................: 467 MB  15 MB/s
     data_sent......................: 6.3 MB  204 kB/s
     http_req_blocked...............: avg=986.86µs min=1.43µs  med=3.41µs   max=946.2ms  p(90)=5.72µs   p(95)=722.14µs
     http_req_connecting............: avg=903.75µs min=0s      med=0s       max=946.13ms p(90)=0s       p(95)=493.15µs
     http_req_duration..............: avg=888.47ms min=3.38ms  med=732.09ms max=4.61s    p(90)=1.89s    p(95)=2.26s   
       { expected_response:true }...: avg=888.47ms min=3.38ms  med=732.09ms max=4.61s    p(90)=1.89s    p(95)=2.26s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 5311 
     http_req_receiving.............: avg=283.07ms min=32.6µs  med=83.58µs  max=3.9s     p(90)=1.22s    p(95)=1.72s   
     http_req_sending...............: avg=18.85ms  min=8.08µs  med=15.11µs  max=3.85s    p(90)=276.15µs p(95)=7.87ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=586.54ms min=3.31ms  med=554.49ms max=3.16s    p(90)=1.07s    p(95)=1.28s   
     http_reqs......................: 5311    172.149137/s
     iteration_duration.............: avg=1.71s    min=23.97ms med=1.48s    max=7.75s    p(90)=3.35s    p(95)=4.08s   
     iterations.....................: 5291    171.500863/s
     vus............................: 300     min=300      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 14886      ✗ 0    
     data_received..................: 437 MB  14 MB/s
     data_sent......................: 5.9 MB  191 kB/s
     http_req_blocked...............: avg=1.95ms   min=1.41µs  med=3.33µs   max=749.61ms p(90)=6.08µs   p(95)=7.4ms  
     http_req_connecting............: avg=1.74ms   min=0s      med=0s       max=749.54ms p(90)=0s       p(95)=2.23ms 
     http_req_duration..............: avg=1s       min=6.5ms   med=800.23ms max=4.91s    p(90)=2.09s    p(95)=2.61s  
       { expected_response:true }...: avg=1s       min=6.5ms   med=800.23ms max=4.91s    p(90)=2.09s    p(95)=2.61s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 4982 
     http_req_receiving.............: avg=296.57ms min=34.86µs med=85.57µs  max=4.65s    p(90)=1.2s     p(95)=1.82s  
     http_req_sending...............: avg=17.73ms  min=8.07µs  med=15.11µs  max=2.4s     p(90)=394.78µs p(95)=19.46ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=686.57ms min=6.44ms  med=663.28ms max=2.41s    p(90)=1.12s    p(95)=1.26s  
     http_reqs......................: 4982    160.922816/s
     iteration_duration.............: avg=1.83s    min=22.57ms med=1.54s    max=9.13s    p(90)=3.64s    p(95)=4.3s   
     iterations.....................: 4962    160.276799/s
     vus............................: 300     min=300      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 7947      ✗ 0    
     data_received..................: 234 MB  7.1 MB/s
     data_sent......................: 3.2 MB  96 kB/s
     http_req_blocked...............: avg=1.07ms   min=1.79µs   med=4.1µs    max=140.29ms p(90)=1ms      p(95)=11.07ms 
     http_req_connecting............: avg=992.97µs min=0s       med=0s       max=20.32ms  p(90)=781.88µs p(95)=10.97ms 
     http_req_duration..............: avg=3.45s    min=16.42ms  med=3.26s    max=9s       p(90)=5.02s    p(95)=5.55s   
       { expected_response:true }...: avg=3.45s    min=16.42ms  med=3.26s    max=9s       p(90)=5.02s    p(95)=5.55s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 2669 
     http_req_receiving.............: avg=63.47ms  min=35.6µs   med=140.08µs max=2.14s    p(90)=8.09ms   p(95)=547.95ms
     http_req_sending...............: avg=1.33ms   min=9.38µs   med=22.01µs  max=403.49ms p(90)=652.35µs p(95)=2.62ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.38s    min=16.19ms  med=3.23s    max=9s       p(90)=4.96s    p(95)=5.46s   
     http_reqs......................: 2669    80.636828/s
     iteration_duration.............: avg=3.55s    min=159.97ms med=3.3s     max=9.07s    p(90)=5.17s    p(95)=5.8s    
     iterations.....................: 2649    80.03258/s
     vus............................: 37      min=37      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 7842      ✗ 0    
     data_received..................: 232 MB  6.9 MB/s
     data_sent......................: 3.1 MB  93 kB/s
     http_req_blocked...............: avg=206.37µs min=1.37µs   med=2.79µs  max=10.59ms p(90)=252.77µs p(95)=1.69ms  
     http_req_connecting............: avg=193.07µs min=0s       med=0s      max=10.56ms p(90)=187.53µs p(95)=1.58ms  
     http_req_duration..............: avg=3.57s    min=12.57ms  med=1.43s   max=33.01s  p(90)=2.6s     p(95)=31.55s  
       { expected_response:true }...: avg=3.57s    min=12.57ms  med=1.43s   max=33.01s  p(90)=2.6s     p(95)=31.55s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2634 
     http_req_receiving.............: avg=203.45µs min=43.2µs   med=105.6µs max=33.59ms p(90)=183.29µs p(95)=283.19µs
     http_req_sending...............: avg=123.41µs min=8.41µs   med=14.53µs max=18.48ms p(90)=120.98µs p(95)=511.73µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s      max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.57s    min=12.5ms   med=1.43s   max=33.01s  p(90)=2.6s     p(95)=31.55s  
     http_reqs......................: 2634    78.598009/s
     iteration_duration.............: avg=3.61s    min=250.19ms med=1.45s   max=33.03s  p(90)=2.64s    p(95)=31.57s  
     iterations.....................: 2614    78.001213/s
     vus............................: 47      min=47      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 7524      ✗ 0    
     data_received..................: 222 MB  6.6 MB/s
     data_sent......................: 3.0 MB  89 kB/s
     http_req_blocked...............: avg=1.45ms   min=1.59µs   med=3.97µs   max=24.41ms p(90)=2.11ms   p(95)=16.07ms 
     http_req_connecting............: avg=1.41ms   min=0s       med=0s       max=24.36ms p(90)=1.81ms   p(95)=15.15ms 
     http_req_duration..............: avg=3.73s    min=15.28ms  med=1.92s    max=33.01s  p(90)=3.55s    p(95)=23.89s  
       { expected_response:true }...: avg=3.73s    min=15.28ms  med=1.92s    max=33.01s  p(90)=3.55s    p(95)=23.89s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2528 
     http_req_receiving.............: avg=402.14µs min=42.42µs  med=108.87µs max=70.77ms p(90)=413.37µs p(95)=1.18ms  
     http_req_sending...............: avg=186.84µs min=8.61µs   med=23.49µs  max=31.63ms p(90)=247.33µs p(95)=680.92µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.73s    min=15.18ms  med=1.92s    max=33.01s  p(90)=3.55s    p(95)=23.89s  
     http_reqs......................: 2528    75.15393/s
     iteration_duration.............: avg=3.78s    min=429.89ms med=1.95s    max=33.02s  p(90)=3.62s    p(95)=24.25s  
     iterations.....................: 2508    74.559357/s
     vus............................: 59      min=59      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 6219      ✗ 0    
     data_received..................: 184 MB  5.7 MB/s
     data_sent......................: 2.5 MB  77 kB/s
     http_req_blocked...............: avg=587.31µs min=1.95µs   med=4.15µs  max=23.67ms  p(90)=1.71ms   p(95)=5.03ms  
     http_req_connecting............: avg=552.27µs min=0s       med=0s      max=10.89ms  p(90)=1.63ms   p(95)=4.94ms  
     http_req_duration..............: avg=4.4s     min=16.82ms  med=4.4s    max=9.71s    p(90)=5.42s    p(95)=7.57s   
       { expected_response:true }...: avg=4.4s     min=16.82ms  med=4.4s    max=9.71s    p(90)=5.42s    p(95)=7.57s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 2093 
     http_req_receiving.............: avg=6.91ms   min=37.54µs  med=107.8µs max=561.68ms p(90)=232.48µs p(95)=540.23µs
     http_req_sending...............: avg=187.47µs min=9.29µs   med=23.56µs max=12.81ms  p(90)=777.05µs p(95)=1.29ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s      max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=4.39s    min=16.71ms  med=4.4s    max=9.71s    p(90)=5.42s    p(95)=7.57s   
     http_reqs......................: 2093    64.883512/s
     iteration_duration.............: avg=4.47s    min=457.34ms med=4.42s   max=9.72s    p(90)=5.43s    p(95)=7.62s   
     iterations.....................: 2073    64.263507/s
     vus............................: 75      min=75      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Apr 3, 2025

Overview for: federation/constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 300 VUs over 30s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
cosmo 188 5826 total, 0 failed avg: 854ms, p95: 2712ms
grafbase 168 5192 total, 0 failed avg: 848ms, p95: 2066ms
apollo-router 159 4961 total, 0 failed avg: 905ms, p95: 2315ms
hive-gateway-bun 84 2789 total, 0 failed avg: 3346ms, p95: 5516ms
apollo-server 73 2518 total, 0 failed avg: 3785ms, p95: 32012ms
hive-gateway 73 2481 total, 0 failed avg: 3797ms, p95: 24643ms
mercurius 67 2163 total, 0 failed avg: 4254ms, p95: 6792ms
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 17418      ✗ 0    
     data_received..................: 511 MB  17 MB/s
     data_sent......................: 6.9 MB  224 kB/s
     http_req_blocked...............: avg=1.4ms    min=1.48µs  med=3.17µs   max=1.82s p(90)=5.49µs   p(95)=632.22µs
     http_req_connecting............: avg=1.25ms   min=0s      med=0s       max=1.82s p(90)=0s       p(95)=323.78µs
     http_req_duration..............: avg=853.82ms min=3.22ms  med=625.93ms max=6.75s p(90)=1.94s    p(95)=2.71s   
       { expected_response:true }...: avg=853.82ms min=3.22ms  med=625.93ms max=6.75s p(90)=1.94s    p(95)=2.71s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 5826 
     http_req_receiving.............: avg=345.85ms min=35.14µs med=83µs     max=6.05s p(90)=1.38s    p(95)=2.21s   
     http_req_sending...............: avg=15.7ms   min=8.07µs  med=13.95µs  max=3.48s p(90)=161.2µs  p(95)=3.99ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s    p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=492.25ms min=3.11ms  med=442.65ms max=2.55s p(90)=929.19ms p(95)=1.11s   
     http_reqs......................: 5826    188.356152/s
     iteration_duration.............: avg=1.56s    min=22.15ms med=1.16s    max=9.46s p(90)=3.36s    p(95)=4.14s   
     iterations.....................: 5806    187.709547/s
     vus............................: 287     min=287      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 15516      ✗ 0    
     data_received..................: 456 MB  15 MB/s
     data_sent......................: 6.2 MB  200 kB/s
     http_req_blocked...............: avg=1.79ms   min=1.41µs  med=3.51µs   max=1.59s p(90)=6.07µs   p(95)=581.59µs
     http_req_connecting............: avg=1.62ms   min=0s      med=0s       max=1.59s p(90)=0s       p(95)=330.48µs
     http_req_duration..............: avg=848.44ms min=3.1ms   med=748.86ms max=5.58s p(90)=1.67s    p(95)=2.06s   
       { expected_response:true }...: avg=848.44ms min=3.1ms   med=748.86ms max=5.58s p(90)=1.67s    p(95)=2.06s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 5192 
     http_req_receiving.............: avg=265.16ms min=33.71µs med=90.22µs  max=3.12s p(90)=1.08s    p(95)=1.52s   
     http_req_sending...............: avg=15.11ms  min=7.03µs  med=15.88µs  max=2.58s p(90)=137.99µs p(95)=2.07ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s    p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=568.16ms min=3.04ms  med=515.49ms max=2.47s p(90)=1.04s    p(95)=1.24s   
     http_reqs......................: 5192    168.089833/s
     iteration_duration.............: avg=1.73s    min=34.38ms med=1.51s    max=8.68s p(90)=3.48s    p(95)=4.17s   
     iterations.....................: 5172    167.442338/s
     vus............................: 300     min=300      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 14823      ✗ 0    
     data_received..................: 435 MB  14 MB/s
     data_sent......................: 5.9 MB  190 kB/s
     http_req_blocked...............: avg=574.6µs  min=1.55µs  med=3.4µs    max=822.2ms  p(90)=6.08µs  p(95)=737.6µs
     http_req_connecting............: avg=369.02µs min=0s      med=0s       max=320.64ms p(90)=0s      p(95)=582.9µs
     http_req_duration..............: avg=904.54ms min=6.54ms  med=745.34ms max=4.88s    p(90)=1.88s   p(95)=2.31s  
       { expected_response:true }...: avg=904.54ms min=6.54ms  med=745.34ms max=4.88s    p(90)=1.88s   p(95)=2.31s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 4961 
     http_req_receiving.............: avg=329.67ms min=33.71µs med=103.14µs max=3.81s    p(90)=1.26s   p(95)=1.84s  
     http_req_sending...............: avg=16.1ms   min=8.2µs   med=15.48µs  max=3.4s     p(90)=145.9µs p(95)=1.09ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s      p(95)=0s     
     http_req_waiting...............: avg=558.76ms min=6.47ms  med=497.49ms max=2.19s    p(90)=1.01s   p(95)=1.22s  
     http_reqs......................: 4961    159.990219/s
     iteration_duration.............: avg=1.84s    min=28.91ms med=1.48s    max=10.18s   p(90)=3.98s   p(95)=4.81s  
     iterations.....................: 4941    159.345227/s
     vus............................: 17      min=17       max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8307      ✗ 0    
     data_received..................: 245 MB  7.4 MB/s
     data_sent......................: 3.3 MB  101 kB/s
     http_req_blocked...............: avg=721.42µs min=1.69µs   med=3.67µs  max=49.26ms  p(90)=375.35µs p(95)=6.65ms 
     http_req_connecting............: avg=681.72µs min=0s       med=0s      max=22.42ms  p(90)=275.44µs p(95)=6.41ms 
     http_req_duration..............: avg=3.34s    min=18.84ms  med=3.09s   max=7.77s    p(90)=4.67s    p(95)=5.51s  
       { expected_response:true }...: avg=3.34s    min=18.84ms  med=3.09s   max=7.77s    p(90)=4.67s    p(95)=5.51s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2789 
     http_req_receiving.............: avg=52.83ms  min=39.58µs  med=298.4µs max=1.61s    p(90)=4.15ms   p(95)=458.2ms
     http_req_sending...............: avg=386.26µs min=8.88µs   med=20.16µs max=158.33ms p(90)=126.67µs p(95)=2.18ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s      max=0s       p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=3.29s    min=18.51ms  med=3.06s   max=7.77s    p(90)=4.62s    p(95)=5.51s  
     http_reqs......................: 2789    84.661139/s
     iteration_duration.............: avg=3.39s    min=360.38ms med=3.11s   max=7.81s    p(90)=4.71s    p(95)=5.55s  
     iterations.....................: 2769    84.054032/s
     vus............................: 136     min=136     max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 7494      ✗ 0    
     data_received..................: 221 MB  6.5 MB/s
     data_sent......................: 3.0 MB  87 kB/s
     http_req_blocked...............: avg=5.89ms   min=1.56µs   med=4.01µs  max=103.34ms p(90)=33.65ms  p(95)=54.04ms 
     http_req_connecting............: avg=5.79ms   min=0s       med=0s      max=103.31ms p(90)=32.12ms  p(95)=53.15ms 
     http_req_duration..............: avg=3.78s    min=14.83ms  med=1.43s   max=33.64s   p(90)=3.77s    p(95)=32.01s  
       { expected_response:true }...: avg=3.78s    min=14.83ms  med=1.43s   max=33.64s   p(90)=3.77s    p(95)=32.01s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2518 
     http_req_receiving.............: avg=293.26µs min=48.91µs  med=117.9µs max=223.9ms  p(90)=202.23µs p(95)=312.22µs
     http_req_sending...............: avg=2.41ms   min=9.33µs   med=22.14µs max=57.41ms  p(90)=3.94ms   p(95)=15.04ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s      max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.78s    min=14.73ms  med=1.43s   max=33.64s   p(90)=3.73s    p(95)=32s     
     http_reqs......................: 2518    73.516345/s
     iteration_duration.............: avg=3.83s    min=134.26ms med=1.45s   max=33.7s    p(90)=4.22s    p(95)=32.09s  
     iterations.....................: 2498    72.932418/s
     vus............................: 21      min=21      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 7383      ✗ 0    
     data_received..................: 218 MB  6.5 MB/s
     data_sent......................: 2.9 MB  87 kB/s
     http_req_blocked...............: avg=1.56ms   min=1.46µs   med=3.81µs   max=40.42ms p(90)=4.15ms   p(95)=15.56ms
     http_req_connecting............: avg=1.51ms   min=0s       med=0s       max=26.41ms p(90)=3.8ms    p(95)=14.28ms
     http_req_duration..............: avg=3.79s    min=16.08ms  med=1.9s     max=33.11s  p(90)=3.83s    p(95)=24.64s 
       { expected_response:true }...: avg=3.79s    min=16.08ms  med=1.9s     max=33.11s  p(90)=3.83s    p(95)=24.64s 
     http_req_failed................: 0.00%   ✓ 0         ✗ 2481 
     http_req_receiving.............: avg=351.85µs min=41.94µs  med=108.48µs max=54.68ms p(90)=408.45µs p(95)=1.08ms 
     http_req_sending...............: avg=284.23µs min=8.95µs   med=21.86µs  max=20.85ms p(90)=364.88µs p(95)=1.01ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=3.79s    min=15.95ms  med=1.9s     max=33.1s   p(90)=3.83s    p(95)=24.63s 
     http_reqs......................: 2481    73.655637/s
     iteration_duration.............: avg=3.84s    min=252.98ms med=1.92s    max=33.11s  p(90)=3.95s    p(95)=24.94s 
     iterations.....................: 2461    73.061879/s
     vus............................: 65      min=65      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 6429      ✗ 0    
     data_received..................: 190 MB  5.9 MB/s
     data_sent......................: 2.6 MB  80 kB/s
     http_req_blocked...............: avg=3.56ms min=1.62µs   med=3.67µs   max=66.96ms p(90)=11.73ms  p(95)=30.41ms 
     http_req_connecting............: avg=3.46ms min=0s       med=0s       max=62.2ms  p(90)=11.19ms  p(95)=29.01ms 
     http_req_duration..............: avg=4.25s  min=15.26ms  med=4.32s    max=9.08s   p(90)=5.17s    p(95)=6.79s   
       { expected_response:true }...: avg=4.25s  min=15.26ms  med=4.32s    max=9.08s   p(90)=5.17s    p(95)=6.79s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 2163 
     http_req_receiving.............: avg=3.33ms min=37.28µs  med=101.67µs max=410ms   p(90)=260.68µs p(95)=692.07µs
     http_req_sending...............: avg=1.82ms min=8.53µs   med=20.37µs  max=51.04ms p(90)=5.75ms   p(95)=8.51ms  
     http_req_tls_handshaking.......: avg=0s     min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=4.24s  min=15.18ms  med=4.32s    max=9.08s   p(90)=5.17s    p(95)=6.78s   
     http_reqs......................: 2163    67.05326/s
     iteration_duration.............: avg=4.31s  min=552.74ms med=4.35s    max=9.1s    p(90)=5.18s    p(95)=6.83s   
     iterations.....................: 2143    66.433257/s
     vus............................: 53      min=53      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Apr 3, 2025

Overview for: federation/constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 500 VUs over 30s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
cosmo 181 5720 total, 0 failed avg: 1285ms, p95: 2448ms
apollo-router 161 5319 total, 1 failed avg: 1465ms, p95: 3371ms ❌ 1 failed requests, 1 non-200 responses, 1 unexpected GraphQL errors
grafbase 161 5094 total, 0 failed avg: 1463ms, p95: 4193ms
hive-gateway-bun 87 3038 total, 0 failed avg: 5213ms, p95: 8892ms
hive-gateway 79 2843 total, 0 failed avg: 5706ms, p95: 33708ms
apollo-server 75 2726 total, 0 failed avg: 5983ms, p95: 33920ms
mercurius 64 2159 total, 0 failed avg: 7250ms, p95: 13052ms
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 17100      ✗ 0    
     data_received..................: 502 MB  16 MB/s
     data_sent......................: 6.8 MB  216 kB/s
     http_req_blocked...............: avg=3.33ms   min=1.44µs  med=3.2µs    max=2.75s p(90)=11.31µs  p(95)=20.52ms
     http_req_connecting............: avg=3.18ms   min=0s      med=0s       max=2.75s p(90)=0s       p(95)=20.26ms
     http_req_duration..............: avg=1.28s    min=3.1ms   med=1.13s    max=5.83s p(90)=2.25s    p(95)=2.44s  
       { expected_response:true }...: avg=1.28s    min=3.1ms   med=1.13s    max=5.83s p(90)=2.25s    p(95)=2.44s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 5720 
     http_req_receiving.............: avg=214.51ms min=34.61µs med=73.42µs  max=4.41s p(90)=921.48ms p(95)=1.44s  
     http_req_sending...............: avg=29.83ms  min=7.89µs  med=14.32µs  max=2.39s p(90)=668.08µs p(95)=9.55ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s    p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=1.04s    min=3.02ms  med=958.12ms max=4.6s  p(90)=1.74s    p(95)=1.97s  
     http_reqs......................: 5720    181.682912/s
     iteration_duration.............: avg=2.64s    min=25.6ms  med=2.49s    max=9.6s  p(90)=4.66s    p(95)=5.43s  
     iterations.....................: 5700    181.047657/s
     vus............................: 196     min=196      max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✗ response code was 200
      ↳  99% — ✓ 5298 / ✗ 1
     ✗ no graphql errors
      ↳  99% — ✓ 5298 / ✗ 1
     ✓ valid response structure

     █ setup

     checks.........................: 99.98% ✓ 15894      ✗ 2    
     data_received..................: 467 MB 14 MB/s
     data_sent......................: 6.3 MB 191 kB/s
     http_req_blocked...............: avg=4.59ms   min=1.46µs  med=3.37µs   max=2.22s  p(90)=35.23µs p(95)=26.05ms
     http_req_connecting............: avg=3.66ms   min=0s      med=0s       max=2.22s  p(90)=0s      p(95)=23.87ms
     http_req_duration..............: avg=1.46s    min=6.79ms  med=1.23s    max=6.48s  p(90)=3.01s   p(95)=3.37s  
       { expected_response:true }...: avg=1.46s    min=6.79ms  med=1.23s    max=6.48s  p(90)=3.01s   p(95)=3.37s  
     http_req_failed................: 0.01%  ✓ 1          ✗ 5318 
     http_req_receiving.............: avg=425.64ms min=0s      med=92.93µs  max=5.23s  p(90)=1.72s   p(95)=2.42s  
     http_req_sending...............: avg=27.09ms  min=8.1µs   med=15.77µs  max=3.76s  p(90)=2.68ms  p(95)=49.72ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s      p(95)=0s     
     http_req_waiting...............: avg=1.01s    min=6.7ms   med=996.48ms max=4.53s  p(90)=1.69s   p(95)=1.87s  
     http_reqs......................: 5319   161.222755/s
     iteration_duration.............: avg=3.02s    min=77.38ms med=2.73s    max=12.38s p(90)=5.7s    p(95)=6.7s   
     iterations.....................: 5299   160.616541/s
     vus............................: 31     min=31       max=500
     vus_max........................: 500    min=500      max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 15222      ✗ 0    
     data_received..................: 448 MB  14 MB/s
     data_sent......................: 6.0 MB  192 kB/s
     http_req_blocked...............: avg=3.19ms   min=1.63µs  med=3.7µs    max=1.6s   p(90)=270.51µs p(95)=16.87ms
     http_req_connecting............: avg=2.22ms   min=0s      med=0s       max=1.36s  p(90)=0s       p(95)=16.49ms
     http_req_duration..............: avg=1.46s    min=3.11ms  med=1.1s     max=12.67s p(90)=3.34s    p(95)=4.19s  
       { expected_response:true }...: avg=1.46s    min=3.11ms  med=1.1s     max=12.67s p(90)=3.34s    p(95)=4.19s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 5094 
     http_req_receiving.............: avg=577.26ms min=31.89µs med=102.95µs max=11.45s p(90)=1.88s    p(95)=2.67s  
     http_req_sending...............: avg=41.48ms  min=8.14µs  med=17.64µs  max=5.47s  p(90)=1.62ms   p(95)=17.64ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=843.8ms  min=3.05ms  med=710.11ms max=4.48s  p(90)=1.66s    p(95)=2.39s  
     http_reqs......................: 5094    161.61131/s
     iteration_duration.............: avg=3s       min=25.47ms med=2.34s    max=17.34s p(90)=6.52s    p(95)=8.13s  
     iterations.....................: 5074    160.976794/s
     vus............................: 209     min=209      max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 9054      ✗ 0    
     data_received..................: 267 MB  7.7 MB/s
     data_sent......................: 3.6 MB  104 kB/s
     http_req_blocked...............: avg=3.29ms  min=1.89µs   med=3.83µs   max=50.56ms  p(90)=18.38ms p(95)=27.55ms 
     http_req_connecting............: avg=3.21ms  min=0s       med=0s       max=48.47ms  p(90)=18.1ms  p(95)=27.4ms  
     http_req_duration..............: avg=5.21s   min=14.91ms  med=5.09s    max=11.47s   p(90)=7.21s   p(95)=8.89s   
       { expected_response:true }...: avg=5.21s   min=14.91ms  med=5.09s    max=11.47s   p(90)=7.21s   p(95)=8.89s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 3038 
     http_req_receiving.............: avg=45.93ms min=37.31µs  med=160.65µs max=2.91s    p(90)=5.64ms  p(95)=115.67ms
     http_req_sending...............: avg=1.21ms  min=8.49µs   med=21.36µs  max=386.78ms p(90)=1.11ms  p(95)=2.9ms   
     http_req_tls_handshaking.......: avg=0s      min=0s       med=0s       max=0s       p(90)=0s      p(95)=0s      
     http_req_waiting...............: avg=5.16s   min=14.71ms  med=5.05s    max=11.47s   p(90)=7.13s   p(95)=8.79s   
     http_reqs......................: 3038    87.744824/s
     iteration_duration.............: avg=5.32s   min=442.72ms med=5.19s    max=11.78s   p(90)=7.26s   p(95)=8.92s   
     iterations.....................: 3018    87.167175/s
     vus............................: 120     min=120     max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8469      ✗ 0    
     data_received..................: 250 MB  7.0 MB/s
     data_sent......................: 3.4 MB  94 kB/s
     http_req_blocked...............: avg=3.56ms   min=1.92µs   med=4.41µs   max=50.79ms  p(90)=19.9ms   p(95)=31.22ms
     http_req_connecting............: avg=3.51ms   min=0s       med=0s       max=47.79ms  p(90)=19.73ms  p(95)=31ms   
     http_req_duration..............: avg=5.7s     min=14.47ms  med=2.35s    max=35.2s    p(90)=22.39s   p(95)=33.7s  
       { expected_response:true }...: avg=5.7s     min=14.47ms  med=2.35s    max=35.2s    p(90)=22.39s   p(95)=33.7s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2843 
     http_req_receiving.............: avg=991.41µs min=43.73µs  med=113.82µs max=182.31ms p(90)=1ms      p(95)=2.65ms 
     http_req_sending...............: avg=427.58µs min=10.4µs   med=25.73µs  max=34.03ms  p(90)=823.37µs p(95)=2.1ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=5.7s     min=14.36ms  med=2.34s    max=35.2s    p(90)=22.39s   p(95)=33.7s  
     http_reqs......................: 2843    79.564827/s
     iteration_duration.............: avg=5.77s    min=223.41ms med=2.38s    max=35.21s   p(90)=23.04s   p(95)=33.75s 
     iterations.....................: 2823    79.005102/s
     vus............................: 78      min=78      max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8118      ✗ 0    
     data_received..................: 240 MB  6.6 MB/s
     data_sent......................: 3.2 MB  89 kB/s
     http_req_blocked...............: avg=8.38ms   min=1.67µs  med=4.01µs   max=129.21ms p(90)=41.53ms  p(95)=68.29ms 
     http_req_connecting............: avg=8.22ms   min=0s      med=0s       max=111.36ms p(90)=41.29ms  p(95)=67.98ms 
     http_req_duration..............: avg=5.98s    min=13.33ms med=1.6s     max=35.52s   p(90)=32.3s    p(95)=33.92s  
       { expected_response:true }...: avg=5.98s    min=13.33ms med=1.6s     max=35.52s   p(90)=32.3s    p(95)=33.92s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2726 
     http_req_receiving.............: avg=196.82µs min=44.92µs med=115.02µs max=44.19ms  p(90)=210.56µs p(95)=313.75µs
     http_req_sending...............: avg=3ms      min=9.36µs  med=21.5µs   max=72.42ms  p(90)=10.41ms  p(95)=23.37ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=5.98s    min=13.25ms med=1.6s     max=35.52s   p(90)=32.28s   p(95)=33.89s  
     http_reqs......................: 2726    75.128239/s
     iteration_duration.............: avg=6.04s    min=358.1ms med=1.62s    max=35.53s   p(90)=32.39s   p(95)=33.96s  
     iterations.....................: 2706    74.577041/s
     vus............................: 33      min=33      max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 6417      ✗ 0    
     data_received..................: 190 MB  5.7 MB/s
     data_sent......................: 2.6 MB  77 kB/s
     http_req_blocked...............: avg=5.36ms   min=1.7µs    med=4.5µs    max=45.41ms  p(90)=24.55ms  p(95)=30.52ms
     http_req_connecting............: avg=5.27ms   min=0s       med=0s       max=36.44ms  p(90)=24.31ms  p(95)=30.29ms
     http_req_duration..............: avg=7.25s    min=14.27ms  med=7.8s     max=15.05s   p(90)=10.32s   p(95)=13.05s 
       { expected_response:true }...: avg=7.25s    min=14.27ms  med=7.8s     max=15.05s   p(90)=10.32s   p(95)=13.05s 
     http_req_failed................: 0.00%   ✓ 0         ✗ 2159 
     http_req_receiving.............: avg=8.76ms   min=40.21µs  med=107.78µs max=674.89ms p(90)=309.38µs p(95)=1.15ms 
     http_req_sending...............: avg=817.38µs min=9.18µs   med=25.71µs  max=22.87ms  p(90)=2.51ms   p(95)=4.47ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=7.24s    min=14.15ms  med=7.8s     max=15.04s   p(90)=10.32s   p(95)=13.05s 
     http_reqs......................: 2159    64.645854/s
     iteration_duration.............: avg=7.34s    min=630.61ms med=7.82s    max=15.08s   p(90)=10.4s    p(95)=13.11s 
     iterations.....................: 2139    64.047004/s
     vus............................: 108     min=108     max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Apr 3, 2025

Overview for: federation/ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was trying to reach 2000 concurrent VUs over 60s

Comparison

Comparison

Gateway duration(p95)⬇️ RPS Requests Durations Notes
grafbase 5684ms 164 11553 total, 0 failed avg: 2543ms, p95: 5684ms, max: 10476ms, med: 2300ms
cosmo 5945ms 179 12593 total, 0 failed avg: 2248ms, p95: 5946ms, max: 11670ms, med: 1829ms
apollo-router 10053ms 163 12771 total, 508 failed avg: 2993ms, p95: 10054ms, max: 23677ms, med: 2168ms ❌ 508 failed requests, 508 non-200 responses, 508 unexpected GraphQL errors
hive-gateway-bun 30558ms 88 7337 total, 0 failed avg: 12138ms, p95: 30559ms, max: 40921ms, med: 10121ms
mercurius 41484ms 47 4363 total, 0 failed avg: 24234ms, p95: 41484ms, max: 43236ms, med: 25078ms
hive-gateway 53462ms 80 7195 total, 0 failed avg: 13306ms, p95: 53463ms, max: 58787ms, med: 3529ms
apollo-server 60000ms 77 7184 total, 552 failed avg: 12900ms, p95: 60000ms, max: 60047ms, med: 2331ms ❌ 552 failed requests, 552 non-200 responses, 552 unexpected GraphQL errors
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 34599      ✗ 0     
     data_received..................: 1.0 GB  15 MB/s
     data_sent......................: 14 MB   196 kB/s
     http_req_blocked...............: avg=319.96ms min=1.51µs  med=4.05µs  max=8.77s  p(90)=826.5ms  p(95)=3.23s 
     http_req_connecting............: avg=317.14ms min=0s      med=0s      max=8.77s  p(90)=815.95ms p(95)=3.21s 
     http_req_duration..............: avg=2.54s    min=3.21ms  med=2.29s   max=10.47s p(90)=4.82s    p(95)=5.68s 
       { expected_response:true }...: avg=2.54s    min=3.21ms  med=2.29s   max=10.47s p(90)=4.82s    p(95)=5.68s 
     http_req_failed................: 0.00%   ✓ 0          ✗ 11553 
     http_req_receiving.............: avg=260.05ms min=32.74µs med=83.22µs max=4.7s   p(90)=1.04s    p(95)=1.8s  
     http_req_sending...............: avg=141.41ms min=8.11µs  med=19.38µs max=8.93s  p(90)=312.3ms  p(95)=1.01s 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s     p(90)=0s       p(95)=0s    
     http_req_waiting...............: avg=2.14s    min=3.15ms  med=1.73s   max=9.39s  p(90)=4.46s    p(95)=5.02s 
     http_reqs......................: 11553   164.807786/s
     iteration_duration.............: avg=6.06s    min=8.91ms  med=5.35s   max=28.97s p(90)=11.99s   p(95)=13.77s
     iterations.....................: 11533   164.522478/s
     vus............................: 4       min=4        max=2000
     vus_max........................: 2000    min=2000     max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 37719      ✗ 0     
     data_received..................: 1.1 GB  16 MB/s
     data_sent......................: 15 MB   213 kB/s
     http_req_blocked...............: avg=242.47ms min=1.48µs  med=3.53µs  max=8.61s  p(90)=495.69ms p(95)=2.11s   
     http_req_connecting............: avg=227.75ms min=0s      med=0s      max=8.61s  p(90)=486.95ms p(95)=1.97s   
     http_req_duration..............: avg=2.24s    min=3.22ms  med=1.82s   max=11.66s p(90)=4.65s    p(95)=5.94s   
       { expected_response:true }...: avg=2.24s    min=3.22ms  med=1.82s   max=11.66s p(90)=4.65s    p(95)=5.94s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 12593 
     http_req_receiving.............: avg=475.69ms min=33.12µs med=89.02µs max=8.98s  p(90)=1.75s    p(95)=3.64s   
     http_req_sending...............: avg=109.69ms min=8.18µs  med=15.75µs max=10.35s p(90)=150.82ms p(95)=543.99ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s     p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=1.66s    min=3.11ms  med=1.35s   max=8.46s  p(90)=3.62s    p(95)=4.04s   
     http_reqs......................: 12593   179.594862/s
     iteration_duration.............: avg=5.46s    min=8.91ms  med=4.48s   max=34.37s p(90)=11.58s   p(95)=14.06s  
     iterations.....................: 12573   179.309633/s
     vus............................: 5       min=5        max=1939
     vus_max........................: 2000    min=2000     max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✗ response code was 200
      ↳  96% — ✓ 12243 / ✗ 508
     ✗ no graphql errors
      ↳  96% — ✓ 12243 / ✗ 508
     ✓ valid response structure

     █ setup

     checks.........................: 97.30% ✓ 36729      ✗ 1016  
     data_received..................: 1.1 GB 14 MB/s
     data_sent......................: 15 MB  194 kB/s
     http_req_blocked...............: avg=596.83ms min=1.61µs  med=4.32µs  max=17.83s p(90)=2.78s    p(95)=3.75s 
     http_req_connecting............: avg=585.35ms min=0s      med=0s      max=17.42s p(90)=2.77s    p(95)=3.69s 
     http_req_duration..............: avg=2.99s    min=0s      med=2.16s   max=23.67s p(90)=5.67s    p(95)=10.05s
       { expected_response:true }...: avg=2.98s    min=6.91ms  med=2.19s   max=23.67s p(90)=5.64s    p(95)=9.65s 
     http_req_failed................: 3.97%  ✓ 508        ✗ 12263 
     http_req_receiving.............: avg=860.34ms min=0s      med=99.74µs max=18.48s p(90)=2.76s    p(95)=6s    
     http_req_sending...............: avg=322.5ms  min=0s      med=24.29µs max=20.09s p(90)=531.72ms p(95)=1.01s 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s     p(90)=0s       p(95)=0s    
     http_req_waiting...............: avg=1.8s     min=0s      med=1.47s   max=18.07s p(90)=3.69s    p(95)=4.16s 
     http_reqs......................: 12771  163.827625/s
     iteration_duration.............: avg=6.79s    min=14.68ms med=5.35s   max=36.06s p(90)=14.88s   p(95)=18.96s
     iterations.....................: 12751  163.571063/s
     vus............................: 75     min=68       max=1896
     vus_max........................: 2000   min=2000     max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 21951     ✗ 0     
     data_received..................: 644 MB  7.7 MB/s
     data_sent......................: 8.7 MB  105 kB/s
     http_req_blocked...............: avg=6.23ms   min=1.82µs   med=4.18µs   max=585.38ms p(90)=2.19ms   p(95)=36.6ms 
     http_req_connecting............: avg=6.17ms   min=0s       med=0s       max=585.14ms p(90)=1.89ms   p(95)=35.97ms
     http_req_duration..............: avg=12.13s   min=15.91ms  med=10.12s   max=40.92s   p(90)=25.97s   p(95)=30.55s 
       { expected_response:true }...: avg=12.13s   min=15.91ms  med=10.12s   max=40.92s   p(90)=25.97s   p(95)=30.55s 
     http_req_failed................: 0.00%   ✓ 0         ✗ 7337  
     http_req_receiving.............: avg=106.17ms min=35.88µs  med=190.99µs max=9.77s    p(90)=4.1ms    p(95)=51.98ms
     http_req_sending...............: avg=2.76ms   min=9.15µs   med=24.94µs  max=443.38ms p(90)=313.22µs p(95)=14.88ms
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=12.02s   min=15.6ms   med=10.1s    max=40.92s   p(90)=25.89s   p(95)=30.54s 
     http_reqs......................: 7337    88.179909/s
     iteration_duration.............: avg=12.53s   min=156.16ms med=10.24s   max=43.79s   p(90)=26.45s   p(95)=31.31s 
     iterations.....................: 7317    87.939539/s
     vus............................: 279     min=52      max=1999
     vus_max........................: 2000    min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 12981     ✗ 0     
     data_received..................: 384 MB  4.2 MB/s
     data_sent......................: 5.3 MB  58 kB/s
     http_req_blocked...............: avg=226.2µs min=2.23µs   med=6.02µs   max=15.08ms p(90)=508.31µs p(95)=862.77µs
     http_req_connecting............: avg=185.4µs min=0s       med=0s       max=14.88ms p(90)=417.98µs p(95)=710.17µs
     http_req_duration..............: avg=24.23s  min=15.65ms  med=25.07s   max=43.23s  p(90)=40.51s   p(95)=41.48s  
       { expected_response:true }...: avg=24.23s  min=15.65ms  med=25.07s   max=43.23s  p(90)=40.51s   p(95)=41.48s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 4363  
     http_req_receiving.............: avg=38.46ms min=41.11µs  med=124.32µs max=2.09s   p(90)=594.24µs p(95)=7.28ms  
     http_req_sending...............: avg=67.4µs  min=9.99µs   med=38.1µs   max=18.08ms p(90)=77.26µs  p(95)=102.73µs
     http_req_tls_handshaking.......: avg=0s      min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=24.19s  min=15.22ms  med=25.07s   max=43.23s  p(90)=40.5s    p(95)=41.47s  
     http_reqs......................: 4363    47.602249/s
     iteration_duration.............: avg=24.29s  min=333.24ms med=24.87s   max=43.24s  p(90)=40.58s   p(95)=41.9s   
     iterations.....................: 4296    46.87125/s
     vus............................: 450     min=51      max=2000
     vus_max........................: 2000    min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 21525     ✗ 0     
     data_received..................: 632 MB  7.0 MB/s
     data_sent......................: 8.5 MB  95 kB/s
     http_req_blocked...............: avg=924.11µs min=1.78µs  med=4.55µs   max=101.81ms p(90)=560.95µs p(95)=2.59ms  
     http_req_connecting............: avg=890.19µs min=0s      med=0s       max=101.71ms p(90)=462.33µs p(95)=2.38ms  
     http_req_duration..............: avg=13.3s    min=14.96ms med=3.52s    max=58.78s   p(90)=47.56s   p(95)=53.46s  
       { expected_response:true }...: avg=13.3s    min=14.96ms med=3.52s    max=58.78s   p(90)=47.56s   p(95)=53.46s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 7195  
     http_req_receiving.............: avg=679.27µs min=41.85µs med=111.05µs max=531.82ms p(90)=853.89µs p(95)=2.48ms  
     http_req_sending...............: avg=430.06µs min=9.74µs  med=27.05µs  max=176.5ms  p(90)=68.82µs  p(95)=255.76µs
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=13.3s    min=14.85ms med=3.52s    max=58.78s   p(90)=47.56s   p(95)=53.46s  
     http_reqs......................: 7195    80.048139/s
     iteration_duration.............: avg=13.36s   min=66.04ms med=3.55s    max=58.92s   p(90)=47.6s    p(95)=53.48s  
     iterations.....................: 7175    79.825628/s
     vus............................: 15      min=15      max=1999
     vus_max........................: 2000    min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✗ response code was 200
      ↳  92% — ✓ 6612 / ✗ 552
     ✗ no graphql errors
      ↳  92% — ✓ 6612 / ✗ 552
     ✓ valid response structure

     █ setup

     checks.........................: 94.72% ✓ 19836    ✗ 1104  
     data_received..................: 583 MB 6.3 MB/s
     data_sent......................: 8.6 MB 93 kB/s
     http_req_blocked...............: avg=346.28µs min=1.35µs  med=3.25µs   max=74.88ms p(90)=317.38µs p(95)=480.87µs
     http_req_connecting............: avg=323.2µs  min=0s      med=0s       max=74.82ms p(90)=249.88µs p(95)=393.14µs
     http_req_duration..............: avg=12.89s   min=12.9ms  med=2.33s    max=1m0s    p(90)=57.28s   p(95)=1m0s    
       { expected_response:true }...: avg=8.97s    min=12.9ms  med=2.25s    max=59.99s  p(90)=38.59s   p(95)=46.37s  
     http_req_failed................: 7.68%  ✓ 552      ✗ 6632  
     http_req_receiving.............: avg=234.58µs min=0s      med=110.27µs max=199.3ms p(90)=200.99µs p(95)=298.19µs
     http_req_sending...............: avg=135.87µs min=8.8µs   med=16.15µs  max=44ms    p(90)=57.69µs  p(95)=83.29µs 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=12.89s   min=12.74ms med=2.32s    max=1m0s    p(90)=57.28s   p(95)=1m0s    
     http_reqs......................: 7184   77.46153/s
     iteration_duration.............: avg=12.94s   min=64.38ms med=2.34s    max=1m0s    p(90)=57.35s   p(95)=1m0s    
     iterations.....................: 7164   77.24588/s
     vus............................: 90     min=59     max=2000
     vus_max........................: 2000   min=2000   max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
dependencies Pull requests that update a dependency file
Projects
None yet
Development

Successfully merging this pull request may close these issues.

0 participants