Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Try alpha #636

Draft
wants to merge 7 commits into
base: main
Choose a base branch
from
Draft

Try alpha #636

wants to merge 7 commits into from

Conversation

ardatan
Copy link
Member

@ardatan ardatan commented Mar 27, 2025

No description provided.

Copy link

github-actions bot commented Mar 27, 2025

Overview for: federation/constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 300 VUs over 30s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
cosmo 182 5665 total, 0 failed avg: 821ms, p95: 2399ms
grafbase 168 5218 total, 0 failed avg: 966ms, p95: 2860ms
apollo-router 161 4981 total, 0 failed avg: 932ms, p95: 2249ms
hive-gateway-bun 85 2884 total, 0 failed avg: 3285ms, p95: 5373ms
hive-gateway 82 2805 total, 0 failed avg: 3362ms, p95: 16789ms
apollo-server 77 2612 total, 0 failed avg: 3608ms, p95: 31538ms
mercurius 63 2058 total, 0 failed avg: 4493ms, p95: 7778ms
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 16935      ✗ 0    
     data_received..................: 497 MB  16 MB/s
     data_sent......................: 6.7 MB  217 kB/s
     http_req_blocked...............: avg=1.03ms   min=1.47µs  med=3.42µs   max=1.32s  p(90)=5.91µs   p(95)=582.42µs
     http_req_connecting............: avg=723.94µs min=0s      med=0s       max=1.32s  p(90)=0s       p(95)=420.2µs 
     http_req_duration..............: avg=820.73ms min=3.13ms  med=557.12ms max=6.6s   p(90)=2.05s    p(95)=2.39s   
       { expected_response:true }...: avg=820.73ms min=3.13ms  med=557.12ms max=6.6s   p(90)=2.05s    p(95)=2.39s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 5665 
     http_req_receiving.............: avg=400.1ms  min=31.05µs med=126.9µs  max=4.48s  p(90)=1.71s    p(95)=1.96s   
     http_req_sending...............: avg=22.28ms  min=8.08µs  med=15.88µs  max=3.14s  p(90)=355.41µs p(95)=5.76ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=398.35ms min=3.02ms  med=352.64ms max=2.02s  p(90)=788.85ms p(95)=910.96ms
     http_reqs......................: 5665    182.600089/s
     iteration_duration.............: avg=1.6s     min=20.77ms med=1.19s    max=10.47s p(90)=3.6s     p(95)=4.32s   
     iterations.....................: 5645    181.955429/s
     vus............................: 24      min=24       max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 15594      ✗ 0    
     data_received..................: 459 MB  15 MB/s
     data_sent......................: 6.2 MB  201 kB/s
     http_req_blocked...............: avg=2.44ms   min=1.51µs  med=3.36µs   max=538.64ms p(90)=5.83µs   p(95)=7.56ms 
     http_req_connecting............: avg=2.37ms   min=0s      med=0s       max=538.58ms p(90)=0s       p(95)=6.79ms 
     http_req_duration..............: avg=966.04ms min=3.1ms   med=641.97ms max=4.95s    p(90)=2.3s     p(95)=2.85s  
       { expected_response:true }...: avg=966.04ms min=3.1ms   med=641.97ms max=4.95s    p(90)=2.3s     p(95)=2.85s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 5218 
     http_req_receiving.............: avg=507.95ms min=31.57µs med=154.7µs  max=4.51s    p(90)=1.82s    p(95)=2.29s  
     http_req_sending...............: avg=13.19ms  min=7.81µs  med=15.14µs  max=2.32s    p(90)=600.7µs  p(95)=24.63ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=444.89ms min=3.05ms  med=357.67ms max=1.94s    p(90)=947.12ms p(95)=1.15s  
     http_reqs......................: 5218    168.89742/s
     iteration_duration.............: avg=1.75s    min=20.84ms med=1.34s    max=10.62s   p(90)=4.06s    p(95)=4.82s  
     iterations.....................: 5198    168.250055/s
     vus............................: 300     min=300      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 14883      ✗ 0    
     data_received..................: 437 MB  14 MB/s
     data_sent......................: 5.9 MB  192 kB/s
     http_req_blocked...............: avg=3.18ms   min=1.39µs  med=3.17µs   max=1.47s p(90)=5.43µs   p(95)=11.42ms
     http_req_connecting............: avg=2.73ms   min=0s      med=0s       max=1.47s p(90)=0s       p(95)=10.68ms
     http_req_duration..............: avg=931.52ms min=6.52ms  med=803.43ms max=4.52s p(90)=1.9s     p(95)=2.24s  
       { expected_response:true }...: avg=931.52ms min=6.52ms  med=803.43ms max=4.52s p(90)=1.9s     p(95)=2.24s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 4981 
     http_req_receiving.............: avg=337ms    min=35.94µs med=98.44µs  max=3.66s p(90)=1.07s    p(95)=1.63s  
     http_req_sending...............: avg=15.13ms  min=7.76µs  med=14.72µs  max=4.09s p(90)=500.85µs p(95)=15.6ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s    p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=579.38ms min=6.45ms  med=553.77ms max=2.9s  p(90)=1.02s    p(95)=1.19s  
     http_reqs......................: 4981    161.351515/s
     iteration_duration.............: avg=1.82s    min=35.01ms med=1.56s    max=8.28s p(90)=3.67s    p(95)=4.35s  
     iterations.....................: 4961    160.703647/s
     vus............................: 300     min=300      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8592      ✗ 0    
     data_received..................: 253 MB  7.5 MB/s
     data_sent......................: 3.4 MB  102 kB/s
     http_req_blocked...............: avg=491.69µs min=1.7µs    med=3.92µs   max=27.99ms  p(90)=257.44µs p(95)=3.77ms  
     http_req_connecting............: avg=456.66µs min=0s       med=0s       max=21.26ms  p(90)=155.44µs p(95)=3.57ms  
     http_req_duration..............: avg=3.28s    min=16.88ms  med=2.94s    max=7.36s    p(90)=4.79s    p(95)=5.37s   
       { expected_response:true }...: avg=3.28s    min=16.88ms  med=2.94s    max=7.36s    p(90)=4.79s    p(95)=5.37s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 2884 
     http_req_receiving.............: avg=55.33ms  min=40.1µs   med=273.14µs max=1.78s    p(90)=6.88ms   p(95)=383.31ms
     http_req_sending...............: avg=594.86µs min=8.62µs   med=20.54µs  max=205.36ms p(90)=185.99µs p(95)=1.31ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.22s    min=16.67ms  med=2.91s    max=7.36s    p(90)=4.73s    p(95)=5.36s   
     http_reqs......................: 2884    85.613034/s
     iteration_duration.............: avg=3.35s    min=304.79ms med=3.06s    max=7.48s    p(90)=4.82s    p(95)=5.43s   
     iterations.....................: 2864    85.019323/s
     vus............................: 134     min=134     max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8355     ✗ 0    
     data_received..................: 246 MB  7.3 MB/s
     data_sent......................: 3.3 MB  99 kB/s
     http_req_blocked...............: avg=1.21ms   min=1.69µs   med=3.75µs   max=47.41ms  p(90)=361.02µs p(95)=10.42ms 
     http_req_connecting............: avg=1.16ms   min=0s       med=0s       max=23.71ms  p(90)=231.98µs p(95)=10.17ms 
     http_req_duration..............: avg=3.36s    min=16.02ms  med=1.88s    max=33.25s   p(90)=3.15s    p(95)=16.78s  
       { expected_response:true }...: avg=3.36s    min=16.02ms  med=1.88s    max=33.25s   p(90)=3.15s    p(95)=16.78s  
     http_req_failed................: 0.00%   ✓ 0        ✗ 2805 
     http_req_receiving.............: avg=3.77ms   min=44.36µs  med=110.59µs max=580.47ms p(90)=586.94µs p(95)=1.91ms  
     http_req_sending...............: avg=233.68µs min=9.32µs   med=21.25µs  max=24.94ms  p(90)=165.38µs p(95)=665.74µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.35s    min=15.85ms  med=1.88s    max=33.25s   p(90)=3.14s    p(95)=16.78s  
     http_reqs......................: 2805    82.99435/s
     iteration_duration.............: avg=3.41s    min=187.02ms med=1.9s     max=33.26s   p(90)=3.2s     p(95)=16.99s  
     iterations.....................: 2785    82.40259/s
     vus............................: 43      min=43     max=300
     vus_max........................: 300     min=300    max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 7776      ✗ 0    
     data_received..................: 230 MB  6.8 MB/s
     data_sent......................: 3.1 MB  92 kB/s
     http_req_blocked...............: avg=2.13ms   min=1.42µs   med=3.7µs    max=71.94ms p(90)=2.3ms    p(95)=23.29ms 
     http_req_connecting............: avg=2.05ms   min=0s       med=0s       max=50.1ms  p(90)=1.87ms   p(95)=22.7ms  
     http_req_duration..............: avg=3.6s     min=13.98ms  med=1.47s    max=33.1s   p(90)=2.42s    p(95)=31.53s  
       { expected_response:true }...: avg=3.6s     min=13.98ms  med=1.47s    max=33.1s   p(90)=2.42s    p(95)=31.53s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2612 
     http_req_receiving.............: avg=159.51µs min=46.92µs  med=112.46µs max=13.59ms p(90)=188.06µs p(95)=263.28µs
     http_req_sending...............: avg=493.29µs min=8.57µs   med=20.54µs  max=59.18ms p(90)=527.94µs p(95)=4.25ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.6s     min=13.8ms   med=1.47s    max=33.1s   p(90)=2.42s    p(95)=31.53s  
     http_reqs......................: 2612    77.586342/s
     iteration_duration.............: avg=3.65s    min=208.21ms med=1.49s    max=33.18s  p(90)=2.59s    p(95)=31.58s  
     iterations.....................: 2592    76.992265/s
     vus............................: 56      min=56      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 6114      ✗ 0    
     data_received..................: 181 MB  5.6 MB/s
     data_sent......................: 2.4 MB  76 kB/s
     http_req_blocked...............: avg=783.19µs min=1.92µs   med=4.66µs   max=26.9ms   p(90)=1.36ms   p(95)=6.59ms  
     http_req_connecting............: avg=744.59µs min=0s       med=0s       max=26.67ms  p(90)=1.16ms   p(95)=6.24ms  
     http_req_duration..............: avg=4.49s    min=16.66ms  med=4.66s    max=9.96s    p(90)=5.48s    p(95)=7.77s   
       { expected_response:true }...: avg=4.49s    min=16.66ms  med=4.66s    max=9.96s    p(90)=5.48s    p(95)=7.77s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 2058 
     http_req_receiving.............: avg=3.16ms   min=42.4µs   med=111.09µs max=425.63ms p(90)=270.59µs p(95)=722.94µs
     http_req_sending...............: avg=148.49µs min=10.17µs  med=26.42µs  max=26.76ms  p(90)=303.61µs p(95)=1.07ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=4.48s    min=16.51ms  med=4.66s    max=9.96s    p(90)=5.47s    p(95)=7.77s   
     http_reqs......................: 2058    63.56367/s
     iteration_duration.............: avg=4.55s    min=293.57ms med=4.68s    max=9.97s    p(90)=5.49s    p(95)=7.82s   
     iterations.....................: 2038    62.945948/s
     vus............................: 101     min=101     max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Mar 27, 2025

Overview for: federation/constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 300 VUs over 30s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
cosmo 183 5652 total, 0 failed avg: 899ms, p95: 2307ms
grafbase 167 5170 total, 0 failed avg: 903ms, p95: 2381ms
apollo-router 150 4682 total, 0 failed avg: 1068ms, p95: 2894ms
hive-gateway-bun 87 2871 total, 0 failed avg: 3213ms, p95: 5312ms
apollo-server 75 2534 total, 0 failed avg: 3715ms, p95: 31616ms
hive-gateway 68 2350 total, 0 failed avg: 4052ms, p95: 27352ms
mercurius 65 2086 total, 0 failed avg: 4415ms, p95: 7192ms
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 16896      ✗ 0    
     data_received..................: 496 MB  16 MB/s
     data_sent......................: 6.7 MB  218 kB/s
     http_req_blocked...............: avg=1ms      min=1.47µs  med=3.08µs   max=880.04ms p(90)=5.16µs   p(95)=424.19µs
     http_req_connecting............: avg=893.21µs min=0s      med=0s       max=879.96ms p(90)=0s       p(95)=297.86µs
     http_req_duration..............: avg=898.87ms min=3.19ms  med=716.34ms max=4.59s    p(90)=1.77s    p(95)=2.3s    
       { expected_response:true }...: avg=898.87ms min=3.19ms  med=716.34ms max=4.59s    p(90)=1.77s    p(95)=2.3s    
     http_req_failed................: 0.00%   ✓ 0          ✗ 5652 
     http_req_receiving.............: avg=296.28ms min=33.95µs med=81.64µs  max=3.98s    p(90)=1.14s    p(95)=1.7s    
     http_req_sending...............: avg=22.71ms  min=7.89µs  med=14.05µs  max=3.08s    p(90)=223.28µs p(95)=21.78ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=579.87ms min=3.11ms  med=547.28ms max=2.01s    p(90)=1.01s    p(95)=1.19s   
     http_reqs......................: 5652    183.397575/s
     iteration_duration.............: avg=1.61s    min=19.16ms med=1.38s    max=8.06s    p(90)=3.23s    p(95)=3.85s   
     iterations.....................: 5632    182.74861/s
     vus............................: 288     min=288      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 15450      ✗ 0    
     data_received..................: 454 MB  15 MB/s
     data_sent......................: 6.1 MB  199 kB/s
     http_req_blocked...............: avg=1.2ms    min=1.6µs   med=3.52µs   max=1.56s    p(90)=6.02µs   p(95)=861.14µs
     http_req_connecting............: avg=563.75µs min=0s      med=0s       max=621.98ms p(90)=0s       p(95)=497.26µs
     http_req_duration..............: avg=903.48ms min=4.33ms  med=731.98ms max=5.94s    p(90)=1.96s    p(95)=2.38s   
       { expected_response:true }...: avg=903.48ms min=4.33ms  med=731.98ms max=5.94s    p(90)=1.96s    p(95)=2.38s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 5170 
     http_req_receiving.............: avg=370.9ms  min=26.53µs med=105.24µs max=5.73s    p(90)=1.28s    p(95)=1.95s   
     http_req_sending...............: avg=13.26ms  min=7.99µs  med=16.53µs  max=3.01s    p(90)=131.89µs p(95)=1.04ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=519.3ms  min=4.21ms  med=442.1ms  max=1.99s    p(90)=1.02s    p(95)=1.28s   
     http_reqs......................: 5170    167.676973/s
     iteration_duration.............: avg=1.75s    min=21.79ms med=1.46s    max=9.39s    p(90)=3.56s    p(95)=4.32s   
     iterations.....................: 5150    167.028319/s
     vus............................: 300     min=300      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 13986      ✗ 0    
     data_received..................: 411 MB  13 MB/s
     data_sent......................: 5.6 MB  179 kB/s
     http_req_blocked...............: avg=1.94ms   min=1.98µs  med=4.45µs   max=3.53s p(90)=8.61µs   p(95)=3.16ms
     http_req_connecting............: avg=1.78ms   min=0s      med=0s       max=3.53s p(90)=0s       p(95)=2.87ms
     http_req_duration..............: avg=1.06s    min=7.41ms  med=788.78ms max=5.82s p(90)=2.39s    p(95)=2.89s 
       { expected_response:true }...: avg=1.06s    min=7.41ms  med=788.78ms max=5.82s p(90)=2.39s    p(95)=2.89s 
     http_req_failed................: 0.00%   ✓ 0          ✗ 4682 
     http_req_receiving.............: avg=455.97ms min=37.3µs  med=124.32µs max=4.98s p(90)=1.88s    p(95)=2.21s 
     http_req_sending...............: avg=15.42ms  min=8.52µs  med=23.21µs  max=2.32s p(90)=569.95µs p(95)=8.43ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s    p(90)=0s       p(95)=0s    
     http_req_waiting...............: avg=596.69ms min=7.28ms  med=538.34ms max=2.73s p(90)=1.14s    p(95)=1.28s 
     http_reqs......................: 4682    150.967058/s
     iteration_duration.............: avg=1.95s    min=37.25ms med=1.69s    max=9.52s p(90)=3.95s    p(95)=4.56s 
     iterations.....................: 4662    150.322175/s
     vus............................: 16      min=16       max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8553      ✗ 0    
     data_received..................: 252 MB  7.7 MB/s
     data_sent......................: 3.4 MB  104 kB/s
     http_req_blocked...............: avg=530.29µs min=1.75µs   med=3.98µs   max=22.1ms   p(90)=194.78µs p(95)=3.78ms  
     http_req_connecting............: avg=501.37µs min=0s       med=0s       max=12.61ms  p(90)=122.99µs p(95)=3.49ms  
     http_req_duration..............: avg=3.21s    min=16.57ms  med=3.04s    max=8.4s     p(90)=4.72s    p(95)=5.31s   
       { expected_response:true }...: avg=3.21s    min=16.57ms  med=3.04s    max=8.4s     p(90)=4.72s    p(95)=5.31s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 2871 
     http_req_receiving.............: avg=57.35ms  min=35.49µs  med=169.71µs max=2.04s    p(90)=7.02ms   p(95)=512.59ms
     http_req_sending...............: avg=789.34µs min=8.49µs   med=22.1µs   max=251.89ms p(90)=454.88µs p(95)=2.93ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.15s    min=16.23ms  med=2.93s    max=8.4s     p(90)=4.66s    p(95)=5.28s   
     http_reqs......................: 2871    87.282897/s
     iteration_duration.............: avg=3.28s    min=330.06ms med=3.11s    max=8.49s    p(90)=4.77s    p(95)=5.32s   
     iterations.....................: 2851    86.674865/s
     vus............................: 104     min=104     max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 7542      ✗ 0    
     data_received..................: 223 MB  6.6 MB/s
     data_sent......................: 3.0 MB  90 kB/s
     http_req_blocked...............: avg=2.17ms   min=1.46µs   med=3.15µs   max=60.83ms p(90)=375.35µs p(95)=21.21ms 
     http_req_connecting............: avg=2.09ms   min=0s       med=0s       max=50.61ms p(90)=101.4µs  p(95)=21.04ms 
     http_req_duration..............: avg=3.71s    min=13.48ms  med=1.56s    max=32.97s  p(90)=2.44s    p(95)=31.61s  
       { expected_response:true }...: avg=3.71s    min=13.48ms  med=1.56s    max=32.97s  p(90)=2.44s    p(95)=31.61s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2534 
     http_req_receiving.............: avg=245.7µs  min=43.18µs  med=110.26µs max=41.06ms p(90)=210.6µs  p(95)=361.09µs
     http_req_sending...............: avg=851.49µs min=8.73µs   med=16.98µs  max=60.77ms p(90)=278.26µs p(95)=5.53ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.71s    min=13.4ms   med=1.56s    max=32.97s  p(90)=2.44s    p(95)=31.61s  
     http_reqs......................: 2534    75.465173/s
     iteration_duration.............: avg=3.76s    min=137.93ms med=1.58s    max=33.04s  p(90)=2.51s    p(95)=31.67s  
     iterations.....................: 2514    74.869552/s
     vus............................: 56      min=56      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 6990      ✗ 0    
     data_received..................: 206 MB  6.0 MB/s
     data_sent......................: 2.8 MB  81 kB/s
     http_req_blocked...............: avg=1.18ms   min=2.39µs  med=5.1µs    max=28.44ms  p(90)=4.81ms   p(95)=10.62ms
     http_req_connecting............: avg=1.13ms   min=0s      med=0s       max=18.93ms  p(90)=4.62ms   p(95)=10.5ms 
     http_req_duration..............: avg=4.05s    min=17.68ms med=1.95s    max=33.79s   p(90)=4.45s    p(95)=27.35s 
       { expected_response:true }...: avg=4.05s    min=17.68ms med=1.95s    max=33.79s   p(90)=4.45s    p(95)=27.35s 
     http_req_failed................: 0.00%   ✓ 0         ✗ 2350 
     http_req_receiving.............: avg=497.74µs min=50.93µs med=128.85µs max=109.81ms p(90)=455.71µs p(95)=1.18ms 
     http_req_sending...............: avg=316.75µs min=11.96µs med=31.28µs  max=75.15ms  p(90)=446.53µs p(95)=2.5ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=4.05s    min=17.56ms med=1.95s    max=33.79s   p(90)=4.44s    p(95)=27.34s 
     http_reqs......................: 2350    68.295146/s
     iteration_duration.............: avg=4.1s     min=189.1ms med=1.98s    max=33.8s    p(90)=4.51s    p(95)=27.61s 
     iterations.....................: 2330    67.71391/s
     vus............................: 35      min=35      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 6198      ✗ 0    
     data_received..................: 183 MB  5.7 MB/s
     data_sent......................: 2.5 MB  77 kB/s
     http_req_blocked...............: avg=1.64ms   min=1.51µs   med=4.3µs    max=53.02ms  p(90)=5.06ms   p(95)=11.46ms
     http_req_connecting............: avg=1.56ms   min=0s       med=0s       max=50.48ms  p(90)=4.76ms   p(95)=11.1ms 
     http_req_duration..............: avg=4.41s    min=13.7ms   med=4.46s    max=9.66s    p(90)=5.42s    p(95)=7.19s  
       { expected_response:true }...: avg=4.41s    min=13.7ms   med=4.46s    max=9.66s    p(90)=5.42s    p(95)=7.19s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2086 
     http_req_receiving.............: avg=4.48ms   min=39.91µs  med=108.32µs max=500.22ms p(90)=322.46µs p(95)=1.08ms 
     http_req_sending...............: avg=952.12µs min=9.46µs   med=24.27µs  max=50.33ms  p(90)=447.27µs p(95)=7.58ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=4.4s     min=13.6ms   med=4.46s    max=9.66s    p(90)=5.42s    p(95)=7.18s  
     http_reqs......................: 2086    65.018542/s
     iteration_duration.............: avg=4.47s    min=288.76ms med=4.48s    max=9.68s    p(90)=5.44s    p(95)=7.23s  
     iterations.....................: 2066    64.395162/s
     vus............................: 57      min=57      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Mar 27, 2025

Overview for: federation/constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 500 VUs over 30s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
cosmo 181 5718 total, 0 failed avg: 1176ms, p95: 2685ms
grafbase 166 5228 total, 0 failed avg: 1397ms, p95: 3430ms
apollo-router 156 4938 total, 11 failed avg: 1519ms, p95: 4245ms ❌ 11 failed requests, 11 non-200 responses, 11 unexpected GraphQL errors
hive-gateway-bun 84 2956 total, 0 failed avg: 5428ms, p95: 9457ms
hive-gateway 81 2893 total, 0 failed avg: 5582ms, p95: 33365ms
apollo-server 72 2615 total, 0 failed avg: 6273ms, p95: 34112ms
mercurius 65 2192 total, 0 failed avg: 7192ms, p95: 11900ms
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 17094      ✗ 0    
     data_received..................: 502 MB  16 MB/s
     data_sent......................: 6.8 MB  215 kB/s
     http_req_blocked...............: avg=2.13ms   min=1.52µs  med=3.4µs    max=2.58s  p(90)=21.5µs p(95)=6.26ms
     http_req_connecting............: avg=1.6ms    min=0s      med=0s       max=2.58s  p(90)=0s     p(95)=5.79ms
     http_req_duration..............: avg=1.17s    min=3.21ms  med=1.01s    max=7.59s  p(90)=2.19s  p(95)=2.68s 
       { expected_response:true }...: avg=1.17s    min=3.21ms  med=1.01s    max=7.59s  p(90)=2.19s  p(95)=2.68s 
     http_req_failed................: 0.00%   ✓ 0          ✗ 5718 
     http_req_receiving.............: avg=313.24ms min=33.9µs  med=82.12µs  max=6.6s   p(90)=1.37s  p(95)=1.7s  
     http_req_sending...............: avg=31.06ms  min=8.66µs  med=15.83µs  max=3.61s  p(90)=627µs  p(95)=8.49ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s     p(95)=0s    
     http_req_waiting...............: avg=831.4ms  min=3.05ms  med=836.19ms max=3.66s  p(90)=1.42s  p(95)=1.62s 
     http_reqs......................: 5718    181.429292/s
     iteration_duration.............: avg=2.66s    min=25.68ms med=2.2s     max=12.31s p(90)=5.26s  p(95)=6.32s 
     iterations.....................: 5698    180.794702/s
     vus............................: 190     min=190      max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 15624      ✗ 0    
     data_received..................: 459 MB  15 MB/s
     data_sent......................: 6.2 MB  198 kB/s
     http_req_blocked...............: avg=4.07ms   min=1.41µs  med=3.78µs   max=3.11s  p(90)=58.15µs p(95)=16.96ms
     http_req_connecting............: avg=3.47ms   min=0s      med=0s       max=3.11s  p(90)=0s      p(95)=16.54ms
     http_req_duration..............: avg=1.39s    min=3.14ms  med=1.22s    max=5.55s  p(90)=2.69s   p(95)=3.43s  
       { expected_response:true }...: avg=1.39s    min=3.14ms  med=1.22s    max=5.55s  p(90)=2.69s   p(95)=3.43s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 5228 
     http_req_receiving.............: avg=341.75ms min=34.55µs med=97.67µs  max=4.3s   p(90)=1.4s    p(95)=1.77s  
     http_req_sending...............: avg=29.86ms  min=7.52µs  med=18.11µs  max=3.77s  p(90)=1.42ms  p(95)=16.65ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s      p(95)=0s     
     http_req_waiting...............: avg=1.02s    min=3.06ms  med=975.25ms max=3.68s  p(90)=1.75s   p(95)=2.15s  
     http_reqs......................: 5228    166.881983/s
     iteration_duration.............: avg=2.91s    min=26.42ms med=2.59s    max=12.18s p(90)=5.49s   p(95)=6.37s  
     iterations.....................: 5208    166.243567/s
     vus............................: 236     min=236      max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✗ response code was 200
      ↳  99% — ✓ 4907 / ✗ 11
     ✗ no graphql errors
      ↳  99% — ✓ 4907 / ✗ 11
     ✓ valid response structure

     █ setup

     checks.........................: 99.85% ✓ 14721      ✗ 22   
     data_received..................: 432 MB 14 MB/s
     data_sent......................: 5.9 MB 186 kB/s
     http_req_blocked...............: avg=10.29ms  min=1.61µs  med=3.68µs   max=2.91s  p(90)=744.21µs p(95)=17.24ms
     http_req_connecting............: avg=9.68ms   min=0s      med=0s       max=2.91s  p(90)=507.18µs p(95)=17ms   
     http_req_duration..............: avg=1.51s    min=7.88ms  med=1.2s     max=8.49s  p(90)=3.28s    p(95)=4.24s  
       { expected_response:true }...: avg=1.51s    min=7.88ms  med=1.19s    max=8.49s  p(90)=3.28s    p(95)=4.24s  
     http_req_failed................: 0.22%  ✓ 11         ✗ 4927 
     http_req_receiving.............: avg=529.71ms min=0s      med=87.52µs  max=7.63s  p(90)=2.06s    p(95)=3.27s  
     http_req_sending...............: avg=22.34ms  min=8.29µs  med=17.21µs  max=7.43s  p(90)=917.47µs p(95)=3.15ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=967.37ms min=7.76ms  med=837.25ms max=4.73s  p(90)=1.86s    p(95)=2.36s  
     http_reqs......................: 4938   156.876037/s
     iteration_duration.............: avg=3.07s    min=38.57ms med=2.79s    max=14.47s p(90)=6.2s     p(95)=7.45s  
     iterations.....................: 4918   156.240655/s
     vus............................: 271    min=271      max=500
     vus_max........................: 500    min=500      max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8808      ✗ 0    
     data_received..................: 260 MB  7.4 MB/s
     data_sent......................: 3.5 MB  100 kB/s
     http_req_blocked...............: avg=4.01ms   min=1.92µs   med=4.21µs   max=87.36ms  p(90)=21.14ms  p(95)=32.67ms 
     http_req_connecting............: avg=3.07ms   min=0s       med=0s       max=42.73ms  p(90)=14.59ms  p(95)=23.27ms 
     http_req_duration..............: avg=5.42s    min=18.74ms  med=5.27s    max=12.05s   p(90)=7.53s    p(95)=9.45s   
       { expected_response:true }...: avg=5.42s    min=18.74ms  med=5.27s    max=12.05s   p(90)=7.53s    p(95)=9.45s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 2956 
     http_req_receiving.............: avg=54.87ms  min=39.48µs  med=242.61µs max=3.18s    p(90)=5.28ms   p(95)=130.38ms
     http_req_sending...............: avg=619.84µs min=9.09µs   med=23.68µs  max=128.08ms p(90)=667.19µs p(95)=1.58ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=5.37s    min=18.61ms  med=5.25s    max=11.58s   p(90)=7.25s    p(95)=9.45s   
     http_reqs......................: 2956    84.6146/s
     iteration_duration.............: avg=5.51s    min=295.57ms med=5.31s    max=12.07s   p(90)=7.65s    p(95)=9.49s   
     iterations.....................: 2936    84.042106/s
     vus............................: 3       min=3       max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8619      ✗ 0    
     data_received..................: 254 MB  7.2 MB/s
     data_sent......................: 3.4 MB  97 kB/s
     http_req_blocked...............: avg=2.82ms   min=1.97µs   med=4.39µs  max=65.47ms  p(90)=15.48ms  p(95)=22.24ms
     http_req_connecting............: avg=2.73ms   min=0s       med=0s      max=43.29ms  p(90)=15.13ms  p(95)=21.97ms
     http_req_duration..............: avg=5.58s    min=14.34ms  med=2.23s   max=34.95s   p(90)=22.1s    p(95)=33.36s 
       { expected_response:true }...: avg=5.58s    min=14.34ms  med=2.23s   max=34.95s   p(90)=22.1s    p(95)=33.36s 
     http_req_failed................: 0.00%   ✓ 0         ✗ 2893 
     http_req_receiving.............: avg=1.01ms   min=43.35µs  med=111µs   max=254.78ms p(90)=920.06µs p(95)=2.76ms 
     http_req_sending...............: avg=475.19µs min=11µs     med=25.61µs max=117.49ms p(90)=1.07ms   p(95)=2.95ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s      max=0s       p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=5.58s    min=14.23ms  med=2.23s   max=34.95s   p(90)=22.1s    p(95)=33.36s 
     http_reqs......................: 2893    81.504724/s
     iteration_duration.............: avg=5.65s    min=194.24ms med=2.26s   max=35s      p(90)=22.21s   p(95)=33.39s 
     iterations.....................: 2873    80.941263/s
     vus............................: 47      min=47      max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 7785     ✗ 0    
     data_received..................: 230 MB  6.3 MB/s
     data_sent......................: 3.1 MB  86 kB/s
     http_req_blocked...............: avg=8.41ms   min=1.61µs   med=3.92µs   max=104.29ms p(90)=42.1ms  p(95)=63.99ms 
     http_req_connecting............: avg=8.16ms   min=0s       med=0s       max=104.26ms p(90)=41.42ms p(95)=63.13ms 
     http_req_duration..............: avg=6.27s    min=13.63ms  med=3.14s    max=35.65s   p(90)=20.12s  p(95)=34.11s  
       { expected_response:true }...: avg=6.27s    min=13.63ms  med=3.14s    max=35.65s   p(90)=20.12s  p(95)=34.11s  
     http_req_failed................: 0.00%   ✓ 0        ✗ 2615 
     http_req_receiving.............: avg=273.54µs min=47.53µs  med=112.29µs max=41.48ms  p(90)=206.7µs p(95)=354.19µs
     http_req_sending...............: avg=3.25ms   min=9.08µs   med=21.9µs   max=68.89ms  p(90)=16.57ms p(95)=19.05ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s      p(95)=0s      
     http_req_waiting...............: avg=6.26s    min=13.52ms  med=3.14s    max=35.65s   p(90)=20.12s  p(95)=34.09s  
     http_reqs......................: 2615    72.12166/s
     iteration_duration.............: avg=6.34s    min=485.01ms med=3.17s    max=35.72s   p(90)=21.11s  p(95)=34.16s  
     iterations.....................: 2595    71.57006/s
     vus............................: 26      min=26     max=500
     vus_max........................: 500     min=500    max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 6516      ✗ 0    
     data_received..................: 192 MB  5.8 MB/s
     data_sent......................: 2.6 MB  78 kB/s
     http_req_blocked...............: avg=5.79ms   min=1.67µs   med=3.63µs  max=50.8ms  p(90)=27.26ms  p(95)=31.26ms
     http_req_connecting............: avg=5.71ms   min=0s       med=0s      max=47.74ms p(90)=26.85ms  p(95)=31.09ms
     http_req_duration..............: avg=7.19s    min=13.88ms  med=7.63s   max=13.82s  p(90)=9.28s    p(95)=11.9s  
       { expected_response:true }...: avg=7.19s    min=13.88ms  med=7.63s   max=13.82s  p(90)=9.28s    p(95)=11.9s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2192 
     http_req_receiving.............: avg=26.69ms  min=39.43µs  med=97.47µs max=1.08s   p(90)=315.94µs p(95)=2.61ms 
     http_req_sending...............: avg=746.89µs min=9.35µs   med=19.45µs max=11.36ms p(90)=2.06ms   p(95)=5.53ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s      max=0s      p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=7.16s    min=13.81ms  med=7.63s   max=13.82s  p(90)=9.27s    p(95)=11.89s 
     http_reqs......................: 2192    65.591073/s
     iteration_duration.............: avg=7.31s    min=588.23ms med=7.69s   max=13.85s  p(90)=9.35s    p(95)=11.96s 
     iterations.....................: 2172    64.992615/s
     vus............................: 171     min=171     max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Mar 27, 2025

Overview for: federation/ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was trying to reach 2000 concurrent VUs over 60s

Comparison

Comparison

Gateway duration(p95)⬇️ RPS Requests Durations Notes
cosmo 4525ms 172 12097 total, 0 failed avg: 1969ms, p95: 4525ms, max: 11735ms, med: 1839ms
grafbase 7838ms 155 10921 total, 0 failed avg: 2992ms, p95: 7839ms, max: 14196ms, med: 2433ms
apollo-router 8376ms 160 11248 total, 311 failed avg: 3116ms, p95: 8377ms, max: 23075ms, med: 2476ms ❌ 311 failed requests, 311 non-200 responses, 311 unexpected GraphQL errors
hive-gateway-bun 31233ms 86 7168 total, 0 failed avg: 12392ms, p95: 31233ms, max: 41937ms, med: 12056ms
mercurius 44364ms 43 4068 total, 0 failed avg: 25187ms, p95: 44364ms, max: 45889ms, med: 26710ms
hive-gateway 52195ms 84 7539 total, 0 failed avg: 12520ms, p95: 52196ms, max: 58240ms, med: 3380ms
apollo-server 60000ms 75 7032 total, 563 failed avg: 13279ms, p95: 60000ms, max: 60207ms, med: 2344ms ❌ 563 failed requests, 563 non-200 responses, 563 unexpected GraphQL errors
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 36231      ✗ 0     
     data_received..................: 1.1 GB  15 MB/s
     data_sent......................: 14 MB   205 kB/s
     http_req_blocked...............: avg=225.13ms min=1.57µs  med=4.65µs  max=9.15s  p(90)=872.38ms p(95)=1.64s   
     http_req_connecting............: avg=220.56ms min=0s      med=0s      max=6.5s   p(90)=869.21ms p(95)=1.64s   
     http_req_duration..............: avg=1.96s    min=3.38ms  med=1.83s   max=11.73s p(90)=3.71s    p(95)=4.52s   
       { expected_response:true }...: avg=1.96s    min=3.38ms  med=1.83s   max=11.73s p(90)=3.71s    p(95)=4.52s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 12097 
     http_req_receiving.............: avg=168.77ms min=32.42µs med=86.5µs  max=6.41s  p(90)=408.99ms p(95)=1.14s   
     http_req_sending...............: avg=102.1ms  min=8.28µs  med=25.33µs max=6.82s  p(90)=352.9ms  p(95)=638.71ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s     p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=1.69s    min=3.24ms  med=1.61s   max=7.33s  p(90)=3.27s    p(95)=3.88s   
     http_reqs......................: 12097   172.556925/s
     iteration_duration.............: avg=5.63s    min=15.1ms  med=4.82s   max=24.73s p(90)=11.73s   p(95)=13.72s  
     iterations.....................: 12077   172.271636/s
     vus............................: 4       min=4        max=1955
     vus_max........................: 2000    min=2000     max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 32703      ✗ 0     
     data_received..................: 960 MB  14 MB/s
     data_sent......................: 13 MB   185 kB/s
     http_req_blocked...............: avg=363.53ms min=1.68µs  med=4.56µs   max=12.29s p(90)=949.98ms p(95)=2.4s  
     http_req_connecting............: avg=358.9ms  min=0s      med=0s       max=12.29s p(90)=923.38ms p(95)=2.39s 
     http_req_duration..............: avg=2.99s    min=3.26ms  med=2.43s    max=14.19s p(90)=6.26s    p(95)=7.83s 
       { expected_response:true }...: avg=2.99s    min=3.26ms  med=2.43s    max=14.19s p(90)=6.26s    p(95)=7.83s 
     http_req_failed................: 0.00%   ✓ 0          ✗ 10921 
     http_req_receiving.............: avg=781.18ms min=34.58µs med=108.23µs max=12.01s p(90)=3.66s    p(95)=5.67s 
     http_req_sending...............: avg=245.24ms min=7.96µs  med=24.11µs  max=8.77s  p(90)=360.19ms p(95)=1.3s  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s       p(95)=0s    
     http_req_waiting...............: avg=1.96s    min=3.18ms  med=1.65s    max=12.44s p(90)=4.68s    p(95)=5.13s 
     http_reqs......................: 10921   155.817038/s
     iteration_duration.............: avg=6.67s    min=9.99ms  med=5.29s    max=34.41s p(90)=14.33s   p(95)=17.08s
     iterations.....................: 10901   155.531685/s
     vus............................: 73      min=64       max=2000
     vus_max........................: 2000    min=2000     max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✗ response code was 200
      ↳  97% — ✓ 10917 / ✗ 311
     ✗ no graphql errors
      ↳  97% — ✓ 10917 / ✗ 311
     ✓ valid response structure

     █ setup

     checks.........................: 98.13% ✓ 32751      ✗ 622   
     data_received..................: 960 MB 14 MB/s
     data_sent......................: 13 MB  190 kB/s
     http_req_blocked...............: avg=440.15ms min=1.69µs  med=4.69µs   max=15.65s p(90)=1.91s    p(95)=3.15s   
     http_req_connecting............: avg=426.79ms min=0s      med=0s       max=15.65s p(90)=1.88s    p(95)=3.12s   
     http_req_duration..............: avg=3.11s    min=7.14ms  med=2.47s    max=23.07s p(90)=6.38s    p(95)=8.37s   
       { expected_response:true }...: avg=3.13s    min=7.14ms  med=2.49s    max=23.07s p(90)=6.4s     p(95)=8.4s    
     http_req_failed................: 2.76%  ✓ 311        ✗ 10937 
     http_req_receiving.............: avg=579.73ms min=0s      med=102.27µs max=20.41s p(90)=1.69s    p(95)=3.88s   
     http_req_sending...............: avg=225.86ms min=8.1µs   med=26.64µs  max=15.11s p(90)=386.73ms p(95)=932.48ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=2.3s     min=7ms     med=2.07s    max=12.29s p(90)=4.94s    p(95)=5.63s   
     http_reqs......................: 11248  160.276927/s
     iteration_duration.............: avg=6.27s    min=15.37ms med=5.09s    max=36.84s p(90)=13.02s   p(95)=15.26s  
     iterations.....................: 11228  159.991939/s
     vus............................: 87     min=69       max=1920
     vus_max........................: 2000   min=2000     max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 21444     ✗ 0     
     data_received..................: 629 MB  7.6 MB/s
     data_sent......................: 8.5 MB  103 kB/s
     http_req_blocked...............: avg=5.14ms   min=1.94µs  med=4.62µs  max=305.83ms p(90)=1.1ms    p(95)=24.93ms 
     http_req_connecting............: avg=5.05ms   min=0s      med=0s      max=305.76ms p(90)=885.42µs p(95)=23.97ms 
     http_req_duration..............: avg=12.39s   min=17.81ms med=12.05s  max=41.93s   p(90)=26.68s   p(95)=31.23s  
       { expected_response:true }...: avg=12.39s   min=17.81ms med=12.05s  max=41.93s   p(90)=26.68s   p(95)=31.23s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 7168  
     http_req_receiving.............: avg=112.14ms min=38.73µs med=248.1µs max=8.6s     p(90)=4.66ms   p(95)=122.75ms
     http_req_sending...............: avg=2.72ms   min=9.28µs  med=28.6µs  max=364.82ms p(90)=302.11µs p(95)=14.42ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=12.27s   min=17.6ms  med=11.79s  max=39.04s   p(90)=26.68s   p(95)=31.22s  
     http_reqs......................: 7168    86.445115/s
     iteration_duration.............: avg=12.58s   min=77.19ms med=12.09s  max=42.07s   p(90)=26.9s    p(95)=31.58s  
     iterations.....................: 7148    86.203917/s
     vus............................: 107     min=0       max=1994
     vus_max........................: 2000    min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 12135     ✗ 0     
     data_received..................: 357 MB  3.8 MB/s
     data_sent......................: 5.2 MB  55 kB/s
     http_req_blocked...............: avg=232.84µs min=2.29µs  med=7.23µs   max=32.66ms p(90)=525.77µs p(95)=792.01µs
     http_req_connecting............: avg=192.19µs min=0s      med=0s       max=31.96ms p(90)=436.42µs p(95)=665.75µs
     http_req_duration..............: avg=25.18s   min=16.9ms  med=26.71s   max=45.88s  p(90)=42.9s    p(95)=44.36s  
       { expected_response:true }...: avg=25.18s   min=16.9ms  med=26.71s   max=45.88s  p(90)=42.9s    p(95)=44.36s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 4068  
     http_req_receiving.............: avg=6.42ms   min=43.78µs med=140.53µs max=1.03s   p(90)=448.13µs p(95)=1.14ms  
     http_req_sending...............: avg=64.98µs  min=10.65µs med=42.37µs  max=5.03ms  p(90)=86.75µs  p(95)=123.47µs
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=25.18s   min=16.75ms med=26.7s    max=45.88s  p(90)=42.77s   p(95)=44.36s  
     http_reqs......................: 4068    43.477805/s
     iteration_duration.............: avg=25.33s   min=92.87ms med=26.77s   max=45.93s  p(90)=43.21s   p(95)=44.43s  
     iterations.....................: 4041    43.189236/s
     vus............................: 202     min=50      max=2000
     vus_max........................: 2000    min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 22557     ✗ 0     
     data_received..................: 662 MB  7.5 MB/s
     data_sent......................: 8.9 MB  101 kB/s
     http_req_blocked...............: avg=1.23ms   min=2.06µs  med=4.54µs   max=109.79ms p(90)=555.42µs p(95)=3.34ms  
     http_req_connecting............: avg=1.2ms    min=0s      med=0s       max=109.71ms p(90)=458.11µs p(95)=3.2ms   
     http_req_duration..............: avg=12.51s   min=17.08ms med=3.37s    max=58.23s   p(90)=45.9s    p(95)=52.19s  
       { expected_response:true }...: avg=12.51s   min=17.08ms med=3.37s    max=58.23s   p(90)=45.9s    p(95)=52.19s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 7539  
     http_req_receiving.............: avg=948.57µs min=41.05µs med=110.89µs max=375.3ms  p(90)=948.74µs p(95)=2.67ms  
     http_req_sending...............: avg=528.18µs min=9.75µs  med=26.89µs  max=70.51ms  p(90)=78.63µs  p(95)=410.88µs
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=12.51s   min=16.93ms med=3.37s    max=58.23s   p(90)=45.87s   p(95)=52.19s  
     http_reqs......................: 7539    84.842012/s
     iteration_duration.............: avg=12.58s   min=99.84ms med=3.41s    max=58.36s   p(90)=45.97s   p(95)=52.48s  
     iterations.....................: 7519    84.616937/s
     vus............................: 17      min=17      max=2000
     vus_max........................: 2000    min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✗ response code was 200
      ↳  91% — ✓ 6449 / ✗ 563
     ✗ no graphql errors
      ↳  91% — ✓ 6449 / ✗ 563
     ✓ valid response structure

     █ setup

     checks.........................: 94.50% ✓ 19347     ✗ 1126  
     data_received..................: 569 MB 6.1 MB/s
     data_sent......................: 8.4 MB 91 kB/s
     http_req_blocked...............: avg=341.08µs min=1.41µs  med=3.43µs  max=75.52ms  p(90)=336.57µs p(95)=533.77µs
     http_req_connecting............: avg=311.34µs min=0s      med=0s      max=75.36ms  p(90)=267.06µs p(95)=419.27µs
     http_req_duration..............: avg=13.27s   min=13.64ms med=2.34s   max=1m0s     p(90)=57.86s   p(95)=1m0s    
       { expected_response:true }...: avg=9.21s    min=13.64ms med=2.27s   max=59.98s   p(90)=38.63s   p(95)=48.64s  
     http_req_failed................: 8.00%  ✓ 563       ✗ 6469  
     http_req_receiving.............: avg=212.04µs min=0s      med=109.7µs max=110.24ms p(90)=211.88µs p(95)=326.14µs
     http_req_sending...............: avg=131.6µs  min=8.67µs  med=16.92µs max=60.1ms   p(90)=62.38µs  p(95)=90.49µs 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=13.27s   min=13.53ms med=2.34s   max=1m0s     p(90)=57.86s   p(95)=1m0s    
     http_reqs......................: 7032   75.720773/s
     iteration_duration.............: avg=13.32s   min=68.77ms med=2.35s   max=1m0s     p(90)=57.92s   p(95)=1m0s    
     iterations.....................: 7012   75.505413/s
     vus............................: 28     min=28      max=2000
     vus_max........................: 2000   min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant