Skip to content

Conversation

renovate[bot]
Copy link
Contributor

@renovate renovate bot commented Sep 18, 2025

Coming soon: The Renovate bot (GitHub App) will be renamed to Mend. PRs from Renovate will soon appear from 'Mend'. Learn more here.

This PR contains the following updates:

Package Change Age Confidence
@types/node (source) 22.18.5 -> 22.18.6 age confidence

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.


  • If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

@renovate renovate bot added the dependencies Pull requests that update a dependency file label Sep 18, 2025
Copy link

💻 Website Preview

The latest changes are available as preview in: https://c0f67fdd.federation-gateway-benchmark.pages.dev

Copy link

Overview for: constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1840 110951 total, 0 failed avg: 27ms, p95: 47ms
grafbase 1587 95787 total, 0 failed avg: 31ms, p95: 54ms
cosmo 691 41777 total, 0 failed avg: 72ms, p95: 105ms
apollo-router 383 23284 total, 0 failed avg: 129ms, p95: 166ms
hive-gateway-bun 300 18379 total, 0 failed avg: 163ms, p95: 225ms
hive-gateway 299 18289 total, 0 failed avg: 164ms, p95: 227ms
apollo-gateway 113 6960 total, 0 failed avg: 432ms, p95: 510ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 332553      ✗ 0     
     data_received..................: 9.7 GB  161 MB/s
     data_sent......................: 129 MB  2.1 MB/s
     http_req_blocked...............: avg=5.02µs   min=1.1µs   med=2.46µs  max=9.15ms   p(90)=3.67µs   p(95)=4.69µs   p(99.9)=75.69µs 
     http_req_connecting............: avg=2.03µs   min=0s      med=0s      max=9.11ms   p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_duration..............: avg=26.84ms  min=1.87ms  med=24.51ms max=437.18ms p(90)=40.61ms  p(95)=47.12ms  p(99.9)=100.2ms 
       { expected_response:true }...: avg=26.84ms  min=1.87ms  med=24.51ms max=437.18ms p(90)=40.61ms  p(95)=47.12ms  p(99.9)=100.2ms 
     http_req_failed................: 0.00%   ✓ 0           ✗ 110951
     http_req_receiving.............: avg=109.54µs min=22.83µs med=42.42µs max=371.87ms p(90)=117.43µs p(95)=322.2µs  p(99.9)=8.97ms  
     http_req_sending...............: avg=82.5µs   min=4.97µs  med=9.94µs  max=389.94ms p(90)=30.91µs  p(95)=118.85µs p(99.9)=10.56ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=26.65ms  min=1.83ms  med=24.36ms max=425.9ms  p(90)=40.29ms  p(95)=46.79ms  p(99.9)=98.48ms 
     http_reqs......................: 110951  1840.647019/s
     iteration_duration.............: avg=27.05ms  min=4.99ms  med=24.7ms  max=450.24ms p(90)=40.81ms  p(95)=47.33ms  p(99.9)=101.52ms
     iterations.....................: 110851  1838.988046/s
     success_rate...................: 100.00% ✓ 110851      ✗ 0     
     vus............................: 50      min=50        max=50  
     vus_max........................: 50      min=50        max=50  

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 287061      ✗ 0    
     data_received..................: 8.4 GB  140 MB/s
     data_sent......................: 111 MB  1.8 MB/s
     http_req_blocked...............: avg=6.93µs   min=1.22µs  med=3.24µs  max=10.82ms  p(90)=4.74µs   p(95)=6.08µs   p(99.9)=125.49µs
     http_req_connecting............: avg=2.89µs   min=0s      med=0s      max=10.79ms  p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_duration..............: avg=31.07ms  min=2.6ms   med=28.16ms max=480.99ms p(90)=46.82ms  p(95)=53.72ms  p(99.9)=93.26ms 
       { expected_response:true }...: avg=31.07ms  min=2.6ms   med=28.16ms max=480.99ms p(90)=46.82ms  p(95)=53.72ms  p(99.9)=93.26ms 
     http_req_failed................: 0.00%   ✓ 0           ✗ 95787
     http_req_receiving.............: avg=147.23µs min=27.21µs med=51.31µs max=50.61ms  p(90)=172.97µs p(95)=417.58µs p(99.9)=13.95ms 
     http_req_sending...............: avg=103.18µs min=5.74µs  med=12.14µs max=313.79ms p(90)=42.84µs  p(95)=144.55µs p(99.9)=14.16ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=30.82ms  min=2.55ms  med=27.99ms max=479ms    p(90)=46.35ms  p(95)=53.23ms  p(99.9)=91.61ms 
     http_reqs......................: 95787   1587.654096/s
     iteration_duration.............: avg=31.34ms  min=7.15ms  med=28.39ms max=510.17ms p(90)=47.07ms  p(95)=53.98ms  p(99.9)=93.93ms 
     iterations.....................: 95687   1585.996612/s
     success_rate...................: 100.00% ✓ 95687       ✗ 0    
     vus............................: 50      min=50        max=50 
     vus_max........................: 50      min=50        max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 125031     ✗ 0    
     data_received..................: 3.7 GB  61 MB/s
     data_sent......................: 49 MB   804 kB/s
     http_req_blocked...............: avg=9.15µs   min=1.21µs  med=2.69µs  max=9.66ms   p(90)=3.78µs   p(95)=4.42µs   p(99.9)=1.82ms  
     http_req_connecting............: avg=5.88µs   min=0s      med=0s      max=9.61ms   p(90)=0s       p(95)=0s       p(99.9)=1.8ms   
     http_req_duration..............: avg=71.6ms   min=2.88ms  med=70.41ms max=517.53ms p(90)=97.26ms  p(95)=105.22ms p(99.9)=297.33ms
       { expected_response:true }...: avg=71.6ms   min=2.88ms  med=70.41ms max=517.53ms p(90)=97.26ms  p(95)=105.22ms p(99.9)=297.33ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 41777
     http_req_receiving.............: avg=177.54µs min=27.92µs med=67.92µs max=42.22ms  p(90)=146.45µs p(95)=364.14µs p(99.9)=17.71ms 
     http_req_sending...............: avg=66.4µs   min=5.67µs  med=10.8µs  max=421.9ms  p(90)=28.45µs  p(95)=116.33µs p(99.9)=2.6ms   
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=71.35ms  min=2.81ms  med=70.19ms max=516.56ms p(90)=97.02ms  p(95)=105.01ms p(99.9)=281.94ms
     http_reqs......................: 41777   691.53663/s
     iteration_duration.............: avg=71.99ms  min=4.32ms  med=70.68ms max=527.79ms p(90)=97.5ms   p(95)=105.46ms p(99.9)=300.34ms
     iterations.....................: 41677   689.881325/s
     success_rate...................: 100.00% ✓ 41677      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 69552      ✗ 0    
     data_received..................: 2.0 GB  34 MB/s
     data_sent......................: 27 MB   446 kB/s
     http_req_blocked...............: avg=13.38µs  min=1.9µs   med=2.98µs   max=9.02ms   p(90)=4.19µs   p(95)=4.92µs   p(99.9)=4.94ms  
     http_req_connecting............: avg=9.87µs   min=0s      med=0s       max=8.99ms   p(90)=0s       p(95)=0s       p(99.9)=4.92ms  
     http_req_duration..............: avg=128.73ms min=5.83ms  med=128.08ms max=566.1ms  p(90)=157.29ms p(95)=166.11ms p(99.9)=390.01ms
       { expected_response:true }...: avg=128.73ms min=5.83ms  med=128.08ms max=566.1ms  p(90)=157.29ms p(95)=166.11ms p(99.9)=390.01ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 23284
     http_req_receiving.............: avg=73.66µs  min=32.11µs med=52.1µs   max=3.7ms    p(90)=98.28µs  p(95)=123.37µs p(99.9)=1.23ms  
     http_req_sending...............: avg=85.05µs  min=7.34µs  med=11.72µs  max=356.89ms p(90)=18.39µs  p(95)=32.22µs  p(99.9)=1.82ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=128.57ms min=5.78ms  med=127.99ms max=564.53ms p(90)=157.17ms p(95)=165.91ms p(99.9)=389.15ms
     http_reqs......................: 23284   383.063648/s
     iteration_duration.............: avg=129.56ms min=23.73ms med=128.42ms max=597.22ms p(90)=157.55ms p(95)=166.46ms p(99.9)=417.73ms
     iterations.....................: 23184   381.418468/s
     success_rate...................: 100.00% ✓ 23184      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 54837      ✗ 0    
     data_received..................: 1.6 GB  26 MB/s
     data_sent......................: 21 MB   350 kB/s
     http_req_blocked...............: avg=42.65µs  min=1.26µs  med=2.85µs   max=19.27ms  p(90)=4.77µs   p(95)=5.98µs   p(99.9)=15.23ms 
     http_req_connecting............: avg=38.46µs  min=0s      med=0s       max=19.23ms  p(90)=0s       p(95)=0s       p(99.9)=15.18ms 
     http_req_duration..............: avg=163.18ms min=7.67ms  med=150.7ms  max=598.83ms p(90)=183.86ms p(95)=224.63ms p(99.9)=502.24ms
       { expected_response:true }...: avg=163.18ms min=7.67ms  med=150.7ms  max=598.83ms p(90)=183.86ms p(95)=224.63ms p(99.9)=502.24ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 18379
     http_req_receiving.............: avg=104.59µs min=27.2µs  med=50.95µs  max=162.98ms p(90)=113.25µs p(95)=195.66µs p(99.9)=3.14ms  
     http_req_sending...............: avg=82.33µs  min=5.83µs  med=11.56µs  max=364.06ms p(90)=33.25µs  p(95)=125.67µs p(99.9)=5.31ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=163ms    min=7.59ms  med=150.54ms max=594.43ms p(90)=183.67ms p(95)=224.41ms p(99.9)=501.73ms
     http_reqs......................: 18379   300.939111/s
     iteration_duration.............: avg=164.42ms min=42.98ms med=151.06ms max=660.08ms p(90)=184.16ms p(95)=226.37ms p(99.9)=505.3ms 
     iterations.....................: 18279   299.301704/s
     success_rate...................: 100.00% ✓ 18279      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 54567      ✗ 0    
     data_received..................: 1.6 GB  26 MB/s
     data_sent......................: 21 MB   349 kB/s
     http_req_blocked...............: avg=35.91µs  min=1.27µs  med=2.83µs   max=18.71ms  p(90)=4.83µs   p(95)=6.05µs   p(99.9)=13.91ms 
     http_req_connecting............: avg=30.98µs  min=0s      med=0s       max=16.75ms  p(90)=0s       p(95)=0s       p(99.9)=13.7ms  
     http_req_duration..............: avg=163.84ms min=6.95ms  med=150.66ms max=960.08ms p(90)=182.27ms p(95)=227.4ms  p(99.9)=937.61ms
       { expected_response:true }...: avg=163.84ms min=6.95ms  med=150.66ms max=960.08ms p(90)=182.27ms p(95)=227.4ms  p(99.9)=937.61ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 18289
     http_req_receiving.............: avg=96.32µs  min=27.37µs med=49.24µs  max=13.02ms  p(90)=111.28µs p(95)=253.6µs  p(99.9)=3.51ms  
     http_req_sending...............: avg=124.01µs min=5.69µs  med=11.48µs  max=241.02ms p(90)=32.93µs  p(95)=130.59µs p(99.9)=8.35ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=163.62ms min=6.89ms  med=150.54ms max=957.71ms p(90)=182.05ms p(95)=226.9ms  p(99.9)=937.3ms 
     http_reqs......................: 18289   299.700438/s
     iteration_duration.............: avg=165.06ms min=21.35ms med=151.04ms max=960.31ms p(90)=182.75ms p(95)=230.72ms p(99.9)=938.47ms
     iterations.....................: 18189   298.061745/s
     success_rate...................: 100.00% ✓ 18189      ✗ 0    
     vus............................: 39      min=39       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 20580      ✗ 0   
     data_received..................: 611 MB  10 MB/s
     data_sent......................: 8.1 MB  132 kB/s
     http_req_blocked...............: avg=104.85µs min=1.42µs   med=3.47µs   max=22.57ms  p(90)=5.49µs   p(95)=6.24µs   p(99.9)=19.34ms 
     http_req_connecting............: avg=98.68µs  min=0s       med=0s       max=22.34ms  p(90)=0s       p(95)=0s       p(99.9)=19.27ms 
     http_req_duration..............: avg=431.76ms min=7.87ms   med=431.59ms max=742.78ms p(90)=490.41ms p(95)=510.47ms p(99.9)=695.45ms
       { expected_response:true }...: avg=431.76ms min=7.87ms   med=431.59ms max=742.78ms p(90)=490.41ms p(95)=510.47ms p(99.9)=695.45ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 6960
     http_req_receiving.............: avg=76.5µs   min=27.11µs  med=63.57µs  max=29.7ms   p(90)=106.2µs  p(95)=123.72µs p(99.9)=381.95µs
     http_req_sending...............: avg=61.41µs  min=6.41µs   med=14.84µs  max=156.82ms p(90)=22.69µs  p(95)=28.21µs  p(99.9)=4.47ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=431.63ms min=7.77ms   med=431.5ms  max=741.86ms p(90)=490.25ms p(95)=510.34ms p(99.9)=694.63ms
     http_reqs......................: 6960    113.727809/s
     iteration_duration.............: avg=438.33ms min=215.27ms med=432.31ms max=767.06ms p(90)=491.33ms p(95)=511.19ms p(99.9)=719.41ms
     iterations.....................: 6860    112.093789/s
     success_rate...................: 100.00% ✓ 6860       ✗ 0   
     vus............................: 31      min=31       max=50
     vus_max........................: 50      min=50       max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

Overview for: constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 173 14039 total, 0 failed avg: 215ms, p95: 226ms
hive-router 170 13791 total, 0 failed avg: 219ms, p95: 229ms
cosmo 166 13518 total, 0 failed avg: 223ms, p95: 246ms
hive-gateway 166 12740 total, 0 failed avg: 237ms, p95: 261ms
hive-gateway-bun 157 12059 total, 0 failed avg: 250ms, p95: 274ms
apollo-router 136 11132 total, 0 failed avg: 271ms, p95: 312ms
apollo-gateway 110 9064 total, 0 failed avg: 334ms, p95: 375ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41817      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   202 kB/s
     http_req_blocked...............: avg=42.71µs  min=1.14µs   med=1.93µs   max=15.05ms  p(90)=3.37µs   p(95)=5.22µs   p(99.9)=12.93ms 
     http_req_connecting............: avg=40.01µs  min=0s       med=0s       max=15.02ms  p(90)=0s       p(95)=0s       p(99.9)=12.85ms 
     http_req_duration..............: avg=215.07ms min=156.86ms med=214.38ms max=580.26ms p(90)=222.99ms p(95)=225.54ms p(99.9)=493.03ms
       { expected_response:true }...: avg=215.07ms min=156.86ms med=214.38ms max=580.26ms p(90)=222.99ms p(95)=225.54ms p(99.9)=493.03ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 14039
     http_req_receiving.............: avg=82.48µs  min=25.7µs   med=45.66µs  max=18.74ms  p(90)=93.02µs  p(95)=270.16µs p(99.9)=4.4ms   
     http_req_sending...............: avg=144.98µs min=5.41µs   med=8.55µs   max=355.5ms  p(90)=29.36µs  p(95)=94.03µs  p(99.9)=7.91ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=214.84ms min=156.81ms med=214.26ms max=577.51ms p(90)=222.86ms p(95)=225.35ms p(99.9)=471.13ms
     http_reqs......................: 14039   173.548015/s
     iteration_duration.............: avg=215.34ms min=157.03ms med=214.6ms  max=593.09ms p(90)=223.17ms p(95)=225.71ms p(99.9)=503.66ms
     iterations.....................: 13939   172.31183/s
     success_rate...................: 100.00% ✓ 13939      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41073      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   198 kB/s
     http_req_blocked...............: avg=18.68µs  min=1.21µs   med=2.1µs    max=8.94ms   p(90)=3.32µs   p(95)=4.66µs   p(99.9)=6.43ms  
     http_req_connecting............: avg=16.01µs  min=0s       med=0s       max=8.91ms   p(90)=0s       p(95)=0s       p(99.9)=6.41ms  
     http_req_duration..............: avg=219.44ms min=138.67ms med=218.55ms max=602.76ms p(90)=226.51ms p(95)=229.14ms p(99.9)=512.27ms
       { expected_response:true }...: avg=219.44ms min=138.67ms med=218.55ms max=602.76ms p(90)=226.51ms p(95)=229.14ms p(99.9)=512.27ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13791
     http_req_receiving.............: avg=72.94µs  min=23.63µs  med=41.81µs  max=9.13ms   p(90)=85.75µs  p(95)=255.35µs p(99.9)=1.86ms  
     http_req_sending...............: avg=147.44µs min=5.55µs   med=8.65µs   max=370.74ms p(90)=29.09µs  p(95)=94.9µs   p(99.9)=6.95ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=219.22ms min=138.64ms med=218.46ms max=601.91ms p(90)=226.37ms p(95)=228.98ms p(99.9)=494.81ms
     http_reqs......................: 13791   170.38269/s
     iteration_duration.............: avg=219.72ms min=138.78ms med=218.76ms max=611.8ms  p(90)=226.67ms p(95)=229.31ms p(99.9)=521.62ms
     iterations.....................: 13691   169.147227/s
     success_rate...................: 100.00% ✓ 13691      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40254      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   194 kB/s
     http_req_blocked...............: avg=21.25µs  min=1.34µs   med=2.69µs   max=10.25ms  p(90)=4.05µs   p(95)=5.04µs   p(99.9)=6.95ms  
     http_req_connecting............: avg=17.7µs   min=0s       med=0s       max=10.22ms  p(90)=0s       p(95)=0s       p(99.9)=6.92ms  
     http_req_duration..............: avg=223.49ms min=125.7ms  med=222.12ms max=644.17ms p(90)=240.23ms p(95)=246.09ms p(99.9)=528.41ms
       { expected_response:true }...: avg=223.49ms min=125.7ms  med=222.12ms max=644.17ms p(90)=240.23ms p(95)=246.09ms p(99.9)=528.41ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13518
     http_req_receiving.............: avg=459.94µs min=31.18µs  med=67.58µs  max=35.48ms  p(90)=377.69µs p(95)=843.41µs p(99.9)=25.35ms 
     http_req_sending...............: avg=121.15µs min=6.03µs   med=11µs     max=313.03ms p(90)=31.54µs  p(95)=124.08µs p(99.9)=4.07ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=222.91ms min=121.27ms med=221.7ms  max=643.43ms p(90)=239.7ms  p(95)=245.54ms p(99.9)=527.22ms
     http_reqs......................: 13518   166.52755/s
     iteration_duration.............: avg=223.89ms min=125.88ms med=222.45ms max=662.07ms p(90)=240.6ms  p(95)=246.35ms p(99.9)=547.53ms
     iterations.....................: 13418   165.295655/s
     success_rate...................: 100.00% ✓ 13418      ✗ 0    
     vus............................: 22      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 37920      ✗ 0    
     data_received..................: 1.1 GB  15 MB/s
     data_sent......................: 15 MB   193 kB/s
     http_req_blocked...............: avg=23.31µs  min=1.16µs   med=2.56µs   max=10.21ms  p(90)=4.2µs    p(95)=5.41µs   p(99.9)=7.78ms  
     http_req_connecting............: avg=19.7µs   min=0s       med=0s       max=10.16ms  p(90)=0s       p(95)=0s       p(99.9)=7.76ms  
     http_req_duration..............: avg=236.93ms min=160.58ms med=229.87ms max=723.16ms p(90)=250.6ms  p(95)=261.17ms p(99.9)=656.84ms
       { expected_response:true }...: avg=236.93ms min=160.58ms med=229.87ms max=723.16ms p(90)=250.6ms  p(95)=261.17ms p(99.9)=656.84ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12740
     http_req_receiving.............: avg=89.59µs  min=26.12µs  med=45.32µs  max=58.64ms  p(90)=101.79µs p(95)=180.29µs p(99.9)=3.43ms  
     http_req_sending...............: avg=79.54µs  min=5.46µs   med=10.82µs  max=136.6ms  p(90)=32.62µs  p(95)=121.02µs p(99.9)=4.4ms   
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=236.76ms min=160.45ms med=229.75ms max=722.03ms p(90)=250.44ms p(95)=260.96ms p(99.9)=656.43ms
     http_reqs......................: 12740   166.259223/s
     iteration_duration.............: avg=237.86ms min=161.74ms med=230.13ms max=743.41ms p(90)=250.91ms p(95)=261.83ms p(99.9)=659.84ms
     iterations.....................: 12640   164.954205/s
     success_rate...................: 100.00% ✓ 12640      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 35877      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 14 MB   183 kB/s
     http_req_blocked...............: avg=28.86µs  min=1.15µs   med=2.66µs   max=11.72ms  p(90)=4.57µs   p(95)=6.24µs   p(99.9)=9ms   
     http_req_connecting............: avg=24.67µs  min=0s       med=0s       max=11.69ms  p(90)=0s       p(95)=0s       p(99.9)=8.97ms
     http_req_duration..............: avg=250.32ms min=161.18ms med=240.42ms max=2.02s    p(90)=261.85ms p(95)=274.02ms p(99.9)=2.01s 
       { expected_response:true }...: avg=250.32ms min=161.18ms med=240.42ms max=2.02s    p(90)=261.85ms p(95)=274.02ms p(99.9)=2.01s 
     http_req_failed................: 0.00%   ✓ 0          ✗ 12059
     http_req_receiving.............: avg=95.68µs  min=26.27µs  med=48.31µs  max=11.29ms  p(90)=117.13µs p(95)=273.57µs p(99.9)=4.05ms
     http_req_sending...............: avg=97.23µs  min=5.75µs   med=11.07µs  max=322.57ms p(90)=34µs     p(95)=134.14µs p(99.9)=5.39ms
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s    
     http_req_waiting...............: avg=250.13ms min=161.08ms med=240.27ms max=2.02s    p(90)=261.64ms p(95)=273.78ms p(99.9)=2.01s 
     http_reqs......................: 12059   157.427917/s
     iteration_duration.............: avg=251.42ms min=189.82ms med=240.82ms max=2.02s    p(90)=262.18ms p(95)=274.33ms p(99.9)=2.01s 
     iterations.....................: 11959   156.122437/s
     success_rate...................: 100.00% ✓ 11959      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 33096      ✗ 0    
     data_received..................: 977 MB  12 MB/s
     data_sent......................: 13 MB   159 kB/s
     http_req_blocked...............: avg=25.24µs  min=1.35µs   med=2.76µs   max=9.4ms    p(90)=4.05µs   p(95)=5.1µs    p(99.9)=7.3ms   
     http_req_connecting............: avg=21.12µs  min=0s       med=0s       max=9.36ms   p(90)=0s       p(95)=0s       p(99.9)=7.28ms  
     http_req_duration..............: avg=271.43ms min=163.68ms med=272.73ms max=687.83ms p(90)=304.09ms p(95)=311.83ms p(99.9)=592.05ms
       { expected_response:true }...: avg=271.43ms min=163.68ms med=272.73ms max=687.83ms p(90)=304.09ms p(95)=311.83ms p(99.9)=592.05ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11132
     http_req_receiving.............: avg=118.58µs min=31.37µs  med=52.2µs   max=10.15ms  p(90)=152.14µs p(95)=430.89µs p(99.9)=5.12ms  
     http_req_sending...............: avg=91.03µs  min=6.14µs   med=11.08µs  max=311.2ms  p(90)=36.69µs  p(95)=135.36µs p(99.9)=3.55ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=271.22ms min=163.62ms med=272.55ms max=687.06ms p(90)=303.82ms p(95)=311.7ms  p(99.9)=590.58ms
     http_reqs......................: 11132   136.913982/s
     iteration_duration.............: avg=272.32ms min=163.86ms med=273.27ms max=710.83ms p(90)=304.4ms  p(95)=312.24ms p(99.9)=641.32ms
     iterations.....................: 11032   135.684069/s
     success_rate...................: 100.00% ✓ 11032      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 26892      ✗ 0   
     data_received..................: 796 MB  9.7 MB/s
     data_sent......................: 11 MB   129 kB/s
     http_req_blocked...............: avg=36.26µs  min=1.95µs   med=5.82µs   max=10.52ms  p(90)=7.81µs   p(95)=9.76µs   p(99.9)=8.45ms  
     http_req_connecting............: avg=28.28µs  min=0s       med=0s       max=10.48ms  p(90)=0s       p(95)=0s       p(99.9)=8.42ms  
     http_req_duration..............: avg=333.59ms min=213.12ms med=330.97ms max=847.49ms p(90)=362.54ms p(95)=375.14ms p(99.9)=741.22ms
       { expected_response:true }...: avg=333.59ms min=213.12ms med=330.97ms max=847.49ms p(90)=362.54ms p(95)=375.14ms p(99.9)=741.22ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 9064
     http_req_receiving.............: avg=157.27µs min=35.41µs  med=106.16µs max=274.5ms  p(90)=169.48µs p(95)=206.16µs p(99.9)=2.8ms   
     http_req_sending...............: avg=165.46µs min=7.55µs   med=23.01µs  max=357.87ms p(90)=42.55µs  p(95)=58.97µs  p(99.9)=5.72ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=333.26ms min=213ms    med=330.76ms max=839.09ms p(90)=362.26ms p(95)=374.66ms p(99.9)=731.05ms
     http_reqs......................: 9064    110.789331/s
     iteration_duration.............: avg=335.4ms  min=229.75ms med=331.68ms max=875.81ms p(90)=363.15ms p(95)=375.66ms p(99.9)=765.74ms
     iterations.....................: 8964    109.567031/s
     success_rate...................: 100.00% ✓ 8964       ✗ 0   
     vus............................: 50      min=0        max=50
     vus_max........................: 50      min=50       max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

Overview for: ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 500 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1988 123774 total, 0 failed avg: 113ms, p95: 276ms
grafbase 1647 104274 total, 0 failed avg: 134ms, p95: 314ms
cosmo 644 41348 total, 0 failed avg: 340ms, p95: 742ms
apollo-router 394 26420 total, 0 failed avg: 534ms, p95: 1192ms ❌ 20 unexpected GraphQL errors
hive-gateway 270 18885 total, 0 failed avg: 743ms, p95: 1549ms
hive-gateway-bun 268 18784 total, 0 failed avg: 747ms, p95: 1644ms
apollo-gateway 159 10907 total, 0 failed avg: 1199ms, p95: 2530ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 368322      ✗ 0     
     data_received..................: 11 GB   174 MB/s
     data_sent......................: 144 MB  2.3 MB/s
     http_req_blocked...............: avg=365.66µs min=1.14µs  med=2.45µs   max=313.07ms p(90)=3.87µs   p(95)=4.61µs   p(99.9)=139.11ms
     http_req_connecting............: avg=361.92µs min=0s      med=0s       max=313.04ms p(90)=0s       p(95)=0s       p(99.9)=138.16ms
     http_req_duration..............: avg=112.56ms min=1.82ms  med=99.88ms  max=420.43ms p(90)=232ms    p(95)=275.74ms p(99.9)=367.31ms
       { expected_response:true }...: avg=112.56ms min=1.82ms  med=99.88ms  max=420.43ms p(90)=232ms    p(95)=275.74ms p(99.9)=367.31ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 123774
     http_req_receiving.............: avg=444.05µs min=23.32µs med=40.92µs  max=144.39ms p(90)=161.01µs p(95)=383.09µs p(99.9)=65.17ms 
     http_req_sending...............: avg=346.02µs min=5.18µs  med=9.99µs   max=138.09ms p(90)=27.86µs  p(95)=124.6µs  p(99.9)=64.46ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=111.77ms min=1.76ms  med=99.2ms   max=398.57ms p(90)=230.11ms p(95)=274.21ms p(99.9)=363.95ms
     http_reqs......................: 123774  1988.204321/s
     iteration_duration.............: avg=114.08ms min=1.98ms  med=101.23ms max=784.37ms p(90)=233.85ms p(95)=277.76ms p(99.9)=381.59ms
     iterations.....................: 122774  1972.141138/s
     success_rate...................: 100.00% ✓ 122774      ✗ 0     
     vus............................: 72      min=0         max=495 
     vus_max........................: 500     min=500       max=500 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 309822      ✗ 0     
     data_received..................: 9.2 GB  145 MB/s
     data_sent......................: 121 MB  1.9 MB/s
     http_req_blocked...............: avg=537.2µs  min=1.17µs  med=2.93µs   max=373.17ms p(90)=4.27µs   p(95)=5.28µs   p(99.9)=183.48ms
     http_req_connecting............: avg=532.89µs min=0s      med=0s       max=373.14ms p(90)=0s       p(95)=0s       p(99.9)=183.43ms
     http_req_duration..............: avg=133.52ms min=2.55ms  med=122.76ms max=480.64ms p(90)=265.8ms  p(95)=314.22ms p(99.9)=414.86ms
       { expected_response:true }...: avg=133.52ms min=2.55ms  med=122.76ms max=480.64ms p(90)=265.8ms  p(95)=314.22ms p(99.9)=414.86ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 104274
     http_req_receiving.............: avg=564.48µs min=24.67µs med=47.29µs  max=131.16ms p(90)=193.97µs p(95)=425.59µs p(99.9)=80.29ms 
     http_req_sending...............: avg=467µs    min=5.3µs   med=11.77µs  max=128.24ms p(90)=33.78µs  p(95)=136.82µs p(99.9)=75.35ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=132.49ms min=2.5ms   med=121.82ms max=469.81ms p(90)=262.91ms p(95)=312.19ms p(99.9)=409.7ms 
     http_reqs......................: 104274  1647.016154/s
     iteration_duration.............: avg=135.66ms min=2.74ms  med=124.55ms max=812.17ms p(90)=268.71ms p(95)=317.13ms p(99.9)=460.45ms
     iterations.....................: 103274  1631.221074/s
     success_rate...................: 100.00% ✓ 103274      ✗ 0     
     vus............................: 78      min=0         max=493 
     vus_max........................: 500     min=500       max=500 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 121044     ✗ 0    
     data_received..................: 3.6 GB  57 MB/s
     data_sent......................: 48 MB   751 kB/s
     http_req_blocked...............: avg=107.73µs min=1.47µs  med=3.35µs   max=179.29ms p(90)=5.45µs   p(95)=7.49µs   p(99.9)=34.12ms
     http_req_connecting............: avg=102.16µs min=0s      med=0s       max=179.23ms p(90)=0s       p(95)=0s       p(99.9)=34.05ms
     http_req_duration..............: avg=339.84ms min=3.03ms  med=321.56ms max=1.38s    p(90)=660.89ms p(95)=741.67ms p(99.9)=1.15s  
       { expected_response:true }...: avg=339.84ms min=3.03ms  med=321.56ms max=1.38s    p(90)=660.89ms p(95)=741.67ms p(99.9)=1.15s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 41348
     http_req_receiving.............: avg=642.56µs min=30.89µs med=70.42µs  max=254.95ms p(90)=255.59µs p(95)=529.1µs  p(99.9)=85.32ms
     http_req_sending...............: avg=146.74µs min=6.37µs  med=12.45µs  max=117.02ms p(90)=35.44µs  p(95)=138.71µs p(99.9)=28.99ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=339.05ms min=2.93ms  med=320.48ms max=1.38s    p(90)=659.84ms p(95)=739.74ms p(99.9)=1.15s  
     http_reqs......................: 41348   644.624455/s
     iteration_duration.............: avg=348.76ms min=3.45ms  med=330.53ms max=1.38s    p(90)=664.45ms p(95)=744.85ms p(99.9)=1.15s  
     iterations.....................: 40348   629.034234/s
     success_rate...................: 100.00% ✓ 40348      ✗ 0    
     vus............................: 68      min=0        max=496
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  99% — ✓ 25400 / ✗ 20
     ✓ valid response structure

     checks.........................: 99.97% ✓ 76240      ✗ 20   
     data_received..................: 2.3 GB 35 MB/s
     data_sent......................: 31 MB  459 kB/s
     http_req_blocked...............: avg=77.01µs  min=1.77µs  med=3.13µs   max=206.64ms p(90)=4.82µs  p(95)=6.77µs   p(99.9)=16.07ms
     http_req_connecting............: avg=67.21µs  min=0s      med=0s       max=206.54ms p(90)=0s      p(95)=0s       p(99.9)=15.38ms
     http_req_duration..............: avg=534.04ms min=6.15ms  med=504.55ms max=1.9s     p(90)=1.07s   p(95)=1.19s    p(99.9)=1.8s   
       { expected_response:true }...: avg=534.04ms min=6.15ms  med=504.55ms max=1.9s     p(90)=1.07s   p(95)=1.19s    p(99.9)=1.8s   
     http_req_failed................: 0.00%  ✓ 0          ✗ 26420
     http_req_receiving.............: avg=116.25µs min=29.23µs med=52.12µs  max=141.11ms p(90)=99.04µs p(95)=156.55µs p(99.9)=6.44ms 
     http_req_sending...............: avg=103.32µs min=7.47µs  med=11.82µs  max=135.09ms p(90)=26.56µs p(95)=82.29µs  p(99.9)=17.1ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=533.82ms min=6.1ms   med=504.48ms max=1.9s     p(90)=1.07s   p(95)=1.19s    p(99.9)=1.78s  
     http_reqs......................: 26420  394.002545/s
     iteration_duration.............: avg=555.45ms min=6.39ms  med=528.6ms  max=1.9s     p(90)=1.08s   p(95)=1.19s    p(99.9)=1.8s   
     iterations.....................: 25420  379.089504/s
     success_rate...................: 99.92% ✓ 25400      ✗ 20   
     vus............................: 68     min=0        max=498
     vus_max........................: 500    min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 53654      ✗ 0    
     data_received..................: 1.7 GB  24 MB/s
     data_sent......................: 22 MB   317 kB/s
     http_req_blocked...............: avg=106.45µs min=1.3µs   med=2.77µs   max=104.04ms p(90)=4.7µs   p(95)=7.74µs   p(99.9)=29.53ms
     http_req_connecting............: avg=100.48µs min=0s      med=0s       max=103.98ms p(90)=0s      p(95)=0s       p(99.9)=29.47ms
     http_req_duration..............: avg=743.35ms min=7.07ms  med=695.09ms max=4.79s    p(90)=1.44s   p(95)=1.54s    p(99.9)=4.03s  
       { expected_response:true }...: avg=743.35ms min=7.07ms  med=695.09ms max=4.79s    p(90)=1.44s   p(95)=1.54s    p(99.9)=4.03s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 18885
     http_req_receiving.............: avg=165.1µs  min=27.11µs med=43.94µs  max=82.09ms  p(90)=91.23µs p(95)=241.89µs p(99.9)=22.87ms
     http_req_sending...............: avg=163.23µs min=6µs     med=10.81µs  max=85.27ms  p(90)=30.31µs p(95)=117.96µs p(99.9)=32.15ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=743.02ms min=7.02ms  med=694.94ms max=4.79s    p(90)=1.44s   p(95)=1.54s    p(99.9)=4.03s  
     http_reqs......................: 18885   270.636763/s
     iteration_duration.............: avg=784.95ms min=7.79ms  med=754.92ms max=4.77s    p(90)=1.45s   p(95)=1.56s    p(99.9)=4.04s  
     iterations.....................: 17884   256.291653/s
     success_rate...................: 100.00% ✓ 17884      ✗ 0    
     vus............................: 102     min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 53352      ✗ 0    
     data_received..................: 1.6 GB  24 MB/s
     data_sent......................: 22 MB   315 kB/s
     http_req_blocked...............: avg=100.91µs min=1.23µs  med=2.83µs   max=105.13ms p(90)=4.83µs  p(95)=7.27µs   p(99.9)=26.96ms
     http_req_connecting............: avg=95.43µs  min=0s      med=0s       max=104.98ms p(90)=0s      p(95)=0s       p(99.9)=26.87ms
     http_req_duration..............: avg=747.19ms min=7.2ms   med=690.9ms  max=4.82s    p(90)=1.48s   p(95)=1.64s    p(99.9)=4.12s  
       { expected_response:true }...: avg=747.19ms min=7.2ms   med=690.9ms  max=4.82s    p(90)=1.48s   p(95)=1.64s    p(99.9)=4.12s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 18784
     http_req_receiving.............: avg=158.74µs min=26.39µs med=44.36µs  max=80.43ms  p(90)=92.63µs p(95)=156.45µs p(99.9)=25.86ms
     http_req_sending...............: avg=141.21µs min=5.61µs  med=11.03µs  max=100.01ms p(90)=30.4µs  p(95)=111.05µs p(99.9)=21.98ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=746.89ms min=7.15ms  med=690.3ms  max=4.8s     p(90)=1.48s   p(95)=1.64s    p(99.9)=4.12s  
     http_reqs......................: 18784   268.628916/s
     iteration_duration.............: avg=789.43ms min=8.74ms  med=746.23ms max=4.85s    p(90)=1.49s   p(95)=1.65s    p(99.9)=4.15s  
     iterations.....................: 17784   254.327973/s
     success_rate...................: 100.00% ✓ 17784      ✗ 0    
     vus............................: 60      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 29721      ✗ 0    
     data_received..................: 958 MB  14 MB/s
     data_sent......................: 13 MB   190 kB/s
     http_req_blocked...............: avg=34.77µs min=1.33µs  med=3.26µs  max=21.77ms p(90)=5.39µs  p(95)=10.19µs  p(99.9)=8.81ms
     http_req_connecting............: avg=28.74µs min=0s      med=0s      max=21.71ms p(90)=0s      p(95)=0s       p(99.9)=8.76ms
     http_req_duration..............: avg=1.19s   min=7.32ms  med=1.15s   max=15.72s  p(90)=2.14s   p(95)=2.52s    p(99.9)=14.4s 
       { expected_response:true }...: avg=1.19s   min=7.32ms  med=1.15s   max=15.72s  p(90)=2.14s   p(95)=2.52s    p(99.9)=14.4s 
     http_req_failed................: 0.00%   ✓ 0          ✗ 10907
     http_req_receiving.............: avg=77.64µs min=27.08µs med=53.26µs max=12.12ms p(90)=101.8µs p(95)=129.68µs p(99.9)=1.77ms
     http_req_sending...............: avg=33.96µs min=5.95µs  med=12.68µs max=18.63ms p(90)=27.5µs  p(95)=46.14µs  p(99.9)=3.71ms
     http_req_tls_handshaking.......: avg=0s      min=0s      med=0s      max=0s      p(90)=0s      p(95)=0s       p(99.9)=0s    
     http_req_waiting...............: avg=1.19s   min=7.25ms  med=1.15s   max=15.72s  p(90)=2.14s   p(95)=2.52s    p(99.9)=14.4s 
     http_reqs......................: 10907   159.269123/s
     iteration_duration.............: avg=1.31s   min=7.46ms  med=1.29s   max=15.74s  p(90)=2.19s   p(95)=2.62s    p(99.9)=14.43s
     iterations.....................: 9907    144.666654/s
     success_rate...................: 100.00% ✓ 9907       ✗ 0    
     vus............................: 100     min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

Overview for: constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 172 13984 total, 0 failed avg: 216ms, p95: 227ms
hive-router 166 13486 total, 0 failed avg: 224ms, p95: 235ms
cosmo 156 12738 total, 0 failed avg: 237ms, p95: 264ms
hive-gateway 152 11643 total, 0 failed avg: 259ms, p95: 285ms
hive-gateway-bun 144 11092 total, 0 failed avg: 272ms, p95: 397ms
apollo-router 128 10418 total, 0 failed avg: 290ms, p95: 333ms
apollo-gateway 87 7153 total, 0 failed avg: 424ms, p95: 463ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41652      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   201 kB/s
     http_req_blocked...............: avg=39.64µs  min=1.16µs   med=2.03µs   max=17.4ms   p(90)=3.6µs    p(95)=5.04µs   p(99.9)=13.33ms 
     http_req_connecting............: avg=36.36µs  min=0s       med=0s       max=17.38ms  p(90)=0s       p(95)=0s       p(99.9)=13.31ms 
     http_req_duration..............: avg=216.29ms min=154.47ms med=215.57ms max=583.71ms p(90)=224.71ms p(95)=227.4ms  p(99.9)=491.54ms
       { expected_response:true }...: avg=216.29ms min=154.47ms med=215.57ms max=583.71ms p(90)=224.71ms p(95)=227.4ms  p(99.9)=491.54ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13984
     http_req_receiving.............: avg=83.29µs  min=26.71µs  med=46.2µs   max=13.48ms  p(90)=97.93µs  p(95)=270.19µs p(99.9)=4.82ms  
     http_req_sending...............: avg=119.82µs min=5.92µs   med=8.84µs   max=347.1ms  p(90)=33.02µs  p(95)=93.85µs  p(99.9)=7.4ms   
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=216.08ms min=154.42ms med=215.47ms max=582.49ms p(90)=224.56ms p(95)=227.22ms p(99.9)=476.47ms
     http_reqs......................: 13984   172.59509/s
     iteration_duration.............: avg=216.57ms min=154.66ms med=215.81ms max=604.91ms p(90)=224.9ms  p(95)=227.57ms p(99.9)=508.49ms
     iterations.....................: 13884   171.360858/s
     success_rate...................: 100.00% ✓ 13884      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40158      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   194 kB/s
     http_req_blocked...............: avg=40.55µs  min=1.12µs   med=2.26µs   max=18.73ms  p(90)=3.35µs   p(95)=4.59µs   p(99.9)=12.63ms 
     http_req_connecting............: avg=37.12µs  min=0s       med=0s       max=18.55ms  p(90)=0s       p(95)=0s       p(99.9)=12.6ms  
     http_req_duration..............: avg=224.31ms min=126.67ms med=223.34ms max=588.38ms p(90)=232.71ms p(95)=235.22ms p(99.9)=499.41ms
       { expected_response:true }...: avg=224.31ms min=126.67ms med=223.34ms max=588.38ms p(90)=232.71ms p(95)=235.22ms p(99.9)=499.41ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13486
     http_req_receiving.............: avg=79.51µs  min=24.9µs   med=44.55µs  max=10.29ms  p(90)=97.7µs   p(95)=271.57µs p(99.9)=1.96ms  
     http_req_sending...............: avg=112.56µs min=5.6µs    med=9.65µs   max=344.59ms p(90)=30.11µs  p(95)=100.49µs p(99.9)=4.74ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=224.11ms min=123.16ms med=223.24ms max=587.64ms p(90)=232.58ms p(95)=235.03ms p(99.9)=487.87ms
     http_reqs......................: 13486   166.514107/s
     iteration_duration.............: avg=224.7ms  min=126.86ms med=223.57ms max=603.24ms p(90)=232.91ms p(95)=235.44ms p(99.9)=528.58ms
     iterations.....................: 13386   165.279389/s
     success_rate...................: 100.00% ✓ 13386      ✗ 0    
     vus............................: 35      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 37914      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 15 MB   183 kB/s
     http_req_blocked...............: avg=48.14µs  min=1.29µs   med=2.69µs   max=16.27ms  p(90)=3.99µs   p(95)=5.02µs   p(99.9)=13.69ms 
     http_req_connecting............: avg=44.36µs  min=0s       med=0s       max=16.17ms  p(90)=0s       p(95)=0s       p(99.9)=13.66ms 
     http_req_duration..............: avg=237.41ms min=139.08ms med=237.01ms max=633.48ms p(90)=257.92ms p(95)=264.1ms  p(99.9)=522.92ms
       { expected_response:true }...: avg=237.41ms min=139.08ms med=237.01ms max=633.48ms p(90)=257.92ms p(95)=264.1ms  p(99.9)=522.92ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12738
     http_req_receiving.............: avg=391.49µs min=32.76µs  med=64.95µs  max=118.91ms p(90)=224.37µs p(95)=467.34µs p(99.9)=35.46ms 
     http_req_sending...............: avg=85.1µs   min=6.13µs   med=11.03µs  max=200.29ms p(90)=30.29µs  p(95)=125.32µs p(99.9)=6.64ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=236.93ms min=138.75ms med=236.68ms max=628.54ms p(90)=257.19ms p(95)=263.24ms p(99.9)=521.18ms
     http_reqs......................: 12738   156.991393/s
     iteration_duration.............: avg=237.93ms min=139.45ms med=237.38ms max=652.08ms p(90)=258.21ms p(95)=264.38ms p(99.9)=546.5ms 
     iterations.....................: 12638   155.758928/s
     success_rate...................: 100.00% ✓ 12638      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 34629      ✗ 0    
     data_received..................: 1.0 GB  13 MB/s
     data_sent......................: 14 MB   177 kB/s
     http_req_blocked...............: avg=29.26µs  min=1.14µs   med=2.56µs   max=11.44ms  p(90)=4.13µs   p(95)=5.35µs   p(99.9)=9.1ms   
     http_req_connecting............: avg=25.88µs  min=0s       med=0s       max=11.4ms   p(90)=0s       p(95)=0s       p(99.9)=9.07ms  
     http_req_duration..............: avg=258.9ms  min=159.41ms med=250.31ms max=799.71ms p(90)=266.64ms p(95)=284.74ms p(99.9)=684.51ms
       { expected_response:true }...: avg=258.9ms  min=159.41ms med=250.31ms max=799.71ms p(90)=266.64ms p(95)=284.74ms p(99.9)=684.51ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11643
     http_req_receiving.............: avg=88.35µs  min=25.04µs  med=45.07µs  max=10.21ms  p(90)=105.37µs p(95)=366.73µs p(99.9)=2.74ms  
     http_req_sending...............: avg=77.05µs  min=5.49µs   med=10.58µs  max=220.92ms p(90)=36.4µs   p(95)=134.78µs p(99.9)=5.05ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=258.73ms min=154.74ms med=250.18ms max=799.01ms p(90)=266.39ms p(95)=284.2ms  p(99.9)=683.49ms
     http_reqs......................: 11643   152.469761/s
     iteration_duration.............: avg=260.09ms min=159.55ms med=250.61ms max=820.48ms p(90)=266.95ms p(95)=286.64ms p(99.9)=705.78ms
     iterations.....................: 11543   151.160221/s
     success_rate...................: 100.00% ✓ 11543      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 32976      ✗ 0    
     data_received..................: 974 MB  13 MB/s
     data_sent......................: 13 MB   168 kB/s
     http_req_blocked...............: avg=29.77µs  min=1.16µs   med=2.72µs   max=11.72ms  p(90)=4.47µs   p(95)=6.15µs   p(99.9)=9.12ms  
     http_req_connecting............: avg=26.16µs  min=0s       med=0s       max=11.68ms  p(90)=0s       p(95)=0s       p(99.9)=9.07ms  
     http_req_duration..............: avg=272ms    min=135.37ms med=262.11ms max=743.7ms  p(90)=283.76ms p(95)=397.19ms p(99.9)=643.57ms
       { expected_response:true }...: avg=272ms    min=135.37ms med=262.11ms max=743.7ms  p(90)=283.76ms p(95)=397.19ms p(99.9)=643.57ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11092
     http_req_receiving.............: avg=98.85µs  min=25.56µs  med=47.73µs  max=9.99ms   p(90)=112.67µs p(95)=408.76µs p(99.9)=3.6ms   
     http_req_sending...............: avg=121.6µs  min=5.64µs   med=11.2µs   max=227.81ms p(90)=38.96µs  p(95)=148.21µs p(99.9)=5.85ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=271.78ms min=135.3ms  med=261.97ms max=742.93ms p(90)=283.49ms p(95)=395.39ms p(99.9)=642.29ms
     http_reqs......................: 11092   144.468128/s
     iteration_duration.............: avg=273.28ms min=135.61ms med=262.44ms max=774.43ms p(90)=284.07ms p(95)=404.19ms p(99.9)=678.01ms
     iterations.....................: 10992   143.165674/s
     success_rate...................: 100.00% ✓ 10992      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 30954      ✗ 0    
     data_received..................: 914 MB  11 MB/s
     data_sent......................: 12 MB   149 kB/s
     http_req_blocked...............: avg=61.3µs   min=1.66µs   med=2.72µs   max=16.37ms  p(90)=3.95µs   p(95)=4.78µs   p(99.9)=14.58ms 
     http_req_connecting............: avg=57.6µs   min=0s       med=0s       max=16.21ms  p(90)=0s       p(95)=0s       p(99.9)=14.54ms 
     http_req_duration..............: avg=289.73ms min=170.57ms med=292.32ms max=674.15ms p(90)=324.83ms p(95)=333.13ms p(99.9)=596.01ms
       { expected_response:true }...: avg=289.73ms min=170.57ms med=292.32ms max=674.15ms p(90)=324.83ms p(95)=333.13ms p(99.9)=596.01ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10418
     http_req_receiving.............: avg=89.02µs  min=35.02µs  med=49.98µs  max=102.34ms p(90)=94.94µs  p(95)=178.79µs p(99.9)=1.36ms  
     http_req_sending...............: avg=104.19µs min=7.32µs   med=10.95µs  max=252.33ms p(90)=22.17µs  p(95)=126.25µs p(99.9)=4.96ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=289.53ms min=170.48ms med=292.19ms max=662.24ms p(90)=324.65ms p(95)=332.91ms p(99.9)=582.7ms 
     http_reqs......................: 10418   128.329267/s
     iteration_duration.............: avg=290.81ms min=170.79ms med=292.83ms max=695.03ms p(90)=325.16ms p(95)=333.74ms p(99.9)=620.63ms
     iterations.....................: 10318   127.097464/s
     success_rate...................: 100.00% ✓ 10318      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 21159     ✗ 0   
     data_received..................: 628 MB  7.7 MB/s
     data_sent......................: 8.3 MB  102 kB/s
     http_req_blocked...............: avg=43.07µs  min=1.4µs    med=3.02µs   max=11.39ms  p(90)=4.31µs   p(95)=5.06µs   p(99.9)=9.86ms  
     http_req_connecting............: avg=39.57µs  min=0s       med=0s       max=11.36ms  p(90)=0s       p(95)=0s       p(99.9)=9.82ms  
     http_req_duration..............: avg=423.69ms min=210.43ms med=426.45ms max=871.5ms  p(90)=451.57ms p(95)=463.14ms p(99.9)=776.24ms
       { expected_response:true }...: avg=423.69ms min=210.43ms med=426.45ms max=871.5ms  p(90)=451.57ms p(95)=463.14ms p(99.9)=776.24ms
     http_req_failed................: 0.00%   ✓ 0         ✗ 7153
     http_req_receiving.............: avg=62.21µs  min=28.86µs  med=51.63µs  max=6.18ms   p(90)=89.05µs  p(95)=104.29µs p(99.9)=381.22µs
     http_req_sending...............: avg=87.12µs  min=6.5µs    med=12.3µs   max=226.83ms p(90)=18.13µs  p(95)=22.92µs  p(99.9)=5.18ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=423.54ms min=210.35ms med=426.36ms max=870.09ms p(90)=451.49ms p(95)=463.03ms p(99.9)=774.86ms
     http_reqs......................: 7153    87.590523/s
     iteration_duration.............: avg=427.08ms min=276.53ms med=426.95ms max=919.71ms p(90)=452.06ms p(95)=463.69ms p(99.9)=815.6ms 
     iterations.....................: 7053    86.365995/s
     success_rate...................: 100.00% ✓ 7053      ✗ 0   
     vus............................: 50      min=0       max=50
     vus_max........................: 50      min=50      max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@ardatan ardatan merged commit 087a1c6 into main Sep 19, 2025
34 checks passed
@ardatan ardatan deleted the renovate/node-22.x branch September 19, 2025 18:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant