Skip to content

Conversation

renovate[bot]
Copy link
Contributor

@renovate renovate bot commented Sep 17, 2025

Coming soon: The Renovate bot (GitHub App) will be renamed to Mend. PRs from Renovate will soon appear from 'Mend'. Learn more here.

This PR contains the following updates:

Package Change Age Confidence
@graphql-hive/gateway (source) 2.1.3 -> 2.1.6 age confidence

Release Notes

graphql-hive/gateway (@​graphql-hive/gateway)

v2.1.6

Compare Source

Patch Changes

v2.1.5

Compare Source

Patch Changes

v2.1.4

Compare Source

Patch Changes

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.


  • If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

@renovate renovate bot added the dependencies Pull requests that update a dependency file label Sep 17, 2025
Copy link

github-actions bot commented Sep 17, 2025

💻 Website Preview

The latest changes are available as preview in: https://190d428b.federation-gateway-benchmark.pages.dev

Copy link

github-actions bot commented Sep 17, 2025

Overview for: constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1839 110926 total, 0 failed avg: 27ms, p95: 48ms
grafbase 1714 103386 total, 0 failed avg: 29ms, p95: 50ms
cosmo 694 41934 total, 0 failed avg: 71ms, p95: 105ms
apollo-router 390 23744 total, 0 failed avg: 126ms, p95: 165ms
hive-gateway 308 18864 total, 0 failed avg: 159ms, p95: 211ms
hive-gateway-bun 291 17796 total, 0 failed avg: 168ms, p95: 281ms
apollo-gateway 126 7735 total, 0 failed avg: 388ms, p95: 458ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 332478      ✗ 0     
     data_received..................: 9.7 GB  161 MB/s
     data_sent......................: 129 MB  2.1 MB/s
     http_req_blocked...............: avg=5.21µs   min=1.13µs  med=2.53µs  max=9.91ms   p(90)=3.75µs   p(95)=4.5µs    p(99.9)=85.07µs
     http_req_connecting............: avg=2.16µs   min=0s      med=0s      max=9.87ms   p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_duration..............: avg=26.84ms  min=1.98ms  med=24.52ms max=446.78ms p(90)=41.34ms  p(95)=47.61ms  p(99.9)=82.98ms
       { expected_response:true }...: avg=26.84ms  min=1.98ms  med=24.52ms max=446.78ms p(90)=41.34ms  p(95)=47.61ms  p(99.9)=82.98ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 110926
     http_req_receiving.............: avg=117.16µs min=23.29µs med=43.48µs max=175.73ms p(90)=122.16µs p(95)=343.52µs p(99.9)=11.13ms
     http_req_sending...............: avg=83.51µs  min=5.33µs  med=10.33µs max=366.43ms p(90)=33.01µs  p(95)=124.44µs p(99.9)=11.02ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=26.64ms  min=1.94ms  med=24.36ms max=427.53ms p(90)=40.99ms  p(95)=47.24ms  p(99.9)=81.39ms
     http_reqs......................: 110926  1839.968193/s
     iteration_duration.............: avg=27.06ms  min=3.79ms  med=24.72ms max=480.72ms p(90)=41.55ms  p(95)=47.82ms  p(99.9)=83.76ms
     iterations.....................: 110826  1838.309458/s
     success_rate...................: 100.00% ✓ 110826      ✗ 0     
     vus............................: 50      min=50        max=50  
     vus_max........................: 50      min=50        max=50  

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 309858      ✗ 0     
     data_received..................: 9.1 GB  151 MB/s
     data_sent......................: 120 MB  2.0 MB/s
     http_req_blocked...............: avg=5.85µs   min=1.19µs med=3µs     max=9.31ms   p(90)=4.07µs   p(95)=4.95µs   p(99.9)=109.06µs
     http_req_connecting............: avg=2.17µs   min=0s     med=0s      max=9.27ms   p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_duration..............: avg=28.78ms  min=2.55ms med=25.84ms max=434.52ms p(90)=43.53ms  p(95)=50.22ms  p(99.9)=87.89ms 
       { expected_response:true }...: avg=28.78ms  min=2.55ms med=25.84ms max=434.52ms p(90)=43.53ms  p(95)=50.22ms  p(99.9)=87.89ms 
     http_req_failed................: 0.00%   ✓ 0           ✗ 103386
     http_req_receiving.............: avg=126.19µs min=24.7µs med=46.61µs max=48.27ms  p(90)=132.21µs p(95)=364.54µs p(99.9)=11.56ms 
     http_req_sending...............: avg=95.6µs   min=5.38µs med=11.64µs max=360.85ms p(90)=36.32µs  p(95)=127.44µs p(99.9)=13.97ms 
     http_req_tls_handshaking.......: avg=0s       min=0s     med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=28.56ms  min=2.5ms  med=25.68ms max=419.38ms p(90)=43.13ms  p(95)=49.81ms  p(99.9)=84.12ms 
     http_reqs......................: 103386  1714.156796/s
     iteration_duration.............: avg=29.03ms  min=6.94ms med=26.06ms max=457.96ms p(90)=43.75ms  p(95)=50.44ms  p(99.9)=88.93ms 
     iterations.....................: 103286  1712.49878/s
     success_rate...................: 100.00% ✓ 103286      ✗ 0     
     vus............................: 50      min=50        max=50  
     vus_max........................: 50      min=50        max=50  

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 125502     ✗ 0    
     data_received..................: 3.7 GB  61 MB/s
     data_sent......................: 49 MB   808 kB/s
     http_req_blocked...............: avg=8.78µs   min=1.23µs  med=2.66µs  max=9.09ms   p(90)=3.76µs   p(95)=4.46µs   p(99.9)=1.41ms  
     http_req_connecting............: avg=5.47µs   min=0s      med=0s      max=9.03ms   p(90)=0s       p(95)=0s       p(99.9)=1.39ms  
     http_req_duration..............: avg=71.29ms  min=2.82ms  med=70.22ms max=491.58ms p(90)=96.66ms  p(95)=104.52ms p(99.9)=260.44ms
       { expected_response:true }...: avg=71.29ms  min=2.82ms  med=70.22ms max=491.58ms p(90)=96.66ms  p(95)=104.52ms p(99.9)=260.44ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 41934
     http_req_receiving.............: avg=161.63µs min=29.93µs med=73.93µs max=34.07ms  p(90)=153.13µs p(95)=379.5µs  p(99.9)=15.45ms 
     http_req_sending...............: avg=64.39µs  min=5.9µs   med=10.79µs max=212.4ms  p(90)=28.59µs  p(95)=119.11µs p(99.9)=3.11ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=71.07ms  min=2.75ms  med=70.02ms max=490.33ms p(90)=96.4ms   p(95)=104.22ms p(99.9)=246.21ms
     http_reqs......................: 41934   694.314661/s
     iteration_duration.............: avg=71.71ms  min=5.52ms  med=70.49ms max=534.96ms p(90)=96.89ms  p(95)=104.75ms p(99.9)=273.73ms
     iterations.....................: 41834   692.658929/s
     success_rate...................: 100.00% ✓ 41834      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 70932      ✗ 0    
     data_received..................: 2.1 GB  34 MB/s
     data_sent......................: 28 MB   454 kB/s
     http_req_blocked...............: avg=12.03µs  min=1.88µs  med=2.88µs   max=7.7ms    p(90)=4.11µs   p(95)=4.77µs   p(99.9)=4.35ms  
     http_req_connecting............: avg=8.52µs   min=0s      med=0s       max=7.67ms   p(90)=0s       p(95)=0s       p(99.9)=4.33ms  
     http_req_duration..............: avg=126.22ms min=6.06ms  med=125.34ms max=589.48ms p(90)=154.98ms p(95)=164.51ms p(99.9)=409.61ms
       { expected_response:true }...: avg=126.22ms min=6.06ms  med=125.34ms max=589.48ms p(90)=154.98ms p(95)=164.51ms p(99.9)=409.61ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 23744
     http_req_receiving.............: avg=79.02µs  min=36.15µs med=51.44µs  max=120.73ms p(90)=96.04µs  p(95)=122.95µs p(99.9)=1.52ms  
     http_req_sending...............: avg=64.17µs  min=7.97µs  med=11.41µs  max=398.38ms p(90)=18.97µs  p(95)=34.01µs  p(99.9)=2.04ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=126.07ms min=6.01ms  med=125.24ms max=577.02ms p(90)=154.85ms p(95)=164.39ms p(99.9)=405.85ms
     http_reqs......................: 23744   390.6527/s
     iteration_duration.............: avg=126.98ms min=25.15ms med=125.68ms max=607.01ms p(90)=155.25ms p(95)=164.78ms p(99.9)=422.93ms
     iterations.....................: 23644   389.007431/s
     success_rate...................: 100.00% ✓ 23644      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 56292      ✗ 0    
     data_received..................: 1.7 GB  27 MB/s
     data_sent......................: 22 MB   359 kB/s
     http_req_blocked...............: avg=19.54µs  min=1.3µs   med=2.79µs   max=11.24ms  p(90)=4.57µs   p(95)=5.77µs   p(99.9)=7.03ms  
     http_req_connecting............: avg=15.44µs  min=0s      med=0s       max=11.2ms   p(90)=0s       p(95)=0s       p(99.9)=7ms     
     http_req_duration..............: avg=158.81ms min=6.93ms  med=147.74ms max=604.39ms p(90)=174.93ms p(95)=211.46ms p(99.9)=478.38ms
       { expected_response:true }...: avg=158.81ms min=6.93ms  med=147.74ms max=604.39ms p(90)=174.93ms p(95)=211.46ms p(99.9)=478.38ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 18864
     http_req_receiving.............: avg=95.17µs  min=26.88µs med=46.51µs  max=20.02ms  p(90)=110.84µs p(95)=269.85µs p(99.9)=3.91ms  
     http_req_sending...............: avg=86.4µs   min=5.48µs  med=11.23µs  max=242.6ms  p(90)=32.68µs  p(95)=127.86µs p(99.9)=6.33ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=158.63ms min=6.86ms  med=147.61ms max=604.22ms p(90)=174.66ms p(95)=209.92ms p(99.9)=477.64ms
     http_reqs......................: 18864   308.667483/s
     iteration_duration.............: avg=159.98ms min=62.78ms med=148.12ms max=643.39ms p(90)=175.3ms  p(95)=214.01ms p(99.9)=500.67ms
     iterations.....................: 18764   307.031205/s
     success_rate...................: 100.00% ✓ 18764      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 53088      ✗ 0    
     data_received..................: 1.6 GB  26 MB/s
     data_sent......................: 21 MB   340 kB/s
     http_req_blocked...............: avg=27.32µs  min=1.19µs  med=2.86µs   max=16.93ms  p(90)=4.84µs   p(95)=6.24µs   p(99.9)=10.68ms 
     http_req_connecting............: avg=23.45µs  min=0s      med=0s       max=16.89ms  p(90)=0s       p(95)=0s       p(99.9)=10.56ms 
     http_req_duration..............: avg=168.45ms min=6.98ms  med=156.57ms max=616.76ms p(90)=193.52ms p(95)=280.59ms p(99.9)=532.02ms
       { expected_response:true }...: avg=168.45ms min=6.98ms  med=156.57ms max=616.76ms p(90)=193.52ms p(95)=280.59ms p(99.9)=532.02ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 17796
     http_req_receiving.............: avg=92.26µs  min=26.07µs med=47.64µs  max=14.73ms  p(90)=103.34µs p(95)=171.06µs p(99.9)=4.54ms  
     http_req_sending...............: avg=117.21µs min=5.54µs  med=11.48µs  max=239.63ms p(90)=32.22µs  p(95)=120.05µs p(99.9)=10.17ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=168.24ms min=6.92ms  med=156.47ms max=606.56ms p(90)=193.19ms p(95)=263.83ms p(99.9)=531.74ms
     http_reqs......................: 17796   291.940763/s
     iteration_duration.............: avg=169.68ms min=27.32ms med=156.95ms max=670.76ms p(90)=193.86ms p(95)=303.19ms p(99.9)=534.28ms
     iterations.....................: 17696   290.300278/s
     success_rate...................: 100.00% ✓ 17696      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 22905      ✗ 0   
     data_received..................: 679 MB  11 MB/s
     data_sent......................: 9.0 MB  147 kB/s
     http_req_blocked...............: avg=40.1µs   min=1.31µs   med=2.99µs   max=11.09ms  p(90)=4.09µs   p(95)=4.76µs   p(99.9)=9.47ms  
     http_req_connecting............: avg=36.48µs  min=0s       med=0s       max=11.06ms  p(90)=0s       p(95)=0s       p(99.9)=9.44ms  
     http_req_duration..............: avg=388.41ms min=7.03ms   med=388.12ms max=859.88ms p(90)=440.44ms p(95)=457.78ms p(99.9)=757.84ms
       { expected_response:true }...: avg=388.41ms min=7.03ms   med=388.12ms max=859.88ms p(90)=440.44ms p(95)=457.78ms p(99.9)=757.84ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 7735
     http_req_receiving.............: avg=67.18µs  min=27.89µs  med=48.66µs  max=84.31ms  p(90)=82.85µs  p(95)=97.13µs  p(99.9)=423.18µs
     http_req_sending...............: avg=66.13µs  min=6.07µs   med=11.79µs  max=215.63ms p(90)=16.22µs  p(95)=20.55µs  p(99.9)=3.7ms   
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=388.27ms min=6.98ms   med=388.03ms max=816.61ms p(90)=440.38ms p(95)=457.72ms p(99.9)=756.4ms 
     http_reqs......................: 7735    126.594356/s
     iteration_duration.............: avg=393.97ms min=119.08ms med=388.74ms max=875.5ms  p(90)=441.11ms p(95)=458.54ms p(99.9)=797.67ms
     iterations.....................: 7635    124.957713/s
     success_rate...................: 100.00% ✓ 7635       ✗ 0   
     vus............................: 27      min=27       max=50
     vus_max........................: 50      min=50       max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Sep 17, 2025

Overview for: constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 173 14043 total, 0 failed avg: 215ms, p95: 226ms
hive-router 169 13739 total, 0 failed avg: 220ms, p95: 230ms
cosmo 167 13590 total, 0 failed avg: 222ms, p95: 244ms
hive-gateway 161 12322 total, 0 failed avg: 245ms, p95: 273ms
hive-gateway-bun 160 12279 total, 0 failed avg: 246ms, p95: 277ms
apollo-router 134 10995 total, 0 failed avg: 275ms, p95: 319ms
apollo-gateway 123 10073 total, 0 failed avg: 300ms, p95: 331ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41829      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   202 kB/s
     http_req_blocked...............: avg=18.71µs  min=1.17µs   med=1.95µs   max=8.75ms   p(90)=3.64µs   p(95)=5.32µs   p(99.9)=6.31ms  
     http_req_connecting............: avg=15.82µs  min=0s       med=0s       max=8.72ms   p(90)=0s       p(95)=0s       p(99.9)=6.29ms  
     http_req_duration..............: avg=215.36ms min=124.5ms  med=214.6ms  max=579.49ms p(90)=223.36ms p(95)=225.83ms p(99.9)=485.32ms
       { expected_response:true }...: avg=215.36ms min=124.5ms  med=214.6ms  max=579.49ms p(90)=223.36ms p(95)=225.83ms p(99.9)=485.32ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 14043
     http_req_receiving.............: avg=80.74µs  min=25.67µs  med=44.93µs  max=16.95ms  p(90)=93.74µs  p(95)=253.04µs p(99.9)=4.34ms  
     http_req_sending...............: avg=91.57µs  min=5.41µs   med=8.22µs   max=356.65ms p(90)=27.26µs  p(95)=93.71µs  p(99.9)=6.08ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=215.19ms min=120.39ms med=214.51ms max=578.12ms p(90)=223.23ms p(95)=225.63ms p(99.9)=469.76ms
     http_reqs......................: 14043   173.422126/s
     iteration_duration.............: avg=215.62ms min=124.68ms med=214.81ms max=606.81ms p(90)=223.54ms p(95)=226.03ms p(99.9)=517.78ms
     iterations.....................: 13943   172.18719/s
     success_rate...................: 100.00% ✓ 13943      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40917      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   198 kB/s
     http_req_blocked...............: avg=39.06µs  min=1.13µs   med=2.01µs   max=14.23ms  p(90)=3.16µs   p(95)=4.41µs   p(99.9)=12.38ms 
     http_req_connecting............: avg=36.4µs   min=0s       med=0s       max=14.2ms   p(90)=0s       p(95)=0s       p(99.9)=12.33ms 
     http_req_duration..............: avg=220.11ms min=160.21ms med=219.28ms max=587.5ms  p(90)=227.45ms p(95)=229.89ms p(99.9)=497.13ms
       { expected_response:true }...: avg=220.11ms min=160.21ms med=219.28ms max=587.5ms  p(90)=227.45ms p(95)=229.89ms p(99.9)=497.13ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13739
     http_req_receiving.............: avg=77.12µs  min=24.89µs  med=42.36µs  max=24.94ms  p(90)=89.12µs  p(95)=259.23µs p(99.9)=3.59ms  
     http_req_sending...............: avg=153.09µs min=5.3µs    med=8.61µs   max=342.95ms p(90)=31.08µs  p(95)=94.06µs  p(99.9)=6.24ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=219.88ms min=160.16ms med=219.19ms max=583.39ms p(90)=227.33ms p(95)=229.66ms p(99.9)=476.94ms
     http_reqs......................: 13739   169.798146/s
     iteration_duration.............: avg=220.42ms min=160.36ms med=219.48ms max=597.75ms p(90)=227.63ms p(95)=230.06ms p(99.9)=512.1ms 
     iterations.....................: 13639   168.562261/s
     success_rate...................: 100.00% ✓ 13639      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40470      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   195 kB/s
     http_req_blocked...............: avg=43.63µs  min=1.51µs   med=2.76µs   max=19.79ms  p(90)=4.16µs   p(95)=5.1µs    p(99.9)=14.01ms 
     http_req_connecting............: avg=38.61µs  min=0s       med=0s       max=17.82ms  p(90)=0s       p(95)=0s       p(99.9)=13.47ms 
     http_req_duration..............: avg=222.18ms min=159.81ms med=220.87ms max=598.72ms p(90)=237.8ms  p(95)=243.53ms p(99.9)=496.5ms 
       { expected_response:true }...: avg=222.18ms min=159.81ms med=220.87ms max=598.72ms p(90)=237.8ms  p(95)=243.53ms p(99.9)=496.5ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 13590
     http_req_receiving.............: avg=355.58µs min=32.83µs  med=66.66µs  max=28.1ms   p(90)=333.03µs p(95)=718.3µs  p(99.9)=22.62ms 
     http_req_sending...............: avg=102.48µs min=7.15µs   med=11.24µs  max=349.27ms p(90)=30.04µs  p(95)=122.24µs p(99.9)=2.94ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=221.73ms min=159.6ms  med=220.52ms max=598.16ms p(90)=237.35ms p(95)=243.08ms p(99.9)=488.41ms
     http_reqs......................: 13590   167.693725/s
     iteration_duration.............: avg=222.57ms min=160ms    med=221.21ms max=625.01ms p(90)=238.08ms p(95)=243.83ms p(99.9)=523.26ms
     iterations.....................: 13490   166.459776/s
     success_rate...................: 100.00% ✓ 13490      ✗ 0    
     vus............................: 20      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 36666      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 14 MB   188 kB/s
     http_req_blocked...............: avg=55.61µs  min=1.14µs   med=2.68µs   max=21.92ms  p(90)=4.39µs   p(95)=5.6µs    p(99.9)=17.96ms 
     http_req_connecting............: avg=51.62µs  min=0s       med=0s       max=21.86ms  p(90)=0s       p(95)=0s       p(99.9)=17.81ms 
     http_req_duration..............: avg=244.73ms min=160.33ms med=236.03ms max=814.95ms p(90)=259.87ms p(95)=272.73ms p(99.9)=664.36ms
       { expected_response:true }...: avg=244.73ms min=160.33ms med=236.03ms max=814.95ms p(90)=259.87ms p(95)=272.73ms p(99.9)=664.36ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12322
     http_req_receiving.............: avg=105.07µs min=26.01µs  med=46.44µs  max=188.1ms  p(90)=106.7µs  p(95)=279.92µs p(99.9)=3.08ms  
     http_req_sending...............: avg=147.2µs  min=5.53µs   med=11.05µs  max=274.37ms p(90)=34.5µs   p(95)=129.71µs p(99.9)=8.7ms   
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=244.48ms min=160.25ms med=235.89ms max=813.31ms p(90)=259.75ms p(95)=272.44ms p(99.9)=656.54ms
     http_reqs......................: 12322   161.194414/s
     iteration_duration.............: avg=245.78ms min=174.42ms med=236.4ms  max=836.73ms p(90)=260.15ms p(95)=273.02ms p(99.9)=704.19ms
     iterations.....................: 12222   159.88623/s
     success_rate...................: 100.00% ✓ 12222      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 36537      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 14 MB   187 kB/s
     http_req_blocked...............: avg=27.17µs  min=1.17µs   med=2.64µs   max=12.05ms  p(90)=4.35µs   p(95)=5.77µs   p(99.9)=8.98ms  
     http_req_connecting............: avg=23.32µs  min=0s       med=0s       max=12.01ms  p(90)=0s       p(95)=0s       p(99.9)=8.95ms  
     http_req_duration..............: avg=245.61ms min=160.34ms med=237.31ms max=772.62ms p(90)=262.01ms p(95)=277.35ms p(99.9)=648.18ms
       { expected_response:true }...: avg=245.61ms min=160.34ms med=237.31ms max=772.62ms p(90)=262.01ms p(95)=277.35ms p(99.9)=648.18ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12279
     http_req_receiving.............: avg=100.67µs min=25.82µs  med=45.69µs  max=204.92ms p(90)=100.15µs p(95)=177.04µs p(99.9)=3.21ms  
     http_req_sending...............: avg=101.76µs min=5.61µs   med=10.96µs  max=195.68ms p(90)=33.33µs  p(95)=118.41µs p(99.9)=6.51ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=245.41ms min=160.22ms med=237.18ms max=771.3ms  p(90)=261.75ms p(95)=277.16ms p(99.9)=647.03ms
     http_reqs......................: 12279   160.543884/s
     iteration_duration.............: avg=246.67ms min=181.24ms med=237.69ms max=798.79ms p(90)=262.31ms p(95)=277.62ms p(99.9)=695.77ms
     iterations.....................: 12179   159.236417/s
     success_rate...................: 100.00% ✓ 12179      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 32685      ✗ 0    
     data_received..................: 965 MB  12 MB/s
     data_sent......................: 13 MB   157 kB/s
     http_req_blocked...............: avg=54.53µs  min=1.46µs   med=2.93µs   max=19.98ms  p(90)=4.81µs   p(95)=6.06µs   p(99.9)=15.07ms 
     http_req_connecting............: avg=49.54µs  min=0s       med=0s       max=19.82ms  p(90)=0s       p(95)=0s       p(99.9)=15.03ms 
     http_req_duration..............: avg=274.88ms min=172.66ms med=276.07ms max=693.44ms p(90)=309.85ms p(95)=319.23ms p(99.9)=586.54ms
       { expected_response:true }...: avg=274.88ms min=172.66ms med=276.07ms max=693.44ms p(90)=309.85ms p(95)=319.23ms p(99.9)=586.54ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10995
     http_req_receiving.............: avg=135.52µs min=32.76µs  med=58.44µs  max=10.34ms  p(90)=170.61µs p(95)=497.81µs p(99.9)=5.13ms  
     http_req_sending...............: avg=147.04µs min=6.77µs   med=11.96µs  max=275.07ms p(90)=77.7µs   p(95)=145.84µs p(99.9)=5.81ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=274.6ms  min=172.59ms med=275.9ms  max=692.79ms p(90)=309.61ms p(95)=318.78ms p(99.9)=584.92ms
     http_reqs......................: 10995   134.769212/s
     iteration_duration.............: avg=275.82ms min=172.84ms med=276.65ms max=718.28ms p(90)=310.26ms p(95)=319.74ms p(99.9)=620.35ms
     iterations.....................: 10895   133.543481/s
     success_rate...................: 100.00% ✓ 10895      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 29919      ✗ 0    
     data_received..................: 885 MB  11 MB/s
     data_sent......................: 12 MB   144 kB/s
     http_req_blocked...............: avg=60.6µs   min=1.35µs   med=3.51µs   max=20.76ms  p(90)=5.38µs   p(95)=6.27µs   p(99.9)=15.42ms 
     http_req_connecting............: avg=55.43µs  min=0s       med=0s       max=20.63ms  p(90)=0s       p(95)=0s       p(99.9)=14.96ms 
     http_req_duration..............: avg=299.75ms min=211.96ms med=296.77ms max=862.43ms p(90)=321.13ms p(95)=330.82ms p(99.9)=751.45ms
       { expected_response:true }...: avg=299.75ms min=211.96ms med=296.77ms max=862.43ms p(90)=321.13ms p(95)=330.82ms p(99.9)=751.45ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10073
     http_req_receiving.............: avg=87.97µs  min=30.84µs  med=68.66µs  max=5.35ms   p(90)=120.14µs p(95)=151.89µs p(99.9)=2.22ms  
     http_req_sending...............: avg=75.25µs  min=6.6µs    med=13.9µs   max=314.75ms p(90)=25.02µs  p(95)=42.26µs  p(99.9)=2.79ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=299.59ms min=211.82ms med=296.62ms max=861.85ms p(90)=321ms    p(95)=330.65ms p(99.9)=750.62ms
     http_reqs......................: 10073   123.387279/s
     iteration_duration.............: avg=301.12ms min=218.68ms med=297.23ms max=895.32ms p(90)=321.66ms p(95)=331.12ms p(99.9)=835.76ms
     iterations.....................: 9973    122.162348/s
     success_rate...................: 100.00% ✓ 9973       ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Sep 17, 2025

Overview for: constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 173 14041 total, 0 failed avg: 216ms, p95: 227ms
hive-router 168 13625 total, 0 failed avg: 222ms, p95: 232ms
cosmo 156 12734 total, 0 failed avg: 238ms, p95: 265ms
hive-gateway 152 11610 total, 0 failed avg: 260ms, p95: 378ms
hive-gateway-bun 148 11375 total, 0 failed avg: 266ms, p95: 328ms
apollo-router 126 10272 total, 0 failed avg: 294ms, p95: 338ms
apollo-gateway 84 6919 total, 0 failed avg: 437ms, p95: 490ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41823     ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   202 kB/s
     http_req_blocked...............: avg=20.23µs  min=1.24µs   med=2.04µs   max=9.63ms   p(90)=3.47µs   p(95)=4.8µs    p(99.9)=7.12ms  
     http_req_connecting............: avg=17.51µs  min=0s       med=0s       max=9.6ms    p(90)=0s       p(95)=0s       p(99.9)=7.1ms   
     http_req_duration..............: avg=215.54ms min=158.04ms med=214.68ms max=600.05ms p(90)=224.08ms p(95)=226.9ms  p(99.9)=509.25ms
       { expected_response:true }...: avg=215.54ms min=158.04ms med=214.68ms max=600.05ms p(90)=224.08ms p(95)=226.9ms  p(99.9)=509.25ms
     http_req_failed................: 0.00%   ✓ 0         ✗ 14041
     http_req_receiving.............: avg=80.36µs  min=26.49µs  med=45.11µs  max=12.23ms  p(90)=96.84µs  p(95)=269.53µs p(99.9)=3.46ms  
     http_req_sending...............: avg=142.26µs min=5.51µs   med=8.75µs   max=373.01ms p(90)=33.43µs  p(95)=96.97µs  p(99.9)=6.56ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=215.32ms min=157.95ms med=214.57ms max=598.63ms p(90)=223.92ms p(95)=226.7ms  p(99.9)=489.53ms
     http_reqs......................: 14041   173.31373/s
     iteration_duration.............: avg=215.82ms min=158.17ms med=214.9ms  max=615.61ms p(90)=224.25ms p(95)=227.09ms p(99.9)=523.03ms
     iterations.....................: 13941   172.07939/s
     success_rate...................: 100.00% ✓ 13941     ✗ 0    
     vus............................: 50      min=0       max=50 
     vus_max........................: 50      min=50      max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40575      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   196 kB/s
     http_req_blocked...............: avg=43.9µs   min=1.16µs   med=2.17µs   max=15.1ms   p(90)=3.12µs   p(95)=4.14µs   p(99.9)=12.79ms 
     http_req_connecting............: avg=41.15µs  min=0s       med=0s       max=14.97ms  p(90)=0s       p(95)=0s       p(99.9)=12.77ms 
     http_req_duration..............: avg=222.09ms min=125.46ms med=221.54ms max=575.96ms p(90)=229.84ms p(95)=232.23ms p(99.9)=476.3ms 
       { expected_response:true }...: avg=222.09ms min=125.46ms med=221.54ms max=575.96ms p(90)=229.84ms p(95)=232.23ms p(99.9)=476.3ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 13625
     http_req_receiving.............: avg=74.48µs  min=23.29µs  med=41.57µs  max=16.61ms  p(90)=83.02µs  p(95)=259.28µs p(99.9)=2.59ms  
     http_req_sending...............: avg=123.26µs min=5.5µs    med=9.34µs   max=320.62ms p(90)=29.53µs  p(95)=95.77µs  p(99.9)=4.87ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=221.89ms min=125.42ms med=221.46ms max=573.86ms p(90)=229.7ms  p(95)=232.04ms p(99.9)=473.64ms
     http_reqs......................: 13625   168.275346/s
     iteration_duration.............: avg=222.44ms min=125.6ms  med=221.76ms max=595.86ms p(90)=230.03ms p(95)=232.4ms  p(99.9)=497.4ms 
     iterations.....................: 13525   167.040298/s
     success_rate...................: 100.00% ✓ 13525      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 37902      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 15 MB   183 kB/s
     http_req_blocked...............: avg=54.34µs  min=1.5µs    med=2.7µs    max=18.14ms  p(90)=4.03µs   p(95)=5.05µs   p(99.9)=15.51ms 
     http_req_connecting............: avg=50.41µs  min=0s       med=0s       max=17.92ms  p(90)=0s       p(95)=0s       p(99.9)=15.49ms 
     http_req_duration..............: avg=237.59ms min=158.81ms med=236.87ms max=615.7ms  p(90)=258.95ms p(95)=264.64ms p(99.9)=510.42ms
       { expected_response:true }...: avg=237.59ms min=158.81ms med=236.87ms max=615.7ms  p(90)=258.95ms p(95)=264.64ms p(99.9)=510.42ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12734
     http_req_receiving.............: avg=293.65µs min=33.66µs  med=64.85µs  max=42.5ms   p(90)=184.55µs p(95)=434.55µs p(99.9)=27.82ms 
     http_req_sending...............: avg=65.87µs  min=7.25µs   med=11.22µs  max=150.86ms p(90)=29.11µs  p(95)=117.6µs  p(99.9)=4.57ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=237.23ms min=158.7ms  med=236.56ms max=615.28ms p(90)=258.43ms p(95)=264.18ms p(99.9)=508.83ms
     http_reqs......................: 12734   156.96152/s
     iteration_duration.............: avg=238.14ms min=159.04ms med=237.25ms max=643.52ms p(90)=259.24ms p(95)=264.89ms p(99.9)=551.51ms
     iterations.....................: 12634   155.728902/s
     success_rate...................: 100.00% ✓ 12634      ✗ 0    
     vus............................: 44      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 34530      ✗ 0    
     data_received..................: 1.0 GB  13 MB/s
     data_sent......................: 14 MB   177 kB/s
     http_req_blocked...............: avg=63.45µs  min=1.18µs   med=2.6µs    max=18.23ms  p(90)=4.07µs   p(95)=5.49µs   p(99.9)=16.42ms 
     http_req_connecting............: avg=59.98µs  min=0s       med=0s       max=18.08ms  p(90)=0s       p(95)=0s       p(99.9)=16.36ms 
     http_req_duration..............: avg=260.01ms min=149.36ms med=251.25ms max=693.06ms p(90)=271.9ms  p(95)=378.48ms p(99.9)=584.53ms
       { expected_response:true }...: avg=260.01ms min=149.36ms med=251.25ms max=693.06ms p(90)=271.9ms  p(95)=378.48ms p(99.9)=584.53ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11610
     http_req_receiving.............: avg=93.22µs  min=25.62µs  med=44.75µs  max=57.58ms  p(90)=112.95µs p(95)=344.96µs p(99.9)=3.14ms  
     http_req_sending...............: avg=84.17µs  min=5.58µs   med=10.81µs  max=181.54ms p(90)=37.05µs  p(95)=135.36µs p(99.9)=5.08ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=259.83ms min=149.31ms med=251.11ms max=680.04ms p(90)=271.73ms p(95)=378.16ms p(99.9)=582.12ms
     http_reqs......................: 11610   152.028329/s
     iteration_duration.............: avg=261.22ms min=149.53ms med=251.53ms max=723.99ms p(90)=272.49ms p(95)=380.04ms p(99.9)=645.82ms
     iterations.....................: 11510   150.718869/s
     success_rate...................: 100.00% ✓ 11510      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 33825      ✗ 0    
     data_received..................: 999 MB  13 MB/s
     data_sent......................: 13 MB   172 kB/s
     http_req_blocked...............: avg=28.53µs  min=1.19µs   med=2.59µs   max=11.77ms  p(90)=4.13µs   p(95)=5.39µs   p(99.9)=8.92ms  
     http_req_connecting............: avg=25.15µs  min=0s       med=0s       max=11.52ms  p(90)=0s       p(95)=0s       p(99.9)=8.86ms  
     http_req_duration..............: avg=265.68ms min=122.68ms med=256.67ms max=762.29ms p(90)=276.15ms p(95)=327.67ms p(99.9)=647.13ms
       { expected_response:true }...: avg=265.68ms min=122.68ms med=256.67ms max=762.29ms p(90)=276.15ms p(95)=327.67ms p(99.9)=647.13ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11375
     http_req_receiving.............: avg=114.44µs min=25.46µs  med=45.63µs  max=178.92ms p(90)=114.31µs p(95)=352.91µs p(99.9)=3.2ms   
     http_req_sending...............: avg=177.65µs min=5.54µs   med=10.82µs  max=236.76ms p(90)=36.87µs  p(95)=143.01µs p(99.9)=13.38ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=265.39ms min=122.63ms med=256.51ms max=761.01ms p(90)=275.65ms p(95)=326.1ms  p(99.9)=639.59ms
     http_reqs......................: 11375   148.266054/s
     iteration_duration.............: avg=266.93ms min=122.81ms med=256.94ms max=782.05ms p(90)=276.55ms p(95)=338.95ms p(99.9)=704.11ms
     iterations.....................: 11275   146.962616/s
     success_rate...................: 100.00% ✓ 11275      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 30516      ✗ 0    
     data_received..................: 901 MB  11 MB/s
     data_sent......................: 12 MB   147 kB/s
     http_req_blocked...............: avg=25.84µs  min=1.69µs   med=2.8µs    max=9.14ms   p(90)=4.02µs   p(95)=4.95µs   p(99.9)=7.32ms  
     http_req_connecting............: avg=22.21µs  min=0s       med=0s       max=9.11ms   p(90)=0s       p(95)=0s       p(99.9)=7.3ms   
     http_req_duration..............: avg=294.1ms  min=176.95ms med=295.42ms max=711.57ms p(90)=329.33ms p(95)=338.17ms p(99.9)=630.68ms
       { expected_response:true }...: avg=294.1ms  min=176.95ms med=295.42ms max=711.57ms p(90)=329.33ms p(95)=338.17ms p(99.9)=630.68ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10272
     http_req_receiving.............: avg=87.72µs  min=35.28µs  med=51.14µs  max=5.59ms   p(90)=110.17µs p(95)=251.56µs p(99.9)=1.51ms  
     http_req_sending...............: avg=114.21µs min=7.56µs   med=11.04µs  max=261.57ms p(90)=29.25µs  p(95)=129.26µs p(99.9)=4.16ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=293.9ms  min=176.87ms med=295.27ms max=710.08ms p(90)=329.17ms p(95)=337.92ms p(99.9)=629.23ms
     http_reqs......................: 10272   126.341751/s
     iteration_duration.............: avg=295.29ms min=177.11ms med=295.98ms max=749.12ms p(90)=329.71ms p(95)=338.54ms p(99.9)=665.35ms
     iterations.....................: 10172   125.111788/s
     success_rate...................: 100.00% ✓ 10172      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 20457     ✗ 0   
     data_received..................: 608 MB  7.4 MB/s
     data_sent......................: 8.0 MB  99 kB/s
     http_req_blocked...............: avg=46.17µs  min=1.39µs   med=3.29µs   max=11.32ms  p(90)=5.35µs   p(95)=6.15µs   p(99.9)=9.85ms  
     http_req_connecting............: avg=41.41µs  min=0s       med=0s       max=11.28ms  p(90)=0s       p(95)=0s       p(99.9)=9.82ms  
     http_req_duration..............: avg=437.09ms min=211.92ms med=438.83ms max=872.63ms p(90)=476.06ms p(95)=489.73ms p(99.9)=786.4ms 
       { expected_response:true }...: avg=437.09ms min=211.92ms med=438.83ms max=872.63ms p(90)=476.06ms p(95)=489.73ms p(99.9)=786.4ms 
     http_req_failed................: 0.00%   ✓ 0         ✗ 6919
     http_req_receiving.............: avg=72.94µs  min=30.26µs  med=60.38µs  max=3.02ms   p(90)=110.11µs p(95)=130.9µs  p(99.9)=563.43µs
     http_req_sending...............: avg=140.43µs min=6.18µs   med=13.03µs  max=229.76ms p(90)=22.83µs  p(95)=33.07µs  p(99.9)=5.98ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=436.88ms min=211.76ms med=438.75ms max=871.1ms  p(90)=475.89ms p(95)=489.47ms p(99.9)=786.17ms
     http_reqs......................: 6919    84.672004/s
     iteration_duration.............: avg=440.73ms min=288.86ms med=439.43ms max=889.46ms p(90)=476.74ms p(95)=490.58ms p(99.9)=805.5ms 
     iterations.....................: 6819    83.448244/s
     success_rate...................: 100.00% ✓ 6819      ✗ 0   
     vus............................: 50      min=0       max=50
     vus_max........................: 50      min=50      max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Sep 17, 2025

Overview for: ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 500 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1933 120620 total, 0 failed avg: 116ms, p95: 284ms
grafbase 1618 102388 total, 0 failed avg: 136ms, p95: 322ms
cosmo 701 44708 total, 0 failed avg: 314ms, p95: 695ms
apollo-router 401 26955 total, 0 failed avg: 523ms, p95: 1190ms ❌ 22 unexpected GraphQL errors
hive-gateway-bun 270 18757 total, 0 failed avg: 750ms, p95: 1626ms
hive-gateway 266 18555 total, 0 failed avg: 756ms, p95: 1636ms
apollo-gateway 153 10596 total, 0 failed avg: 1228ms, p95: 2676ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 358860      ✗ 0     
     data_received..................: 11 GB   170 MB/s
     data_sent......................: 140 MB  2.2 MB/s
     http_req_blocked...............: avg=362.74µs min=1.11µs med=2.45µs   max=296.99ms p(90)=3.86µs   p(95)=4.73µs   p(99.9)=132.85ms
     http_req_connecting............: avg=358.74µs min=0s     med=0s       max=296.91ms p(90)=0s       p(95)=0s       p(99.9)=132.78ms
     http_req_duration..............: avg=115.52ms min=1.79ms med=102.4ms  max=436.02ms p(90)=238.22ms p(95)=283.71ms p(99.9)=389ms   
       { expected_response:true }...: avg=115.52ms min=1.79ms med=102.4ms  max=436.02ms p(90)=238.22ms p(95)=283.71ms p(99.9)=389ms   
     http_req_failed................: 0.00%   ✓ 0           ✗ 120620
     http_req_receiving.............: avg=472.54µs min=23.1µs med=42.01µs  max=131.85ms p(90)=204.79µs p(95)=395.95µs p(99.9)=68.74ms 
     http_req_sending...............: avg=337.69µs min=5.29µs med=10.01µs  max=122.68ms p(90)=30.02µs  p(95)=127.41µs p(99.9)=59.29ms 
     http_req_tls_handshaking.......: avg=0s       min=0s     med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=114.71ms min=1.73ms med=101.67ms max=435.96ms p(90)=236.25ms p(95)=281.66ms p(99.9)=385.12ms
     http_reqs......................: 120620  1933.117984/s
     iteration_duration.............: avg=117.09ms min=1.93ms med=103.76ms max=704.7ms  p(90)=240.36ms p(95)=285.68ms p(99.9)=406.79ms
     iterations.....................: 119620  1917.091471/s
     success_rate...................: 100.00% ✓ 119620      ✗ 0     
     vus............................: 77      min=0         max=493 
     vus_max........................: 500     min=500       max=500 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 304164      ✗ 0     
     data_received..................: 9.0 GB  142 MB/s
     data_sent......................: 119 MB  1.9 MB/s
     http_req_blocked...............: avg=540.81µs min=1.17µs  med=3.07µs   max=360.4ms  p(90)=4.62µs   p(95)=5.88µs   p(99.9)=185.26ms
     http_req_connecting............: avg=536.13µs min=0s      med=0s       max=360.34ms p(90)=0s       p(95)=0s       p(99.9)=185.13ms
     http_req_duration..............: avg=136.02ms min=2.58ms  med=124.25ms max=512.94ms p(90)=274.87ms p(95)=322.08ms p(99.9)=435.07ms
       { expected_response:true }...: avg=136.02ms min=2.58ms  med=124.25ms max=512.94ms p(90)=274.87ms p(95)=322.08ms p(99.9)=435.07ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 102388
     http_req_receiving.............: avg=591.7µs  min=25.69µs med=47.98µs  max=248.17ms p(90)=183.17µs p(95)=451.69µs p(99.9)=82.97ms 
     http_req_sending...............: avg=467.6µs  min=5.74µs  med=11.7µs   max=151.95ms p(90)=34.01µs  p(95)=142.95µs p(99.9)=81.34ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=134.96ms min=2.53ms  med=123.25ms max=503.55ms p(90)=272.5ms  p(95)=319.84ms p(99.9)=431.25ms
     http_reqs......................: 102388  1618.075146/s
     iteration_duration.............: avg=138.22ms min=2.9ms   med=125.98ms max=770.53ms p(90)=277.45ms p(95)=324.92ms p(99.9)=468.57ms
     iterations.....................: 101388  1602.271779/s
     success_rate...................: 100.00% ✓ 101388      ✗ 0     
     vus............................: 73      min=0         max=495 
     vus_max........................: 500     min=500       max=500 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 131124     ✗ 0    
     data_received..................: 3.9 GB  62 MB/s
     data_sent......................: 52 MB   816 kB/s
     http_req_blocked...............: avg=99.69µs  min=1.23µs  med=2.83µs   max=123.63ms p(90)=4.32µs   p(95)=5.98µs   p(99.9)=36.11ms 
     http_req_connecting............: avg=94.9µs   min=0s      med=0s       max=123.56ms p(90)=0s       p(95)=0s       p(99.9)=36.04ms 
     http_req_duration..............: avg=314.06ms min=2.73ms  med=301.8ms  max=1.08s    p(90)=617.75ms p(95)=694.72ms p(99.9)=975.31ms
       { expected_response:true }...: avg=314.06ms min=2.73ms  med=301.8ms  max=1.08s    p(90)=617.75ms p(95)=694.72ms p(99.9)=975.31ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 44708
     http_req_receiving.............: avg=459.01µs min=28.68µs med=61.47µs  max=143.25ms p(90)=214.62µs p(95)=480.81µs p(99.9)=69.16ms 
     http_req_sending...............: avg=165.99µs min=5.9µs   med=11.37µs  max=159.5ms  p(90)=31.03µs  p(95)=130.57µs p(99.9)=35.75ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=313.44ms min=2.64ms  med=301.19ms max=1.08s    p(90)=616.96ms p(95)=693.46ms p(99.9)=970.57ms
     http_reqs......................: 44708   701.142165/s
     iteration_duration.............: avg=321.73ms min=2.99ms  med=310.03ms max=1.12s    p(90)=621.26ms p(95)=697.39ms p(99.9)=979.91ms
     iterations.....................: 43708   685.459465/s
     success_rate...................: 100.00% ✓ 43708      ✗ 0    
     vus............................: 57      min=0        max=499
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  99% — ✓ 25933 / ✗ 22
     ✓ valid response structure

     checks.........................: 99.97% ✓ 77843      ✗ 22   
     data_received..................: 2.4 GB 35 MB/s
     data_sent......................: 31 MB  469 kB/s
     http_req_blocked...............: avg=86.78µs  min=1.62µs  med=2.88µs   max=134.16ms p(90)=4.64µs   p(95)=7.31µs   p(99.9)=25.52ms
     http_req_connecting............: avg=81.81µs  min=0s      med=0s       max=134.09ms p(90)=0s       p(95)=0s       p(99.9)=25.46ms
     http_req_duration..............: avg=523.28ms min=6.18ms  med=483.82ms max=2.29s    p(90)=1.04s    p(95)=1.18s    p(99.9)=1.8s   
       { expected_response:true }...: avg=523.28ms min=6.18ms  med=483.82ms max=2.29s    p(90)=1.04s    p(95)=1.18s    p(99.9)=1.8s   
     http_req_failed................: 0.00%  ✓ 0          ✗ 26955
     http_req_receiving.............: avg=117.09µs min=28.83µs med=51.27µs  max=81.25ms  p(90)=101.86µs p(95)=196.04µs p(99.9)=7.84ms 
     http_req_sending...............: avg=107.99µs min=6.4µs   med=11.62µs  max=108.83ms p(90)=30.99µs  p(95)=117.01µs p(99.9)=20.32ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=523.06ms min=6.14ms  med=483.57ms max=2.29s    p(90)=1.04s    p(95)=1.18s    p(99.9)=1.8s   
     http_reqs......................: 26955  401.876536/s
     iteration_duration.............: avg=543.83ms min=6.5ms   med=507.84ms max=2.29s    p(90)=1.05s    p(95)=1.19s    p(99.9)=1.82s  
     iterations.....................: 25955  386.967372/s
     success_rate...................: 99.91% ✓ 25933      ✗ 22   
     vus............................: 64     min=0        max=500
     vus_max........................: 500    min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 53271      ✗ 0    
     data_received..................: 1.6 GB  24 MB/s
     data_sent......................: 22 MB   317 kB/s
     http_req_blocked...............: avg=114.07µs min=1.28µs med=2.86µs   max=175.36ms p(90)=4.95µs  p(95)=7.96µs   p(99.9)=31.43ms
     http_req_connecting............: avg=108.36µs min=0s     med=0s       max=175.2ms  p(90)=0s      p(95)=0s       p(99.9)=31.27ms
     http_req_duration..............: avg=749.51ms min=6.97ms med=699.33ms max=4.68s    p(90)=1.47s   p(95)=1.62s    p(99.9)=3.69s  
       { expected_response:true }...: avg=749.51ms min=6.97ms med=699.33ms max=4.68s    p(90)=1.47s   p(95)=1.62s    p(99.9)=3.69s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 18757
     http_req_receiving.............: avg=179.98µs min=25.6µs med=44.63µs  max=138.02ms p(90)=95.17µs p(95)=297.06µs p(99.9)=26.63ms
     http_req_sending...............: avg=174.14µs min=5.94µs med=11.03µs  max=78.22ms  p(90)=33.02µs p(95)=124.19µs p(99.9)=33.78ms
     http_req_tls_handshaking.......: avg=0s       min=0s     med=0s       max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=749.15ms min=6.91ms med=699.26ms max=4.68s    p(90)=1.47s   p(95)=1.62s    p(99.9)=3.69s  
     http_reqs......................: 18757   270.485305/s
     iteration_duration.............: avg=792ms    min=7.7ms  med=754.62ms max=4.69s    p(90)=1.48s   p(95)=1.63s    p(99.9)=3.74s  
     iterations.....................: 17757   256.064806/s
     success_rate...................: 100.00% ✓ 17757      ✗ 0    
     vus............................: 87      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 52665      ✗ 0    
     data_received..................: 1.6 GB  23 MB/s
     data_sent......................: 22 MB   313 kB/s
     http_req_blocked...............: avg=96.71µs  min=1.4µs   med=2.76µs   max=188.62ms p(90)=4.53µs  p(95)=6.94µs   p(99.9)=23.67ms
     http_req_connecting............: avg=91.54µs  min=0s      med=0s       max=188.45ms p(90)=0s      p(95)=0s       p(99.9)=23.63ms
     http_req_duration..............: avg=755.97ms min=6.98ms  med=701.34ms max=5.17s    p(90)=1.49s   p(95)=1.63s    p(99.9)=3.77s  
       { expected_response:true }...: avg=755.97ms min=6.98ms  med=701.34ms max=5.17s    p(90)=1.49s   p(95)=1.63s    p(99.9)=3.77s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 18555
     http_req_receiving.............: avg=162.02µs min=27.36µs med=44.07µs  max=135.63ms p(90)=85.96µs p(95)=146.77µs p(99.9)=20.25ms
     http_req_sending...............: avg=162.89µs min=5.59µs  med=10.9µs   max=133.6ms  p(90)=28.67µs p(95)=74.54µs  p(99.9)=28.43ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=755.64ms min=6.93ms  med=701.07ms max=5.17s    p(90)=1.49s   p(95)=1.63s    p(99.9)=3.77s  
     http_reqs......................: 18555   266.664255/s
     iteration_duration.............: avg=799.27ms min=7.25ms  med=757.96ms max=5.18s    p(90)=1.51s   p(95)=1.64s    p(99.9)=3.81s  
     iterations.....................: 17555   252.292697/s
     success_rate...................: 100.00% ✓ 17555      ✗ 0    
     vus............................: 91      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 28788      ✗ 0    
     data_received..................: 931 MB  14 MB/s
     data_sent......................: 13 MB   183 kB/s
     http_req_blocked...............: avg=24.43µs min=1.31µs  med=3.24µs  max=15.53ms p(90)=5.3µs   p(95)=11.12µs  p(99.9)=3.33ms
     http_req_connecting............: avg=18.58µs min=0s      med=0s      max=15.47ms p(90)=0s      p(95)=0s       p(99.9)=3.27ms
     http_req_duration..............: avg=1.22s   min=7.41ms  med=1.18s   max=16.02s  p(90)=2.2s    p(95)=2.67s    p(99.9)=14.42s
       { expected_response:true }...: avg=1.22s   min=7.41ms  med=1.18s   max=16.02s  p(90)=2.2s    p(95)=2.67s    p(99.9)=14.42s
     http_req_failed................: 0.00%   ✓ 0          ✗ 10596
     http_req_receiving.............: avg=73.52µs min=25.08µs med=52.76µs max=15.16ms p(90)=98.8µs  p(95)=121.71µs p(99.9)=1.67ms
     http_req_sending...............: avg=34.81µs min=6.11µs  med=12.51µs max=17.68ms p(90)=27.95µs p(95)=43.62µs  p(99.9)=5.88ms
     http_req_tls_handshaking.......: avg=0s      min=0s      med=0s      max=0s      p(90)=0s      p(95)=0s       p(99.9)=0s    
     http_req_waiting...............: avg=1.22s   min=7.35ms  med=1.18s   max=16.02s  p(90)=2.2s    p(95)=2.67s    p(99.9)=14.42s
     http_reqs......................: 10596   153.376385/s
     iteration_duration.............: avg=1.35s   min=7.73ms  med=1.31s   max=16.03s  p(90)=2.27s   p(95)=2.7s     p(99.9)=14.58s
     iterations.....................: 9596    138.901453/s
     success_rate...................: 100.00% ✓ 9596       ✗ 0    
     vus............................: 76      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@renovate renovate bot force-pushed the renovate/graphql-hive-gateway-monorepo branch from bcafb7b to 1a2e4e3 Compare September 19, 2025 14:23
@renovate renovate bot changed the title Update dependency @graphql-hive/gateway to v2.1.4 Update dependency @graphql-hive/gateway to v2.1.5 Sep 19, 2025
@renovate renovate bot force-pushed the renovate/graphql-hive-gateway-monorepo branch from 1a2e4e3 to 98609de Compare September 19, 2025 18:47
@renovate renovate bot changed the title Update dependency @graphql-hive/gateway to v2.1.5 Update dependency @graphql-hive/gateway to v2.1.6 Sep 19, 2025
@ardatan ardatan merged commit a83cce8 into main Sep 19, 2025
34 checks passed
@ardatan ardatan deleted the renovate/graphql-hive-gateway-monorepo branch September 19, 2025 18:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant