Skip to content

Conversation

renovate[bot]
Copy link
Contributor

@renovate renovate bot commented Oct 8, 2025

This PR contains the following updates:

Package Change Age Confidence
npm (source) 11.6.1 -> 11.6.2 age confidence

Release Notes

npm/cli (npm)

v11.6.2

Compare Source

Bug Fixes
Documentation
Dependencies
Chores

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.


  • If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

@renovate renovate bot added the dependencies Pull requests that update a dependency file label Oct 8, 2025
Copy link

github-actions bot commented Oct 8, 2025

💻 Website Preview

The latest changes are available as preview in: https://3ecbc23c.federation-gateway-benchmark.pages.dev

Copy link

github-actions bot commented Oct 8, 2025

Overview for: constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1786 107756 total, 0 failed avg: 28ms, p95: 49ms
grafbase 1607 96946 total, 0 failed avg: 31ms, p95: 54ms
cosmo 703 42486 total, 0 failed avg: 70ms, p95: 103ms
apollo-router 389 23651 total, 0 failed avg: 127ms, p95: 165ms
hive-gateway 301 18354 total, 0 failed avg: 163ms, p95: 232ms
hive-gateway-bun 298 18233 total, 0 failed avg: 164ms, p95: 332ms
apollo-gateway 122 7471 total, 0 failed avg: 402ms, p95: 473ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 322968      ✗ 0     
     data_received..................: 9.5 GB  157 MB/s
     data_sent......................: 125 MB  2.1 MB/s
     http_req_blocked...............: avg=5.7µs    min=1.16µs  med=2.54µs  max=10.82ms  p(90)=3.65µs   p(95)=4.29µs   p(99.9)=100.44µs
     http_req_connecting............: avg=2.66µs   min=0s      med=0s      max=10.75ms  p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_duration..............: avg=27.6ms   min=2.13ms  med=25.09ms max=442.97ms p(90)=42.84ms  p(95)=49.13ms  p(99.9)=90.87ms 
       { expected_response:true }...: avg=27.6ms   min=2.13ms  med=25.09ms max=442.97ms p(90)=42.84ms  p(95)=49.13ms  p(99.9)=90.87ms 
     http_req_failed................: 0.00%   ✓ 0           ✗ 107756
     http_req_receiving.............: avg=122.12µs min=23.51µs med=42.55µs max=64.01ms  p(90)=106.48µs p(95)=341.83µs p(99.9)=14.08ms 
     http_req_sending...............: avg=100.61µs min=4.91µs  med=9.93µs  max=317.25ms p(90)=29.35µs  p(95)=125.05µs p(99.9)=15.05ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=27.38ms  min=2.09ms  med=24.91ms max=441.62ms p(90)=42.43ms  p(95)=48.66ms  p(99.9)=89.59ms 
     http_reqs......................: 107756  1786.960547/s
     iteration_duration.............: avg=27.86ms  min=4.98ms  med=25.32ms max=482.96ms p(90)=43.08ms  p(95)=49.37ms  p(99.9)=91.39ms 
     iterations.....................: 107656  1785.302208/s
     success_rate...................: 100.00% ✓ 107656      ✗ 0     
     vus............................: 50      min=50        max=50  
     vus_max........................: 50      min=50        max=50  

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 290538      ✗ 0    
     data_received..................: 8.5 GB  141 MB/s
     data_sent......................: 113 MB  1.9 MB/s
     http_req_blocked...............: avg=6.09µs   min=1.17µs  med=2.99µs  max=9.44ms   p(90)=4.07µs   p(95)=4.7µs    p(99.9)=114.58µs
     http_req_connecting............: avg=2.46µs   min=0s      med=0s      max=9.4ms    p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_duration..............: avg=30.66ms  min=2.47ms  med=27.59ms max=456.69ms p(90)=47.04ms  p(95)=53.58ms  p(99.9)=91.95ms 
       { expected_response:true }...: avg=30.66ms  min=2.47ms  med=27.59ms max=456.69ms p(90)=47.04ms  p(95)=53.58ms  p(99.9)=91.95ms 
     http_req_failed................: 0.00%   ✓ 0           ✗ 96946
     http_req_receiving.............: avg=151.46µs min=26.24µs med=46.09µs max=107.18ms p(90)=130.93µs p(95)=387.23µs p(99.9)=17.61ms 
     http_req_sending...............: avg=124.41µs min=5.03µs  med=11.32µs max=398.49ms p(90)=35.95µs  p(95)=134.34µs p(99.9)=18.87ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=30.39ms  min=2.42ms  med=27.39ms max=443.12ms p(90)=46.5ms   p(95)=53ms     p(99.9)=90.44ms 
     http_reqs......................: 96946   1607.061996/s
     iteration_duration.............: avg=30.97ms  min=6.85ms  med=27.87ms max=475.11ms p(90)=47.32ms  p(95)=53.87ms  p(99.9)=92.5ms  
     iterations.....................: 96846   1605.404309/s
     success_rate...................: 100.00% ✓ 96846       ✗ 0    
     vus............................: 50      min=50        max=50 
     vus_max........................: 50      min=50        max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 127158     ✗ 0    
     data_received..................: 3.7 GB  62 MB/s
     data_sent......................: 49 MB   818 kB/s
     http_req_blocked...............: avg=8.96µs   min=1.24µs  med=2.72µs  max=9.74ms   p(90)=3.75µs   p(95)=4.44µs   p(99.9)=1.42ms  
     http_req_connecting............: avg=5.46µs   min=0s      med=0s      max=9.48ms   p(90)=0s       p(95)=0s       p(99.9)=1.23ms  
     http_req_duration..............: avg=70.35ms  min=2.72ms  med=69.29ms max=504.12ms p(90)=95.27ms  p(95)=102.92ms p(99.9)=287.35ms
       { expected_response:true }...: avg=70.35ms  min=2.72ms  med=69.29ms max=504.12ms p(90)=95.27ms  p(95)=102.92ms p(99.9)=287.35ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 42486
     http_req_receiving.............: avg=171.45µs min=30.02µs med=65.9µs  max=353.77ms p(90)=134.07µs p(95)=361.13µs p(99.9)=18.13ms 
     http_req_sending...............: avg=61.71µs  min=6.17µs  med=11.18µs max=393.11ms p(90)=28.41µs  p(95)=122.01µs p(99.9)=3.65ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=70.11ms  min=2.62ms  med=69.11ms max=494.14ms p(90)=94.99ms  p(95)=102.69ms p(99.9)=271.62ms
     http_reqs......................: 42486   703.118841/s
     iteration_duration.............: avg=70.8ms   min=7.66ms  med=69.61ms max=514.64ms p(90)=95.59ms  p(95)=103.26ms p(99.9)=292.96ms
     iterations.....................: 42386   701.463899/s
     success_rate...................: 100.00% ✓ 42386      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 70653      ✗ 0    
     data_received..................: 2.1 GB  34 MB/s
     data_sent......................: 28 MB   453 kB/s
     http_req_blocked...............: avg=13.92µs  min=1.86µs  med=3µs      max=9.41ms   p(90)=4.16µs   p(95)=4.86µs   p(99.9)=5.27ms  
     http_req_connecting............: avg=10.33µs  min=0s      med=0s       max=9.37ms   p(90)=0s       p(95)=0s       p(99.9)=5.25ms  
     http_req_duration..............: avg=126.67ms min=5.53ms  med=125.68ms max=584.71ms p(90)=155.91ms p(95)=164.92ms p(99.9)=419.75ms
       { expected_response:true }...: avg=126.67ms min=5.53ms  med=125.68ms max=584.71ms p(90)=155.91ms p(95)=164.92ms p(99.9)=419.75ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 23651
     http_req_receiving.............: avg=91.08µs  min=34.07µs med=52.36µs  max=309.42ms p(90)=101.37µs p(95)=129.44µs p(99.9)=1.7ms   
     http_req_sending...............: avg=74.01µs  min=6.99µs  med=11.64µs  max=347.35ms p(90)=18.51µs  p(95)=33.97µs  p(99.9)=2.18ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=126.5ms  min=5.48ms  med=125.58ms max=564.43ms p(90)=155.78ms p(95)=164.8ms  p(99.9)=409.97ms
     http_reqs......................: 23651   389.319004/s
     iteration_duration.............: avg=127.5ms  min=25.88ms med=126.03ms max=630.34ms p(90)=156.26ms p(95)=165.29ms p(99.9)=427.38ms
     iterations.....................: 23551   387.672904/s
     success_rate...................: 100.00% ✓ 23551      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 54762      ✗ 0    
     data_received..................: 1.6 GB  27 MB/s
     data_sent......................: 21 MB   350 kB/s
     http_req_blocked...............: avg=20.04µs  min=1.23µs  med=2.75µs   max=11.72ms  p(90)=4.64µs   p(95)=5.91µs   p(99.9)=7.4ms 
     http_req_connecting............: avg=16.09µs  min=0s      med=0s       max=11.67ms  p(90)=0s       p(95)=0s       p(99.9)=7.37ms
     http_req_duration..............: avg=163.16ms min=6.73ms  med=148.93ms max=1.14s    p(90)=193.18ms p(95)=232.09ms p(99.9)=1.09s 
       { expected_response:true }...: avg=163.16ms min=6.73ms  med=148.93ms max=1.14s    p(90)=193.18ms p(95)=232.09ms p(99.9)=1.09s 
     http_req_failed................: 0.00%   ✓ 0          ✗ 18354
     http_req_receiving.............: avg=103.08µs min=27.58µs med=47.76µs  max=113.46ms p(90)=107.59µs p(95)=225.81µs p(99.9)=4.44ms
     http_req_sending...............: avg=70.32µs  min=5.7µs   med=11.46µs  max=150.32ms p(90)=32.94µs  p(95)=132.73µs p(99.9)=5.38ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s    
     http_req_waiting...............: avg=162.98ms min=6.67ms  med=148.8ms  max=1.14s    p(90)=192.86ms p(95)=231.06ms p(99.9)=1.09s 
     http_reqs......................: 18354   301.265032/s
     iteration_duration.............: avg=164.44ms min=36.18ms med=149.41ms max=1.14s    p(90)=193.66ms p(95)=234.37ms p(99.9)=1.09s 
     iterations.....................: 18254   299.623619/s
     success_rate...................: 100.00% ✓ 18254      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 54399      ✗ 0    
     data_received..................: 1.6 GB  26 MB/s
     data_sent......................: 21 MB   348 kB/s
     http_req_blocked...............: avg=21.61µs  min=1.17µs  med=2.8µs    max=12.33ms  p(90)=4.44µs   p(95)=5.55µs   p(99.9)=7.76ms  
     http_req_connecting............: avg=17.51µs  min=0s      med=0s       max=12.29ms  p(90)=0s       p(95)=0s       p(99.9)=7.73ms  
     http_req_duration..............: avg=164.41ms min=7.13ms  med=152.04ms max=666.12ms p(90)=185.61ms p(95)=331.94ms p(99.9)=517.23ms
       { expected_response:true }...: avg=164.41ms min=7.13ms  med=152.04ms max=666.12ms p(90)=185.61ms p(95)=331.94ms p(99.9)=517.23ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 18233
     http_req_receiving.............: avg=110.29µs min=27.29µs med=46.56µs  max=334.61ms p(90)=100.13µs p(95)=167.01µs p(99.9)=3.9ms   
     http_req_sending...............: avg=131.41µs min=5.8µs   med=11.36µs  max=448.18ms p(90)=32.29µs  p(95)=122.42µs p(99.9)=6.21ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=164.16ms min=7.07ms  med=151.91ms max=665.79ms p(90)=185.47ms p(95)=329.27ms p(99.9)=516.49ms
     http_reqs......................: 18233   298.934587/s
     iteration_duration.............: avg=165.67ms min=25.55ms med=152.48ms max=714.41ms p(90)=186.05ms p(95)=333.74ms p(99.9)=550.41ms
     iterations.....................: 18133   297.295062/s
     success_rate...................: 100.00% ✓ 18133      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 22113      ✗ 0   
     data_received..................: 656 MB  11 MB/s
     data_sent......................: 8.7 MB  142 kB/s
     http_req_blocked...............: avg=42µs     min=1.25µs   med=2.88µs   max=11.29ms  p(90)=4.32µs   p(95)=5.12µs   p(99.9)=9.66ms  
     http_req_connecting............: avg=38.69µs  min=0s       med=0s       max=11.26ms  p(90)=0s       p(95)=0s       p(99.9)=9.63ms  
     http_req_duration..............: avg=402.36ms min=7.15ms   med=402.33ms max=751.49ms p(90)=455.99ms p(95)=472.55ms p(99.9)=667.24ms
       { expected_response:true }...: avg=402.36ms min=7.15ms   med=402.33ms max=751.49ms p(90)=455.99ms p(95)=472.55ms p(99.9)=667.24ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 7471
     http_req_receiving.............: avg=59.86µs  min=26.31µs  med=49.67µs  max=1.13ms   p(90)=90.25µs  p(95)=104.76µs p(99.9)=607.53µs
     http_req_sending...............: avg=134.31µs min=5.73µs   med=11.89µs  max=256.43ms p(90)=18.47µs  p(95)=22.58µs  p(99.9)=10.24ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=402.17ms min=7.1ms    med=402.24ms max=751.29ms p(90)=455.82ms p(95)=472.47ms p(99.9)=667.05ms
     http_reqs......................: 7471    122.238205/s
     iteration_duration.............: avg=408.1ms  min=103.34ms med=402.92ms max=781.14ms p(90)=456.55ms p(95)=473.13ms p(99.9)=699.37ms
     iterations.....................: 7371    120.602036/s
     success_rate...................: 100.00% ✓ 7371       ✗ 0   
     vus............................: 27      min=27       max=50
     vus_max........................: 50      min=50       max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Oct 8, 2025

Overview for: ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 500 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1717 107101 total, 0 failed avg: 130ms, p95: 314ms
grafbase 1470 93311 total, 0 failed avg: 149ms, p95: 352ms
cosmo 683 43606 total, 0 failed avg: 322ms, p95: 716ms
apollo-router 395 26544 total, 0 failed avg: 531ms, p95: 1212ms ❌ 12 unexpected GraphQL errors
hive-gateway 263 18046 total, 0 failed avg: 777ms, p95: 1671ms
hive-gateway-bun 254 17827 total, 0 failed avg: 786ms, p95: 1695ms
apollo-gateway 157 10763 total, 0 failed avg: 1212ms, p95: 2677ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 318303      ✗ 0     
     data_received..................: 9.4 GB  151 MB/s
     data_sent......................: 125 MB  2.0 MB/s
     http_req_blocked...............: avg=532.6µs  min=1.12µs  med=2.75µs   max=365.11ms p(90)=4.5µs    p(95)=5.56µs   p(99.9)=181.02ms
     http_req_connecting............: avg=528.12µs min=0s      med=0s       max=365.07ms p(90)=0s       p(95)=0s       p(99.9)=180.97ms
     http_req_duration..............: avg=130ms    min=1.89ms  med=116.26ms max=474.61ms p(90)=264.98ms p(95)=313.99ms p(99.9)=410.24ms
       { expected_response:true }...: avg=130ms    min=1.89ms  med=116.26ms max=474.61ms p(90)=264.98ms p(95)=313.99ms p(99.9)=410.24ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 107101
     http_req_receiving.............: avg=593.4µs  min=23.59µs med=44.03µs  max=134.76ms p(90)=159.36µs p(95)=428.84µs p(99.9)=85.32ms 
     http_req_sending...............: avg=486.24µs min=5.37µs  med=10.49µs  max=145.34ms p(90)=30.51µs  p(95)=138.51µs p(99.9)=76.41ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=128.92ms min=1.81ms  med=115.08ms max=450.47ms p(90)=262.36ms p(95)=311.73ms p(99.9)=406.31ms
     http_reqs......................: 107101  1717.641424/s
     iteration_duration.............: avg=132.07ms min=2.06ms  med=118.13ms max=836.92ms p(90)=267.36ms p(95)=316.51ms p(99.9)=447.31ms
     iterations.....................: 106101  1701.603839/s
     success_rate...................: 100.00% ✓ 106101      ✗ 0     
     vus............................: 77      min=0         max=494 
     vus_max........................: 500     min=500       max=500 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 276933      ✗ 0    
     data_received..................: 8.2 GB  129 MB/s
     data_sent......................: 109 MB  1.7 MB/s
     http_req_blocked...............: avg=770.07µs min=1.18µs  med=3.16µs   max=590.97ms p(90)=4.86µs   p(95)=6µs      p(99.9)=236.65ms
     http_req_connecting............: avg=764.85µs min=0s      med=0s       max=590.87ms p(90)=0s       p(95)=0s       p(99.9)=236.43ms
     http_req_duration..............: avg=149.01ms min=2.59ms  med=136.88ms max=544.61ms p(90)=295.29ms p(95)=351.7ms  p(99.9)=458.67ms
       { expected_response:true }...: avg=149.01ms min=2.59ms  med=136.88ms max=544.61ms p(90)=295.29ms p(95)=351.7ms  p(99.9)=458.67ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 93311
     http_req_receiving.............: avg=675.08µs min=27.03µs med=49.22µs  max=156.15ms p(90)=129.06µs p(95)=472.46µs p(99.9)=91.65ms 
     http_req_sending...............: avg=627.02µs min=5.52µs  med=12.02µs  max=151.73ms p(90)=32.37µs  p(95)=151.38µs p(99.9)=90.47ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=147.71ms min=2.55ms  med=135.61ms max=506.25ms p(90)=292.42ms p(95)=348.56ms p(99.9)=455.31ms
     http_reqs......................: 93311   1470.256284/s
     iteration_duration.............: avg=151.83ms min=2.87ms  med=139.32ms max=1.26s    p(90)=298.97ms p(95)=355.91ms p(99.9)=555.9ms 
     iterations.....................: 92311   1454.499768/s
     success_rate...................: 100.00% ✓ 92311       ✗ 0    
     vus............................: 82      min=0         max=497
     vus_max........................: 500     min=500       max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 127818     ✗ 0    
     data_received..................: 3.8 GB  60 MB/s
     data_sent......................: 51 MB   796 kB/s
     http_req_blocked...............: avg=152.53µs min=1.26µs  med=3µs      max=223.92ms p(90)=4.59µs   p(95)=6.31µs   p(99.9)=46.45ms
     http_req_connecting............: avg=146.97µs min=0s      med=0s       max=223.88ms p(90)=0s       p(95)=0s       p(99.9)=46.39ms
     http_req_duration..............: avg=321.88ms min=2.8ms   med=297.04ms max=1.44s    p(90)=640.21ms p(95)=715.54ms p(99.9)=1.06s  
       { expected_response:true }...: avg=321.88ms min=2.8ms   med=297.04ms max=1.44s    p(90)=640.21ms p(95)=715.54ms p(99.9)=1.06s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 43606
     http_req_receiving.............: avg=569.61µs min=28.09µs med=60.13µs  max=186.67ms p(90)=199.98µs p(95)=506.2µs  p(99.9)=74.51ms
     http_req_sending...............: avg=186.03µs min=5.86µs  med=11.51µs  max=150.96ms p(90)=34.04µs  p(95)=135.34µs p(99.9)=37.29ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=321.13ms min=2.71ms  med=295.77ms max=1.44s    p(90)=639.33ms p(95)=714.71ms p(99.9)=1.06s  
     http_reqs......................: 43606   683.577191/s
     iteration_duration.............: avg=330.06ms min=2.98ms  med=305.39ms max=1.44s    p(90)=644.12ms p(95)=719.47ms p(99.9)=1.08s  
     iterations.....................: 42606   667.900972/s
     success_rate...................: 100.00% ✓ 42606      ✗ 0    
     vus............................: 5       min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  99% — ✓ 25532 / ✗ 12
     ✓ valid response structure

     checks.........................: 99.98% ✓ 76620      ✗ 12   
     data_received..................: 2.3 GB 35 MB/s
     data_sent......................: 31 MB  462 kB/s
     http_req_blocked...............: avg=88.05µs  min=1.57µs  med=3.01µs   max=113.59ms p(90)=4.85µs   p(95)=6.8µs    p(99.9)=24.43ms
     http_req_connecting............: avg=81.49µs  min=0s      med=0s       max=113.53ms p(90)=0s       p(95)=0s       p(99.9)=23.3ms 
     http_req_duration..............: avg=531.25ms min=5.93ms  med=494.33ms max=2.1s     p(90)=1.06s    p(95)=1.21s    p(99.9)=1.7s   
       { expected_response:true }...: avg=531.25ms min=5.93ms  med=494.33ms max=2.1s     p(90)=1.06s    p(95)=1.21s    p(99.9)=1.7s   
     http_req_failed................: 0.00%  ✓ 0          ✗ 26544
     http_req_receiving.............: avg=124.6µs  min=31.34µs med=53.13µs  max=79.81ms  p(90)=106.81µs p(95)=189.42µs p(99.9)=10.16ms
     http_req_sending...............: avg=115.42µs min=6.74µs  med=11.72µs  max=109.88ms p(90)=30.67µs  p(95)=120.41µs p(99.9)=21.5ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=531.01ms min=5.89ms  med=494.12ms max=2.1s     p(90)=1.06s    p(95)=1.21s    p(99.9)=1.7s   
     http_reqs......................: 26544  395.958391/s
     iteration_duration.............: avg=552.51ms min=6.31ms  med=520.06ms max=2.1s     p(90)=1.07s    p(95)=1.21s    p(99.9)=1.7s   
     iterations.....................: 25544  381.041333/s
     success_rate...................: 99.95% ✓ 25532      ✗ 12   
     vus............................: 67     min=0        max=497
     vus_max........................: 500    min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 51138      ✗ 0    
     data_received..................: 1.6 GB  23 MB/s
     data_sent......................: 21 MB   309 kB/s
     http_req_blocked...............: avg=170.68µs min=1.24µs  med=2.99µs   max=216.85ms p(90)=5.48µs   p(95)=9.45µs   p(99.9)=41.23ms
     http_req_connecting............: avg=164µs    min=0s      med=0s       max=216.78ms p(90)=0s       p(95)=0s       p(99.9)=40.94ms
     http_req_duration..............: avg=776.95ms min=6.25ms  med=714.02ms max=4.52s    p(90)=1.55s    p(95)=1.67s    p(99.9)=3.97s  
       { expected_response:true }...: avg=776.95ms min=6.25ms  med=714.02ms max=4.52s    p(90)=1.55s    p(95)=1.67s    p(99.9)=3.97s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 18046
     http_req_receiving.............: avg=245.97µs min=25.69µs med=47.34µs  max=145.98ms p(90)=105.46µs p(95)=350.38µs p(99.9)=39.71ms
     http_req_sending...............: avg=266.65µs min=5.78µs  med=11.51µs  max=153.38ms p(90)=35.48µs  p(95)=137.58µs p(99.9)=48.19ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=776.43ms min=6.19ms  med=713.78ms max=4.51s    p(90)=1.55s    p(95)=1.66s    p(99.9)=3.97s  
     http_reqs......................: 18046   263.186824/s
     iteration_duration.............: avg=823.07ms min=8.1ms   med=773.88ms max=4.59s    p(90)=1.57s    p(95)=1.68s    p(99.9)=4.02s  
     iterations.....................: 17046   248.602604/s
     success_rate...................: 100.00% ✓ 17046      ✗ 0    
     vus............................: 95      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 50481      ✗ 0    
     data_received..................: 1.6 GB  22 MB/s
     data_sent......................: 21 MB   299 kB/s
     http_req_blocked...............: avg=104.16µs min=1.3µs   med=2.94µs   max=140.77ms p(90)=5.29µs   p(95)=8.45µs   p(99.9)=27.61ms
     http_req_connecting............: avg=98.38µs  min=0s      med=0s       max=140.72ms p(90)=0s       p(95)=0s       p(99.9)=27.56ms
     http_req_duration..............: avg=786.03ms min=7.22ms  med=756.27ms max=5.61s    p(90)=1.53s    p(95)=1.69s    p(99.9)=4.24s  
       { expected_response:true }...: avg=786.03ms min=7.22ms  med=756.27ms max=5.61s    p(90)=1.53s    p(95)=1.69s    p(99.9)=4.24s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 17827
     http_req_receiving.............: avg=191.53µs min=27.61µs med=47.51µs  max=108.02ms p(90)=100.18µs p(95)=276.83µs p(99.9)=26.02ms
     http_req_sending...............: avg=198.39µs min=5.81µs  med=11.49µs  max=87.83ms  p(90)=34.14µs  p(95)=127.02µs p(99.9)=34.22ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=785.64ms min=7.16ms  med=756.11ms max=5.61s    p(90)=1.53s    p(95)=1.69s    p(99.9)=4.24s  
     http_reqs......................: 17827   254.668087/s
     iteration_duration.............: avg=833.04ms min=8.81ms  med=800.73ms max=5.62s    p(90)=1.54s    p(95)=1.7s     p(99.9)=4.28s  
     iterations.....................: 16827   240.38256/s
     success_rate...................: 100.00% ✓ 16827      ✗ 0    
     vus............................: 65      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 29289      ✗ 0    
     data_received..................: 945 MB  14 MB/s
     data_sent......................: 13 MB   188 kB/s
     http_req_blocked...............: avg=37.62µs min=1.32µs  med=3.26µs  max=37.46ms p(90)=5.21µs  p(95)=11.92µs  p(99.9)=6.42ms
     http_req_connecting............: avg=31.34µs min=0s      med=0s      max=37.4ms  p(90)=0s      p(95)=0s       p(99.9)=6.2ms 
     http_req_duration..............: avg=1.21s   min=7.3ms   med=1.13s   max=15.41s  p(90)=2.23s   p(95)=2.67s    p(99.9)=14.09s
       { expected_response:true }...: avg=1.21s   min=7.3ms   med=1.13s   max=15.41s  p(90)=2.23s   p(95)=2.67s    p(99.9)=14.09s
     http_req_failed................: 0.00%   ✓ 0          ✗ 10763
     http_req_receiving.............: avg=73.81µs min=27.66µs med=53.19µs max=12.69ms p(90)=97.63µs p(95)=118.98µs p(99.9)=1.5ms 
     http_req_sending...............: avg=44.35µs min=6.16µs  med=12.63µs max=16.69ms p(90)=28.39µs p(95)=47.34µs  p(99.9)=7.24ms
     http_req_tls_handshaking.......: avg=0s      min=0s      med=0s      max=0s      p(90)=0s      p(95)=0s       p(99.9)=0s    
     http_req_waiting...............: avg=1.21s   min=7.25ms  med=1.13s   max=15.41s  p(90)=2.23s   p(95)=2.67s    p(99.9)=14.09s
     http_reqs......................: 10763   157.126976/s
     iteration_duration.............: avg=1.33s   min=7.8ms   med=1.29s   max=15.42s  p(90)=2.29s   p(95)=2.73s    p(99.9)=14.65s
     iterations.....................: 9763    142.528167/s
     success_rate...................: 100.00% ✓ 9763       ✗ 0    
     vus............................: 105     min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Oct 8, 2025

Overview for: constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 173 14009 total, 0 failed avg: 215ms, p95: 227ms
hive-router 167 13539 total, 0 failed avg: 223ms, p95: 234ms
cosmo 159 12963 total, 0 failed avg: 233ms, p95: 254ms
hive-gateway-bun 150 11536 total, 0 failed avg: 262ms, p95: 361ms
hive-gateway 145 11167 total, 0 failed avg: 270ms, p95: 300ms
apollo-router 125 10201 total, 0 failed avg: 296ms, p95: 341ms
apollo-gateway 86 7109 total, 0 failed avg: 426ms, p95: 467ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41727      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   201 kB/s
     http_req_blocked...............: avg=19.66µs  min=1.3µs    med=1.95µs   max=9.52ms   p(90)=3.42µs   p(95)=4.96µs   p(99.9)=6.99ms  
     http_req_connecting............: avg=17.04µs  min=0s       med=0s       max=9.48ms   p(90)=0s       p(95)=0s       p(99.9)=6.97ms  
     http_req_duration..............: avg=215.44ms min=122.4ms  med=214.18ms max=609.74ms p(90)=224.33ms p(95)=227.25ms p(99.9)=514.27ms
       { expected_response:true }...: avg=215.44ms min=122.4ms  med=214.18ms max=609.74ms p(90)=224.33ms p(95)=227.25ms p(99.9)=514.27ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 14009
     http_req_receiving.............: avg=79.89µs  min=24.74µs  med=46.04µs  max=13.03ms  p(90)=96.98µs  p(95)=256.1µs  p(99.9)=2.77ms  
     http_req_sending...............: avg=129.6µs  min=5.87µs   med=8.61µs   max=375.12ms p(90)=30.01µs  p(95)=97.74µs  p(99.9)=5.34ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=215.23ms min=122.34ms med=214.08ms max=608.73ms p(90)=224.16ms p(95)=227.04ms p(99.9)=495.38ms
     http_reqs......................: 14009   173.145952/s
     iteration_duration.............: avg=215.77ms min=122.62ms med=214.46ms max=636.36ms p(90)=224.58ms p(95)=227.47ms p(99.9)=534.55ms
     iterations.....................: 13909   171.90999/s
     success_rate...................: 100.00% ✓ 13909      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40317      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   195 kB/s
     http_req_blocked...............: avg=19.27µs  min=1.15µs   med=2.15µs   max=8.93ms   p(90)=3.11µs   p(95)=4.22µs   p(99.9)=6.62ms  
     http_req_connecting............: avg=16.72µs  min=0s       med=0s       max=8.89ms   p(90)=0s       p(95)=0s       p(99.9)=6.6ms   
     http_req_duration..............: avg=223.09ms min=162.64ms med=222.16ms max=617.6ms  p(90)=231.23ms p(95)=234.07ms p(99.9)=525.49ms
       { expected_response:true }...: avg=223.09ms min=162.64ms med=222.16ms max=617.6ms  p(90)=231.23ms p(95)=234.07ms p(99.9)=525.49ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13539
     http_req_receiving.............: avg=76.39µs  min=24.99µs  med=42.01µs  max=12.09ms  p(90)=85.95µs  p(95)=248.01µs p(99.9)=4.44ms  
     http_req_sending...............: avg=159.92µs min=5.54µs   med=9.23µs   max=374.27ms p(90)=27.9µs   p(95)=95.04µs  p(99.9)=7.29ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=222.85ms min=162.59ms med=222.06ms max=616.85ms p(90)=231.09ms p(95)=233.92ms p(99.9)=509.23ms
     http_reqs......................: 13539   167.474265/s
     iteration_duration.............: avg=223.46ms min=162.87ms med=222.41ms max=638.48ms p(90)=231.44ms p(95)=234.29ms p(99.9)=540.91ms
     iterations.....................: 13439   166.237289/s
     success_rate...................: 100.00% ✓ 13439      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 38589      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 15 MB   186 kB/s
     http_req_blocked...............: avg=21.39µs  min=1.4µs    med=2.62µs   max=9.37ms   p(90)=3.88µs   p(95)=4.88µs   p(99.9)=7.06ms  
     http_req_connecting............: avg=18.12µs  min=0s       med=0s       max=9.34ms   p(90)=0s       p(95)=0s       p(99.9)=7.05ms  
     http_req_duration..............: avg=232.93ms min=169.68ms med=232.53ms max=640.32ms p(90)=248.76ms p(95)=254.32ms p(99.9)=526.78ms
       { expected_response:true }...: avg=232.93ms min=169.68ms med=232.53ms max=640.32ms p(90)=248.76ms p(95)=254.32ms p(99.9)=526.78ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12963
     http_req_receiving.............: avg=369.36µs min=30.41µs  med=65.28µs  max=79.63ms  p(90)=200.27µs p(95)=538.98µs p(99.9)=26.18ms 
     http_req_sending...............: avg=98.49µs  min=5.83µs   med=10.83µs  max=242.85ms p(90)=28.66µs  p(95)=120.77µs p(99.9)=3.74ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=232.47ms min=169.05ms med=232.14ms max=621.85ms p(90)=248.19ms p(95)=253.69ms p(99.9)=525.66ms
     http_reqs......................: 12963   159.757465/s
     iteration_duration.............: avg=233.46ms min=169.95ms med=232.91ms max=668.26ms p(90)=249.08ms p(95)=254.66ms p(99.9)=551.02ms
     iterations.....................: 12863   158.525054/s
     success_rate...................: 100.00% ✓ 12863      ✗ 0    
     vus............................: 21      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 34308      ✗ 0    
     data_received..................: 1.0 GB  13 MB/s
     data_sent......................: 13 MB   175 kB/s
     http_req_blocked...............: avg=27.59µs  min=1.12µs   med=2.56µs   max=11.27ms  p(90)=4.05µs   p(95)=5.24µs   p(99.9)=8.86ms  
     http_req_connecting............: avg=24.33µs  min=0s       med=0s       max=11.24ms  p(90)=0s       p(95)=0s       p(99.9)=8.81ms  
     http_req_duration..............: avg=261.51ms min=148.17ms med=252.02ms max=742.6ms  p(90)=270.49ms p(95)=361.19ms p(99.9)=619.84ms
       { expected_response:true }...: avg=261.51ms min=148.17ms med=252.02ms max=742.6ms  p(90)=270.49ms p(95)=361.19ms p(99.9)=619.84ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11536
     http_req_receiving.............: avg=86.39µs  min=23.74µs  med=44µs     max=14.42ms  p(90)=99.26µs  p(95)=352.18µs p(99.9)=1.65ms  
     http_req_sending...............: avg=120.96µs min=5.43µs   med=10.67µs  max=225.43ms p(90)=35.28µs  p(95)=143.66µs p(99.9)=6.63ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=261.3ms  min=143.32ms med=251.87ms max=741.87ms p(90)=270.3ms  p(95)=350.14ms p(99.9)=618.82ms
     http_reqs......................: 11536   150.693533/s
     iteration_duration.............: avg=262.73ms min=148.37ms med=252.36ms max=760.73ms p(90)=270.94ms p(95)=394.01ms p(99.9)=644.6ms 
     iterations.....................: 11436   149.387243/s
     success_rate...................: 100.00% ✓ 11436      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 33201      ✗ 0    
     data_received..................: 981 MB  13 MB/s
     data_sent......................: 13 MB   170 kB/s
     http_req_blocked...............: avg=31.56µs  min=1.13µs   med=2.66µs   max=12.62ms  p(90)=4.32µs   p(95)=5.73µs   p(99.9)=10.19ms 
     http_req_connecting............: avg=28.1µs   min=0s       med=0s       max=12.58ms  p(90)=0s       p(95)=0s       p(99.9)=10.15ms 
     http_req_duration..............: avg=270.11ms min=144.56ms med=260.87ms max=679.58ms p(90)=277.26ms p(95)=299.64ms p(99.9)=604.91ms
       { expected_response:true }...: avg=270.11ms min=144.56ms med=260.87ms max=679.58ms p(90)=277.26ms p(95)=299.64ms p(99.9)=604.91ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11167
     http_req_receiving.............: avg=96.84µs  min=25.62µs  med=46.75µs  max=25.27ms  p(90)=105.05µs p(95)=374.39µs p(99.9)=3.54ms  
     http_req_sending...............: avg=144.68µs min=5.57µs   med=11.12µs  max=227.24ms p(90)=37.91µs  p(95)=159.96µs p(99.9)=11.64ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=269.87ms min=144.5ms  med=260.73ms max=678.33ms p(90)=277.08ms p(95)=298.95ms p(99.9)=603.37ms
     http_reqs......................: 11167   145.996819/s
     iteration_duration.............: avg=271.45ms min=144.84ms med=261.22ms max=717.68ms p(90)=277.66ms p(95)=300.99ms p(99.9)=634.57ms
     iterations.....................: 11067   144.689424/s
     success_rate...................: 100.00% ✓ 11067      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 30303      ✗ 0    
     data_received..................: 895 MB  11 MB/s
     data_sent......................: 12 MB   146 kB/s
     http_req_blocked...............: avg=23.17µs  min=1.52µs   med=2.77µs   max=8ms      p(90)=4.13µs   p(95)=5.12µs   p(99.9)=6.42ms  
     http_req_connecting............: avg=19.67µs  min=0s       med=0s       max=7.96ms   p(90)=0s       p(95)=0s       p(99.9)=6.4ms   
     http_req_duration..............: avg=295.89ms min=179.64ms med=297.47ms max=724.16ms p(90)=331.55ms p(95)=340.82ms p(99.9)=635.94ms
       { expected_response:true }...: avg=295.89ms min=179.64ms med=297.47ms max=724.16ms p(90)=331.55ms p(95)=340.82ms p(99.9)=635.94ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10201
     http_req_receiving.............: avg=109.84µs min=36.29µs  med=52.21µs  max=194.04ms p(90)=109.27µs p(95)=261.45µs p(99.9)=2.28ms  
     http_req_sending...............: avg=146.84µs min=7.9µs    med=11.26µs  max=363.83ms p(90)=30.27µs  p(95)=142.18µs p(99.9)=3.7ms   
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=295.63ms min=179.55ms med=297.33ms max=705.71ms p(90)=331.38ms p(95)=340.69ms p(99.9)=627.33ms
     http_reqs......................: 10201   125.208556/s
     iteration_duration.............: avg=297.13ms min=179.89ms med=298.12ms max=761.81ms p(90)=332.02ms p(95)=341.45ms p(99.9)=670.14ms
     iterations.....................: 10101   123.981142/s
     success_rate...................: 100.00% ✓ 10101      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 21027     ✗ 0   
     data_received..................: 624 MB  7.6 MB/s
     data_sent......................: 8.3 MB  101 kB/s
     http_req_blocked...............: avg=39.29µs  min=1.3µs    med=3.71µs   max=9.59ms   p(90)=5.72µs   p(95)=6.45µs   p(99.9)=8.33ms  
     http_req_connecting............: avg=35.06µs  min=0s       med=0s       max=9.55ms   p(90)=0s       p(95)=0s       p(99.9)=8.31ms  
     http_req_duration..............: avg=426ms    min=212.07ms med=429.8ms  max=819.84ms p(90)=457.6ms  p(95)=467.27ms p(99.9)=728.58ms
       { expected_response:true }...: avg=426ms    min=212.07ms med=429.8ms  max=819.84ms p(90)=457.6ms  p(95)=467.27ms p(99.9)=728.58ms
     http_req_failed................: 0.00%   ✓ 0         ✗ 7109
     http_req_receiving.............: avg=71.49µs  min=27.94µs  med=63.73µs  max=856.85µs p(90)=102.41µs p(95)=116.14µs p(99.9)=497.68µs
     http_req_sending...............: avg=101.99µs min=5.51µs   med=13.69µs  max=269.52ms p(90)=21.49µs  p(95)=25.38µs  p(99.9)=4.88ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=425.83ms min=211.98ms med=429.71ms max=819.07ms p(90)=457.43ms p(95)=467.17ms p(99.9)=727.8ms 
     http_reqs......................: 7109    86.952564/s
     iteration_duration.............: avg=429.39ms min=270.82ms med=430.29ms max=839.4ms  p(90)=458.27ms p(95)=467.76ms p(99.9)=787.05ms
     iterations.....................: 7009    85.72943/s
     success_rate...................: 100.00% ✓ 7009      ✗ 0   
     vus............................: 50      min=0       max=50
     vus_max........................: 50      min=50      max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Oct 8, 2025

Overview for: constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 173 14033 total, 0 failed avg: 216ms, p95: 227ms
hive-router 170 13792 total, 0 failed avg: 219ms, p95: 229ms
cosmo 167 13597 total, 0 failed avg: 222ms, p95: 241ms
hive-gateway 160 12277 total, 0 failed avg: 246ms, p95: 271ms
hive-gateway-bun 159 12207 total, 0 failed avg: 247ms, p95: 272ms
apollo-router 133 10859 total, 0 failed avg: 278ms, p95: 322ms
apollo-gateway 124 10138 total, 0 failed avg: 298ms, p95: 333ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41799      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   201 kB/s
     http_req_blocked...............: avg=19.36µs  min=1.14µs   med=1.88µs   max=9.1ms    p(90)=3.39µs   p(95)=5.04µs   p(99.9)=6.68ms  
     http_req_connecting............: avg=16.03µs  min=0s       med=0s       max=9.06ms   p(90)=0s       p(95)=0s       p(99.9)=6.66ms  
     http_req_duration..............: avg=215.57ms min=159.43ms med=214.85ms max=611.03ms p(90)=224.35ms p(95)=227.08ms p(99.9)=507.9ms 
       { expected_response:true }...: avg=215.57ms min=159.43ms med=214.85ms max=611.03ms p(90)=224.35ms p(95)=227.08ms p(99.9)=507.9ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 14033
     http_req_receiving.............: avg=87.01µs  min=26.24µs  med=46.27µs  max=19.86ms  p(90)=95.11µs  p(95)=242.09µs p(99.9)=7.18ms  
     http_req_sending...............: avg=84.23µs  min=5.51µs   med=8.37µs   max=376.74ms p(90)=25.77µs  p(95)=95.09µs  p(99.9)=6.4ms   
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=215.4ms  min=159.31ms med=214.76ms max=610.31ms p(90)=224.22ms p(95)=226.89ms p(99.9)=489.76ms
     http_reqs......................: 14033   173.072653/s
     iteration_duration.............: avg=215.88ms min=159.68ms med=215.09ms max=625.34ms p(90)=224.56ms p(95)=227.32ms p(99.9)=537.2ms 
     iterations.....................: 13933   171.839327/s
     success_rate...................: 100.00% ✓ 13933      ✗ 0    
     vus............................: 41      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41076      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   198 kB/s
     http_req_blocked...............: avg=19.35µs  min=1.17µs   med=1.9µs    max=9.18ms   p(90)=2.98µs   p(95)=3.98µs   p(99.9)=6.81ms  
     http_req_connecting............: avg=16.95µs  min=0s       med=0s       max=9.15ms   p(90)=0s       p(95)=0s       p(99.9)=6.79ms  
     http_req_duration..............: avg=219.43ms min=156.76ms med=218.43ms max=605.15ms p(90)=226.79ms p(95)=229.44ms p(99.9)=513.45ms
       { expected_response:true }...: avg=219.43ms min=156.76ms med=218.43ms max=605.15ms p(90)=226.79ms p(95)=229.44ms p(99.9)=513.45ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13792
     http_req_receiving.............: avg=70.62µs  min=23.18µs  med=40.75µs  max=20.44ms  p(90)=80.46µs  p(95)=223.79µs p(99.9)=2.47ms  
     http_req_sending...............: avg=120.61µs min=5.38µs   med=8.06µs   max=374.67ms p(90)=27.44µs  p(95)=95.15µs  p(99.9)=6ms     
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=219.24ms min=156.69ms med=218.34ms max=604.46ms p(90)=226.66ms p(95)=229.25ms p(99.9)=496.65ms
     http_reqs......................: 13792   170.415663/s
     iteration_duration.............: avg=219.77ms min=157ms    med=218.68ms max=618.57ms p(90)=226.99ms p(95)=229.61ms p(99.9)=526.68ms
     iterations.....................: 13692   169.180051/s
     success_rate...................: 100.00% ✓ 13692      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40491      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   195 kB/s
     http_req_blocked...............: avg=20.61µs  min=1.29µs   med=2.62µs   max=9.38ms   p(90)=3.8µs    p(95)=4.71µs   p(99.9)=6.91ms  
     http_req_connecting............: avg=17.27µs  min=0s       med=0s       max=9.35ms   p(90)=0s       p(95)=0s       p(99.9)=6.89ms  
     http_req_duration..............: avg=221.94ms min=161.36ms med=220.86ms max=640.49ms p(90)=235.93ms p(95)=240.85ms p(99.9)=525.56ms
       { expected_response:true }...: avg=221.94ms min=161.36ms med=220.86ms max=640.49ms p(90)=235.93ms p(95)=240.85ms p(99.9)=525.56ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13597
     http_req_receiving.............: avg=434.09µs min=28.28µs  med=62.26µs  max=208.92ms p(90)=368.28µs p(95)=969.39µs p(99.9)=22.56ms 
     http_req_sending...............: avg=115.52µs min=6.38µs   med=10.78µs  max=319.29ms p(90)=29.82µs  p(95)=117.46µs p(99.9)=3.85ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=221.39ms min=161.24ms med=220.46ms max=639.34ms p(90)=235.35ms p(95)=240.36ms p(99.9)=511.71ms
     http_reqs......................: 13597   167.998886/s
     iteration_duration.............: avg=222.35ms min=161.58ms med=221.22ms max=652.25ms p(90)=236.29ms p(95)=241.19ms p(99.9)=539.1ms 
     iterations.....................: 13497   166.763327/s
     success_rate...................: 100.00% ✓ 13497      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 36531      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 14 MB   187 kB/s
     http_req_blocked...............: avg=26.64µs  min=1.16µs   med=2.66µs   max=11.02ms  p(90)=4.32µs   p(95)=5.61µs   p(99.9)=8.46ms
     http_req_connecting............: avg=22.99µs  min=0s       med=0s       max=10.99ms  p(90)=0s       p(95)=0s       p(99.9)=8.42ms
     http_req_duration..............: avg=245.88ms min=135.81ms med=235.57ms max=1.63s    p(90)=256.33ms p(95)=271.07ms p(99.9)=1.62s 
       { expected_response:true }...: avg=245.88ms min=135.81ms med=235.57ms max=1.63s    p(90)=256.33ms p(95)=271.07ms p(99.9)=1.62s 
     http_req_failed................: 0.00%   ✓ 0          ✗ 12277
     http_req_receiving.............: avg=87.82µs  min=26.12µs  med=46.45µs  max=14.68ms  p(90)=100.82µs p(95)=171.76µs p(99.9)=4.1ms 
     http_req_sending...............: avg=117.37µs min=5.47µs   med=10.93µs  max=259.17ms p(90)=31.52µs  p(95)=117.62µs p(99.9)=6.07ms
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s    
     http_req_waiting...............: avg=245.67ms min=135.71ms med=235.42ms max=1.63s    p(90)=256.14ms p(95)=270.57ms p(99.9)=1.62s 
     http_reqs......................: 12277   160.538259/s
     iteration_duration.............: avg=246.97ms min=136ms    med=235.97ms max=1.63s    p(90)=256.71ms p(95)=271.42ms p(99.9)=1.62s 
     iterations.....................: 12177   159.230625/s
     success_rate...................: 100.00% ✓ 12177      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 36321      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 14 MB   185 kB/s
     http_req_blocked...............: avg=30.58µs  min=1.15µs   med=2.65µs   max=12.38ms  p(90)=4.5µs    p(95)=5.93µs   p(99.9)=9.11ms  
     http_req_connecting............: avg=26.78µs  min=0s       med=0s       max=12.33ms  p(90)=0s       p(95)=0s       p(99.9)=9.07ms  
     http_req_duration..............: avg=247.23ms min=137.61ms med=236.91ms max=875.33ms p(90)=256.51ms p(95)=271.95ms p(99.9)=866.69ms
       { expected_response:true }...: avg=247.23ms min=137.61ms med=236.91ms max=875.33ms p(90)=256.51ms p(95)=271.95ms p(99.9)=866.69ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12207
     http_req_receiving.............: avg=89.95µs  min=26.22µs  med=48.74µs  max=14.61ms  p(90)=113.89µs p(95)=181.07µs p(99.9)=3.11ms  
     http_req_sending...............: avg=80.55µs  min=5.54µs   med=11.09µs  max=368.41ms p(90)=32.7µs   p(95)=122.49µs p(99.9)=4.82ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=247.06ms min=137.52ms med=236.79ms max=875.24ms p(90)=256.34ms p(95)=271.51ms p(99.9)=866.62ms
     http_reqs......................: 12207   159.179249/s
     iteration_duration.............: avg=248.29ms min=137.95ms med=237.29ms max=875.47ms p(90)=256.82ms p(95)=272.34ms p(99.9)=867.02ms
     iterations.....................: 12107   157.87525/s
     success_rate...................: 100.00% ✓ 12107      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 32277      ✗ 0    
     data_received..................: 953 MB  12 MB/s
     data_sent......................: 13 MB   155 kB/s
     http_req_blocked...............: avg=24.21µs  min=1.38µs   med=2.9µs    max=8.35ms   p(90)=4.59µs   p(95)=5.97µs   p(99.9)=6.65ms  
     http_req_connecting............: avg=19.43µs  min=0s       med=0s       max=8.32ms   p(90)=0s       p(95)=0s       p(99.9)=6.64ms  
     http_req_duration..............: avg=278.42ms min=147.6ms  med=279.37ms max=727.43ms p(90)=312.79ms p(95)=321.93ms p(99.9)=630.27ms
       { expected_response:true }...: avg=278.42ms min=147.6ms  med=279.37ms max=727.43ms p(90)=312.79ms p(95)=321.93ms p(99.9)=630.27ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10859
     http_req_receiving.............: avg=163.83µs min=32.84µs  med=58.27µs  max=267.2ms  p(90)=168.79µs p(95)=489.12µs p(99.9)=5.29ms  
     http_req_sending...............: avg=125.81µs min=6.24µs   med=11.68µs  max=267.1ms  p(90)=91.47µs  p(95)=149.62µs p(99.9)=4.88ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=278.13ms min=147.54ms med=279.18ms max=711.55ms p(90)=312.54ms p(95)=321.6ms  p(99.9)=622.96ms
     http_reqs......................: 10859   133.164424/s
     iteration_duration.............: avg=279.53ms min=147.83ms med=280.12ms max=762.28ms p(90)=313.31ms p(95)=322.54ms p(99.9)=660.21ms
     iterations.....................: 10759   131.938119/s
     success_rate...................: 100.00% ✓ 10759      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 30114      ✗ 0    
     data_received..................: 890 MB  11 MB/s
     data_sent......................: 12 MB   144 kB/s
     http_req_blocked...............: avg=34.9µs   min=1.36µs   med=3.39µs   max=11.74ms  p(90)=5.06µs   p(95)=6.05µs   p(99.9)=9.59ms  
     http_req_connecting............: avg=30.23µs  min=0s       med=0s       max=11.7ms   p(90)=0s       p(95)=0s       p(99.9)=9.57ms  
     http_req_duration..............: avg=297.97ms min=211.54ms med=295.13ms max=829.08ms p(90)=321.81ms p(95)=332.73ms p(99.9)=718.23ms
       { expected_response:true }...: avg=297.97ms min=211.54ms med=295.13ms max=829.08ms p(90)=321.81ms p(95)=332.73ms p(99.9)=718.23ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10138
     http_req_receiving.............: avg=95.88µs  min=30.95µs  med=63.31µs  max=136.52ms p(90)=110.96µs p(95)=141.81µs p(99.9)=1.97ms  
     http_req_sending...............: avg=113.96µs min=6.59µs   med=13.23µs  max=233.29ms p(90)=22.5µs   p(95)=38.75µs  p(99.9)=4.36ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=297.76ms min=211.43ms med=294.98ms max=828.07ms p(90)=321.64ms p(95)=332.48ms p(99.9)=716.98ms
     http_reqs......................: 10138   124.195371/s
     iteration_duration.............: avg=299.28ms min=214.94ms med=295.66ms max=870.06ms p(90)=322.34ms p(95)=333.21ms p(99.9)=747.63ms
     iterations.....................: 10038   122.970323/s
     success_rate...................: 100.00% ✓ 10038      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@ardatan ardatan merged commit 752dd99 into main Oct 8, 2025
34 checks passed
@ardatan ardatan deleted the renovate/npm-11.x branch October 8, 2025 21:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant