Skip to content

Conversation

@renovate
Copy link
Contributor

@renovate renovate bot commented Sep 13, 2025

This PR contains the following updates:

Package Change Age Confidence
@types/node (source) 22.18.1 -> 22.18.3 age confidence

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.


  • If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

@renovate renovate bot added the dependencies Pull requests that update a dependency file label Sep 13, 2025
@github-actions
Copy link

💻 Website Preview

The latest changes are available as preview in: https://159f1ae3.federation-gateway-benchmark.pages.dev

@github-actions
Copy link

Overview for: constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1848 111375 total, 0 failed avg: 27ms, p95: 48ms
grafbase 1709 103139 total, 0 failed avg: 29ms, p95: 50ms
cosmo 682 41268 total, 0 failed avg: 72ms, p95: 106ms
apollo-router 389 23654 total, 0 failed avg: 127ms, p95: 165ms
hive-gateway 302 18412 total, 0 failed avg: 163ms, p95: 210ms
hive-gateway-bun 280 17229 total, 0 failed avg: 174ms, p95: 271ms
apollo-gateway 122 7486 total, 0 failed avg: 401ms, p95: 469ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 333825      ✗ 0     
     data_received..................: 9.8 GB  162 MB/s
     data_sent......................: 130 MB  2.1 MB/s
     http_req_blocked...............: avg=5.1µs    min=1.11µs  med=2.52µs  max=9.74ms   p(90)=3.69µs  p(95)=4.34µs   p(99.9)=65.06µs
     http_req_connecting............: avg=2.1µs    min=0s      med=0s      max=9.71ms   p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_duration..............: avg=26.74ms  min=1.89ms  med=24.38ms max=417.72ms p(90)=41.03ms p(95)=47.5ms   p(99.9)=81.21ms
       { expected_response:true }...: avg=26.74ms  min=1.89ms  med=24.38ms max=417.72ms p(90)=41.03ms p(95)=47.5ms   p(99.9)=81.21ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 111375
     http_req_receiving.............: avg=111.58µs min=23.57µs med=42.28µs max=46.93ms  p(90)=116.6µs p(95)=336.75µs p(99.9)=10.35ms
     http_req_sending...............: avg=88.96µs  min=5.38µs  med=10.05µs max=386.12ms p(90)=30.35µs p(95)=120.22µs p(99.9)=10.32ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=26.54ms  min=1.85ms  med=24.23ms max=416.85ms p(90)=40.7ms  p(95)=47.12ms  p(99.9)=79.31ms
     http_reqs......................: 111375  1848.600268/s
     iteration_duration.............: avg=26.95ms  min=3.55ms  med=24.58ms max=451.19ms p(90)=41.23ms p(95)=47.69ms  p(99.9)=82.13ms
     iterations.....................: 111275  1846.940469/s
     success_rate...................: 100.00% ✓ 111275      ✗ 0     
     vus............................: 50      min=50        max=50  
     vus_max........................: 50      min=50        max=50  

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 309117      ✗ 0     
     data_received..................: 9.1 GB  150 MB/s
     data_sent......................: 120 MB  2.0 MB/s
     http_req_blocked...............: avg=6.19µs   min=1.18µs  med=2.94µs  max=10.03ms  p(90)=4.07µs   p(95)=4.96µs   p(99.9)=113.21µs
     http_req_connecting............: avg=2.52µs   min=0s      med=0s      max=10ms     p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_duration..............: avg=28.86ms  min=2.58ms  med=25.86ms max=432.62ms p(90)=43.76ms  p(95)=50.4ms   p(99.9)=86.84ms 
       { expected_response:true }...: avg=28.86ms  min=2.58ms  med=25.86ms max=432.62ms p(90)=43.76ms  p(95)=50.4ms   p(99.9)=86.84ms 
     http_req_failed................: 0.00%   ✓ 0           ✗ 103139
     http_req_receiving.............: avg=132.89µs min=25.68µs med=46.97µs max=43.14ms  p(90)=142.77µs p(95)=369.41µs p(99.9)=14.11ms 
     http_req_sending...............: avg=95.74µs  min=5.29µs  med=11.42µs max=266.41ms p(90)=36.88µs  p(95)=128.45µs p(99.9)=13.07ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=28.63ms  min=2.54ms  med=25.69ms max=431.01ms p(90)=43.34ms  p(95)=49.89ms  p(99.9)=84.56ms 
     http_reqs......................: 103139  1709.515653/s
     iteration_duration.............: avg=29.1ms   min=7.01ms  med=26.07ms max=449.93ms p(90)=44ms     p(95)=50.63ms  p(99.9)=87.15ms 
     iterations.....................: 103039  1707.858166/s
     success_rate...................: 100.00% ✓ 103039      ✗ 0     
     vus............................: 50      min=50        max=50  
     vus_max........................: 50      min=50        max=50  

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 123504     ✗ 0    
     data_received..................: 3.6 GB  60 MB/s
     data_sent......................: 48 MB   794 kB/s
     http_req_blocked...............: avg=9.73µs   min=1.34µs  med=2.83µs  max=9.87ms   p(90)=4µs      p(95)=4.75µs   p(99.9)=1.95ms  
     http_req_connecting............: avg=6.28µs   min=0s      med=0s      max=9.83ms   p(90)=0s       p(95)=0s       p(99.9)=1.93ms  
     http_req_duration..............: avg=72.47ms  min=2.79ms  med=71.34ms max=509.97ms p(90)=98.42ms  p(95)=106.1ms  p(99.9)=288.52ms
       { expected_response:true }...: avg=72.47ms  min=2.79ms  med=71.34ms max=509.97ms p(90)=98.42ms  p(95)=106.1ms  p(99.9)=288.52ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 41268
     http_req_receiving.............: avg=165.86µs min=29.91µs med=75.75µs max=35.63ms  p(90)=155.73µs p(95)=387.6µs  p(99.9)=14.61ms 
     http_req_sending...............: avg=48.22µs  min=6µs     med=11.18µs max=128.18ms p(90)=29.08µs  p(95)=120.48µs p(99.9)=3.42ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=72.25ms  min=2.72ms  med=71.15ms max=508.61ms p(90)=98.17ms  p(95)=105.91ms p(99.9)=288.45ms
     http_reqs......................: 41268   682.98265/s
     iteration_duration.............: avg=72.89ms  min=6.01ms  med=71.62ms max=535.11ms p(90)=98.68ms  p(95)=106.38ms p(99.9)=305.08ms
     iterations.....................: 41168   681.327656/s
     success_rate...................: 100.00% ✓ 41168      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 70662      ✗ 0    
     data_received..................: 2.1 GB  34 MB/s
     data_sent......................: 28 MB   453 kB/s
     http_req_blocked...............: avg=13.74µs  min=1.87µs  med=2.79µs   max=9.85ms   p(90)=4.1µs    p(95)=4.82µs   p(99.9)=5.03ms  
     http_req_connecting............: avg=10.32µs  min=0s      med=0s       max=9.78ms   p(90)=0s       p(95)=0s       p(99.9)=5ms     
     http_req_duration..............: avg=126.63ms min=5.82ms  med=125.82ms max=591.65ms p(90)=155.68ms p(95)=164.9ms  p(99.9)=407.01ms
       { expected_response:true }...: avg=126.63ms min=5.82ms  med=125.82ms max=591.65ms p(90)=155.68ms p(95)=164.9ms  p(99.9)=407.01ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 23654
     http_req_receiving.............: avg=83.45µs  min=35.38µs med=50.48µs  max=280.15ms p(90)=94.1µs   p(95)=119.99µs p(99.9)=1.2ms   
     http_req_sending...............: avg=72.61µs  min=7.27µs  med=11.36µs  max=371.33ms p(90)=18.79µs  p(95)=32.32µs  p(99.9)=1.73ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=126.48ms min=5.75ms  med=125.71ms max=566.38ms p(90)=155.58ms p(95)=164.74ms p(99.9)=399.48ms
     http_reqs......................: 23654   389.552806/s
     iteration_duration.............: avg=127.42ms min=35.31ms med=126.15ms max=616.8ms  p(90)=155.96ms p(95)=165.13ms p(99.9)=425.73ms
     iterations.....................: 23554   387.905926/s
     success_rate...................: 100.00% ✓ 23554      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 54936      ✗ 0    
     data_received..................: 1.6 GB  27 MB/s
     data_sent......................: 21 MB   351 kB/s
     http_req_blocked...............: avg=38.91µs  min=1.26µs  med=2.89µs   max=20.44ms  p(90)=4.78µs   p(95)=6.09µs   p(99.9)=13.74ms 
     http_req_connecting............: avg=34.74µs  min=0s      med=0s       max=20.39ms  p(90)=0s       p(95)=0s       p(99.9)=13.71ms 
     http_req_duration..............: avg=162.75ms min=6.94ms  med=151.09ms max=629.36ms p(90)=182.6ms  p(95)=209.74ms p(99.9)=623.4ms 
       { expected_response:true }...: avg=162.75ms min=6.94ms  med=151.09ms max=629.36ms p(90)=182.6ms  p(95)=209.74ms p(99.9)=623.4ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 18412
     http_req_receiving.............: avg=103.86µs min=27.79µs med=51.86µs  max=146.35ms p(90)=119.55µs p(95)=210.54µs p(99.9)=3.51ms  
     http_req_sending...............: avg=85.96µs  min=5.59µs  med=11.54µs  max=313.4ms  p(90)=33.51µs  p(95)=126.77µs p(99.9)=4.76ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=162.56ms min=6.9ms   med=150.94ms max=629.25ms p(90)=182.43ms p(95)=209.28ms p(99.9)=623.24ms
     http_reqs......................: 18412   302.143641/s
     iteration_duration.............: avg=163.95ms min=40.43ms med=151.49ms max=629.55ms p(90)=182.97ms p(95)=210.49ms p(99.9)=623.58ms
     iterations.....................: 18312   300.502627/s
     success_rate...................: 100.00% ✓ 18312      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 51387      ✗ 0    
     data_received..................: 1.5 GB  25 MB/s
     data_sent......................: 20 MB   326 kB/s
     http_req_blocked...............: avg=36.59µs  min=1.22µs  med=2.79µs   max=20.76ms  p(90)=4.66µs   p(95)=5.91µs   p(99.9)=11.95ms 
     http_req_connecting............: avg=31.79µs  min=0s      med=0s       max=20.66ms  p(90)=0s       p(95)=0s       p(99.9)=11.9ms  
     http_req_duration..............: avg=173.9ms  min=7.62ms  med=162.41ms max=719.77ms p(90)=222.47ms p(95)=270.69ms p(99.9)=543.42ms
       { expected_response:true }...: avg=173.9ms  min=7.62ms  med=162.41ms max=719.77ms p(90)=222.47ms p(95)=270.69ms p(99.9)=543.42ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 17229
     http_req_receiving.............: avg=97.22µs  min=26.41µs med=47.96µs  max=16.73ms  p(90)=111.72µs p(95)=291.34µs p(99.9)=3.92ms  
     http_req_sending...............: avg=76.21µs  min=5.6µs   med=11.38µs  max=439.21ms p(90)=33.51µs  p(95)=128.08µs p(99.9)=4.79ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=173.73ms min=7.54ms  med=162.29ms max=717.76ms p(90)=222.11ms p(95)=270.56ms p(99.9)=543.13ms
     http_reqs......................: 17229   280.042578/s
     iteration_duration.............: avg=175.27ms min=59.88ms med=162.77ms max=798.58ms p(90)=226.15ms p(95)=271.2ms  p(99.9)=611.66ms
     iterations.....................: 17129   278.417164/s
     success_rate...................: 100.00% ✓ 17129      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 22158      ✗ 0   
     data_received..................: 658 MB  11 MB/s
     data_sent......................: 8.7 MB  143 kB/s
     http_req_blocked...............: avg=42.31µs  min=1.37µs   med=3.09µs   max=11.75ms  p(90)=4.2µs    p(95)=4.92µs   p(99.9)=10.13ms 
     http_req_connecting............: avg=38.77µs  min=0s       med=0s       max=11.71ms  p(90)=0s       p(95)=0s       p(99.9)=10.1ms  
     http_req_duration..............: avg=401.4ms  min=7.27ms   med=400.73ms max=759.67ms p(90)=454.31ms p(95)=469.11ms p(99.9)=679.64ms
       { expected_response:true }...: avg=401.4ms  min=7.27ms   med=400.73ms max=759.67ms p(90)=454.31ms p(95)=469.11ms p(99.9)=679.64ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 7486
     http_req_receiving.............: avg=72.16µs  min=29.57µs  med=50.74µs  max=104.97ms p(90)=84.99µs  p(95)=99.82µs  p(99.9)=500.79µs
     http_req_sending...............: avg=81.92µs  min=6.14µs   med=12.25µs  max=206.12ms p(90)=15.94µs  p(95)=20.53µs  p(99.9)=4.81ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=401.25ms min=7.22ms   med=400.65ms max=743.2ms  p(90)=454.19ms p(95)=468.99ms p(99.9)=669.22ms
     http_reqs......................: 7486    122.565058/s
     iteration_duration.............: avg=407.14ms min=200.94ms med=401.28ms max=828.78ms p(90)=454.94ms p(95)=469.63ms p(99.9)=737.71ms
     iterations.....................: 7386    120.927801/s
     success_rate...................: 100.00% ✓ 7386       ✗ 0   
     vus............................: 25      min=25       max=50
     vus_max........................: 50      min=50       max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@github-actions
Copy link

Overview for: ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 500 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1960 122441 total, 0 failed avg: 114ms, p95: 282ms
grafbase 1659 105235 total, 0 failed avg: 132ms, p95: 314ms
cosmo 700 44680 total, 0 failed avg: 314ms, p95: 693ms
apollo-router 409 27404 total, 0 failed avg: 514ms, p95: 1162ms ❌ 20 unexpected GraphQL errors
hive-gateway 263 18405 total, 0 failed avg: 762ms, p95: 1621ms
hive-gateway-bun 255 17877 total, 0 failed avg: 783ms, p95: 1707ms
apollo-gateway 157 10771 total, 0 failed avg: 1209ms, p95: 2594ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 364323      ✗ 0     
     data_received..................: 11 GB   172 MB/s
     data_sent......................: 143 MB  2.3 MB/s
     http_req_blocked...............: avg=359.62µs min=1.08µs  med=2.42µs  max=306.45ms p(90)=3.9µs    p(95)=4.79µs   p(99.9)=132.07ms
     http_req_connecting............: avg=355.74µs min=0s      med=0s      max=306.4ms  p(90)=0s       p(95)=0s       p(99.9)=131.95ms
     http_req_duration..............: avg=113.82ms min=1.9ms   med=99.95ms max=495.56ms p(90)=236.57ms p(95)=281.9ms  p(99.9)=382.15ms
       { expected_response:true }...: avg=113.82ms min=1.9ms   med=99.95ms max=495.56ms p(90)=236.57ms p(95)=281.9ms  p(99.9)=382.15ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 122441
     http_req_receiving.............: avg=458.11µs min=22.81µs med=41.52µs max=127.76ms p(90)=179.62µs p(95)=390.97µs p(99.9)=70.2ms  
     http_req_sending...............: avg=344.06µs min=5.01µs  med=9.86µs  max=132.5ms  p(90)=29.05µs  p(95)=125.25µs p(99.9)=62.55ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=113.02ms min=1.86ms  med=99.25ms max=457.48ms p(90)=234.88ms p(95)=280.16ms p(99.9)=379.43ms
     http_reqs......................: 122441  1960.407232/s
     iteration_duration.............: avg=115.36ms min=2ms     med=101.3ms max=719.24ms p(90)=238.39ms p(95)=283.81ms p(99.9)=403.93ms
     iterations.....................: 121441  1944.396196/s
     success_rate...................: 100.00% ✓ 121441      ✗ 0     
     vus............................: 79      min=0         max=493 
     vus_max........................: 500     min=500       max=500 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 312705      ✗ 0     
     data_received..................: 9.2 GB  146 MB/s
     data_sent......................: 122 MB  1.9 MB/s
     http_req_blocked...............: avg=545.58µs min=1.14µs  med=2.96µs   max=377.8ms  p(90)=4.37µs   p(95)=5.39µs   p(99.9)=181.07ms
     http_req_connecting............: avg=535.1µs  min=0s      med=0s       max=377.76ms p(90)=0s       p(95)=0s       p(99.9)=180.66ms
     http_req_duration..............: avg=132.27ms min=2.59ms  med=121.84ms max=482.84ms p(90)=264.94ms p(95)=313.63ms p(99.9)=425.14ms
       { expected_response:true }...: avg=132.27ms min=2.59ms  med=121.84ms max=482.84ms p(90)=264.94ms p(95)=313.63ms p(99.9)=425.14ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 105235
     http_req_receiving.............: avg=563.78µs min=23.91µs med=47.36µs  max=127.9ms  p(90)=197.46µs p(95)=430.12µs p(99.9)=75.8ms  
     http_req_sending...............: avg=441.96µs min=5.56µs  med=11.69µs  max=148.03ms p(90)=33.4µs   p(95)=136.76µs p(99.9)=74.61ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=131.26ms min=2.54ms  med=120.96ms max=480.95ms p(90)=262.34ms p(95)=311.44ms p(99.9)=422.83ms
     http_reqs......................: 105235  1659.913654/s
     iteration_duration.............: avg=134.4ms  min=2.82ms  med=123.75ms max=846.97ms p(90)=267.98ms p(95)=316.68ms p(99.9)=473.02ms
     iterations.....................: 104235  1644.140255/s
     success_rate...................: 100.00% ✓ 104235      ✗ 0     
     vus............................: 78      min=0         max=493 
     vus_max........................: 500     min=500       max=500 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 131040     ✗ 0    
     data_received..................: 3.9 GB  62 MB/s
     data_sent......................: 52 MB   816 kB/s
     http_req_blocked...............: avg=97.46µs  min=1.23µs  med=2.97µs   max=155.65ms p(90)=4.42µs   p(95)=5.99µs   p(99.9)=31.6ms  
     http_req_connecting............: avg=92.79µs  min=0s      med=0s       max=155.59ms p(90)=0s       p(95)=0s       p(99.9)=31.45ms 
     http_req_duration..............: avg=314.38ms min=2.8ms   med=297.91ms max=1.33s    p(90)=617.38ms p(95)=693.2ms  p(99.9)=991.86ms
       { expected_response:true }...: avg=314.38ms min=2.8ms   med=297.91ms max=1.33s    p(90)=617.38ms p(95)=693.2ms  p(99.9)=991.86ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 44680
     http_req_receiving.............: avg=629.73µs min=26.67µs med=60.99µs  max=206.54ms p(90)=187.67µs p(95)=484.64µs p(99.9)=87.51ms 
     http_req_sending...............: avg=138.2µs  min=5.49µs  med=11.36µs  max=149.71ms p(90)=30.39µs  p(95)=129.92µs p(99.9)=28.47ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=313.62ms min=2.72ms  med=297.26ms max=1.33s    p(90)=616.45ms p(95)=691.75ms p(99.9)=991.79ms
     http_reqs......................: 44680   700.913315/s
     iteration_duration.............: avg=322.05ms min=3.04ms  med=306.78ms max=1.33s    p(90)=620.79ms p(95)=695.56ms p(99.9)=993.6ms 
     iterations.....................: 43680   685.225909/s
     success_rate...................: 100.00% ✓ 43680      ✗ 0    
     vus............................: 100     min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  99% — ✓ 26384 / ✗ 20
     ✓ valid response structure

     checks.........................: 99.97% ✓ 79192      ✗ 20   
     data_received..................: 2.4 GB 36 MB/s
     data_sent......................: 32 MB  477 kB/s
     http_req_blocked...............: avg=83.28µs  min=1.49µs  med=2.93µs   max=136.6ms  p(90)=4.65µs   p(95)=6.57µs   p(99.9)=20.23ms
     http_req_connecting............: avg=78.35µs  min=0s      med=0s       max=136.56ms p(90)=0s       p(95)=0s       p(99.9)=20.17ms
     http_req_duration..............: avg=514.38ms min=6.05ms  med=475.39ms max=1.91s    p(90)=1.04s    p(95)=1.16s    p(99.9)=1.77s  
       { expected_response:true }...: avg=514.38ms min=6.05ms  med=475.39ms max=1.91s    p(90)=1.04s    p(95)=1.16s    p(99.9)=1.77s  
     http_req_failed................: 0.00%  ✓ 0          ✗ 27404
     http_req_receiving.............: avg=124.69µs min=30.11µs med=50.96µs  max=120.79ms p(90)=101.97µs p(95)=233.72µs p(99.9)=6.78ms 
     http_req_sending...............: avg=111.12µs min=6.12µs  med=11.45µs  max=107.17ms p(90)=30.07µs  p(95)=117.6µs  p(99.9)=19.46ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=514.14ms min=6ms     med=475.15ms max=1.91s    p(90)=1.04s    p(95)=1.16s    p(99.9)=1.77s  
     http_reqs......................: 27404  409.075346/s
     iteration_duration.............: avg=534.24ms min=6.28ms  med=499.95ms max=1.91s    p(90)=1.04s    p(95)=1.17s    p(99.9)=1.79s  
     iterations.....................: 26404  394.147768/s
     success_rate...................: 99.92% ✓ 26384      ✗ 20   
     vus............................: 62     min=0        max=498
     vus_max........................: 500    min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 52215      ✗ 0    
     data_received..................: 1.6 GB  23 MB/s
     data_sent......................: 22 MB   308 kB/s
     http_req_blocked...............: avg=116.97µs min=1.17µs  med=2.81µs   max=149.68ms p(90)=5.09µs  p(95)=7.83µs   p(99.9)=28.88ms
     http_req_connecting............: avg=111.07µs min=0s      med=0s       max=149.62ms p(90)=0s      p(95)=0s       p(99.9)=28.64ms
     http_req_duration..............: avg=762.13ms min=7.13ms  med=711.13ms max=4.95s    p(90)=1.48s   p(95)=1.62s    p(99.9)=4.27s  
       { expected_response:true }...: avg=762.13ms min=7.13ms  med=711.13ms max=4.95s    p(90)=1.48s   p(95)=1.62s    p(99.9)=4.27s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 18405
     http_req_receiving.............: avg=174.3µs  min=25.95µs med=44.92µs  max=94.73ms  p(90)=99.23µs p(95)=242.83µs p(99.9)=24.66ms
     http_req_sending...............: avg=166.43µs min=5.4µs   med=11.05µs  max=92.57ms  p(90)=32.74µs p(95)=122.81µs p(99.9)=22.99ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=761.79ms min=7.07ms  med=711.01ms max=4.95s    p(90)=1.48s   p(95)=1.62s    p(99.9)=4.27s  
     http_reqs......................: 18405   263.190662/s
     iteration_duration.............: avg=806.2ms  min=7.53ms  med=770.89ms max=4.96s    p(90)=1.49s   p(95)=1.63s    p(99.9)=4.33s  
     iterations.....................: 17405   248.890707/s
     success_rate...................: 100.00% ✓ 17405      ✗ 0    
     vus............................: 65      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 50631      ✗ 0    
     data_received..................: 1.6 GB  22 MB/s
     data_sent......................: 21 MB   300 kB/s
     http_req_blocked...............: avg=72.05µs  min=1.29µs  med=2.78µs   max=79.81ms p(90)=4.76µs  p(95)=7.17µs   p(99.9)=19.72ms
     http_req_connecting............: avg=65.3µs   min=0s      med=0s       max=79.72ms p(90)=0s      p(95)=0s       p(99.9)=19.43ms
     http_req_duration..............: avg=783.44ms min=7.21ms  med=747.86ms max=5.1s    p(90)=1.53s   p(95)=1.7s     p(99.9)=4.03s  
       { expected_response:true }...: avg=783.44ms min=7.21ms  med=747.86ms max=5.1s    p(90)=1.53s   p(95)=1.7s     p(99.9)=4.03s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 17877
     http_req_receiving.............: avg=116.45µs min=26.16µs med=44.63µs  max=40.08ms p(90)=89.12µs p(95)=129.09µs p(99.9)=13.67ms
     http_req_sending...............: avg=123.61µs min=6µs     med=10.83µs  max=42.54ms p(90)=27.06µs p(95)=56.68µs  p(99.9)=21.47ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s      p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=783.2ms  min=7.15ms  med=747.51ms max=5.1s    p(90)=1.53s   p(95)=1.7s     p(99.9)=4.03s  
     http_reqs......................: 17877   255.298017/s
     iteration_duration.............: avg=830ms    min=7.56ms  med=795.69ms max=5.12s   p(90)=1.55s   p(95)=1.71s    p(99.9)=4.1s   
     iterations.....................: 16877   241.017208/s
     success_rate...................: 100.00% ✓ 16877      ✗ 0    
     vus............................: 66      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 29313      ✗ 0    
     data_received..................: 946 MB  14 MB/s
     data_sent......................: 13 MB   188 kB/s
     http_req_blocked...............: avg=28.73µs min=1.39µs med=3.4µs   max=32ms    p(90)=5.5µs    p(95)=12.11µs  p(99.9)=4.29ms
     http_req_connecting............: avg=22.76µs min=0s     med=0s      max=31.95ms p(90)=0s       p(95)=0s       p(99.9)=4.23ms
     http_req_duration..............: avg=1.2s    min=7.32ms med=1.15s   max=15.55s  p(90)=2.17s    p(95)=2.59s    p(99.9)=14.16s
       { expected_response:true }...: avg=1.2s    min=7.32ms med=1.15s   max=15.55s  p(90)=2.17s    p(95)=2.59s    p(99.9)=14.16s
     http_req_failed................: 0.00%   ✓ 0          ✗ 10771
     http_req_receiving.............: avg=80.27µs min=27.2µs med=56.15µs max=18.25ms p(90)=101.86µs p(95)=125.59µs p(99.9)=2.23ms
     http_req_sending...............: avg=38.56µs min=6.17µs med=13µs    max=15.13ms p(90)=30.77µs  p(95)=48.41µs  p(99.9)=6.84ms
     http_req_tls_handshaking.......: avg=0s      min=0s     med=0s      max=0s      p(90)=0s       p(95)=0s       p(99.9)=0s    
     http_req_waiting...............: avg=1.2s    min=7.27ms med=1.15s   max=15.55s  p(90)=2.17s    p(95)=2.59s    p(99.9)=14.16s
     http_reqs......................: 10771   157.180303/s
     iteration_duration.............: avg=1.33s   min=8.01ms med=1.29s   max=15.57s  p(90)=2.22s    p(95)=2.68s    p(99.9)=14.26s
     iterations.....................: 9771    142.587386/s
     success_rate...................: 100.00% ✓ 9771       ✗ 0    
     vus............................: 99      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@github-actions
Copy link

Overview for: constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 173 14040 total, 0 failed avg: 215ms, p95: 226ms
hive-router 169 13741 total, 0 failed avg: 220ms, p95: 229ms
cosmo 166 13480 total, 0 failed avg: 224ms, p95: 247ms
hive-gateway 165 12665 total, 0 failed avg: 238ms, p95: 264ms
hive-gateway-bun 162 12410 total, 0 failed avg: 243ms, p95: 269ms
apollo-router 138 11274 total, 0 failed avg: 268ms, p95: 313ms
apollo-gateway 124 10177 total, 0 failed avg: 298ms, p95: 333ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41820      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   202 kB/s
     http_req_blocked...............: avg=42.57µs  min=1.15µs   med=1.9µs    max=19.7ms   p(90)=3.47µs   p(95)=5.04µs   p(99.9)=14.4ms  
     http_req_connecting............: avg=38.73µs  min=0s       med=0s       max=17.03ms  p(90)=0s       p(95)=0s       p(99.9)=14.1ms  
     http_req_duration..............: avg=215.38ms min=159.4ms  med=214.6ms  max=575.01ms p(90)=223.37ms p(95)=225.85ms p(99.9)=487.11ms
       { expected_response:true }...: avg=215.38ms min=159.4ms  med=214.6ms  max=575.01ms p(90)=223.37ms p(95)=225.85ms p(99.9)=487.11ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 14040
     http_req_receiving.............: avg=77.28µs  min=27.35µs  med=46.28µs  max=9.45ms   p(90)=98.59µs  p(95)=270.79µs p(99.9)=2.55ms  
     http_req_sending...............: avg=138.58µs min=5.39µs   med=8.46µs   max=346.08ms p(90)=29.55µs  p(95)=94.37µs  p(99.9)=6.21ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=215.16ms min=159.35ms med=214.5ms  max=573.86ms p(90)=223.22ms p(95)=225.63ms p(99.9)=469.02ms
     http_reqs......................: 14040   173.286687/s
     iteration_duration.............: avg=215.65ms min=159.57ms med=214.82ms max=592.64ms p(90)=223.55ms p(95)=226.05ms p(99.9)=508.85ms
     iterations.....................: 13940   172.052451/s
     success_rate...................: 100.00% ✓ 13940      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40923      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   198 kB/s
     http_req_blocked...............: avg=19.09µs  min=1.1µs    med=1.99µs   max=8.93ms   p(90)=3.14µs   p(95)=4.45µs   p(99.9)=6.65ms  
     http_req_connecting............: avg=16.6µs   min=0s       med=0s       max=8.89ms   p(90)=0s       p(95)=0s       p(99.9)=6.63ms  
     http_req_duration..............: avg=219.86ms min=157.7ms  med=218.87ms max=611.92ms p(90)=226.82ms p(95)=229.22ms p(99.9)=517.79ms
       { expected_response:true }...: avg=219.86ms min=157.7ms  med=218.87ms max=611.92ms p(90)=226.82ms p(95)=229.22ms p(99.9)=517.79ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13741
     http_req_receiving.............: avg=72.43µs  min=25.6µs   med=41.3µs   max=12.15ms  p(90)=82.49µs  p(95)=246.32µs p(99.9)=3.38ms  
     http_req_sending...............: avg=156.15µs min=5.44µs   med=8.58µs   max=378.73ms p(90)=28.31µs  p(95)=92.66µs  p(99.9)=8.56ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=219.63ms min=157.65ms med=218.78ms max=611.19ms p(90)=226.66ms p(95)=229.08ms p(99.9)=501.44ms
     http_reqs......................: 13741   169.939239/s
     iteration_duration.............: avg=220.15ms min=157.89ms med=219.08ms max=617.37ms p(90)=226.99ms p(95)=229.39ms p(99.9)=530.68ms
     iterations.....................: 13641   168.702508/s
     success_rate...................: 100.00% ✓ 13641      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40140      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   193 kB/s
     http_req_blocked...............: avg=20.65µs  min=1.37µs   med=2.7µs    max=9.35ms   p(90)=4.17µs   p(95)=5.19µs   p(99.9)=6.89ms  
     http_req_connecting............: avg=17.22µs  min=0s       med=0s       max=9.32ms   p(90)=0s       p(95)=0s       p(99.9)=6.87ms  
     http_req_duration..............: avg=223.96ms min=118.74ms med=222.84ms max=620.52ms p(90)=241.93ms p(95)=247.28ms p(99.9)=526ms   
       { expected_response:true }...: avg=223.96ms min=118.74ms med=222.84ms max=620.52ms p(90)=241.93ms p(95)=247.28ms p(99.9)=526ms   
     http_req_failed................: 0.00%   ✓ 0          ✗ 13480
     http_req_receiving.............: avg=435.93µs min=32.84µs  med=64.91µs  max=33.83ms  p(90)=356.8µs  p(95)=708.53µs p(99.9)=25.64ms 
     http_req_sending...............: avg=155.05µs min=6.32µs   med=11.27µs  max=340.4ms  p(90)=34.34µs  p(95)=126.39µs p(99.9)=4.5ms   
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=223.37ms min=118.59ms med=222.35ms max=619.5ms  p(90)=241.44ms p(95)=246.72ms p(99.9)=512.47ms
     http_reqs......................: 13480   166.204176/s
     iteration_duration.............: avg=224.37ms min=118.92ms med=223.15ms max=644.42ms p(90)=242.18ms p(95)=247.54ms p(99.9)=555.67ms
     iterations.....................: 13380   164.971208/s
     success_rate...................: 100.00% ✓ 13380      ✗ 0    
     vus............................: 39      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 37695      ✗ 0    
     data_received..................: 1.1 GB  15 MB/s
     data_sent......................: 15 MB   193 kB/s
     http_req_blocked...............: avg=22.56µs  min=1.09µs   med=2.59µs   max=10.25ms  p(90)=4.22µs   p(95)=5.61µs   p(99.9)=7.34ms  
     http_req_connecting............: avg=19.12µs  min=0s       med=0s       max=10.21ms  p(90)=0s       p(95)=0s       p(99.9)=7.31ms  
     http_req_duration..............: avg=238.41ms min=154.73ms med=231.01ms max=671.39ms p(90)=253.37ms p(95)=264.12ms p(99.9)=557.71ms
       { expected_response:true }...: avg=238.41ms min=154.73ms med=231.01ms max=671.39ms p(90)=253.37ms p(95)=264.12ms p(99.9)=557.71ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12665
     http_req_receiving.............: avg=82.63µs  min=25.97µs  med=43.7µs   max=7.44ms   p(90)=102.66µs p(95)=222.16µs p(99.9)=2.67ms  
     http_req_sending...............: avg=124.03µs min=5.34µs   med=10.67µs  max=286.54ms p(90)=32.31µs  p(95)=123.07µs p(99.9)=5.44ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=238.2ms  min=151.22ms med=230.91ms max=670.68ms p(90)=253.26ms p(95)=263.96ms p(99.9)=556.48ms
     http_reqs......................: 12665   165.53344/s
     iteration_duration.............: avg=239.31ms min=154.98ms med=231.37ms max=699.97ms p(90)=253.63ms p(95)=264.58ms p(99.9)=590.79ms
     iterations.....................: 12565   164.226425/s
     success_rate...................: 100.00% ✓ 12565      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 36930      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 14 MB   189 kB/s
     http_req_blocked...............: avg=21.99µs  min=1.14µs   med=2.56µs   max=9.28ms   p(90)=4.26µs   p(95)=5.61µs   p(99.9)=6.86ms  
     http_req_connecting............: avg=18.64µs  min=0s       med=0s       max=9.24ms   p(90)=0s       p(95)=0s       p(99.9)=6.85ms  
     http_req_duration..............: avg=242.95ms min=160.18ms med=235.38ms max=723.8ms  p(90)=256.37ms p(95)=269.18ms p(99.9)=614.48ms
       { expected_response:true }...: avg=242.95ms min=160.18ms med=235.38ms max=723.8ms  p(90)=256.37ms p(95)=269.18ms p(99.9)=614.48ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12410
     http_req_receiving.............: avg=83.86µs  min=25.22µs  med=45.37µs  max=8.95ms   p(90)=100.15µs p(95)=183.77µs p(99.9)=2.88ms  
     http_req_sending...............: avg=86.81µs  min=5.42µs   med=10.73µs  max=263.1ms  p(90)=32.31µs  p(95)=120.6µs  p(99.9)=3.49ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=242.78ms min=160.1ms  med=235.27ms max=722.51ms p(90)=256.26ms p(95)=268.96ms p(99.9)=613.31ms
     http_reqs......................: 12410   162.557261/s
     iteration_duration.............: avg=243.94ms min=172.38ms med=235.7ms  max=735.98ms p(90)=256.7ms  p(95)=270.25ms p(99.9)=666.73ms
     iterations.....................: 12310   161.247371/s
     success_rate...................: 100.00% ✓ 12310      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 33522      ✗ 0    
     data_received..................: 989 MB  12 MB/s
     data_sent......................: 13 MB   161 kB/s
     http_req_blocked...............: avg=54.14µs  min=1.35µs   med=2.75µs   max=17.57ms  p(90)=4.06µs   p(95)=4.9µs    p(99.9)=15.32ms 
     http_req_connecting............: avg=49.77µs  min=0s       med=0s       max=17.43ms  p(90)=0s       p(95)=0s       p(99.9)=15.25ms 
     http_req_duration..............: avg=268.24ms min=157.42ms med=267.5ms  max=674.23ms p(90)=303.51ms p(95)=312.81ms p(99.9)=574.44ms
       { expected_response:true }...: avg=268.24ms min=157.42ms med=267.5ms  max=674.23ms p(90)=303.51ms p(95)=312.81ms p(99.9)=574.44ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11274
     http_req_receiving.............: avg=132.26µs min=31.57µs  med=51.68µs  max=132.4ms  p(90)=151.93µs p(95)=442.23µs p(99.9)=5.04ms  
     http_req_sending...............: avg=115.56µs min=6.01µs   med=11.11µs  max=194.83ms p(90)=38.64µs  p(95)=133.09µs p(99.9)=4.52ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=268ms    min=157.36ms med=267.26ms max=667.51ms p(90)=303.16ms p(95)=312.47ms p(99.9)=566.1ms 
     http_reqs......................: 11274   138.431199/s
     iteration_duration.............: avg=269.09ms min=157.59ms med=268.05ms max=689.68ms p(90)=303.88ms p(95)=313.16ms p(99.9)=598.93ms
     iterations.....................: 11174   137.203319/s
     success_rate...................: 100.00% ✓ 11174      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 30231      ✗ 0    
     data_received..................: 894 MB  11 MB/s
     data_sent......................: 12 MB   145 kB/s
     http_req_blocked...............: avg=32.15µs  min=1.32µs   med=3.19µs   max=10.91ms  p(90)=4.96µs   p(95)=5.74µs   p(99.9)=8.98ms  
     http_req_connecting............: avg=27.96µs  min=0s       med=0s       max=10.87ms  p(90)=0s       p(95)=0s       p(99.9)=8.93ms  
     http_req_duration..............: avg=297.58ms min=210.69ms med=294.11ms max=807.68ms p(90)=322.07ms p(95)=332.82ms p(99.9)=698.54ms
       { expected_response:true }...: avg=297.58ms min=210.69ms med=294.11ms max=807.68ms p(90)=322.07ms p(95)=332.82ms p(99.9)=698.54ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10177
     http_req_receiving.............: avg=80.4µs   min=29.97µs  med=57.47µs  max=8.99ms   p(90)=108.5µs  p(95)=136.74µs p(99.9)=2.25ms  
     http_req_sending...............: avg=147.68µs min=6.38µs   med=12.84µs  max=360.54ms p(90)=22.14µs  p(95)=37.39µs  p(99.9)=4.99ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=297.35ms min=210.59ms med=294ms    max=807.53ms p(90)=321.93ms p(95)=332.65ms p(99.9)=697.21ms
     http_reqs......................: 10177   124.619335/s
     iteration_duration.............: avg=298.82ms min=217.1ms  med=294.56ms max=834.88ms p(90)=322.54ms p(95)=333.3ms  p(99.9)=716.64ms
     iterations.....................: 10077   123.394816/s
     success_rate...................: 100.00% ✓ 10077      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@github-actions
Copy link

Overview for: constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 172 13936 total, 0 failed avg: 217ms, p95: 228ms
hive-router 167 13540 total, 0 failed avg: 223ms, p95: 234ms
cosmo 158 12880 total, 0 failed avg: 235ms, p95: 258ms
hive-gateway 149 11435 total, 0 failed avg: 264ms, p95: 293ms
hive-gateway-bun 148 11373 total, 0 failed avg: 265ms, p95: 381ms
apollo-router 126 10262 total, 0 failed avg: 295ms, p95: 338ms
apollo-gateway 79 6475 total, 0 failed avg: 468ms, p95: 540ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41508      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   200 kB/s
     http_req_blocked...............: avg=51.99µs  min=1.2µs    med=2.03µs   max=19.09ms  p(90)=3.74µs   p(95)=5.33µs   p(99.9)=15.9ms  
     http_req_connecting............: avg=48.15µs  min=0s       med=0s       max=18.87ms  p(90)=0s       p(95)=0s       p(99.9)=15.82ms 
     http_req_duration..............: avg=216.69ms min=116.87ms med=215.9ms  max=602.45ms p(90)=225.07ms p(95)=227.71ms p(99.9)=506.43ms
       { expected_response:true }...: avg=216.69ms min=116.87ms med=215.9ms  max=602.45ms p(90)=225.07ms p(95)=227.71ms p(99.9)=506.43ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13936
     http_req_receiving.............: avg=80.83µs  min=26.14µs  med=47.28µs  max=11.71ms  p(90)=97.27µs  p(95)=257.73µs p(99.9)=2.47ms  
     http_req_sending...............: avg=164.23µs min=6.17µs   med=8.98µs   max=371.23ms p(90)=33.53µs  p(95)=95.91µs  p(99.9)=10.89ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=216.45ms min=116.82ms med=215.8ms  max=598.59ms p(90)=224.91ms p(95)=227.53ms p(99.9)=486.53ms
     http_reqs......................: 13936   172.188076/s
     iteration_duration.............: avg=217ms    min=117.08ms med=216.14ms max=625.12ms p(90)=225.25ms p(95)=227.92ms p(99.9)=513.94ms
     iterations.....................: 13836   170.952512/s
     success_rate...................: 100.00% ✓ 13836      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40320      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   195 kB/s
     http_req_blocked...............: avg=38.5µs   min=1.14µs   med=2.18µs   max=18.16ms  p(90)=3.15µs   p(95)=4.55µs   p(99.9)=12.56ms 
     http_req_connecting............: avg=35.15µs  min=0s       med=0s       max=17.94ms  p(90)=0s       p(95)=0s       p(99.9)=12.49ms 
     http_req_duration..............: avg=223.15ms min=161.33ms med=222.45ms max=584.39ms p(90)=231.01ms p(95)=233.52ms p(99.9)=505.06ms
       { expected_response:true }...: avg=223.15ms min=161.33ms med=222.45ms max=584.39ms p(90)=231.01ms p(95)=233.52ms p(99.9)=505.06ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13540
     http_req_receiving.............: avg=73.2µs   min=23.62µs  med=42.94µs  max=7.65ms   p(90)=93.71µs  p(95)=257.25µs p(99.9)=1.04ms  
     http_req_sending...............: avg=142.81µs min=5.75µs   med=9.5µs    max=345.32ms p(90)=31.45µs  p(95)=95.99µs  p(99.9)=5.25ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=222.93ms min=161.29ms med=222.37ms max=582.84ms p(90)=230.85ms p(95)=233.34ms p(99.9)=483.73ms
     http_reqs......................: 13540   167.446591/s
     iteration_duration.............: avg=223.49ms min=161.47ms med=222.68ms max=605.28ms p(90)=231.2ms  p(95)=233.69ms p(99.9)=519.81ms
     iterations.....................: 13440   166.20991/s
     success_rate...................: 100.00% ✓ 13440      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 38340      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 15 MB   185 kB/s
     http_req_blocked...............: avg=49.89µs  min=1.41µs   med=2.65µs   max=20.77ms  p(90)=3.82µs   p(95)=4.74µs   p(99.9)=15.36ms 
     http_req_connecting............: avg=45.33µs  min=0s       med=0s       max=20.56ms  p(90)=0s       p(95)=0s       p(99.9)=15.3ms  
     http_req_duration..............: avg=234.8ms  min=160.74ms med=234.7ms  max=622.57ms p(90)=251.79ms p(95)=257.62ms p(99.9)=507.76ms
       { expected_response:true }...: avg=234.8ms  min=160.74ms med=234.7ms  max=622.57ms p(90)=251.79ms p(95)=257.62ms p(99.9)=507.76ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12880
     http_req_receiving.............: avg=284.08µs min=33.81µs  med=63.96µs  max=34.03ms  p(90)=175.87µs p(95)=432.4µs  p(99.9)=27.23ms 
     http_req_sending...............: avg=83.79µs  min=6.74µs   med=11.01µs  max=218.52ms p(90)=27.41µs  p(95)=91.81µs  p(99.9)=2.5ms   
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=234.43ms min=160.63ms med=234.42ms max=621.71ms p(90)=251.31ms p(95)=257.02ms p(99.9)=506.99ms
     http_reqs......................: 12880   158.817751/s
     iteration_duration.............: avg=235.29ms min=160.98ms med=235.08ms max=647.93ms p(90)=252.09ms p(95)=257.93ms p(99.9)=528.99ms
     iterations.....................: 12780   157.584694/s
     success_rate...................: 100.00% ✓ 12780      ✗ 0    
     vus............................: 39      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 34005      ✗ 0    
     data_received..................: 1.0 GB  13 MB/s
     data_sent......................: 13 MB   174 kB/s
     http_req_blocked...............: avg=27.73µs  min=1.14µs   med=2.61µs   max=11.44ms  p(90)=4.18µs   p(95)=5.3µs    p(99.9)=8.87ms  
     http_req_connecting............: avg=24.3µs   min=0s       med=0s       max=11.4ms   p(90)=0s       p(95)=0s       p(99.9)=8.83ms  
     http_req_duration..............: avg=264.14ms min=160.7ms  med=254.49ms max=718.93ms p(90)=273.63ms p(95)=292.97ms p(99.9)=634.08ms
       { expected_response:true }...: avg=264.14ms min=160.7ms  med=254.49ms max=718.93ms p(90)=273.63ms p(95)=292.97ms p(99.9)=634.08ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11435
     http_req_receiving.............: avg=112.04µs min=25.98µs  med=47.84µs  max=200.74ms p(90)=114.52µs p(95)=369.48µs p(99.9)=4.54ms  
     http_req_sending...............: avg=94.25µs  min=5.37µs   med=10.89µs  max=200.68ms p(90)=36.24µs  p(95)=141.87µs p(99.9)=4.55ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=263.93ms min=160.61ms med=254.37ms max=717.46ms p(90)=273.45ms p(95)=290.8ms  p(99.9)=633.28ms
     http_reqs......................: 11435   149.331929/s
     iteration_duration.............: avg=265.41ms min=163.46ms med=254.78ms max=772.76ms p(90)=273.95ms p(95)=295.67ms p(99.9)=669.27ms
     iterations.....................: 11335   148.02601/s
     success_rate...................: 100.00% ✓ 11335      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 33819      ✗ 0    
     data_received..................: 999 MB  13 MB/s
     data_sent......................: 13 MB   173 kB/s
     http_req_blocked...............: avg=28.66µs  min=1.19µs   med=2.74µs   max=11.25ms  p(90)=4.49µs   p(95)=6.07µs   p(99.9)=8.87ms  
     http_req_connecting............: avg=24.67µs  min=0s       med=0s       max=11.22ms  p(90)=0s       p(95)=0s       p(99.9)=8.83ms  
     http_req_duration..............: avg=265.38ms min=138.4ms  med=257.17ms max=784.93ms p(90)=282.02ms p(95)=381.21ms p(99.9)=657.56ms
       { expected_response:true }...: avg=265.38ms min=138.4ms  med=257.17ms max=784.93ms p(90)=282.02ms p(95)=381.21ms p(99.9)=657.56ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11373
     http_req_receiving.............: avg=114.55µs min=25.8µs   med=48.89µs  max=158.46ms p(90)=123.39µs p(95)=406.71µs p(99.9)=3.08ms  
     http_req_sending...............: avg=76.7µs   min=5.31µs   med=11.2µs   max=197.58ms p(90)=38.02µs  p(95)=149.86µs p(99.9)=6.31ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=265.19ms min=138.33ms med=257.05ms max=784.25ms p(90)=281.73ms p(95)=378.29ms p(99.9)=650.67ms
     http_reqs......................: 11373   148.504585/s
     iteration_duration.............: avg=266.8ms  min=138.57ms med=257.57ms max=809.78ms p(90)=282.44ms p(95)=386.99ms p(99.9)=764.28ms
     iterations.....................: 11273   147.198821/s
     success_rate...................: 100.00% ✓ 11273      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 30486      ✗ 0    
     data_received..................: 900 MB  11 MB/s
     data_sent......................: 12 MB   147 kB/s
     http_req_blocked...............: avg=52.94µs  min=1.77µs   med=2.79µs   max=18.24ms  p(90)=4.12µs   p(95)=4.97µs   p(99.9)=14.48ms 
     http_req_connecting............: avg=49.07µs  min=0s       med=0s       max=18.05ms  p(90)=0s       p(95)=0s       p(99.9)=14.4ms  
     http_req_duration..............: avg=294.64ms min=173.24ms med=297.03ms max=695.39ms p(90)=329.19ms p(95)=338.19ms p(99.9)=604.83ms
       { expected_response:true }...: avg=294.64ms min=173.24ms med=297.03ms max=695.39ms p(90)=329.19ms p(95)=338.19ms p(99.9)=604.83ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10262
     http_req_receiving.............: avg=81.39µs  min=35.16µs  med=50.05µs  max=7.47ms   p(90)=99.23µs  p(95)=178.46µs p(99.9)=1.3ms   
     http_req_sending...............: avg=74.26µs  min=7.17µs   med=10.86µs  max=193.59ms p(90)=23.21µs  p(95)=128.75µs p(99.9)=2.58ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=294.49ms min=173.04ms med=296.9ms  max=694.7ms  p(90)=328.92ms p(95)=337.99ms p(99.9)=603.84ms
     http_reqs......................: 10262   126.118781/s
     iteration_duration.............: avg=295.87ms min=173.52ms med=297.59ms max=722.57ms p(90)=329.58ms p(95)=338.63ms p(99.9)=667.46ms
     iterations.....................: 10162   124.889793/s
     success_rate...................: 100.00% ✓ 10162      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 19125     ✗ 0   
     data_received..................: 569 MB  6.9 MB/s
     data_sent......................: 7.5 MB  92 kB/s
     http_req_blocked...............: avg=118.56µs min=1.31µs   med=4.23µs   max=19.6ms   p(90)=6.52µs   p(95)=7.37µs   p(99.9)=18.33ms 
     http_req_connecting............: avg=113.1µs  min=0s       med=0s       max=19.55ms  p(90)=0s       p(95)=0s       p(99.9)=18.28ms 
     http_req_duration..............: avg=468.17ms min=211.95ms med=469.82ms max=951.24ms p(90)=523.22ms p(95)=540.16ms p(99.9)=882.03ms
       { expected_response:true }...: avg=468.17ms min=211.95ms med=469.82ms max=951.24ms p(90)=523.22ms p(95)=540.16ms p(99.9)=882.03ms
     http_req_failed................: 0.00%   ✓ 0         ✗ 6475
     http_req_receiving.............: avg=92.68µs  min=32.41µs  med=84.23µs  max=2.44ms   p(90)=136.65µs p(95)=159.16µs p(99.9)=894.43µs
     http_req_sending...............: avg=122.34µs min=6.71µs   med=17.59µs  max=332.77ms p(90)=27.33µs  p(95)=41.61µs  p(99.9)=5.23ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=467.96ms min=211.82ms med=469.72ms max=950.53ms p(90)=522.96ms p(95)=540ms    p(99.9)=879.32ms
     http_reqs......................: 6475    79.080227/s
     iteration_duration.............: avg=472.97ms min=277.72ms med=470.65ms max=1s       p(90)=523.88ms p(95)=540.9ms  p(99.9)=983.53ms
     iterations.....................: 6375    77.858911/s
     success_rate...................: 100.00% ✓ 6375      ✗ 0   
     vus............................: 50      min=0       max=50
     vus_max........................: 50      min=50      max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@ardatan ardatan merged commit c667fdf into main Sep 14, 2025
34 checks passed
@ardatan ardatan deleted the renovate/node-22.x branch September 14, 2025 23:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant