Skip to content

Conversation

renovate[bot]
Copy link
Contributor

@renovate renovate bot commented Sep 4, 2025

This PR contains the following updates:

Package Change Age Confidence
typescript (source) ~5.8.3 -> ~5.9.0 age confidence

Release Notes

microsoft/TypeScript (typescript)

v5.9.2

Compare Source


Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.


  • If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

@renovate renovate bot added the dependencies Pull requests that update a dependency file label Sep 4, 2025
Copy link

github-actions bot commented Sep 4, 2025

Overview for: constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1883 113462 total, 0 failed avg: 26ms, p95: 47ms
cosmo 658 39797 total, 0 failed avg: 75ms, p95: 110ms
grafbase 562 33924 total, 0 failed avg: 88ms, p95: 115ms
apollo-router 341 20783 total, 0 failed avg: 144ms, p95: 187ms
hive-gateway 175 10696 total, 0 failed avg: 281ms, p95: 409ms
hive-gateway-bun 173 10624 total, 0 failed avg: 282ms, p95: 406ms
apollo-gateway 120 7364 total, 0 failed avg: 408ms, p95: 479ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 340086      ✗ 0     
     data_received..................: 10 GB   165 MB/s
     data_sent......................: 132 MB  2.2 MB/s
     http_req_blocked...............: avg=4.92µs   min=1.13µs  med=2.48µs  max=8.55ms   p(90)=3.6µs    p(95)=4.25µs   p(99.9)=85.62µs
     http_req_connecting............: avg=1.95µs   min=0s      med=0s      max=8.51ms   p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_duration..............: avg=26.24ms  min=1.88ms  med=23.84ms max=426.69ms p(90)=40.42ms  p(95)=46.79ms  p(99.9)=83.31ms
       { expected_response:true }...: avg=26.24ms  min=1.88ms  med=23.84ms max=426.69ms p(90)=40.42ms  p(95)=46.79ms  p(99.9)=83.31ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 113462
     http_req_receiving.............: avg=109.59µs min=22.32µs med=41.76µs max=329.67ms p(90)=104.94µs p(95)=324.29µs p(99.9)=10.37ms
     http_req_sending...............: avg=87.24µs  min=5.12µs  med=9.96µs  max=382.64ms p(90)=29.53µs  p(95)=118.91µs p(99.9)=10.7ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=26.05ms  min=1.85ms  med=23.71ms max=412.93ms p(90)=40.07ms  p(95)=46.4ms   p(99.9)=81.18ms
     http_reqs......................: 113462  1883.090445/s
     iteration_duration.............: avg=26.45ms  min=5.26ms  med=24.04ms max=452ms    p(90)=40.62ms  p(95)=47ms     p(99.9)=83.86ms
     iterations.....................: 113362  1881.430779/s
     success_rate...................: 100.00% ✓ 113362      ✗ 0     
     vus............................: 50      min=50        max=50  
     vus_max........................: 50      min=50        max=50  

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 119091     ✗ 0    
     data_received..................: 3.5 GB  58 MB/s
     data_sent......................: 46 MB   766 kB/s
     http_req_blocked...............: avg=9.91µs   min=1.3µs   med=2.79µs  max=9.99ms   p(90)=4.15µs   p(95)=4.97µs   p(99.9)=2.14ms  
     http_req_connecting............: avg=6.47µs   min=0s      med=0s      max=9.95ms   p(90)=0s       p(95)=0s       p(99.9)=2.12ms  
     http_req_duration..............: avg=75.13ms  min=2.86ms  med=74.05ms max=523.6ms  p(90)=101.93ms p(95)=110.37ms p(99.9)=314.88ms
       { expected_response:true }...: avg=75.13ms  min=2.86ms  med=74.05ms max=523.6ms  p(90)=101.93ms p(95)=110.37ms p(99.9)=314.88ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 39797
     http_req_receiving.............: avg=159.58µs min=29.41µs med=74.89µs max=36.85ms  p(90)=152.2µs  p(95)=370.67µs p(99.9)=14.22ms 
     http_req_sending...............: avg=63.74µs  min=6.03µs  med=11.44µs max=447.67ms p(90)=29.13µs  p(95)=123.05µs p(99.9)=2.86ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=74.91ms  min=2.8ms   med=73.9ms  max=522.55ms p(90)=101.64ms p(95)=110.03ms p(99.9)=305.06ms
     http_reqs......................: 39797   658.682607/s
     iteration_duration.............: avg=75.58ms  min=5.29ms  med=74.35ms max=599.31ms p(90)=102.2ms  p(95)=110.61ms p(99.9)=330.12ms
     iterations.....................: 39697   657.0275/s
     success_rate...................: 100.00% ✓ 39697      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 101472     ✗ 0    
     data_received..................: 3.0 GB  49 MB/s
     data_sent......................: 40 MB   654 kB/s
     http_req_blocked...............: avg=12.81µs  min=1.33µs  med=3.25µs  max=9.31ms   p(90)=4.59µs   p(95)=6.33µs   p(99.9)=3.22ms  
     http_req_connecting............: avg=6.89µs   min=0s      med=0s      max=9.28ms   p(90)=0s       p(95)=0s       p(99.9)=2.8ms   
     http_req_duration..............: avg=88.1ms   min=2.57ms  med=87.16ms max=511.4ms  p(90)=107.82ms p(95)=114.61ms p(99.9)=310.1ms 
       { expected_response:true }...: avg=88.1ms   min=2.57ms  med=87.16ms max=511.4ms  p(90)=107.82ms p(95)=114.61ms p(99.9)=310.1ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 33924
     http_req_receiving.............: avg=176.35µs min=29.67µs med=66.79µs max=207.65ms p(90)=182.25µs p(95)=423.48µs p(99.9)=9.01ms  
     http_req_sending...............: avg=108.44µs min=6.32µs  med=12.79µs max=346.08ms p(90)=109.29µs p(95)=135.07µs p(99.9)=7.45ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=87.81ms  min=2.53ms  med=86.91ms max=492.52ms p(90)=107.53ms p(95)=114.29ms p(99.9)=300.35ms
     http_reqs......................: 33924   562.083373/s
     iteration_duration.............: avg=88.71ms  min=22.25ms med=87.5ms  max=524.7ms  p(90)=108.15ms p(95)=114.97ms p(99.9)=324.66ms
     iterations.....................: 33824   560.426483/s
     success_rate...................: 100.00% ✓ 33824      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 62049      ✗ 0    
     data_received..................: 1.8 GB  30 MB/s
     data_sent......................: 24 MB   397 kB/s
     http_req_blocked...............: avg=16.05µs  min=1.98µs  med=3.51µs   max=9.77ms   p(90)=5.37µs   p(95)=6.08µs   p(99.9)=5.69ms  
     http_req_connecting............: avg=11.84µs  min=0s      med=0s       max=9.74ms   p(90)=0s       p(95)=0s       p(99.9)=5.67ms  
     http_req_duration..............: avg=144.19ms min=6.51ms  med=143.48ms max=603.24ms p(90)=176.77ms p(95)=186.96ms p(99.9)=433.98ms
       { expected_response:true }...: avg=144.19ms min=6.51ms  med=143.48ms max=603.24ms p(90)=176.77ms p(95)=186.96ms p(99.9)=433.98ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 20783
     http_req_receiving.............: avg=93.39µs  min=38.51µs med=62.54µs  max=180.38ms p(90)=113.93µs p(95)=143.06µs p(99.9)=1.34ms  
     http_req_sending...............: avg=92.78µs  min=8.56µs  med=13.89µs  max=346.63ms p(90)=23.55µs  p(95)=41.16µs  p(99.9)=2.15ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=144.01ms min=6.44ms  med=143.35ms max=587.65ms p(90)=176.65ms p(95)=186.8ms  p(99.9)=421.46ms
     http_reqs......................: 20783   341.417893/s
     iteration_duration.............: avg=145.19ms min=39.78ms med=143.83ms max=652.24ms p(90)=177.06ms p(95)=187.3ms  p(99.9)=451.87ms
     iterations.....................: 20683   339.775118/s
     success_rate...................: 100.00% ✓ 20683      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 31788      ✗ 0    
     data_received..................: 939 MB  15 MB/s
     data_sent......................: 12 MB   204 kB/s
     http_req_blocked...............: avg=30.76µs  min=1.64µs  med=3.43µs   max=11.08ms  p(90)=4.62µs   p(95)=5.24µs   p(99.9)=9.02ms  
     http_req_connecting............: avg=25.89µs  min=0s      med=0s       max=11.05ms  p(90)=0s       p(95)=0s       p(99.9)=8.99ms  
     http_req_duration..............: avg=280.62ms min=6.89ms  med=268.95ms max=790.71ms p(90)=373.14ms p(95)=409.22ms p(99.9)=663.16ms
       { expected_response:true }...: avg=280.62ms min=6.89ms  med=268.95ms max=790.71ms p(90)=373.14ms p(95)=409.22ms p(99.9)=663.16ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10696
     http_req_receiving.............: avg=107.61µs min=33.47µs med=55.06µs  max=339.13ms p(90)=98.11µs  p(95)=117.9µs  p(99.9)=2.53ms  
     http_req_sending...............: avg=80.39µs  min=7.33µs  med=13.24µs  max=301.09ms p(90)=18.74µs  p(95)=35.1µs   p(99.9)=2.39ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=280.43ms min=6.84ms  med=268.8ms  max=754.81ms p(90)=373ms    p(95)=409.02ms p(99.9)=646.11ms
     http_reqs......................: 10696   175.108155/s
     iteration_duration.............: avg=283.66ms min=37.35ms med=269.53ms max=824.08ms p(90)=374.45ms p(95)=410.43ms p(99.9)=700.06ms
     iterations.....................: 10596   173.471018/s
     success_rate...................: 100.00% ✓ 10596      ✗ 0    
     vus............................: 33      min=33       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 31572      ✗ 0    
     data_received..................: 933 MB  15 MB/s
     data_sent......................: 12 MB   202 kB/s
     http_req_blocked...............: avg=63.36µs  min=1.56µs  med=3.5µs    max=17.84ms  p(90)=4.97µs   p(95)=5.57µs   p(99.9)=15.42ms 
     http_req_connecting............: avg=58.37µs  min=0s      med=0s       max=17.81ms  p(90)=0s       p(95)=0s       p(99.9)=15.34ms 
     http_req_duration..............: avg=282.37ms min=7.05ms  med=271.05ms max=742.32ms p(90)=374.46ms p(95)=406.45ms p(99.9)=579.92ms
       { expected_response:true }...: avg=282.37ms min=7.05ms  med=271.05ms max=742.32ms p(90)=374.46ms p(95)=406.45ms p(99.9)=579.92ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10624
     http_req_receiving.............: avg=84.97µs  min=33.73µs med=62.09µs  max=61.27ms  p(90)=107.28µs p(95)=125.87µs p(99.9)=1.75ms  
     http_req_sending...............: avg=67.11µs  min=6.89µs  med=14.17µs  max=226.03ms p(90)=21.5µs   p(95)=36.86µs  p(99.9)=5.67ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=282.22ms min=7ms     med=270.92ms max=708.07ms p(90)=374.3ms  p(95)=406.24ms p(99.9)=576.23ms
     http_reqs......................: 10624   173.739149/s
     iteration_duration.............: avg=285.53ms min=15.98ms med=271.81ms max=782.84ms p(90)=375.55ms p(95)=407.17ms p(99.9)=695ms   
     iterations.....................: 10524   172.103803/s
     success_rate...................: 100.00% ✓ 10524      ✗ 0    
     vus............................: 42      min=42       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 21792      ✗ 0   
     data_received..................: 647 MB  11 MB/s
     data_sent......................: 8.6 MB  140 kB/s
     http_req_blocked...............: avg=94.93µs  min=1.37µs   med=3µs      max=18.06ms  p(90)=4.63µs   p(95)=5.28µs   p(99.9)=16.77ms 
     http_req_connecting............: avg=90.54µs  min=0s       med=0s       max=17.9ms   p(90)=0s       p(95)=0s       p(99.9)=16.74ms 
     http_req_duration..............: avg=407.95ms min=7.43ms   med=407.28ms max=867.75ms p(90)=461.4ms  p(95)=478.99ms p(99.9)=792.9ms 
       { expected_response:true }...: avg=407.95ms min=7.43ms   med=407.28ms max=867.75ms p(90)=461.4ms  p(95)=478.99ms p(99.9)=792.9ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 7364
     http_req_receiving.............: avg=64.26µs  min=30.04µs  med=51.33µs  max=12.24ms  p(90)=96.77µs  p(95)=112.29µs p(99.9)=274.39µs
     http_req_sending...............: avg=96.28µs  min=6.4µs    med=12.11µs  max=192.05ms p(90)=19.81µs  p(95)=23.24µs  p(99.9)=3.82ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=407.79ms min=7.38ms   med=407.17ms max=867.09ms p(90)=461.26ms p(95)=478.89ms p(99.9)=792.25ms
     http_reqs......................: 7364    120.447693/s
     iteration_duration.............: avg=414.13ms min=119.65ms med=407.89ms max=904.53ms p(90)=462.04ms p(95)=479.94ms p(99.9)=894.56ms
     iterations.....................: 7264    118.812064/s
     success_rate...................: 100.00% ✓ 7264       ✗ 0   
     vus............................: 35      min=35       max=50
     vus_max........................: 50      min=50       max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Sep 4, 2025

Overview for: ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 500 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1692 105825 total, 0 failed avg: 132ms, p95: 330ms
cosmo 717 45747 total, 0 failed avg: 307ms, p95: 680ms
grafbase 463 29497 total, 0 failed avg: 476ms, p95: 1096ms
apollo-router 384 25829 total, 0 failed avg: 546ms, p95: 1240ms ❌ 11 unexpected GraphQL errors
hive-gateway 166 11511 total, 0 failed avg: 1168ms, p95: 2320ms
hive-gateway-bun 157 10901 total, 0 failed avg: 1227ms, p95: 2450ms
apollo-gateway 152 10521 total, 0 failed avg: 1238ms, p95: 2590ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 314475      ✗ 0     
     data_received..................: 9.3 GB  149 MB/s
     data_sent......................: 123 MB  2.0 MB/s
     http_req_blocked...............: avg=495.27µs min=1.19µs  med=2.86µs   max=359.08ms p(90)=4.72µs   p(95)=6.05µs   p(99.9)=172.85ms
     http_req_connecting............: avg=489.88µs min=0s      med=0s       max=358.87ms p(90)=0s       p(95)=0s       p(99.9)=172.21ms
     http_req_duration..............: avg=131.6ms  min=1.91ms  med=116.24ms max=518.24ms p(90)=275.29ms p(95)=330.01ms p(99.9)=448.8ms 
       { expected_response:true }...: avg=131.6ms  min=1.91ms  med=116.24ms max=518.24ms p(90)=275.29ms p(95)=330.01ms p(99.9)=448.8ms 
     http_req_failed................: 0.00%   ✓ 0           ✗ 105825
     http_req_receiving.............: avg=559.03µs min=25.17µs med=47.79µs  max=160.55ms p(90)=237.43µs p(95)=470.75µs p(99.9)=82.3ms  
     http_req_sending...............: avg=451.23µs min=5.61µs  med=11.21µs  max=158.01ms p(90)=35.39µs  p(95)=151.03µs p(99.9)=79.01ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=130.59ms min=1.86ms  med=115.49ms max=492.83ms p(90)=272.76ms p(95)=327.89ms p(99.9)=444.68ms
     http_reqs......................: 105825  1692.226503/s
     iteration_duration.............: avg=133.69ms min=2.05ms  med=117.74ms max=822.28ms p(90)=278.23ms p(95)=333.05ms p(99.9)=483.4ms 
     iterations.....................: 104825  1676.235702/s
     success_rate...................: 100.00% ✓ 104825      ✗ 0     
     vus............................: 84      min=0         max=497 
     vus_max........................: 500     min=500       max=500 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 134241    ✗ 0    
     data_received..................: 4.0 GB  63 MB/s
     data_sent......................: 53 MB   836 kB/s
     http_req_blocked...............: avg=89.69µs  min=1.23µs  med=2.74µs   max=148.98ms p(90)=3.94µs   p(95)=5.27µs   p(99.9)=30.52ms
     http_req_connecting............: avg=85.47µs  min=0s      med=0s       max=148.91ms p(90)=0s       p(95)=0s       p(99.9)=30.45ms
     http_req_duration..............: avg=306.95ms min=2.79ms  med=293.06ms max=1.29s    p(90)=602.78ms p(95)=680.16ms p(99.9)=1.01s  
       { expected_response:true }...: avg=306.95ms min=2.79ms  med=293.06ms max=1.29s    p(90)=602.78ms p(95)=680.16ms p(99.9)=1.01s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 45747
     http_req_receiving.............: avg=445.26µs min=27.44µs med=58.65µs  max=186.33ms p(90)=188.1µs  p(95)=449.82µs p(99.9)=65.46ms
     http_req_sending...............: avg=127.61µs min=5.86µs  med=11.1µs   max=81.14ms  p(90)=29.3µs   p(95)=122.68µs p(99.9)=24.28ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=306.38ms min=2.7ms   med=292.35ms max=1.29s    p(90)=602.34ms p(95)=679.48ms p(99.9)=1s     
     http_reqs......................: 45747   717.97031/s
     iteration_duration.............: avg=314.24ms min=2.99ms  med=300.42ms max=1.29s    p(90)=605.8ms  p(95)=683.03ms p(99.9)=1.01s  
     iterations.....................: 44747   702.27594/s
     success_rate...................: 100.00% ✓ 44747     ✗ 0    
     vus............................: 94      min=0       max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 85491      ✗ 0    
     data_received..................: 2.6 GB  41 MB/s
     data_sent......................: 34 MB   540 kB/s
     http_req_blocked...............: avg=652.24µs min=1.29µs  med=3.82µs   max=349.58ms p(90)=6.82µs   p(95)=10.96µs  p(99.9)=166.36ms
     http_req_connecting............: avg=639.14µs min=0s      med=0s       max=346.27ms p(90)=0s       p(95)=0s       p(99.9)=163.16ms
     http_req_duration..............: avg=475.92ms min=2.73ms  med=424.99ms max=1.73s    p(90)=984.82ms p(95)=1.09s    p(99.9)=1.49s   
       { expected_response:true }...: avg=475.92ms min=2.73ms  med=424.99ms max=1.73s    p(90)=984.82ms p(95)=1.09s    p(99.9)=1.49s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 29497
     http_req_receiving.............: avg=521.16µs min=29.02µs med=67.72µs  max=215.63ms p(90)=323.18µs p(95)=647.85µs p(99.9)=93ms    
     http_req_sending...............: avg=691.14µs min=6.1µs   med=14.09µs  max=247.73ms p(90)=126.14µs p(95)=195.17µs p(99.9)=121.43ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=474.71ms min=2.68ms  med=422.97ms max=1.73s    p(90)=982.97ms p(95)=1.09s    p(99.9)=1.49s   
     http_reqs......................: 29497   463.04858/s
     iteration_duration.............: avg=494.65ms min=3ms     med=448.31ms max=1.73s    p(90)=995.29ms p(95)=1.1s     p(99.9)=1.49s   
     iterations.....................: 28497   447.350421/s
     success_rate...................: 100.00% ✓ 28497      ✗ 0    
     vus............................: 97      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  99% — ✓ 24818 / ✗ 11
     ✓ valid response structure

     checks.........................: 99.98% ✓ 74476      ✗ 11   
     data_received..................: 2.3 GB 34 MB/s
     data_sent......................: 30 MB  448 kB/s
     http_req_blocked...............: avg=75.56µs  min=1.54µs  med=3.13µs   max=81.16ms p(90)=5.19µs   p(95)=7.79µs   p(99.9)=22.69ms
     http_req_connecting............: avg=69.85µs  min=0s      med=0s       max=80.95ms p(90)=0s       p(95)=0s       p(99.9)=22.64ms
     http_req_duration..............: avg=546.04ms min=6.24ms  med=506.97ms max=1.84s   p(90)=1.1s     p(95)=1.23s    p(99.9)=1.76s  
       { expected_response:true }...: avg=546.04ms min=6.24ms  med=506.97ms max=1.84s   p(90)=1.1s     p(95)=1.23s    p(99.9)=1.76s  
     http_req_failed................: 0.00%  ✓ 0          ✗ 25829
     http_req_receiving.............: avg=118.2µs  min=31.27µs med=55.63µs  max=70.53ms p(90)=106.69µs p(95)=180.83µs p(99.9)=8.64ms 
     http_req_sending...............: avg=99.17µs  min=6.76µs  med=12.08µs  max=46.87ms p(90)=31.05µs  p(95)=119.51µs p(99.9)=16.72ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s      p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=545.82ms min=6.19ms  med=506.74ms max=1.84s   p(90)=1.1s     p(95)=1.23s    p(99.9)=1.76s  
     http_reqs......................: 25829  384.280456/s
     iteration_duration.............: avg=568.41ms min=6.6ms   med=530.47ms max=1.84s   p(90)=1.11s    p(95)=1.24s    p(99.9)=1.76s  
     iterations.....................: 24829  369.402588/s
     success_rate...................: 99.95% ✓ 24818      ✗ 11   
     vus............................: 75     min=0        max=497
     vus_max........................: 500    min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 31533      ✗ 0    
     data_received..................: 1.0 GB  15 MB/s
     data_sent......................: 14 MB   198 kB/s
     http_req_blocked...............: avg=53.71µs min=1.65µs  med=3.38µs  max=42.97ms p(90)=5.14µs   p(95)=22.54µs  p(99.9)=14.12ms
     http_req_connecting............: avg=47.06µs min=0s      med=0s      max=42.89ms p(90)=0s       p(95)=0s       p(99.9)=14.07ms
     http_req_duration..............: avg=1.16s   min=6.61ms  med=1.15s   max=11.99s  p(90)=2.15s    p(95)=2.31s    p(99.9)=10.71s 
       { expected_response:true }...: avg=1.16s   min=6.61ms  med=1.15s   max=11.99s  p(90)=2.15s    p(95)=2.31s    p(99.9)=10.71s 
     http_req_failed................: 0.00%   ✓ 0          ✗ 11511
     http_req_receiving.............: avg=88.54µs min=31.14µs med=54.87µs max=13.33ms p(90)=104.17µs p(95)=150.51µs p(99.9)=3.06ms 
     http_req_sending...............: avg=52.82µs min=6.52µs  med=12.9µs  max=26.83ms p(90)=32.61µs  p(95)=49.25µs  p(99.9)=8.58ms 
     http_req_tls_handshaking.......: avg=0s      min=0s      med=0s      max=0s      p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=1.16s   min=6.56ms  med=1.15s   max=11.99s  p(90)=2.15s    p(95)=2.31s    p(99.9)=10.71s 
     http_reqs......................: 11511   166.243441/s
     iteration_duration.............: avg=1.27s   min=6.78ms  med=1.29s   max=12s     p(90)=2.17s    p(95)=2.33s    p(99.9)=10.75s 
     iterations.....................: 10511   151.801304/s
     success_rate...................: 100.00% ✓ 10511      ✗ 0    
     vus............................: 94      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 29703      ✗ 0    
     data_received..................: 957 MB  14 MB/s
     data_sent......................: 13 MB   188 kB/s
     http_req_blocked...............: avg=68.91µs min=1.51µs  med=3.89µs  max=57.4ms  p(90)=6.67µs   p(95)=25.73µs  p(99.9)=19.24ms
     http_req_connecting............: avg=59.51µs min=0s      med=0s      max=57.33ms p(90)=0s       p(95)=0s       p(99.9)=17.83ms
     http_req_duration..............: avg=1.22s   min=6.38ms  med=1.22s   max=12.92s  p(90)=2.26s    p(95)=2.45s    p(99.9)=11.78s 
       { expected_response:true }...: avg=1.22s   min=6.38ms  med=1.22s   max=12.92s  p(90)=2.26s    p(95)=2.45s    p(99.9)=11.78s 
     http_req_failed................: 0.00%   ✓ 0          ✗ 10901
     http_req_receiving.............: avg=108µs   min=30.37µs med=74.28µs max=23.01ms p(90)=132.83µs p(95)=180.25µs p(99.9)=3.77ms 
     http_req_sending...............: avg=71.53µs min=6.66µs  med=15.7µs  max=31.75ms p(90)=38.69µs  p(95)=68.21µs  p(99.9)=11.8ms 
     http_req_tls_handshaking.......: avg=0s      min=0s      med=0s      max=0s      p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=1.22s   min=6.32ms  med=1.22s   max=12.92s  p(90)=2.26s    p(95)=2.45s    p(99.9)=11.78s 
     http_reqs......................: 10901   157.986486/s
     iteration_duration.............: avg=1.35s   min=8.26ms  med=1.34s   max=12.93s  p(90)=2.29s    p(95)=2.47s    p(99.9)=11.9s  
     iterations.....................: 9901    143.493642/s
     success_rate...................: 100.00% ✓ 9901       ✗ 0    
     vus............................: 79      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 28563      ✗ 0    
     data_received..................: 924 MB  13 MB/s
     data_sent......................: 13 MB   182 kB/s
     http_req_blocked...............: avg=33.05µs min=1.35µs  med=3.52µs  max=19.05ms p(90)=5.74µs   p(95)=12.01µs  p(99.9)=5.5ms 
     http_req_connecting............: avg=26.75µs min=0s      med=0s      max=19ms    p(90)=0s       p(95)=0s       p(99.9)=5.44ms
     http_req_duration..............: avg=1.23s   min=7.42ms  med=1.18s   max=16.22s  p(90)=2.28s    p(95)=2.58s    p(99.9)=14.86s
       { expected_response:true }...: avg=1.23s   min=7.42ms  med=1.18s   max=16.22s  p(90)=2.28s    p(95)=2.58s    p(99.9)=14.86s
     http_req_failed................: 0.00%   ✓ 0          ✗ 10521
     http_req_receiving.............: avg=85.05µs min=26.67µs med=59.23µs max=12.79ms p(90)=108.29µs p(95)=136.51µs p(99.9)=2.56ms
     http_req_sending...............: avg=42.6µs  min=6.22µs  med=13.56µs max=24.38ms p(90)=32.55µs  p(95)=50.41µs  p(99.9)=7.01ms
     http_req_tls_handshaking.......: avg=0s      min=0s      med=0s      max=0s      p(90)=0s       p(95)=0s       p(99.9)=0s    
     http_req_waiting...............: avg=1.23s   min=7.37ms  med=1.18s   max=16.22s  p(90)=2.28s    p(95)=2.58s    p(99.9)=14.86s
     http_reqs......................: 10521   152.197263/s
     iteration_duration.............: avg=1.36s   min=8.14ms  med=1.32s   max=16.23s  p(90)=2.33s    p(95)=2.64s    p(99.9)=14.99s
     iterations.....................: 9521    137.731218/s
     success_rate...................: 100.00% ✓ 9521       ✗ 0    
     vus............................: 85      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Sep 4, 2025

Overview for: constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 169 13709 total, 0 failed avg: 220ms, p95: 233ms
hive-router 167 13585 total, 0 failed avg: 222ms, p95: 233ms
cosmo 166 13494 total, 0 failed avg: 224ms, p95: 246ms
hive-gateway 145 11086 total, 0 failed avg: 272ms, p95: 427ms
hive-gateway-bun 145 11124 total, 0 failed avg: 271ms, p95: 422ms
apollo-router 144 11791 total, 0 failed avg: 256ms, p95: 301ms
apollo-gateway 126 10274 total, 0 failed avg: 294ms, p95: 321ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40827      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   197 kB/s
     http_req_blocked...............: avg=22µs     min=1.31µs   med=2.94µs   max=10.03ms  p(90)=4.02µs   p(95)=4.75µs   p(99.9)=7.46ms  
     http_req_connecting............: avg=18.33µs  min=0s       med=0s       max=9.98ms   p(90)=0s       p(95)=0s       p(99.9)=7.42ms  
     http_req_duration..............: avg=220.47ms min=205.6ms  med=218.76ms max=660.7ms  p(90)=229.61ms p(95)=233.1ms  p(99.9)=539.99ms
       { expected_response:true }...: avg=220.47ms min=205.6ms  med=218.76ms max=660.7ms  p(90)=229.61ms p(95)=233.1ms  p(99.9)=539.99ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13709
     http_req_receiving.............: avg=79.51µs  min=28.64µs  med=53.34µs  max=9.36ms   p(90)=94.58µs  p(95)=132.24µs p(99.9)=2.6ms   
     http_req_sending...............: avg=71.12µs  min=6.42µs   med=12.02µs  max=204.56ms p(90)=18.11µs  p(95)=33.97µs  p(99.9)=3.82ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=220.31ms min=205.54ms med=218.66ms max=659.62ms p(90)=229.5ms  p(95)=232.94ms p(99.9)=538.75ms
     http_reqs......................: 13709   169.112875/s
     iteration_duration.............: avg=220.81ms min=205.74ms med=219.05ms max=673.15ms p(90)=229.92ms p(95)=233.41ms p(99.9)=555.77ms
     iterations.....................: 13609   167.879285/s
     success_rate...................: 100.00% ✓ 13609      ✗ 0    
     vus............................: 27      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40455      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   195 kB/s
     http_req_blocked...............: avg=41.14µs  min=1.19µs   med=2.18µs   max=18.97ms  p(90)=3.59µs   p(95)=5.15µs   p(99.9)=12.65ms 
     http_req_connecting............: avg=38.23µs  min=0s       med=0s       max=18.93ms  p(90)=0s       p(95)=0s       p(99.9)=12.59ms 
     http_req_duration..............: avg=222.39ms min=117.14ms med=221.45ms max=611.27ms p(90)=230.12ms p(95)=232.81ms p(99.9)=506.36ms
       { expected_response:true }...: avg=222.39ms min=117.14ms med=221.45ms max=611.27ms p(90)=230.12ms p(95)=232.81ms p(99.9)=506.36ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13585
     http_req_receiving.............: avg=88.59µs  min=26.75µs  med=46.25µs  max=34.44ms  p(90)=98.02µs  p(95)=286.72µs p(99.9)=5.53ms  
     http_req_sending...............: avg=104.7µs  min=5.74µs   med=9.27µs   max=338.48ms p(90)=32.41µs  p(95)=102.3µs  p(99.9)=6.19ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=222.2ms  min=116.88ms med=221.36ms max=600.92ms p(90)=229.95ms p(95)=232.64ms p(99.9)=495.2ms 
     http_reqs......................: 13585   167.836672/s
     iteration_duration.............: avg=222.77ms min=117.34ms med=221.68ms max=627.5ms  p(90)=230.29ms p(95)=233.02ms p(99.9)=530.64ms
     iterations.....................: 13485   166.601216/s
     success_rate...................: 100.00% ✓ 13485      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40182      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   194 kB/s
     http_req_blocked...............: avg=20.01µs  min=1.27µs   med=2.66µs   max=9.24ms   p(90)=3.99µs   p(95)=4.86µs   p(99.9)=6.58ms  
     http_req_connecting............: avg=16.67µs  min=0s       med=0s       max=9.21ms   p(90)=0s       p(95)=0s       p(99.9)=6.57ms  
     http_req_duration..............: avg=223.7ms  min=165ms    med=222.35ms max=642.72ms p(90)=239.89ms p(95)=245.75ms p(99.9)=525.48ms
       { expected_response:true }...: avg=223.7ms  min=165ms    med=222.35ms max=642.72ms p(90)=239.89ms p(95)=245.75ms p(99.9)=525.48ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13494
     http_req_receiving.............: avg=338.27µs min=30.66µs  med=62.59µs  max=32.54ms  p(90)=317.63µs p(95)=655.29µs p(99.9)=21.25ms 
     http_req_sending...............: avg=93.61µs  min=6.07µs   med=11.12µs  max=269.4ms  p(90)=30.59µs  p(95)=123.15µs p(99.9)=3.52ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=223.26ms min=164.79ms med=221.98ms max=641.81ms p(90)=239.38ms p(95)=245.25ms p(99.9)=524.49ms
     http_reqs......................: 13494   166.454454/s
     iteration_duration.............: avg=224.06ms min=165.27ms med=222.68ms max=653.6ms  p(90)=240.2ms  p(95)=246.03ms p(99.9)=540.19ms
     iterations.....................: 13394   165.220909/s
     success_rate...................: 100.00% ✓ 13394      ✗ 0    
     vus............................: 9       min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 32958      ✗ 0    
     data_received..................: 974 MB  13 MB/s
     data_sent......................: 13 MB   169 kB/s
     http_req_blocked...............: avg=33.49µs  min=1.57µs   med=3.99µs   max=12.04ms  p(90)=5.74µs   p(95)=6.93µs   p(99.9)=9.55ms  
     http_req_connecting............: avg=27.1µs   min=0s       med=0s       max=11.99ms  p(90)=0s       p(95)=0s       p(99.9)=9.53ms  
     http_req_duration..............: avg=271.96ms min=159.81ms med=256.45ms max=827.27ms p(90)=313.29ms p(95)=427.35ms p(99.9)=700.6ms 
       { expected_response:true }...: avg=271.96ms min=159.81ms med=256.45ms max=827.27ms p(90)=313.29ms p(95)=427.35ms p(99.9)=700.6ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 11086
     http_req_receiving.............: avg=112.39µs min=30.8µs   med=78.67µs  max=10.14ms  p(90)=134.29µs p(95)=177.36µs p(99.9)=3.96ms  
     http_req_sending...............: avg=98.36µs  min=7.3µs    med=15.5µs   max=278.97ms p(90)=34.44µs  p(95)=56.59µs  p(99.9)=3.33ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=271.75ms min=159.71ms med=256.32ms max=825.88ms p(90)=313.05ms p(95)=427.09ms p(99.9)=699.05ms
     http_reqs......................: 11086   145.000216/s
     iteration_duration.............: avg=273.52ms min=171.33ms med=257.02ms max=854.23ms p(90)=315.48ms p(95)=428.77ms p(99.9)=783.14ms
     iterations.....................: 10986   143.692258/s
     success_rate...................: 100.00% ✓ 10986      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 33072      ✗ 0    
     data_received..................: 977 MB  13 MB/s
     data_sent......................: 13 MB   169 kB/s
     http_req_blocked...............: avg=28.57µs  min=1.52µs   med=3.88µs   max=10.36ms  p(90)=5.6µs    p(95)=6.77µs   p(99.9)=8.1ms   
     http_req_connecting............: avg=22.99µs  min=0s       med=0s       max=10.31ms  p(90)=0s       p(95)=0s       p(99.9)=7.86ms  
     http_req_duration..............: avg=271.15ms min=160.69ms med=257.05ms max=838.11ms p(90)=306.79ms p(95)=422.44ms p(99.9)=705.51ms
       { expected_response:true }...: avg=271.15ms min=160.69ms med=257.05ms max=838.11ms p(90)=306.79ms p(95)=422.44ms p(99.9)=705.51ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11124
     http_req_receiving.............: avg=115.46µs min=34.96µs  med=80.46µs  max=12.03ms  p(90)=143.57µs p(95)=186.83µs p(99.9)=4.83ms  
     http_req_sending...............: avg=74.47µs  min=6.72µs   med=16.34µs  max=292.34ms p(90)=35.43µs  p(95)=56.54µs  p(99.9)=4.17ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=270.96ms min=160.51ms med=256.84ms max=836.56ms p(90)=306.56ms p(95)=422.26ms p(99.9)=704.54ms
     http_reqs......................: 11124   145.118924/s
     iteration_duration.............: avg=272.66ms min=172.24ms med=257.56ms max=867.62ms p(90)=308.55ms p(95)=423.63ms p(99.9)=746.32ms
     iterations.....................: 11024   143.814367/s
     success_rate...................: 100.00% ✓ 11024      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 35073      ✗ 0    
     data_received..................: 1.0 GB  13 MB/s
     data_sent......................: 14 MB   169 kB/s
     http_req_blocked...............: avg=23.3µs   min=1.32µs   med=2.71µs   max=9.13ms   p(90)=3.99µs   p(95)=4.87µs   p(99.9)=7.07ms  
     http_req_connecting............: avg=19.44µs  min=0s       med=0s       max=9.1ms    p(90)=0s       p(95)=0s       p(99.9)=7.05ms  
     http_req_duration..............: avg=256.25ms min=166.87ms med=251.5ms  max=696.46ms p(90)=289.71ms p(95)=300.61ms p(99.9)=592.91ms
       { expected_response:true }...: avg=256.25ms min=166.87ms med=251.5ms  max=696.46ms p(90)=289.71ms p(95)=300.61ms p(99.9)=592.91ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11791
     http_req_receiving.............: avg=123.29µs min=30.67µs  med=49.51µs  max=206.02ms p(90)=129.96µs p(95)=394.22µs p(99.9)=3.77ms  
     http_req_sending...............: avg=81.47µs  min=6µs      med=11.04µs  max=152.63ms p(90)=33.68µs  p(95)=137.52µs p(99.9)=3.62ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=256.05ms min=166.72ms med=251.38ms max=685ms    p(90)=289.54ms p(95)=300.44ms p(99.9)=591.3ms 
     http_reqs......................: 11791   144.981728/s
     iteration_duration.............: avg=256.96ms min=167.14ms med=251.92ms max=710.94ms p(90)=290.11ms p(95)=300.97ms p(99.9)=613.98ms
     iterations.....................: 11691   143.752132/s
     success_rate...................: 100.00% ✓ 11691      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 30522      ✗ 0    
     data_received..................: 902 MB  11 MB/s
     data_sent......................: 12 MB   147 kB/s
     http_req_blocked...............: avg=33µs     min=1.39µs   med=3.2µs    max=11.16ms  p(90)=4.64µs   p(95)=5.48µs   p(99.9)=9.11ms  
     http_req_connecting............: avg=28.28µs  min=0s       med=0s       max=11.12ms  p(90)=0s       p(95)=0s       p(99.9)=9.09ms  
     http_req_duration..............: avg=294.21ms min=210.29ms med=292.6ms  max=778.6ms  p(90)=314.01ms p(95)=321.49ms p(99.9)=690.41ms
       { expected_response:true }...: avg=294.21ms min=210.29ms med=292.6ms  max=778.6ms  p(90)=314.01ms p(95)=321.49ms p(99.9)=690.41ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10274
     http_req_receiving.............: avg=76.93µs  min=30.81µs  med=56.87µs  max=6.18ms   p(90)=104.37µs p(95)=127.46µs p(99.9)=1.89ms  
     http_req_sending...............: avg=67.79µs  min=6.39µs   med=12.57µs  max=275.14ms p(90)=20.66µs  p(95)=37.32µs  p(99.9)=1.61ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=294.07ms min=210.22ms med=292.51ms max=777.82ms p(90)=313.92ms p(95)=321.38ms p(99.9)=689.28ms
     http_reqs......................: 10274   126.071754/s
     iteration_duration.............: avg=295.39ms min=224.55ms med=293ms    max=797.84ms p(90)=314.36ms p(95)=321.86ms p(99.9)=719.1ms 
     iterations.....................: 10174   124.844658/s
     success_rate...................: 100.00% ✓ 10174      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Sep 4, 2025

Overview for: constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 170 13784 total, 0 failed avg: 219ms, p95: 230ms
hive-router 166 13486 total, 0 failed avg: 224ms, p95: 235ms
cosmo 157 12743 total, 0 failed avg: 237ms, p95: 263ms
hive-gateway-bun 136 10452 total, 0 failed avg: 289ms, p95: 414ms
hive-gateway 130 10011 total, 0 failed avg: 302ms, p95: 429ms
apollo-router 125 10196 total, 0 failed avg: 296ms, p95: 342ms
apollo-gateway 86 7053 total, 0 failed avg: 429ms, p95: 470ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41052      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   198 kB/s
     http_req_blocked...............: avg=46.66µs  min=1.32µs   med=3.02µs   max=17.39ms  p(90)=4.09µs   p(95)=4.87µs   p(99.9)=14.31ms 
     http_req_connecting............: avg=42.8µs   min=0s       med=0s       max=17.36ms  p(90)=0s       p(95)=0s       p(99.9)=14.29ms 
     http_req_duration..............: avg=219.31ms min=205.64ms med=218.01ms max=624.04ms p(90)=227.04ms p(95)=230.28ms p(99.9)=506.05ms
       { expected_response:true }...: avg=219.31ms min=205.64ms med=218.01ms max=624.04ms p(90)=227.04ms p(95)=230.28ms p(99.9)=506.05ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13784
     http_req_receiving.............: avg=73.91µs  min=29.61µs  med=52.95µs  max=3.91ms   p(90)=93.52µs  p(95)=118.22µs p(99.9)=2.03ms  
     http_req_sending...............: avg=47.04µs  min=6.06µs   med=12.34µs  max=126.51ms p(90)=18.25µs  p(95)=34.85µs  p(99.9)=5.62ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=219.18ms min=205.56ms med=217.91ms max=623.8ms  p(90)=226.93ms p(95)=230.18ms p(99.9)=505.83ms
     http_reqs......................: 13784   170.017508/s
     iteration_duration.............: avg=219.73ms min=205.78ms med=218.3ms  max=654.2ms  p(90)=227.33ms p(95)=230.55ms p(99.9)=540.7ms 
     iterations.....................: 13684   168.784067/s
     success_rate...................: 100.00% ✓ 13684      ✗ 0    
     vus............................: 31      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40158      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   194 kB/s
     http_req_blocked...............: avg=45.18µs  min=1.22µs   med=2.19µs   max=15.7ms   p(90)=3.25µs   p(95)=4.46µs   p(99.9)=13.25ms 
     http_req_connecting............: avg=42.29µs  min=0s       med=0s       max=15.66ms  p(90)=0s       p(95)=0s       p(99.9)=13.21ms 
     http_req_duration..............: avg=223.9ms  min=114.69ms med=223ms    max=588.57ms p(90)=232.33ms p(95)=234.82ms p(99.9)=496.51ms
       { expected_response:true }...: avg=223.9ms  min=114.69ms med=223ms    max=588.57ms p(90)=232.33ms p(95)=234.82ms p(99.9)=496.51ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13486
     http_req_receiving.............: avg=98.24µs  min=25.57µs  med=43.31µs  max=308.56ms p(90)=89.57µs  p(95)=252.1µs  p(99.9)=1.65ms  
     http_req_sending...............: avg=126.05µs min=5.46µs   med=9.33µs   max=359.34ms p(90)=29.28µs  p(95)=94.23µs  p(99.9)=6.92ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=223.67ms min=110.62ms med=222.91ms max=584.61ms p(90)=232.19ms p(95)=234.68ms p(99.9)=478.9ms 
     http_reqs......................: 13486   166.704757/s
     iteration_duration.............: avg=224.29ms min=114.89ms med=223.24ms max=610.78ms p(90)=232.54ms p(95)=235.07ms p(99.9)=533ms   
     iterations.....................: 13386   165.468625/s
     success_rate...................: 100.00% ✓ 13386      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 37929      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 15 MB   183 kB/s
     http_req_blocked...............: avg=56.98µs  min=1.44µs   med=2.66µs   max=18.19ms  p(90)=3.92µs   p(95)=5.04µs   p(99.9)=15.4ms  
     http_req_connecting............: avg=53.27µs  min=0s       med=0s       max=17.91ms  p(90)=0s       p(95)=0s       p(99.9)=15.36ms 
     http_req_duration..............: avg=236.83ms min=161.79ms med=236.29ms max=630.84ms p(90)=256.45ms p(95)=262.77ms p(99.9)=522.26ms
       { expected_response:true }...: avg=236.83ms min=161.79ms med=236.29ms max=630.84ms p(90)=256.45ms p(95)=262.77ms p(99.9)=522.26ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12743
     http_req_receiving.............: avg=263.42µs min=33.54µs  med=61.35µs  max=49.78ms  p(90)=165.2µs  p(95)=428.97µs p(99.9)=23.2ms  
     http_req_sending...............: avg=93.96µs  min=6.84µs   med=11.04µs  max=231.13ms p(90)=28.85µs  p(95)=118.26µs p(99.9)=4.42ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=236.47ms min=161.72ms med=236ms    max=620.83ms p(90)=255.98ms p(95)=262.22ms p(99.9)=519.06ms
     http_reqs......................: 12743   157.435984/s
     iteration_duration.............: avg=237.35ms min=161.96ms med=236.66ms max=660.11ms p(90)=256.71ms p(95)=263.07ms p(99.9)=539.9ms 
     iterations.....................: 12643   156.200514/s
     success_rate...................: 100.00% ✓ 12643      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 31056      ✗ 0    
     data_received..................: 918 MB  12 MB/s
     data_sent......................: 12 MB   159 kB/s
     http_req_blocked...............: avg=32.01µs  min=1.64µs   med=3.38µs   max=11.5ms   p(90)=5.09µs   p(95)=5.87µs   p(99.9)=9.25ms  
     http_req_connecting............: avg=27.25µs  min=0s       med=0s       max=11.45ms  p(90)=0s       p(95)=0s       p(99.9)=9.22ms  
     http_req_duration..............: avg=288.58ms min=159.9ms  med=271.42ms max=794.48ms p(90)=389.31ms p(95)=413.8ms  p(99.9)=673.89ms
       { expected_response:true }...: avg=288.58ms min=159.9ms  med=271.42ms max=794.48ms p(90)=389.31ms p(95)=413.8ms  p(99.9)=673.89ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10452
     http_req_receiving.............: avg=84.08µs  min=33.94µs  med=64.34µs  max=7.03ms   p(90)=113.24µs p(95)=138.37µs p(99.9)=2.73ms  
     http_req_sending...............: avg=141.55µs min=8.14µs   med=13.47µs  max=225.52ms p(90)=22.72µs  p(95)=37.05µs  p(99.9)=4.76ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=288.35ms min=159.77ms med=271.28ms max=793.09ms p(90)=389.01ms p(95)=413.44ms p(99.9)=672.55ms
     http_reqs......................: 10452   136.722352/s
     iteration_duration.............: avg=290.27ms min=176.03ms med=271.89ms max=825.78ms p(90)=390.45ms p(95)=414.51ms p(99.9)=704.07ms
     iterations.....................: 10352   135.414254/s
     success_rate...................: 100.00% ✓ 10352      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 29733      ✗ 0    
     data_received..................: 879 MB  12 MB/s
     data_sent......................: 12 MB   152 kB/s
     http_req_blocked...............: avg=36.24µs  min=1.79µs   med=4.12µs   max=11.84ms  p(90)=5.79µs   p(95)=6.7µs    p(99.9)=9.63ms  
     http_req_connecting............: avg=30.86µs  min=0s       med=0s       max=11.8ms   p(90)=0s       p(95)=0s       p(99.9)=9.6ms   
     http_req_duration..............: avg=301.7ms  min=160.55ms med=285.2ms  max=852.5ms  p(90)=403.62ms p(95)=429.11ms p(99.9)=755.47ms
       { expected_response:true }...: avg=301.7ms  min=160.55ms med=285.2ms  max=852.5ms  p(90)=403.62ms p(95)=429.11ms p(99.9)=755.47ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10011
     http_req_receiving.............: avg=94µs     min=36.75µs  med=78.91µs  max=6.17ms   p(90)=126.42µs p(95)=154.69µs p(99.9)=2.51ms  
     http_req_sending...............: avg=171.08µs min=8.27µs   med=16.19µs  max=382.41ms p(90)=25.87µs  p(95)=42.29µs  p(99.9)=4.87ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=301.43ms min=160.43ms med=285.04ms max=851.27ms p(90)=403.18ms p(95)=428.66ms p(99.9)=754.24ms
     http_reqs......................: 10011   130.523545/s
     iteration_duration.............: avg=303.62ms min=175.12ms med=285.73ms max=911.04ms p(90)=404.64ms p(95)=429.9ms  p(99.9)=805.17ms
     iterations.....................: 9911    129.219743/s
     success_rate...................: 100.00% ✓ 9911       ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 30288      ✗ 0    
     data_received..................: 895 MB  11 MB/s
     data_sent......................: 12 MB   146 kB/s
     http_req_blocked...............: avg=65.86µs  min=1.69µs   med=2.68µs   max=18.72ms  p(90)=4.09µs   p(95)=4.87µs   p(99.9)=15.52ms 
     http_req_connecting............: avg=62.19µs  min=0s       med=0s       max=18.56ms  p(90)=0s       p(95)=0s       p(99.9)=15.42ms 
     http_req_duration..............: avg=296.15ms min=175.83ms med=296.71ms max=709.37ms p(90)=331.98ms p(95)=341.52ms p(99.9)=627.26ms
       { expected_response:true }...: avg=296.15ms min=175.83ms med=296.71ms max=709.37ms p(90)=331.98ms p(95)=341.52ms p(99.9)=627.26ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10196
     http_req_receiving.............: avg=102.8µs  min=35.33µs  med=53.39µs  max=163.84ms p(90)=105.51µs p(95)=222.66µs p(99.9)=1.33ms  
     http_req_sending...............: avg=101.53µs min=7.28µs   med=11.19µs  max=256.73ms p(90)=29.8µs   p(95)=131.48µs p(99.9)=5.65ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=295.95ms min=175.78ms med=296.61ms max=698.57ms p(90)=331.79ms p(95)=341.36ms p(99.9)=619.32ms
     http_reqs......................: 10196   125.301748/s
     iteration_duration.............: avg=297.34ms min=175.96ms med=297.31ms max=743.24ms p(90)=332.36ms p(95)=341.91ms p(99.9)=664.61ms
     iterations.....................: 10096   124.072817/s
     success_rate...................: 100.00% ✓ 10096      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 20859     ✗ 0   
     data_received..................: 620 MB  7.6 MB/s
     data_sent......................: 8.2 MB  100 kB/s
     http_req_blocked...............: avg=45.22µs  min=1.44µs   med=3.18µs   max=11.77ms p(90)=4.73µs   p(95)=5.34µs   p(99.9)=10.26ms 
     http_req_connecting............: avg=41.58µs  min=0s       med=0s       max=11.74ms p(90)=0s       p(95)=0s       p(99.9)=10.23ms 
     http_req_duration..............: avg=429.32ms min=211.5ms  med=431.33ms max=1.01s   p(90)=458.93ms p(95)=470.26ms p(99.9)=900.03ms
       { expected_response:true }...: avg=429.32ms min=211.5ms  med=431.33ms max=1.01s   p(90)=458.93ms p(95)=470.26ms p(99.9)=900.03ms
     http_req_failed................: 0.00%   ✓ 0         ✗ 7053
     http_req_receiving.............: avg=67.52µs  min=31.67µs  med=53.96µs  max=18.94ms p(90)=96.11µs  p(95)=112.37µs p(99.9)=493.96µs
     http_req_sending...............: avg=95.59µs  min=6.49µs   med=12.85µs  max=212.6ms p(90)=19.96µs  p(95)=23.82µs  p(99.9)=3.42ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=429.16ms min=211.41ms med=431.25ms max=1.01s   p(90)=458.82ms p(95)=470.13ms p(99.9)=898.9ms 
     http_reqs......................: 7053    86.31165/s
     iteration_duration.............: avg=433.01ms min=261.26ms med=431.81ms max=1.04s   p(90)=459.4ms  p(95)=470.59ms p(99.9)=1.02s   
     iterations.....................: 6953    85.087892/s
     success_rate...................: 100.00% ✓ 6953      ✗ 0   
     vus............................: 50      min=0       max=50
     vus_max........................: 50      min=50      max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@renovate renovate bot force-pushed the renovate/typescript-5.x branch from f86eee5 to b5c8a7c Compare September 4, 2025 12:33
@ardatan ardatan merged commit 7a40b4b into main Sep 5, 2025
33 checks passed
@ardatan ardatan deleted the renovate/typescript-5.x branch September 5, 2025 01:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant