Skip to content

Conversation

@renovate
Copy link
Contributor

@renovate renovate bot commented Sep 14, 2025

This PR contains the following updates:

Package Change Age Confidence
bun (source) 1.2.21 -> 1.2.22 age confidence

Release Notes

oven-sh/bun (bun)

v1.2.22

Compare Source


Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.


  • If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

@renovate renovate bot added the dependencies Pull requests that update a dependency file label Sep 14, 2025
@github-actions
Copy link

💻 Website Preview

The latest changes are available as preview in: https://2774bee1.federation-gateway-benchmark.pages.dev

@github-actions
Copy link

Overview for: constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1813 109270 total, 0 failed avg: 27ms, p95: 49ms
grafbase 1650 99655 total, 0 failed avg: 30ms, p95: 52ms
cosmo 669 40458 total, 0 failed avg: 74ms, p95: 108ms
apollo-router 350 21325 total, 0 failed avg: 141ms, p95: 184ms
hive-gateway-bun 303 18592 total, 0 failed avg: 161ms, p95: 280ms
hive-gateway 301 18492 total, 0 failed avg: 162ms, p95: 217ms
apollo-gateway 120 7376 total, 0 failed avg: 407ms, p95: 478ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 327510      ✗ 0     
     data_received..................: 9.6 GB  159 MB/s
     data_sent......................: 127 MB  2.1 MB/s
     http_req_blocked...............: avg=6.52µs   min=1.17µs  med=2.65µs  max=14ms     p(90)=3.92µs  p(95)=4.7µs    p(99.9)=84.5µs 
     http_req_connecting............: avg=3.27µs   min=0s      med=0s      max=13.97ms  p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_duration..............: avg=27.24ms  min=1.92ms  med=24.76ms max=445.07ms p(90)=42.13ms p(95)=48.93ms  p(99.9)=85.06ms
       { expected_response:true }...: avg=27.24ms  min=1.92ms  med=24.76ms max=445.07ms p(90)=42.13ms p(95)=48.93ms  p(99.9)=85.06ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 109270
     http_req_receiving.............: avg=113.29µs min=23.38µs med=44.32µs max=42.11ms  p(90)=114.9µs p(95)=348.78µs p(99.9)=10.3ms 
     http_req_sending...............: avg=88.14µs  min=5.28µs  med=10.47µs max=366.7ms  p(90)=31.68µs p(95)=127.39µs p(99.9)=11.81ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=27.04ms  min=1.88ms  med=24.6ms  max=435.71ms p(90)=41.77ms p(95)=48.53ms  p(99.9)=82.92ms
     http_reqs......................: 109270  1813.793866/s
     iteration_duration.............: avg=27.47ms  min=5.9ms   med=24.96ms max=482.77ms p(90)=42.35ms p(95)=49.14ms  p(99.9)=86.07ms
     iterations.....................: 109170  1812.133946/s
     success_rate...................: 100.00% ✓ 109170      ✗ 0     
     vus............................: 50      min=50        max=50  
     vus_max........................: 50      min=50        max=50  

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 298665      ✗ 0    
     data_received..................: 8.8 GB  145 MB/s
     data_sent......................: 116 MB  1.9 MB/s
     http_req_blocked...............: avg=6.09µs   min=1.19µs  med=3.07µs  max=9.38ms   p(90)=4.31µs   p(95)=5.46µs   p(99.9)=114.67µs
     http_req_connecting............: avg=2.35µs   min=0s      med=0s      max=9.34ms   p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_duration..............: avg=29.87ms  min=2.9ms   med=26.72ms max=489.94ms p(90)=45.7ms   p(95)=52.26ms  p(99.9)=90.03ms 
       { expected_response:true }...: avg=29.87ms  min=2.9ms   med=26.72ms max=489.94ms p(90)=45.7ms   p(95)=52.26ms  p(99.9)=90.03ms 
     http_req_failed................: 0.00%   ✓ 0           ✗ 99655
     http_req_receiving.............: avg=142.08µs min=26.51µs med=48.58µs max=182.94ms p(90)=157.03µs p(95)=390.64µs p(99.9)=13.96ms 
     http_req_sending...............: avg=113.62µs min=5.59µs  med=11.99µs max=432ms    p(90)=38.77µs  p(95)=136.48µs p(99.9)=14.5ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=29.62ms  min=2.84ms  med=26.54ms max=474.47ms p(90)=45.26ms  p(95)=51.77ms  p(99.9)=83.78ms 
     http_reqs......................: 99655   1650.714335/s
     iteration_duration.............: avg=30.12ms  min=7.54ms  med=26.95ms max=519.34ms p(90)=45.94ms  p(95)=52.49ms  p(99.9)=90.68ms 
     iterations.....................: 99555   1649.057906/s
     success_rate...................: 100.00% ✓ 99555       ✗ 0    
     vus............................: 50      min=50        max=50 
     vus_max........................: 50      min=50        max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 121074     ✗ 0    
     data_received..................: 3.6 GB  59 MB/s
     data_sent......................: 47 MB   779 kB/s
     http_req_blocked...............: avg=9.95µs   min=1.24µs  med=2.86µs  max=9.98ms   p(90)=4.14µs   p(95)=4.97µs   p(99.9)=2.04ms  
     http_req_connecting............: avg=6.36µs   min=0s      med=0s      max=9.94ms   p(90)=0s       p(95)=0s       p(99.9)=2.02ms  
     http_req_duration..............: avg=73.95ms  min=2.84ms  med=72.78ms max=513.3ms  p(90)=100.04ms p(95)=108.12ms p(99.9)=288.03ms
       { expected_response:true }...: avg=73.95ms  min=2.84ms  med=72.78ms max=513.3ms  p(90)=100.04ms p(95)=108.12ms p(99.9)=288.03ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 40458
     http_req_receiving.............: avg=178.56µs min=29.51µs med=78.98µs max=138.21ms p(90)=161.44µs p(95)=390.14µs p(99.9)=15.69ms 
     http_req_sending...............: avg=70.29µs  min=5.57µs  med=11.35µs max=262.07ms p(90)=29.79µs  p(95)=121.22µs p(99.9)=3.17ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=73.7ms   min=2.75ms  med=72.58ms max=495.32ms p(90)=99.74ms  p(95)=107.81ms p(99.9)=284.82ms
     http_reqs......................: 40458   669.424708/s
     iteration_duration.............: avg=74.37ms  min=7.92ms  med=73.06ms max=540.12ms p(90)=100.29ms p(95)=108.42ms p(99.9)=296.61ms
     iterations.....................: 40358   667.770091/s
     success_rate...................: 100.00% ✓ 40358      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 63675      ✗ 0    
     data_received..................: 1.9 GB  31 MB/s
     data_sent......................: 25 MB   408 kB/s
     http_req_blocked...............: avg=34.23µs  min=1.99µs  med=3.26µs   max=18.16ms  p(90)=4.89µs   p(95)=5.59µs   p(99.9)=13.59ms 
     http_req_connecting............: avg=29.89µs  min=0s      med=0s       max=17.93ms  p(90)=0s       p(95)=0s       p(99.9)=13.53ms 
     http_req_duration..............: avg=140.57ms min=6.06ms  med=139.84ms max=556.54ms p(90)=173.8ms  p(95)=183.9ms  p(99.9)=436.53ms
       { expected_response:true }...: avg=140.57ms min=6.06ms  med=139.84ms max=556.54ms p(90)=173.8ms  p(95)=183.9ms  p(99.9)=436.53ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 21325
     http_req_receiving.............: avg=80.59µs  min=37.92µs med=58.65µs  max=8.5ms    p(90)=108.43µs p(95)=134.24µs p(99.9)=1.56ms  
     http_req_sending...............: avg=61.06µs  min=8.5µs   med=12.63µs  max=335.63ms p(90)=21.16µs  p(95)=36.57µs  p(99.9)=6.56ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=140.43ms min=6.01ms  med=139.75ms max=555.41ms p(90)=173.66ms p(95)=183.8ms  p(99.9)=421.02ms
     http_reqs......................: 21325   350.601624/s
     iteration_duration.............: avg=141.51ms min=40.45ms med=140.24ms max=630.71ms p(90)=174.12ms p(95)=184.18ms p(99.9)=454.58ms
     iterations.....................: 21225   348.957536/s
     success_rate...................: 100.00% ✓ 21225      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 55476      ✗ 0    
     data_received..................: 1.6 GB  27 MB/s
     data_sent......................: 22 MB   353 kB/s
     http_req_blocked...............: avg=36.07µs  min=1.25µs  med=2.86µs   max=20.98ms  p(90)=4.68µs   p(95)=6.04µs   p(99.9)=13.29ms 
     http_req_connecting............: avg=31.43µs  min=0s      med=0s       max=20.76ms  p(90)=0s       p(95)=0s       p(99.9)=13.09ms 
     http_req_duration..............: avg=161.19ms min=7.5ms   med=148.71ms max=634.78ms p(90)=178.23ms p(95)=280.04ms p(99.9)=499.75ms
       { expected_response:true }...: avg=161.19ms min=7.5ms   med=148.71ms max=634.78ms p(90)=178.23ms p(95)=280.04ms p(99.9)=499.75ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 18592
     http_req_receiving.............: avg=112.92µs min=27.17µs med=51.22µs  max=353.12ms p(90)=112.41µs p(95)=203.96µs p(99.9)=3.44ms  
     http_req_sending...............: avg=50.73µs  min=5.48µs  med=11.53µs  max=47.6ms   p(90)=32.58µs  p(95)=124.24µs p(99.9)=3.55ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=161.03ms min=7.44ms  med=148.59ms max=622.4ms  p(90)=178.04ms p(95)=279.31ms p(99.9)=497.46ms
     http_reqs......................: 18592   303.780136/s
     iteration_duration.............: avg=162.38ms min=68.59ms med=149.04ms max=711.37ms p(90)=178.56ms p(95)=334.01ms p(99.9)=528.65ms
     iterations.....................: 18492   302.146207/s
     success_rate...................: 100.00% ✓ 18492      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 55176      ✗ 0    
     data_received..................: 1.6 GB  27 MB/s
     data_sent......................: 22 MB   351 kB/s
     http_req_blocked...............: avg=41.72µs  min=1.19µs  med=2.81µs   max=18.85ms  p(90)=4.74µs   p(95)=5.93µs   p(99.9)=15.23ms 
     http_req_connecting............: avg=37.12µs  min=0s      med=0s       max=18.82ms  p(90)=0s       p(95)=0s       p(99.9)=15.06ms 
     http_req_duration..............: avg=162.21ms min=7.12ms  med=151ms    max=582.36ms p(90)=181.78ms p(95)=216.9ms  p(99.9)=489.85ms
       { expected_response:true }...: avg=162.21ms min=7.12ms  med=151ms    max=582.36ms p(90)=181.78ms p(95)=216.9ms  p(99.9)=489.85ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 18492
     http_req_receiving.............: avg=102.22µs min=26.86µs med=49.83µs  max=44.12ms  p(90)=117.56µs p(95)=257.89µs p(99.9)=4.96ms  
     http_req_sending...............: avg=73.33µs  min=5.69µs  med=11.46µs  max=163.27ms p(90)=33.19µs  p(95)=129.79µs p(99.9)=5.63ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=162.04ms min=7.05ms  med=150.85ms max=558.62ms p(90)=181.59ms p(95)=216.73ms p(99.9)=489.56ms
     http_reqs......................: 18492   301.516951/s
     iteration_duration.............: avg=163.4ms  min=53.4ms  med=151.35ms max=648.19ms p(90)=182.23ms p(95)=217.94ms p(99.9)=492.31ms
     iterations.....................: 18392   299.886424/s
     success_rate...................: 100.00% ✓ 18392      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 21828      ✗ 0   
     data_received..................: 648 MB  11 MB/s
     data_sent......................: 8.6 MB  140 kB/s
     http_req_blocked...............: avg=93.76µs  min=1.41µs  med=3.01µs   max=21.21ms  p(90)=4.62µs   p(95)=5.22µs   p(99.9)=19.04ms 
     http_req_connecting............: avg=89.25µs  min=0s      med=0s       max=20.99ms  p(90)=0s       p(95)=0s       p(99.9)=19.02ms 
     http_req_duration..............: avg=407.14ms min=7.37ms  med=407.17ms max=919.45ms p(90)=461.61ms p(95)=478.07ms p(99.9)=835.38ms
       { expected_response:true }...: avg=407.14ms min=7.37ms  med=407.17ms max=919.45ms p(90)=461.61ms p(95)=478.07ms p(99.9)=835.38ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 7376
     http_req_receiving.............: avg=66.56µs  min=29.47µs med=50.67µs  max=29.4ms   p(90)=95.46µs  p(95)=110.51µs p(99.9)=554.84µs
     http_req_sending...............: avg=58.43µs  min=6.35µs  med=11.95µs  max=210.54ms p(90)=19.41µs  p(95)=22.97µs  p(99.9)=1.78ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=407.01ms min=7.31ms  med=407.12ms max=918.58ms p(90)=461.4ms  p(95)=477.99ms p(99.9)=834.43ms
     http_reqs......................: 7376    120.637081/s
     iteration_duration.............: avg=413.41ms min=52.44ms med=407.69ms max=968.67ms p(90)=462.32ms p(95)=478.73ms p(99.9)=939.69ms
     iterations.....................: 7276    119.001545/s
     success_rate...................: 100.00% ✓ 7276       ✗ 0   
     vus............................: 35      min=35       max=50
     vus_max........................: 50      min=50       max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@github-actions
Copy link

Overview for: constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 173 14041 total, 0 failed avg: 215ms, p95: 226ms
hive-router 170 13794 total, 0 failed avg: 219ms, p95: 229ms
cosmo 167 13596 total, 0 failed avg: 222ms, p95: 242ms
hive-gateway 162 12497 total, 0 failed avg: 242ms, p95: 266ms
hive-gateway-bun 161 12360 total, 0 failed avg: 244ms, p95: 273ms
apollo-router 142 11551 total, 0 failed avg: 262ms, p95: 304ms
apollo-gateway 125 10194 total, 0 failed avg: 296ms, p95: 330ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41823      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   202 kB/s
     http_req_blocked...............: avg=18.83µs  min=1.19µs   med=1.96µs   max=8.91ms   p(90)=3.55µs   p(95)=5.07µs   p(99.9)=6.59ms  
     http_req_connecting............: avg=16.19µs  min=0s       med=0s       max=8.87ms   p(90)=0s       p(95)=0s       p(99.9)=6.57ms  
     http_req_duration..............: avg=215.27ms min=156.1ms  med=214.36ms max=612.52ms p(90)=223.17ms p(95)=225.64ms p(99.9)=518.6ms 
       { expected_response:true }...: avg=215.27ms min=156.1ms  med=214.36ms max=612.52ms p(90)=223.17ms p(95)=225.64ms p(99.9)=518.6ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 14041
     http_req_receiving.............: avg=80.21µs  min=27.27µs  med=45.11µs  max=12.54ms  p(90)=92.93µs  p(95)=261.24µs p(99.9)=4.51ms  
     http_req_sending...............: avg=149.1µs  min=5.4µs    med=8.51µs   max=381.77ms p(90)=30.16µs  p(95)=95.95µs  p(99.9)=6.41ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=215.05ms min=156.02ms med=214.25ms max=610.96ms p(90)=223.03ms p(95)=225.43ms p(99.9)=498.83ms
     http_reqs......................: 14041   173.439093/s
     iteration_duration.............: avg=215.53ms min=156.32ms med=214.57ms max=626.17ms p(90)=223.35ms p(95)=225.82ms p(99.9)=530.43ms
     iterations.....................: 13941   172.20386/s
     success_rate...................: 100.00% ✓ 13941      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41082      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   198 kB/s
     http_req_blocked...............: avg=18.55µs  min=1.12µs  med=1.99µs   max=8.76ms   p(90)=3.15µs   p(95)=4.28µs   p(99.9)=6.37ms  
     http_req_connecting............: avg=16.07µs  min=0s      med=0s       max=8.73ms   p(90)=0s       p(95)=0s       p(99.9)=6.35ms  
     http_req_duration..............: avg=219.2ms  min=97.2ms  med=218.4ms  max=613.51ms p(90)=226.22ms p(95)=228.89ms p(99.9)=516.04ms
       { expected_response:true }...: avg=219.2ms  min=97.2ms  med=218.4ms  max=613.51ms p(90)=226.22ms p(95)=228.89ms p(99.9)=516.04ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13794
     http_req_receiving.............: avg=84.3µs   min=22.01µs med=42.04µs  max=144.42ms p(90)=85.61µs  p(95)=240.65µs p(99.9)=2.48ms  
     http_req_sending...............: avg=67.36µs  min=5.48µs  med=8.42µs   max=375.59ms p(90)=27.06µs  p(95)=93.33µs  p(99.9)=3.83ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=219.05ms min=97.13ms med=218.32ms max=612.24ms p(90)=226.06ms p(95)=228.71ms p(99.9)=504.6ms 
     http_reqs......................: 13794   170.536623/s
     iteration_duration.............: avg=219.5ms  min=97.35ms med=218.61ms max=629.98ms p(90)=226.39ms p(95)=229.05ms p(99.9)=529.39ms
     iterations.....................: 13694   169.300313/s
     success_rate...................: 100.00% ✓ 13694      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40488      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   195 kB/s
     http_req_blocked...............: avg=21.46µs  min=1.45µs   med=2.65µs   max=9.48ms   p(90)=3.91µs   p(95)=4.76µs   p(99.9)=7.19ms  
     http_req_connecting............: avg=18.07µs  min=0s       med=0s       max=9.44ms   p(90)=0s       p(95)=0s       p(99.9)=7.17ms  
     http_req_duration..............: avg=222.16ms min=158.54ms med=221.03ms max=633.39ms p(90)=237.12ms p(95)=242.19ms p(99.9)=522.41ms
       { expected_response:true }...: avg=222.16ms min=158.54ms med=221.03ms max=633.39ms p(90)=237.12ms p(95)=242.19ms p(99.9)=522.41ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13596
     http_req_receiving.............: avg=405.6µs  min=30.6µs   med=65.38µs  max=31.61ms  p(90)=360.55µs p(95)=810.38µs p(99.9)=23.59ms 
     http_req_sending...............: avg=79.01µs  min=6.06µs   med=11.1µs   max=245.72ms p(90)=29.9µs   p(95)=111.5µs  p(99.9)=3.46ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=221.68ms min=155.73ms med=220.58ms max=632.09ms p(90)=236.5ms  p(95)=241.66ms p(99.9)=521.42ms
     http_reqs......................: 13596   167.754503/s
     iteration_duration.............: avg=222.52ms min=158.74ms med=221.33ms max=662.68ms p(90)=237.42ms p(95)=242.48ms p(99.9)=536.97ms
     iterations.....................: 13496   166.520651/s
     success_rate...................: 100.00% ✓ 13496      ✗ 0    
     vus............................: 24      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 37191      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 15 MB   189 kB/s
     http_req_blocked...............: avg=24.52µs  min=1.13µs   med=2.6µs    max=12.01ms  p(90)=4.33µs   p(95)=5.62µs   p(99.9)=7.83ms  
     http_req_connecting............: avg=20.85µs  min=0s       med=0s       max=11.97ms  p(90)=0s       p(95)=0s       p(99.9)=7.77ms  
     http_req_duration..............: avg=241.85ms min=152.61ms med=233.6ms  max=740.21ms p(90)=255.68ms p(95)=266.19ms p(99.9)=702.13ms
       { expected_response:true }...: avg=241.85ms min=152.61ms med=233.6ms  max=740.21ms p(90)=255.68ms p(95)=266.19ms p(99.9)=702.13ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12497
     http_req_receiving.............: avg=90.81µs  min=26.08µs  med=48.32µs  max=13.71ms  p(90)=114.46µs p(95)=230.62µs p(99.9)=3.19ms  
     http_req_sending...............: avg=204.61µs min=5.58µs   med=10.98µs  max=326.3ms  p(90)=33.26µs  p(95)=127.91µs p(99.9)=14.4ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=241.56ms min=152.47ms med=233.47ms max=737.61ms p(90)=255.42ms p(95)=265.82ms p(99.9)=701.78ms
     http_reqs......................: 12497   162.520851/s
     iteration_duration.............: avg=242.79ms min=152.88ms med=233.91ms max=778.54ms p(90)=256.02ms p(95)=266.49ms p(99.9)=702.94ms
     iterations.....................: 12397   161.220372/s
     success_rate...................: 100.00% ✓ 12397      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 36780      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 14 MB   188 kB/s
     http_req_blocked...............: avg=23.67µs  min=1.1µs    med=2.47µs   max=10.13ms  p(90)=4.16µs   p(95)=5.44µs   p(99.9)=7.54ms
     http_req_connecting............: avg=19.88µs  min=0s       med=0s       max=10.1ms   p(90)=0s       p(95)=0s       p(99.9)=7.51ms
     http_req_duration..............: avg=244.14ms min=145.2ms  med=236.03ms max=1.22s    p(90)=260.65ms p(95)=272.51ms p(99.9)=1.2s  
       { expected_response:true }...: avg=244.14ms min=145.2ms  med=236.03ms max=1.22s    p(90)=260.65ms p(95)=272.51ms p(99.9)=1.2s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 12360
     http_req_receiving.............: avg=86.92µs  min=25.92µs  med=44.55µs  max=13.71ms  p(90)=105.21µs p(95)=228.93µs p(99.9)=2.87ms
     http_req_sending...............: avg=78.26µs  min=5.66µs   med=10.6µs   max=169.43ms p(90)=32.21µs  p(95)=119.71µs p(99.9)=4.5ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s    
     http_req_waiting...............: avg=243.97ms min=145ms    med=235.92ms max=1.22s    p(90)=260.47ms p(95)=272.13ms p(99.9)=1.2s  
     http_reqs......................: 12360   161.470326/s
     iteration_duration.............: avg=245.13ms min=145.42ms med=236.41ms max=1.22s    p(90)=261.01ms p(95)=273.11ms p(99.9)=1.2s  
     iterations.....................: 12260   160.163931/s
     success_rate...................: 100.00% ✓ 12260      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 34353      ✗ 0    
     data_received..................: 1.0 GB  13 MB/s
     data_sent......................: 13 MB   165 kB/s
     http_req_blocked...............: avg=70.85µs  min=1.5µs    med=2.75µs   max=178.44ms p(90)=4.1µs    p(95)=5.02µs   p(99.9)=14.74ms 
     http_req_connecting............: avg=50.13µs  min=0s       med=0s       max=16.95ms  p(90)=0s       p(95)=0s       p(99.9)=14.41ms 
     http_req_duration..............: avg=261.64ms min=143.34ms med=259.23ms max=657ms    p(90)=294.75ms p(95)=303.72ms p(99.9)=562.81ms
       { expected_response:true }...: avg=261.64ms min=143.34ms med=259.23ms max=657ms    p(90)=294.75ms p(95)=303.72ms p(99.9)=562.81ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11551
     http_req_receiving.............: avg=112.49µs min=33.21µs  med=50.53µs  max=11.72ms  p(90)=149.12µs p(95)=420.14µs p(99.9)=4.04ms  
     http_req_sending...............: avg=124.55µs min=7.07µs   med=10.91µs  max=184.59ms p(90)=35.88µs  p(95)=132.11µs p(99.9)=5.47ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=261.4ms  min=143.28ms med=259.02ms max=654.7ms  p(90)=294.5ms  p(95)=303.38ms p(99.9)=560.56ms
     http_reqs......................: 11551   142.066216/s
     iteration_duration.............: avg=262.42ms min=143.52ms med=259.75ms max=683.61ms p(90)=295.17ms p(95)=304.14ms p(99.9)=603.61ms
     iterations.....................: 11451   140.836312/s
     success_rate...................: 100.00% ✓ 11451      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 30282      ✗ 0    
     data_received..................: 895 MB  11 MB/s
     data_sent......................: 12 MB   145 kB/s
     http_req_blocked...............: avg=30.49µs  min=1.43µs   med=3.27µs   max=10.96ms  p(90)=4.56µs   p(95)=5.48µs   p(99.9)=8.87ms  
     http_req_connecting............: avg=26.05µs  min=0s       med=0s       max=10.89ms  p(90)=0s       p(95)=0s       p(99.9)=8.85ms  
     http_req_duration..............: avg=296.38ms min=210.54ms med=293.72ms max=782.6ms  p(90)=320.06ms p(95)=329.6ms  p(99.9)=711.3ms 
       { expected_response:true }...: avg=296.38ms min=210.54ms med=293.72ms max=782.6ms  p(90)=320.06ms p(95)=329.6ms  p(99.9)=711.3ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 10194
     http_req_receiving.............: avg=90.55µs  min=29.74µs  med=56.22µs  max=132.08ms p(90)=104.23µs p(95)=126.92µs p(99.9)=2.17ms  
     http_req_sending...............: avg=85.72µs  min=6.16µs   med=12.89µs  max=199.94ms p(90)=21.39µs  p(95)=37.72µs  p(99.9)=2.89ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=296.2ms  min=210.47ms med=293.61ms max=772.26ms p(90)=319.93ms p(95)=329.34ms p(99.9)=698.99ms
     http_reqs......................: 10194   125.024308/s
     iteration_duration.............: avg=297.65ms min=220.91ms med=294.16ms max=816.73ms p(90)=320.55ms p(95)=330.06ms p(99.9)=745.83ms
     iterations.....................: 10094   123.797858/s
     success_rate...................: 100.00% ✓ 10094      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@github-actions
Copy link

Overview for: constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 172 13993 total, 0 failed avg: 216ms, p95: 227ms
hive-router 168 13636 total, 0 failed avg: 222ms, p95: 233ms
cosmo 161 13091 total, 0 failed avg: 231ms, p95: 250ms
hive-gateway-bun 150 11507 total, 0 failed avg: 263ms, p95: 402ms
hive-gateway 149 11459 total, 0 failed avg: 264ms, p95: 409ms
apollo-router 127 10345 total, 0 failed avg: 292ms, p95: 335ms
apollo-gateway 85 6967 total, 0 failed avg: 435ms, p95: 477ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41679      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   201 kB/s
     http_req_blocked...............: avg=19.46µs  min=1.25µs   med=2.01µs   max=9.18ms   p(90)=3.53µs  p(95)=4.91µs   p(99.9)=6.74ms  
     http_req_connecting............: avg=16.75µs  min=0s       med=0s       max=9.15ms   p(90)=0s      p(95)=0s       p(99.9)=6.72ms  
     http_req_duration..............: avg=216.09ms min=157.87ms med=215.27ms max=611.27ms p(90)=224.6ms p(95)=227.41ms p(99.9)=501.17ms
       { expected_response:true }...: avg=216.09ms min=157.87ms med=215.27ms max=611.27ms p(90)=224.6ms p(95)=227.41ms p(99.9)=501.17ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13993
     http_req_receiving.............: avg=93.03µs  min=28.29µs  med=45.66µs  max=218.14ms p(90)=94.85µs p(95)=257.68µs p(99.9)=2.24ms  
     http_req_sending...............: avg=68.64µs  min=5.65µs   med=8.82µs   max=270.04ms p(90)=33.11µs p(95)=93.96µs  p(99.9)=5.09ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=215.93ms min=157.83ms med=215.17ms max=600.32ms p(90)=224.4ms p(95)=227.17ms p(99.9)=486.76ms
     http_reqs......................: 13993   172.79991/s
     iteration_duration.............: avg=216.37ms min=158ms    med=215.48ms max=632.58ms p(90)=224.8ms p(95)=227.61ms p(99.9)=512.96ms
     iterations.....................: 13893   171.565008/s
     success_rate...................: 100.00% ✓ 13893      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40608      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   196 kB/s
     http_req_blocked...............: avg=18.7µs   min=1.16µs   med=2.2µs    max=8.64ms   p(90)=3.17µs   p(95)=4.48µs   p(99.9)=6.41ms  
     http_req_connecting............: avg=15.99µs  min=0s       med=0s       max=8.6ms    p(90)=0s       p(95)=0s       p(99.9)=6.39ms  
     http_req_duration..............: avg=221.99ms min=124.18ms med=221.09ms max=604.21ms p(90)=230.13ms p(95)=232.75ms p(99.9)=499.13ms
       { expected_response:true }...: avg=221.99ms min=124.18ms med=221.09ms max=604.21ms p(90)=230.13ms p(95)=232.75ms p(99.9)=499.13ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13636
     http_req_receiving.............: avg=85.52µs  min=24.81µs  med=41.78µs  max=169.77ms p(90)=83.34µs  p(95)=253.07µs p(99.9)=2.77ms  
     http_req_sending...............: avg=96.79µs  min=5.59µs   med=9.45µs   max=328.51ms p(90)=28.72µs  p(95)=95.01µs  p(99.9)=5.87ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=221.81ms min=124.12ms med=221.01ms max=592.07ms p(90)=229.97ms p(95)=232.57ms p(99.9)=487.68ms
     http_reqs......................: 13636   168.431507/s
     iteration_duration.............: avg=222.32ms min=124.37ms med=221.32ms max=614.87ms p(90)=230.33ms p(95)=232.92ms p(99.9)=509.93ms
     iterations.....................: 13536   167.196309/s
     success_rate...................: 100.00% ✓ 13536      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 38973      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 15 MB   188 kB/s
     http_req_blocked...............: avg=21.47µs  min=1.34µs   med=2.68µs   max=9.54ms   p(90)=3.92µs   p(95)=4.91µs   p(99.9)=7.09ms  
     http_req_connecting............: avg=18.13µs  min=0s       med=0s       max=9.5ms    p(90)=0s       p(95)=0s       p(99.9)=7.07ms  
     http_req_duration..............: avg=230.99ms min=126.76ms med=230.72ms max=638.78ms p(90)=244.42ms p(95)=249.68ms p(99.9)=535.39ms
       { expected_response:true }...: avg=230.99ms min=126.76ms med=230.72ms max=638.78ms p(90)=244.42ms p(95)=249.68ms p(99.9)=535.39ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13091
     http_req_receiving.............: avg=301.78µs min=29.82µs  med=66.1µs   max=230.38ms p(90)=194.69µs p(95)=460.45µs p(99.9)=25.87ms 
     http_req_sending...............: avg=101.23µs min=6.57µs   med=11.08µs  max=361.54ms p(90)=28.79µs  p(95)=122.72µs p(99.9)=3.18ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=230.59ms min=126.67ms med=230.42ms max=638.03ms p(90)=244.04ms p(95)=249.15ms p(99.9)=515.73ms
     http_reqs......................: 13091   161.51241/s
     iteration_duration.............: avg=231.44ms min=126.9ms  med=231.01ms max=654.8ms  p(90)=244.7ms  p(95)=249.96ms p(99.9)=549.45ms
     iterations.....................: 12991   160.278644/s
     success_rate...................: 100.00% ✓ 12991      ✗ 0    
     vus............................: 44      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 34221      ✗ 0    
     data_received..................: 1.0 GB  13 MB/s
     data_sent......................: 13 MB   175 kB/s
     http_req_blocked...............: avg=29.92µs  min=1.13µs   med=2.59µs   max=11.69ms  p(90)=4.13µs   p(95)=5.45µs   p(99.9)=9.26ms  
     http_req_connecting............: avg=26.49µs  min=0s       med=0s       max=11.66ms  p(90)=0s       p(95)=0s       p(99.9)=9.22ms  
     http_req_duration..............: avg=262.62ms min=161.02ms med=252.92ms max=747.73ms p(90)=272ms    p(95)=401.95ms p(99.9)=648.93ms
       { expected_response:true }...: avg=262.62ms min=161.02ms med=252.92ms max=747.73ms p(90)=272ms    p(95)=401.95ms p(99.9)=648.93ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11507
     http_req_receiving.............: avg=87.83µs  min=24.44µs  med=45.22µs  max=15.54ms  p(90)=99.62µs  p(95)=352.32µs p(99.9)=2.39ms  
     http_req_sending...............: avg=94.2µs   min=5.57µs   med=10.94µs  max=196.44ms p(90)=34.96µs  p(95)=135.01µs p(99.9)=8.49ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=262.44ms min=160.92ms med=252.82ms max=747.03ms p(90)=271.78ms p(95)=401.87ms p(99.9)=647.89ms
     http_reqs......................: 11507   150.30024/s
     iteration_duration.............: avg=263.87ms min=176.68ms med=253.2ms  max=794.58ms p(90)=272.31ms p(95)=407.91ms p(99.9)=700.59ms
     iterations.....................: 11407   148.994076/s
     success_rate...................: 100.00% ✓ 11407      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 34077      ✗ 0    
     data_received..................: 1.0 GB  13 MB/s
     data_sent......................: 13 MB   174 kB/s
     http_req_blocked...............: avg=30.4µs   min=1.17µs   med=2.65µs   max=12.13ms  p(90)=4.3µs    p(95)=5.93µs   p(99.9)=9.54ms  
     http_req_connecting............: avg=26.87µs  min=0s       med=0s       max=12.09ms  p(90)=0s       p(95)=0s       p(99.9)=9.52ms  
     http_req_duration..............: avg=263.73ms min=160.57ms med=253.26ms max=772.05ms p(90)=276.41ms p(95)=409.31ms p(99.9)=661.65ms
       { expected_response:true }...: avg=263.73ms min=160.57ms med=253.26ms max=772.05ms p(90)=276.41ms p(95)=409.31ms p(99.9)=661.65ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11459
     http_req_receiving.............: avg=108.11µs min=24.18µs  med=48.55µs  max=101.32ms p(90)=120.35µs p(95)=396.48µs p(99.9)=4.52ms  
     http_req_sending...............: avg=140.19µs min=5.37µs   med=11.04µs  max=243.39ms p(90)=37.97µs  p(95)=141.88µs p(99.9)=9.1ms   
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=263.48ms min=160.47ms med=253.13ms max=771.47ms p(90)=276.16ms p(95)=408.17ms p(99.9)=660.62ms
     http_reqs......................: 11459   149.6072/s
     iteration_duration.............: avg=264.97ms min=167.77ms med=253.57ms max=806.82ms p(90)=276.95ms p(95)=410.33ms p(99.9)=688.05ms
     iterations.....................: 11359   148.301613/s
     success_rate...................: 100.00% ✓ 11359      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 30735      ✗ 0    
     data_received..................: 908 MB  11 MB/s
     data_sent......................: 12 MB   148 kB/s
     http_req_blocked...............: avg=50.97µs  min=1.57µs   med=2.79µs   max=265.12ms p(90)=4.12µs   p(95)=4.94µs   p(99.9)=7.23ms  
     http_req_connecting............: avg=21.92µs  min=0s       med=0s       max=9.53ms   p(90)=0s       p(95)=0s       p(99.9)=7.01ms  
     http_req_duration..............: avg=292.1ms  min=146.55ms med=292.72ms max=690.72ms p(90)=326.32ms p(95)=335.49ms p(99.9)=613.1ms 
       { expected_response:true }...: avg=292.1ms  min=146.55ms med=292.72ms max=690.72ms p(90)=326.32ms p(95)=335.49ms p(99.9)=613.1ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 10345
     http_req_receiving.............: avg=84.2µs   min=37.19µs  med=50.84µs  max=5.31ms   p(90)=102.18µs p(95)=205.46µs p(99.9)=1.45ms  
     http_req_sending...............: avg=90.46µs  min=7.78µs   med=10.92µs  max=321.56ms p(90)=26.86µs  p(95)=133.34µs p(99.9)=2.8ms   
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=291.93ms min=144.74ms med=292.6ms  max=689.43ms p(90)=326.2ms  p(95)=335.29ms p(99.9)=612.17ms
     http_reqs......................: 10345   127.042614/s
     iteration_duration.............: avg=293.29ms min=146.73ms med=293.28ms max=708.11ms p(90)=326.72ms p(95)=335.93ms p(99.9)=664.03ms
     iterations.....................: 10245   125.814556/s
     success_rate...................: 100.00% ✓ 10245      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 20601     ✗ 0   
     data_received..................: 612 MB  7.5 MB/s
     data_sent......................: 8.1 MB  99 kB/s
     http_req_blocked...............: avg=47.07µs  min=1.44µs   med=3.37µs   max=11.55ms  p(90)=5.03µs   p(95)=5.73µs   p(99.9)=10.02ms 
     http_req_connecting............: avg=43µs     min=0s       med=0s       max=11.52ms  p(90)=0s       p(95)=0s       p(99.9)=9.99ms  
     http_req_duration..............: avg=434.57ms min=211.8ms  med=438.2ms  max=913.1ms  p(90)=463.91ms p(95)=476.78ms p(99.9)=842.02ms
       { expected_response:true }...: avg=434.57ms min=211.8ms  med=438.2ms  max=913.1ms  p(90)=463.91ms p(95)=476.78ms p(99.9)=842.02ms
     http_req_failed................: 0.00%   ✓ 0         ✗ 6967
     http_req_receiving.............: avg=107.3µs  min=31.33µs  med=58.2µs   max=264.15ms p(90)=100.44µs p(95)=119.29µs p(99.9)=469.15µs
     http_req_sending...............: avg=74.02µs  min=6.51µs   med=13.41µs  max=242.9ms  p(90)=20.98µs  p(95)=28.66µs  p(99.9)=3.62ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=434.39ms min=211.71ms med=438.08ms max=901.36ms p(90)=463.78ms p(95)=476.62ms p(99.9)=831.88ms
     http_reqs......................: 6967    85.257217/s
     iteration_duration.............: avg=438.31ms min=276.58ms med=438.7ms  max=975.1ms  p(90)=464.54ms p(95)=477.14ms p(99.9)=932.54ms
     iterations.....................: 6867    84.033487/s
     success_rate...................: 100.00% ✓ 6867      ✗ 0   
     vus............................: 50      min=0       max=50
     vus_max........................: 50      min=50      max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@github-actions
Copy link

Overview for: ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 500 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1975 122989 total, 0 failed avg: 113ms, p95: 276ms
grafbase 1689 106675 total, 0 failed avg: 131ms, p95: 306ms
cosmo 701 44700 total, 0 failed avg: 314ms, p95: 692ms
apollo-router 398 26670 total, 0 failed avg: 529ms, p95: 1200ms ❌ 22 unexpected GraphQL errors, non-compatible response structure (1)
hive-gateway 274 19048 total, 0 failed avg: 738ms, p95: 1561ms
hive-gateway-bun 262 18224 total, 0 failed avg: 770ms, p95: 1632ms
apollo-gateway 154 10556 total, 0 failed avg: 1236ms, p95: 2577ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 365967      ✗ 0     
     data_received..................: 11 GB   173 MB/s
     data_sent......................: 143 MB  2.3 MB/s
     http_req_blocked...............: avg=386.53µs min=1.12µs  med=2.51µs   max=341.34ms p(90)=3.88µs   p(95)=4.66µs   p(99.9)=142.42ms
     http_req_connecting............: avg=383.24µs min=0s      med=0s       max=341.28ms p(90)=0s       p(95)=0s       p(99.9)=142.38ms
     http_req_duration..............: avg=113.27ms min=1.72ms  med=100.73ms max=439.42ms p(90)=232.1ms  p(95)=276.02ms p(99.9)=381.62ms
       { expected_response:true }...: avg=113.27ms min=1.72ms  med=100.73ms max=439.42ms p(90)=232.1ms  p(95)=276.02ms p(99.9)=381.62ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 122989
     http_req_receiving.............: avg=466.47µs min=22.48µs med=41.14µs  max=132.51ms p(90)=152.92µs p(95)=386.23µs p(99.9)=69.26ms 
     http_req_sending...............: avg=351.46µs min=5.19µs  med=10.04µs  max=205.29ms p(90)=28.04µs  p(95)=125.3µs  p(99.9)=63.66ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=112.45ms min=1.65ms  med=100ms    max=414.14ms p(90)=230.16ms p(95)=274.16ms p(99.9)=378.98ms
     http_reqs......................: 122989  1975.763177/s
     iteration_duration.............: avg=114.83ms min=1.86ms  med=101.99ms max=702.21ms p(90)=234.1ms  p(95)=278.61ms p(99.9)=402.01ms
     iterations.....................: 121989  1959.698625/s
     success_rate...................: 100.00% ✓ 121989      ✗ 0     
     vus............................: 71      min=0         max=494 
     vus_max........................: 500     min=500       max=500 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 317025      ✗ 0     
     data_received..................: 9.4 GB  149 MB/s
     data_sent......................: 124 MB  2.0 MB/s
     http_req_blocked...............: avg=487.1µs  min=1.17µs  med=2.89µs   max=343.18ms p(90)=4.19µs   p(95)=5.18µs   p(99.9)=167.73ms
     http_req_connecting............: avg=483.27µs min=0s      med=0s       max=343.11ms p(90)=0s       p(95)=0s       p(99.9)=167.69ms
     http_req_duration..............: avg=130.55ms min=2.54ms  med=120.89ms max=477ms    p(90)=261.73ms p(95)=306ms    p(99.9)=418.44ms
       { expected_response:true }...: avg=130.55ms min=2.54ms  med=120.89ms max=477ms    p(90)=261.73ms p(95)=306ms    p(99.9)=418.44ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 106675
     http_req_receiving.............: avg=542.46µs min=22.35µs med=45.97µs  max=146.45ms p(90)=141.47µs p(95)=412.49µs p(99.9)=78.2ms  
     http_req_sending...............: avg=419.47µs min=5.23µs  med=11.52µs  max=148.76ms p(90)=31.4µs   p(95)=133.53µs p(99.9)=70.46ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=129.59ms min=2.47ms  med=120.04ms max=466.49ms p(90)=259.39ms p(95)=304.04ms p(99.9)=416.06ms
     http_reqs......................: 106675  1689.921985/s
     iteration_duration.............: avg=132.6ms  min=2.78ms  med=122.63ms max=783.76ms p(90)=264.32ms p(95)=308.49ms p(99.9)=456.08ms
     iterations.....................: 105675  1674.080204/s
     success_rate...................: 100.00% ✓ 105675      ✗ 0     
     vus............................: 67      min=0         max=495 
     vus_max........................: 500     min=500       max=500 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 131100     ✗ 0    
     data_received..................: 3.9 GB  62 MB/s
     data_sent......................: 52 MB   816 kB/s
     http_req_blocked...............: avg=99.1µs   min=1.12µs  med=2.86µs   max=143.54ms p(90)=4.14µs   p(95)=5.51µs   p(99.9)=31.68ms 
     http_req_connecting............: avg=94.38µs  min=0s      med=0s       max=143.36ms p(90)=0s       p(95)=0s       p(99.9)=31.33ms 
     http_req_duration..............: avg=314.12ms min=2.8ms   med=300.53ms max=1.12s    p(90)=613.17ms p(95)=691.76ms p(99.9)=1.01s   
       { expected_response:true }...: avg=314.12ms min=2.8ms   med=300.53ms max=1.12s    p(90)=613.17ms p(95)=691.76ms p(99.9)=1.01s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 44700
     http_req_receiving.............: avg=1.15ms   min=26.81µs med=59.35µs  max=244.72ms p(90)=207.5µs  p(95)=492.81µs p(99.9)=191.75ms
     http_req_sending...............: avg=132.89µs min=5.84µs  med=11.17µs  max=85.77ms  p(90)=29.63µs  p(95)=126.8µs  p(99.9)=28.34ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=312.83ms min=2.74ms  med=299.21ms max=1.12s    p(90)=610.74ms p(95)=689.1ms  p(99.9)=1.01s   
     http_reqs......................: 44700   701.217374/s
     iteration_duration.............: avg=321.77ms min=3.02ms  med=309.75ms max=1.12s    p(90)=617.31ms p(95)=695.29ms p(99.9)=1.01s   
     iterations.....................: 43700   685.530184/s
     success_rate...................: 100.00% ✓ 43700      ✗ 0    
     vus............................: 95      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  99% — ✓ 25648 / ✗ 22
     ✗ valid response structure
      ↳  99% — ✓ 25668 / ✗ 1

     checks.........................: 99.97% ✓ 76986      ✗ 23   
     data_received..................: 2.3 GB 35 MB/s
     data_sent......................: 31 MB  464 kB/s
     http_req_blocked...............: avg=65.95µs  min=1.26µs  med=2.92µs   max=87.07ms p(90)=4.64µs  p(95)=6.59µs   p(99.9)=14.55ms
     http_req_connecting............: avg=60.83µs  min=0s      med=0s       max=86.99ms p(90)=0s      p(95)=0s       p(99.9)=14.49ms
     http_req_duration..............: avg=528.88ms min=6.15ms  med=486.61ms max=1.84s   p(90)=1.06s   p(95)=1.19s    p(99.9)=1.65s  
       { expected_response:true }...: avg=528.88ms min=6.15ms  med=486.61ms max=1.84s   p(90)=1.06s   p(95)=1.19s    p(99.9)=1.65s  
     http_req_failed................: 0.00%  ✓ 0          ✗ 26670
     http_req_receiving.............: avg=102.07µs min=27.56µs med=52.05µs  max=36.52ms p(90)=97.81µs p(95)=160.39µs p(99.9)=5.8ms  
     http_req_sending...............: avg=87.64µs  min=5.64µs  med=11.67µs  max=97.87ms p(90)=27.52µs p(95)=104.42µs p(99.9)=13.15ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s      p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=528.69ms min=6.07ms  med=486.48ms max=1.84s   p(90)=1.06s   p(95)=1.19s    p(99.9)=1.65s  
     http_reqs......................: 26670  398.036666/s
     iteration_duration.............: avg=549.82ms min=6.29ms  med=512.87ms max=1.84s   p(90)=1.07s   p(95)=1.2s     p(99.9)=1.65s  
     iterations.....................: 25669  383.097233/s
     success_rate...................: 99.91% ✓ 25647      ✗ 22   
     vus............................: 62     min=0        max=497
     vus_max........................: 500    min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 54144      ✗ 0    
     data_received..................: 1.7 GB  24 MB/s
     data_sent......................: 22 MB   321 kB/s
     http_req_blocked...............: avg=96.4µs   min=1.29µs med=2.74µs   max=91.39ms  p(90)=4.54µs  p(95)=7.05µs   p(99.9)=25.57ms
     http_req_connecting............: avg=90.92µs  min=0s     med=0s       max=91.35ms  p(90)=0s      p(95)=0s       p(99.9)=25.51ms
     http_req_duration..............: avg=737.5ms  min=6.6ms  med=688.65ms max=4.24s    p(90)=1.47s   p(95)=1.56s    p(99.9)=3.28s  
       { expected_response:true }...: avg=737.5ms  min=6.6ms  med=688.65ms max=4.24s    p(90)=1.47s   p(95)=1.56s    p(99.9)=3.28s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 19048
     http_req_receiving.............: avg=160.17µs min=27.1µs med=42.82µs  max=128.04ms p(90)=86.02µs p(95)=142.46µs p(99.9)=28.21ms
     http_req_sending...............: avg=175.86µs min=5.88µs med=10.91µs  max=125.07ms p(90)=28.12µs p(95)=71.64µs  p(99.9)=36.75ms
     http_req_tls_handshaking.......: avg=0s       min=0s     med=0s       max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=737.16ms min=6.54ms med=688.39ms max=4.24s    p(90)=1.47s   p(95)=1.56s    p(99.9)=3.28s  
     http_reqs......................: 19048   274.006658/s
     iteration_duration.............: avg=778.64ms min=6.73ms med=735.74ms max=4.25s    p(90)=1.49s   p(95)=1.57s    p(99.9)=3.38s  
     iterations.....................: 18048   259.621596/s
     success_rate...................: 100.00% ✓ 18048      ✗ 0    
     vus............................: 86      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 51672      ✗ 0    
     data_received..................: 1.6 GB  23 MB/s
     data_sent......................: 21 MB   308 kB/s
     http_req_blocked...............: avg=120.42µs min=1.17µs  med=2.8µs    max=152.21ms p(90)=5.1µs   p(95)=7.84µs   p(99.9)=39.35ms
     http_req_connecting............: avg=114.81µs min=0s      med=0s       max=152.15ms p(90)=0s      p(95)=0s       p(99.9)=39.29ms
     http_req_duration..............: avg=770.05ms min=6.86ms  med=732.45ms max=5.09s    p(90)=1.48s   p(95)=1.63s    p(99.9)=3.94s  
       { expected_response:true }...: avg=770.05ms min=6.86ms  med=732.45ms max=5.09s    p(90)=1.48s   p(95)=1.63s    p(99.9)=3.94s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 18224
     http_req_receiving.............: avg=191.56µs min=25.95µs med=45.31µs  max=107.38ms p(90)=99.38µs p(95)=246.81µs p(99.9)=29.26ms
     http_req_sending...............: avg=179.16µs min=5.62µs  med=11.16µs  max=150.64ms p(90)=32.18µs p(95)=120.25µs p(99.9)=38.38ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=769.68ms min=6.79ms  med=731.78ms max=5.09s    p(90)=1.47s   p(95)=1.63s    p(99.9)=3.94s  
     http_reqs......................: 18224   262.462775/s
     iteration_duration.............: avg=815.07ms min=9.49ms  med=786.47ms max=5.15s    p(90)=1.49s   p(95)=1.64s    p(99.9)=3.96s  
     iterations.....................: 17224   248.060735/s
     success_rate...................: 100.00% ✓ 17224      ✗ 0    
     vus............................: 86      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 28668      ✗ 0    
     data_received..................: 927 MB  14 MB/s
     data_sent......................: 13 MB   185 kB/s
     http_req_blocked...............: avg=31.8µs  min=1.33µs  med=3.37µs  max=34.82ms p(90)=5.83µs   p(95)=12.86µs p(99.9)=3.94ms
     http_req_connecting............: avg=25.16µs min=0s      med=0s      max=34.75ms p(90)=0s       p(95)=0s      p(99.9)=3.84ms
     http_req_duration..............: avg=1.23s   min=7.32ms  med=1.17s   max=15.97s  p(90)=2.24s    p(95)=2.57s   p(99.9)=14.17s
       { expected_response:true }...: avg=1.23s   min=7.32ms  med=1.17s   max=15.97s  p(90)=2.24s    p(95)=2.57s   p(99.9)=14.17s
     http_req_failed................: 0.00%   ✓ 0          ✗ 10556
     http_req_receiving.............: avg=79.45µs min=28.55µs med=59.07µs max=6.04ms  p(90)=109.39µs p(95)=138µs   p(99.9)=1.38ms
     http_req_sending...............: avg=47.51µs min=6.08µs  med=13.21µs max=31.29ms p(90)=31.92µs  p(95)=49.4µs  p(99.9)=6.72ms
     http_req_tls_handshaking.......: avg=0s      min=0s      med=0s      max=0s      p(90)=0s       p(95)=0s      p(99.9)=0s    
     http_req_waiting...............: avg=1.23s   min=7.25ms  med=1.17s   max=15.97s  p(90)=2.24s    p(95)=2.57s   p(99.9)=14.17s
     http_reqs......................: 10556   154.180157/s
     iteration_duration.............: avg=1.36s   min=8.16ms  med=1.3s    max=15.99s  p(90)=2.28s    p(95)=2.64s   p(99.9)=14.28s
     iterations.....................: 9556    139.574231/s
     success_rate...................: 100.00% ✓ 9556       ✗ 0    
     vus............................: 98      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@ardatan ardatan merged commit 9a79496 into main Sep 14, 2025
34 checks passed
@ardatan ardatan deleted the renovate/bun-1.x branch September 14, 2025 23:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant