Skip to content

Conversation

renovate[bot]
Copy link
Contributor

@renovate renovate bot commented Sep 15, 2025

Coming soon: The Renovate bot (GitHub App) will be renamed to Mend. PRs from Renovate will soon appear from 'Mend'. Learn more here.

This PR contains the following updates:

Package Type Update Change
serde (source) dependencies patch 1.0.223 -> 1.0.225

Release Notes

serde-rs/serde (serde)

v1.0.225

Compare Source

  • Avoid triggering a deprecation warning in derived Serialize and Deserialize impls for a data structure that contains its own deprecations (#​2879, thanks @​rcrisanti)

v1.0.224

Compare Source

  • Remove private types being suggested in rustc diagnostics (#​2979)

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.


  • If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

@renovate renovate bot added the dependencies Pull requests that update a dependency file label Sep 15, 2025
Copy link

github-actions bot commented Sep 15, 2025

💻 Website Preview

The latest changes are available as preview in: https://5b060d75.federation-gateway-benchmark.pages.dev

Copy link

github-actions bot commented Sep 15, 2025

Overview for: constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1882 113407 total, 0 failed avg: 26ms, p95: 46ms
grafbase 1701 102634 total, 0 failed avg: 29ms, p95: 51ms
cosmo 700 42282 total, 0 failed avg: 71ms, p95: 104ms
apollo-router 330 20138 total, 0 failed avg: 149ms, p95: 193ms
hive-gateway 306 18666 total, 0 failed avg: 160ms, p95: 212ms
hive-gateway-bun 294 18036 total, 0 failed avg: 166ms, p95: 314ms
apollo-gateway 118 7278 total, 0 failed avg: 413ms, p95: 486ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 339921      ✗ 0     
     data_received..................: 9.9 GB  165 MB/s
     data_sent......................: 132 MB  2.2 MB/s
     http_req_blocked...............: avg=5.19µs   min=1.17µs  med=2.49µs  max=9.85ms   p(90)=3.56µs   p(95)=4.14µs   p(99.9)=81.99µs
     http_req_connecting............: avg=2.23µs   min=0s      med=0s      max=9.81ms   p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_duration..............: avg=26.25ms  min=1.85ms  med=24.03ms max=438.4ms  p(90)=40.12ms  p(95)=46ms     p(99.9)=82.43ms
       { expected_response:true }...: avg=26.25ms  min=1.85ms  med=24.03ms max=438.4ms  p(90)=40.12ms  p(95)=46ms     p(99.9)=82.43ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 113407
     http_req_receiving.............: avg=103.62µs min=22.13µs med=41.02µs max=54.62ms  p(90)=105.49µs p(95)=322.37µs p(99.9)=9.2ms  
     http_req_sending...............: avg=78.54µs  min=4.91µs  med=9.78µs  max=248.28ms p(90)=30.72µs  p(95)=117.23µs p(99.9)=9.65ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=26.07ms  min=1.81ms  med=23.9ms  max=437.5ms  p(90)=39.8ms   p(95)=45.67ms  p(99.9)=79.68ms
     http_reqs......................: 113407  1882.267565/s
     iteration_duration.............: avg=26.47ms  min=4.16ms  med=24.22ms max=460.34ms p(90)=40.32ms  p(95)=46.19ms  p(99.9)=84.02ms
     iterations.....................: 113307  1880.607819/s
     success_rate...................: 100.00% ✓ 113307      ✗ 0     
     vus............................: 50      min=50        max=50  
     vus_max........................: 50      min=50        max=50  

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 307602      ✗ 0     
     data_received..................: 9.0 GB  150 MB/s
     data_sent......................: 119 MB  2.0 MB/s
     http_req_blocked...............: avg=6.06µs   min=1.15µs  med=2.97µs  max=10.79ms  p(90)=4.03µs   p(95)=4.91µs   p(99.9)=107.01µs
     http_req_connecting............: avg=2.42µs   min=0s      med=0s      max=10.76ms  p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_duration..............: avg=29ms     min=2.54ms  med=26.02ms max=429.56ms p(90)=44.3ms   p(95)=50.95ms  p(99.9)=88.1ms  
       { expected_response:true }...: avg=29ms     min=2.54ms  med=26.02ms max=429.56ms p(90)=44.3ms   p(95)=50.95ms  p(99.9)=88.1ms  
     http_req_failed................: 0.00%   ✓ 0           ✗ 102634
     http_req_receiving.............: avg=135.83µs min=25.88µs med=47.6µs  max=47.49ms  p(90)=144.73µs p(95)=369.03µs p(99.9)=14.27ms 
     http_req_sending...............: avg=99.48µs  min=5.32µs  med=11.56µs max=257.3ms  p(90)=36.36µs  p(95)=128.19µs p(99.9)=12.87ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=28.77ms  min=2.5ms   med=25.86ms max=417.72ms p(90)=43.86ms  p(95)=50.49ms  p(99.9)=85.88ms 
     http_reqs......................: 102634  1701.579074/s
     iteration_duration.............: avg=29.25ms  min=6.03ms  med=26.24ms max=445.96ms p(90)=44.53ms  p(95)=51.17ms  p(99.9)=88.57ms 
     iterations.....................: 102534  1699.921165/s
     success_rate...................: 100.00% ✓ 102534      ✗ 0     
     vus............................: 50      min=50        max=50  
     vus_max........................: 50      min=50        max=50  

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 126546     ✗ 0    
     data_received..................: 3.7 GB  61 MB/s
     data_sent......................: 49 MB   814 kB/s
     http_req_blocked...............: avg=13.89µs  min=1.3µs   med=2.76µs  max=15.37ms  p(90)=3.77µs   p(95)=4.38µs   p(99.9)=4.1ms   
     http_req_connecting............: avg=10.52µs  min=0s      med=0s      max=15.15ms  p(90)=0s       p(95)=0s       p(99.9)=4.08ms  
     http_req_duration..............: avg=70.72ms  min=2.89ms  med=69.39ms max=490.77ms p(90)=95.95ms  p(95)=103.81ms p(99.9)=274.95ms
       { expected_response:true }...: avg=70.72ms  min=2.89ms  med=69.39ms max=490.77ms p(90)=95.95ms  p(95)=103.81ms p(99.9)=274.95ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 42282
     http_req_receiving.............: avg=162.75µs min=29.48µs med=69.42µs max=37.62ms  p(90)=144.08µs p(95)=371.47µs p(99.9)=14.63ms 
     http_req_sending...............: avg=55.89µs  min=5.9µs   med=11.29µs max=111.48ms p(90)=28.96µs  p(95)=119.59µs p(99.9)=6.57ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=70.5ms   min=2.81ms  med=69.23ms max=482.99ms p(90)=95.72ms  p(95)=103.44ms p(99.9)=272.74ms
     http_reqs......................: 42282   700.042858/s
     iteration_duration.............: avg=71.13ms  min=5.91ms  med=69.65ms max=534.83ms p(90)=96.21ms  p(95)=104.04ms p(99.9)=294.41ms
     iterations.....................: 42182   698.387206/s
     success_rate...................: 100.00% ✓ 42182      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 60114      ✗ 0    
     data_received..................: 1.8 GB  29 MB/s
     data_sent......................: 23 MB   385 kB/s
     http_req_blocked...............: avg=14.7µs   min=1.78µs  med=3.68µs   max=8.22ms   p(90)=5.62µs   p(95)=6.45µs   p(99.9)=5.01ms  
     http_req_connecting............: avg=10.29µs  min=0s      med=0s       max=8.18ms   p(90)=0s       p(95)=0s       p(99.9)=4.98ms  
     http_req_duration..............: avg=148.84ms min=6.79ms  med=147.99ms max=601.56ms p(90)=182.86ms p(95)=193.08ms p(99.9)=459.77ms
       { expected_response:true }...: avg=148.84ms min=6.79ms  med=147.99ms max=601.56ms p(90)=182.86ms p(95)=193.08ms p(99.9)=459.77ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 20138
     http_req_receiving.............: avg=90.53µs  min=35.28µs med=65.77µs  max=17.48ms  p(90)=118.87µs p(95)=152.93µs p(99.9)=1.65ms  
     http_req_sending...............: avg=72.9µs   min=8.35µs  med=14.35µs  max=301.06ms p(90)=23.78µs  p(95)=42.75µs  p(99.9)=2.21ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=148.68ms min=6.71ms  med=147.86ms max=599.8ms  p(90)=182.72ms p(95)=192.94ms p(99.9)=459.45ms
     http_reqs......................: 20138   330.637824/s
     iteration_duration.............: avg=149.89ms min=39.43ms med=148.35ms max=658.68ms p(90)=183.18ms p(95)=193.42ms p(99.9)=498.84ms
     iterations.....................: 20038   328.995964/s
     success_rate...................: 100.00% ✓ 20038      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 55698      ✗ 0    
     data_received..................: 1.6 GB  27 MB/s
     data_sent......................: 22 MB   356 kB/s
     http_req_blocked...............: avg=19.52µs  min=1.26µs  med=2.81µs   max=11.27ms p(90)=4.64µs   p(95)=5.71µs   p(99.9)=7.11ms  
     http_req_connecting............: avg=15.64µs  min=0s      med=0s       max=11.24ms p(90)=0s       p(95)=0s       p(99.9)=7.08ms  
     http_req_duration..............: avg=160.46ms min=6.66ms  med=148.23ms max=1s      p(90)=177.57ms p(95)=211.9ms  p(99.9)=995.94ms
       { expected_response:true }...: avg=160.46ms min=6.66ms  med=148.23ms max=1s      p(90)=177.57ms p(95)=211.9ms  p(99.9)=995.94ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 18666
     http_req_receiving.............: avg=96.77µs  min=26.44µs med=50.04µs  max=16.08ms p(90)=117.78µs p(95)=256.18µs p(99.9)=3.57ms  
     http_req_sending...............: avg=115.63µs min=5.58µs  med=11.44µs  max=306.9ms p(90)=33.23µs  p(95)=126.04µs p(99.9)=5.1ms   
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s      p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=160.25ms min=6.62ms  med=148.09ms max=1s      p(90)=177.34ms p(95)=211.4ms  p(99.9)=995.87ms
     http_reqs......................: 18666   306.422052/s
     iteration_duration.............: avg=161.64ms min=19.84ms med=148.57ms max=1s      p(90)=177.94ms p(95)=212.7ms  p(99.9)=996.26ms
     iterations.....................: 18566   304.780446/s
     success_rate...................: 100.00% ✓ 18566      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 53808      ✗ 0    
     data_received..................: 1.6 GB  26 MB/s
     data_sent......................: 21 MB   343 kB/s
     http_req_blocked...............: avg=41.29µs  min=1.15µs  med=2.72µs   max=18.36ms  p(90)=4.47µs   p(95)=5.62µs   p(99.9)=14.82ms 
     http_req_connecting............: avg=37µs     min=0s      med=0s       max=18.32ms  p(90)=0s       p(95)=0s       p(99.9)=14.75ms 
     http_req_duration..............: avg=166.09ms min=7.13ms  med=154.52ms max=604.53ms p(90)=191.44ms p(95)=314.3ms  p(99.9)=471.14ms
       { expected_response:true }...: avg=166.09ms min=7.13ms  med=154.52ms max=604.53ms p(90)=191.44ms p(95)=314.3ms  p(99.9)=471.14ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 18036
     http_req_receiving.............: avg=93.63µs  min=24.94µs med=46.23µs  max=26.26ms  p(90)=106.61µs p(95)=238.61µs p(99.9)=3.55ms  
     http_req_sending...............: avg=80.24µs  min=5.54µs  med=11.23µs  max=344.07ms p(90)=32.72µs  p(95)=126.31µs p(99.9)=5ms     
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=165.91ms min=7.03ms  med=154.42ms max=600.56ms p(90)=191.13ms p(95)=314.13ms p(99.9)=471.09ms
     http_reqs......................: 18036   294.980732/s
     iteration_duration.............: avg=167.31ms min=37.83ms med=154.91ms max=639.8ms  p(90)=191.93ms p(95)=315.18ms p(99.9)=518.2ms 
     iterations.....................: 17936   293.345222/s
     success_rate...................: 100.00% ✓ 17936      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 21534      ✗ 0   
     data_received..................: 639 MB  10 MB/s
     data_sent......................: 8.5 MB  138 kB/s
     http_req_blocked...............: avg=91.62µs  min=1.24µs   med=3µs      max=20.13ms  p(90)=4.79µs   p(95)=5.43µs   p(99.9)=19.07ms 
     http_req_connecting............: avg=87.48µs  min=0s       med=0s       max=20.1ms   p(90)=0s       p(95)=0s       p(99.9)=19ms    
     http_req_duration..............: avg=412.91ms min=7.57ms   med=412.73ms max=818.88ms p(90)=466.96ms p(95)=485.95ms p(99.9)=768.23ms
       { expected_response:true }...: avg=412.91ms min=7.57ms   med=412.73ms max=818.88ms p(90)=466.96ms p(95)=485.95ms p(99.9)=768.23ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 7278
     http_req_receiving.............: avg=73.48µs  min=29.99µs  med=52.85µs  max=61.11ms  p(90)=98.87µs  p(95)=113.26µs p(99.9)=740.58µs
     http_req_sending...............: avg=117.06µs min=6.5µs    med=12.25µs  max=226.8ms  p(90)=20.3µs   p(95)=23.69µs  p(99.9)=7.21ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=412.72ms min=7.51ms   med=412.62ms max=818.14ms p(90)=466.72ms p(95)=485.54ms p(99.9)=752.65ms
     http_reqs......................: 7278    118.970005/s
     iteration_duration.............: avg=419.01ms min=165.39ms med=413.4ms  max=838.63ms p(90)=467.75ms p(95)=487.05ms p(99.9)=791.06ms
     iterations.....................: 7178    117.335352/s
     success_rate...................: 100.00% ✓ 7178       ✗ 0   
     vus............................: 33      min=33       max=50
     vus_max........................: 50      min=50       max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Sep 15, 2025

Overview for: constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 172 13988 total, 0 failed avg: 216ms, p95: 227ms
hive-router 170 13798 total, 0 failed avg: 219ms, p95: 230ms
cosmo 168 13693 total, 0 failed avg: 221ms, p95: 240ms
hive-gateway 161 12364 total, 0 failed avg: 244ms, p95: 275ms
hive-gateway-bun 161 12428 total, 0 failed avg: 243ms, p95: 267ms
apollo-router 138 11281 total, 0 failed avg: 268ms, p95: 314ms ❌ 2 unexpected GraphQL errors
apollo-gateway 123 10084 total, 0 failed avg: 300ms, p95: 335ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41664      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   201 kB/s
     http_req_blocked...............: avg=41.66µs  min=1.12µs   med=1.91µs   max=17.39ms  p(90)=3.65µs   p(95)=5.36µs   p(99.9)=14.26ms 
     http_req_connecting............: avg=38.61µs  min=0s       med=0s       max=17.26ms  p(90)=0s       p(95)=0s       p(99.9)=14.15ms 
     http_req_duration..............: avg=215.86ms min=129.37ms med=215.1ms  max=590.76ms p(90)=224.04ms p(95)=226.61ms p(99.9)=493.61ms
       { expected_response:true }...: avg=215.86ms min=129.37ms med=215.1ms  max=590.76ms p(90)=224.04ms p(95)=226.61ms p(99.9)=493.61ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13988
     http_req_receiving.............: avg=84.37µs  min=26.22µs  med=47.12µs  max=11.65ms  p(90)=101.44µs p(95)=273.63µs p(99.9)=4.47ms  
     http_req_sending...............: avg=97.23µs  min=5.29µs   med=8.48µs   max=342.8ms  p(90)=30.92µs  p(95)=94.93µs  p(99.9)=6.03ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=215.68ms min=129.29ms med=215ms    max=590.09ms p(90)=223.9ms  p(95)=226.48ms p(99.9)=483.14ms
     http_reqs......................: 13988   172.873741/s
     iteration_duration.............: avg=216.14ms min=129.54ms med=215.34ms max=604.07ms p(90)=224.24ms p(95)=226.81ms p(99.9)=502.55ms
     iterations.....................: 13888   171.637869/s
     success_rate...................: 100.00% ✓ 13888      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41094      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   198 kB/s
     http_req_blocked...............: avg=19.7µs   min=1.19µs   med=2.13µs   max=9.29ms   p(90)=3.29µs   p(95)=4.72µs   p(99.9)=6.86ms  
     http_req_connecting............: avg=17.07µs  min=0s       med=0s       max=9.26ms   p(90)=0s       p(95)=0s       p(99.9)=6.84ms  
     http_req_duration..............: avg=219.41ms min=156.98ms med=218.49ms max=598.98ms p(90)=226.85ms p(95)=229.59ms p(99.9)=508.8ms 
       { expected_response:true }...: avg=219.41ms min=156.98ms med=218.49ms max=598.98ms p(90)=226.85ms p(95)=229.59ms p(99.9)=508.8ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 13798
     http_req_receiving.............: avg=86.99µs  min=25.09µs  med=42.98µs  max=121.6ms  p(90)=88.78µs  p(95)=260.02µs p(99.9)=3.7ms   
     http_req_sending...............: avg=124.15µs min=5.4µs    med=8.79µs   max=357.84ms p(90)=29.1µs   p(95)=98.43µs  p(99.9)=5.78ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=219.2ms  min=156.9ms  med=218.41ms max=583.83ms p(90)=226.7ms  p(95)=229.45ms p(99.9)=479.78ms
     http_reqs......................: 13798   170.380694/s
     iteration_duration.............: avg=219.7ms  min=157.19ms med=218.72ms max=619.77ms p(90)=227.03ms p(95)=229.76ms p(99.9)=522.81ms
     iterations.....................: 13698   169.145873/s
     success_rate...................: 100.00% ✓ 13698      ✗ 0    
     vus............................: 4       min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40779      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   196 kB/s
     http_req_blocked...............: avg=19.5µs   min=1.43µs   med=2.66µs   max=9.03ms   p(90)=3.78µs   p(95)=4.57µs   p(99.9)=6.41ms  
     http_req_connecting............: avg=16.09µs  min=0s       med=0s       max=9ms      p(90)=0s       p(95)=0s       p(99.9)=6.37ms  
     http_req_duration..............: avg=220.89ms min=162.69ms med=219.9ms  max=613.47ms p(90)=234.73ms p(95)=240.15ms p(99.9)=504.05ms
       { expected_response:true }...: avg=220.89ms min=162.69ms med=219.9ms  max=613.47ms p(90)=234.73ms p(95)=240.15ms p(99.9)=504.05ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13693
     http_req_receiving.............: avg=432.69µs min=32.79µs  med=66.09µs  max=31.63ms  p(90)=394.33µs p(95)=1ms      p(99.9)=23.41ms 
     http_req_sending...............: avg=84.19µs  min=6.53µs   med=11.04µs  max=270.44ms p(90)=30.7µs   p(95)=121.01µs p(99.9)=3.47ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=220.37ms min=162.26ms med=219.54ms max=612.84ms p(90)=234.25ms p(95)=239.49ms p(99.9)=502.97ms
     http_reqs......................: 13693   168.865868/s
     iteration_duration.............: avg=221.28ms min=162.87ms med=220.21ms max=628.54ms p(90)=235ms    p(95)=240.46ms p(99.9)=521.98ms
     iterations.....................: 13593   167.632641/s
     success_rate...................: 100.00% ✓ 13593      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 36792      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 14 MB   188 kB/s
     http_req_blocked...............: avg=23.97µs  min=1.09µs   med=2.61µs   max=10.42ms  p(90)=4.32µs   p(95)=5.47µs   p(99.9)=7.72ms  
     http_req_connecting............: avg=20.49µs  min=0s       med=0s       max=10.37ms  p(90)=0s       p(95)=0s       p(99.9)=7.69ms  
     http_req_duration..............: avg=244.08ms min=160.58ms med=236.11ms max=769.2ms  p(90)=260.27ms p(95)=275.39ms p(99.9)=627.75ms
       { expected_response:true }...: avg=244.08ms min=160.58ms med=236.11ms max=769.2ms  p(90)=260.27ms p(95)=275.39ms p(99.9)=627.75ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12364
     http_req_receiving.............: avg=92.44µs  min=25.82µs  med=45.34µs  max=153.34ms p(90)=99.94µs  p(95)=161.7µs  p(99.9)=3.07ms  
     http_req_sending...............: avg=44.37µs  min=5.48µs   med=10.79µs  max=10.89ms  p(90)=31.88µs  p(95)=98.92µs  p(99.9)=3.78ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=243.94ms min=160.49ms med=235.98ms max=768.43ms p(90)=260.15ms p(95)=275.19ms p(99.9)=626.27ms
     http_reqs......................: 12364   161.281342/s
     iteration_duration.............: avg=245.1ms  min=174.85ms med=236.53ms max=784.87ms p(90)=260.57ms p(95)=275.81ms p(99.9)=661.39ms
     iterations.....................: 12264   159.976899/s
     success_rate...................: 100.00% ✓ 12264      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 36984      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 15 MB   188 kB/s
     http_req_blocked...............: avg=33.61µs  min=1.18µs   med=2.61µs   max=16.3ms   p(90)=4.36µs   p(95)=5.61µs   p(99.9)=11.94ms 
     http_req_connecting............: avg=30.1µs   min=0s       med=0s       max=16.26ms  p(90)=0s       p(95)=0s       p(99.9)=11.88ms 
     http_req_duration..............: avg=242.77ms min=160.76ms med=233.36ms max=735.67ms p(90)=254.1ms  p(95)=267ms    p(99.9)=729.21ms
       { expected_response:true }...: avg=242.77ms min=160.76ms med=233.36ms max=735.67ms p(90)=254.1ms  p(95)=267ms    p(99.9)=729.21ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12428
     http_req_receiving.............: avg=102.78µs min=25.86µs  med=46.34µs  max=148.33ms p(90)=102.1µs  p(95)=159.99µs p(99.9)=3.16ms  
     http_req_sending...............: avg=119.28µs min=5.43µs   med=10.84µs  max=258.89ms p(90)=31.88µs  p(95)=98.16µs  p(99.9)=12.21ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=242.55ms min=160.71ms med=233.25ms max=731.14ms p(90)=253.88ms p(95)=266.65ms p(99.9)=728.66ms
     http_reqs......................: 12428   161.793253/s
     iteration_duration.............: avg=243.76ms min=160.94ms med=233.73ms max=765.07ms p(90)=254.41ms p(95)=267.59ms p(99.9)=730.42ms
     iterations.....................: 12328   160.491408/s
     success_rate...................: 100.00% ✓ 12328      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  99% — ✓ 11179 / ✗ 2
     ✓ valid response structure

     checks.........................: 99.99% ✓ 33541      ✗ 2    
     data_received..................: 990 MB 12 MB/s
     data_sent......................: 13 MB  161 kB/s
     http_req_blocked...............: avg=24.7µs   min=1.52µs   med=2.9µs    max=9.15ms   p(90)=4.42µs   p(95)=5.34µs   p(99.9)=7.19ms  
     http_req_connecting............: avg=20.71µs  min=0s       med=0s       max=9.11ms   p(90)=0s       p(95)=0s       p(99.9)=7.17ms  
     http_req_duration..............: avg=268.1ms  min=174.42ms med=267.01ms max=661.02ms p(90)=304.22ms p(95)=314.02ms p(99.9)=575.39ms
       { expected_response:true }...: avg=268.1ms  min=174.42ms med=267.01ms max=661.02ms p(90)=304.22ms p(95)=314.02ms p(99.9)=575.39ms
     http_req_failed................: 0.00%  ✓ 0          ✗ 11281
     http_req_receiving.............: avg=118.64µs min=28.63µs  med=54.16µs  max=18.02ms  p(90)=149.72µs p(95)=399.6µs  p(99.9)=3.8ms   
     http_req_sending...............: avg=79µs     min=6.83µs   med=11.41µs  max=228.9ms  p(90)=34.96µs  p(95)=135.23µs p(99.9)=3.53ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=267.91ms min=174.35ms med=266.85ms max=660.29ms p(90)=303.94ms p(95)=313.65ms p(99.9)=574.53ms
     http_reqs......................: 11281  138.403764/s
     iteration_duration.............: avg=268.96ms min=174.62ms med=267.63ms max=678.9ms  p(90)=304.65ms p(95)=314.51ms p(99.9)=617.12ms
     iterations.....................: 11181  137.176889/s
     success_rate...................: 99.98% ✓ 11179      ✗ 2    
     vus............................: 50     min=0        max=50 
     vus_max........................: 50     min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 29952      ✗ 0    
     data_received..................: 886 MB  11 MB/s
     data_sent......................: 12 MB   144 kB/s
     http_req_blocked...............: avg=81.53µs  min=1.37µs   med=3.55µs   max=21.88ms  p(90)=5.56µs   p(95)=6.56µs   p(99.9)=19.66ms 
     http_req_connecting............: avg=75.56µs  min=0s       med=0s       max=21.71ms  p(90)=0s       p(95)=0s       p(99.9)=19.5ms  
     http_req_duration..............: avg=299.64ms min=212.34ms med=297.37ms max=777.22ms p(90)=325.99ms p(95)=335.3ms  p(99.9)=698.85ms
       { expected_response:true }...: avg=299.64ms min=212.34ms med=297.37ms max=777.22ms p(90)=325.99ms p(95)=335.3ms  p(99.9)=698.85ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10084
     http_req_receiving.............: avg=101.01µs min=32.75µs  med=75.03µs  max=81.51ms  p(90)=129.08µs p(95)=162.61µs p(99.9)=2.31ms  
     http_req_sending...............: avg=111.74µs min=6.63µs   med=14.62µs  max=203.42ms p(90)=28.85µs  p(95)=45.11µs  p(99.9)=4.56ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=299.43ms min=212.22ms med=297.22ms max=776.81ms p(90)=325.81ms p(95)=334.81ms p(99.9)=695.93ms
     http_reqs......................: 10084   123.420414/s
     iteration_duration.............: avg=300.93ms min=219.84ms med=297.95ms max=834.99ms p(90)=326.39ms p(95)=335.62ms p(99.9)=733.71ms
     iterations.....................: 9984    122.196491/s
     success_rate...................: 100.00% ✓ 9984       ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Sep 15, 2025

Overview for: ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 500 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1982 123464 total, 0 failed avg: 113ms, p95: 274ms
grafbase 1641 103986 total, 0 failed avg: 134ms, p95: 317ms
cosmo 657 42104 total, 0 failed avg: 334ms, p95: 736ms
apollo-router 399 26756 total, 0 failed avg: 527ms, p95: 1208ms ❌ 16 unexpected GraphQL errors
hive-gateway 278 19290 total, 0 failed avg: 728ms, p95: 1552ms
hive-gateway-bun 256 17973 total, 0 failed avg: 780ms, p95: 1648ms
apollo-gateway 156 10794 total, 0 failed avg: 1209ms, p95: 2563ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 367392      ✗ 0     
     data_received..................: 11 GB   174 MB/s
     data_sent......................: 144 MB  2.3 MB/s
     http_req_blocked...............: avg=359.42µs min=1.12µs  med=2.47µs   max=304.11ms p(90)=3.8µs    p(95)=4.6µs    p(99.9)=136.73ms
     http_req_connecting............: avg=355.94µs min=0s      med=0s       max=304.04ms p(90)=0s       p(95)=0s       p(99.9)=136.06ms
     http_req_duration..............: avg=112.87ms min=1.82ms  med=101.25ms max=407.38ms p(90)=228.81ms p(95)=273.96ms p(99.9)=350.06ms
       { expected_response:true }...: avg=112.87ms min=1.82ms  med=101.25ms max=407.38ms p(90)=228.81ms p(95)=273.96ms p(99.9)=350.06ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 123464
     http_req_receiving.............: avg=444.16µs min=22.54µs med=40.72µs  max=155.71ms p(90)=173.11µs p(95)=376.04µs p(99.9)=65.26ms 
     http_req_sending...............: avg=339.08µs min=5µs     med=10.01µs  max=128.98ms p(90)=28.31µs  p(95)=122.02µs p(99.9)=60.35ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=112.08ms min=1.78ms  med=100.5ms  max=375.06ms p(90)=226.84ms p(95)=272.21ms p(99.9)=348.26ms
     http_reqs......................: 123464  1982.903882/s
     iteration_duration.............: avg=114.38ms min=1.94ms  med=102.59ms max=687.71ms p(90)=230.74ms p(95)=275.73ms p(99.9)=369.97ms
     iterations.....................: 122464  1966.843298/s
     success_rate...................: 100.00% ✓ 122464      ✗ 0     
     vus............................: 74      min=0         max=494 
     vus_max........................: 500     min=500       max=500 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 308958      ✗ 0     
     data_received..................: 9.1 GB  144 MB/s
     data_sent......................: 121 MB  1.9 MB/s
     http_req_blocked...............: avg=536.67µs min=1.16µs  med=3.03µs   max=385.41ms p(90)=4.48µs   p(95)=5.67µs   p(99.9)=179.25ms
     http_req_connecting............: avg=532.52µs min=0s      med=0s       max=385.37ms p(90)=0s       p(95)=0s       p(99.9)=179.1ms 
     http_req_duration..............: avg=133.88ms min=2.52ms  med=124.2ms  max=499.48ms p(90)=267.22ms p(95)=317.04ms p(99.9)=429.67ms
       { expected_response:true }...: avg=133.88ms min=2.52ms  med=124.2ms  max=499.48ms p(90)=267.22ms p(95)=317.04ms p(99.9)=429.67ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 103986
     http_req_receiving.............: avg=556.65µs min=24.03µs med=47.35µs  max=260.78ms p(90)=159.36µs p(95)=432.07µs p(99.9)=79.97ms 
     http_req_sending...............: avg=456.32µs min=5.48µs  med=11.81µs  max=130.95ms p(90)=32.57µs  p(95)=137.97µs p(99.9)=73.68ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=132.87ms min=2.48ms  med=123.17ms max=458.58ms p(90)=265ms    p(95)=314.97ms p(99.9)=426.67ms
     http_reqs......................: 103986  1641.243888/s
     iteration_duration.............: avg=136.05ms min=2.81ms  med=126.05ms max=820.62ms p(90)=270.12ms p(95)=320.22ms p(99.9)=459.84ms
     iterations.....................: 102986  1625.460572/s
     success_rate...................: 100.00% ✓ 102986      ✗ 0     
     vus............................: 75      min=0         max=494 
     vus_max........................: 500     min=500       max=500 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 123312     ✗ 0    
     data_received..................: 3.7 GB  58 MB/s
     data_sent......................: 49 MB   766 kB/s
     http_req_blocked...............: avg=114.61µs min=1.22µs  med=2.85µs   max=141.91ms p(90)=4.35µs   p(95)=6.54µs   p(99.9)=32.66ms 
     http_req_connecting............: avg=109.58µs min=0s      med=0s       max=141.73ms p(90)=0s       p(95)=0s       p(99.9)=32.59ms 
     http_req_duration..............: avg=333.56ms min=2.92ms  med=313.6ms  max=1.36s    p(90)=658.48ms p(95)=735.99ms p(99.9)=1.15s   
       { expected_response:true }...: avg=333.56ms min=2.92ms  med=313.6ms  max=1.36s    p(90)=658.48ms p(95)=735.99ms p(99.9)=1.15s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 42104
     http_req_receiving.............: avg=835.19µs min=28.16µs med=63.9µs   max=308.83ms p(90)=222.32µs p(95)=517.51µs p(99.9)=144.64ms
     http_req_sending...............: avg=157.52µs min=5.82µs  med=11.67µs  max=132.66ms p(90)=32.27µs  p(95)=136.63µs p(99.9)=31.37ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=332.57ms min=2.86ms  med=312.8ms  max=1.36s    p(90)=657.09ms p(95)=734.57ms p(99.9)=1.14s   
     http_reqs......................: 42104   657.937595/s
     iteration_duration.............: avg=342.17ms min=3.13ms  med=323.71ms max=1.36s    p(90)=662.65ms p(95)=739.56ms p(99.9)=1.15s   
     iterations.....................: 41104   642.311108/s
     success_rate...................: 100.00% ✓ 41104      ✗ 0    
     vus............................: 61      min=0        max=497
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  99% — ✓ 25740 / ✗ 16
     ✓ valid response structure

     checks.........................: 99.97% ✓ 77252      ✗ 16   
     data_received..................: 2.3 GB 35 MB/s
     data_sent......................: 31 MB  466 kB/s
     http_req_blocked...............: avg=79.33µs  min=1.42µs  med=2.94µs   max=127.75ms p(90)=4.54µs  p(95)=6.35µs   p(99.9)=16.73ms
     http_req_connecting............: avg=73.56µs  min=0s      med=0s       max=127.7ms  p(90)=0s      p(95)=0s       p(99.9)=16.68ms
     http_req_duration..............: avg=527.28ms min=6ms     med=494.66ms max=1.66s    p(90)=1.06s   p(95)=1.2s     p(99.9)=1.55s  
       { expected_response:true }...: avg=527.28ms min=6ms     med=494.66ms max=1.66s    p(90)=1.06s   p(95)=1.2s     p(99.9)=1.55s  
     http_req_failed................: 0.00%  ✓ 0          ✗ 26756
     http_req_receiving.............: avg=126.67µs min=29.44µs med=51.07µs  max=96.61ms  p(90)=98.5µs  p(95)=173µs    p(99.9)=12.04ms
     http_req_sending...............: avg=111.79µs min=6.72µs  med=11.52µs  max=83.23ms  p(90)=29.07µs p(95)=115.79µs p(99.9)=21.89ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=527.05ms min=5.95ms  med=494.5ms  max=1.66s    p(90)=1.06s   p(95)=1.2s     p(99.9)=1.55s  
     http_reqs......................: 26756  399.275542/s
     iteration_duration.............: avg=548.12ms min=6.34ms  med=523.26ms max=1.66s    p(90)=1.07s   p(95)=1.21s    p(99.9)=1.56s  
     iterations.....................: 25756  384.3527/s
     success_rate...................: 99.93% ✓ 25740      ✗ 16   
     vus............................: 64     min=0        max=497
     vus_max........................: 500    min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 54870      ✗ 0    
     data_received..................: 1.7 GB  25 MB/s
     data_sent......................: 23 MB   327 kB/s
     http_req_blocked...............: avg=101.44µs min=1.21µs  med=2.78µs   max=118.39ms p(90)=4.87µs  p(95)=7.99µs   p(99.9)=29.87ms
     http_req_connecting............: avg=92.23µs  min=0s      med=0s       max=112.98ms p(90)=0s      p(95)=0s       p(99.9)=29.82ms
     http_req_duration..............: avg=728.26ms min=6.54ms  med=689.79ms max=4.54s    p(90)=1.45s   p(95)=1.55s    p(99.9)=3.61s  
       { expected_response:true }...: avg=728.26ms min=6.54ms  med=689.79ms max=4.54s    p(90)=1.45s   p(95)=1.55s    p(99.9)=3.61s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 19290
     http_req_receiving.............: avg=183.24µs min=26.37µs med=44.96µs  max=103.7ms  p(90)=95.92µs p(95)=155.92µs p(99.9)=33.34ms
     http_req_sending...............: avg=170.99µs min=5.39µs  med=10.8µs   max=96.29ms  p(90)=28.87µs p(95)=79.15µs  p(99.9)=32.97ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=727.9ms  min=6.49ms  med=689.58ms max=4.54s    p(90)=1.45s   p(95)=1.55s    p(99.9)=3.61s  
     http_reqs......................: 19290   278.95501/s
     iteration_duration.............: avg=768.33ms min=7.2ms   med=723.92ms max=4.56s    p(90)=1.46s   p(95)=1.56s    p(99.9)=3.68s  
     iterations.....................: 18290   264.493889/s
     success_rate...................: 100.00% ✓ 18290      ✗ 0    
     vus............................: 72      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 50919      ✗ 0    
     data_received..................: 1.6 GB  23 MB/s
     data_sent......................: 21 MB   301 kB/s
     http_req_blocked...............: avg=114.5µs  min=1.25µs  med=2.76µs   max=95.48ms  p(90)=5.1µs    p(95)=8.3µs    p(99.9)=35.1ms 
     http_req_connecting............: avg=108.08µs min=0s      med=0s       max=95.43ms  p(90)=0s       p(95)=0s       p(99.9)=35.05ms
     http_req_duration..............: avg=780.37ms min=7.29ms  med=728.92ms max=5.2s     p(90)=1.51s    p(95)=1.64s    p(99.9)=4.56s  
       { expected_response:true }...: avg=780.37ms min=7.29ms  med=728.92ms max=5.2s     p(90)=1.51s    p(95)=1.64s    p(99.9)=4.56s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 17973
     http_req_receiving.............: avg=175.73µs min=26.19µs med=45.7µs   max=203.71ms p(90)=101.72µs p(95)=310.46µs p(99.9)=20.71ms
     http_req_sending...............: avg=200.02µs min=5.9µs   med=11.14µs  max=134.12ms p(90)=33.45µs  p(95)=125.51µs p(99.9)=34.54ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=779.99ms min=7.21ms  med=728.66ms max=5.2s     p(90)=1.51s    p(95)=1.64s    p(99.9)=4.56s  
     http_reqs......................: 17973   256.442845/s
     iteration_duration.............: avg=826.57ms min=8.41ms  med=785.49ms max=5.23s    p(90)=1.52s    p(95)=1.65s    p(99.9)=4.6s   
     iterations.....................: 16973   242.174618/s
     success_rate...................: 100.00% ✓ 16973      ✗ 0    
     vus............................: 66      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 29382      ✗ 0    
     data_received..................: 948 MB  14 MB/s
     data_sent......................: 13 MB   187 kB/s
     http_req_blocked...............: avg=34.94µs min=1.32µs  med=3.25µs  max=22.92ms p(90)=5.15µs  p(95)=12.31µs  p(99.9)=9.7ms 
     http_req_connecting............: avg=28.95µs min=0s      med=0s      max=22.87ms p(90)=0s      p(95)=0s       p(99.9)=9.64ms
     http_req_duration..............: avg=1.2s    min=7.45ms  med=1.17s   max=15.52s  p(90)=2.21s   p(95)=2.56s    p(99.9)=14.03s
       { expected_response:true }...: avg=1.2s    min=7.45ms  med=1.17s   max=15.52s  p(90)=2.21s   p(95)=2.56s    p(99.9)=14.03s
     http_req_failed................: 0.00%   ✓ 0          ✗ 10794
     http_req_receiving.............: avg=75.54µs min=25.97µs med=54.49µs max=6.08ms  p(90)=98.65µs p(95)=121.67µs p(99.9)=1.85ms
     http_req_sending...............: avg=41.3µs  min=6.01µs  med=12.66µs max=22.87ms p(90)=27.94µs p(95)=46.14µs  p(99.9)=7.18ms
     http_req_tls_handshaking.......: avg=0s      min=0s      med=0s      max=0s      p(90)=0s      p(95)=0s       p(99.9)=0s    
     http_req_waiting...............: avg=1.2s    min=7.4ms   med=1.17s   max=15.52s  p(90)=2.21s   p(95)=2.56s    p(99.9)=14.03s
     http_reqs......................: 10794   156.899026/s
     iteration_duration.............: avg=1.33s   min=7.71ms  med=1.28s   max=15.53s  p(90)=2.25s   p(95)=2.62s    p(99.9)=14.27s
     iterations.....................: 9794    142.363263/s
     success_rate...................: 100.00% ✓ 9794       ✗ 0    
     vus............................: 110     min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Sep 15, 2025

Overview for: constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 171 13895 total, 0 failed avg: 217ms, p95: 229ms
hive-router 167 13541 total, 0 failed avg: 223ms, p95: 234ms
cosmo 157 12815 total, 0 failed avg: 236ms, p95: 260ms
hive-gateway 153 11759 total, 0 failed avg: 257ms, p95: 366ms
hive-gateway-bun 144 11014 total, 0 failed avg: 274ms, p95: 329ms
apollo-router 125 10163 total, 0 failed avg: 297ms, p95: 338ms
apollo-gateway 86 7054 total, 0 failed avg: 430ms, p95: 473ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41385      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   200 kB/s
     http_req_blocked...............: avg=50.49µs  min=1.27µs   med=2.19µs   max=20.75ms  p(90)=3.9µs    p(95)=5.58µs   p(99.9)=15.39ms 
     http_req_connecting............: avg=46.79µs  min=0s       med=0s       max=17.86ms  p(90)=0s       p(95)=0s       p(99.9)=15.18ms 
     http_req_duration..............: avg=217.37ms min=113ms    med=216.45ms max=603.21ms p(90)=226.23ms p(95)=229.03ms p(99.9)=512.59ms
       { expected_response:true }...: avg=217.37ms min=113ms    med=216.45ms max=603.21ms p(90)=226.23ms p(95)=229.03ms p(99.9)=512.59ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13895
     http_req_receiving.............: avg=85.04µs  min=27.47µs  med=48.05µs  max=12.86ms  p(90)=107.1µs  p(95)=290.02µs p(99.9)=2.95ms  
     http_req_sending...............: avg=116.64µs min=6.25µs   med=9.3µs    max=368.86ms p(90)=33.91µs  p(95)=104.59µs p(99.9)=6.36ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=217.17ms min=109.79ms med=216.34ms max=597.16ms p(90)=226.05ms p(95)=228.84ms p(99.9)=488.93ms
     http_reqs......................: 13895   171.556741/s
     iteration_duration.............: avg=217.7ms  min=113.25ms med=216.71ms max=628.07ms p(90)=226.42ms p(95)=229.23ms p(99.9)=551.31ms
     iterations.....................: 13795   170.322076/s
     success_rate...................: 100.00% ✓ 13795      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40323      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   195 kB/s
     http_req_blocked...............: avg=40.62µs  min=1.17µs   med=2.19µs   max=20.95ms  p(90)=3.15µs   p(95)=4.47µs   p(99.9)=12.6ms  
     http_req_connecting............: avg=37.9µs   min=0s       med=0s       max=20.91ms  p(90)=0s       p(95)=0s       p(99.9)=12.55ms 
     http_req_duration..............: avg=222.87ms min=158.75ms med=221.94ms max=589.35ms p(90)=230.99ms p(95)=233.55ms p(99.9)=493.16ms
       { expected_response:true }...: avg=222.87ms min=158.75ms med=221.94ms max=589.35ms p(90)=230.99ms p(95)=233.55ms p(99.9)=493.16ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13541
     http_req_receiving.............: avg=77.51µs  min=25.34µs  med=44.79µs  max=13.61ms  p(90)=95.7µs   p(95)=261.29µs p(99.9)=1.62ms  
     http_req_sending...............: avg=113.02µs min=5.32µs   med=9.31µs   max=326.15ms p(90)=29.2µs   p(95)=96.33µs  p(99.9)=5.73ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=222.68ms min=158.68ms med=221.84ms max=584.93ms p(90)=230.86ms p(95)=233.36ms p(99.9)=482.69ms
     http_reqs......................: 13541   167.539781/s
     iteration_duration.............: avg=223.24ms min=158.98ms med=222.18ms max=610.72ms p(90)=231.15ms p(95)=233.73ms p(99.9)=520ms   
     iterations.....................: 13441   166.302504/s
     success_rate...................: 100.00% ✓ 13441      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 38145      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 15 MB   184 kB/s
     http_req_blocked...............: avg=22.61µs  min=1.47µs   med=2.89µs   max=9.49ms   p(90)=4.26µs   p(95)=5.31µs   p(99.9)=7.03ms  
     http_req_connecting............: avg=18.37µs  min=0s       med=0s       max=9.45ms   p(90)=0s       p(95)=0s       p(99.9)=7.01ms  
     http_req_duration..............: avg=235.81ms min=166.63ms med=235.88ms max=623.42ms p(90)=253.91ms p(95)=260.19ms p(99.9)=528.46ms
       { expected_response:true }...: avg=235.81ms min=166.63ms med=235.88ms max=623.42ms p(90)=253.91ms p(95)=260.19ms p(99.9)=528.46ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12815
     http_req_receiving.............: avg=270.01µs min=33.56µs  med=70.99µs  max=31.89ms  p(90)=194.91µs p(95)=462.86µs p(99.9)=25.63ms 
     http_req_sending...............: avg=38.89µs  min=6.5µs    med=11.7µs   max=10.85ms  p(90)=28.89µs  p(95)=113.06µs p(99.9)=2.51ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=235.5ms  min=166.51ms med=235.6ms  max=622.61ms p(90)=253.51ms p(95)=259.73ms p(99.9)=527.19ms
     http_reqs......................: 12815   157.880643/s
     iteration_duration.............: avg=236.35ms min=166.85ms med=236.2ms  max=666.88ms p(90)=254.18ms p(95)=260.52ms p(99.9)=569.82ms
     iterations.....................: 12715   156.648645/s
     success_rate...................: 100.00% ✓ 12715      ✗ 0    
     vus............................: 33      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 34977      ✗ 0    
     data_received..................: 1.0 GB  14 MB/s
     data_sent......................: 14 MB   179 kB/s
     http_req_blocked...............: avg=28.12µs  min=1.16µs   med=2.56µs   max=11.2ms   p(90)=4.07µs   p(95)=5.31µs   p(99.9)=8.85ms  
     http_req_connecting............: avg=24.83µs  min=0s       med=0s       max=11.17ms  p(90)=0s       p(95)=0s       p(99.9)=8.82ms  
     http_req_duration..............: avg=256.61ms min=160.27ms med=248.3ms  max=750.53ms p(90)=267.98ms p(95)=365.64ms p(99.9)=630.68ms
       { expected_response:true }...: avg=256.61ms min=160.27ms med=248.3ms  max=750.53ms p(90)=267.98ms p(95)=365.64ms p(99.9)=630.68ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11759
     http_req_receiving.............: avg=103.99µs min=24.95µs  med=43.93µs  max=178.94ms p(90)=105.89µs p(95)=348.3µs  p(99.9)=2.6ms   
     http_req_sending...............: avg=134.68µs min=5.15µs   med=10.55µs  max=308.23ms p(90)=35.39µs  p(95)=135.81µs p(99.9)=9.06ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=256.37ms min=137.68ms med=248.2ms  max=749.72ms p(90)=267.78ms p(95)=365.2ms  p(99.9)=624.33ms
     http_reqs......................: 11759   153.533012/s
     iteration_duration.............: avg=257.8ms  min=161.23ms med=248.59ms max=773.82ms p(90)=268.27ms p(95)=368.21ms p(99.9)=718.99ms
     iterations.....................: 11659   152.227348/s
     success_rate...................: 100.00% ✓ 11659      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 32742      ✗ 0    
     data_received..................: 967 MB  13 MB/s
     data_sent......................: 13 MB   168 kB/s
     http_req_blocked...............: avg=32.3µs   min=1.21µs   med=2.68µs   max=12.16ms  p(90)=4.28µs   p(95)=5.6µs    p(99.9)=9.72ms  
     http_req_connecting............: avg=28.81µs  min=0s       med=0s       max=12.12ms  p(90)=0s       p(95)=0s       p(99.9)=9.69ms  
     http_req_duration..............: avg=273.7ms  min=160.48ms med=264.96ms max=752.71ms p(90)=295.02ms p(95)=329.15ms p(99.9)=684.72ms
       { expected_response:true }...: avg=273.7ms  min=160.48ms med=264.96ms max=752.71ms p(90)=295.02ms p(95)=329.15ms p(99.9)=684.72ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11014
     http_req_receiving.............: avg=92.51µs  min=26.17µs  med=47.68µs  max=21.71ms  p(90)=110.7µs  p(95)=351.05µs p(99.9)=2.36ms  
     http_req_sending...............: avg=149.03µs min=5.62µs   med=11.03µs  max=327.72ms p(90)=34.18µs  p(95)=135.48µs p(99.9)=6.23ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=273.46ms min=160.25ms med=264.84ms max=752.11ms p(90)=294.63ms p(95)=328.91ms p(99.9)=683.71ms
     http_reqs......................: 11014   144.016873/s
     iteration_duration.............: avg=275.1ms  min=174.51ms med=265.28ms max=798.67ms p(90)=295.91ms p(95)=330.14ms p(99.9)=724.7ms 
     iterations.....................: 10914   142.709293/s
     success_rate...................: 100.00% ✓ 10914      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 30189      ✗ 0    
     data_received..................: 892 MB  11 MB/s
     data_sent......................: 12 MB   145 kB/s
     http_req_blocked...............: avg=59.92µs  min=1.78µs   med=2.72µs   max=18ms     p(90)=3.98µs   p(95)=4.86µs   p(99.9)=16.14ms 
     http_req_connecting............: avg=55.85µs  min=0s       med=0s       max=17.85ms  p(90)=0s       p(95)=0s       p(99.9)=16.03ms 
     http_req_duration..............: avg=297.01ms min=147.82ms med=298.64ms max=701.83ms p(90)=329.93ms p(95)=338.14ms p(99.9)=595.68ms
       { expected_response:true }...: avg=297.01ms min=147.82ms med=298.64ms max=701.83ms p(90)=329.93ms p(95)=338.14ms p(99.9)=595.68ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10163
     http_req_receiving.............: avg=84.21µs  min=34.34µs  med=50.85µs  max=2.35ms   p(90)=99.15µs  p(95)=252.03µs p(99.9)=1.4ms   
     http_req_sending...............: avg=127.26µs min=7.83µs   med=11.02µs  max=291.56ms p(90)=28.94µs  p(95)=132.49µs p(99.9)=3.81ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=296.8ms  min=147.76ms med=298.51ms max=701.32ms p(90)=329.72ms p(95)=337.82ms p(99.9)=595.09ms
     http_reqs......................: 10163   125.014717/s
     iteration_duration.............: avg=298.23ms min=148.04ms med=299.21ms max=735.64ms p(90)=330.36ms p(95)=338.58ms p(99.9)=668.31ms
     iterations.....................: 10063   123.78462/s
     success_rate...................: 100.00% ✓ 10063      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 20862     ✗ 0   
     data_received..................: 620 MB  7.6 MB/s
     data_sent......................: 8.2 MB  100 kB/s
     http_req_blocked...............: avg=105.58µs min=1.33µs   med=3.15µs   max=22.84ms  p(90)=4.75µs   p(95)=5.55µs   p(99.9)=17.85ms 
     http_req_connecting............: avg=99.72µs  min=0s       med=0s       max=22.8ms   p(90)=0s       p(95)=0s       p(99.9)=17.81ms 
     http_req_duration..............: avg=429.7ms  min=211.75ms med=432.06ms max=956.76ms p(90)=459.74ms p(95)=472.51ms p(99.9)=884.96ms
       { expected_response:true }...: avg=429.7ms  min=211.75ms med=432.06ms max=956.76ms p(90)=459.74ms p(95)=472.51ms p(99.9)=884.96ms
     http_req_failed................: 0.00%   ✓ 0         ✗ 7054
     http_req_receiving.............: avg=63.28µs  min=31.01µs  med=53.39µs  max=1.91ms   p(90)=94.03µs  p(95)=108.92µs p(99.9)=378.98µs
     http_req_sending...............: avg=72.89µs  min=6.66µs   med=12.62µs  max=191.58ms p(90)=19.82µs  p(95)=25.62µs  p(99.9)=5.57ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=429.57ms min=211.64ms med=431.97ms max=955.99ms p(90)=459.65ms p(95)=472.39ms p(99.9)=884.17ms
     http_reqs......................: 7054    86.250781/s
     iteration_duration.............: avg=433.52ms min=271.8ms  med=432.51ms max=996.96ms p(90)=460.38ms p(95)=472.85ms p(99.9)=972.99ms
     iterations.....................: 6954    85.028059/s
     success_rate...................: 100.00% ✓ 6954      ✗ 0   
     vus............................: 50      min=0       max=50
     vus_max........................: 50      min=50      max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@renovate renovate bot changed the title Update Rust crate serde to v1.0.224 Update Rust crate serde to v1.0.225 Sep 16, 2025
@renovate renovate bot force-pushed the renovate/serde-monorepo branch from d1fbe27 to e15c104 Compare September 16, 2025 13:58
@ardatan ardatan merged commit ee7f9d6 into main Sep 16, 2025
34 checks passed
@ardatan ardatan deleted the renovate/serde-monorepo branch September 16, 2025 14:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant