Skip to content

Conversation

renovate[bot]
Copy link
Contributor

@renovate renovate bot commented Sep 16, 2025

Coming soon: The Renovate bot (GitHub App) will be renamed to Mend. PRs from Renovate will soon appear from 'Mend'. Learn more here.

This PR contains the following updates:

Package Change Age Confidence
@types/node (source) 22.18.4 -> 22.18.5 age confidence

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.


  • If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

@renovate renovate bot added the dependencies Pull requests that update a dependency file label Sep 16, 2025
Copy link

💻 Website Preview

The latest changes are available as preview in: https://2eb2fdda.federation-gateway-benchmark.pages.dev

Copy link

Overview for: constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1898 114345 total, 0 failed avg: 26ms, p95: 46ms
grafbase 1674 101040 total, 0 failed avg: 29ms, p95: 52ms
cosmo 705 42614 total, 0 failed avg: 70ms, p95: 102ms
apollo-router 361 21987 total, 0 failed avg: 136ms, p95: 177ms
hive-gateway 311 19004 total, 0 failed avg: 158ms, p95: 233ms
hive-gateway-bun 294 18009 total, 0 failed avg: 166ms, p95: 290ms
apollo-gateway 119 7313 total, 0 failed avg: 411ms, p95: 483ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 342735      ✗ 0     
     data_received..................: 10 GB   167 MB/s
     data_sent......................: 133 MB  2.2 MB/s
     http_req_blocked...............: avg=5.24µs   min=1.13µs  med=2.49µs  max=9.98ms   p(90)=3.57µs   p(95)=4.15µs   p(99.9)=50.61µs
     http_req_connecting............: avg=2.27µs   min=0s      med=0s      max=9.95ms   p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_duration..............: avg=26.03ms  min=1.88ms  med=23.68ms max=425.94ms p(90)=40.03ms  p(95)=46.39ms  p(99.9)=79.76ms
       { expected_response:true }...: avg=26.03ms  min=1.88ms  med=23.68ms max=425.94ms p(90)=40.03ms  p(95)=46.39ms  p(99.9)=79.76ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 114345
     http_req_receiving.............: avg=104.22µs min=22.79µs med=41.29µs max=104.05ms p(90)=103.19µs p(95)=319.42µs p(99.9)=9.17ms 
     http_req_sending...............: avg=79.81µs  min=5.06µs  med=9.92µs  max=326.42ms p(90)=29.3µs   p(95)=117.26µs p(99.9)=10.73ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=25.84ms  min=1.83ms  med=23.54ms max=416.09ms p(90)=39.69ms  p(95)=45.99ms  p(99.9)=78.5ms 
     http_reqs......................: 114345  1898.236948/s
     iteration_duration.............: avg=26.25ms  min=5.41ms  med=23.88ms max=448.7ms  p(90)=40.24ms  p(95)=46.59ms  p(99.9)=80.4ms 
     iterations.....................: 114245  1896.576852/s
     success_rate...................: 100.00% ✓ 114245      ✗ 0     
     vus............................: 50      min=50        max=50  
     vus_max........................: 50      min=50        max=50  

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 302820      ✗ 0     
     data_received..................: 8.9 GB  147 MB/s
     data_sent......................: 118 MB  1.9 MB/s
     http_req_blocked...............: avg=6µs      min=1.2µs   med=3µs     max=9.19ms   p(90)=4.2µs    p(95)=5.22µs   p(99.9)=114.49µs
     http_req_connecting............: avg=2.31µs   min=0s      med=0s      max=9.16ms   p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_duration..............: avg=29.46ms  min=2.52ms  med=26.43ms max=450.04ms p(90)=44.95ms  p(95)=51.55ms  p(99.9)=91.9ms  
       { expected_response:true }...: avg=29.46ms  min=2.52ms  med=26.43ms max=450.04ms p(90)=44.95ms  p(95)=51.55ms  p(99.9)=91.9ms  
     http_req_failed................: 0.00%   ✓ 0           ✗ 101040
     http_req_receiving.............: avg=139.28µs min=24.85µs med=48.31µs max=245.38ms p(90)=155.18µs p(95)=386.84µs p(99.9)=14.09ms 
     http_req_sending...............: avg=102.76µs min=5.29µs  med=11.84µs max=411.99ms p(90)=39.26µs  p(95)=134.56µs p(99.9)=14.61ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=29.22ms  min=2.48ms  med=26.26ms max=440.59ms p(90)=44.5ms   p(95)=51.09ms  p(99.9)=90.04ms 
     http_reqs......................: 101040  1674.555948/s
     iteration_duration.............: avg=29.71ms  min=6.85ms  med=26.65ms max=481.74ms p(90)=45.19ms  p(95)=51.78ms  p(99.9)=94.56ms 
     iterations.....................: 100940  1672.898628/s
     success_rate...................: 100.00% ✓ 100940      ✗ 0     
     vus............................: 50      min=50        max=50  
     vus_max........................: 50      min=50        max=50  

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 127542     ✗ 0    
     data_received..................: 3.7 GB  62 MB/s
     data_sent......................: 50 MB   820 kB/s
     http_req_blocked...............: avg=10.16µs min=1.29µs  med=2.73µs  max=11ms     p(90)=3.74µs   p(95)=4.28µs   p(99.9)=1.94ms  
     http_req_connecting............: avg=6.85µs  min=0s      med=0s      max=10.95ms  p(90)=0s       p(95)=0s       p(99.9)=1.91ms  
     http_req_duration..............: avg=70.18ms min=2.85ms  med=69.14ms max=479.93ms p(90)=94.97ms  p(95)=102.36ms p(99.9)=258.2ms 
       { expected_response:true }...: avg=70.18ms min=2.85ms  med=69.14ms max=479.93ms p(90)=94.97ms  p(95)=102.36ms p(99.9)=258.2ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 42614
     http_req_receiving.............: avg=156.9µs min=29.26µs med=69.28µs max=32.75ms  p(90)=142.31µs p(95)=359.6µs  p(99.9)=15.45ms 
     http_req_sending...............: avg=47.02µs min=5.83µs  med=11µs    max=150.09ms p(90)=28.8µs   p(95)=117.82µs p(99.9)=2.76ms  
     http_req_tls_handshaking.......: avg=0s      min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=69.97ms min=2.76ms  med=68.95ms max=478.93ms p(90)=94.75ms  p(95)=102.14ms p(99.9)=253.43ms
     http_reqs......................: 42614   705.170435/s
     iteration_duration.............: avg=70.59ms min=5.08ms  med=69.41ms max=522.67ms p(90)=95.22ms  p(95)=102.6ms  p(99.9)=274.88ms
     iterations.....................: 42514   703.515649/s
     success_rate...................: 100.00% ✓ 42514      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 65661      ✗ 0    
     data_received..................: 1.9 GB  32 MB/s
     data_sent......................: 26 MB   421 kB/s
     http_req_blocked...............: avg=28.62µs  min=1.84µs  med=3.06µs   max=17.04ms  p(90)=4.87µs   p(95)=5.62µs   p(99.9)=11.57ms 
     http_req_connecting............: avg=24.37µs  min=0s      med=0s       max=16.89ms  p(90)=0s       p(95)=0s       p(99.9)=11.55ms 
     http_req_duration..............: avg=136.23ms min=6.25ms  med=135.44ms max=623.19ms p(90)=167.18ms p(95)=176.84ms p(99.9)=431.72ms
       { expected_response:true }...: avg=136.23ms min=6.25ms  med=135.44ms max=623.19ms p(90)=167.18ms p(95)=176.84ms p(99.9)=431.72ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 21987
     http_req_receiving.............: avg=100.02µs min=34.08µs med=57.92µs  max=317.55ms p(90)=113.83µs p(95)=149.14µs p(99.9)=1.92ms  
     http_req_sending...............: avg=63.24µs  min=8.23µs  med=12.28µs  max=371.86ms p(90)=21.63µs  p(95)=39.55µs  p(99.9)=6.79ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=136.07ms min=6.13ms  med=135.32ms max=586.08ms p(90)=167.03ms p(95)=176.74ms p(99.9)=423.73ms
     http_reqs......................: 21987   361.583886/s
     iteration_duration.............: avg=137.15ms min=25.56ms med=135.79ms max=677.96ms p(90)=167.43ms p(95)=177.19ms p(99.9)=455.74ms
     iterations.....................: 21887   359.939351/s
     success_rate...................: 100.00% ✓ 21887      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 56712      ✗ 0    
     data_received..................: 1.7 GB  27 MB/s
     data_sent......................: 22 MB   363 kB/s
     http_req_blocked...............: avg=34.48µs  min=1.24µs  med=2.75µs   max=17.85ms  p(90)=4.63µs   p(95)=5.82µs   p(99.9)=13.74ms 
     http_req_connecting............: avg=30.55µs  min=0s      med=0s       max=17.8ms   p(90)=0s       p(95)=0s       p(99.9)=13.72ms 
     http_req_duration..............: avg=157.73ms min=6.79ms  med=150.05ms max=614.32ms p(90)=201.28ms p(95)=232.76ms p(99.9)=588.68ms
       { expected_response:true }...: avg=157.73ms min=6.79ms  med=150.05ms max=614.32ms p(90)=201.28ms p(95)=232.76ms p(99.9)=588.68ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 19004
     http_req_receiving.............: avg=98.7µs   min=27.41µs med=49.25µs  max=22.53ms  p(90)=119.21µs p(95)=259.41µs p(99.9)=3.58ms  
     http_req_sending...............: avg=86.93µs  min=5.61µs  med=11.3µs   max=171.42ms p(90)=32.25µs  p(95)=126.73µs p(99.9)=8.7ms   
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=157.54ms min=6.71ms  med=149.86ms max=608.66ms p(90)=201.12ms p(95)=232.02ms p(99.9)=587.98ms
     http_reqs......................: 19004   311.836847/s
     iteration_duration.............: avg=158.83ms min=32.17ms med=151.2ms  max=648.73ms p(90)=201.71ms p(95)=233.16ms p(99.9)=590.16ms
     iterations.....................: 18904   310.195946/s
     success_rate...................: 100.00% ✓ 18904      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 53727      ✗ 0    
     data_received..................: 1.6 GB  26 MB/s
     data_sent......................: 21 MB   343 kB/s
     http_req_blocked...............: avg=24.49µs  min=1.14µs  med=2.87µs   max=14.26ms  p(90)=4.78µs   p(95)=5.98µs   p(99.9)=7.57ms  
     http_req_connecting............: avg=20.55µs  min=0s      med=0s       max=14.21ms  p(90)=0s       p(95)=0s       p(99.9)=7.54ms  
     http_req_duration..............: avg=166.49ms min=7.66ms  med=160.32ms max=750.18ms p(90)=228.15ms p(95)=290.28ms p(99.9)=566.84ms
       { expected_response:true }...: avg=166.49ms min=7.66ms  med=160.32ms max=750.18ms p(90)=228.15ms p(95)=290.28ms p(99.9)=566.84ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 18009
     http_req_receiving.............: avg=111.86µs min=25.54µs med=47.98µs  max=296.11ms p(90)=105.78µs p(95)=184.62µs p(99.9)=3.78ms  
     http_req_sending...............: avg=80.25µs  min=5.88µs  med=11.51µs  max=303.66ms p(90)=32.49µs  p(95)=122.9µs  p(99.9)=3.79ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=166.3ms  min=7.6ms   med=160.18ms max=749.67ms p(90)=227.98ms p(95)=289.69ms p(99.9)=563.39ms
     http_reqs......................: 18009   294.724888/s
     iteration_duration.............: avg=167.81ms min=36.78ms med=163.88ms max=763.15ms p(90)=228.73ms p(95)=291.98ms p(99.9)=631.34ms
     iterations.....................: 17909   293.088346/s
     success_rate...................: 100.00% ✓ 17909      ✗ 0    
     vus............................: 47      min=47       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 21639      ✗ 0   
     data_received..................: 642 MB  11 MB/s
     data_sent......................: 8.5 MB  139 kB/s
     http_req_blocked...............: avg=41.87µs  min=1.38µs  med=3.12µs   max=11.25ms  p(90)=4.61µs   p(95)=5.42µs   p(99.9)=9.71ms  
     http_req_connecting............: avg=38.32µs  min=0s      med=0s       max=11.22ms  p(90)=0s       p(95)=0s       p(99.9)=9.68ms  
     http_req_duration..............: avg=411.24ms min=7.44ms  med=410.95ms max=729.14ms p(90)=466.16ms p(95)=482.74ms p(99.9)=646.19ms
       { expected_response:true }...: avg=411.24ms min=7.44ms  med=410.95ms max=729.14ms p(90)=466.16ms p(95)=482.74ms p(99.9)=646.19ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 7313
     http_req_receiving.............: avg=60.31µs  min=29.16µs med=50.85µs  max=1.07ms   p(90)=91.56µs  p(95)=105.89µs p(99.9)=293.07µs
     http_req_sending...............: avg=91.07µs  min=6.37µs  med=12.37µs  max=168.48ms p(90)=19.35µs  p(95)=22.86µs  p(99.9)=7.27ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=411.09ms min=7.39ms  med=410.86ms max=728.31ms p(90)=466.04ms p(95)=482.59ms p(99.9)=645.36ms
     http_reqs......................: 7313    119.571909/s
     iteration_duration.............: avg=417.16ms min=209.1ms med=411.49ms max=751.09ms p(90)=466.7ms  p(95)=483.37ms p(99.9)=669.1ms 
     iterations.....................: 7213    117.936849/s
     success_rate...................: 100.00% ✓ 7213       ✗ 0   
     vus............................: 35      min=35       max=50
     vus_max........................: 50      min=50       max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

Overview for: constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 172 13985 total, 0 failed avg: 216ms, p95: 227ms
hive-router 168 13633 total, 0 failed avg: 222ms, p95: 232ms
cosmo 159 12889 total, 0 failed avg: 235ms, p95: 260ms
hive-gateway 149 11458 total, 0 failed avg: 264ms, p95: 299ms
hive-gateway-bun 148 11360 total, 0 failed avg: 266ms, p95: 393ms
apollo-router 125 10255 total, 0 failed avg: 295ms, p95: 341ms
apollo-gateway 87 7163 total, 0 failed avg: 422ms, p95: 466ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41655      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   201 kB/s
     http_req_blocked...............: avg=39.09µs  min=1.16µs   med=2.11µs   max=18ms     p(90)=3.75µs   p(95)=5.37µs   p(99.9)=14.01ms 
     http_req_connecting............: avg=35.92µs  min=0s       med=0s       max=17.98ms  p(90)=0s       p(95)=0s       p(99.9)=13.63ms 
     http_req_duration..............: avg=216.16ms min=156.79ms med=215.31ms max=592.34ms p(90)=224.55ms p(95)=227.46ms p(99.9)=498.23ms
       { expected_response:true }...: avg=216.16ms min=156.79ms med=215.31ms max=592.34ms p(90)=224.55ms p(95)=227.46ms p(99.9)=498.23ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13985
     http_req_receiving.............: avg=81.4µs   min=27.96µs  med=46.66µs  max=11.91ms  p(90)=101.26µs p(95)=283.17µs p(99.9)=2.15ms  
     http_req_sending...............: avg=145.94µs min=5.69µs   med=8.83µs   max=370.28ms p(90)=33.06µs  p(95)=97.41µs  p(99.9)=7.14ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=215.94ms min=156.73ms med=215.2ms  max=591.14ms p(90)=224.38ms p(95)=227.24ms p(99.9)=481.61ms
     http_reqs......................: 13985   172.720356/s
     iteration_duration.............: avg=216.48ms min=156.96ms med=215.54ms max=617.78ms p(90)=224.74ms p(95)=227.64ms p(99.9)=520.91ms
     iterations.....................: 13885   171.485316/s
     success_rate...................: 100.00% ✓ 13885      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40599      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   196 kB/s
     http_req_blocked...............: avg=20.01µs  min=1.15µs   med=2.12µs   max=9.43ms   p(90)=3.04µs   p(95)=4.21µs   p(99.9)=6.97ms  
     http_req_connecting............: avg=17.45µs  min=0s       med=0s       max=9.4ms    p(90)=0s       p(95)=0s       p(99.9)=6.95ms  
     http_req_duration..............: avg=221.95ms min=163.4ms  med=221.11ms max=611.36ms p(90)=229.69ms p(95)=232.28ms p(99.9)=513.46ms
       { expected_response:true }...: avg=221.95ms min=163.4ms  med=221.11ms max=611.36ms p(90)=229.69ms p(95)=232.28ms p(99.9)=513.46ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13633
     http_req_receiving.............: avg=73.63µs  min=25.32µs  med=42.42µs  max=10.18ms  p(90)=82.23µs  p(95)=258.87µs p(99.9)=1.89ms  
     http_req_sending...............: avg=69.22µs  min=5.41µs   med=9.26µs   max=377.49ms p(90)=28.25µs  p(95)=94.28µs  p(99.9)=4.74ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=221.81ms min=163.35ms med=221ms    max=610.63ms p(90)=229.57ms p(95)=232.11ms p(99.9)=503.94ms
     http_reqs......................: 13633   168.399394/s
     iteration_duration.............: avg=222.27ms min=163.58ms med=221.33ms max=617.7ms  p(90)=229.87ms p(95)=232.45ms p(99.9)=524.85ms
     iterations.....................: 13533   167.16416/s
     success_rate...................: 100.00% ✓ 13533      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 38367      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 15 MB   185 kB/s
     http_req_blocked...............: avg=21.93µs  min=1.41µs   med=2.58µs   max=9.44ms   p(90)=3.76µs   p(95)=4.59µs   p(99.9)=7.16ms  
     http_req_connecting............: avg=18.53µs  min=0s       med=0s       max=9.4ms    p(90)=0s       p(95)=0s       p(99.9)=7.14ms  
     http_req_duration..............: avg=234.53ms min=126.39ms med=234.3ms  max=611.02ms p(90)=254.05ms p(95)=260.12ms p(99.9)=512.95ms
       { expected_response:true }...: avg=234.53ms min=126.39ms med=234.3ms  max=611.02ms p(90)=254.05ms p(95)=260.12ms p(99.9)=512.95ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12889
     http_req_receiving.............: avg=383.93µs min=31.28µs  med=62.31µs  max=42.66ms  p(90)=197.51µs p(95)=486.43µs p(99.9)=34.74ms 
     http_req_sending...............: avg=74.15µs  min=6.57µs   med=10.81µs  max=234.52ms p(90)=29µs     p(95)=117.67µs p(99.9)=3.3ms   
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=234.07ms min=126.33ms med=233.98ms max=609.92ms p(90)=253.3ms  p(95)=259.24ms p(99.9)=511.98ms
     http_reqs......................: 12889   159.104503/s
     iteration_duration.............: avg=235.02ms min=126.65ms med=234.71ms max=643.27ms p(90)=254.34ms p(95)=260.46ms p(99.9)=554.27ms
     iterations.....................: 12789   157.870082/s
     success_rate...................: 100.00% ✓ 12789      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 34074      ✗ 0    
     data_received..................: 1.0 GB  13 MB/s
     data_sent......................: 13 MB   174 kB/s
     http_req_blocked...............: avg=30.04µs  min=1.11µs   med=2.63µs   max=11.33ms  p(90)=4.33µs   p(95)=5.76µs   p(99.9)=9.2ms   
     http_req_connecting............: avg=26.53µs  min=0s       med=0s       max=11.3ms   p(90)=0s       p(95)=0s       p(99.9)=9.17ms  
     http_req_duration..............: avg=263.53ms min=140.3ms  med=255.11ms max=784.61ms p(90)=274.76ms p(95)=299.07ms p(99.9)=675.34ms
       { expected_response:true }...: avg=263.53ms min=140.3ms  med=255.11ms max=784.61ms p(90)=274.76ms p(95)=299.07ms p(99.9)=675.34ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11458
     http_req_receiving.............: avg=126.13µs min=26.15µs  med=46.08µs  max=327.72ms p(90)=112.7µs  p(95)=376.29µs p(99.9)=5.29ms  
     http_req_sending...............: avg=78.95µs  min=5.66µs   med=10.89µs  max=231.91ms p(90)=36.57µs  p(95)=139.75µs p(99.9)=6.07ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=263.33ms min=118.95ms med=254.98ms max=770.93ms p(90)=274.43ms p(95)=298.84ms p(99.9)=658.09ms
     http_reqs......................: 11458   149.165675/s
     iteration_duration.............: avg=264.75ms min=140.48ms med=255.41ms max=837.35ms p(90)=275.02ms p(95)=299.51ms p(99.9)=710.36ms
     iterations.....................: 11358   147.863828/s
     success_rate...................: 100.00% ✓ 11358      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 33780      ✗ 0    
     data_received..................: 998 MB  13 MB/s
     data_sent......................: 13 MB   172 kB/s
     http_req_blocked...............: avg=28.39µs  min=1.16µs   med=2.65µs   max=11.47ms  p(90)=4.17µs   p(95)=5.48µs   p(99.9)=9.06ms  
     http_req_connecting............: avg=24.96µs  min=0s       med=0s       max=11.43ms  p(90)=0s       p(95)=0s       p(99.9)=9ms     
     http_req_duration..............: avg=265.71ms min=160.44ms med=264.64ms max=800.79ms p(90)=290.56ms p(95)=393.36ms p(99.9)=672.89ms
       { expected_response:true }...: avg=265.71ms min=160.44ms med=264.64ms max=800.79ms p(90)=290.56ms p(95)=393.36ms p(99.9)=672.89ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11360
     http_req_receiving.............: avg=100.83µs min=24.14µs  med=44.63µs  max=160.72ms p(90)=104.9µs  p(95)=298.12µs p(99.9)=3.37ms  
     http_req_sending...............: avg=106.06µs min=5.39µs   med=10.98µs  max=255.02ms p(90)=33.98µs  p(95)=132.16µs p(99.9)=6ms     
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=265.51ms min=160.31ms med=264.52ms max=799.58ms p(90)=290.32ms p(95)=392.54ms p(99.9)=671.91ms
     http_reqs......................: 11360   148.255029/s
     iteration_duration.............: avg=267.04ms min=190.05ms med=265.09ms max=827.29ms p(90)=290.9ms  p(95)=394.28ms p(99.9)=763.83ms
     iterations.....................: 11260   146.949967/s
     success_rate...................: 100.00% ✓ 11260      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 30465      ✗ 0    
     data_received..................: 900 MB  11 MB/s
     data_sent......................: 12 MB   146 kB/s
     http_req_blocked...............: avg=52.46µs  min=1.73µs   med=2.77µs   max=18.32ms  p(90)=4.22µs   p(95)=4.98µs   p(99.9)=13.98ms 
     http_req_connecting............: avg=48.68µs  min=0s       med=0s       max=18.08ms  p(90)=0s       p(95)=0s       p(99.9)=13.86ms 
     http_req_duration..............: avg=295.22ms min=159.01ms med=296.9ms  max=725.29ms p(90)=331.8ms  p(95)=340.8ms  p(99.9)=635.85ms
       { expected_response:true }...: avg=295.22ms min=159.01ms med=296.9ms  max=725.29ms p(90)=331.8ms  p(95)=340.8ms  p(99.9)=635.85ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10255
     http_req_receiving.............: avg=107.23µs min=32.33µs  med=53.18µs  max=102.38ms p(90)=105.36µs p(95)=199.33µs p(99.9)=1.88ms  
     http_req_sending...............: avg=72.75µs  min=7.39µs   med=11.18µs  max=227.79ms p(90)=23.33µs  p(95)=133.05µs p(99.9)=3.1ms   
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=295.04ms min=158.91ms med=296.77ms max=674.39ms p(90)=331.67ms p(95)=340.57ms p(99.9)=626.15ms
     http_reqs......................: 10255   125.76399/s
     iteration_duration.............: avg=296.4ms  min=159.2ms  med=297.52ms max=759.37ms p(90)=332.23ms p(95)=341.16ms p(99.9)=665.06ms
     iterations.....................: 10155   124.537623/s
     success_rate...................: 100.00% ✓ 10155      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 21189     ✗ 0   
     data_received..................: 629 MB  7.7 MB/s
     data_sent......................: 8.3 MB  102 kB/s
     http_req_blocked...............: avg=76.19µs  min=1.5µs    med=3.09µs   max=19.09ms  p(90)=4.26µs   p(95)=5.04µs   p(99.9)=15.9ms  
     http_req_connecting............: avg=72.01µs  min=0s       med=0s       max=18.95ms  p(90)=0s       p(95)=0s       p(99.9)=15.76ms 
     http_req_duration..............: avg=422.14ms min=210.21ms med=425.19ms max=798.12ms p(90)=450.72ms p(95)=465.56ms p(99.9)=754ms   
       { expected_response:true }...: avg=422.14ms min=210.21ms med=425.19ms max=798.12ms p(90)=450.72ms p(95)=465.56ms p(99.9)=754ms   
     http_req_failed................: 0.00%   ✓ 0         ✗ 7163
     http_req_receiving.............: avg=71.2µs   min=32.38µs  med=51.12µs  max=76.5ms   p(90)=88.19µs  p(95)=102.99µs p(99.9)=435.55µs
     http_req_sending...............: avg=72.86µs  min=6.66µs   med=12.65µs  max=130.09ms p(90)=17.73µs  p(95)=24.25µs  p(99.9)=4.69ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=422ms    min=210.15ms med=425.12ms max=797.67ms p(90)=450.6ms  p(95)=465.46ms p(99.9)=753.59ms
     http_reqs......................: 7163    87.787816/s
     iteration_duration.............: avg=425.45ms min=267.4ms  med=425.66ms max=818.61ms p(90)=451.3ms  p(95)=466.02ms p(99.9)=777.18ms
     iterations.....................: 7063    86.562242/s
     success_rate...................: 100.00% ✓ 7063      ✗ 0   
     vus............................: 50      min=0       max=50
     vus_max........................: 50      min=50      max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

Overview for: ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 500 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 2036 126717 total, 0 failed avg: 110ms, p95: 270ms
grafbase 1694 107183 total, 0 failed avg: 130ms, p95: 313ms
cosmo 715 45604 total, 0 failed avg: 308ms, p95: 693ms
apollo-router 384 25852 total, 0 failed avg: 546ms, p95: 1240ms ❌ 20 unexpected GraphQL errors
hive-gateway 268 18738 total, 0 failed avg: 750ms, p95: 1617ms
hive-gateway-bun 250 17625 total, 0 failed avg: 794ms, p95: 1633ms
apollo-gateway 151 10466 total, 0 failed avg: 1241ms, p95: 2650ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 377151      ✗ 0     
     data_received..................: 11 GB   179 MB/s
     data_sent......................: 147 MB  2.4 MB/s
     http_req_blocked...............: avg=365µs    min=1.12µs  med=2.42µs  max=318.22ms p(90)=3.71µs   p(95)=4.36µs   p(99.9)=138.14ms
     http_req_connecting............: avg=361.57µs min=0s      med=0s      max=318.15ms p(90)=0s       p(95)=0s       p(99.9)=138.06ms
     http_req_duration..............: avg=109.94ms min=1.79ms  med=98.56ms max=403.2ms  p(90)=224.63ms p(95)=269.72ms p(99.9)=363.25ms
       { expected_response:true }...: avg=109.94ms min=1.79ms  med=98.56ms max=403.2ms  p(90)=224.63ms p(95)=269.72ms p(99.9)=363.25ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 126717
     http_req_receiving.............: avg=436.23µs min=22.04µs med=40.02µs max=117.58ms p(90)=153.86µs p(95)=364.75µs p(99.9)=63.9ms  
     http_req_sending...............: avg=339.73µs min=5.03µs  med=9.8µs   max=129.48ms p(90)=26.05µs  p(95)=120.08µs p(99.9)=59.27ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=109.17ms min=1.7ms   med=97.88ms max=382.4ms  p(90)=222.68ms p(95)=268.13ms p(99.9)=360.96ms
     http_reqs......................: 126717  2036.2173/s
     iteration_duration.............: avg=111.42ms min=1.9ms   med=99.71ms max=662.2ms  p(90)=226.63ms p(95)=271.79ms p(99.9)=376.26ms
     iterations.....................: 125717  2020.148285/s
     success_rate...................: 100.00% ✓ 125717      ✗ 0     
     vus............................: 69      min=0         max=496 
     vus_max........................: 500     min=500       max=500 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 318549      ✗ 0     
     data_received..................: 9.4 GB  149 MB/s
     data_sent......................: 125 MB  2.0 MB/s
     http_req_blocked...............: avg=515.3µs  min=1.16µs  med=2.98µs   max=384.01ms p(90)=4.28µs   p(95)=5.13µs   p(99.9)=182.33ms
     http_req_connecting............: avg=510.9µs  min=0s      med=0s       max=383.94ms p(90)=0s       p(95)=0s       p(99.9)=182.15ms
     http_req_duration..............: avg=129.92ms min=2.49ms  med=118.93ms max=466.12ms p(90)=261.05ms p(95)=313.36ms p(99.9)=419.38ms
       { expected_response:true }...: avg=129.92ms min=2.49ms  med=118.93ms max=466.12ms p(90)=261.05ms p(95)=313.36ms p(99.9)=419.38ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 107183
     http_req_receiving.............: avg=539.65µs min=24.24µs med=46.94µs  max=149.65ms p(90)=156.34µs p(95)=421.89µs p(99.9)=76.32ms 
     http_req_sending...............: avg=455.68µs min=5.32µs  med=11.6µs   max=146.39ms p(90)=31.79µs  p(95)=135.59µs p(99.9)=71.72ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=128.93ms min=2.44ms  med=117.93ms max=442.84ms p(90)=258.74ms p(95)=311.42ms p(99.9)=415.96ms
     http_reqs......................: 107183  1694.335235/s
     iteration_duration.............: avg=131.96ms min=2.73ms  med=120.71ms max=709.83ms p(90)=263.55ms p(95)=316.17ms p(99.9)=451.69ms
     iterations.....................: 106183  1678.527362/s
     success_rate...................: 100.00% ✓ 106183      ✗ 0     
     vus............................: 71      min=0         max=495 
     vus_max........................: 500     min=500       max=500 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 133812     ✗ 0    
     data_received..................: 4.0 GB  63 MB/s
     data_sent......................: 53 MB   833 kB/s
     http_req_blocked...............: avg=109.61µs min=1.28µs  med=2.82µs   max=190.57ms p(90)=4.19µs   p(95)=5.53µs   p(99.9)=38.47ms 
     http_req_connecting............: avg=105µs    min=0s      med=0s       max=190.5ms  p(90)=0s       p(95)=0s       p(99.9)=38.39ms 
     http_req_duration..............: avg=307.9ms  min=2.84ms  med=285.84ms max=1.19s    p(90)=611.34ms p(95)=693.44ms p(99.9)=968.78ms
       { expected_response:true }...: avg=307.9ms  min=2.84ms  med=285.84ms max=1.19s    p(90)=611.34ms p(95)=693.44ms p(99.9)=968.78ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 45604
     http_req_receiving.............: avg=585.57µs min=26.33µs med=59.66µs  max=221.47ms p(90)=177.25µs p(95)=485.7µs  p(99.9)=87.96ms 
     http_req_sending...............: avg=158.26µs min=5.72µs  med=11.1µs   max=140.39ms p(90)=28.85µs  p(95)=125.2µs  p(99.9)=34.45ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=307.16ms min=2.76ms  med=285.27ms max=1.19s    p(90)=610.62ms p(95)=692.26ms p(99.9)=968.22ms
     http_reqs......................: 45604   715.72037/s
     iteration_duration.............: avg=315.28ms min=3.03ms  med=293.82ms max=1.19s    p(90)=615.26ms p(95)=696.12ms p(99.9)=970.16ms
     iterations.....................: 44604   700.026125/s
     success_rate...................: 100.00% ✓ 44604      ✗ 0    
     vus............................: 95      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  99% — ✓ 24832 / ✗ 20
     ✓ valid response structure

     checks.........................: 99.97% ✓ 74536      ✗ 20   
     data_received..................: 2.3 GB 34 MB/s
     data_sent......................: 30 MB  448 kB/s
     http_req_blocked...............: avg=85.35µs  min=1.42µs  med=3.1µs    max=178ms    p(90)=4.94µs   p(95)=7.18µs   p(99.9)=21.33ms
     http_req_connecting............: avg=78.9µs   min=0s      med=0s       max=177.95ms p(90)=0s       p(95)=0s       p(99.9)=21.23ms
     http_req_duration..............: avg=545.52ms min=6.15ms  med=509.52ms max=2s       p(90)=1.1s     p(95)=1.24s    p(99.9)=1.79s  
       { expected_response:true }...: avg=545.52ms min=6.15ms  med=509.52ms max=2s       p(90)=1.1s     p(95)=1.24s    p(99.9)=1.79s  
     http_req_failed................: 0.00%  ✓ 0          ✗ 25852
     http_req_receiving.............: avg=117.93µs min=29.75µs med=53.87µs  max=45.29ms  p(90)=105.48µs p(95)=175.93µs p(99.9)=11.25ms
     http_req_sending...............: avg=103.23µs min=6.54µs  med=11.85µs  max=88.02ms  p(90)=29.14µs  p(95)=114.23µs p(99.9)=16.19ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=545.3ms  min=6.08ms  med=509.29ms max=2s       p(90)=1.1s     p(95)=1.23s    p(99.9)=1.79s  
     http_reqs......................: 25852  384.382741/s
     iteration_duration.............: avg=567.84ms min=6.66ms  med=535.87ms max=2s       p(90)=1.11s    p(95)=1.24s    p(99.9)=1.79s  
     iterations.....................: 24852  369.514153/s
     success_rate...................: 99.91% ✓ 24832      ✗ 20   
     vus............................: 75     min=0        max=500
     vus_max........................: 500    min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 53214      ✗ 0    
     data_received..................: 1.6 GB  24 MB/s
     data_sent......................: 22 MB   315 kB/s
     http_req_blocked...............: avg=111.24µs min=1.24µs  med=2.83µs   max=88.94ms p(90)=4.68µs  p(95)=6.84µs   p(99.9)=31.37ms
     http_req_connecting............: avg=105.98µs min=0s      med=0s       max=88.87ms p(90)=0s      p(95)=0s       p(99.9)=31.31ms
     http_req_duration..............: avg=749.6ms  min=6.99ms  med=681.88ms max=4.88s   p(90)=1.48s   p(95)=1.61s    p(99.9)=3.77s  
       { expected_response:true }...: avg=749.6ms  min=6.99ms  med=681.88ms max=4.88s   p(90)=1.48s   p(95)=1.61s    p(99.9)=3.77s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 18738
     http_req_receiving.............: avg=156.5µs  min=25.94µs med=44.54µs  max=71.68ms p(90)=90.49µs p(95)=150.21µs p(99.9)=21.5ms 
     http_req_sending...............: avg=152.44µs min=5.76µs  med=10.9µs   max=78.49ms p(90)=26.89µs p(95)=69.82µs  p(99.9)=26.88ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s      p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=749.29ms min=6.94ms  med=681.71ms max=4.88s   p(90)=1.47s   p(95)=1.61s    p(99.9)=3.77s  
     http_reqs......................: 18738   268.919679/s
     iteration_duration.............: avg=792.17ms min=7.57ms  med=766.28ms max=4.9s    p(90)=1.48s   p(95)=1.62s    p(99.9)=3.81s  
     iterations.....................: 17738   254.568111/s
     success_rate...................: 100.00% ✓ 17738      ✗ 0    
     vus............................: 96      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 49875      ✗ 0    
     data_received..................: 1.5 GB  22 MB/s
     data_sent......................: 21 MB   294 kB/s
     http_req_blocked...............: avg=113.93µs min=1.31µs  med=2.97µs   max=134.42ms p(90)=5.27µs   p(95)=8.33µs   p(99.9)=28.73ms
     http_req_connecting............: avg=108.29µs min=0s      med=0s       max=134.35ms p(90)=0s       p(95)=0s       p(99.9)=28.05ms
     http_req_duration..............: avg=793.71ms min=7.56ms  med=758.37ms max=5.57s    p(90)=1.51s    p(95)=1.63s    p(99.9)=4.75s  
       { expected_response:true }...: avg=793.71ms min=7.56ms  med=758.37ms max=5.57s    p(90)=1.51s    p(95)=1.63s    p(99.9)=4.75s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 17625
     http_req_receiving.............: avg=165.81µs min=26.01µs med=46.74µs  max=90.51ms  p(90)=100.14µs p(95)=285.35µs p(99.9)=21.18ms
     http_req_sending...............: avg=153.54µs min=5.91µs  med=11.45µs  max=102.19ms p(90)=33.77µs  p(95)=128.16µs p(99.9)=25.7ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=793.39ms min=7.5ms   med=758.15ms max=5.57s    p(90)=1.51s    p(95)=1.63s    p(99.9)=4.74s  
     http_reqs......................: 17625   250.555412/s
     iteration_duration.............: avg=841.68ms min=8.91ms  med=810.39ms max=5.58s    p(90)=1.52s    p(95)=1.65s    p(99.9)=4.78s  
     iterations.....................: 16625   236.339502/s
     success_rate...................: 100.00% ✓ 16625      ✗ 0    
     vus............................: 84      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 28398      ✗ 0    
     data_received..................: 919 MB  13 MB/s
     data_sent......................: 13 MB   181 kB/s
     http_req_blocked...............: avg=30.85µs min=1.39µs  med=3.26µs  max=24.55ms p(90)=5.41µs   p(95)=10.72µs  p(99.9)=4.51ms
     http_req_connecting............: avg=24.49µs min=0s      med=0s      max=24.49ms p(90)=0s       p(95)=0s       p(99.9)=4.32ms
     http_req_duration..............: avg=1.24s   min=7.41ms  med=1.19s   max=16.09s  p(90)=2.17s    p(95)=2.65s    p(99.9)=15s   
       { expected_response:true }...: avg=1.24s   min=7.41ms  med=1.19s   max=16.09s  p(90)=2.17s    p(95)=2.65s    p(99.9)=15s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 10466
     http_req_receiving.............: avg=79.09µs min=26.67µs med=54.87µs max=14.57ms p(90)=104.58µs p(95)=133.92µs p(99.9)=1.36ms
     http_req_sending...............: avg=44.38µs min=6.39µs  med=12.69µs max=14.56ms p(90)=29.71µs  p(95)=49.24µs  p(99.9)=7.78ms
     http_req_tls_handshaking.......: avg=0s      min=0s      med=0s      max=0s      p(90)=0s       p(95)=0s       p(99.9)=0s    
     http_req_waiting...............: avg=1.24s   min=7.37ms  med=1.19s   max=16.09s  p(90)=2.17s    p(95)=2.64s    p(99.9)=15s   
     http_reqs......................: 10466   151.128925/s
     iteration_duration.............: avg=1.37s   min=7.75ms  med=1.33s   max=16.1s   p(90)=2.22s    p(95)=2.7s     p(99.9)=15.06s
     iterations.....................: 9466    136.688936/s
     success_rate...................: 100.00% ✓ 9466       ✗ 0    
     vus............................: 84      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

Overview for: constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 172 13994 total, 0 failed avg: 216ms, p95: 228ms
hive-gateway 169 12983 total, 0 failed avg: 233ms, p95: 261ms
hive-router 167 13542 total, 0 failed avg: 223ms, p95: 234ms
cosmo 166 13488 total, 0 failed avg: 224ms, p95: 249ms
hive-gateway-bun 163 12483 total, 0 failed avg: 242ms, p95: 284ms
apollo-router 135 11073 total, 0 failed avg: 273ms, p95: 317ms
apollo-gateway 125 10224 total, 0 failed avg: 296ms, p95: 324ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41682      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   201 kB/s
     http_req_blocked...............: avg=21.74µs  min=1.18µs   med=2µs      max=10.48ms  p(90)=4.11µs   p(95)=5.72µs   p(99.9)=7.7ms   
     http_req_connecting............: avg=18.87µs  min=0s       med=0s       max=10.43ms  p(90)=0s       p(95)=0s       p(99.9)=7.67ms  
     http_req_duration..............: avg=215.82ms min=157.77ms med=214.9ms  max=628.87ms p(90)=224.61ms p(95)=227.56ms p(99.9)=530.06ms
       { expected_response:true }...: avg=215.82ms min=157.77ms med=214.9ms  max=628.87ms p(90)=224.61ms p(95)=227.56ms p(99.9)=530.06ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13994
     http_req_receiving.............: avg=87.7µs   min=24.6µs   med=48.24µs  max=20.98ms  p(90)=111.41µs p(95)=291.5µs  p(99.9)=3.25ms  
     http_req_sending...............: avg=105.43µs min=5.59µs   med=9.24µs   max=385.89ms p(90)=34.31µs  p(95)=107.74µs p(99.9)=7.68ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=215.63ms min=157.67ms med=214.77ms max=627.46ms p(90)=224.44ms p(95)=227.35ms p(99.9)=515.85ms
     http_reqs......................: 13994   172.891355/s
     iteration_duration.............: avg=216.13ms min=157.96ms med=215.13ms max=653.4ms  p(90)=224.81ms p(95)=227.76ms p(99.9)=551.14ms
     iterations.....................: 13894   171.655887/s
     success_rate...................: 100.00% ✓ 13894      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 38649      ✗ 0    
     data_received..................: 1.1 GB  15 MB/s
     data_sent......................: 15 MB   197 kB/s
     http_req_blocked...............: avg=29.9µs   min=1.16µs   med=2.56µs   max=11.94ms  p(90)=4.13µs   p(95)=5.39µs   p(99.9)=9.38ms  
     http_req_connecting............: avg=26.26µs  min=0s       med=0s       max=11.9ms   p(90)=0s       p(95)=0s       p(99.9)=9.34ms  
     http_req_duration..............: avg=232.68ms min=135.3ms  med=224.11ms max=690.22ms p(90)=247.38ms p(95)=261.3ms  p(99.9)=584.12ms
       { expected_response:true }...: avg=232.68ms min=135.3ms  med=224.11ms max=690.22ms p(90)=247.38ms p(95)=261.3ms  p(99.9)=584.12ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12983
     http_req_receiving.............: avg=84.22µs  min=25.06µs  med=44.05µs  max=40.05ms  p(90)=97.52µs  p(95)=197.76µs p(99.9)=2.18ms  
     http_req_sending...............: avg=117.48µs min=5.57µs   med=10.69µs  max=252.01ms p(90)=33.13µs  p(95)=124.02µs p(99.9)=6.08ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=232.48ms min=131.76ms med=224ms    max=689.53ms p(90)=247.19ms p(95)=260.75ms p(99.9)=582.86ms
     http_reqs......................: 12983   169.315518/s
     iteration_duration.............: avg=233.5ms  min=135.51ms med=224.43ms max=712.36ms p(90)=247.64ms p(95)=261.62ms p(99.9)=617.4ms 
     iterations.....................: 12883   168.011386/s
     success_rate...................: 100.00% ✓ 12883      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40326      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   195 kB/s
     http_req_blocked...............: avg=54.28µs  min=1.15µs   med=2.24µs   max=19.02ms  p(90)=4.1µs    p(95)=5.49µs   p(99.9)=15.9ms  
     http_req_connecting............: avg=50.48µs  min=0s       med=0s       max=18.69ms  p(90)=0s       p(95)=0s       p(99.9)=15.86ms 
     http_req_duration..............: avg=223.11ms min=120.38ms med=221.8ms  max=658.14ms p(90)=231.15ms p(95)=234.12ms p(99.9)=513.87ms
       { expected_response:true }...: avg=223.11ms min=120.38ms med=221.8ms  max=658.14ms p(90)=231.15ms p(95)=234.12ms p(99.9)=513.87ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13542
     http_req_receiving.............: avg=90.93µs  min=26.31µs  med=46.97µs  max=28.74ms  p(90)=103.58µs p(95)=268.23µs p(99.9)=5.28ms  
     http_req_sending...............: avg=116.41µs min=5.55µs   med=9.53µs   max=294.95ms p(90)=32.77µs  p(95)=108.01µs p(99.9)=8.67ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=222.9ms  min=116.22ms med=221.71ms max=644.89ms p(90)=230.98ms p(95)=233.93ms p(99.9)=512.07ms
     http_reqs......................: 13542   167.252492/s
     iteration_duration.............: avg=223.53ms min=120.55ms med=222.04ms max=692.29ms p(90)=231.35ms p(95)=234.31ms p(99.9)=555.59ms
     iterations.....................: 13442   166.017427/s
     success_rate...................: 100.00% ✓ 13442      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40164      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   193 kB/s
     http_req_blocked...............: avg=21.46µs  min=1.23µs   med=2.68µs   max=10.05ms  p(90)=4.07µs   p(95)=5.05µs   p(99.9)=7.09ms  
     http_req_connecting............: avg=17.72µs  min=0s       med=0s       max=10ms     p(90)=0s       p(95)=0s       p(99.9)=7.06ms  
     http_req_duration..............: avg=224.05ms min=161.48ms med=222.34ms max=621.37ms p(90)=242.35ms p(95)=248.57ms p(99.9)=511.36ms
       { expected_response:true }...: avg=224.05ms min=161.48ms med=222.34ms max=621.37ms p(90)=242.35ms p(95)=248.57ms p(99.9)=511.36ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13488
     http_req_receiving.............: avg=599.98µs min=30.4µs   med=71.3µs   max=35.82ms  p(90)=409.41µs p(95)=1.18ms   p(99.9)=26.73ms 
     http_req_sending...............: avg=125.64µs min=5.64µs   med=11.29µs  max=223.76ms p(90)=33.61µs  p(95)=124.84µs p(99.9)=10.8ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=223.32ms min=161.42ms med=221.69ms max=616.2ms  p(90)=241.66ms p(95)=247.96ms p(99.9)=502.52ms
     http_reqs......................: 13488   166.270096/s
     iteration_duration.............: avg=224.46ms min=161.7ms  med=222.7ms  max=645.74ms p(90)=242.63ms p(95)=248.88ms p(99.9)=538.35ms
     iterations.....................: 13388   165.03737/s
     success_rate...................: 100.00% ✓ 13388      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 37149      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 15 MB   190 kB/s
     http_req_blocked...............: avg=24.63µs  min=1.15µs   med=2.51µs   max=10.84ms  p(90)=4.08µs   p(95)=5.17µs   p(99.9)=8.25ms  
     http_req_connecting............: avg=21µs     min=0s       med=0s       max=10.8ms   p(90)=0s       p(95)=0s       p(99.9)=8.22ms  
     http_req_duration..............: avg=241.76ms min=160.42ms med=232.63ms max=877.64ms p(90)=264.99ms p(95)=284.38ms p(99.9)=736.89ms
       { expected_response:true }...: avg=241.76ms min=160.42ms med=232.63ms max=877.64ms p(90)=264.99ms p(95)=284.38ms p(99.9)=736.89ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12483
     http_req_receiving.............: avg=92.64µs  min=24.13µs  med=43.45µs  max=67.85ms  p(90)=97.53µs  p(95)=206.88µs p(99.9)=4.79ms  
     http_req_sending...............: avg=116.81µs min=5.39µs   med=10.54µs  max=212.81ms p(90)=31.89µs  p(95)=118.72µs p(99.9)=7.55ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=241.55ms min=160.15ms med=232.54ms max=876.12ms p(90)=264.82ms p(95)=284.21ms p(99.9)=735.65ms
     http_reqs......................: 12483   163.365685/s
     iteration_duration.............: avg=242.75ms min=175.2ms  med=233.07ms max=895.35ms p(90)=265.36ms p(95)=284.75ms p(99.9)=753.15ms
     iterations.....................: 12383   162.05698/s
     success_rate...................: 100.00% ✓ 12383      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 32919      ✗ 0    
     data_received..................: 972 MB  12 MB/s
     data_sent......................: 13 MB   158 kB/s
     http_req_blocked...............: avg=55.7µs   min=1.52µs   med=2.92µs   max=15.63ms  p(90)=4.41µs   p(95)=5.37µs   p(99.9)=13.51ms 
     http_req_connecting............: avg=50.56µs  min=0s       med=0s       max=15.55ms  p(90)=0s       p(95)=0s       p(99.9)=13.49ms 
     http_req_duration..............: avg=273.06ms min=141.2ms  med=273.82ms max=657.11ms p(90)=307.44ms p(95)=317.17ms p(99.9)=572.9ms 
       { expected_response:true }...: avg=273.06ms min=141.2ms  med=273.82ms max=657.11ms p(90)=307.44ms p(95)=317.17ms p(99.9)=572.9ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 11073
     http_req_receiving.............: avg=117.88µs min=32.2µs   med=54.43µs  max=14.65ms  p(90)=152.74µs p(95)=438.4µs  p(99.9)=4.83ms  
     http_req_sending...............: avg=129.29µs min=7.22µs   med=11.59µs  max=189.52ms p(90)=38.32µs  p(95)=140.03µs p(99.9)=5.37ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=272.81ms min=141.12ms med=273.59ms max=656.45ms p(90)=307.28ms p(95)=316.93ms p(99.9)=572.1ms 
     http_reqs......................: 11073   135.88316/s
     iteration_duration.............: avg=273.98ms min=141.42ms med=274.35ms max=707.76ms p(90)=307.89ms p(95)=317.61ms p(99.9)=630.81ms
     iterations.....................: 10973   134.656003/s
     success_rate...................: 100.00% ✓ 10973      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 30372      ✗ 0    
     data_received..................: 898 MB  11 MB/s
     data_sent......................: 12 MB   146 kB/s
     http_req_blocked...............: avg=31.91µs  min=1.36µs   med=3.64µs   max=11.42ms  p(90)=5.45µs   p(95)=6.32µs   p(99.9)=8.82ms  
     http_req_connecting............: avg=26.96µs  min=0s       med=0s       max=11.39ms  p(90)=0s       p(95)=0s       p(99.9)=8.78ms  
     http_req_duration..............: avg=295.88ms min=210.84ms med=293.9ms  max=831.53ms p(90)=317.05ms p(95)=323.95ms p(99.9)=726.7ms 
       { expected_response:true }...: avg=295.88ms min=210.84ms med=293.9ms  max=831.53ms p(90)=317.05ms p(95)=323.95ms p(99.9)=726.7ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 10224
     http_req_receiving.............: avg=88.68µs  min=29.1µs   med=68.77µs  max=6.4ms    p(90)=119.26µs p(95)=155.42µs p(99.9)=2.47ms  
     http_req_sending...............: avg=75.93µs  min=5.96µs   med=14.1µs   max=223.41ms p(90)=25.94µs  p(95)=43.56µs  p(99.9)=3.36ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=295.72ms min=210.75ms med=293.78ms max=830.31ms p(90)=316.92ms p(95)=323.85ms p(99.9)=725.51ms
     http_reqs......................: 10224   125.301298/s
     iteration_duration.............: avg=297.14ms min=219.55ms med=294.35ms max=870.58ms p(90)=317.39ms p(95)=324.29ms p(99.9)=750.34ms
     iterations.....................: 10124   124.075738/s
     success_rate...................: 100.00% ✓ 10124      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@ardatan ardatan merged commit e69af0d into main Sep 16, 2025
34 checks passed
@ardatan ardatan deleted the renovate/node-22.x branch September 16, 2025 23:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant