Skip to content

Conversation

renovate[bot]
Copy link
Contributor

@renovate renovate bot commented Sep 16, 2025

Coming soon: The Renovate bot (GitHub App) will be renamed to Mend. PRs from Renovate will soon appear from 'Mend'. Learn more here.

This PR contains the following updates:

Package Change Age Confidence
vega 6.1.2 -> 6.2.0 age confidence

Release Notes

vega/vega (vega)

v6.2.0

Compare Source


Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.


  • If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

@renovate renovate bot added the dependencies Pull requests that update a dependency file label Sep 16, 2025
Copy link

💻 Website Preview

The latest changes are available as preview in: https://e86d4636.federation-gateway-benchmark.pages.dev

Copy link

Overview for: constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1901 114565 total, 0 failed avg: 26ms, p95: 46ms
grafbase 1653 99752 total, 0 failed avg: 30ms, p95: 52ms
cosmo 658 39818 total, 0 failed avg: 75ms, p95: 110ms
apollo-router 392 23849 total, 0 failed avg: 126ms, p95: 164ms
hive-gateway 318 19537 total, 0 failed avg: 153ms, p95: 199ms
hive-gateway-bun 310 18959 total, 0 failed avg: 158ms, p95: 210ms
apollo-gateway 114 7003 total, 0 failed avg: 430ms, p95: 507ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 343395      ✗ 0     
     data_received..................: 10 GB   167 MB/s
     data_sent......................: 133 MB  2.2 MB/s
     http_req_blocked...............: avg=7.41µs   min=1.12µs  med=2.45µs  max=92.28ms  p(90)=3.54µs   p(95)=4.13µs   p(99.9)=74.71µs
     http_req_connecting............: avg=4.51µs   min=0s      med=0s      max=91.84ms  p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_duration..............: avg=25.99ms  min=1.86ms  med=23.67ms max=394.34ms p(90)=39.96ms  p(95)=46.17ms  p(99.9)=79.97ms
       { expected_response:true }...: avg=25.99ms  min=1.86ms  med=23.67ms max=394.34ms p(90)=39.96ms  p(95)=46.17ms  p(99.9)=79.97ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 114565
     http_req_receiving.............: avg=104.18µs min=22.65µs med=41.38µs max=35.48ms  p(90)=104.17µs p(95)=323.95µs p(99.9)=9.89ms 
     http_req_sending...............: avg=80.92µs  min=5.15µs  med=9.92µs  max=201.61ms p(90)=29.37µs  p(95)=117.87µs p(99.9)=10.17ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=25.8ms   min=1.82ms  med=23.53ms max=386.58ms p(90)=39.63ms  p(95)=45.84ms  p(99.9)=77.04ms
     http_reqs......................: 114565  1901.496582/s
     iteration_duration.............: avg=26.2ms   min=4.4ms   med=23.86ms max=456.82ms p(90)=40.15ms  p(95)=46.36ms  p(99.9)=80.6ms 
     iterations.....................: 114465  1899.836829/s
     success_rate...................: 100.00% ✓ 114465      ✗ 0     
     vus............................: 50      min=50        max=50  
     vus_max........................: 50      min=50        max=50  

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 298956      ✗ 0    
     data_received..................: 8.8 GB  145 MB/s
     data_sent......................: 116 MB  1.9 MB/s
     http_req_blocked...............: avg=5.99µs   min=1.15µs  med=2.97µs  max=9.22ms   p(90)=4.27µs   p(95)=5.45µs   p(99.9)=118.37µs
     http_req_connecting............: avg=2.33µs   min=0s      med=0s      max=9.18ms   p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_duration..............: avg=29.85ms  min=2.59ms  med=26.82ms max=459.07ms p(90)=45.4ms   p(95)=51.99ms  p(99.9)=87.04ms 
       { expected_response:true }...: avg=29.85ms  min=2.59ms  med=26.82ms max=459.07ms p(90)=45.4ms   p(95)=51.99ms  p(99.9)=87.04ms 
     http_req_failed................: 0.00%   ✓ 0           ✗ 99752
     http_req_receiving.............: avg=143.41µs min=25.64µs med=48.56µs max=277.39ms p(90)=152.58µs p(95)=396.56µs p(99.9)=13.98ms 
     http_req_sending...............: avg=100.31µs min=5.49µs  med=11.9µs  max=406.34ms p(90)=37.77µs  p(95)=137.01µs p(99.9)=13.19ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=29.6ms   min=2.55ms  med=26.66ms max=449.49ms p(90)=45ms     p(95)=51.49ms  p(99.9)=84.58ms 
     http_reqs......................: 99752   1653.145767/s
     iteration_duration.............: avg=30.09ms  min=7.52ms  med=27.05ms max=483.88ms p(90)=45.64ms  p(95)=52.21ms  p(99.9)=87.42ms 
     iterations.....................: 99652   1651.488511/s
     success_rate...................: 100.00% ✓ 99652       ✗ 0    
     vus............................: 50      min=50        max=50 
     vus_max........................: 50      min=50        max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 119154     ✗ 0    
     data_received..................: 3.5 GB  58 MB/s
     data_sent......................: 46 MB   766 kB/s
     http_req_blocked...............: avg=10.09µs  min=1.32µs  med=2.85µs  max=9.94ms   p(90)=4.13µs   p(95)=4.94µs   p(99.9)=2.33ms  
     http_req_connecting............: avg=6.49µs   min=0s      med=0s      max=9.9ms    p(90)=0s       p(95)=0s       p(99.9)=2.15ms  
     http_req_duration..............: avg=75.12ms  min=2.83ms  med=73.93ms max=512.46ms p(90)=101.74ms p(95)=110.13ms p(99.9)=302.08ms
       { expected_response:true }...: avg=75.12ms  min=2.83ms  med=73.93ms max=512.46ms p(90)=101.74ms p(95)=110.13ms p(99.9)=302.08ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 39818
     http_req_receiving.............: avg=172.99µs min=29.28µs med=77.05µs max=50.93ms  p(90)=156.71µs p(95)=382.5µs  p(99.9)=16ms    
     http_req_sending...............: avg=61.6µs   min=5.95µs  med=11.51µs max=377.32ms p(90)=29.11µs  p(95)=124.83µs p(99.9)=3.2ms   
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=74.89ms  min=2.75ms  med=73.74ms max=511.43ms p(90)=101.45ms p(95)=109.82ms p(99.9)=290.77ms
     http_reqs......................: 39818   658.778494/s
     iteration_duration.............: avg=75.56ms  min=6.41ms  med=74.22ms max=540.1ms  p(90)=101.98ms p(95)=110.37ms p(99.9)=315.09ms
     iterations.....................: 39718   657.12402/s
     success_rate...................: 100.00% ✓ 39718      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 71247      ✗ 0    
     data_received..................: 2.1 GB  34 MB/s
     data_sent......................: 28 MB   456 kB/s
     http_req_blocked...............: avg=12.8µs   min=1.88µs  med=2.78µs   max=9.08ms   p(90)=3.94µs   p(95)=4.6µs    p(99.9)=4.68ms  
     http_req_connecting............: avg=9.52µs   min=0s      med=0s       max=9.03ms   p(90)=0s       p(95)=0s       p(99.9)=4.65ms  
     http_req_duration..............: avg=125.71ms min=5.87ms  med=125.03ms max=578.71ms p(90)=154.62ms p(95)=164.15ms p(99.9)=408.36ms
       { expected_response:true }...: avg=125.71ms min=5.87ms  med=125.03ms max=578.71ms p(90)=154.62ms p(95)=164.15ms p(99.9)=408.36ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 23849
     http_req_receiving.............: avg=83.47µs  min=32.24µs med=50.05µs  max=304.72ms p(90)=94.34µs  p(95)=118.67µs p(99.9)=1.09ms  
     http_req_sending...............: avg=72.93µs  min=7.34µs  med=11.34µs  max=357.35ms p(90)=18.55µs  p(95)=32.56µs  p(99.9)=1.84ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=125.56ms min=5.83ms  med=124.94ms max=561.82ms p(90)=154.47ms p(95)=163.93ms p(99.9)=392.65ms
     http_reqs......................: 23849   392.430084/s
     iteration_duration.............: avg=126.48ms min=26.08ms med=125.33ms max=599.32ms p(90)=154.88ms p(95)=164.43ms p(99.9)=416.65ms
     iterations.....................: 23749   390.784606/s
     success_rate...................: 100.00% ✓ 23749      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 58311      ✗ 0    
     data_received..................: 1.7 GB  28 MB/s
     data_sent......................: 23 MB   370 kB/s
     http_req_blocked...............: avg=18.03µs  min=1.25µs  med=2.7µs    max=11.58ms  p(90)=4.32µs   p(95)=5.26µs   p(99.9)=6.72ms  
     http_req_connecting............: avg=14.38µs  min=0s      med=0s       max=11.54ms  p(90)=0s       p(95)=0s       p(99.9)=6.68ms  
     http_req_duration..............: avg=153.44ms min=6.7ms   med=142.84ms max=682.21ms p(90)=171.15ms p(95)=199.3ms  p(99.9)=511.62ms
       { expected_response:true }...: avg=153.44ms min=6.7ms   med=142.84ms max=682.21ms p(90)=171.15ms p(95)=199.3ms  p(99.9)=511.62ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 19537
     http_req_receiving.............: avg=101.07µs min=26.02µs med=44.15µs  max=250.45ms p(90)=99.15µs  p(95)=172.58µs p(99.9)=3.63ms  
     http_req_sending...............: avg=82.68µs  min=5.66µs  med=11.08µs  max=292ms    p(90)=32.36µs  p(95)=118.39µs p(99.9)=4.87ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=153.26ms min=6.64ms  med=142.71ms max=659.37ms p(90)=170.94ms p(95)=197.51ms p(99.9)=510.88ms
     http_reqs......................: 19537   318.373319/s
     iteration_duration.............: avg=154.59ms min=39.66ms med=143.18ms max=739.84ms p(90)=171.48ms p(95)=200.85ms p(99.9)=553.61ms
     iterations.....................: 19437   316.743727/s
     success_rate...................: 100.00% ✓ 19437      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 56577      ✗ 0    
     data_received..................: 1.7 GB  27 MB/s
     data_sent......................: 22 MB   362 kB/s
     http_req_blocked...............: avg=32.9µs   min=1.21µs  med=2.75µs   max=20.09ms  p(90)=4.45µs   p(95)=5.55µs   p(99.9)=11.52ms 
     http_req_connecting............: avg=28.71µs  min=0s      med=0s       max=19.96ms  p(90)=0s       p(95)=0s       p(99.9)=11.3ms  
     http_req_duration..............: avg=158.03ms min=7.41ms  med=146.82ms max=598.8ms  p(90)=175.83ms p(95)=210.49ms p(99.9)=523.1ms 
       { expected_response:true }...: avg=158.03ms min=7.41ms  med=146.82ms max=598.8ms  p(90)=175.83ms p(95)=210.49ms p(99.9)=523.1ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 18959
     http_req_receiving.............: avg=90.22µs  min=27.26µs med=45.73µs  max=25.11ms  p(90)=103.11µs p(95)=199.92µs p(99.9)=3.48ms  
     http_req_sending...............: avg=93.82µs  min=5.68µs  med=11.27µs  max=266.62ms p(90)=32.86µs  p(95)=123.13µs p(99.9)=5.7ms   
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=157.85ms min=7.36ms  med=146.7ms  max=598.11ms p(90)=175.58ms p(95)=209.89ms p(99.9)=523.02ms
     http_reqs......................: 18959   310.937664/s
     iteration_duration.............: avg=159.17ms min=50.25ms med=147.14ms max=648.82ms p(90)=176.2ms  p(95)=212.94ms p(99.9)=535.29ms
     iterations.....................: 18859   309.297611/s
     success_rate...................: 100.00% ✓ 18859      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 20709      ✗ 0   
     data_received..................: 615 MB  10 MB/s
     data_sent......................: 8.1 MB  133 kB/s
     http_req_blocked...............: avg=44.92µs  min=1.32µs   med=3.09µs   max=11.49ms  p(90)=4.56µs   p(95)=5.29µs   p(99.9)=9.95ms  
     http_req_connecting............: avg=40.17µs  min=0s       med=0s       max=11.46ms  p(90)=0s       p(95)=0s       p(99.9)=9.92ms  
     http_req_duration..............: avg=429.7ms  min=7.42ms   med=429.88ms max=817.26ms p(90)=489.26ms p(95)=507.32ms p(99.9)=720.37ms
       { expected_response:true }...: avg=429.7ms  min=7.42ms   med=429.88ms max=817.26ms p(90)=489.26ms p(95)=507.32ms p(99.9)=720.37ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 7003
     http_req_receiving.............: avg=95.26µs  min=30.19µs  med=52.5µs   max=175.86ms p(90)=94.49µs  p(95)=109.95µs p(99.9)=724.72µs
     http_req_sending...............: avg=106.58µs min=6.62µs   med=12.38µs  max=236.77ms p(90)=18.98µs  p(95)=22.99µs  p(99.9)=1.1ms   
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=429.5ms  min=7.34ms   med=429.79ms max=816.33ms p(90)=489ms    p(95)=507.13ms p(99.9)=694.09ms
     http_reqs......................: 7003    114.325248/s
     iteration_duration.............: avg=436.33ms min=158.02ms med=430.63ms max=853.8ms  p(90)=490.04ms p(95)=508.03ms p(99.9)=838.66ms
     iterations.....................: 6903    112.692729/s
     success_rate...................: 100.00% ✓ 6903       ✗ 0   
     vus............................: 48      min=48       max=50
     vus_max........................: 50      min=50       max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

Overview for: ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 500 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 2004 124705 total, 0 failed avg: 112ms, p95: 274ms
grafbase 1642 103820 total, 0 failed avg: 134ms, p95: 315ms
cosmo 697 44537 total, 0 failed avg: 315ms, p95: 701ms
apollo-router 374 25289 total, 0 failed avg: 558ms, p95: 1252ms ❌ 15 unexpected GraphQL errors
hive-gateway 270 18784 total, 0 failed avg: 746ms, p95: 1636ms
hive-gateway-bun 265 18292 total, 0 failed avg: 767ms, p95: 1656ms
apollo-gateway 156 10760 total, 0 failed avg: 1214ms, p95: 2621ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 371115      ✗ 0     
     data_received..................: 11 GB   176 MB/s
     data_sent......................: 145 MB  2.3 MB/s
     http_req_blocked...............: avg=375.48µs min=1.12µs  med=2.54µs   max=312.64ms p(90)=3.89µs   p(95)=4.6µs    p(99.9)=138.53ms
     http_req_connecting............: avg=372.23µs min=0s      med=0s       max=312.59ms p(90)=0s       p(95)=0s       p(99.9)=138.42ms
     http_req_duration..............: avg=111.54ms min=1.8ms   med=100.39ms max=424.64ms p(90)=229.81ms p(95)=273.73ms p(99.9)=368.42ms
       { expected_response:true }...: avg=111.54ms min=1.8ms   med=100.39ms max=424.64ms p(90)=229.81ms p(95)=273.73ms p(99.9)=368.42ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 124705
     http_req_receiving.............: avg=478µs    min=19.89µs med=40.78µs  max=143.27ms p(90)=196.21µs p(95)=389.79µs p(99.9)=69.31ms 
     http_req_sending...............: avg=342.86µs min=4.29µs  med=10.01µs  max=136.79ms p(90)=27.89µs  p(95)=126.09µs p(99.9)=59.96ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=110.71ms min=1.73ms  med=99.54ms  max=407.96ms p(90)=228.19ms p(95)=271.91ms p(99.9)=364.73ms
     http_reqs......................: 124705  2004.056244/s
     iteration_duration.............: avg=113.23ms min=1.94ms  med=101.77ms max=692.23ms p(90)=231.99ms p(95)=276.58ms p(99.9)=408.31ms
     iterations.....................: 123705  1987.985868/s
     success_rate...................: 100.00% ✓ 123705      ✗ 0     
     vus............................: 68      min=0         max=495 
     vus_max........................: 500     min=500       max=500 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 308460      ✗ 0     
     data_received..................: 9.1 GB  144 MB/s
     data_sent......................: 121 MB  1.9 MB/s
     http_req_blocked...............: avg=535.23µs min=1.21µs  med=3.02µs   max=365.54ms p(90)=4.52µs   p(95)=5.74µs   p(99.9)=185.91ms
     http_req_connecting............: avg=530.4µs  min=0s      med=0s       max=365.5ms  p(90)=0s       p(95)=0s       p(99.9)=185.83ms
     http_req_duration..............: avg=134.09ms min=2.47ms  med=121.5ms  max=494.79ms p(90)=269.64ms p(95)=315.4ms  p(99.9)=412.76ms
       { expected_response:true }...: avg=134.09ms min=2.47ms  med=121.5ms  max=494.79ms p(90)=269.64ms p(95)=315.4ms  p(99.9)=412.76ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 103820
     http_req_receiving.............: avg=570.74µs min=24.65µs med=47.3µs   max=146.01ms p(90)=186.78µs p(95)=444.39µs p(99.9)=83.6ms  
     http_req_sending...............: avg=452.19µs min=5.45µs  med=11.6µs   max=143.57ms p(90)=33.19µs  p(95)=140.52µs p(99.9)=75.61ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=133.06ms min=2.43ms  med=120.55ms max=451.03ms p(90)=267.16ms p(95)=313.22ms p(99.9)=406.7ms 
     http_reqs......................: 103820  1642.151839/s
     iteration_duration.............: avg=136.27ms min=2.81ms  med=123.12ms max=806.67ms p(90)=272.14ms p(95)=318.36ms p(99.9)=471.89ms
     iterations.....................: 102820  1626.334541/s
     success_rate...................: 100.00% ✓ 102820      ✗ 0     
     vus............................: 71      min=0         max=495 
     vus_max........................: 500     min=500       max=500 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 130611     ✗ 0    
     data_received..................: 3.9 GB  61 MB/s
     data_sent......................: 52 MB   812 kB/s
     http_req_blocked...............: avg=82.67µs  min=1.27µs  med=2.93µs   max=125.98ms p(90)=4.33µs   p(95)=6.04µs   p(99.9)=22.73ms
     http_req_connecting............: avg=77.62µs  min=0s      med=0s       max=125.79ms p(90)=0s       p(95)=0s       p(99.9)=22.68ms
     http_req_duration..............: avg=315.32ms min=2.81ms  med=293.95ms max=1.31s    p(90)=616.73ms p(95)=700.55ms p(99.9)=1.06s  
       { expected_response:true }...: avg=315.32ms min=2.81ms  med=293.95ms max=1.31s    p(90)=616.73ms p(95)=700.55ms p(99.9)=1.06s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 44537
     http_req_receiving.............: avg=635.43µs min=27.31µs med=62.38µs  max=203.53ms p(90)=202.33µs p(95)=483.16µs p(99.9)=103.3ms
     http_req_sending...............: avg=132.64µs min=5.51µs  med=11.25µs  max=133.18ms p(90)=30.84µs  p(95)=126.87µs p(99.9)=24.68ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=314.55ms min=2.75ms  med=293.44ms max=1.31s    p(90)=614.77ms p(95)=698.82ms p(99.9)=1.06s  
     http_reqs......................: 44537   697.605247/s
     iteration_duration.............: avg=322.98ms min=3.2ms   med=302.46ms max=1.31s    p(90)=620.79ms p(95)=703.64ms p(99.9)=1.06s  
     iterations.....................: 43537   681.941749/s
     success_rate...................: 100.00% ✓ 43537      ✗ 0    
     vus............................: 54      min=0        max=499
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  99% — ✓ 24274 / ✗ 15
     ✓ valid response structure

     checks.........................: 99.97% ✓ 72852      ✗ 15   
     data_received..................: 2.2 GB 33 MB/s
     data_sent......................: 30 MB  436 kB/s
     http_req_blocked...............: avg=59.13µs  min=1.54µs  med=3.27µs   max=122.51ms p(90)=5.49µs   p(95)=8.46µs   p(99.9)=15.54ms
     http_req_connecting............: avg=53.13µs  min=0s      med=0s       max=122.44ms p(90)=0s       p(95)=0s       p(99.9)=15.49ms
     http_req_duration..............: avg=558.1ms  min=6.18ms  med=522.61ms max=2.27s    p(90)=1.11s    p(95)=1.25s    p(99.9)=1.74s  
       { expected_response:true }...: avg=558.1ms  min=6.18ms  med=522.61ms max=2.27s    p(90)=1.11s    p(95)=1.25s    p(99.9)=1.74s  
     http_req_failed................: 0.00%  ✓ 0          ✗ 25289
     http_req_receiving.............: avg=101.9µs  min=30.32µs med=56.5µs   max=27.74ms  p(90)=113.04µs p(95)=171.97µs p(99.9)=4.51ms 
     http_req_sending...............: avg=78.21µs  min=6.04µs  med=12.25µs  max=72.87ms  p(90)=31.39µs  p(95)=112.57µs p(99.9)=12.59ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=557.92ms min=6.13ms  med=522.05ms max=2.27s    p(90)=1.11s    p(95)=1.25s    p(99.9)=1.74s  
     http_reqs......................: 25289  374.192208/s
     iteration_duration.............: avg=581.39ms min=6.45ms  med=551.64ms max=2.27s    p(90)=1.12s    p(95)=1.26s    p(99.9)=1.74s  
     iterations.....................: 24289  359.395569/s
     success_rate...................: 99.93% ✓ 24274      ✗ 15   
     vus............................: 92     min=0        max=500
     vus_max........................: 500    min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 53352      ✗ 0    
     data_received..................: 1.6 GB  24 MB/s
     data_sent......................: 22 MB   318 kB/s
     http_req_blocked...............: avg=69.2µs   min=1.34µs  med=2.74µs   max=80.17ms p(90)=4.71µs  p(95)=7.22µs   p(99.9)=16.78ms
     http_req_connecting............: avg=62.59µs  min=0s      med=0s       max=80.09ms p(90)=0s      p(95)=0s       p(99.9)=16.67ms
     http_req_duration..............: avg=746.07ms min=6.82ms  med=690.65ms max=4.61s   p(90)=1.49s   p(95)=1.63s    p(99.9)=3.91s  
       { expected_response:true }...: avg=746.07ms min=6.82ms  med=690.65ms max=4.61s   p(90)=1.49s   p(95)=1.63s    p(99.9)=3.91s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 18784
     http_req_receiving.............: avg=145.7µs  min=26.98µs med=43.96µs  max=88.03ms p(90)=91.11µs p(95)=145.28µs p(99.9)=16.04ms
     http_req_sending...............: avg=144.08µs min=5.43µs  med=10.8µs   max=93.42ms p(90)=28.7µs  p(95)=66.08µs  p(99.9)=25.6ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s      p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=745.78ms min=6.76ms  med=690.06ms max=4.61s   p(90)=1.49s   p(95)=1.63s    p(99.9)=3.91s  
     http_reqs......................: 18784   270.961141/s
     iteration_duration.............: avg=788.2ms  min=7.76ms  med=764.57ms max=4.63s   p(90)=1.51s   p(95)=1.65s    p(99.9)=3.92s  
     iterations.....................: 17784   256.536038/s
     success_rate...................: 100.00% ✓ 17784      ✗ 0    
     vus............................: 78      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 51876      ✗ 0    
     data_received..................: 1.6 GB  23 MB/s
     data_sent......................: 21 MB   311 kB/s
     http_req_blocked...............: avg=79.19µs  min=1.32µs  med=2.76µs   max=78.7ms  p(90)=4.54µs  p(95)=8.08µs   p(99.9)=21.85ms
     http_req_connecting............: avg=73.73µs  min=0s      med=0s       max=78.58ms p(90)=0s      p(95)=0s       p(99.9)=21.73ms
     http_req_duration..............: avg=766.53ms min=6.76ms  med=722.94ms max=4.8s    p(90)=1.46s   p(95)=1.65s    p(99.9)=4.15s  
       { expected_response:true }...: avg=766.53ms min=6.76ms  med=722.94ms max=4.8s    p(90)=1.46s   p(95)=1.65s    p(99.9)=4.15s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 18292
     http_req_receiving.............: avg=155.78µs min=26.85µs med=43.64µs  max=64.53ms p(90)=90.5µs  p(95)=191.06µs p(99.9)=20.82ms
     http_req_sending...............: avg=143.25µs min=5.88µs  med=10.83µs  max=70.28ms p(90)=30.56µs p(95)=111.74µs p(99.9)=27.36ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s      p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=766.23ms min=6.69ms  med=722.62ms max=4.8s    p(90)=1.46s   p(95)=1.65s    p(99.9)=4.15s  
     http_reqs......................: 18292   265.282612/s
     iteration_duration.............: avg=811.11ms min=8.03ms  med=776.63ms max=4.81s   p(90)=1.48s   p(95)=1.67s    p(99.9)=4.2s   
     iterations.....................: 17292   250.779954/s
     success_rate...................: 100.00% ✓ 17292      ✗ 0    
     vus............................: 60      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 29280      ✗ 0    
     data_received..................: 945 MB  14 MB/s
     data_sent......................: 13 MB   187 kB/s
     http_req_blocked...............: avg=31.07µs min=1.33µs  med=3.12µs  max=38.33ms p(90)=4.8µs   p(95)=11.64µs p(99.9)=4.7ms 
     http_req_connecting............: avg=25.22µs min=0s      med=0s      max=37.83ms p(90)=0s      p(95)=0s      p(99.9)=4.56ms
     http_req_duration..............: avg=1.21s   min=7.26ms  med=1.18s   max=15.51s  p(90)=2.22s   p(95)=2.62s   p(99.9)=14.27s
       { expected_response:true }...: avg=1.21s   min=7.26ms  med=1.18s   max=15.51s  p(90)=2.22s   p(95)=2.62s   p(99.9)=14.27s
     http_req_failed................: 0.00%   ✓ 0          ✗ 10760
     http_req_receiving.............: avg=75.49µs min=27.25µs med=49.86µs max=33.5ms  p(90)=91.71µs p(95)=115.3µs p(99.9)=2.8ms 
     http_req_sending...............: avg=44.68µs min=6.2µs   med=12.22µs max=33.42ms p(90)=25.26µs p(95)=43.57µs p(99.9)=7.53ms
     http_req_tls_handshaking.......: avg=0s      min=0s      med=0s      max=0s      p(90)=0s      p(95)=0s      p(99.9)=0s    
     http_req_waiting...............: avg=1.21s   min=7.22ms  med=1.18s   max=15.51s  p(90)=2.22s   p(95)=2.62s   p(99.9)=14.27s
     http_reqs......................: 10760   156.570221/s
     iteration_duration.............: avg=1.33s   min=7.79ms  med=1.3s    max=15.52s  p(90)=2.26s   p(95)=2.65s   p(99.9)=14.39s
     iterations.....................: 9760    142.019085/s
     success_rate...................: 100.00% ✓ 9760       ✗ 0    
     vus............................: 112     min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

Overview for: constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 172 14025 total, 0 failed avg: 216ms, p95: 226ms
hive-router 170 13795 total, 0 failed avg: 219ms, p95: 229ms
cosmo 167 13542 total, 0 failed avg: 223ms, p95: 245ms
hive-gateway-bun 165 12617 total, 0 failed avg: 239ms, p95: 262ms
hive-gateway 164 12594 total, 0 failed avg: 240ms, p95: 267ms
apollo-router 137 11190 total, 0 failed avg: 270ms, p95: 315ms
apollo-gateway 124 10196 total, 0 failed avg: 297ms, p95: 330ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41775      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   201 kB/s
     http_req_blocked...............: avg=18.81µs  min=1.2µs    med=1.95µs   max=9.04ms   p(90)=3.34µs   p(95)=4.82µs   p(99.9)=6.62ms  
     http_req_connecting............: avg=16.23µs  min=0s       med=0s       max=9.01ms   p(90)=0s       p(95)=0s       p(99.9)=6.6ms   
     http_req_duration..............: avg=215.66ms min=158.56ms med=214.88ms max=613.67ms p(90)=223.68ms p(95)=226.31ms p(99.9)=516.68ms
       { expected_response:true }...: avg=215.66ms min=158.56ms med=214.88ms max=613.67ms p(90)=223.68ms p(95)=226.31ms p(99.9)=516.68ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 14025
     http_req_receiving.............: avg=76.81µs  min=26.73µs  med=44.09µs  max=11.32ms  p(90)=93.77µs  p(95)=248.11µs p(99.9)=3.24ms  
     http_req_sending...............: avg=107.25µs min=5.4µs    med=8.68µs   max=378.08ms p(90)=29.46µs  p(95)=95.18µs  p(99.9)=6.75ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=215.48ms min=158.52ms med=214.79ms max=612.36ms p(90)=223.57ms p(95)=226.13ms p(99.9)=506.46ms
     http_reqs......................: 14025   172.948442/s
     iteration_duration.............: avg=215.92ms min=158.69ms med=215.1ms  max=629.08ms p(90)=223.86ms p(95)=226.49ms p(99.9)=524.11ms
     iterations.....................: 13925   171.715298/s
     success_rate...................: 100.00% ✓ 13925      ✗ 0    
     vus............................: 34      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41085      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   198 kB/s
     http_req_blocked...............: avg=43.05µs  min=1.15µs   med=2.03µs   max=14.73ms  p(90)=3.03µs   p(95)=4.11µs   p(99.9)=12.79ms 
     http_req_connecting............: avg=40.42µs  min=0s       med=0s       max=14.7ms   p(90)=0s       p(95)=0s       p(99.9)=12.75ms 
     http_req_duration..............: avg=219.34ms min=159.17ms med=218.46ms max=583.22ms p(90)=226.48ms p(95)=229.09ms p(99.9)=498.68ms
       { expected_response:true }...: avg=219.34ms min=159.17ms med=218.46ms max=583.22ms p(90)=226.48ms p(95)=229.09ms p(99.9)=498.68ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13795
     http_req_receiving.............: avg=74.45µs  min=23.93µs  med=40.99µs  max=12.11ms  p(90)=82.59µs  p(95)=241.75µs p(99.9)=3.36ms  
     http_req_sending...............: avg=94.31µs  min=5.51µs   med=8.55µs   max=361.11ms p(90)=27.62µs  p(95)=91.37µs  p(99.9)=5.9ms   
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=219.17ms min=157.35ms med=218.38ms max=580.53ms p(90)=226.39ms p(95)=228.92ms p(99.9)=468.47ms
     http_reqs......................: 13795   170.485167/s
     iteration_duration.............: avg=219.65ms min=159.28ms med=218.66ms max=601.21ms p(90)=226.67ms p(95)=229.26ms p(99.9)=521.9ms 
     iterations.....................: 13695   169.24932/s
     success_rate...................: 100.00% ✓ 13695      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40326      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   194 kB/s
     http_req_blocked...............: avg=43.14µs  min=1.27µs   med=2.82µs   max=18.32ms  p(90)=4.09µs   p(95)=5.04µs   p(99.9)=15.2ms  
     http_req_connecting............: avg=38.39µs  min=0s       med=0s       max=18.2ms   p(90)=0s       p(95)=0s       p(99.9)=14.59ms 
     http_req_duration..............: avg=222.99ms min=165.11ms med=221.87ms max=600.4ms  p(90)=239.43ms p(95)=244.94ms p(99.9)=496.24ms
       { expected_response:true }...: avg=222.99ms min=165.11ms med=221.87ms max=600.4ms  p(90)=239.43ms p(95)=244.94ms p(99.9)=496.24ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13542
     http_req_receiving.............: avg=459.33µs min=29.94µs  med=65.6µs   max=29.96ms  p(90)=363.93µs p(95)=804.22µs p(99.9)=25.62ms 
     http_req_sending...............: avg=107.44µs min=6.2µs    med=11.22µs  max=226.94ms p(90)=30.8µs   p(95)=119.55µs p(99.9)=3.86ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=222.42ms min=165.05ms med=221.34ms max=599.3ms  p(90)=238.77ms p(95)=244.3ms  p(99.9)=495.01ms
     http_reqs......................: 13542   167.185211/s
     iteration_duration.............: avg=223.41ms min=165.29ms med=222.19ms max=633.51ms p(90)=239.72ms p(95)=245.25ms p(99.9)=541.24ms
     iterations.....................: 13442   165.950643/s
     success_rate...................: 100.00% ✓ 13442      ✗ 0    
     vus............................: 9       min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 37551      ✗ 0    
     data_received..................: 1.1 GB  15 MB/s
     data_sent......................: 15 MB   192 kB/s
     http_req_blocked...............: avg=22.64µs  min=1.15µs   med=2.63µs   max=10.54ms  p(90)=4.08µs   p(95)=5.2µs    p(99.9)=7.08ms  
     http_req_connecting............: avg=19.29µs  min=0s       med=0s       max=10.51ms  p(90)=0s       p(95)=0s       p(99.9)=6.95ms  
     http_req_duration..............: avg=239.34ms min=132.21ms med=231.01ms max=689.86ms p(90)=251.57ms p(95)=262.26ms p(99.9)=688.06ms
       { expected_response:true }...: avg=239.34ms min=132.21ms med=231.01ms max=689.86ms p(90)=251.57ms p(95)=262.26ms p(99.9)=688.06ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12617
     http_req_receiving.............: avg=81.67µs  min=23.46µs  med=43.79µs  max=11.55ms  p(90)=95.86µs  p(95)=177.2µs  p(99.9)=3.14ms  
     http_req_sending...............: avg=116.54µs min=5.31µs   med=10.56µs  max=302.87ms p(90)=32.17µs  p(95)=118.49µs p(99.9)=12.03ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=239.14ms min=128.74ms med=230.92ms max=689.79ms p(90)=251.44ms p(95)=262ms    p(99.9)=688ms   
     http_reqs......................: 12617   165.191689/s
     iteration_duration.............: avg=240.23ms min=132.41ms med=231.32ms max=690.67ms p(90)=251.81ms p(95)=262.88ms p(99.9)=688.46ms
     iterations.....................: 12517   163.882411/s
     success_rate...................: 100.00% ✓ 12517      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 37482      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 15 MB   191 kB/s
     http_req_blocked...............: avg=29.55µs  min=1.2µs    med=2.7µs    max=12.81ms  p(90)=4.41µs   p(95)=5.79µs   p(99.9)=10.02ms 
     http_req_connecting............: avg=25.85µs  min=0s       med=0s       max=12.77ms  p(90)=0s       p(95)=0s       p(99.9)=9.98ms  
     http_req_duration..............: avg=239.63ms min=149.72ms med=232.02ms max=845.96ms p(90)=254.31ms p(95)=267.44ms p(99.9)=707.17ms
       { expected_response:true }...: avg=239.63ms min=149.72ms med=232.02ms max=845.96ms p(90)=254.31ms p(95)=267.44ms p(99.9)=707.17ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12594
     http_req_receiving.............: avg=93.85µs  min=25.88µs  med=47.32µs  max=144.99ms p(90)=102.86µs p(95)=166.29µs p(99.9)=2.68ms  
     http_req_sending...............: avg=66.35µs  min=5.12µs   med=11.03µs  max=301.95ms p(90)=32.99µs  p(95)=108.68µs p(99.9)=4.54ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=239.47ms min=149.67ms med=231.91ms max=845.52ms p(90)=254.2ms  p(95)=267.35ms p(99.9)=706.43ms
     http_reqs......................: 12594   164.359313/s
     iteration_duration.............: avg=240.6ms  min=149.91ms med=232.37ms max=867.57ms p(90)=254.57ms p(95)=267.75ms p(99.9)=740.64ms
     iterations.....................: 12494   163.054252/s
     success_rate...................: 100.00% ✓ 12494      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 33270      ✗ 0    
     data_received..................: 982 MB  12 MB/s
     data_sent......................: 13 MB   160 kB/s
     http_req_blocked...............: avg=23.12µs  min=1.34µs   med=2.87µs   max=8.07ms   p(90)=4.52µs   p(95)=5.56µs   p(99.9)=6.44ms  
     http_req_connecting............: avg=19.04µs  min=0s       med=0s       max=8.04ms   p(90)=0s       p(95)=0s       p(99.9)=6.42ms  
     http_req_duration..............: avg=269.97ms min=160.1ms  med=271.43ms max=717.96ms p(90)=305.18ms p(95)=314.99ms p(99.9)=614.93ms
       { expected_response:true }...: avg=269.97ms min=160.1ms  med=271.43ms max=717.96ms p(90)=305.18ms p(95)=314.99ms p(99.9)=614.93ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11190
     http_req_receiving.............: avg=147.98µs min=32.05µs  med=55.02µs  max=212.41ms p(90)=154.11µs p(95)=438.24µs p(99.9)=7.4ms   
     http_req_sending...............: avg=124.79µs min=6.72µs   med=11.51µs  max=243.51ms p(90)=40.93µs  p(95)=141.34µs p(99.9)=4.25ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=269.7ms  min=160.04ms med=271.2ms  max=700.2ms  p(90)=304.77ms p(95)=314.65ms p(99.9)=613.22ms
     http_reqs......................: 11190   137.12973/s
     iteration_duration.............: avg=270.89ms min=160.35ms med=272.04ms max=736.73ms p(90)=305.66ms p(95)=315.41ms p(99.9)=666.42ms
     iterations.....................: 11090   135.904263/s
     success_rate...................: 100.00% ✓ 11090      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 30288      ✗ 0    
     data_received..................: 896 MB  11 MB/s
     data_sent......................: 12 MB   145 kB/s
     http_req_blocked...............: avg=34.23µs  min=1.37µs   med=3.35µs   max=11.8ms   p(90)=4.99µs   p(95)=5.93µs   p(99.9)=9.66ms  
     http_req_connecting............: avg=29.12µs  min=0s       med=0s       max=11.72ms  p(90)=0s       p(95)=0s       p(99.9)=9.64ms  
     http_req_duration..............: avg=296.66ms min=210.35ms med=294.6ms  max=814.75ms p(90)=319.76ms p(95)=330.09ms p(99.9)=699.13ms
       { expected_response:true }...: avg=296.66ms min=210.35ms med=294.6ms  max=814.75ms p(90)=319.76ms p(95)=330.09ms p(99.9)=699.13ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10196
     http_req_receiving.............: avg=77.85µs  min=29.8µs   med=58.91µs  max=6.49ms   p(90)=106.64µs p(95)=129.53µs p(99.9)=2.14ms  
     http_req_sending...............: avg=81.9µs   min=6.51µs   med=12.97µs  max=238.93ms p(90)=22.43µs  p(95)=39.2µs   p(99.9)=4.41ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=296.5ms  min=210.28ms med=294.47ms max=813.98ms p(90)=319.6ms  p(95)=329.92ms p(99.9)=698.42ms
     http_reqs......................: 10196   124.964717/s
     iteration_duration.............: avg=297.87ms min=214.8ms  med=295.03ms max=840.64ms p(90)=320.19ms p(95)=330.68ms p(99.9)=719.73ms
     iterations.....................: 10096   123.739092/s
     success_rate...................: 100.00% ✓ 10096      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

Overview for: constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 171 13890 total, 0 failed avg: 217ms, p95: 229ms
hive-router 166 13494 total, 0 failed avg: 224ms, p95: 235ms
cosmo 156 12635 total, 0 failed avg: 239ms, p95: 266ms
hive-gateway 149 11431 total, 0 failed avg: 264ms, p95: 303ms
hive-gateway-bun 143 11043 total, 0 failed avg: 273ms, p95: 425ms
apollo-router 127 10330 total, 0 failed avg: 293ms, p95: 335ms
apollo-gateway 85 7005 total, 0 failed avg: 433ms, p95: 474ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41370      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   200 kB/s
     http_req_blocked...............: avg=46.62µs  min=1.27µs   med=2.07µs   max=16.99ms  p(90)=3.9µs    p(95)=5.49µs   p(99.9)=14.02ms 
     http_req_connecting............: avg=43.61µs  min=0s       med=0s       max=16.84ms  p(90)=0s       p(95)=0s       p(99.9)=13.92ms 
     http_req_duration..............: avg=217.29ms min=161.37ms med=216.5ms  max=595.97ms p(90)=226.02ms p(95)=228.92ms p(99.9)=496.72ms
       { expected_response:true }...: avg=217.29ms min=161.37ms med=216.5ms  max=595.97ms p(90)=226.02ms p(95)=228.92ms p(99.9)=496.72ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13890
     http_req_receiving.............: avg=86.47µs  min=26.1µs   med=48.02µs  max=12.78ms  p(90)=100.56µs p(95)=272.89µs p(99.9)=5.34ms  
     http_req_sending...............: avg=77.98µs  min=6.16µs   med=9.07µs   max=338.21ms p(90)=34.59µs  p(95)=97.99µs  p(99.9)=7.86ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=217.13ms min=159.86ms med=216.39ms max=593.75ms p(90)=225.86ms p(95)=228.75ms p(99.9)=489.04ms
     http_reqs......................: 13890   171.625137/s
     iteration_duration.............: avg=217.61ms min=161.49ms med=216.75ms max=617.22ms p(90)=226.23ms p(95)=229.1ms  p(99.9)=520.26ms
     iterations.....................: 13790   170.389535/s
     success_rate...................: 100.00% ✓ 13790      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40182      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   194 kB/s
     http_req_blocked...............: avg=19.44µs  min=1.16µs   med=2.24µs   max=8.93ms   p(90)=3.28µs   p(95)=4.55µs   p(99.9)=6.58ms  
     http_req_connecting............: avg=16.43µs  min=0s       med=0s       max=8.89ms   p(90)=0s       p(95)=0s       p(99.9)=6.56ms  
     http_req_duration..............: avg=224.3ms  min=161.68ms med=223.4ms  max=617.05ms p(90)=232.13ms p(95)=234.66ms p(99.9)=521.61ms
       { expected_response:true }...: avg=224.3ms  min=161.68ms med=223.4ms  max=617.05ms p(90)=232.13ms p(95)=234.66ms p(99.9)=521.61ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13494
     http_req_receiving.............: avg=76.24µs  min=26.62µs  med=45.31µs  max=5.84ms   p(90)=94.32µs  p(95)=262.55µs p(99.9)=1.39ms  
     http_req_sending...............: avg=94.38µs  min=5.57µs   med=9.45µs   max=327.9ms  p(90)=29.72µs  p(95)=99.91µs  p(99.9)=5.19ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=224.13ms min=161.62ms med=223.3ms  max=615.81ms p(90)=232.01ms p(95)=234.47ms p(99.9)=503.62ms
     http_reqs......................: 13494   166.553124/s
     iteration_duration.............: avg=224.64ms min=161.85ms med=223.64ms max=645.4ms  p(90)=232.33ms p(95)=234.83ms p(99.9)=535.02ms
     iterations.....................: 13394   165.318849/s
     success_rate...................: 100.00% ✓ 13394      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 37605      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 15 MB   182 kB/s
     http_req_blocked...............: avg=23.19µs  min=1.56µs  med=2.66µs   max=10.25ms  p(90)=3.89µs   p(95)=4.86µs   p(99.9)=7.62ms  
     http_req_connecting............: avg=19.86µs  min=0s      med=0s       max=10.03ms  p(90)=0s       p(95)=0s       p(99.9)=7.6ms   
     http_req_duration..............: avg=238.95ms min=81.35ms med=238.87ms max=635.91ms p(90)=259.7ms  p(95)=265.5ms  p(99.9)=527.68ms
       { expected_response:true }...: avg=238.95ms min=81.35ms med=238.87ms max=635.91ms p(90)=259.7ms  p(95)=265.5ms  p(99.9)=527.68ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12635
     http_req_receiving.............: avg=290.76µs min=33.02µs med=64.35µs  max=192.04ms p(90)=202.31µs p(95)=451.5µs  p(99.9)=28.01ms 
     http_req_sending...............: avg=110.73µs min=6.56µs  med=11.11µs  max=245.08ms p(90)=29.18µs  p(95)=123.68µs p(99.9)=11.98ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=238.55ms min=80.62ms med=238.57ms max=633.56ms p(90)=259.34ms p(95)=265.1ms  p(99.9)=517.79ms
     http_reqs......................: 12635   156.02516/s
     iteration_duration.............: avg=239.49ms min=81.59ms med=239.22ms max=646.99ms p(90)=259.99ms p(95)=265.73ms p(99.9)=559.14ms
     iterations.....................: 12535   154.790295/s
     success_rate...................: 100.00% ✓ 12535      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 33993      ✗ 0    
     data_received..................: 1.0 GB  13 MB/s
     data_sent......................: 13 MB   174 kB/s
     http_req_blocked...............: avg=29.89µs  min=1.17µs   med=2.56µs   max=11.53ms  p(90)=4.16µs   p(95)=5.53µs   p(99.9)=9.2ms   
     http_req_connecting............: avg=26.5µs   min=0s       med=0s       max=11.49ms  p(90)=0s       p(95)=0s       p(99.9)=9.17ms  
     http_req_duration..............: avg=263.88ms min=151.54ms med=255.65ms max=710.09ms p(90)=273.77ms p(95)=302.77ms p(99.9)=623ms   
       { expected_response:true }...: avg=263.88ms min=151.54ms med=255.65ms max=710.09ms p(90)=273.77ms p(95)=302.77ms p(99.9)=623ms   
     http_req_failed................: 0.00%   ✓ 0          ✗ 11431
     http_req_receiving.............: avg=88.61µs  min=26.02µs  med=45.78µs  max=12.73ms  p(90)=106.19µs p(95)=345.75µs p(99.9)=2.07ms  
     http_req_sending...............: avg=130.14µs min=5.39µs   med=10.65µs  max=219.12ms p(90)=35.28µs  p(95)=135.65µs p(99.9)=7.73ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=263.66ms min=150.67ms med=255.53ms max=709.07ms p(90)=273.4ms  p(95)=302.17ms p(99.9)=622.08ms
     http_reqs......................: 11431   149.557642/s
     iteration_duration.............: avg=265.12ms min=151.84ms med=255.98ms max=733.94ms p(90)=274.2ms  p(95)=306.47ms p(99.9)=668.4ms 
     iterations.....................: 11331   148.249291/s
     success_rate...................: 100.00% ✓ 11331      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 32829      ✗ 0    
     data_received..................: 970 MB  13 MB/s
     data_sent......................: 13 MB   167 kB/s
     http_req_blocked...............: avg=33.94µs  min=1.24µs   med=2.86µs   max=12.52ms  p(90)=4.67µs   p(95)=6.26µs   p(99.9)=10.14ms 
     http_req_connecting............: avg=30.18µs  min=0s       med=0s       max=12.49ms  p(90)=0s       p(95)=0s       p(99.9)=10.13ms 
     http_req_duration..............: avg=273.49ms min=160.47ms med=262.39ms max=763.4ms  p(90)=284.33ms p(95)=424.71ms p(99.9)=641.2ms 
       { expected_response:true }...: avg=273.49ms min=160.47ms med=262.39ms max=763.4ms  p(90)=284.33ms p(95)=424.71ms p(99.9)=641.2ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 11043
     http_req_receiving.............: avg=116.76µs min=26.99µs  med=52.47µs  max=139.72ms p(90)=120.79µs p(95)=391.25µs p(99.9)=5.69ms  
     http_req_sending...............: avg=112.99µs min=5.67µs   med=11.46µs  max=313.13ms p(90)=36.89µs  p(95)=147.97µs p(99.9)=6.53ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=273.26ms min=160.34ms med=262.23ms max=762.54ms p(90)=284.1ms  p(95)=424.21ms p(99.9)=639.85ms
     http_reqs......................: 11043   143.951083/s
     iteration_duration.............: avg=274.91ms min=173.19ms med=262.69ms max=794.61ms p(90)=284.67ms p(95)=426.35ms p(99.9)=689.86ms
     iterations.....................: 10943   142.647532/s
     success_rate...................: 100.00% ✓ 10943      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 30690      ✗ 0    
     data_received..................: 906 MB  11 MB/s
     data_sent......................: 12 MB   148 kB/s
     http_req_blocked...............: avg=25.48µs  min=1.73µs   med=2.66µs   max=9.24ms   p(90)=3.87µs   p(95)=4.6µs    p(99.9)=7.34ms  
     http_req_connecting............: avg=22.24µs  min=0s       med=0s       max=9.2ms    p(90)=0s       p(95)=0s       p(99.9)=7.32ms  
     http_req_duration..............: avg=292.65ms min=165.05ms med=293.9ms  max=695.67ms p(90)=326.73ms p(95)=334.78ms p(99.9)=615.79ms
       { expected_response:true }...: avg=292.65ms min=165.05ms med=293.9ms  max=695.67ms p(90)=326.73ms p(95)=334.78ms p(99.9)=615.79ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10330
     http_req_receiving.............: avg=103.38µs min=33.7µs   med=49.57µs  max=162.87ms p(90)=98.95µs  p(95)=217.67µs p(99.9)=1.3ms   
     http_req_sending...............: avg=119.61µs min=7.32µs   med=10.77µs  max=192.49ms p(90)=22.21µs  p(95)=133.1µs  p(99.9)=2.71ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=292.42ms min=164.99ms med=293.76ms max=678.5ms  p(90)=326.54ms p(95)=334.58ms p(99.9)=614.85ms
     http_reqs......................: 10330   127.068648/s
     iteration_duration.............: avg=293.73ms min=165.24ms med=294.36ms max=723.92ms p(90)=327.07ms p(95)=335.14ms p(99.9)=634.69ms
     iterations.....................: 10230   125.838554/s
     success_rate...................: 100.00% ✓ 10230      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 20715     ✗ 0   
     data_received..................: 615 MB  7.5 MB/s
     data_sent......................: 8.1 MB  100 kB/s
     http_req_blocked...............: avg=44.55µs  min=1.44µs   med=3.05µs   max=11.48ms  p(90)=4.65µs   p(95)=5.55µs   p(99.9)=10.04ms 
     http_req_connecting............: avg=40.94µs  min=0s       med=0s       max=11.42ms  p(90)=0s       p(95)=0s       p(99.9)=10.01ms 
     http_req_duration..............: avg=432.9ms  min=211.03ms med=435.77ms max=914.96ms p(90)=463.13ms p(95)=474.39ms p(99.9)=869.25ms
       { expected_response:true }...: avg=432.9ms  min=211.03ms med=435.77ms max=914.96ms p(90)=463.13ms p(95)=474.39ms p(99.9)=869.25ms
     http_req_failed................: 0.00%   ✓ 0         ✗ 7005
     http_req_receiving.............: avg=62.99µs  min=31.25µs  med=53.03µs  max=1.21ms   p(90)=93.39µs  p(95)=110.62µs p(99.9)=436.15µs
     http_req_sending...............: avg=33.22µs  min=6.46µs   med=12.26µs  max=24.2ms   p(90)=19.39µs  p(95)=25.18µs  p(99.9)=3.53ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=432.81ms min=210.95ms med=435.7ms  max=914ms    p(90)=463.05ms p(95)=474.3ms  p(99.9)=868.32ms
     http_reqs......................: 7005    85.624641/s
     iteration_duration.............: avg=436.61ms min=278.57ms med=436.22ms max=961.49ms p(90)=463.66ms p(95)=474.74ms p(99.9)=908.55ms
     iterations.....................: 6905    84.402305/s
     success_rate...................: 100.00% ✓ 6905      ✗ 0   
     vus............................: 50      min=0       max=50
     vus_max........................: 50      min=50      max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@ardatan ardatan merged commit b4eca45 into main Sep 16, 2025
34 checks passed
@ardatan ardatan deleted the renovate/vega-6.x branch September 16, 2025 23:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant