Skip to content

Conversation

renovate[bot]
Copy link
Contributor

@renovate renovate bot commented Sep 28, 2025

Coming soon: The Renovate bot (GitHub App) will be renamed to Mend. PRs from Renovate will soon appear from 'Mend'. Learn more here.

This PR contains the following updates:

Package Change Age Confidence
bun (source) 1.2.22 -> 1.2.23 age confidence

Release Notes

oven-sh/bun (bun)

v1.2.23: Bun v1.2.23

Compare Source

To install Bun v1.2.23

curl -fsSL https://bun.sh/install | bash

### or you can use npm
### npm install -g bun

Windows:

powershell -c "irm bun.sh/install.ps1|iex"

To upgrade to Bun v1.2.23:

bun upgrade
Read Bun v1.2.23's release notes on Bun's blog
Thanks to 16 contributors!

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.


  • If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

@renovate renovate bot added the dependencies Pull requests that update a dependency file label Sep 28, 2025
Copy link

💻 Website Preview

The latest changes are available as preview in: https://e4121bc9.federation-gateway-benchmark.pages.dev

Copy link

Overview for: constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1793 108079 total, 0 failed avg: 28ms, p95: 50ms
grafbase 1627 98223 total, 0 failed avg: 30ms, p95: 53ms
cosmo 705 42577 total, 0 failed avg: 70ms, p95: 104ms
apollo-router 372 22635 total, 0 failed avg: 132ms, p95: 171ms
hive-gateway-bun 306 18684 total, 0 failed avg: 160ms, p95: 214ms
hive-gateway 299 18336 total, 0 failed avg: 164ms, p95: 215ms
apollo-gateway 118 7267 total, 0 failed avg: 414ms, p95: 487ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 323937      ✗ 0     
     data_received..................: 9.5 GB  157 MB/s
     data_sent......................: 126 MB  2.1 MB/s
     http_req_blocked...............: avg=5.29µs   min=1.21µs  med=2.57µs  max=9.56ms   p(90)=3.75µs   p(95)=4.42µs   p(99.9)=38.74µs
     http_req_connecting............: avg=2.26µs   min=0s      med=0s      max=9.52ms   p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_duration..............: avg=27.51ms  min=1.92ms  med=24.74ms max=449.87ms p(90)=43.41ms  p(95)=49.98ms  p(99.9)=91.47ms
       { expected_response:true }...: avg=27.51ms  min=1.92ms  med=24.74ms max=449.87ms p(90)=43.41ms  p(95)=49.98ms  p(99.9)=91.47ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 108079
     http_req_receiving.............: avg=128.88µs min=24.54µs med=43.08µs max=255.23ms p(90)=110.09µs p(95)=356.4µs  p(99.9)=14.34ms
     http_req_sending...............: avg=105.9µs  min=5.14µs  med=10.15µs max=303.36ms p(90)=30.63µs  p(95)=128.56µs p(99.9)=15.12ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=27.27ms  min=1.88ms  med=24.57ms max=448.58ms p(90)=42.99ms  p(95)=49.47ms  p(99.9)=87.21ms
     http_reqs......................: 108079  1793.886348/s
     iteration_duration.............: avg=27.77ms  min=4.07ms  med=24.99ms max=461.26ms p(90)=43.65ms  p(95)=50.23ms  p(99.9)=91.83ms
     iterations.....................: 107979  1792.226556/s
     success_rate...................: 100.00% ✓ 107979      ✗ 0     
     vus............................: 50      min=50        max=50  
     vus_max........................: 50      min=50        max=50  

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 294369      ✗ 0    
     data_received..................: 8.6 GB  143 MB/s
     data_sent......................: 114 MB  1.9 MB/s
     http_req_blocked...............: avg=6.25µs   min=1.17µs  med=2.95µs  max=10.34ms  p(90)=4.04µs   p(95)=4.64µs   p(99.9)=113.25µs
     http_req_connecting............: avg=2.72µs   min=0s      med=0s      max=10.3ms   p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_duration..............: avg=30.25ms  min=2.95ms  med=27.08ms max=499.08ms p(90)=46.38ms  p(95)=53.05ms  p(99.9)=93.11ms 
       { expected_response:true }...: avg=30.25ms  min=2.95ms  med=27.08ms max=499.08ms p(90)=46.38ms  p(95)=53.05ms  p(99.9)=93.11ms 
     http_req_failed................: 0.00%   ✓ 0           ✗ 98223
     http_req_receiving.............: avg=147.31µs min=25.57µs med=45.49µs max=44.41ms  p(90)=132.05µs p(95)=379.55µs p(99.9)=16.82ms 
     http_req_sending...............: avg=116.15µs min=5.31µs  med=11.31µs max=284.26ms p(90)=35.8µs   p(95)=133.21µs p(99.9)=18.48ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=29.99ms  min=2.9ms   med=26.89ms max=498.12ms p(90)=45.91ms  p(95)=52.53ms  p(99.9)=91.89ms 
     http_reqs......................: 98223   1627.054721/s
     iteration_duration.............: avg=30.56ms  min=6.16ms  med=27.36ms max=514.32ms p(90)=46.67ms  p(95)=53.33ms  p(99.9)=94.21ms 
     iterations.....................: 98123   1625.39823/s
     success_rate...................: 100.00% ✓ 98123       ✗ 0    
     vus............................: 50      min=50        max=50 
     vus_max........................: 50      min=50        max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 127431     ✗ 0    
     data_received..................: 3.7 GB  62 MB/s
     data_sent......................: 50 MB   820 kB/s
     http_req_blocked...............: avg=8.86µs   min=1.24µs  med=2.77µs  max=9.24ms   p(90)=3.79µs   p(95)=4.52µs   p(99.9)=1.19ms  
     http_req_connecting............: avg=5.42µs   min=0s      med=0s      max=9.21ms   p(90)=0s       p(95)=0s       p(99.9)=1.17ms  
     http_req_duration..............: avg=70.16ms  min=2.79ms  med=68.89ms max=493.68ms p(90)=95.47ms  p(95)=103.53ms p(99.9)=285.54ms
       { expected_response:true }...: avg=70.16ms  min=2.79ms  med=68.89ms max=493.68ms p(90)=95.47ms  p(95)=103.53ms p(99.9)=285.54ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 42577
     http_req_receiving.............: avg=156.72µs min=26.27µs med=70µs    max=38.4ms   p(90)=141.02µs p(95)=376.66µs p(99.9)=14.56ms 
     http_req_sending...............: avg=75.32µs  min=5.66µs  med=10.96µs max=242.03ms p(90)=28.84µs  p(95)=121.37µs p(99.9)=4.2ms   
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=69.93ms  min=2.73ms  med=68.68ms max=492.7ms  p(90)=95.23ms  p(95)=103.27ms p(99.9)=276.07ms
     http_reqs......................: 42577   705.056049/s
     iteration_duration.............: avg=70.62ms  min=5.84ms  med=69.23ms max=513.65ms p(90)=95.76ms  p(95)=103.86ms p(99.9)=295.49ms
     iterations.....................: 42477   703.400093/s
     success_rate...................: 100.00% ✓ 42477      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 67605      ✗ 0    
     data_received..................: 2.0 GB  33 MB/s
     data_sent......................: 26 MB   433 kB/s
     http_req_blocked...............: avg=14.19µs  min=1.81µs  med=2.98µs   max=10.51ms  p(90)=4.58µs   p(95)=5.31µs   p(99.9)=4.7ms   
     http_req_connecting............: avg=10.36µs  min=0s      med=0s       max=10.46ms  p(90)=0s       p(95)=0s       p(99.9)=4.67ms  
     http_req_duration..............: avg=132.36ms min=6.01ms  med=131.31ms max=606.29ms p(90)=162.06ms p(95)=171.11ms p(99.9)=421.59ms
       { expected_response:true }...: avg=132.36ms min=6.01ms  med=131.31ms max=606.29ms p(90)=162.06ms p(95)=171.11ms p(99.9)=421.59ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 22635
     http_req_receiving.............: avg=83.75µs  min=37.99µs med=54.61µs  max=132.76ms p(90)=102.96µs p(95)=130.1µs  p(99.9)=1.53ms  
     http_req_sending...............: avg=88.98µs  min=7.9µs   med=11.85µs  max=423.39ms p(90)=20.35µs  p(95)=37.22µs  p(99.9)=2.19ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=132.19ms min=5.96ms  med=131.2ms  max=593.6ms  p(90)=161.93ms p(95)=170.92ms p(99.9)=416.71ms
     http_reqs......................: 22635   372.279201/s
     iteration_duration.............: avg=133.25ms min=29.49ms med=131.7ms  max=626.39ms p(90)=162.44ms p(95)=171.48ms p(99.9)=448.99ms
     iterations.....................: 22535   370.634495/s
     success_rate...................: 100.00% ✓ 22535      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 55752      ✗ 0    
     data_received..................: 1.6 GB  27 MB/s
     data_sent......................: 22 MB   357 kB/s
     http_req_blocked...............: avg=18.66µs  min=1.21µs  med=2.7µs    max=11.04ms  p(90)=4.39µs   p(95)=5.46µs   p(99.9)=7.04ms  
     http_req_connecting............: avg=14.97µs  min=0s      med=0s       max=11.01ms  p(90)=0s       p(95)=0s       p(99.9)=7.01ms  
     http_req_duration..............: avg=160.28ms min=6.81ms  med=148.43ms max=620.11ms p(90)=178.95ms p(95)=213.97ms p(99.9)=502.65ms
       { expected_response:true }...: avg=160.28ms min=6.81ms  med=148.43ms max=620.11ms p(90)=178.95ms p(95)=213.97ms p(99.9)=502.65ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 18684
     http_req_receiving.............: avg=97.46µs  min=26.83µs med=45.01µs  max=19.26ms  p(90)=103.89µs p(95)=238.81µs p(99.9)=4.75ms  
     http_req_sending...............: avg=66.59µs  min=5.55µs  med=10.91µs  max=166.98ms p(90)=31.57µs  p(95)=124.97µs p(99.9)=4.28ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=160.11ms min=6.72ms  med=148.29ms max=618.72ms p(90)=178.74ms p(95)=213.56ms p(99.9)=501.66ms
     http_reqs......................: 18684   306.61999/s
     iteration_duration.............: avg=161.54ms min=44.58ms med=148.83ms max=666.69ms p(90)=179.44ms p(95)=215.39ms p(99.9)=519.17ms
     iterations.....................: 18584   304.978906/s
     success_rate...................: 100.00% ✓ 18584      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 54708      ✗ 0    
     data_received..................: 1.6 GB  26 MB/s
     data_sent......................: 21 MB   348 kB/s
     http_req_blocked...............: avg=19.83µs  min=1.21µs  med=2.86µs   max=11.9ms   p(90)=4.69µs   p(95)=5.94µs   p(99.9)=7.25ms  
     http_req_connecting............: avg=15.81µs  min=0s      med=0s       max=11.86ms  p(90)=0s       p(95)=0s       p(99.9)=7.21ms  
     http_req_duration..............: avg=163.53ms min=7.01ms  med=150.77ms max=961.69ms p(90)=184.79ms p(95)=215.22ms p(99.9)=898.47ms
       { expected_response:true }...: avg=163.53ms min=7.01ms  med=150.77ms max=961.69ms p(90)=184.79ms p(95)=215.22ms p(99.9)=898.47ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 18336
     http_req_receiving.............: avg=102.72µs min=26.92µs med=49.15µs  max=80.12ms  p(90)=109.96µs p(95)=245.99µs p(99.9)=4.7ms   
     http_req_sending...............: avg=100.1µs  min=5.89µs  med=11.38µs  max=226.07ms p(90)=32.72µs  p(95)=132.27µs p(99.9)=6.27ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=163.33ms min=6.95ms  med=150.62ms max=961.63ms p(90)=184.6ms  p(95)=214.61ms p(99.9)=898.41ms
     http_reqs......................: 18336   299.589228/s
     iteration_duration.............: avg=164.82ms min=25.84ms med=151.21ms max=961.93ms p(90)=185.31ms p(95)=216.22ms p(99.9)=900.73ms
     iterations.....................: 18236   297.955343/s
     success_rate...................: 100.00% ✓ 18236      ✗ 0    
     vus............................: 38      min=38       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 21501      ✗ 0   
     data_received..................: 638 MB  10 MB/s
     data_sent......................: 8.5 MB  138 kB/s
     http_req_blocked...............: avg=45.25µs  min=1.31µs   med=2.88µs   max=11.89ms  p(90)=4.48µs   p(95)=5.17µs   p(99.9)=10.29ms 
     http_req_connecting............: avg=41.76µs  min=0s       med=0s       max=11.86ms  p(90)=0s       p(95)=0s       p(99.9)=10.26ms 
     http_req_duration..............: avg=414.08ms min=7.43ms   med=413.84ms max=762.81ms p(90)=468.15ms p(95)=486.58ms p(99.9)=712.62ms
       { expected_response:true }...: avg=414.08ms min=7.43ms   med=413.84ms max=762.81ms p(90)=468.15ms p(95)=486.58ms p(99.9)=712.62ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 7267
     http_req_receiving.............: avg=61.59µs  min=29.59µs  med=49.24µs  max=6.36ms   p(90)=93.76µs  p(95)=106.88µs p(99.9)=432.34µs
     http_req_sending...............: avg=78.89µs  min=6.19µs   med=11.9µs   max=226.33ms p(90)=19.46µs  p(95)=23.51µs  p(99.9)=2.11ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=413.94ms min=7.38ms   med=413.74ms max=755.78ms p(90)=468.08ms p(95)=486.43ms p(99.9)=711.73ms
     http_reqs......................: 7267    118.726913/s
     iteration_duration.............: avg=420.19ms min=169.02ms med=414.55ms max=792.13ms p(90)=468.98ms p(95)=487.8ms  p(99.9)=748.9ms 
     iterations.....................: 7167    117.093131/s
     success_rate...................: 100.00% ✓ 7167       ✗ 0   
     vus............................: 41      min=41       max=50
     vus_max........................: 50      min=50       max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

Overview for: ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 500 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1844 114671 total, 0 failed avg: 121ms, p95: 290ms
grafbase 1549 98006 total, 0 failed avg: 142ms, p95: 333ms
cosmo 701 44731 total, 0 failed avg: 314ms, p95: 694ms
apollo-router 390 26168 total, 0 failed avg: 538ms, p95: 1208ms ❌ 20 unexpected GraphQL errors
hive-gateway-bun 260 18192 total, 0 failed avg: 771ms, p95: 1703ms
hive-gateway 259 17919 total, 0 failed avg: 782ms, p95: 1747ms
apollo-gateway 154 10598 total, 0 failed avg: 1226ms, p95: 2671ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 341013      ✗ 0     
     data_received..................: 10 GB   162 MB/s
     data_sent......................: 133 MB  2.1 MB/s
     http_req_blocked...............: avg=504.42µs min=1.15µs  med=2.53µs   max=369.09ms p(90)=3.92µs   p(95)=4.57µs   p(99.9)=183.25ms
     http_req_connecting............: avg=501.19µs min=0s      med=0s       max=369.04ms p(90)=0s       p(95)=0s       p(99.9)=183.17ms
     http_req_duration..............: avg=121.37ms min=1.79ms  med=111.56ms max=441.47ms p(90)=243.25ms p(95)=289.55ms p(99.9)=376.93ms
       { expected_response:true }...: avg=121.37ms min=1.79ms  med=111.56ms max=441.47ms p(90)=243.25ms p(95)=289.55ms p(99.9)=376.93ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 114671
     http_req_receiving.............: avg=523.84µs min=22.94µs med=41.1µs   max=133.07ms p(90)=93.69µs  p(95)=388.06µs p(99.9)=73.04ms 
     http_req_sending...............: avg=450µs    min=4.92µs  med=10.09µs  max=131.97ms p(90)=24.28µs  p(95)=126.21µs p(99.9)=68.9ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=120.4ms  min=1.75ms  med=110.54ms max=406.63ms p(90)=241.16ms p(95)=287.72ms p(99.9)=373.83ms
     http_reqs......................: 114671  1844.327589/s
     iteration_duration.............: avg=123.25ms min=1.93ms  med=112.93ms max=791.02ms p(90)=245.61ms p(95)=292.23ms p(99.9)=422.29ms
     iterations.....................: 113671  1828.243945/s
     success_rate...................: 100.00% ✓ 113671      ✗ 0     
     vus............................: 69      min=0         max=496 
     vus_max........................: 500     min=500       max=500 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 291018      ✗ 0    
     data_received..................: 8.6 GB  136 MB/s
     data_sent......................: 114 MB  1.8 MB/s
     http_req_blocked...............: avg=688.27µs min=1.19µs  med=3µs      max=397.9ms  p(90)=4.36µs   p(95)=5.42µs   p(99.9)=217.8ms 
     http_req_connecting............: avg=682.36µs min=0s      med=0s       max=397.86ms p(90)=0s       p(95)=0s       p(99.9)=216.33ms
     http_req_duration..............: avg=141.94ms min=2.53ms  med=130.04ms max=470.75ms p(90)=284.29ms p(95)=333.07ms p(99.9)=426.73ms
       { expected_response:true }...: avg=141.94ms min=2.53ms  med=130.04ms max=470.75ms p(90)=284.29ms p(95)=333.07ms p(99.9)=426.73ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 98006
     http_req_receiving.............: avg=647.07µs min=23.92µs med=47.24µs  max=144.63ms p(90)=102.83µs p(95)=428.14µs p(99.9)=88.3ms  
     http_req_sending...............: avg=589.34µs min=5.15µs  med=11.63µs  max=152.86ms p(90)=28.91µs  p(95)=137.44µs p(99.9)=83.48ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=140.7ms  min=2.49ms  med=128.54ms max=454.66ms p(90)=281.83ms p(95)=330.53ms p(99.9)=421.4ms 
     http_reqs......................: 98006   1549.545394/s
     iteration_duration.............: avg=144.46ms min=2.76ms  med=132.17ms max=888.84ms p(90)=287.25ms p(95)=336.24ms p(99.9)=529.45ms
     iterations.....................: 97006   1533.734674/s
     success_rate...................: 100.00% ✓ 97006       ✗ 0    
     vus............................: 74      min=0         max=494
     vus_max........................: 500     min=500       max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 131193     ✗ 0    
     data_received..................: 3.9 GB  62 MB/s
     data_sent......................: 52 MB   817 kB/s
     http_req_blocked...............: avg=140.65µs min=1.28µs  med=2.82µs   max=161.79ms p(90)=4.14µs   p(95)=5.59µs   p(99.9)=50.49ms
     http_req_connecting............: avg=136.24µs min=0s      med=0s       max=161.7ms  p(90)=0s       p(95)=0s       p(99.9)=50.44ms
     http_req_duration..............: avg=313.76ms min=2.82ms  med=295.94ms max=1.2s     p(90)=618.87ms p(95)=694.3ms  p(99.9)=1.05s  
       { expected_response:true }...: avg=313.76ms min=2.82ms  med=295.94ms max=1.2s     p(90)=618.87ms p(95)=694.3ms  p(99.9)=1.05s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 44731
     http_req_receiving.............: avg=481.4µs  min=25.07µs med=58.36µs  max=155.48ms p(90)=242.58µs p(95)=496.83µs p(99.9)=72.71ms
     http_req_sending...............: avg=226.93µs min=5.59µs  med=11.14µs  max=123.92ms p(90)=33.41µs  p(95)=133µs    p(99.9)=47.33ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=313.05ms min=2.74ms  med=295.18ms max=1.2s     p(90)=617.62ms p(95)=693.3ms  p(99.9)=1.04s  
     http_reqs......................: 44731   701.652442/s
     iteration_duration.............: avg=321.53ms min=3.04ms  med=304.09ms max=1.2s     p(90)=622.04ms p(95)=697.37ms p(99.9)=1.05s  
     iterations.....................: 43731   685.966398/s
     success_rate...................: 100.00% ✓ 43731      ✗ 0    
     vus............................: 96      min=0        max=499
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  99% — ✓ 25148 / ✗ 20
     ✓ valid response structure

     checks.........................: 99.97% ✓ 75484      ✗ 20   
     data_received..................: 2.3 GB 34 MB/s
     data_sent......................: 31 MB  455 kB/s
     http_req_blocked...............: avg=87.51µs  min=1.71µs  med=3.08µs   max=149.54ms p(90)=4.96µs   p(95)=7.29µs   p(99.9)=17.54ms
     http_req_connecting............: avg=81.8µs   min=0s      med=0s       max=149.39ms p(90)=0s       p(95)=0s       p(99.9)=17.49ms
     http_req_duration..............: avg=538.42ms min=6.15ms  med=508.42ms max=1.78s    p(90)=1.07s    p(95)=1.2s     p(99.9)=1.74s  
       { expected_response:true }...: avg=538.42ms min=6.15ms  med=508.42ms max=1.78s    p(90)=1.07s    p(95)=1.2s     p(99.9)=1.74s  
     http_req_failed................: 0.00%  ✓ 0          ✗ 26168
     http_req_receiving.............: avg=128.7µs  min=28.39µs med=53.4µs   max=126.35ms p(90)=104.47µs p(95)=177.85µs p(99.9)=7.62ms 
     http_req_sending...............: avg=123.57µs min=7.29µs  med=11.85µs  max=113.27ms p(90)=30.03µs  p(95)=118µs    p(99.9)=21.87ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=538.16ms min=6.1ms   med=508.27ms max=1.78s    p(90)=1.07s    p(95)=1.2s     p(99.9)=1.74s  
     http_reqs......................: 26168  390.097052/s
     iteration_duration.............: avg=560.28ms min=6.52ms  med=529.63ms max=1.78s    p(90)=1.08s    p(95)=1.21s    p(99.9)=1.74s  
     iterations.....................: 25168  375.189644/s
     success_rate...................: 99.92% ✓ 25148      ✗ 20   
     vus............................: 66     min=0        max=496
     vus_max........................: 500    min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 51576      ✗ 0    
     data_received..................: 1.6 GB  23 MB/s
     data_sent......................: 21 MB   305 kB/s
     http_req_blocked...............: avg=124.78µs min=1.25µs  med=2.89µs   max=151.83ms p(90)=4.98µs  p(95)=8.02µs   p(99.9)=29.04ms
     http_req_connecting............: avg=119.28µs min=0s      med=0s       max=151.76ms p(90)=0s      p(95)=0s       p(99.9)=29ms   
     http_req_duration..............: avg=771.07ms min=7.11ms  med=711.86ms max=5.09s    p(90)=1.52s   p(95)=1.7s     p(99.9)=4.11s  
       { expected_response:true }...: avg=771.07ms min=7.11ms  med=711.86ms max=5.09s    p(90)=1.52s   p(95)=1.7s     p(99.9)=4.11s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 18192
     http_req_receiving.............: avg=201.77µs min=23.43µs med=45.64µs  max=113.24ms p(90)=95.47µs p(95)=168.85µs p(99.9)=25.8ms 
     http_req_sending...............: avg=202.88µs min=5.66µs  med=11.25µs  max=139.46ms p(90)=30.18µs p(95)=121.72µs p(99.9)=36.83ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=770.67ms min=7.05ms  med=711.53ms max=5.09s    p(90)=1.52s   p(95)=1.7s     p(99.9)=4.11s  
     http_reqs......................: 18192   260.623831/s
     iteration_duration.............: avg=816.26ms min=8.36ms  med=760.23ms max=5.1s     p(90)=1.53s   p(95)=1.71s    p(99.9)=4.2s   
     iterations.....................: 17192   246.297543/s
     success_rate...................: 100.00% ✓ 17192      ✗ 0    
     vus............................: 55      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 50757      ✗ 0    
     data_received..................: 1.6 GB  23 MB/s
     data_sent......................: 21 MB   304 kB/s
     http_req_blocked...............: avg=122.56µs min=1.21µs  med=3.09µs   max=103.9ms  p(90)=5.5µs   p(95)=8.05µs   p(99.9)=34.33ms
     http_req_connecting............: avg=113.6µs  min=0s      med=0s       max=103.84ms p(90)=0s      p(95)=0s       p(99.9)=34.09ms
     http_req_duration..............: avg=782.01ms min=6.45ms  med=736.09ms max=5.1s     p(90)=1.52s   p(95)=1.74s    p(99.9)=4.03s  
       { expected_response:true }...: avg=782.01ms min=6.45ms  med=736.09ms max=5.1s     p(90)=1.52s   p(95)=1.74s    p(99.9)=4.03s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 17919
     http_req_receiving.............: avg=150.52µs min=26.58µs med=46.98µs  max=115.97ms p(90)=95.85µs p(95)=142.77µs p(99.9)=17.39ms
     http_req_sending...............: avg=176.16µs min=5.9µs   med=11.5µs   max=66.06ms  p(90)=29.13µs p(95)=72.31µs  p(99.9)=27.56ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=781.68ms min=6.39ms  med=735.93ms max=5.1s     p(90)=1.52s   p(95)=1.74s    p(99.9)=4.03s  
     http_reqs......................: 17919   259.736308/s
     iteration_duration.............: avg=828.59ms min=8.51ms  med=799.52ms max=5.11s    p(90)=1.54s   p(95)=1.78s    p(99.9)=4.06s  
     iterations.....................: 16919   245.241286/s
     success_rate...................: 100.00% ✓ 16919      ✗ 0    
     vus............................: 62      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 28794      ✗ 0    
     data_received..................: 931 MB  14 MB/s
     data_sent......................: 13 MB   185 kB/s
     http_req_blocked...............: avg=34.71µs min=1.32µs  med=3.1µs   max=23.12ms p(90)=5.21µs   p(95)=10.97µs  p(99.9)=5.58ms
     http_req_connecting............: avg=28.8µs  min=0s      med=0s      max=23.06ms p(90)=0s       p(95)=0s       p(99.9)=5.53ms
     http_req_duration..............: avg=1.22s   min=7.24ms  med=1.19s   max=15.19s  p(90)=2.22s    p(95)=2.67s    p(99.9)=14.07s
       { expected_response:true }...: avg=1.22s   min=7.24ms  med=1.19s   max=15.19s  p(90)=2.22s    p(95)=2.67s    p(99.9)=14.07s
     http_req_failed................: 0.00%   ✓ 0          ✗ 10598
     http_req_receiving.............: avg=78.13µs min=26.68µs med=53.69µs max=33.69ms p(90)=100.47µs p(95)=124.15µs p(99.9)=1.22ms
     http_req_sending...............: avg=41.35µs min=6.1µs   med=12.39µs max=20.51ms p(90)=30.49µs  p(95)=47.86µs  p(99.9)=6.83ms
     http_req_tls_handshaking.......: avg=0s      min=0s      med=0s      max=0s      p(90)=0s       p(95)=0s       p(99.9)=0s    
     http_req_waiting...............: avg=1.22s   min=7.18ms  med=1.19s   max=15.19s  p(90)=2.22s    p(95)=2.67s    p(99.9)=14.07s
     http_reqs......................: 10598   154.936904/s
     iteration_duration.............: avg=1.35s   min=8.21ms  med=1.32s   max=15.21s  p(90)=2.27s    p(95)=2.71s    p(99.9)=14.2s 
     iterations.....................: 9598    140.317457/s
     success_rate...................: 100.00% ✓ 9598       ✗ 0    
     vus............................: 93      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

Overview for: constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 174 14163 total, 0 failed avg: 213ms, p95: 221ms
hive-router 166 13488 total, 0 failed avg: 224ms, p95: 236ms
cosmo 158 12827 total, 0 failed avg: 236ms, p95: 260ms
hive-gateway-bun 149 11422 total, 0 failed avg: 265ms, p95: 298ms
hive-gateway 144 11118 total, 0 failed avg: 272ms, p95: 367ms
apollo-router 125 10224 total, 0 failed avg: 296ms, p95: 341ms
apollo-gateway 82 6771 total, 0 failed avg: 447ms, p95: 493ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 42189      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 17 MB   203 kB/s
     http_req_blocked...............: avg=19.55µs  min=1.23µs   med=2.24µs   max=9.33ms   p(90)=4.09µs   p(95)=5.55µs   p(99.9)=6.79ms  
     http_req_connecting............: avg=16.55µs  min=0s       med=0s       max=9.29ms   p(90)=0s       p(95)=0s       p(99.9)=6.77ms  
     http_req_duration..............: avg=213.21ms min=159.02ms med=212.34ms max=614.47ms p(90)=218.54ms p(95)=220.58ms p(99.9)=516.28ms
       { expected_response:true }...: avg=213.21ms min=159.02ms med=212.34ms max=614.47ms p(90)=218.54ms p(95)=220.58ms p(99.9)=516.28ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 14163
     http_req_receiving.............: avg=81.55µs  min=25.06µs  med=48.74µs  max=14.95ms  p(90)=97.69µs  p(95)=254.36µs p(99.9)=1.31ms  
     http_req_sending...............: avg=132.44µs min=5.61µs   med=9.91µs   max=376.54ms p(90)=27.47µs  p(95)=108.06µs p(99.9)=6.21ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=212.99ms min=158.93ms med=212.25ms max=613.8ms  p(90)=218.42ms p(95)=220.39ms p(99.9)=496.58ms
     http_reqs......................: 14163   174.854843/s
     iteration_duration.............: avg=213.54ms min=159.32ms med=212.61ms max=632.3ms  p(90)=218.78ms p(95)=220.79ms p(99.9)=537.95ms
     iterations.....................: 14063   173.620254/s
     success_rate...................: 100.00% ✓ 14063      ✗ 0    
     vus............................: 24      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40164      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   194 kB/s
     http_req_blocked...............: avg=46.59µs  min=1.19µs   med=2.14µs   max=18.19ms  p(90)=3.17µs   p(95)=4.34µs   p(99.9)=14.9ms  
     http_req_connecting............: avg=43.68µs  min=0s       med=0s       max=18ms     p(90)=0s       p(95)=0s       p(99.9)=14.82ms 
     http_req_duration..............: avg=223.96ms min=161.3ms  med=223ms    max=605.25ms p(90)=232.66ms p(95)=235.67ms p(99.9)=507.2ms 
       { expected_response:true }...: avg=223.96ms min=161.3ms  med=223ms    max=605.25ms p(90)=232.66ms p(95)=235.67ms p(99.9)=507.2ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 13488
     http_req_receiving.............: avg=76.52µs  min=26.18µs  med=43.96µs  max=17.43ms  p(90)=90.26µs  p(95)=251.32µs p(99.9)=1.54ms  
     http_req_sending...............: avg=126.37µs min=5.45µs   med=9.27µs   max=356.83ms p(90)=28.74µs  p(95)=97.47µs  p(99.9)=8.51ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=223.76ms min=161.25ms med=222.87ms max=604.12ms p(90)=232.52ms p(95)=235.44ms p(99.9)=495.66ms
     http_reqs......................: 13488   166.719635/s
     iteration_duration.............: avg=224.37ms min=161.53ms med=223.27ms max=624.27ms p(90)=232.86ms p(95)=235.9ms  p(99.9)=522.64ms
     iterations.....................: 13388   165.483576/s
     success_rate...................: 100.00% ✓ 13388      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 38181      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 15 MB   184 kB/s
     http_req_blocked...............: avg=21.41µs  min=1.6µs    med=2.63µs   max=9.3ms    p(90)=3.99µs   p(95)=5.12µs   p(99.9)=6.94ms  
     http_req_connecting............: avg=18.04µs  min=0s       med=0s       max=9.26ms   p(90)=0s       p(95)=0s       p(99.9)=6.92ms  
     http_req_duration..............: avg=235.76ms min=140.64ms med=235.54ms max=649.24ms p(90)=254.33ms p(95)=260.37ms p(99.9)=547.07ms
       { expected_response:true }...: avg=235.76ms min=140.64ms med=235.54ms max=649.24ms p(90)=254.33ms p(95)=260.37ms p(99.9)=547.07ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12827
     http_req_receiving.............: avg=331.27µs min=31.7µs   med=63.84µs  max=78.6ms   p(90)=184.37µs p(95)=506.78µs p(99.9)=27.92ms 
     http_req_sending...............: avg=82.26µs  min=7.16µs   med=10.81µs  max=277.16ms p(90)=29.68µs  p(95)=120.34µs p(99.9)=3.7ms   
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=235.35ms min=140.57ms med=235.18ms max=648.16ms p(90)=253.78ms p(95)=259.57ms p(99.9)=545.88ms
     http_reqs......................: 12827   158.038235/s
     iteration_duration.............: avg=236.32ms min=140.87ms med=235.91ms max=676.09ms p(90)=254.67ms p(95)=260.69ms p(99.9)=564.99ms
     iterations.....................: 12727   156.80616/s
     success_rate...................: 100.00% ✓ 12727      ✗ 0    
     vus............................: 35      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 33966      ✗ 0    
     data_received..................: 1.0 GB  13 MB/s
     data_sent......................: 13 MB   174 kB/s
     http_req_blocked...............: avg=28.12µs  min=1.15µs   med=2.65µs   max=11.49ms  p(90)=4.19µs   p(95)=5.35µs   p(99.9)=8.91ms  
     http_req_connecting............: avg=24.66µs  min=0s       med=0s       max=11.45ms  p(90)=0s       p(95)=0s       p(99.9)=8.87ms  
     http_req_duration..............: avg=264.56ms min=149.3ms  med=254.52ms max=773.74ms p(90)=273.49ms p(95)=297.99ms p(99.9)=641.68ms
       { expected_response:true }...: avg=264.56ms min=149.3ms  med=254.52ms max=773.74ms p(90)=273.49ms p(95)=297.99ms p(99.9)=641.68ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11422
     http_req_receiving.............: avg=87.73µs  min=25.37µs  med=44.99µs  max=14.78ms  p(90)=100.85µs p(95)=347.62µs p(99.9)=2.08ms  
     http_req_sending...............: avg=150.26µs min=5.44µs   med=10.97µs  max=251.02ms p(90)=35.61µs  p(95)=148.16µs p(99.9)=9.74ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=264.32ms min=149.24ms med=254.38ms max=772.93ms p(90)=273.18ms p(95)=297.31ms p(99.9)=640.39ms
     http_reqs......................: 11422   149.258507/s
     iteration_duration.............: avg=265.89ms min=149.55ms med=254.89ms max=796.48ms p(90)=273.91ms p(95)=298.91ms p(99.9)=722.75ms
     iterations.....................: 11322   147.951743/s
     success_rate...................: 100.00% ✓ 11322      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 33054      ✗ 0    
     data_received..................: 976 MB  13 MB/s
     data_sent......................: 13 MB   168 kB/s
     http_req_blocked...............: avg=33.1µs   min=1.14µs   med=2.72µs   max=12.36ms  p(90)=4.47µs   p(95)=6.01µs   p(99.9)=9.85ms  
     http_req_connecting............: avg=29.52µs  min=0s       med=0s       max=12.32ms  p(90)=0s       p(95)=0s       p(99.9)=9.82ms  
     http_req_duration..............: avg=272.07ms min=139.31ms med=260.75ms max=902.61ms p(90)=286.22ms p(95)=367.47ms p(99.9)=784.06ms
       { expected_response:true }...: avg=272.07ms min=139.31ms med=260.75ms max=902.61ms p(90)=286.22ms p(95)=367.47ms p(99.9)=784.06ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11118
     http_req_receiving.............: avg=98.52µs  min=26.75µs  med=49.13µs  max=16.38ms  p(90)=119.8µs  p(95)=369.79µs p(99.9)=3.75ms  
     http_req_sending...............: avg=138.51µs min=5.29µs   med=11.24µs  max=239.94ms p(90)=38.95µs  p(95)=156.85µs p(99.9)=8.57ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=271.83ms min=135.28ms med=260.61ms max=901.74ms p(90)=285.96ms p(95)=364.83ms p(99.9)=782.81ms
     http_reqs......................: 11118   144.698713/s
     iteration_duration.............: avg=273.42ms min=139.66ms med=261.15ms max=922.13ms p(90)=286.67ms p(95)=371.44ms p(99.9)=819.14ms
     iterations.....................: 11018   143.397232/s
     success_rate...................: 100.00% ✓ 11018      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 30372      ✗ 0    
     data_received..................: 897 MB  11 MB/s
     data_sent......................: 12 MB   146 kB/s
     http_req_blocked...............: avg=26.92µs  min=1.67µs   med=2.77µs   max=9.47ms   p(90)=4.3µs    p(95)=5.48µs   p(99.9)=7.58ms  
     http_req_connecting............: avg=23.44µs  min=0s       med=0s       max=9.44ms   p(90)=0s       p(95)=0s       p(99.9)=7.56ms  
     http_req_duration..............: avg=296.31ms min=145.71ms med=298.11ms max=714.43ms p(90)=331.88ms p(95)=341.26ms p(99.9)=621.07ms
       { expected_response:true }...: avg=296.31ms min=145.71ms med=298.11ms max=714.43ms p(90)=331.88ms p(95)=341.26ms p(99.9)=621.07ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10224
     http_req_receiving.............: avg=98.26µs  min=34.97µs  med=51.83µs  max=103.68ms p(90)=104.8µs  p(95)=274.61µs p(99.9)=1.55ms  
     http_req_sending...............: avg=160.87µs min=7.54µs   med=11.16µs  max=349.57ms p(90)=29.88µs  p(95)=140.86µs p(99.9)=3.88ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=296.05ms min=126.52ms med=297.94ms max=706.44ms p(90)=331.64ms p(95)=341ms    p(99.9)=614.34ms
     http_reqs......................: 10224   125.355348/s
     iteration_duration.............: avg=297.51ms min=145.95ms med=298.83ms max=740.06ms p(90)=332.39ms p(95)=341.65ms p(99.9)=638.38ms
     iterations.....................: 10124   124.129259/s
     success_rate...................: 100.00% ✓ 10124      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 20013     ✗ 0   
     data_received..................: 595 MB  7.3 MB/s
     data_sent......................: 7.9 MB  96 kB/s
     http_req_blocked...............: avg=47.94µs  min=1.42µs   med=3.36µs   max=11.81ms  p(90)=5.51µs   p(95)=6.24µs   p(99.9)=10.24ms 
     http_req_connecting............: avg=43.64µs  min=0s       med=0s       max=11.76ms  p(90)=0s       p(95)=0s       p(99.9)=10.21ms 
     http_req_duration..............: avg=446.58ms min=213.68ms med=451.52ms max=947.34ms p(90)=479.1ms  p(95)=493.48ms p(99.9)=822.86ms
       { expected_response:true }...: avg=446.58ms min=213.68ms med=451.52ms max=947.34ms p(90)=479.1ms  p(95)=493.48ms p(99.9)=822.86ms
     http_req_failed................: 0.00%   ✓ 0         ✗ 6771
     http_req_receiving.............: avg=94.43µs  min=28.74µs  med=62.3µs   max=125.9ms  p(90)=115.36µs p(95)=134.17µs p(99.9)=465.54µs
     http_req_sending...............: avg=56.52µs  min=6.48µs   med=13.72µs  max=124.34ms p(90)=23.05µs  p(95)=28.5µs   p(99.9)=2.9ms   
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=446.42ms min=213.53ms med=451.4ms  max=945.83ms p(90)=478.99ms p(95)=493.34ms p(99.9)=811.57ms
     http_reqs......................: 6771    82.660279/s
     iteration_duration.............: avg=450.64ms min=299.05ms med=452.15ms max=983.72ms p(90)=479.67ms p(95)=494.29ms p(99.9)=966.04ms
     iterations.....................: 6671    81.43948/s
     success_rate...................: 100.00% ✓ 6671      ✗ 0   
     vus............................: 50      min=0       max=50
     vus_max........................: 50      min=50      max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

Overview for: constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 172 13994 total, 0 failed avg: 216ms, p95: 227ms
hive-router 170 13788 total, 0 failed avg: 219ms, p95: 229ms
cosmo 166 13496 total, 0 failed avg: 224ms, p95: 248ms
hive-gateway 163 12492 total, 0 failed avg: 242ms, p95: 267ms
hive-gateway-bun 163 12482 total, 0 failed avg: 242ms, p95: 262ms
apollo-router 135 11077 total, 0 failed avg: 273ms, p95: 318ms ❌ 1 unexpected GraphQL errors
apollo-gateway 125 10214 total, 0 failed avg: 296ms, p95: 330ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41682      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   201 kB/s
     http_req_blocked...............: avg=18.32µs  min=1.16µs   med=1.89µs   max=8.76ms   p(90)=3.25µs   p(95)=4.76µs   p(99.9)=6.41ms  
     http_req_connecting............: avg=15.73µs  min=0s       med=0s       max=8.73ms   p(90)=0s       p(95)=0s       p(99.9)=6.39ms  
     http_req_duration..............: avg=215.98ms min=158.14ms med=215.2ms  max=606.65ms p(90)=224.5ms  p(95)=227.06ms p(99.9)=530.82ms
       { expected_response:true }...: avg=215.98ms min=158.14ms med=215.2ms  max=606.65ms p(90)=224.5ms  p(95)=227.06ms p(99.9)=530.82ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13994
     http_req_receiving.............: avg=81.21µs  min=27.46µs  med=44.99µs  max=15.36ms  p(90)=95.39µs  p(95)=267.25µs p(99.9)=4.1ms   
     http_req_sending...............: avg=127.17µs min=5.66µs   med=8.49µs   max=386.47ms p(90)=27.97µs  p(95)=98.94µs  p(99.9)=8.97ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=215.77ms min=158.03ms med=215.09ms max=605.97ms p(90)=224.33ms p(95)=226.9ms  p(99.9)=494.82ms
     http_reqs......................: 13994   172.785474/s
     iteration_duration.............: avg=216.29ms min=158.48ms med=215.45ms max=626.8ms  p(90)=224.69ms p(95)=227.25ms p(99.9)=545.42ms
     iterations.....................: 13894   171.550763/s
     success_rate...................: 100.00% ✓ 13894      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41064      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   198 kB/s
     http_req_blocked...............: avg=18.7µs   min=1.19µs   med=1.96µs   max=8.92ms   p(90)=3.14µs   p(95)=4.25µs   p(99.9)=6.53ms  
     http_req_connecting............: avg=16.21µs  min=0s       med=0s       max=8.89ms   p(90)=0s       p(95)=0s       p(99.9)=6.51ms  
     http_req_duration..............: avg=219.08ms min=156.56ms med=218.13ms max=606.87ms p(90)=226.43ms p(95)=229.07ms p(99.9)=515.7ms 
       { expected_response:true }...: avg=219.08ms min=156.56ms med=218.13ms max=606.87ms p(90)=226.43ms p(95)=229.07ms p(99.9)=515.7ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 13788
     http_req_receiving.............: avg=69.13µs  min=23.43µs  med=40.94µs  max=16.05ms  p(90)=81.48µs  p(95)=219.09µs p(99.9)=1.63ms  
     http_req_sending...............: avg=179.04µs min=5.48µs   med=8.21µs   max=366.89ms p(90)=27.63µs  p(95)=94.69µs  p(99.9)=7.36ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=218.83ms min=156.52ms med=218.02ms max=605.04ms p(90)=226.29ms p(95)=228.9ms  p(99.9)=498.32ms
     http_reqs......................: 13788   170.554726/s
     iteration_duration.............: avg=219.43ms min=156.73ms med=218.37ms max=627.86ms p(90)=226.62ms p(95)=229.26ms p(99.9)=532.55ms
     iterations.....................: 13688   169.317747/s
     success_rate...................: 100.00% ✓ 13688      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40188      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   194 kB/s
     http_req_blocked...............: avg=21.28µs  min=1.3µs    med=2.73µs   max=9.5ms    p(90)=4.02µs   p(95)=5.32µs   p(99.9)=7.06ms  
     http_req_connecting............: avg=17.82µs  min=0s       med=0s       max=9.46ms   p(90)=0s       p(95)=0s       p(99.9)=7.05ms  
     http_req_duration..............: avg=223.94ms min=158.99ms med=222.69ms max=647.44ms p(90)=242.85ms p(95)=248.44ms p(99.9)=529.63ms
       { expected_response:true }...: avg=223.94ms min=158.99ms med=222.69ms max=647.44ms p(90)=242.85ms p(95)=248.44ms p(99.9)=529.63ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13496
     http_req_receiving.............: avg=454.26µs min=28.43µs  med=63.36µs  max=124.19ms p(90)=364.1µs  p(95)=788.2µs  p(99.9)=25.89ms 
     http_req_sending...............: avg=86.86µs  min=5.83µs   med=10.97µs  max=219.9ms  p(90)=33.28µs  p(95)=130.26µs p(99.9)=4.85ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=223.4ms  min=154.53ms med=222.24ms max=629.71ms p(90)=242.41ms p(95)=247.84ms p(99.9)=522.79ms
     http_reqs......................: 13496   166.44821/s
     iteration_duration.............: avg=224.39ms min=159.31ms med=223.06ms max=655.36ms p(90)=243.12ms p(95)=248.78ms p(99.9)=551.95ms
     iterations.....................: 13396   165.214895/s
     success_rate...................: 100.00% ✓ 13396      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 37176      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 15 MB   190 kB/s
     http_req_blocked...............: avg=23.65µs  min=1.18µs   med=2.59µs   max=10.49ms  p(90)=4.27µs   p(95)=5.48µs   p(99.9)=7.73ms  
     http_req_connecting............: avg=20.08µs  min=0s       med=0s       max=10.45ms  p(90)=0s       p(95)=0s       p(99.9)=7.68ms  
     http_req_duration..............: avg=241.62ms min=156.35ms med=233.31ms max=857.29ms p(90)=255.7ms  p(95)=267.07ms p(99.9)=710.85ms
       { expected_response:true }...: avg=241.62ms min=156.35ms med=233.31ms max=857.29ms p(90)=255.7ms  p(95)=267.07ms p(99.9)=710.85ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12492
     http_req_receiving.............: avg=115.02µs min=26.07µs  med=47.46µs  max=172.15ms p(90)=112.44µs p(95)=229.98µs p(99.9)=3.97ms  
     http_req_sending...............: avg=103.45µs min=5.47µs   med=10.64µs  max=285.26ms p(90)=32.63µs  p(95)=125.66µs p(99.9)=5.9ms   
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=241.4ms  min=156.25ms med=233.17ms max=846.85ms p(90)=255.52ms p(95)=266.94ms p(99.9)=709.8ms 
     http_reqs......................: 12492   163.306015/s
     iteration_duration.............: avg=242.65ms min=156.7ms  med=233.71ms max=875.45ms p(90)=256.1ms  p(95)=267.46ms p(99.9)=727.51ms
     iterations.....................: 12392   161.99873/s
     success_rate...................: 100.00% ✓ 12392      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 37146      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 15 MB   190 kB/s
     http_req_blocked...............: avg=26.39µs  min=1.14µs   med=2.67µs   max=10.63ms  p(90)=4.43µs   p(95)=6.04µs   p(99.9)=8.14ms  
     http_req_connecting............: avg=21.87µs  min=0s       med=0s       max=10.59ms  p(90)=0s       p(95)=0s       p(99.9)=8.1ms   
     http_req_duration..............: avg=241.68ms min=160.8ms  med=233.73ms max=731.95ms p(90)=251.63ms p(95)=261.99ms p(99.9)=635.06ms
       { expected_response:true }...: avg=241.68ms min=160.8ms  med=233.73ms max=731.95ms p(90)=251.63ms p(95)=261.99ms p(99.9)=635.06ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12482
     http_req_receiving.............: avg=89.17µs  min=24.76µs  med=47.57µs  max=18.04ms  p(90)=105.45µs p(95)=164.14µs p(99.9)=3.9ms   
     http_req_sending...............: avg=120.88µs min=5.68µs   med=11.03µs  max=331.57ms p(90)=33.18µs  p(95)=119.06µs p(99.9)=6.38ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=241.47ms min=160.69ms med=233.59ms max=730.66ms p(90)=251.43ms p(95)=261.61ms p(99.9)=635.01ms
     http_reqs......................: 12482   163.130253/s
     iteration_duration.............: avg=242.68ms min=182.56ms med=234.05ms max=778.31ms p(90)=251.99ms p(95)=262.43ms p(99.9)=639.23ms
     iterations.....................: 12382   161.823329/s
     success_rate...................: 100.00% ✓ 12382      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  99% — ✓ 10976 / ✗ 1
     ✓ valid response structure

     checks.........................: 99.99% ✓ 32930      ✗ 1    
     data_received..................: 972 MB 12 MB/s
     data_sent......................: 13 MB  158 kB/s
     http_req_blocked...............: avg=22.9µs   min=1.38µs   med=2.99µs   max=8.04ms   p(90)=4.52µs   p(95)=5.55µs   p(99.9)=6.33ms  
     http_req_connecting............: avg=18.05µs  min=0s       med=0s       max=8.01ms   p(90)=0s       p(95)=0s       p(99.9)=6.32ms  
     http_req_duration..............: avg=272.94ms min=152.05ms med=272.9ms  max=679.31ms p(90)=308.16ms p(95)=317.58ms p(99.9)=586.47ms
       { expected_response:true }...: avg=272.94ms min=152.05ms med=272.9ms  max=679.31ms p(90)=308.16ms p(95)=317.58ms p(99.9)=586.47ms
     http_req_failed................: 0.00%  ✓ 0          ✗ 11077
     http_req_receiving.............: avg=141.77µs min=29.06µs  med=56.53µs  max=53.83ms  p(90)=158.21µs p(95)=448.69µs p(99.9)=6.17ms  
     http_req_sending...............: avg=124.48µs min=6.12µs   med=11.71µs  max=276.2ms  p(90)=44.52µs  p(95)=137.55µs p(99.9)=4.18ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=272.67ms min=148.33ms med=272.71ms max=664.27ms p(90)=307.8ms  p(95)=317.36ms p(99.9)=585.74ms
     http_reqs......................: 11077  135.956383/s
     iteration_duration.............: avg=273.92ms min=152.32ms med=273.56ms max=705.33ms p(90)=308.68ms p(95)=317.99ms p(99.9)=611.45ms
     iterations.....................: 10977  134.729008/s
     success_rate...................: 99.99% ✓ 10976      ✗ 1    
     vus............................: 50     min=0        max=50 
     vus_max........................: 50     min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 30342      ✗ 0    
     data_received..................: 897 MB  11 MB/s
     data_sent......................: 12 MB   146 kB/s
     http_req_blocked...............: avg=27.88µs  min=1.35µs   med=3.14µs   max=9.64ms   p(90)=4.7µs    p(95)=5.55µs   p(99.9)=7.69ms  
     http_req_connecting............: avg=23.58µs  min=0s       med=0s       max=9.61ms   p(90)=0s       p(95)=0s       p(99.9)=7.67ms  
     http_req_duration..............: avg=296.36ms min=210.83ms med=294.35ms max=849.62ms p(90)=319.02ms p(95)=329.67ms p(99.9)=721.18ms
       { expected_response:true }...: avg=296.36ms min=210.83ms med=294.35ms max=849.62ms p(90)=319.02ms p(95)=329.67ms p(99.9)=721.18ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10214
     http_req_receiving.............: avg=92.42µs  min=29.69µs  med=56.9µs   max=132.77ms p(90)=105.93µs p(95)=128.24µs p(99.9)=2.36ms  
     http_req_sending...............: avg=92.83µs  min=6.04µs   med=12.55µs  max=237.24ms p(90)=21.11µs  p(95)=36.64µs  p(99.9)=4.3ms   
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=296.17ms min=210.7ms  med=294.24ms max=845.05ms p(90)=318.93ms p(95)=329.43ms p(99.9)=719.97ms
     http_reqs......................: 10214   125.116789/s
     iteration_duration.............: avg=297.63ms min=218.23ms med=294.84ms max=882.15ms p(90)=319.57ms p(95)=330.11ms p(99.9)=745.53ms
     iterations.....................: 10114   123.891835/s
     success_rate...................: 100.00% ✓ 10114      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@ardatan ardatan merged commit 1edc96a into main Sep 28, 2025
34 checks passed
@ardatan ardatan deleted the renovate/bun-1.x branch September 28, 2025 21:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant