Skip to content

Conversation

renovate[bot]
Copy link
Contributor

@renovate renovate bot commented Oct 10, 2025

This PR contains the following updates:

Package Change Age Confidence
bun (source) 1.2.23 -> 1.3.0 age confidence

Release Notes

oven-sh/bun (bun)

v1.3.0

Compare Source


Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.


  • If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

@renovate renovate bot added the dependencies Pull requests that update a dependency file label Oct 10, 2025
Copy link

💻 Website Preview

The latest changes are available as preview in: https://fa511aa9.federation-gateway-benchmark.pages.dev

Copy link

Overview for: constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1791 107950 total, 0 failed avg: 28ms, p95: 49ms
grafbase 1611 97231 total, 0 failed avg: 31ms, p95: 54ms
cosmo 688 41597 total, 0 failed avg: 72ms, p95: 106ms
apollo-router 376 22885 total, 0 failed avg: 131ms, p95: 172ms
hive-gateway-bun 296 18114 total, 0 failed avg: 165ms, p95: 244ms
hive-gateway 277 16937 total, 0 failed avg: 177ms, p95: 436ms
apollo-gateway 127 7797 total, 0 failed avg: 386ms, p95: 452ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 323550      ✗ 0     
     data_received..................: 9.5 GB  157 MB/s
     data_sent......................: 126 MB  2.1 MB/s
     http_req_blocked...............: avg=5.11µs   min=1.18µs  med=2.57µs  max=8.97ms   p(90)=3.72µs   p(95)=4.35µs   p(99.9)=85.72µs
     http_req_connecting............: avg=2.08µs   min=0s      med=0s      max=8.93ms   p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_duration..............: avg=27.54ms  min=1.91ms  med=24.91ms max=422.82ms p(90)=43.07ms  p(95)=49.24ms  p(99.9)=86.32ms
       { expected_response:true }...: avg=27.54ms  min=1.91ms  med=24.91ms max=422.82ms p(90)=43.07ms  p(95)=49.24ms  p(99.9)=86.32ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 107950
     http_req_receiving.............: avg=124.05µs min=23.92µs med=43.14µs max=59.59ms  p(90)=106.71µs p(95)=342.43µs p(99.9)=14.28ms
     http_req_sending...............: avg=98.67µs  min=5.29µs  med=10.2µs  max=368.17ms p(90)=29.08µs  p(95)=124.79µs p(99.9)=14.74ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=27.31ms  min=1.86ms  med=24.75ms max=411.9ms  p(90)=42.67ms  p(95)=48.76ms  p(99.9)=84.66ms
     http_reqs......................: 107950  1791.551221/s
     iteration_duration.............: avg=27.8ms   min=4.41ms  med=25.15ms max=458.78ms p(90)=43.33ms  p(95)=49.5ms   p(99.9)=87.01ms
     iterations.....................: 107850  1789.891609/s
     success_rate...................: 100.00% ✓ 107850      ✗ 0     
     vus............................: 50      min=50        max=50  
     vus_max........................: 50      min=50        max=50  

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 291393      ✗ 0    
     data_received..................: 8.5 GB  142 MB/s
     data_sent......................: 113 MB  1.9 MB/s
     http_req_blocked...............: avg=5.87µs   min=1.21µs  med=2.97µs  max=9.1ms    p(90)=4.11µs   p(95)=4.75µs   p(99.9)=114.19µs
     http_req_connecting............: avg=2.33µs   min=0s      med=0s      max=9.07ms   p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_duration..............: avg=30.57ms  min=2.49ms  med=27.09ms max=454.25ms p(90)=47.55ms  p(95)=54.45ms  p(99.9)=91.98ms 
       { expected_response:true }...: avg=30.57ms  min=2.49ms  med=27.09ms max=454.25ms p(90)=47.55ms  p(95)=54.45ms  p(99.9)=91.98ms 
     http_req_failed................: 0.00%   ✓ 0           ✗ 97231
     http_req_receiving.............: avg=152.13µs min=25.33µs med=47.07µs max=44.1ms   p(90)=125.91µs p(95)=388.95µs p(99.9)=17.87ms 
     http_req_sending...............: avg=124.35µs min=5.48µs  med=11.5µs  max=412.83ms p(90)=35.71µs  p(95)=136.55µs p(99.9)=17.73ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=30.29ms  min=2.45ms  med=26.9ms  max=452.78ms p(90)=47.02ms  p(95)=53.84ms  p(99.9)=89.32ms 
     http_reqs......................: 97231   1611.899006/s
     iteration_duration.............: avg=30.87ms  min=7.07ms  med=27.37ms max=477.4ms  p(90)=47.84ms  p(95)=54.74ms  p(99.9)=92.39ms 
     iterations.....................: 97131   1610.241203/s
     success_rate...................: 100.00% ✓ 97131       ✗ 0    
     vus............................: 50      min=50        max=50 
     vus_max........................: 50      min=50        max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 124491     ✗ 0    
     data_received..................: 3.7 GB  60 MB/s
     data_sent......................: 48 MB   801 kB/s
     http_req_blocked...............: avg=8.97µs   min=1.27µs  med=2.81µs  max=9.18ms   p(90)=3.88µs  p(95)=4.55µs   p(99.9)=1.37ms  
     http_req_connecting............: avg=5.53µs   min=0s      med=0s      max=9.15ms   p(90)=0s      p(95)=0s       p(99.9)=1.35ms  
     http_req_duration..............: avg=71.84ms  min=2.84ms  med=70.83ms max=495.64ms p(90)=97.58ms p(95)=105.64ms p(99.9)=274.67ms
       { expected_response:true }...: avg=71.84ms  min=2.84ms  med=70.83ms max=495.64ms p(90)=97.58ms p(95)=105.64ms p(99.9)=274.67ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 41597
     http_req_receiving.............: avg=182.39µs min=29.27µs med=72.79µs max=179.48ms p(90)=145.4µs p(95)=389.17µs p(99.9)=19.93ms 
     http_req_sending...............: avg=63.75µs  min=5.69µs  med=11.15µs max=330.98ms p(90)=28.67µs p(95)=122.78µs p(99.9)=4.06ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=71.6ms   min=2.75ms  med=70.6ms  max=474.64ms p(90)=97.27ms p(95)=105.37ms p(99.9)=266.5ms 
     http_reqs......................: 41597   688.526307/s
     iteration_duration.............: avg=72.32ms  min=6.05ms  med=71.15ms max=554.35ms p(90)=97.9ms  p(95)=105.96ms p(99.9)=292.08ms
     iterations.....................: 41497   686.871076/s
     success_rate...................: 100.00% ✓ 41497      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 68355      ✗ 0    
     data_received..................: 2.0 GB  33 MB/s
     data_sent......................: 27 MB   438 kB/s
     http_req_blocked...............: avg=12.69µs  min=1.87µs  med=3.09µs   max=8.08ms   p(90)=4.42µs   p(95)=5.23µs   p(99.9)=4.39ms  
     http_req_connecting............: avg=8.88µs   min=0s      med=0s       max=8.04ms   p(90)=0s       p(95)=0s       p(99.9)=4.37ms  
     http_req_duration..............: avg=130.87ms min=5.89ms  med=130.33ms max=598.41ms p(90)=161.59ms p(95)=171.59ms p(99.9)=420.67ms
       { expected_response:true }...: avg=130.87ms min=5.89ms  med=130.33ms max=598.41ms p(90)=161.59ms p(95)=171.59ms p(99.9)=420.67ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 22885
     http_req_receiving.............: avg=80.46µs  min=35.74µs med=53.62µs  max=12.35ms  p(90)=100.62µs p(95)=130.9µs  p(99.9)=1.87ms  
     http_req_sending...............: avg=92.14µs  min=7.34µs  med=12µs     max=400.47ms p(90)=19.92µs  p(95)=36.96µs  p(99.9)=2.46ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=130.7ms  min=5.84ms  med=130.23ms max=596.92ms p(90)=161.45ms p(95)=171.45ms p(99.9)=411.47ms
     http_reqs......................: 22885   376.729966/s
     iteration_duration.............: avg=131.77ms min=23.9ms  med=130.75ms max=626.01ms p(90)=161.93ms p(95)=171.91ms p(99.9)=432.15ms
     iterations.....................: 22785   375.083779/s
     success_rate...................: 100.00% ✓ 22785      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 54042      ✗ 0    
     data_received..................: 1.6 GB  26 MB/s
     data_sent......................: 21 MB   345 kB/s
     http_req_blocked...............: avg=21.24µs  min=1.21µs  med=2.91µs   max=12.06ms  p(90)=4.91µs   p(95)=6.32µs   p(99.9)=7.56ms  
     http_req_connecting............: avg=17.08µs  min=0s      med=0s       max=12.02ms  p(90)=0s       p(95)=0s       p(99.9)=7.5ms   
     http_req_duration..............: avg=165.46ms min=6.96ms  med=154.05ms max=663.58ms p(90)=184.67ms p(95)=243.66ms p(99.9)=521.33ms
       { expected_response:true }...: avg=165.46ms min=6.96ms  med=154.05ms max=663.58ms p(90)=184.67ms p(95)=243.66ms p(99.9)=521.33ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 18114
     http_req_receiving.............: avg=101.52µs min=27.81µs med=50.96µs  max=18.74ms  p(90)=109.78µs p(95)=222.47µs p(99.9)=5.02ms  
     http_req_sending...............: avg=94.73µs  min=5.82µs  med=11.63µs  max=215.86ms p(90)=33.3µs   p(95)=133.92µs p(99.9)=4.8ms   
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=165.27ms min=6.9ms   med=153.9ms  max=663.28ms p(90)=184.38ms p(95)=242.66ms p(99.9)=521.27ms
     http_reqs......................: 18114   296.813061/s
     iteration_duration.............: avg=166.79ms min=25.85ms med=154.46ms max=727.05ms p(90)=185.05ms p(95)=259.2ms  p(99.9)=571.49ms
     iterations.....................: 18014   295.174477/s
     success_rate...................: 100.00% ✓ 18014      ✗ 0    
     vus............................: 15      min=15       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 50511      ✗ 0    
     data_received..................: 1.5 GB  24 MB/s
     data_sent......................: 20 MB   323 kB/s
     http_req_blocked...............: avg=23.76µs  min=1.25µs  med=3.01µs   max=12.79ms  p(90)=5.09µs   p(95)=6.23µs   p(99.9)=8.42ms  
     http_req_connecting............: avg=19.67µs  min=0s      med=0s       max=12.75ms  p(90)=0s       p(95)=0s       p(99.9)=8.36ms  
     http_req_duration..............: avg=176.93ms min=7.2ms   med=219.69ms max=868.74ms p(90)=279.22ms p(95)=436.42ms p(99.9)=612.52ms
       { expected_response:true }...: avg=176.93ms min=7.2ms   med=219.69ms max=868.74ms p(90)=279.22ms p(95)=436.42ms p(99.9)=612.52ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 16937
     http_req_receiving.............: avg=96.72µs  min=26.63µs med=51.99µs  max=20.57ms  p(90)=115.07µs p(95)=198.73µs p(99.9)=4.09ms  
     http_req_sending...............: avg=104.62µs min=5.58µs  med=11.85µs  max=350.57ms p(90)=31.97µs  p(95)=131.7µs  p(99.9)=5.54ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=176.73ms min=7.14ms  med=219.38ms max=868.67ms p(90)=278.72ms p(95)=429.33ms p(99.9)=611.35ms
     http_reqs......................: 16937   277.612396/s
     iteration_duration.............: avg=178.31ms min=27.36ms med=220.93ms max=869ms    p(90)=279.58ms p(95)=442.65ms p(99.9)=647.02ms
     iterations.....................: 16837   275.973308/s
     success_rate...................: 100.00% ✓ 16837      ✗ 0    
     vus............................: 20      min=20       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 23091      ✗ 0   
     data_received..................: 685 MB  11 MB/s
     data_sent......................: 9.1 MB  148 kB/s
     http_req_blocked...............: avg=42.53µs  min=1.14µs  med=2.81µs   max=11.67ms  p(90)=4.14µs   p(95)=4.86µs   p(99.9)=9.99ms  
     http_req_connecting............: avg=39.31µs  min=0s      med=0s       max=11.64ms  p(90)=0s       p(95)=0s       p(99.9)=9.95ms  
     http_req_duration..............: avg=385.56ms min=7.05ms  med=384.43ms max=822.85ms p(90)=435.53ms p(95)=451.77ms p(99.9)=704.1ms 
       { expected_response:true }...: avg=385.56ms min=7.05ms  med=384.43ms max=822.85ms p(90)=435.53ms p(95)=451.77ms p(99.9)=704.1ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 7797
     http_req_receiving.............: avg=59.46µs  min=28.07µs med=51.72µs  max=1.08ms   p(90)=89.79µs  p(95)=103.2µs  p(99.9)=287.98µs
     http_req_sending...............: avg=125.53µs min=5.47µs  med=11.97µs  max=331.66ms p(90)=17.14µs  p(95)=21.62µs  p(99.9)=4.73ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=385.37ms min=7ms     med=384.34ms max=822.08ms p(90)=435.42ms p(95)=451.54ms p(99.9)=703.35ms
     http_reqs......................: 7797    127.634841/s
     iteration_duration.............: avg=390.95ms min=32.41ms med=385.01ms max=865.15ms p(90)=436.12ms p(95)=452.24ms p(99.9)=833.66ms
     iterations.....................: 7697    125.997868/s
     success_rate...................: 100.00% ✓ 7697       ✗ 0   
     vus............................: 27      min=27       max=50
     vus_max........................: 50      min=50       max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

Overview for: ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 500 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1862 115798 total, 0 failed avg: 120ms, p95: 288ms
grafbase 1545 98105 total, 0 failed avg: 142ms, p95: 336ms
cosmo 697 44494 total, 0 failed avg: 315ms, p95: 693ms
apollo-router 388 26150 total, 0 failed avg: 539ms, p95: 1216ms ❌ 30 unexpected GraphQL errors, non-compatible response structure (1)
hive-gateway 269 18702 total, 0 failed avg: 751ms, p95: 1627ms
hive-gateway-bun 269 18495 total, 0 failed avg: 759ms, p95: 1590ms
apollo-gateway 159 10874 total, 0 failed avg: 1201ms, p95: 2649ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 344394      ✗ 0     
     data_received..................: 10 GB   163 MB/s
     data_sent......................: 135 MB  2.2 MB/s
     http_req_blocked...............: avg=489.07µs min=1.14µs  med=2.45µs   max=343.33ms p(90)=3.72µs   p(95)=4.26µs   p(99.9)=174.48ms
     http_req_connecting............: avg=485.6µs  min=0s      med=0s       max=343.27ms p(90)=0s       p(95)=0s       p(99.9)=174.42ms
     http_req_duration..............: avg=120.25ms min=1.77ms  med=109.32ms max=407.03ms p(90)=242.48ms p(95)=287.55ms p(99.9)=367.69ms
       { expected_response:true }...: avg=120.25ms min=1.77ms  med=109.32ms max=407.03ms p(90)=242.48ms p(95)=287.55ms p(99.9)=367.69ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 115798
     http_req_receiving.............: avg=526.66µs min=22.49µs med=40.67µs  max=138.13ms p(90)=95.36µs  p(95)=380.26µs p(99.9)=74.89ms 
     http_req_sending...............: avg=435.71µs min=5.08µs  med=9.94µs   max=128.95ms p(90)=20.07µs  p(95)=123.46µs p(99.9)=69.47ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=119.29ms min=1.72ms  med=108.34ms max=384.85ms p(90)=240.32ms p(95)=285.65ms p(99.9)=364.47ms
     http_reqs......................: 115798  1862.717063/s
     iteration_duration.............: avg=122.07ms min=1.92ms  med=110.82ms max=782.55ms p(90)=244.73ms p(95)=290.1ms  p(99.9)=408.54ms
     iterations.....................: 114798  1846.631146/s
     success_rate...................: 100.00% ✓ 114798      ✗ 0     
     vus............................: 67      min=0         max=496 
     vus_max........................: 500     min=500       max=500 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 291315      ✗ 0    
     data_received..................: 8.6 GB  136 MB/s
     data_sent......................: 114 MB  1.8 MB/s
     http_req_blocked...............: avg=691.68µs min=1.17µs  med=2.94µs   max=579.65ms p(90)=4.26µs   p(95)=5.14µs   p(99.9)=226.15ms
     http_req_connecting............: avg=687.48µs min=0s      med=0s       max=579.59ms p(90)=0s       p(95)=0s       p(99.9)=224.9ms 
     http_req_duration..............: avg=141.8ms  min=2.49ms  med=130.39ms max=479.24ms p(90)=282.13ms p(95)=335.79ms p(99.9)=417.96ms
       { expected_response:true }...: avg=141.8ms  min=2.49ms  med=130.39ms max=479.24ms p(90)=282.13ms p(95)=335.79ms p(99.9)=417.96ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 98105
     http_req_receiving.............: avg=646.27µs min=24.41µs med=47.25µs  max=149.93ms p(90)=97.83µs  p(95)=422.55µs p(99.9)=84.25ms 
     http_req_sending...............: avg=584.7µs  min=5.1µs   med=11.7µs   max=154.51ms p(90)=28.83µs  p(95)=135.76µs p(99.9)=87.11ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=140.57ms min=2.45ms  med=128.98ms max=433.05ms p(90)=279.33ms p(95)=333.36ms p(99.9)=409.39ms
     http_reqs......................: 98105   1545.233756/s
     iteration_duration.............: avg=144.34ms min=2.76ms  med=132.64ms max=922.01ms p(90)=285.31ms p(95)=339.81ms p(99.9)=520.05ms
     iterations.....................: 97105   1529.48294/s
     success_rate...................: 100.00% ✓ 97105       ✗ 0    
     vus............................: 82      min=0         max=494
     vus_max........................: 500     min=500       max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 130482     ✗ 0    
     data_received..................: 3.9 GB  61 MB/s
     data_sent......................: 52 MB   813 kB/s
     http_req_blocked...............: avg=124.8µs  min=1.18µs  med=2.88µs   max=172.76ms p(90)=4.28µs   p(95)=5.82µs   p(99.9)=40.68ms
     http_req_connecting............: avg=119.53µs min=0s      med=0s       max=172.56ms p(90)=0s       p(95)=0s       p(99.9)=40.52ms
     http_req_duration..............: avg=315.42ms min=2.83ms  med=297.81ms max=1.27s    p(90)=618.17ms p(95)=692.61ms p(99.9)=1.03s  
       { expected_response:true }...: avg=315.42ms min=2.83ms  med=297.81ms max=1.27s    p(90)=618.17ms p(95)=692.61ms p(99.9)=1.03s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 44494
     http_req_receiving.............: avg=560.04µs min=26.79µs med=59.73µs  max=185.37ms p(90)=180.93µs p(95)=469.69µs p(99.9)=81ms   
     http_req_sending...............: avg=172.36µs min=5.62µs  med=11.12µs  max=157.75ms p(90)=30.55µs  p(95)=132.19µs p(99.9)=35.66ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=314.69ms min=2.75ms  med=297.25ms max=1.27s    p(90)=617.23ms p(95)=691.05ms p(99.9)=1.03s  
     http_reqs......................: 44494   697.816708/s
     iteration_duration.............: avg=323.23ms min=3.07ms  med=305.49ms max=1.28s    p(90)=621.56ms p(95)=695.48ms p(99.9)=1.03s  
     iterations.....................: 43494   682.133319/s
     success_rate...................: 100.00% ✓ 43494      ✗ 0    
     vus............................: 99      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  99% — ✓ 25120 / ✗ 30
     ✗ valid response structure
      ↳  99% — ✓ 25149 / ✗ 1

     checks.........................: 99.95% ✓ 75419      ✗ 31   
     data_received..................: 2.3 GB 34 MB/s
     data_sent......................: 31 MB  453 kB/s
     http_req_blocked...............: avg=84.5µs   min=1.49µs  med=3.03µs   max=105.79ms p(90)=5.14µs   p(95)=7.26µs   p(99.9)=25.26ms
     http_req_connecting............: avg=79.09µs  min=0s      med=0s       max=105.75ms p(90)=0s       p(95)=0s       p(99.9)=25.2ms 
     http_req_duration..............: avg=538.89ms min=6.19ms  med=498.25ms max=2.03s    p(90)=1.07s    p(95)=1.21s    p(99.9)=1.7s   
       { expected_response:true }...: avg=538.89ms min=6.19ms  med=498.25ms max=2.03s    p(90)=1.07s    p(95)=1.21s    p(99.9)=1.7s   
     http_req_failed................: 0.00%  ✓ 0          ✗ 26150
     http_req_receiving.............: avg=130.76µs min=30.64µs med=55.39µs  max=89.73ms  p(90)=111.21µs p(95)=212.16µs p(99.9)=13.74ms
     http_req_sending...............: avg=134.6µs  min=6.68µs  med=11.97µs  max=111.06ms p(90)=31.37µs  p(95)=127.51µs p(99.9)=27.96ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=538.62ms min=6.14ms  med=497.85ms max=2.03s    p(90)=1.07s    p(95)=1.21s    p(99.9)=1.7s   
     http_reqs......................: 26150  388.414964/s
     iteration_duration.............: avg=560.75ms min=6.59ms  med=525.69ms max=2.03s    p(90)=1.08s    p(95)=1.22s    p(99.9)=1.71s  
     iterations.....................: 25150  373.561619/s
     success_rate...................: 99.88% ✓ 25120      ✗ 30   
     vus............................: 79     min=0        max=498
     vus_max........................: 500    min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 53105      ✗ 0    
     data_received..................: 1.6 GB  24 MB/s
     data_sent......................: 22 MB   316 kB/s
     http_req_blocked...............: avg=131.57µs min=1.15µs  med=2.73µs   max=96.57ms p(90)=4.5µs   p(95)=6.8µs    p(99.9)=32.23ms
     http_req_connecting............: avg=125.88µs min=0s      med=0s       max=96.51ms p(90)=0s      p(95)=0s       p(99.9)=32.19ms
     http_req_duration..............: avg=751.12ms min=6.51ms  med=675.51ms max=4.88s   p(90)=1.47s   p(95)=1.62s    p(99.9)=3.93s  
       { expected_response:true }...: avg=751.12ms min=6.51ms  med=675.51ms max=4.88s   p(90)=1.47s   p(95)=1.62s    p(99.9)=3.93s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 18702
     http_req_receiving.............: avg=171.76µs min=26.37µs med=43.66µs  max=73.11ms p(90)=90.59µs p(95)=163.56µs p(99.9)=25.69ms
     http_req_sending...............: avg=211.64µs min=5.8µs   med=10.92µs  max=85.02ms p(90)=29.68µs p(95)=120.13µs p(99.9)=36.36ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s      p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=750.73ms min=6.46ms  med=675.25ms max=4.88s   p(90)=1.47s   p(95)=1.62s    p(99.9)=3.91s  
     http_reqs......................: 18702   269.80835/s
     iteration_duration.............: avg=793.71ms min=6.67ms  med=722.9ms  max=4.74s   p(90)=1.48s   p(95)=1.63s    p(99.9)=3.97s  
     iterations.....................: 17701   255.367212/s
     success_rate...................: 100.00% ✓ 17701      ✗ 0    
     vus............................: 82      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 52485      ✗ 0    
     data_received..................: 1.6 GB  24 MB/s
     data_sent......................: 22 MB   316 kB/s
     http_req_blocked...............: avg=88.25µs  min=1.33µs  med=2.71µs   max=85.3ms   p(90)=4.5µs   p(95)=7.17µs   p(99.9)=25.13ms
     http_req_connecting............: avg=81.73µs  min=0s      med=0s       max=85.23ms  p(90)=0s      p(95)=0s       p(99.9)=25.07ms
     http_req_duration..............: avg=758.5ms  min=6.31ms  med=703.78ms max=5.37s    p(90)=1.46s   p(95)=1.59s    p(99.9)=4.16s  
       { expected_response:true }...: avg=758.5ms  min=6.31ms  med=703.78ms max=5.37s    p(90)=1.46s   p(95)=1.59s    p(99.9)=4.16s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 18495
     http_req_receiving.............: avg=159.1µs  min=26.44µs med=44.3µs   max=61.12ms  p(90)=89.57µs p(95)=151.92µs p(99.9)=22.58ms
     http_req_sending...............: avg=183.64µs min=5.81µs  med=11.03µs  max=100.79ms p(90)=29.63µs p(95)=111.04µs p(99.9)=33.72ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=758.16ms min=6.27ms  med=703.28ms max=5.37s    p(90)=1.46s   p(95)=1.58s    p(99.9)=4.16s  
     http_reqs......................: 18495   269.963448/s
     iteration_duration.............: avg=802.22ms min=8.1ms   med=740.76ms max=5.38s    p(90)=1.47s   p(95)=1.59s    p(99.9)=4.17s  
     iterations.....................: 17495   255.366884/s
     success_rate...................: 100.00% ✓ 17495      ✗ 0    
     vus............................: 90      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 29622      ✗ 0    
     data_received..................: 955 MB  14 MB/s
     data_sent......................: 13 MB   190 kB/s
     http_req_blocked...............: avg=33.96µs min=1.32µs  med=3.24µs  max=57.81ms p(90)=5.12µs  p(95)=11.2µs   p(99.9)=7.16ms
     http_req_connecting............: avg=28.12µs min=0s      med=0s      max=56.95ms p(90)=0s      p(95)=0s       p(99.9)=7.1ms 
     http_req_duration..............: avg=1.2s    min=7.13ms  med=1.17s   max=15.93s  p(90)=2.17s   p(95)=2.64s    p(99.9)=13.85s
       { expected_response:true }...: avg=1.2s    min=7.13ms  med=1.17s   max=15.93s  p(90)=2.17s   p(95)=2.64s    p(99.9)=13.85s
     http_req_failed................: 0.00%   ✓ 0          ✗ 10874
     http_req_receiving.............: avg=70.9µs  min=26.14µs med=52.22µs max=4.26ms  p(90)=95.2µs  p(95)=116.04µs p(99.9)=1.6ms 
     http_req_sending...............: avg=49.76µs min=6.2µs   med=12.49µs max=28.77ms p(90)=29.18µs p(95)=43.5µs   p(99.9)=8.41ms
     http_req_tls_handshaking.......: avg=0s      min=0s      med=0s      max=0s      p(90)=0s      p(95)=0s       p(99.9)=0s    
     http_req_waiting...............: avg=1.2s    min=7.08ms  med=1.17s   max=15.93s  p(90)=2.17s   p(95)=2.64s    p(99.9)=13.85s
     http_reqs......................: 10874   159.156216/s
     iteration_duration.............: avg=1.32s   min=7.93ms  med=1.28s   max=15.95s  p(90)=2.21s   p(95)=2.69s    p(99.9)=14s   
     iterations.....................: 9874    144.519815/s
     success_rate...................: 100.00% ✓ 9874       ✗ 0    
     vus............................: 86      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

Overview for: constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 173 14044 total, 0 failed avg: 215ms, p95: 227ms
hive-router 167 13597 total, 0 failed avg: 222ms, p95: 233ms
cosmo 165 13442 total, 0 failed avg: 225ms, p95: 248ms
hive-gateway-bun 164 12599 total, 0 failed avg: 240ms, p95: 265ms
hive-gateway 156 11983 total, 0 failed avg: 252ms, p95: 278ms
apollo-router 133 10856 total, 0 failed avg: 278ms, p95: 318ms
apollo-gateway 124 10161 total, 0 failed avg: 297ms, p95: 329ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41832      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   202 kB/s
     http_req_blocked...............: avg=18.29µs  min=1.18µs   med=1.87µs   max=9.28ms   p(90)=3.22µs   p(95)=4.65µs   p(99.9)=6.37ms  
     http_req_connecting............: avg=15.71µs  min=0s       med=0s       max=9.23ms   p(90)=0s       p(95)=0s       p(99.9)=6.35ms  
     http_req_duration..............: avg=215.1ms  min=161.86ms med=214.07ms max=595.13ms p(90)=223.68ms p(95)=226.63ms p(99.9)=519.61ms
       { expected_response:true }...: avg=215.1ms  min=161.86ms med=214.07ms max=595.13ms p(90)=223.68ms p(95)=226.63ms p(99.9)=519.61ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 14044
     http_req_receiving.............: avg=82.34µs  min=25.73µs  med=45.55µs  max=17.23ms  p(90)=94.01µs  p(95)=263.98µs p(99.9)=4.01ms  
     http_req_sending...............: avg=154.63µs min=5.54µs   med=8.41µs   max=351.94ms p(90)=30.35µs  p(95)=105.19µs p(99.9)=8.85ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=214.87ms min=158.95ms med=213.96ms max=594.17ms p(90)=223.55ms p(95)=226.39ms p(99.9)=487.47ms
     http_reqs......................: 14044   173.511815/s
     iteration_duration.............: avg=215.4ms  min=162.08ms med=214.33ms max=607.23ms p(90)=223.87ms p(95)=226.83ms p(99.9)=533.27ms
     iterations.....................: 13944   172.276328/s
     success_rate...................: 100.00% ✓ 13944      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40491      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   195 kB/s
     http_req_blocked...............: avg=19.39µs  min=1.16µs   med=2µs      max=9.28ms   p(90)=3.17µs   p(95)=4.81µs   p(99.9)=6.71ms  
     http_req_connecting............: avg=16.82µs  min=0s       med=0s       max=9.23ms   p(90)=0s       p(95)=0s       p(99.9)=6.69ms  
     http_req_duration..............: avg=222.49ms min=162.15ms med=221.57ms max=604.95ms p(90)=230.35ms p(95)=233.25ms p(99.9)=508.43ms
       { expected_response:true }...: avg=222.49ms min=162.15ms med=221.57ms max=604.95ms p(90)=230.35ms p(95)=233.25ms p(99.9)=508.43ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13597
     http_req_receiving.............: avg=83.33µs  min=24.23µs  med=44.54µs  max=15.77ms  p(90)=94.01µs  p(95)=266.13µs p(99.9)=5.01ms  
     http_req_sending...............: avg=133.02µs min=5.7µs    med=8.64µs   max=361.39ms p(90)=29.22µs  p(95)=107.86µs p(99.9)=11.49ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=222.27ms min=159.49ms med=221.47ms max=604.09ms p(90)=230.14ms p(95)=233.06ms p(99.9)=497.39ms
     http_reqs......................: 13597   167.813355/s
     iteration_duration.............: avg=222.87ms min=162.48ms med=221.82ms max=640.2ms  p(90)=230.56ms p(95)=233.45ms p(99.9)=540.22ms
     iterations.....................: 13497   166.579161/s
     success_rate...................: 100.00% ✓ 13497      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40026      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   193 kB/s
     http_req_blocked...............: avg=22.55µs  min=1.38µs   med=2.64µs   max=10.33ms  p(90)=3.91µs   p(95)=5.38µs   p(99.9)=7.66ms  
     http_req_connecting............: avg=19µs     min=0s       med=0s       max=10.28ms  p(90)=0s       p(95)=0s       p(99.9)=7.63ms  
     http_req_duration..............: avg=224.54ms min=136.55ms med=223.34ms max=637.97ms p(90)=241.8ms  p(95)=247.92ms p(99.9)=521.95ms
       { expected_response:true }...: avg=224.54ms min=136.55ms med=223.34ms max=637.97ms p(90)=241.8ms  p(95)=247.92ms p(99.9)=521.95ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13442
     http_req_receiving.............: avg=420.21µs min=31.54µs  med=62.45µs  max=243.13ms p(90)=377.55µs p(95)=790.19µs p(99.9)=24.54ms 
     http_req_sending...............: avg=83.37µs  min=6µs      med=11.05µs  max=202.2ms  p(90)=31.72µs  p(95)=130.06µs p(99.9)=3.7ms   
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=224.03ms min=136.45ms med=222.96ms max=636.66ms p(90)=241.05ms p(95)=247.31ms p(99.9)=521.17ms
     http_reqs......................: 13442   165.968325/s
     iteration_duration.............: avg=225.05ms min=136.86ms med=223.75ms max=660.84ms p(90)=242.16ms p(95)=248.22ms p(99.9)=576.05ms
     iterations.....................: 13342   164.733625/s
     success_rate...................: 100.00% ✓ 13342      ✗ 0    
     vus............................: 21      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 37497      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 15 MB   191 kB/s
     http_req_blocked...............: avg=23.87µs  min=1.12µs   med=2.53µs   max=10.86ms  p(90)=3.98µs   p(95)=5.17µs   p(99.9)=8.1ms   
     http_req_connecting............: avg=20.63µs  min=0s       med=0s       max=10.83ms  p(90)=0s       p(95)=0s       p(99.9)=8.05ms  
     http_req_duration..............: avg=239.74ms min=152.7ms  med=230.87ms max=738.77ms p(90)=255.82ms p(95)=265.01ms p(99.9)=732.88ms
       { expected_response:true }...: avg=239.74ms min=152.7ms  med=230.87ms max=738.77ms p(90)=255.82ms p(95)=265.01ms p(99.9)=732.88ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12599
     http_req_receiving.............: avg=87.22µs  min=25.71µs  med=44.57µs  max=17.92ms  p(90)=101.56µs p(95)=200.81µs p(99.9)=3.65ms  
     http_req_sending...............: avg=77.14µs  min=5.29µs   med=10.53µs  max=132.03ms p(90)=32.49µs  p(95)=121.04µs p(99.9)=4.91ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=239.57ms min=152.64ms med=230.75ms max=738.67ms p(90)=255.54ms p(95)=264.76ms p(99.9)=732.82ms
     http_reqs......................: 12599   164.489479/s
     iteration_duration.............: avg=240.7ms  min=153.01ms med=231.23ms max=739.02ms p(90)=256.21ms p(95)=265.34ms p(99.9)=733.17ms
     iterations.....................: 12499   163.183904/s
     success_rate...................: 100.00% ✓ 12499      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 35649      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 14 MB   182 kB/s
     http_req_blocked...............: avg=23.53µs  min=1.14µs   med=2.72µs   max=9.74ms   p(90)=4.79µs   p(95)=6.32µs   p(99.9)=7.35ms  
     http_req_connecting............: avg=19.84µs  min=0s       med=0s       max=9.71ms   p(90)=0s       p(95)=0s       p(99.9)=7.33ms  
     http_req_duration..............: avg=251.7ms  min=156.76ms med=241.99ms max=784.76ms p(90)=264.48ms p(95)=278.46ms p(99.9)=695.69ms
       { expected_response:true }...: avg=251.7ms  min=156.76ms med=241.99ms max=784.76ms p(90)=264.48ms p(95)=278.46ms p(99.9)=695.69ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11983
     http_req_receiving.............: avg=104.42µs min=27.4µs   med=50.99µs  max=22.49ms  p(90)=118.89µs p(95)=330.8µs  p(99.9)=4.89ms  
     http_req_sending...............: avg=110.34µs min=5.7µs    med=11.37µs  max=150.16ms p(90)=35.7µs   p(95)=145.83µs p(99.9)=5.99ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=251.49ms min=156.3ms  med=241.84ms max=783.9ms  p(90)=264.3ms  p(95)=278.31ms p(99.9)=695.61ms
     http_reqs......................: 11983   156.222441/s
     iteration_duration.............: avg=252.82ms min=157.01ms med=242.39ms max=795.67ms p(90)=264.86ms p(95)=278.96ms p(99.9)=698.74ms
     iterations.....................: 11883   154.918741/s
     success_rate...................: 100.00% ✓ 11883      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 32268      ✗ 0    
     data_received..................: 953 MB  12 MB/s
     data_sent......................: 13 MB   155 kB/s
     http_req_blocked...............: avg=23.27µs  min=1.39µs   med=2.96µs   max=7.84ms   p(90)=4.45µs   p(95)=5.74µs   p(99.9)=6.29ms  
     http_req_connecting............: avg=18.76µs  min=0s       med=0s       max=7.81ms   p(90)=0s       p(95)=0s       p(99.9)=6.27ms  
     http_req_duration..............: avg=277.99ms min=150.37ms med=278.87ms max=679.97ms p(90)=309.55ms p(95)=317.72ms p(99.9)=605.52ms
       { expected_response:true }...: avg=277.99ms min=150.37ms med=278.87ms max=679.97ms p(90)=309.55ms p(95)=317.72ms p(99.9)=605.52ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10856
     http_req_receiving.............: avg=161.68µs min=27.72µs  med=54.31µs  max=196.05ms p(90)=163.61µs p(95)=487.77µs p(99.9)=7.28ms  
     http_req_sending...............: avg=108.08µs min=6.1µs    med=11.57µs  max=212.76ms p(90)=97.21µs  p(95)=144.11µs p(99.9)=4.57ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=277.72ms min=150.3ms  med=278.59ms max=670.03ms p(90)=309.23ms p(95)=317.42ms p(99.9)=591.47ms
     http_reqs......................: 10856   133.491877/s
     iteration_duration.............: avg=279.1ms  min=150.59ms med=279.55ms max=717.33ms p(90)=309.94ms p(95)=318.47ms p(99.9)=641.74ms
     iterations.....................: 10756   132.262217/s
     success_rate...................: 100.00% ✓ 10756      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 30183      ✗ 0    
     data_received..................: 892 MB  11 MB/s
     data_sent......................: 12 MB   145 kB/s
     http_req_blocked...............: avg=32.79µs  min=1.33µs   med=3.16µs   max=11.12ms  p(90)=4.91µs   p(95)=5.86µs   p(99.9)=8.97ms  
     http_req_connecting............: avg=27.86µs  min=0s       med=0s       max=11.08ms  p(90)=0s       p(95)=0s       p(99.9)=8.94ms  
     http_req_duration..............: avg=297.38ms min=210.8ms  med=295.49ms max=794.01ms p(90)=319.53ms p(95)=328.95ms p(99.9)=687.82ms
       { expected_response:true }...: avg=297.38ms min=210.8ms  med=295.49ms max=794.01ms p(90)=319.53ms p(95)=328.95ms p(99.9)=687.82ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10161
     http_req_receiving.............: avg=110.47µs min=29.64µs  med=58.97µs  max=283.94ms p(90)=109.51µs p(95)=140.58µs p(99.9)=2.79ms  
     http_req_sending...............: avg=50.54µs  min=6.32µs   med=12.75µs  max=153.2ms  p(90)=22.38µs  p(95)=38.99µs  p(99.9)=2.65ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=297.22ms min=210.68ms med=295.37ms max=792.65ms p(90)=319.45ms p(95)=328.8ms  p(99.9)=681.42ms
     http_reqs......................: 10161   124.548697/s
     iteration_duration.............: avg=298.7ms  min=220.87ms med=296.05ms max=821.25ms p(90)=319.98ms p(95)=329.68ms p(99.9)=709.28ms
     iterations.....................: 10061   123.322944/s
     success_rate...................: 100.00% ✓ 10061      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

Overview for: constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 172 13959 total, 0 failed avg: 216ms, p95: 228ms
hive-router 168 13642 total, 0 failed avg: 222ms, p95: 233ms
cosmo 157 12744 total, 0 failed avg: 237ms, p95: 265ms
hive-gateway 154 11760 total, 0 failed avg: 257ms, p95: 290ms
hive-gateway-bun 150 11484 total, 0 failed avg: 263ms, p95: 313ms
apollo-router 123 10087 total, 0 failed avg: 300ms, p95: 345ms
apollo-gateway 87 7099 total, 0 failed avg: 426ms, p95: 469ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41577      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   200 kB/s
     http_req_blocked...............: avg=19.72µs  min=1.27µs   med=1.9µs    max=9.52ms   p(90)=3.31µs   p(95)=4.66µs   p(99.9)=7ms     
     http_req_connecting............: avg=17.21µs  min=0s       med=0s       max=9.48ms   p(90)=0s       p(95)=0s       p(99.9)=6.97ms  
     http_req_duration..............: avg=216.36ms min=157.7ms  med=215.43ms max=636.72ms p(90)=225.12ms p(95)=227.89ms p(99.9)=531.27ms
       { expected_response:true }...: avg=216.36ms min=157.7ms  med=215.43ms max=636.72ms p(90)=225.12ms p(95)=227.89ms p(99.9)=531.27ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13959
     http_req_receiving.............: avg=93.76µs  min=26.53µs  med=45.58µs  max=84.81ms  p(90)=96.46µs  p(95)=245.1µs  p(99.9)=7.82ms  
     http_req_sending...............: avg=117.13µs min=5.7µs    med=8.47µs   max=387.32ms p(90)=29.73µs  p(95)=95.22µs  p(99.9)=7.62ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=216.15ms min=157.65ms med=215.33ms max=623.69ms p(90)=224.93ms p(95)=227.7ms  p(99.9)=512.38ms
     http_reqs......................: 13959   172.045236/s
     iteration_duration.............: avg=216.67ms min=157.95ms med=215.69ms max=649.32ms p(90)=225.33ms p(95)=228.09ms p(99.9)=547.33ms
     iterations.....................: 13859   170.812732/s
     success_rate...................: 100.00% ✓ 13859      ✗ 0    
     vus............................: 15      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40626      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   196 kB/s
     http_req_blocked...............: avg=19.15µs  min=1.18µs   med=2.1µs    max=8.93ms   p(90)=2.99µs   p(95)=3.96µs   p(99.9)=6.59ms  
     http_req_connecting............: avg=16.68µs  min=0s       med=0s       max=8.9ms    p(90)=0s       p(95)=0s       p(99.9)=6.57ms  
     http_req_duration..............: avg=221.75ms min=112.5ms  med=220.51ms max=591.64ms p(90)=230.36ms p(95)=233.24ms p(99.9)=516.36ms
       { expected_response:true }...: avg=221.75ms min=112.5ms  med=220.51ms max=591.64ms p(90)=230.36ms p(95)=233.24ms p(99.9)=516.36ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13642
     http_req_receiving.............: avg=74.75µs  min=24.82µs  med=41.81µs  max=11.07ms  p(90)=80.73µs  p(95)=222.91µs p(99.9)=3.59ms  
     http_req_sending...............: avg=142.16µs min=5.6µs    med=9.17µs   max=353.35ms p(90)=27.38µs  p(95)=95.2µs   p(99.9)=5.56ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=221.53ms min=108.95ms med=220.41ms max=590.92ms p(90)=230.24ms p(95)=233.06ms p(99.9)=489.92ms
     http_reqs......................: 13642   168.591196/s
     iteration_duration.............: avg=222.11ms min=112.66ms med=220.77ms max=619.03ms p(90)=230.54ms p(95)=233.42ms p(99.9)=533.74ms
     iterations.....................: 13542   167.355372/s
     success_rate...................: 100.00% ✓ 13542      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 37932      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 15 MB   183 kB/s
     http_req_blocked...............: avg=21.23µs  min=1.41µs   med=2.75µs   max=9.16ms   p(90)=4.06µs   p(95)=5.26µs   p(99.9)=6.78ms  
     http_req_connecting............: avg=17.39µs  min=0s       med=0s       max=9.12ms   p(90)=0s       p(95)=0s       p(99.9)=6.77ms  
     http_req_duration..............: avg=237.32ms min=141.55ms med=236.64ms max=618.52ms p(90)=258.84ms p(95)=264.9ms  p(99.9)=528.94ms
       { expected_response:true }...: avg=237.32ms min=141.55ms med=236.64ms max=618.52ms p(90)=258.84ms p(95)=264.9ms  p(99.9)=528.94ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12744
     http_req_receiving.............: avg=324.56µs min=31.13µs  med=62.11µs  max=39.21ms  p(90)=178.85µs p(95)=479.05µs p(99.9)=32.23ms 
     http_req_sending...............: avg=84.3µs   min=5.83µs   med=10.95µs  max=222.27ms p(90)=29.61µs  p(95)=128.05µs p(99.9)=4.28ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=236.91ms min=141.47ms med=236.28ms max=617.28ms p(90)=258.45ms p(95)=264.37ms p(99.9)=527.74ms
     http_reqs......................: 12744   157.120754/s
     iteration_duration.............: avg=237.91ms min=141.85ms med=237.1ms  max=669.7ms  p(90)=259.18ms p(95)=265.32ms p(99.9)=564.39ms
     iterations.....................: 12644   155.887854/s
     success_rate...................: 100.00% ✓ 12644      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 34980      ✗ 0    
     data_received..................: 1.0 GB  14 MB/s
     data_sent......................: 14 MB   179 kB/s
     http_req_blocked...............: avg=27.04µs  min=1.14µs   med=2.57µs   max=11.22ms  p(90)=3.96µs   p(95)=5.04µs   p(99.9)=8.8ms   
     http_req_connecting............: avg=23.8µs   min=0s       med=0s       max=11.19ms  p(90)=0s       p(95)=0s       p(99.9)=8.77ms  
     http_req_duration..............: avg=256.76ms min=131.62ms med=247.59ms max=762.36ms p(90)=268.83ms p(95)=290.34ms p(99.9)=635.09ms
       { expected_response:true }...: avg=256.76ms min=131.62ms med=247.59ms max=762.36ms p(90)=268.83ms p(95)=290.34ms p(99.9)=635.09ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11760
     http_req_receiving.............: avg=85.88µs  min=24.67µs  med=43.08µs  max=19.26ms  p(90)=102.51µs p(95)=350.03µs p(99.9)=2.14ms  
     http_req_sending...............: avg=131.17µs min=5.43µs   med=10.81µs  max=255.71ms p(90)=35.84µs  p(95)=140.44µs p(99.9)=6.98ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=256.54ms min=127.84ms med=247.42ms max=761.64ms p(90)=268.61ms p(95)=289.42ms p(99.9)=634.07ms
     http_reqs......................: 11760   154.025686/s
     iteration_duration.............: avg=258.03ms min=131.79ms med=247.95ms max=788.11ms p(90)=269.23ms p(95)=292.08ms p(99.9)=673.45ms
     iterations.....................: 11660   152.715944/s
     success_rate...................: 100.00% ✓ 11660      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 34152      ✗ 0    
     data_received..................: 1.0 GB  13 MB/s
     data_sent......................: 13 MB   175 kB/s
     http_req_blocked...............: avg=31.85µs  min=1.16µs   med=2.62µs   max=12.25ms  p(90)=4.08µs   p(95)=5.51µs   p(99.9)=9.77ms  
     http_req_connecting............: avg=28.38µs  min=0s       med=0s       max=12.21ms  p(90)=0s       p(95)=0s       p(99.9)=9.73ms  
     http_req_duration..............: avg=262.58ms min=159.55ms med=252.47ms max=926.66ms p(90)=275.95ms p(95)=313.13ms p(99.9)=923.42ms
       { expected_response:true }...: avg=262.58ms min=159.55ms med=252.47ms max=926.66ms p(90)=275.95ms p(95)=313.13ms p(99.9)=923.42ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11484
     http_req_receiving.............: avg=106.26µs min=26.04µs  med=45.53µs  max=27.55ms  p(90)=109.55µs p(95)=374.87µs p(99.9)=6.36ms  
     http_req_sending...............: avg=103.16µs min=5.44µs   med=10.94µs  max=260.5ms  p(90)=34.88µs  p(95)=148.7µs  p(99.9)=7.72ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=262.37ms min=159.48ms med=252.31ms max=926.62ms p(90)=275.59ms p(95)=312.91ms p(99.9)=922.98ms
     http_reqs......................: 11484   150.61205/s
     iteration_duration.............: avg=263.91ms min=190.34ms med=252.87ms max=926.83ms p(90)=276.39ms p(95)=314.44ms p(99.9)=923.7ms 
     iterations.....................: 11384   149.300556/s
     success_rate...................: 100.00% ✓ 11384      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 29961      ✗ 0    
     data_received..................: 885 MB  11 MB/s
     data_sent......................: 12 MB   144 kB/s
     http_req_blocked...............: avg=24.24µs  min=1.85µs   med=2.84µs   max=8.14ms   p(90)=4.27µs   p(95)=5.23µs   p(99.9)=6.6ms   
     http_req_connecting............: avg=20.71µs  min=0s       med=0s       max=8.1ms    p(90)=0s       p(95)=0s       p(99.9)=6.58ms  
     http_req_duration..............: avg=299.68ms min=177.3ms  med=301.24ms max=721.51ms p(90)=335.81ms p(95)=344.99ms p(99.9)=637.39ms
       { expected_response:true }...: avg=299.68ms min=177.3ms  med=301.24ms max=721.51ms p(90)=335.81ms p(95)=344.99ms p(99.9)=637.39ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10087
     http_req_receiving.............: avg=89.83µs  min=37.95µs  med=53.36µs  max=5.03ms   p(90)=101.97µs p(95)=258.22µs p(99.9)=2.14ms  
     http_req_sending...............: avg=134.07µs min=7.88µs   med=11.34µs  max=334.89ms p(90)=26.33µs  p(95)=136.41µs p(99.9)=4.98ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=299.45ms min=177.19ms med=301.09ms max=718.95ms p(90)=335.61ms p(95)=344.71ms p(99.9)=635.99ms
     http_reqs......................: 10087   123.744502/s
     iteration_duration.............: avg=300.95ms min=177.55ms med=301.93ms max=751.55ms p(90)=336.26ms p(95)=345.41ms p(99.9)=657.89ms
     iterations.....................: 9987    122.51773/s
     success_rate...................: 100.00% ✓ 9987       ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 20997     ✗ 0   
     data_received..................: 624 MB  7.6 MB/s
     data_sent......................: 8.3 MB  101 kB/s
     http_req_blocked...............: avg=44.83µs  min=1.42µs   med=2.94µs   max=11.43ms  p(90)=4.28µs   p(95)=4.98µs   p(99.9)=9.97ms  
     http_req_connecting............: avg=41.4µs   min=0s       med=0s       max=11.38ms  p(90)=0s       p(95)=0s       p(99.9)=9.94ms  
     http_req_duration..............: avg=426.04ms min=210.37ms med=427.42ms max=995.24ms p(90)=457.2ms  p(95)=469.2ms  p(99.9)=919.53ms
       { expected_response:true }...: avg=426.04ms min=210.37ms med=427.42ms max=995.24ms p(90)=457.2ms  p(95)=469.2ms  p(99.9)=919.53ms
     http_req_failed................: 0.00%   ✓ 0         ✗ 7099
     http_req_receiving.............: avg=75.42µs  min=30.38µs  med=50.86µs  max=76.97ms  p(90)=90.66µs  p(95)=106.98µs p(99.9)=485.3µs 
     http_req_sending...............: avg=48.94µs  min=6.43µs   med=12.3µs   max=153.65ms p(90)=17.97µs  p(95)=22.82µs  p(99.9)=1.32ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=425.91ms min=210.25ms med=427.35ms max=973.49ms p(90)=457.12ms p(95)=469.08ms p(99.9)=917.23ms
     http_reqs......................: 7099    87.04109/s
     iteration_duration.............: avg=429.82ms min=264.61ms med=427.97ms max=1.04s    p(90)=457.81ms p(95)=469.6ms  p(99.9)=992.27ms
     iterations.....................: 6999    85.814987/s
     success_rate...................: 100.00% ✓ 6999      ✗ 0   
     vus............................: 50      min=0       max=50
     vus_max........................: 50      min=50      max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@ardatan ardatan merged commit c5d05a3 into main Oct 10, 2025
34 checks passed
@ardatan ardatan deleted the renovate/bun-1.x branch October 10, 2025 22:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant