Skip to content

Conversation

renovate[bot]
Copy link
Contributor

@renovate renovate bot commented Sep 16, 2025

Coming soon: The Renovate bot (GitHub App) will be renamed to Mend. PRs from Renovate will soon appear from 'Mend'. Learn more here.

This PR contains the following updates:

Package Change Age Confidence
@types/node (source) 22.18.3 -> 22.18.4 age confidence

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.


  • If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

@renovate renovate bot added the dependencies Pull requests that update a dependency file label Sep 16, 2025
@github-actions
Copy link

💻 Website Preview

The latest changes are available as preview in: https://1a21e506.federation-gateway-benchmark.pages.dev

@github-actions
Copy link

Overview for: constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1839 110816 total, 0 failed avg: 27ms, p95: 47ms
grafbase 1728 104321 total, 0 failed avg: 29ms, p95: 50ms
cosmo 645 39007 total, 0 failed avg: 77ms, p95: 112ms
apollo-router 361 21954 total, 0 failed avg: 137ms, p95: 177ms
hive-gateway 305 18685 total, 0 failed avg: 160ms, p95: 218ms
hive-gateway-bun 266 16336 total, 0 failed avg: 184ms, p95: 361ms
apollo-gateway 117 7207 total, 0 failed avg: 417ms, p95: 492ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 332148      ✗ 0     
     data_received..................: 9.7 GB  161 MB/s
     data_sent......................: 129 MB  2.1 MB/s
     http_req_blocked...............: avg=5.18µs   min=1.18µs  med=2.56µs  max=9.76ms   p(90)=3.75µs  p(95)=4.46µs   p(99.9)=54.66µs
     http_req_connecting............: avg=2.13µs   min=0s      med=0s      max=9.72ms   p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_duration..............: avg=26.86ms  min=1.89ms  med=24.47ms max=437.09ms p(90)=41.16ms p(95)=47.39ms  p(99.9)=85.42ms
       { expected_response:true }...: avg=26.86ms  min=1.89ms  med=24.47ms max=437.09ms p(90)=41.16ms p(95)=47.39ms  p(99.9)=85.42ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 110816
     http_req_receiving.............: avg=110.53µs min=25.07µs med=43.64µs max=88.49ms  p(90)=114.1µs p(95)=340.23µs p(99.9)=10.27ms
     http_req_sending...............: avg=84.8µs   min=5.32µs  med=10.31µs max=344.37ms p(90)=31.65µs p(95)=123.4µs  p(99.9)=10.87ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=26.66ms  min=1.85ms  med=24.33ms max=426.84ms p(90)=40.81ms p(95)=46.98ms  p(99.9)=83.98ms
     http_reqs......................: 110816  1839.248411/s
     iteration_duration.............: avg=27.08ms  min=3.49ms  med=24.68ms max=453.62ms p(90)=41.37ms p(95)=47.6ms   p(99.9)=86.87ms
     iterations.....................: 110716  1837.588679/s
     success_rate...................: 100.00% ✓ 110716      ✗ 0     
     vus............................: 50      min=50        max=50  
     vus_max........................: 50      min=50        max=50  

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 312663      ✗ 0     
     data_received..................: 9.2 GB  152 MB/s
     data_sent......................: 121 MB  2.0 MB/s
     http_req_blocked...............: avg=5.63µs   min=1.1µs   med=2.9µs   max=8.99ms   p(90)=3.94µs   p(95)=4.84µs   p(99.9)=109.29µs
     http_req_connecting............: avg=2.11µs   min=0s      med=0s      max=8.96ms   p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_duration..............: avg=28.53ms  min=2.86ms  med=25.58ms max=454.13ms p(90)=43.41ms  p(95)=49.9ms   p(99.9)=87.95ms 
       { expected_response:true }...: avg=28.53ms  min=2.86ms  med=25.58ms max=454.13ms p(90)=43.41ms  p(95)=49.9ms   p(99.9)=87.95ms 
     http_req_failed................: 0.00%   ✓ 0           ✗ 104321
     http_req_receiving.............: avg=124.93µs min=23.98µs med=45.89µs max=46.22ms  p(90)=131.46µs p(95)=360.72µs p(99.9)=12.67ms 
     http_req_sending...............: avg=100.28µs min=5.26µs  med=11.36µs max=384.03ms p(90)=34.63µs  p(95)=125.15µs p(99.9)=14.36ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=28.31ms  min=2.82ms  med=25.42ms max=452.8ms  p(90)=43.03ms  p(95)=49.45ms  p(99.9)=86.5ms  
     http_reqs......................: 104321  1728.038155/s
     iteration_duration.............: avg=28.77ms  min=7.15ms  med=25.8ms  max=468.05ms p(90)=43.64ms  p(95)=50.11ms  p(99.9)=88.53ms 
     iterations.....................: 104221  1726.381692/s
     success_rate...................: 100.00% ✓ 104221      ✗ 0     
     vus............................: 50      min=50        max=50  
     vus_max........................: 50      min=50        max=50  

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 116721     ✗ 0    
     data_received..................: 3.4 GB  57 MB/s
     data_sent......................: 45 MB   750 kB/s
     http_req_blocked...............: avg=16.47µs  min=1.36µs med=2.8µs   max=19.32ms  p(90)=4.29µs   p(95)=5.21µs   p(99.9)=6.11ms  
     http_req_connecting............: avg=12.94µs  min=0s     med=0s      max=19.3ms   p(90)=0s       p(95)=0s       p(99.9)=6.09ms  
     http_req_duration..............: avg=76.71ms  min=2.85ms med=75.59ms max=494.69ms p(90)=103.6ms  p(95)=112.09ms p(99.9)=283.47ms
       { expected_response:true }...: avg=76.71ms  min=2.85ms med=75.59ms max=494.69ms p(90)=103.6ms  p(95)=112.09ms p(99.9)=283.47ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 39007
     http_req_receiving.............: avg=166.07µs min=28.8µs med=78.18µs max=45.25ms  p(90)=161.03µs p(95)=378.61µs p(99.9)=14.4ms  
     http_req_sending...............: avg=70.84µs  min=6.26µs med=11.44µs max=287.43ms p(90)=28.93µs  p(95)=120.11µs p(99.9)=7.08ms  
     http_req_tls_handshaking.......: avg=0s       min=0s     med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=76.47ms  min=2.76ms med=75.36ms max=492.97ms p(90)=103.39ms p(95)=111.84ms p(99.9)=276.49ms
     http_reqs......................: 39007   645.179253/s
     iteration_duration.............: avg=77.16ms  min=5.7ms  med=75.87ms max=552.56ms p(90)=103.86ms p(95)=112.39ms p(99.9)=311.21ms
     iterations.....................: 38907   643.525244/s
     success_rate...................: 100.00% ✓ 38907      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 65562      ✗ 0    
     data_received..................: 1.9 GB  32 MB/s
     data_sent......................: 26 MB   420 kB/s
     http_req_blocked...............: avg=12.9µs   min=1.92µs  med=3.16µs   max=7.87ms   p(90)=4.71µs   p(95)=5.51µs   p(99.9)=4.52ms  
     http_req_connecting............: avg=9.13µs   min=0s      med=0s       max=7.83ms   p(90)=0s       p(95)=0s       p(99.9)=4.5ms   
     http_req_duration..............: avg=136.56ms min=6.13ms  med=136.02ms max=604.35ms p(90)=167.68ms p(95)=177.29ms p(99.9)=414.13ms
       { expected_response:true }...: avg=136.56ms min=6.13ms  med=136.02ms max=604.35ms p(90)=167.68ms p(95)=177.29ms p(99.9)=414.13ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 21954
     http_req_receiving.............: avg=80.93µs  min=37.24µs med=56.21µs  max=9.22ms   p(90)=105.96µs p(95)=141.1µs  p(99.9)=1.22ms  
     http_req_sending...............: avg=67.25µs  min=7.66µs  med=12.27µs  max=231.66ms p(90)=21.2µs   p(95)=36.98µs  p(99.9)=1.9ms   
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=136.42ms min=6.05ms  med=135.89ms max=603.25ms p(90)=167.54ms p(95)=177.1ms  p(99.9)=410.71ms
     http_reqs......................: 21954   361.046031/s
     iteration_duration.............: avg=137.45ms min=33ms    med=136.36ms max=658.12ms p(90)=167.96ms p(95)=177.61ms p(99.9)=446.29ms
     iterations.....................: 21854   359.401474/s
     success_rate...................: 100.00% ✓ 21854      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 55755      ✗ 0    
     data_received..................: 1.6 GB  27 MB/s
     data_sent......................: 22 MB   355 kB/s
     http_req_blocked...............: avg=19.57µs  min=1.16µs  med=2.73µs   max=11.26ms  p(90)=4.55µs   p(95)=5.6µs    p(99.9)=7.21ms  
     http_req_connecting............: avg=15.75µs  min=0s      med=0s       max=11.23ms  p(90)=0s       p(95)=0s       p(99.9)=7.18ms  
     http_req_duration..............: avg=160.3ms  min=6.73ms  med=148.78ms max=678.48ms p(90)=177.35ms p(95)=217.73ms p(99.9)=528.73ms
       { expected_response:true }...: avg=160.3ms  min=6.73ms  med=148.78ms max=678.48ms p(90)=177.35ms p(95)=217.73ms p(99.9)=528.73ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 18685
     http_req_receiving.............: avg=91.5µs   min=26.3µs  med=47.08µs  max=28.62ms  p(90)=103.81µs p(95)=186.99µs p(99.9)=3.37ms  
     http_req_sending...............: avg=77.48µs  min=5.57µs  med=11.26µs  max=261.69ms p(90)=32.29µs  p(95)=120.41µs p(99.9)=4.09ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=160.14ms min=6.67ms  med=148.67ms max=677.69ms p(90)=177.19ms p(95)=217.67ms p(99.9)=528.67ms
     http_reqs......................: 18685   305.626262/s
     iteration_duration.............: avg=161.47ms min=26.13ms med=149.15ms max=711.2ms  p(90)=177.68ms p(95)=219.85ms p(99.9)=572.61ms
     iterations.....................: 18585   303.990585/s
     success_rate...................: 100.00% ✓ 18585      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 48708      ✗ 0    
     data_received..................: 1.4 GB  23 MB/s
     data_sent......................: 19 MB   310 kB/s
     http_req_blocked...............: avg=22.35µs  min=1.3µs   med=3µs      max=11.82ms  p(90)=5.2µs    p(95)=6.62µs   p(99.9)=8.05ms  
     http_req_connecting............: avg=17.99µs  min=0s      med=0s       max=11.79ms  p(90)=0s       p(95)=0s       p(99.9)=7.73ms  
     http_req_duration..............: avg=183.71ms min=8.46ms  med=170.41ms max=726.09ms p(90)=208.44ms p(95)=360.55ms p(99.9)=553.06ms
       { expected_response:true }...: avg=183.71ms min=8.46ms  med=170.41ms max=726.09ms p(90)=208.44ms p(95)=360.55ms p(99.9)=553.06ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 16336
     http_req_receiving.............: avg=109.82µs min=26.69µs med=54.54µs  max=52.9ms   p(90)=123.47µs p(95)=246.34µs p(99.9)=5.56ms  
     http_req_sending...............: avg=95.78µs  min=5.9µs   med=11.82µs  max=243.19ms p(90)=33.17µs  p(95)=129.91µs p(99.9)=4.74ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=183.51ms min=8.36ms  med=170.23ms max=725.27ms p(90)=208.27ms p(95)=360.24ms p(99.9)=551.97ms
     http_reqs......................: 16336   266.089672/s
     iteration_duration.............: avg=185.21ms min=34.99ms med=170.83ms max=769.4ms  p(90)=208.79ms p(95)=361.89ms p(99.9)=638.34ms
     iterations.....................: 16236   264.460817/s
     success_rate...................: 100.00% ✓ 16236      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 21321      ✗ 0   
     data_received..................: 633 MB  10 MB/s
     data_sent......................: 8.4 MB  137 kB/s
     http_req_blocked...............: avg=45.12µs  min=1.41µs   med=3.07µs   max=11.77ms  p(90)=5.09µs   p(95)=5.85µs   p(99.9)=10.13ms 
     http_req_connecting............: avg=41.47µs  min=0s       med=0s       max=11.74ms  p(90)=0s       p(95)=0s       p(99.9)=10.1ms  
     http_req_duration..............: avg=417.12ms min=7.16ms   med=416.06ms max=875.88ms p(90)=473.88ms p(95)=491.83ms p(99.9)=759.97ms
       { expected_response:true }...: avg=417.12ms min=7.16ms   med=416.06ms max=875.88ms p(90)=473.88ms p(95)=491.83ms p(99.9)=759.97ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 7207
     http_req_receiving.............: avg=66.42µs  min=32.2µs   med=54.2µs   max=919.45µs p(90)=103.4µs  p(95)=119.06µs p(99.9)=353.04µs
     http_req_sending...............: avg=69.56µs  min=6.54µs   med=12.48µs  max=154.63ms p(90)=21.79µs  p(95)=25.55µs  p(99.9)=1.42ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=416.98ms min=7.11ms   med=416ms    max=874.41ms p(90)=473.82ms p(95)=491.75ms p(99.9)=758.87ms
     http_reqs......................: 7207    117.856649/s
     iteration_duration.............: avg=423.47ms min=156.43ms med=416.62ms max=921.57ms p(90)=474.72ms p(95)=492.77ms p(99.9)=897.1ms 
     iterations.....................: 7107    116.221341/s
     success_rate...................: 100.00% ✓ 7107       ✗ 0   
     vus............................: 33      min=33       max=50
     vus_max........................: 50      min=50       max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@github-actions
Copy link

Overview for: constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 173 14037 total, 0 failed avg: 215ms, p95: 226ms
hive-router 173 14022 total, 0 failed avg: 215ms, p95: 226ms
hive-gateway 167 12869 total, 0 failed avg: 234ms, p95: 256ms
cosmo 165 13444 total, 0 failed avg: 225ms, p95: 250ms
hive-gateway-bun 161 12395 total, 0 failed avg: 244ms, p95: 275ms
apollo-router 137 11187 total, 0 failed avg: 271ms, p95: 315ms ❌ 1 unexpected GraphQL errors
apollo-gateway 126 10352 total, 0 failed avg: 292ms, p95: 324ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41811      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   202 kB/s
     http_req_blocked...............: avg=37.65µs  min=1.16µs   med=1.96µs   max=18.36ms  p(90)=3.5µs    p(95)=5.25µs   p(99.9)=12.11ms 
     http_req_connecting............: avg=34.35µs  min=0s       med=0s       max=18.26ms  p(90)=0s       p(95)=0s       p(99.9)=11.93ms 
     http_req_duration..............: avg=215.46ms min=118.91ms med=214.78ms max=583.28ms p(90)=223.5ms  p(95)=225.93ms p(99.9)=487.9ms 
       { expected_response:true }...: avg=215.46ms min=118.91ms med=214.78ms max=583.28ms p(90)=223.5ms  p(95)=225.93ms p(99.9)=487.9ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 14037
     http_req_receiving.............: avg=85.58µs  min=27.07µs  med=46.78µs  max=15.03ms  p(90)=95.46µs  p(95)=273.1µs  p(99.9)=5.68ms  
     http_req_sending...............: avg=115.87µs min=5.38µs   med=8.61µs   max=335.31ms p(90)=30.47µs  p(95)=96µs     p(99.9)=5.73ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=215.26ms min=118.85ms med=214.66ms max=582.79ms p(90)=223.36ms p(95)=225.75ms p(99.9)=476.48ms
     http_reqs......................: 14037   173.266701/s
     iteration_duration.............: avg=215.73ms min=119.06ms med=214.99ms max=594.09ms p(90)=223.68ms p(95)=226.11ms p(99.9)=506.07ms
     iterations.....................: 13937   172.032344/s
     success_rate...................: 100.00% ✓ 13937      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41766      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   202 kB/s
     http_req_blocked...............: avg=44.26µs  min=1.16µs   med=2.09µs   max=15.69ms  p(90)=3.25µs   p(95)=4.45µs   p(99.9)=13.3ms  
     http_req_connecting............: avg=41.52µs  min=0s       med=0s       max=15.66ms  p(90)=0s       p(95)=0s       p(99.9)=13.28ms 
     http_req_duration..............: avg=215.21ms min=157.18ms med=213.67ms max=578.42ms p(90)=222.33ms p(95)=225.7ms  p(99.9)=486.83ms
       { expected_response:true }...: avg=215.21ms min=157.18ms med=213.67ms max=578.42ms p(90)=222.33ms p(95)=225.7ms  p(99.9)=486.83ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 14022
     http_req_receiving.............: avg=71.39µs  min=25.61µs  med=41.87µs  max=8.8ms    p(90)=83.64µs  p(95)=240.18µs p(99.9)=1.65ms  
     http_req_sending...............: avg=132.07µs min=5.6µs    med=8.94µs   max=324.01ms p(90)=27.05µs  p(95)=96.7µs   p(99.9)=4.15ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=215.01ms min=157.14ms med=213.58ms max=576.63ms p(90)=222.2ms  p(95)=225.56ms p(99.9)=470.82ms
     http_reqs......................: 14022   173.588114/s
     iteration_duration.............: avg=215.5ms  min=157.36ms med=213.88ms max=593.2ms  p(90)=222.5ms  p(95)=225.89ms p(99.9)=507.17ms
     iterations.....................: 13922   172.350145/s
     success_rate...................: 100.00% ✓ 13922      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 38307      ✗ 0    
     data_received..................: 1.1 GB  15 MB/s
     data_sent......................: 15 MB   195 kB/s
     http_req_blocked...............: avg=24.95µs  min=1.16µs   med=2.56µs   max=11.48ms  p(90)=4.14µs   p(95)=5.35µs   p(99.9)=8.46ms  
     http_req_connecting............: avg=21.63µs  min=0s       med=0s       max=11.43ms  p(90)=0s       p(95)=0s       p(99.9)=8.43ms  
     http_req_duration..............: avg=234.3ms  min=145.4ms  med=227.21ms max=763.35ms p(90)=245.82ms p(95)=256.35ms p(99.9)=657.34ms
       { expected_response:true }...: avg=234.3ms  min=145.4ms  med=227.21ms max=763.35ms p(90)=245.82ms p(95)=256.35ms p(99.9)=657.34ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12869
     http_req_receiving.............: avg=86.65µs  min=25.68µs  med=44.28µs  max=84.03ms  p(90)=97.14µs  p(95)=151.21µs p(99.9)=3.51ms  
     http_req_sending...............: avg=102.24µs min=5.33µs   med=10.63µs  max=164.35ms p(90)=31.08µs  p(95)=98.68µs  p(99.9)=5.51ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=234.11ms min=145.34ms med=227.07ms max=762.59ms p(90)=245.68ms p(95)=255.91ms p(99.9)=655.95ms
     http_reqs......................: 12869   167.959626/s
     iteration_duration.............: avg=235.23ms min=145.61ms med=227.5ms  max=791.58ms p(90)=246.13ms p(95)=256.61ms p(99.9)=683.81ms
     iterations.....................: 12769   166.654477/s
     success_rate...................: 100.00% ✓ 12769      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40032      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   193 kB/s
     http_req_blocked...............: avg=21.6µs   min=1.51µs   med=2.65µs   max=10.39ms  p(90)=3.85µs   p(95)=4.91µs   p(99.9)=7.03ms  
     http_req_connecting............: avg=17.85µs  min=0s       med=0s       max=10.34ms  p(90)=0s       p(95)=0s       p(99.9)=7.01ms  
     http_req_duration..............: avg=224.73ms min=147.58ms med=223.69ms max=621.59ms p(90)=244.13ms p(95)=249.65ms p(99.9)=511.63ms
       { expected_response:true }...: avg=224.73ms min=147.58ms med=223.69ms max=621.59ms p(90)=244.13ms p(95)=249.65ms p(99.9)=511.63ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13444
     http_req_receiving.............: avg=517.45µs min=25.72µs  med=64.03µs  max=35.1ms   p(90)=362.85µs p(95)=781µs    p(99.9)=29.42ms 
     http_req_sending...............: avg=116.95µs min=6.54µs   med=11.09µs  max=219.54ms p(90)=32.84µs  p(95)=121.71µs p(99.9)=11.67ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=224.1ms  min=147.52ms med=223.11ms max=617.32ms p(90)=243.43ms p(95)=249.03ms p(99.9)=502.85ms
     http_reqs......................: 13444   165.939206/s
     iteration_duration.............: avg=225.12ms min=147.76ms med=224.07ms max=636.47ms p(90)=244.45ms p(95)=249.94ms p(99.9)=540.28ms
     iterations.....................: 13344   164.704907/s
     success_rate...................: 100.00% ✓ 13344      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 36885      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 14 MB   188 kB/s
     http_req_blocked...............: avg=24.87µs  min=1.19µs   med=2.76µs   max=10.77ms  p(90)=4.51µs   p(95)=5.83µs   p(99.9)=7.94ms  
     http_req_connecting............: avg=21.07µs  min=0s       med=0s       max=10.72ms  p(90)=0s       p(95)=0s       p(99.9)=7.87ms  
     http_req_duration..............: avg=243.51ms min=160.29ms med=235.32ms max=863.66ms p(90)=261.4ms  p(95)=274.64ms p(99.9)=745.26ms
       { expected_response:true }...: avg=243.51ms min=160.29ms med=235.32ms max=863.66ms p(90)=261.4ms  p(95)=274.64ms p(99.9)=745.26ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12395
     http_req_receiving.............: avg=94.36µs  min=26.44µs  med=48.47µs  max=24.45ms  p(90)=110.03µs p(95)=230.19µs p(99.9)=5.34ms  
     http_req_sending...............: avg=133.43µs min=5.46µs   med=11.24µs  max=239.42ms p(90)=33.41µs  p(95)=125.02µs p(99.9)=6.7ms   
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=243.28ms min=160.16ms med=235.18ms max=862.35ms p(90)=261.3ms  p(95)=274.15ms p(99.9)=744.15ms
     http_reqs......................: 12395   161.737576/s
     iteration_duration.............: avg=244.48ms min=164.9ms  med=235.7ms  max=891.64ms p(90)=261.68ms p(95)=275.02ms p(99.9)=760.41ms
     iterations.....................: 12295   160.432714/s
     success_rate...................: 100.00% ✓ 12295      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  99% — ✓ 11086 / ✗ 1
     ✓ valid response structure

     checks.........................: 99.99% ✓ 33260      ✗ 1    
     data_received..................: 982 MB 12 MB/s
     data_sent......................: 13 MB  160 kB/s
     http_req_blocked...............: avg=25.45µs  min=1.69µs   med=2.79µs   max=9.49ms   p(90)=4.3µs    p(95)=5.24µs   p(99.9)=7.36ms  
     http_req_connecting............: avg=20.83µs  min=0s       med=0s       max=9.45ms   p(90)=0s       p(95)=0s       p(99.9)=7.34ms  
     http_req_duration..............: avg=270.59ms min=168.96ms med=270.32ms max=683.57ms p(90)=304.88ms p(95)=314.63ms p(99.9)=589.76ms
       { expected_response:true }...: avg=270.59ms min=168.96ms med=270.32ms max=683.57ms p(90)=304.88ms p(95)=314.63ms p(99.9)=589.76ms
     http_req_failed................: 0.00%  ✓ 0          ✗ 11187
     http_req_receiving.............: avg=121.14µs min=33.19µs  med=53.44µs  max=9.48ms   p(90)=158.99µs p(95)=473.89µs p(99.9)=4.7ms   
     http_req_sending...............: avg=134.43µs min=7.41µs   med=11.3µs   max=219.41ms p(90)=80.22µs  p(95)=146.55µs p(99.9)=4.94ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=270.33ms min=168.91ms med=270.2ms  max=682.38ms p(90)=304.58ms p(95)=314.2ms  p(99.9)=588.87ms
     http_reqs......................: 11187  137.145697/s
     iteration_duration.............: avg=271.42ms min=169.14ms med=270.87ms max=720.31ms p(90)=305.33ms p(95)=314.98ms p(99.9)=607.68ms
     iterations.....................: 11087  135.919759/s
     success_rate...................: 99.99% ✓ 11086      ✗ 1    
     vus............................: 50     min=0        max=50 
     vus_max........................: 50     min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 30756      ✗ 0    
     data_received..................: 909 MB  11 MB/s
     data_sent......................: 12 MB   148 kB/s
     http_req_blocked...............: avg=61.81µs  min=1.39µs   med=3.22µs   max=18.08ms  p(90)=4.98µs   p(95)=5.83µs   p(99.9)=16.7ms  
     http_req_connecting............: avg=55.05µs  min=0s       med=0s       max=17.87ms  p(90)=0s       p(95)=0s       p(99.9)=16.51ms 
     http_req_duration..............: avg=291.83ms min=211.08ms med=289.54ms max=781.06ms p(90)=314.97ms p(95)=323.61ms p(99.9)=676.57ms
       { expected_response:true }...: avg=291.83ms min=211.08ms med=289.54ms max=781.06ms p(90)=314.97ms p(95)=323.61ms p(99.9)=676.57ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10352
     http_req_receiving.............: avg=97.08µs  min=29.5µs   med=61.26µs  max=118.02ms p(90)=110.72µs p(95)=139.35µs p(99.9)=2.67ms  
     http_req_sending...............: avg=100.34µs min=6.29µs   med=12.89µs  max=252.59ms p(90)=22.41µs  p(95)=37.52µs  p(99.9)=4.64ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=291.63ms min=210.99ms med=289.42ms max=778.47ms p(90)=314.84ms p(95)=323.49ms p(99.9)=675.96ms
     http_reqs......................: 10352   126.918719/s
     iteration_duration.............: avg=293.06ms min=216.44ms med=290.01ms max=810.99ms p(90)=315.34ms p(95)=324.05ms p(99.9)=749.07ms
     iterations.....................: 10252   125.692688/s
     success_rate...................: 100.00% ✓ 10252      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@github-actions
Copy link

Overview for: ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 500 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 2018 125600 total, 0 failed avg: 111ms, p95: 273ms
grafbase 1651 104288 total, 0 failed avg: 133ms, p95: 317ms
cosmo 691 44128 total, 0 failed avg: 318ms, p95: 703ms
apollo-router 407 27286 total, 0 failed avg: 517ms, p95: 1167ms ❌ 18 unexpected GraphQL errors
hive-gateway 266 18668 total, 0 failed avg: 751ms, p95: 1599ms
hive-gateway-bun 265 18589 total, 0 failed avg: 754ms, p95: 1626ms
apollo-gateway 149 10322 total, 0 failed avg: 1256ms, p95: 2694ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 373800      ✗ 0     
     data_received..................: 11 GB   177 MB/s
     data_sent......................: 146 MB  2.3 MB/s
     http_req_blocked...............: avg=345.98µs min=1.06µs  med=2.38µs   max=293.42ms p(90)=3.72µs   p(95)=4.43µs   p(99.9)=131.93ms
     http_req_connecting............: avg=341.98µs min=0s      med=0s       max=293.37ms p(90)=0s       p(95)=0s       p(99.9)=131.46ms
     http_req_duration..............: avg=110.75ms min=1.66ms  med=99.21ms  max=396.62ms p(90)=226.32ms p(95)=272.67ms p(99.9)=349.38ms
       { expected_response:true }...: avg=110.75ms min=1.66ms  med=99.21ms  max=396.62ms p(90)=226.32ms p(95)=272.67ms p(99.9)=349.38ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 125600
     http_req_receiving.............: avg=428.24µs min=22.44µs med=40.43µs  max=116.67ms p(90)=157.23µs p(95)=370.33µs p(99.9)=62.04ms 
     http_req_sending...............: avg=326.38µs min=4.88µs  med=9.75µs   max=118.94ms p(90)=27.07µs  p(95)=120.9µs  p(99.9)=56.83ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=110ms    min=1.62ms  med=98.63ms  max=366.24ms p(90)=224.45ms p(95)=271.05ms p(99.9)=346.34ms
     http_reqs......................: 125600  2018.646427/s
     iteration_duration.............: avg=112.41ms min=1.76ms  med=100.44ms max=648.55ms p(90)=228.73ms p(95)=275.44ms p(99.9)=436.45ms
     iterations.....................: 124600  2002.574402/s
     success_rate...................: 100.00% ✓ 124600      ✗ 0     
     vus............................: 70      min=0         max=495 
     vus_max........................: 500     min=500       max=500 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 309864      ✗ 0     
     data_received..................: 9.2 GB  145 MB/s
     data_sent......................: 121 MB  1.9 MB/s
     http_req_blocked...............: avg=557.81µs min=1.2µs   med=3.02µs   max=381.25ms p(90)=4.46µs   p(95)=5.53µs   p(99.9)=192.81ms
     http_req_connecting............: avg=552.63µs min=0s      med=0s       max=381.19ms p(90)=0s       p(95)=0s       p(99.9)=192.76ms
     http_req_duration..............: avg=133.48ms min=2.46ms  med=121.65ms max=459.83ms p(90)=266.45ms p(95)=316.54ms p(99.9)=412.25ms
       { expected_response:true }...: avg=133.48ms min=2.46ms  med=121.65ms max=459.83ms p(90)=266.45ms p(95)=316.54ms p(99.9)=412.25ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 104288
     http_req_receiving.............: avg=583.39µs min=23.76µs med=47.83µs  max=158.55ms p(90)=186.66µs p(95)=437.66µs p(99.9)=80.71ms 
     http_req_sending...............: avg=451.39µs min=5.08µs  med=11.82µs  max=156ms    p(90)=32.26µs  p(95)=139.84µs p(99.9)=74.24ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=132.44ms min=2.42ms  med=120.59ms max=429.19ms p(90)=263.71ms p(95)=314.65ms p(99.9)=409.26ms
     http_reqs......................: 104288  1651.055389/s
     iteration_duration.............: avg=135.66ms min=2.71ms  med=123.42ms max=774.44ms p(90)=269.76ms p(95)=319.6ms  p(99.9)=467.51ms
     iterations.....................: 103288  1635.223698/s
     success_rate...................: 100.00% ✓ 103288      ✗ 0     
     vus............................: 66      min=0         max=497 
     vus_max........................: 500     min=500       max=500 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 129384     ✗ 0    
     data_received..................: 3.9 GB  61 MB/s
     data_sent......................: 51 MB   805 kB/s
     http_req_blocked...............: avg=95.49µs  min=1.36µs  med=2.77µs   max=145.37ms p(90)=4.27µs   p(95)=6.16µs   p(99.9)=30.35ms
     http_req_connecting............: avg=90.09µs  min=0s      med=0s       max=145.19ms p(90)=0s       p(95)=0s       p(99.9)=30.29ms
     http_req_duration..............: avg=318.26ms min=2.8ms   med=300.64ms max=1.5s     p(90)=622.76ms p(95)=702.97ms p(99.9)=1.12s  
       { expected_response:true }...: avg=318.26ms min=2.8ms   med=300.64ms max=1.5s     p(90)=622.76ms p(95)=702.97ms p(99.9)=1.12s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 44128
     http_req_receiving.............: avg=411.33µs min=29.28µs med=61.64µs  max=216.42ms p(90)=175.47µs p(95)=454.85µs p(99.9)=61.31ms
     http_req_sending...............: avg=145.49µs min=6.14µs  med=11.21µs  max=99.87ms  p(90)=29.25µs  p(95)=126.1µs  p(99.9)=31.75ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=317.7ms  min=2.73ms  med=300.32ms max=1.5s     p(90)=622.03ms p(95)=702.21ms p(99.9)=1.12s  
     http_reqs......................: 44128   691.554795/s
     iteration_duration.............: avg=326.1ms  min=3.06ms  med=310.09ms max=1.5s     p(90)=627.05ms p(95)=705.76ms p(99.9)=1.12s  
     iterations.....................: 43128   675.883231/s
     success_rate...................: 100.00% ✓ 43128      ✗ 0    
     vus............................: 52      min=0        max=499
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  99% — ✓ 26268 / ✗ 18
     ✓ valid response structure

     checks.........................: 99.97% ✓ 78840      ✗ 18   
     data_received..................: 2.4 GB 36 MB/s
     data_sent......................: 32 MB  475 kB/s
     http_req_blocked...............: avg=70.95µs  min=1.74µs  med=2.93µs   max=93.51ms p(90)=4.53µs  p(95)=6.33µs   p(99.9)=18.54ms
     http_req_connecting............: avg=65.93µs  min=0s      med=0s       max=93.44ms p(90)=0s      p(95)=0s       p(99.9)=18.49ms
     http_req_duration..............: avg=516.81ms min=6.04ms  med=474.72ms max=2.07s   p(90)=1.03s   p(95)=1.16s    p(99.9)=1.69s  
       { expected_response:true }...: avg=516.81ms min=6.04ms  med=474.72ms max=2.07s   p(90)=1.03s   p(95)=1.16s    p(99.9)=1.69s  
     http_req_failed................: 0.00%  ✓ 0          ✗ 27286
     http_req_receiving.............: avg=105.84µs min=30.23µs med=50.4µs   max=49.09ms p(90)=96.68µs p(95)=163.4µs  p(99.9)=8.49ms 
     http_req_sending...............: avg=93.48µs  min=7.15µs  med=11.28µs  max=73.58ms p(90)=26.8µs  p(95)=111.11µs p(99.9)=19.91ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s      p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=516.61ms min=5.98ms  med=474.45ms max=2.07s   p(90)=1.03s   p(95)=1.16s    p(99.9)=1.69s  
     http_reqs......................: 27286  407.780921/s
     iteration_duration.............: avg=536.84ms min=6.4ms   med=496.04ms max=2.07s   p(90)=1.04s   p(95)=1.17s    p(99.9)=1.69s  
     iterations.....................: 26286  392.836227/s
     success_rate...................: 99.93% ✓ 26268      ✗ 18   
     vus............................: 59     min=0        max=498
     vus_max........................: 500    min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 53004      ✗ 0    
     data_received..................: 1.6 GB  23 MB/s
     data_sent......................: 22 MB   313 kB/s
     http_req_blocked...............: avg=101.65µs min=1.34µs  med=2.9µs    max=105.69ms p(90)=5.14µs  p(95)=8.08µs   p(99.9)=27.3ms 
     http_req_connecting............: avg=95.34µs  min=0s      med=0s       max=105.47ms p(90)=0s      p(95)=0s       p(99.9)=27.17ms
     http_req_duration..............: avg=751.15ms min=6.89ms  med=733.96ms max=4.8s     p(90)=1.49s   p(95)=1.59s    p(99.9)=3.99s  
       { expected_response:true }...: avg=751.15ms min=6.89ms  med=733.96ms max=4.8s     p(90)=1.49s   p(95)=1.59s    p(99.9)=3.99s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 18668
     http_req_receiving.............: avg=149.29µs min=26.16µs med=44.77µs  max=90.31ms  p(90)=95.76µs p(95)=161.99µs p(99.9)=20.61ms
     http_req_sending...............: avg=180.34µs min=6.07µs  med=11.25µs  max=156.27ms p(90)=31.57µs p(95)=115.82µs p(99.9)=29.93ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=750.82ms min=6.84ms  med=733.92ms max=4.8s     p(90)=1.49s   p(95)=1.59s    p(99.9)=3.98s  
     http_reqs......................: 18668   266.800864/s
     iteration_duration.............: avg=793.91ms min=7.75ms  med=767.33ms max=4.81s    p(90)=1.51s   p(95)=1.6s     p(99.9)=4.05s  
     iterations.....................: 17668   252.508981/s
     success_rate...................: 100.00% ✓ 17668      ✗ 0    
     vus............................: 64      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 52767      ✗ 0    
     data_received..................: 1.6 GB  23 MB/s
     data_sent......................: 22 MB   311 kB/s
     http_req_blocked...............: avg=105.22µs min=1.27µs  med=2.82µs   max=111.58ms p(90)=5.05µs  p(95)=7.71µs   p(99.9)=28.03ms
     http_req_connecting............: avg=99.66µs  min=0s      med=0s       max=111.42ms p(90)=0s      p(95)=0s       p(99.9)=27.91ms
     http_req_duration..............: avg=754.28ms min=7.21ms  med=713.02ms max=4.86s    p(90)=1.47s   p(95)=1.62s    p(99.9)=4.04s  
       { expected_response:true }...: avg=754.28ms min=7.21ms  med=713.02ms max=4.86s    p(90)=1.47s   p(95)=1.62s    p(99.9)=4.04s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 18589
     http_req_receiving.............: avg=176.84µs min=27.06µs med=45.45µs  max=110.39ms p(90)=97.91µs p(95)=189.58µs p(99.9)=19.39ms
     http_req_sending...............: avg=139.41µs min=5.77µs  med=11.3µs   max=88.92ms  p(90)=31.04µs p(95)=117.39µs p(99.9)=22.39ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=753.97ms min=7.15ms  med=712.64ms max=4.86s    p(90)=1.47s   p(95)=1.62s    p(99.9)=4.03s  
     http_reqs......................: 18589   265.429703/s
     iteration_duration.............: avg=797.43ms min=7.52ms  med=771.9ms  max=4.87s    p(90)=1.49s   p(95)=1.63s    p(99.9)=4.08s  
     iterations.....................: 17589   251.150844/s
     success_rate...................: 100.00% ✓ 17589      ✗ 0    
     vus............................: 67      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 27966      ✗ 0    
     data_received..................: 907 MB  13 MB/s
     data_sent......................: 12 MB   179 kB/s
     http_req_blocked...............: avg=35.88µs min=1.3µs   med=3.88µs  max=20.43ms p(90)=6.59µs   p(95)=22.11µs p(99.9)=7.58ms
     http_req_connecting............: avg=28.94µs min=0s      med=0s      max=20.36ms p(90)=0s       p(95)=0s      p(99.9)=7.53ms
     http_req_duration..............: avg=1.25s   min=7.75ms  med=1.18s   max=16.39s  p(90)=2.26s    p(95)=2.69s   p(99.9)=15.24s
       { expected_response:true }...: avg=1.25s   min=7.75ms  med=1.18s   max=16.39s  p(90)=2.26s    p(95)=2.69s   p(99.9)=15.24s
     http_req_failed................: 0.00%   ✓ 0          ✗ 10322
     http_req_receiving.............: avg=93.91µs min=28.99µs med=73.32µs max=14.02ms p(90)=123.28µs p(95)=157.3µs p(99.9)=2.8ms 
     http_req_sending...............: avg=43.57µs min=6.25µs  med=15.73µs max=14.12ms p(90)=35.81µs  p(95)=54.9µs  p(99.9)=5.69ms
     http_req_tls_handshaking.......: avg=0s      min=0s      med=0s      max=0s      p(90)=0s       p(95)=0s      p(99.9)=0s    
     http_req_waiting...............: avg=1.25s   min=7.62ms  med=1.18s   max=16.39s  p(90)=2.26s    p(95)=2.69s   p(99.9)=15.24s
     http_reqs......................: 10322   149.21536/s
     iteration_duration.............: avg=1.39s   min=8.36ms  med=1.34s   max=16.41s  p(90)=2.33s    p(95)=2.73s   p(99.9)=15.57s
     iterations.....................: 9322    134.759308/s
     success_rate...................: 100.00% ✓ 9322       ✗ 0    
     vus............................: 82      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@github-actions
Copy link

Overview for: constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 171 13891 total, 0 failed avg: 217ms, p95: 229ms
hive-router 168 13642 total, 0 failed avg: 221ms, p95: 231ms
cosmo 156 12694 total, 0 failed avg: 238ms, p95: 264ms
hive-gateway-bun 152 11635 total, 0 failed avg: 259ms, p95: 373ms
hive-gateway 150 11529 total, 0 failed avg: 262ms, p95: 304ms
apollo-router 125 10251 total, 0 failed avg: 295ms, p95: 342ms
apollo-gateway 87 7165 total, 0 failed avg: 422ms, p95: 462ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41373      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   200 kB/s
     http_req_blocked...............: avg=19.64µs  min=1.29µs   med=2.12µs   max=9.29ms   p(90)=3.67µs   p(95)=5.53µs   p(99.9)=6.78ms  
     http_req_connecting............: avg=16.75µs  min=0s       med=0s       max=9.25ms   p(90)=0s       p(95)=0s       p(99.9)=6.76ms  
     http_req_duration..............: avg=217.41ms min=113.82ms med=216.49ms max=628.06ms p(90)=226.23ms p(95)=229.08ms p(99.9)=535.22ms
       { expected_response:true }...: avg=217.41ms min=113.82ms med=216.49ms max=628.06ms p(90)=226.23ms p(95)=229.08ms p(99.9)=535.22ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13891
     http_req_receiving.............: avg=85.55µs  min=26.19µs  med=47.77µs  max=10.11ms  p(90)=102.63µs p(95)=272.5µs  p(99.9)=3.7ms   
     http_req_sending...............: avg=139.07µs min=6.37µs   med=9.16µs   max=410.27ms p(90)=33.05µs  p(95)=100.44µs p(99.9)=5.5ms   
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=217.19ms min=113.72ms med=216.38ms max=626.54ms p(90)=226.05ms p(95)=228.83ms p(99.9)=512.51ms
     http_reqs......................: 13891   171.581016/s
     iteration_duration.............: avg=217.7ms  min=114.04ms med=216.74ms max=645.96ms p(90)=226.43ms p(95)=229.27ms p(99.9)=547.65ms
     iterations.....................: 13791   170.345821/s
     success_rate...................: 100.00% ✓ 13791      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40626      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   196 kB/s
     http_req_blocked...............: avg=18.91µs  min=1.2µs    med=2.15µs   max=8.76ms   p(90)=3.02µs   p(95)=3.77µs   p(99.9)=6.5ms   
     http_req_connecting............: avg=16.35µs  min=0s       med=0s       max=8.73ms   p(90)=0s       p(95)=0s       p(99.9)=6.49ms  
     http_req_duration..............: avg=221.32ms min=135.32ms med=220.75ms max=606.38ms p(90)=228.67ms p(95)=231.05ms p(99.9)=508.82ms
       { expected_response:true }...: avg=221.32ms min=135.32ms med=220.75ms max=606.38ms p(90)=228.67ms p(95)=231.05ms p(99.9)=508.82ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13642
     http_req_receiving.............: avg=70.21µs  min=23.57µs  med=41.79µs  max=13.17ms  p(90)=77.44µs  p(95)=230.99µs p(99.9)=989.07µs
     http_req_sending...............: avg=74.66µs  min=5.45µs   med=9.14µs   max=369.73ms p(90)=27.66µs  p(95)=92.71µs  p(99.9)=4.22ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=221.17ms min=131.6ms  med=220.67ms max=605.65ms p(90)=228.52ms p(95)=230.91ms p(99.9)=502.2ms 
     http_reqs......................: 13642   168.890319/s
     iteration_duration.............: avg=221.63ms min=135.49ms med=220.96ms max=612.28ms p(90)=228.84ms p(95)=231.24ms p(99.9)=519.56ms
     iterations.....................: 13542   167.652301/s
     success_rate...................: 100.00% ✓ 13542      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 37782      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 15 MB   182 kB/s
     http_req_blocked...............: avg=22.34µs  min=1.45µs   med=2.62µs   max=9.49ms   p(90)=3.79µs   p(95)=4.64µs   p(99.9)=7.17ms  
     http_req_connecting............: avg=18.64µs  min=0s       med=0s       max=9.45ms   p(90)=0s       p(95)=0s       p(99.9)=7.15ms  
     http_req_duration..............: avg=238.45ms min=165.25ms med=237.97ms max=624.95ms p(90)=258.65ms p(95)=264.3ms  p(99.9)=520.93ms
       { expected_response:true }...: avg=238.45ms min=165.25ms med=237.97ms max=624.95ms p(90)=258.65ms p(95)=264.3ms  p(99.9)=520.93ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12694
     http_req_receiving.............: avg=325.12µs min=31.34µs  med=63.85µs  max=63.86ms  p(90)=190.64µs p(95)=433.12µs p(99.9)=27.96ms 
     http_req_sending...............: avg=63.19µs  min=7.03µs   med=10.9µs   max=238.55ms p(90)=28.38µs  p(95)=112.29µs p(99.9)=1.97ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=238.06ms min=165.18ms med=237.65ms max=623.47ms p(90)=258.04ms p(95)=263.86ms p(99.9)=519.6ms 
     http_reqs......................: 12694   156.424333/s
     iteration_duration.............: avg=239.01ms min=165.42ms med=238.3ms  max=641.57ms p(90)=258.92ms p(95)=264.61ms p(99.9)=578.91ms
     iterations.....................: 12594   155.192064/s
     success_rate...................: 100.00% ✓ 12594      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 34605      ✗ 0    
     data_received..................: 1.0 GB  13 MB/s
     data_sent......................: 14 MB   177 kB/s
     http_req_blocked...............: avg=29.36µs  min=1.1µs    med=2.55µs   max=11.46ms  p(90)=4.09µs   p(95)=5.32µs   p(99.9)=9.07ms  
     http_req_connecting............: avg=25.63µs  min=0s       med=0s       max=11.42ms  p(90)=0s       p(95)=0s       p(99.9)=9.02ms  
     http_req_duration..............: avg=259.26ms min=160.35ms med=249.43ms max=739.19ms p(90)=271.06ms p(95)=373.1ms  p(99.9)=623ms   
       { expected_response:true }...: avg=259.26ms min=160.35ms med=249.43ms max=739.19ms p(90)=271.06ms p(95)=373.1ms  p(99.9)=623ms   
     http_req_failed................: 0.00%   ✓ 0          ✗ 11635
     http_req_receiving.............: avg=91.92µs  min=26.01µs  med=47.18µs  max=19.55ms  p(90)=115.48µs p(95)=358.6µs  p(99.9)=2ms     
     http_req_sending...............: avg=107.42µs min=5.41µs   med=10.73µs  max=212.04ms p(90)=36.86µs  p(95)=138.91µs p(99.9)=7.15ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=259.06ms min=160.27ms med=249.27ms max=738.47ms p(90)=270.77ms p(95)=372.22ms p(99.9)=622.01ms
     http_reqs......................: 11635   152.259203/s
     iteration_duration.............: avg=260.38ms min=175.93ms med=249.76ms max=777.46ms p(90)=271.37ms p(95)=376.13ms p(99.9)=638.96ms
     iterations.....................: 11535   150.950573/s
     success_rate...................: 100.00% ✓ 11535      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 34287      ✗ 0    
     data_received..................: 1.0 GB  13 MB/s
     data_sent......................: 13 MB   175 kB/s
     http_req_blocked...............: avg=39.24µs  min=1.16µs   med=2.62µs   max=13.49ms  p(90)=4.24µs   p(95)=5.73µs   p(99.9)=11.42ms 
     http_req_connecting............: avg=35.44µs  min=0s       med=0s       max=13.44ms  p(90)=0s       p(95)=0s       p(99.9)=11.25ms 
     http_req_duration..............: avg=261.73ms min=138.87ms med=252.48ms max=726.93ms p(90)=271.5ms  p(95)=304.06ms p(99.9)=607.65ms
       { expected_response:true }...: avg=261.73ms min=138.87ms med=252.48ms max=726.93ms p(90)=271.5ms  p(95)=304.06ms p(99.9)=607.65ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11529
     http_req_receiving.............: avg=105.09µs min=24.68µs  med=46.19µs  max=158.96ms p(90)=110.76µs p(95)=382.76µs p(99.9)=2.45ms  
     http_req_sending...............: avg=109.66µs min=5.66µs   med=10.98µs  max=189.01ms p(90)=38.05µs  p(95)=140.32µs p(99.9)=11.79ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=261.51ms min=138.81ms med=252.36ms max=724.94ms p(90)=271.28ms p(95)=301.06ms p(99.9)=599.03ms
     http_reqs......................: 11529   150.451167/s
     iteration_duration.............: avg=262.91ms min=139.11ms med=252.75ms max=751.48ms p(90)=271.84ms p(95)=307.11ms p(99.9)=652.02ms
     iterations.....................: 11429   149.146187/s
     success_rate...................: 100.00% ✓ 11429      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 30453      ✗ 0    
     data_received..................: 900 MB  11 MB/s
     data_sent......................: 12 MB   146 kB/s
     http_req_blocked...............: avg=27.48µs  min=1.77µs   med=2.93µs   max=9.69ms   p(90)=4.36µs   p(95)=5.36µs   p(99.9)=7.76ms  
     http_req_connecting............: avg=23.07µs  min=0s       med=0s       max=9.66ms   p(90)=0s       p(95)=0s       p(99.9)=7.54ms  
     http_req_duration..............: avg=295.08ms min=172.03ms med=296.04ms max=700.3ms  p(90)=331.87ms p(95)=341.86ms p(99.9)=598.15ms
       { expected_response:true }...: avg=295.08ms min=172.03ms med=296.04ms max=700.3ms  p(90)=331.87ms p(95)=341.86ms p(99.9)=598.15ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10251
     http_req_receiving.............: avg=105.32µs min=36.04µs  med=53.44µs  max=137.66ms p(90)=105.63µs p(95)=226.48µs p(99.9)=1.74ms  
     http_req_sending...............: avg=77.8µs   min=7.6µs    med=11.38µs  max=212.99ms p(90)=27.22µs  p(95)=133.04µs p(99.9)=2.03ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=294.89ms min=171.94ms med=295.87ms max=698.67ms p(90)=331.74ms p(95)=341.67ms p(99.9)=596.84ms
     http_reqs......................: 10251   125.853839/s
     iteration_duration.............: avg=296.26ms min=172.21ms med=296.58ms max=724.04ms p(90)=332.23ms p(95)=342.2ms  p(99.9)=656.72ms
     iterations.....................: 10151   124.626116/s
     success_rate...................: 100.00% ✓ 10151      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 21195     ✗ 0   
     data_received..................: 629 MB  7.7 MB/s
     data_sent......................: 8.3 MB  102 kB/s
     http_req_blocked...............: avg=42.72µs  min=1.26µs   med=2.91µs   max=11.4ms   p(90)=4.29µs   p(95)=4.97µs   p(99.9)=9.85ms  
     http_req_connecting............: avg=39.32µs  min=0s       med=0s       max=11.37ms  p(90)=0s       p(95)=0s       p(99.9)=9.82ms  
     http_req_duration..............: avg=422.07ms min=210.74ms med=423.58ms max=895.74ms p(90)=449.59ms p(95)=462.29ms p(99.9)=816.53ms
       { expected_response:true }...: avg=422.07ms min=210.74ms med=423.58ms max=895.74ms p(90)=449.59ms p(95)=462.29ms p(99.9)=816.53ms
     http_req_failed................: 0.00%   ✓ 0         ✗ 7165
     http_req_receiving.............: avg=78.73µs  min=26.59µs  med=51µs     max=129.44ms p(90)=91µs     p(95)=107.17µs p(99.9)=304.8µs 
     http_req_sending...............: avg=95.07µs  min=5.85µs   med=11.7µs   max=176.02ms p(90)=17.69µs  p(95)=21.92µs  p(99.9)=3.85ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=421.89ms min=210.65ms med=423.5ms  max=894.43ms p(90)=449.47ms p(95)=462.13ms p(99.9)=814.99ms
     http_reqs......................: 7165    87.802617/s
     iteration_duration.............: avg=425.44ms min=278.71ms med=423.97ms max=922.09ms p(90)=450ms    p(95)=462.68ms p(99.9)=903.2ms 
     iterations.....................: 7065    86.577179/s
     success_rate...................: 100.00% ✓ 7065      ✗ 0   
     vus............................: 50      min=0       max=50
     vus_max........................: 50      min=50      max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@ardatan ardatan merged commit 2bb2ffc into main Sep 16, 2025
34 checks passed
@ardatan ardatan deleted the renovate/node-22.x branch September 16, 2025 14:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant