Skip to content

Conversation

renovate[bot]
Copy link
Contributor

@renovate renovate bot commented Sep 4, 2025

This PR contains the following updates:

Package Type Update Change
Swatinem/rust-cache action pinDigest -> 98c8021
actions-rs/toolchain action pinDigest -> 16499b5
cloudflare/wrangler-action action pinDigest -> da0e0df
grafana/setup-k6-action action pinDigest -> ffe7d72

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

👻 Immortal: This PR will be recreated if closed unmerged. Get config help if that's undesired.


  • If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

@renovate renovate bot added the dependencies Pull requests that update a dependency file label Sep 4, 2025
Copy link

github-actions bot commented Sep 4, 2025

Overview for: constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1851 111600 total, 0 failed avg: 27ms, p95: 47ms
cosmo 696 42095 total, 0 failed avg: 71ms, p95: 104ms
grafbase 572 34577 total, 0 failed avg: 86ms, p95: 112ms
apollo-router 391 23784 total, 0 failed avg: 126ms, p95: 164ms
hive-gateway 178 10944 total, 0 failed avg: 275ms, p95: 401ms
hive-gateway-bun 165 10104 total, 0 failed avg: 297ms, p95: 444ms
apollo-gateway 118 7241 total, 0 failed avg: 415ms, p95: 488ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 334500      ✗ 0     
     data_received..................: 9.8 GB  162 MB/s
     data_sent......................: 130 MB  2.2 MB/s
     http_req_blocked...............: avg=5.01µs   min=1.1µs   med=2.47µs  max=8.95ms   p(90)=3.68µs   p(95)=4.39µs   p(99.9)=58.58µs
     http_req_connecting............: avg=2.05µs   min=0s      med=0s      max=8.92ms   p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_duration..............: avg=26.68ms  min=1.93ms  med=24.33ms max=439.62ms p(90)=40.89ms  p(95)=47.18ms  p(99.9)=87.41ms
       { expected_response:true }...: avg=26.68ms  min=1.93ms  med=24.33ms max=439.62ms p(90)=40.89ms  p(95)=47.18ms  p(99.9)=87.41ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 111600
     http_req_receiving.............: avg=116.45µs min=24.24µs med=43.22µs max=72.72ms  p(90)=110.69µs p(95)=335.01µs p(99.9)=12.76ms
     http_req_sending...............: avg=81.34µs  min=5.52µs  med=10.21µs max=343.84ms p(90)=30.55µs  p(95)=120.62µs p(99.9)=10.57ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=26.48ms  min=1.88ms  med=24.18ms max=425.45ms p(90)=40.53ms  p(95)=46.77ms  p(99.9)=85.06ms
     http_reqs......................: 111600  1851.851646/s
     iteration_duration.............: avg=26.89ms  min=4.18ms  med=24.52ms max=461.39ms p(90)=41.09ms  p(95)=47.39ms  p(99.9)=87.97ms
     iterations.....................: 111500  1850.192281/s
     success_rate...................: 100.00% ✓ 111500      ✗ 0     
     vus............................: 50      min=50        max=50  
     vus_max........................: 50      min=50        max=50  

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 125985     ✗ 0    
     data_received..................: 3.7 GB  61 MB/s
     data_sent......................: 49 MB   810 kB/s
     http_req_blocked...............: avg=9.98µs  min=1.33µs  med=2.73µs  max=10.61ms  p(90)=3.8µs    p(95)=4.49µs   p(99.9)=2.09ms  
     http_req_connecting............: avg=6.57µs  min=0s      med=0s      max=10.56ms  p(90)=0s       p(95)=0s       p(99.9)=1.89ms  
     http_req_duration..............: avg=71.05ms min=2.87ms  med=69.75ms max=505.23ms p(90)=95.97ms  p(95)=104.02ms p(99.9)=287.47ms
       { expected_response:true }...: avg=71.05ms min=2.87ms  med=69.75ms max=505.23ms p(90)=95.97ms  p(95)=104.02ms p(99.9)=287.47ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 42095
     http_req_receiving.............: avg=154.8µs min=24.27µs med=68.68µs max=91.41ms  p(90)=142.44µs p(95)=353.49µs p(99.9)=15.01ms 
     http_req_sending...............: avg=50.93µs min=5.91µs  med=11.25µs max=306.99ms p(90)=28.35µs  p(95)=117.77µs p(99.9)=3ms     
     http_req_tls_handshaking.......: avg=0s      min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=70.85ms min=2.81ms  med=69.57ms max=487.77ms p(90)=95.75ms  p(95)=103.76ms p(99.9)=279.4ms 
     http_reqs......................: 42095   696.508206/s
     iteration_duration.............: avg=71.46ms min=7.58ms  med=70.03ms max=531.56ms p(90)=96.22ms  p(95)=104.29ms p(99.9)=301.98ms
     iterations.....................: 41995   694.853595/s
     success_rate...................: 100.00% ✓ 41995      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 103431     ✗ 0    
     data_received..................: 3.0 GB  50 MB/s
     data_sent......................: 40 MB   666 kB/s
     http_req_blocked...............: avg=16.73µs  min=1.39µs  med=3.16µs  max=24.91ms  p(90)=4.34µs   p(95)=5.66µs   p(99.9)=3.82ms  
     http_req_connecting............: avg=11.16µs  min=0s      med=0s      max=16.07ms  p(90)=0s       p(95)=0s       p(99.9)=3.56ms  
     http_req_duration..............: avg=86.42ms  min=2.97ms  med=85.21ms max=548.65ms p(90)=105.73ms p(95)=112.24ms p(99.9)=326.81ms
       { expected_response:true }...: avg=86.42ms  min=2.97ms  med=85.21ms max=548.65ms p(90)=105.73ms p(95)=112.24ms p(99.9)=326.81ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 34577
     http_req_receiving.............: avg=167.23µs min=29µs    med=62.66µs max=41.84ms  p(90)=180.69µs p(95)=415.2µs  p(99.9)=8.95ms  
     http_req_sending...............: avg=94.38µs  min=5.99µs  med=12.41µs max=149.5ms  p(90)=104.47µs p(95)=129.95µs p(99.9)=10.25ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=86.16ms  min=2.9ms   med=84.99ms max=538.15ms p(90)=105.44ms p(95)=111.99ms p(99.9)=320.6ms 
     http_reqs......................: 34577   572.330463/s
     iteration_duration.............: avg=87.03ms  min=21.85ms med=85.6ms  max=573.27ms p(90)=106.07ms p(95)=112.56ms p(99.9)=354.2ms 
     iterations.....................: 34477   570.675228/s
     success_rate...................: 100.00% ✓ 34477      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 71052      ✗ 0    
     data_received..................: 2.1 GB  34 MB/s
     data_sent......................: 28 MB   455 kB/s
     http_req_blocked...............: avg=12.33µs  min=1.8µs   med=2.7µs    max=8.89ms   p(90)=3.88µs   p(95)=4.54µs   p(99.9)=4.3ms   
     http_req_connecting............: avg=9.03µs   min=0s      med=0s       max=8.86ms   p(90)=0s       p(95)=0s       p(99.9)=4.28ms  
     http_req_duration..............: avg=125.96ms min=5.86ms  med=125.29ms max=571.73ms p(90)=154.75ms p(95)=163.92ms p(99.9)=407.27ms
       { expected_response:true }...: avg=125.96ms min=5.86ms  med=125.29ms max=571.73ms p(90)=154.75ms p(95)=163.92ms p(99.9)=407.27ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 23784
     http_req_receiving.............: avg=71.55µs  min=34.98µs med=50.1µs   max=4.95ms   p(90)=94.18µs  p(95)=121.87µs p(99.9)=1.26ms  
     http_req_sending...............: avg=96.4µs   min=7.17µs  med=11.06µs  max=415.06ms p(90)=18.29µs  p(95)=32.43µs  p(99.9)=1.64ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=125.79ms min=5.82ms  med=125.16ms max=570.25ms p(90)=154.61ms p(95)=163.74ms p(99.9)=392.44ms
     http_reqs......................: 23784   391.582817/s
     iteration_duration.............: avg=126.73ms min=20.62ms med=125.58ms max=595.54ms p(90)=155.03ms p(95)=164.19ms p(99.9)=433.44ms
     iterations.....................: 23684   389.936405/s
     success_rate...................: 100.00% ✓ 23684      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 32532      ✗ 0    
     data_received..................: 961 MB  16 MB/s
     data_sent......................: 13 MB   208 kB/s
     http_req_blocked...............: avg=41.33µs  min=1.63µs  med=3.3µs    max=16.03ms  p(90)=4.77µs   p(95)=5.39µs   p(99.9)=12.82ms 
     http_req_connecting............: avg=36.5µs   min=0s      med=0s       max=15.99ms  p(90)=0s       p(95)=0s       p(99.9)=12.79ms 
     http_req_duration..............: avg=274.6ms  min=6.5ms   med=263.17ms max=764.46ms p(90)=365ms    p(95)=401.11ms p(99.9)=643.52ms
       { expected_response:true }...: avg=274.6ms  min=6.5ms   med=263.17ms max=764.46ms p(90)=365ms    p(95)=401.11ms p(99.9)=643.52ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10944
     http_req_receiving.............: avg=76.36µs  min=31.07µs med=56.29µs  max=28.45ms  p(90)=101.58µs p(95)=122.7µs  p(99.9)=1.17ms  
     http_req_sending...............: avg=104.52µs min=6.99µs  med=13.14µs  max=182.4ms  p(90)=20.45µs  p(95)=33.91µs  p(99.9)=9.62ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=274.42ms min=6.44ms  med=263.06ms max=754.71ms p(90)=364.85ms p(95)=400.95ms p(99.9)=635.09ms
     http_reqs......................: 10944   178.964117/s
     iteration_duration.............: avg=277.53ms min=27.63ms med=263.77ms max=812.11ms p(90)=366.76ms p(95)=401.97ms p(99.9)=715.91ms
     iterations.....................: 10844   177.328845/s
     success_rate...................: 100.00% ✓ 10844      ✗ 0    
     vus............................: 33      min=33       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 30012      ✗ 0    
     data_received..................: 887 MB  15 MB/s
     data_sent......................: 12 MB   192 kB/s
     http_req_blocked...............: avg=71.65µs  min=1.57µs  med=4.36µs   max=19.45ms  p(90)=6.12µs   p(95)=6.98µs   p(99.9)=17.25ms 
     http_req_connecting............: avg=66.02µs  min=0s      med=0s       max=19.24ms  p(90)=0s       p(95)=0s       p(99.9)=17.21ms 
     http_req_duration..............: avg=296.89ms min=6.89ms  med=283.98ms max=698.84ms p(90)=400.76ms p(95)=443.71ms p(99.9)=605.52ms
       { expected_response:true }...: avg=296.89ms min=6.89ms  med=283.98ms max=698.84ms p(90)=400.76ms p(95)=443.71ms p(99.9)=605.52ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10104
     http_req_receiving.............: avg=96.03µs  min=35.72µs med=85.87µs  max=6.6ms    p(90)=136.24µs p(95)=160.52µs p(99.9)=1.41ms  
     http_req_sending...............: avg=60.48µs  min=7.53µs  med=18.13µs  max=275.15ms p(90)=26.1µs   p(95)=43.18µs  p(99.9)=3.09ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=296.73ms min=6.83ms  med=283.85ms max=697.59ms p(90)=400.61ms p(95)=443.61ms p(99.9)=604.91ms
     http_reqs......................: 10104   165.237665/s
     iteration_duration.............: avg=300.36ms min=36.87ms med=284.77ms max=741.54ms p(90)=402.01ms p(95)=445.04ms p(99.9)=688.31ms
     iterations.....................: 10004   163.602296/s
     success_rate...................: 100.00% ✓ 10004      ✗ 0    
     vus............................: 41      min=41       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 21423      ✗ 0   
     data_received..................: 636 MB  10 MB/s
     data_sent......................: 8.4 MB  138 kB/s
     http_req_blocked...............: avg=81.31µs  min=1.41µs   med=3.21µs   max=17.56ms  p(90)=5.22µs   p(95)=5.93µs   p(99.9)=15.61ms 
     http_req_connecting............: avg=77.31µs  min=0s       med=0s       max=17.51ms  p(90)=0s       p(95)=0s       p(99.9)=15.56ms 
     http_req_duration..............: avg=415.15ms min=7.81ms   med=414.62ms max=899.87ms p(90)=470.43ms p(95)=487.96ms p(99.9)=819.32ms
       { expected_response:true }...: avg=415.15ms min=7.81ms   med=414.62ms max=899.87ms p(90)=470.43ms p(95)=487.96ms p(99.9)=819.32ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 7241
     http_req_receiving.............: avg=108.58µs min=31.61µs  med=59.57µs  max=275.4ms  p(90)=104.01µs p(95)=123.97µs p(99.9)=464.9µs 
     http_req_sending...............: avg=67.19µs  min=6.42µs   med=13.34µs  max=22.59ms  p(90)=22.16µs  p(95)=26.22µs  p(99.9)=8.98ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=414.97ms min=7.69ms   med=414.5ms  max=873.99ms p(90)=470.33ms p(95)=487.89ms p(99.9)=791.98ms
     http_reqs......................: 7241    118.28624/s
     iteration_duration.............: avg=421.51ms min=168.59ms med=415.18ms max=948.83ms p(90)=471.05ms p(95)=488.51ms p(99.9)=912.13ms
     iterations.....................: 7141    116.652678/s
     success_rate...................: 100.00% ✓ 7141       ✗ 0   
     vus............................: 42      min=42       max=50
     vus_max........................: 50      min=50       max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Sep 4, 2025

Overview for: ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 500 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 2005 124770 total, 0 failed avg: 112ms, p95: 272ms
cosmo 685 43770 total, 0 failed avg: 321ms, p95: 716ms
grafbase 511 32383 total, 0 failed avg: 434ms, p95: 976ms
apollo-router 392 26354 total, 0 failed avg: 535ms, p95: 1213ms ❌ 27 unexpected GraphQL errors
hive-gateway 166 11529 total, 0 failed avg: 1167ms, p95: 2343ms
hive-gateway-bun 156 10885 total, 0 failed avg: 1229ms, p95: 2435ms
apollo-gateway 153 10543 total, 0 failed avg: 1232ms, p95: 2520ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 371310      ✗ 0     
     data_received..................: 11 GB   176 MB/s
     data_sent......................: 145 MB  2.3 MB/s
     http_req_blocked...............: avg=360.45µs min=1.06µs  med=2.43µs   max=307.52ms p(90)=3.77µs   p(95)=4.52µs   p(99.9)=134.75ms
     http_req_connecting............: avg=356µs    min=0s      med=0s       max=307.32ms p(90)=0s       p(95)=0s       p(99.9)=134.34ms
     http_req_duration..............: avg=111.69ms min=1.7ms   med=101.17ms max=408.32ms p(90)=227.99ms p(95)=272.08ms p(99.9)=373.47ms
       { expected_response:true }...: avg=111.69ms min=1.7ms   med=101.17ms max=408.32ms p(90)=227.99ms p(95)=272.08ms p(99.9)=373.47ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 124770
     http_req_receiving.............: avg=447.19µs min=22.24µs med=40.46µs  max=135.14ms p(90)=187.43µs p(95)=380.97µs p(99.9)=65.98ms 
     http_req_sending...............: avg=334.85µs min=5.09µs  med=9.66µs   max=133.61ms p(90)=28.38µs  p(95)=123.24µs p(99.9)=60.35ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=110.91ms min=1.63ms  med=100.48ms max=400.61ms p(90)=226.36ms p(95)=270.08ms p(99.9)=371.54ms
     http_reqs......................: 124770  2005.010121/s
     iteration_duration.............: avg=113.19ms min=1.86ms  med=102.56ms max=617.19ms p(90)=229.73ms p(95)=274.32ms p(99.9)=387.66ms
     iterations.....................: 123770  1988.940472/s
     success_rate...................: 100.00% ✓ 123770      ✗ 0     
     vus............................: 71      min=0         max=495 
     vus_max........................: 500     min=500       max=500 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 128310     ✗ 0    
     data_received..................: 3.8 GB  60 MB/s
     data_sent......................: 51 MB   798 kB/s
     http_req_blocked...............: avg=97.09µs  min=1.35µs  med=2.91µs   max=205.93ms p(90)=4.47µs   p(95)=6.23µs   p(99.9)=25.05ms 
     http_req_connecting............: avg=92.29µs  min=0s      med=0s       max=200.51ms p(90)=0s       p(95)=0s       p(99.9)=24.99ms 
     http_req_duration..............: avg=320.97ms min=2.84ms  med=302.47ms max=1.25s    p(90)=629.76ms p(95)=715.65ms p(99.9)=1.1s    
       { expected_response:true }...: avg=320.97ms min=2.84ms  med=302.47ms max=1.25s    p(90)=629.76ms p(95)=715.65ms p(99.9)=1.1s    
     http_req_failed................: 0.00%   ✓ 0          ✗ 43770
     http_req_receiving.............: avg=657.32µs min=29.61µs med=62.64µs  max=222.5ms  p(90)=186.17µs p(95)=478.97µs p(99.9)=147.84ms
     http_req_sending...............: avg=136.47µs min=6.17µs  med=11.45µs  max=156ms    p(90)=29.15µs  p(95)=129.15µs p(99.9)=24.07ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=320.18ms min=2.77ms  med=301.98ms max=1.25s    p(90)=628.69ms p(95)=714.11ms p(99.9)=1.09s   
     http_reqs......................: 43770   685.497609/s
     iteration_duration.............: avg=328.93ms min=3.12ms  med=311ms    max=1.25s    p(90)=633.42ms p(95)=718.42ms p(99.9)=1.1s    
     iterations.....................: 42770   669.836252/s
     success_rate...................: 100.00% ✓ 42770      ✗ 0    
     vus............................: 56      min=0        max=499
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 94149      ✗ 0    
     data_received..................: 2.8 GB  45 MB/s
     data_sent......................: 38 MB   596 kB/s
     http_req_blocked...............: avg=267.79µs min=1.21µs  med=3.25µs   max=200.69ms p(90)=4.77µs   p(95)=9.2µs    p(99.9)=73.79ms
     http_req_connecting............: avg=259.42µs min=0s      med=0s       max=200.64ms p(90)=0s       p(95)=0s       p(99.9)=73.73ms
     http_req_duration..............: avg=434.22ms min=2.67ms  med=412.87ms max=1.63s    p(90)=871.95ms p(95)=975.94ms p(99.9)=1.32s  
       { expected_response:true }...: avg=434.22ms min=2.67ms  med=412.87ms max=1.63s    p(90)=871.95ms p(95)=975.94ms p(99.9)=1.32s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 32383
     http_req_receiving.............: avg=238.13µs min=26.73µs med=52.29µs  max=132.94ms p(90)=157.88µs p(95)=447.29µs p(99.9)=35.17ms
     http_req_sending...............: avg=305.25µs min=5.5µs   med=12.31µs  max=137.93ms p(90)=41.96µs  p(95)=138.66µs p(99.9)=65.59ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=433.68ms min=2.62ms  med=411.86ms max=1.63s    p(90)=871.44ms p(95)=975.28ms p(99.9)=1.32s  
     http_reqs......................: 32383   511.613823/s
     iteration_duration.............: avg=449.17ms min=2.92ms  med=433.57ms max=1.63s    p(90)=879.35ms p(95)=981.88ms p(99.9)=1.32s  
     iterations.....................: 31383   495.814983/s
     success_rate...................: 100.00% ✓ 31383      ✗ 0    
     vus............................: 77      min=0        max=496
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  99% — ✓ 25327 / ✗ 27
     ✓ valid response structure

     checks.........................: 99.96% ✓ 76035      ✗ 27   
     data_received..................: 2.3 GB 34 MB/s
     data_sent......................: 31 MB  457 kB/s
     http_req_blocked...............: avg=103.8µs  min=1.32µs  med=3µs      max=124.83ms p(90)=4.6µs    p(95)=6.34µs   p(99.9)=28.08ms
     http_req_connecting............: avg=96.6µs   min=0s      med=0s       max=124.15ms p(90)=0s       p(95)=0s       p(99.9)=28.04ms
     http_req_duration..............: avg=534.91ms min=6.13ms  med=499.94ms max=1.84s    p(90)=1.07s    p(95)=1.21s    p(99.9)=1.61s  
       { expected_response:true }...: avg=534.91ms min=6.13ms  med=499.94ms max=1.84s    p(90)=1.07s    p(95)=1.21s    p(99.9)=1.61s  
     http_req_failed................: 0.00%  ✓ 0          ✗ 26354
     http_req_receiving.............: avg=119.86µs min=29.17µs med=51.77µs  max=81.17ms  p(90)=103.18µs p(95)=238.82µs p(99.9)=8.64ms 
     http_req_sending...............: avg=123.39µs min=5.68µs  med=11.54µs  max=111.04ms p(90)=29.88µs  p(95)=121.72µs p(99.9)=19.48ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=534.66ms min=6.07ms  med=499.77ms max=1.84s    p(90)=1.07s    p(95)=1.21s    p(99.9)=1.61s  
     http_reqs......................: 26354  392.26424/s
     iteration_duration.............: avg=556.42ms min=6.56ms  med=526.75ms max=1.87s    p(90)=1.08s    p(95)=1.22s    p(99.9)=1.61s  
     iterations.....................: 25354  377.379811/s
     success_rate...................: 99.89% ✓ 25327      ✗ 27   
     vus............................: 71     min=0        max=495
     vus_max........................: 500    min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 31586      ✗ 0    
     data_received..................: 1.0 GB  15 MB/s
     data_sent......................: 14 MB   198 kB/s
     http_req_blocked...............: avg=50.33µs min=1.55µs  med=3.45µs  max=42.97ms p(90)=5.69µs   p(95)=24.11µs  p(99.9)=11.82ms
     http_req_connecting............: avg=42.68µs min=0s      med=0s      max=42.89ms p(90)=0s       p(95)=0s       p(99.9)=11.53ms
     http_req_duration..............: avg=1.16s   min=6.43ms  med=1.13s   max=12.33s  p(90)=2.16s    p(95)=2.34s    p(99.9)=11.21s 
       { expected_response:true }...: avg=1.16s   min=6.43ms  med=1.13s   max=12.33s  p(90)=2.16s    p(95)=2.34s    p(99.9)=11.21s 
     http_req_failed................: 0.00%   ✓ 0          ✗ 11529
     http_req_receiving.............: avg=98.68µs min=30.93µs med=58.34µs max=27.84ms p(90)=109.41µs p(95)=154.64µs p(99.9)=4.78ms 
     http_req_sending...............: avg=51.73µs min=6.71µs  med=13.39µs max=32.12ms p(90)=33.74µs  p(95)=51.81µs  p(99.9)=8.58ms 
     http_req_tls_handshaking.......: avg=0s      min=0s      med=0s      max=0s      p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=1.16s   min=6.38ms  med=1.13s   max=12.33s  p(90)=2.16s    p(95)=2.34s    p(99.9)=11.21s 
     http_reqs......................: 11529   166.32009/s
     iteration_duration.............: avg=1.27s   min=6.56ms  med=1.26s   max=12.36s  p(90)=2.18s    p(95)=2.36s    p(99.9)=11.22s 
     iterations.....................: 10528   151.879426/s
     success_rate...................: 100.00% ✓ 10528      ✗ 0    
     vus............................: 87      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 29655      ✗ 0    
     data_received..................: 956 MB  14 MB/s
     data_sent......................: 13 MB   187 kB/s
     http_req_blocked...............: avg=54.49µs min=1.45µs  med=3.44µs  max=44.82ms p(90)=5.35µs  p(95)=13.24µs  p(99.9)=14.51ms
     http_req_connecting............: avg=47.76µs min=0s      med=0s      max=44.75ms p(90)=0s      p(95)=0s       p(99.9)=14.45ms
     http_req_duration..............: avg=1.22s   min=6.91ms  med=1.22s   max=12.82s  p(90)=2.23s   p(95)=2.43s    p(99.9)=11.94s 
       { expected_response:true }...: avg=1.22s   min=6.91ms  med=1.22s   max=12.82s  p(90)=2.23s   p(95)=2.43s    p(99.9)=11.94s 
     http_req_failed................: 0.00%   ✓ 0          ✗ 10885
     http_req_receiving.............: avg=89.27µs min=30.43µs med=59.07µs max=20.88ms p(90)=108.1µs p(95)=148.13µs p(99.9)=3.21ms 
     http_req_sending...............: avg=52.49µs min=6.24µs  med=13.29µs max=27.15ms p(90)=34.45µs p(95)=57.27µs  p(99.9)=7.95ms 
     http_req_tls_handshaking.......: avg=0s      min=0s      med=0s      max=0s      p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=1.22s   min=6.85ms  med=1.22s   max=12.82s  p(90)=2.23s   p(95)=2.43s    p(99.9)=11.94s 
     http_reqs......................: 10885   156.483824/s
     iteration_duration.............: avg=1.35s   min=7.89ms  med=1.37s   max=12.84s  p(90)=2.26s   p(95)=2.46s    p(99.9)=11.97s 
     iterations.....................: 9885    142.107727/s
     success_rate...................: 100.00% ✓ 9885       ✗ 0    
     vus............................: 100     min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 28629      ✗ 0    
     data_received..................: 926 MB  14 MB/s
     data_sent......................: 13 MB   184 kB/s
     http_req_blocked...............: avg=29.21µs min=1.36µs  med=3.21µs  max=24.92ms p(90)=5.44µs   p(95)=10.12µs p(99.9)=5.58ms
     http_req_connecting............: avg=21.89µs min=0s      med=0s      max=24.86ms p(90)=0s       p(95)=0s      p(99.9)=5.17ms
     http_req_duration..............: avg=1.23s   min=7.27ms  med=1.18s   max=16.15s  p(90)=2.2s     p(95)=2.51s   p(99.9)=14.64s
       { expected_response:true }...: avg=1.23s   min=7.27ms  med=1.18s   max=16.15s  p(90)=2.2s     p(95)=2.51s   p(99.9)=14.64s
     http_req_failed................: 0.00%   ✓ 0          ✗ 10543
     http_req_receiving.............: avg=78.23µs min=28.15µs med=54.65µs max=20.4ms  p(90)=106.04µs p(95)=134µs   p(99.9)=1.49ms
     http_req_sending...............: avg=31.17µs min=6.13µs  med=12.63µs max=14.93ms p(90)=28.99µs  p(95)=44.3µs  p(99.9)=3.52ms
     http_req_tls_handshaking.......: avg=0s      min=0s      med=0s      max=0s      p(90)=0s       p(95)=0s      p(99.9)=0s    
     http_req_waiting...............: avg=1.23s   min=7.22ms  med=1.18s   max=16.15s  p(90)=2.2s     p(95)=2.51s   p(99.9)=14.64s
     http_reqs......................: 10543   153.948085/s
     iteration_duration.............: avg=1.36s   min=8.16ms  med=1.31s   max=16.16s  p(90)=2.23s    p(95)=2.57s   p(99.9)=14.74s
     iterations.....................: 9543    139.346161/s
     success_rate...................: 100.00% ✓ 9543       ✗ 0    
     vus............................: 94      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Sep 4, 2025

Overview for: constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 168 13639 total, 0 failed avg: 222ms, p95: 232ms
grafbase 167 13590 total, 0 failed avg: 222ms, p95: 236ms
cosmo 157 12748 total, 0 failed avg: 237ms, p95: 263ms
hive-gateway 133 10238 total, 0 failed avg: 295ms, p95: 410ms
hive-gateway-bun 130 9979 total, 0 failed avg: 303ms, p95: 426ms
apollo-router 125 10208 total, 0 failed avg: 296ms, p95: 339ms
apollo-gateway 84 6913 total, 0 failed avg: 438ms, p95: 483ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40617      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   196 kB/s
     http_req_blocked...............: avg=45.25µs  min=1.15µs   med=2.16µs   max=15.2ms   p(90)=3.03µs   p(95)=3.82µs   p(99.9)=13.6ms  
     http_req_connecting............: avg=42.36µs  min=0s       med=0s       max=15.17ms  p(90)=0s       p(95)=0s       p(99.9)=13.43ms 
     http_req_duration..............: avg=221.65ms min=114.88ms med=220.69ms max=585.93ms p(90)=229.04ms p(95)=231.74ms p(99.9)=496.5ms 
       { expected_response:true }...: avg=221.65ms min=114.88ms med=220.69ms max=585.93ms p(90)=229.04ms p(95)=231.74ms p(99.9)=496.5ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 13639
     http_req_receiving.............: avg=70.35µs  min=24µs     med=41.51µs  max=8.9ms    p(90)=78.79µs  p(95)=243.11µs p(99.9)=1.18ms  
     http_req_sending...............: avg=144.76µs min=5.28µs   med=9.03µs   max=325.45ms p(90)=28.46µs  p(95)=94.48µs  p(99.9)=6.17ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=221.44ms min=114.82ms med=220.62ms max=583.19ms p(90)=228.91ms p(95)=231.53ms p(99.9)=479.43ms
     http_reqs......................: 13639   168.654743/s
     iteration_duration.............: avg=222.01ms min=115.01ms med=220.91ms max=605.41ms p(90)=229.22ms p(95)=231.91ms p(99.9)=532.29ms
     iterations.....................: 13539   167.418181/s
     success_rate...................: 100.00% ✓ 13539      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40470      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   195 kB/s
     http_req_blocked...............: avg=21.91µs  min=1.36µs   med=3.19µs   max=9.47ms   p(90)=4.72µs   p(95)=5.64µs   p(99.9)=7.05ms  
     http_req_connecting............: avg=17.75µs  min=0s       med=0s       max=9.43ms   p(90)=0s       p(95)=0s       p(99.9)=7.03ms  
     http_req_duration..............: avg=222.38ms min=205.67ms med=220.56ms max=666.14ms p(90)=232.67ms p(95)=236.34ms p(99.9)=561.6ms 
       { expected_response:true }...: avg=222.38ms min=205.67ms med=220.56ms max=666.14ms p(90)=232.67ms p(95)=236.34ms p(99.9)=561.6ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 13590
     http_req_receiving.............: avg=82.59µs  min=28.67µs  med=61.5µs   max=6.24ms   p(90)=107.12µs p(95)=136.93µs p(99.9)=1.69ms  
     http_req_sending...............: avg=102.64µs min=6.17µs   med=12.97µs  max=393.98ms p(90)=22.28µs  p(95)=37.73µs  p(99.9)=3.6ms   
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=222.2ms  min=205.62ms med=220.46ms max=665.08ms p(90)=232.51ms p(95)=236.23ms p(99.9)=542.93ms
     http_reqs......................: 13590   167.545694/s
     iteration_duration.............: avg=222.79ms min=205.82ms med=220.88ms max=692.66ms p(90)=232.96ms p(95)=236.63ms p(99.9)=585.82ms
     iterations.....................: 13490   166.312834/s
     success_rate...................: 100.00% ✓ 13490      ✗ 0    
     vus............................: 31      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 37944      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 15 MB   183 kB/s
     http_req_blocked...............: avg=21.87µs  min=1.52µs   med=2.62µs   max=9.29ms   p(90)=3.91µs   p(95)=4.9µs    p(99.9)=7.03ms  
     http_req_connecting............: avg=18.6µs   min=0s       med=0s       max=9.26ms   p(90)=0s       p(95)=0s       p(99.9)=7.01ms  
     http_req_duration..............: avg=237.27ms min=159.66ms med=236.5ms  max=623.48ms p(90)=257.05ms p(95)=263.11ms p(99.9)=520ms   
       { expected_response:true }...: avg=237.27ms min=159.66ms med=236.5ms  max=623.48ms p(90)=257.05ms p(95)=263.11ms p(99.9)=520ms   
     http_req_failed................: 0.00%   ✓ 0          ✗ 12748
     http_req_receiving.............: avg=272.35µs min=32.09µs  med=65.14µs  max=30.63ms  p(90)=191.05µs p(95)=438.3µs  p(99.9)=25ms    
     http_req_sending...............: avg=46.45µs  min=7.16µs   med=11µs     max=89.01ms  p(90)=27.89µs  p(95)=106.78µs p(99.9)=2.67ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=236.95ms min=159.44ms med=236.23ms max=622.03ms p(90)=256.57ms p(95)=262.59ms p(99.9)=518.71ms
     http_reqs......................: 12748   157.200421/s
     iteration_duration.............: avg=237.81ms min=159.97ms med=236.83ms max=662.61ms p(90)=257.36ms p(95)=263.41ms p(99.9)=565.43ms
     iterations.....................: 12648   155.967283/s
     success_rate...................: 100.00% ✓ 12648      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 30414      ✗ 0    
     data_received..................: 899 MB  12 MB/s
     data_sent......................: 12 MB   156 kB/s
     http_req_blocked...............: avg=32.94µs  min=1.95µs   med=3.9µs    max=11.48ms  p(90)=5.59µs   p(95)=6.52µs   p(99.9)=9.27ms  
     http_req_connecting............: avg=27.75µs  min=0s       med=0s       max=11.44ms  p(90)=0s       p(95)=0s       p(99.9)=9.22ms  
     http_req_duration..............: avg=294.59ms min=160.5ms  med=277.66ms max=887.37ms p(90)=392.13ms p(95)=410.35ms p(99.9)=758.56ms
       { expected_response:true }...: avg=294.59ms min=160.5ms  med=277.66ms max=887.37ms p(90)=392.13ms p(95)=410.35ms p(99.9)=758.56ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10238
     http_req_receiving.............: avg=118.35µs min=35.36µs  med=79.33µs  max=275.15ms p(90)=130.84µs p(95)=157.68µs p(99.9)=1.31ms  
     http_req_sending...............: avg=61.25µs  min=7.9µs    med=16.23µs  max=278.12ms p(90)=25.86µs  p(95)=42.08µs  p(99.9)=1.87ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=294.41ms min=160.4ms  med=277.54ms max=870.2ms  p(90)=392.02ms p(95)=410.13ms p(99.9)=747.69ms
     http_reqs......................: 10238   133.798842/s
     iteration_duration.............: avg=296.43ms min=164.76ms med=278.11ms max=923.41ms p(90)=392.93ms p(95)=410.99ms p(99.9)=803.92ms
     iterations.....................: 10138   132.491958/s
     success_rate...................: 100.00% ✓ 10138      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 29637      ✗ 0   
     data_received..................: 876 MB  11 MB/s
     data_sent......................: 12 MB   152 kB/s
     http_req_blocked...............: avg=33.81µs  min=1.89µs   med=3.8µs    max=11.04ms  p(90)=5.34µs   p(95)=6.13µs   p(99.9)=8.92ms  
     http_req_connecting............: avg=28.44µs  min=0s       med=0s       max=10.99ms  p(90)=0s       p(95)=0s       p(99.9)=8.89ms  
     http_req_duration..............: avg=302.5ms  min=160.73ms med=286.7ms  max=861.59ms p(90)=396.78ms p(95)=426.22ms p(99.9)=733.95ms
       { expected_response:true }...: avg=302.5ms  min=160.73ms med=286.7ms  max=861.59ms p(90)=396.78ms p(95)=426.22ms p(99.9)=733.95ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 9979
     http_req_receiving.............: avg=89.84µs  min=32.41µs  med=68.82µs  max=9.05ms   p(90)=115.29µs p(95)=143.7µs  p(99.9)=3.17ms  
     http_req_sending...............: avg=128.67µs min=8.37µs   med=14.61µs  max=334.99ms p(90)=22.69µs  p(95)=38.51µs  p(99.9)=4.38ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=302.28ms min=160.64ms med=286.6ms  max=860.42ms p(90)=396.32ms p(95)=425.84ms p(99.9)=732.53ms
     http_reqs......................: 9979    130.244256/s
     iteration_duration.............: avg=304.37ms min=165.41ms med=287.23ms max=890.92ms p(90)=397.64ms p(95)=426.93ms p(99.9)=778.44ms
     iterations.....................: 9879    128.939073/s
     success_rate...................: 100.00% ✓ 9879       ✗ 0   
     vus............................: 50      min=0        max=50
     vus_max........................: 50      min=50       max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 30324      ✗ 0    
     data_received..................: 896 MB  11 MB/s
     data_sent......................: 12 MB   146 kB/s
     http_req_blocked...............: avg=53.98µs  min=1.66µs   med=2.71µs   max=18.51ms  p(90)=4.11µs   p(95)=4.93µs   p(99.9)=14.93ms 
     http_req_connecting............: avg=50.21µs  min=0s       med=0s       max=18.31ms  p(90)=0s       p(95)=0s       p(99.9)=14.86ms 
     http_req_duration..............: avg=295.85ms min=165.53ms med=297.48ms max=696.12ms p(90)=330.08ms p(95)=339.04ms p(99.9)=601.79ms
       { expected_response:true }...: avg=295.85ms min=165.53ms med=297.48ms max=696.12ms p(90)=330.08ms p(95)=339.04ms p(99.9)=601.79ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10208
     http_req_receiving.............: avg=98µs     min=36.63µs  med=52.59µs  max=116.41ms p(90)=103.44µs p(95)=227.66µs p(99.9)=1.45ms  
     http_req_sending...............: avg=92.36µs  min=7.93µs   med=11.24µs  max=227.98ms p(90)=29.17µs  p(95)=133.63µs p(99.9)=2.61ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=295.66ms min=165.44ms med=297.36ms max=685.34ms p(90)=329.89ms p(95)=338.84ms p(99.9)=584.05ms
     http_reqs......................: 10208   125.273293/s
     iteration_duration.............: avg=297.04ms min=165.7ms  med=298.02ms max=712.42ms p(90)=330.44ms p(95)=339.43ms p(99.9)=655.15ms
     iterations.....................: 10108   124.046086/s
     success_rate...................: 100.00% ✓ 10108      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 20439     ✗ 0   
     data_received..................: 607 MB  7.4 MB/s
     data_sent......................: 8.0 MB  98 kB/s
     http_req_blocked...............: avg=53.72µs  min=1.27µs   med=3.16µs   max=12.56ms  p(90)=4.84µs   p(95)=5.6µs    p(99.9)=10.97ms 
     http_req_connecting............: avg=49.91µs  min=0s       med=0s       max=12.52ms  p(90)=0s       p(95)=0s       p(99.9)=10.94ms 
     http_req_duration..............: avg=437.69ms min=211.63ms med=441.3ms  max=939.41ms p(90)=470.44ms p(95)=482.98ms p(99.9)=858.43ms
       { expected_response:true }...: avg=437.69ms min=211.63ms med=441.3ms  max=939.41ms p(90)=470.44ms p(95)=482.98ms p(99.9)=858.43ms
     http_req_failed................: 0.00%   ✓ 0         ✗ 6913
     http_req_receiving.............: avg=82.32µs  min=29.43µs  med=56.02µs  max=89.05ms  p(90)=96.81µs  p(95)=113.31µs p(99.9)=397.9µs 
     http_req_sending...............: avg=61.44µs  min=5.85µs   med=12.74µs  max=227.3ms  p(90)=19.91µs  p(95)=24.61µs  p(99.9)=3.81ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=437.55ms min=211.51ms med=441.23ms max=931.98ms p(90)=470.35ms p(95)=482.84ms p(99.9)=851.02ms
     http_reqs......................: 6913    84.576872/s
     iteration_duration.............: avg=441.48ms min=249.89ms med=441.79ms max=957.63ms p(90)=471.23ms p(95)=483.39ms p(99.9)=881.37ms
     iterations.....................: 6813    83.353425/s
     success_rate...................: 100.00% ✓ 6813      ✗ 0   
     vus............................: 50      min=0       max=50
     vus_max........................: 50      min=50      max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Sep 4, 2025

Overview for: constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 170 13792 total, 0 failed avg: 219ms, p95: 229ms
cosmo 168 13624 total, 0 failed avg: 222ms, p95: 242ms
grafbase 166 13506 total, 0 failed avg: 224ms, p95: 239ms
hive-gateway-bun 149 11397 total, 0 failed avg: 265ms, p95: 414ms
hive-gateway 143 10948 total, 0 failed avg: 275ms, p95: 429ms
apollo-router 136 11094 total, 0 failed avg: 273ms, p95: 313ms
apollo-gateway 124 10137 total, 0 failed avg: 298ms, p95: 325ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41076      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   198 kB/s
     http_req_blocked...............: avg=36.93µs  min=1.14µs   med=2µs      max=13.94ms  p(90)=3.06µs   p(95)=4.24µs   p(99.9)=11.91ms 
     http_req_connecting............: avg=34.39µs  min=0s       med=0s       max=13.9ms   p(90)=0s       p(95)=0s       p(99.9)=11.78ms 
     http_req_duration..............: avg=219.49ms min=121.98ms med=218.75ms max=575.94ms p(90)=226.48ms p(95)=229.03ms p(99.9)=480.57ms
       { expected_response:true }...: avg=219.49ms min=121.98ms med=218.75ms max=575.94ms p(90)=226.48ms p(95)=229.03ms p(99.9)=480.57ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13792
     http_req_receiving.............: avg=69.5µs   min=23.82µs  med=41.5µs   max=12.33ms  p(90)=81.12µs  p(95)=236.31µs p(99.9)=1.18ms  
     http_req_sending...............: avg=90.76µs  min=5.35µs   med=8.37µs   max=324.86ms p(90)=27.24µs  p(95)=92.24µs  p(99.9)=6.09ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=219.33ms min=120.79ms med=218.67ms max=572.01ms p(90)=226.33ms p(95)=228.84ms p(99.9)=468.54ms
     http_reqs......................: 13792   170.336344/s
     iteration_duration.............: avg=219.8ms  min=122.18ms med=218.96ms max=588.55ms p(90)=226.65ms p(95)=229.19ms p(99.9)=499.08ms
     iterations.....................: 13692   169.101306/s
     success_rate...................: 100.00% ✓ 13692      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40572      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   195 kB/s
     http_req_blocked...............: avg=47.43µs  min=1.4µs    med=2.57µs   max=16.32ms  p(90)=3.73µs   p(95)=4.56µs   p(99.9)=13.49ms 
     http_req_connecting............: avg=43µs     min=0s       med=0s       max=15.77ms  p(90)=0s       p(95)=0s       p(99.9)=13.25ms 
     http_req_duration..............: avg=221.99ms min=162.89ms med=221.13ms max=609.88ms p(90)=236.71ms p(95)=242.39ms p(99.9)=508.7ms 
       { expected_response:true }...: avg=221.99ms min=162.89ms med=221.13ms max=609.88ms p(90)=236.71ms p(95)=242.39ms p(99.9)=508.7ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 13624
     http_req_receiving.............: avg=456.29µs min=28.55µs  med=63.9µs   max=31.78ms  p(90)=379.67µs p(95)=921.71µs p(99.9)=24.29ms 
     http_req_sending...............: avg=117.61µs min=6.61µs   med=10.74µs  max=330.54ms p(90)=29.14µs  p(95)=117.39µs p(99.9)=4.42ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=221.41ms min=162.78ms med=220.67ms max=605.36ms p(90)=236.07ms p(95)=241.77ms p(99.9)=498.41ms
     http_reqs......................: 13624   168.024582/s
     iteration_duration.............: avg=222.37ms min=163.14ms med=221.45ms max=634.5ms  p(90)=236.99ms p(95)=242.72ms p(99.9)=526.31ms
     iterations.....................: 13524   166.791283/s
     success_rate...................: 100.00% ✓ 13524      ✗ 0    
     vus............................: 36      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40218      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   194 kB/s
     http_req_blocked...............: avg=22.63µs  min=1.38µs   med=3.77µs   max=9.56ms   p(90)=6.1µs    p(95)=7.21µs   p(99.9)=7.02ms  
     http_req_connecting............: avg=17.59µs  min=0s       med=0s       max=9.53ms   p(90)=0s       p(95)=0s       p(99.9)=7ms     
     http_req_duration..............: avg=223.69ms min=205.78ms med=221.61ms max=667.05ms p(90)=234.77ms p(95)=238.98ms p(99.9)=541.42ms
       { expected_response:true }...: avg=223.69ms min=205.78ms med=221.61ms max=667.05ms p(90)=234.77ms p(95)=238.98ms p(99.9)=541.42ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13506
     http_req_receiving.............: avg=97.46µs  min=29.71µs  med=74.07µs  max=9.13ms   p(90)=128.73µs p(95)=166.88µs p(99.9)=2.85ms  
     http_req_sending...............: avg=86.7µs   min=6.48µs   med=14.66µs  max=297.86ms p(90)=27.48µs  p(95)=41.9µs   p(99.9)=3.56ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=223.5ms  min=205.66ms med=221.48ms max=665.78ms p(90)=234.65ms p(95)=238.78ms p(99.9)=540.39ms
     http_reqs......................: 13506   166.422285/s
     iteration_duration.............: avg=224.11ms min=205.96ms med=221.95ms max=695.19ms p(90)=235.09ms p(95)=239.25ms p(99.9)=572.69ms
     iterations.....................: 13406   165.190075/s
     success_rate...................: 100.00% ✓ 13406      ✗ 0    
     vus............................: 39      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 33891      ✗ 0    
     data_received..................: 1.0 GB  13 MB/s
     data_sent......................: 13 MB   173 kB/s
     http_req_blocked...............: avg=30.25µs  min=1.55µs   med=3.44µs   max=11.23ms  p(90)=5.12µs   p(95)=6.19µs   p(99.9)=8.79ms  
     http_req_connecting............: avg=25.08µs  min=0s       med=0s       max=11.18ms  p(90)=0s       p(95)=0s       p(99.9)=8.77ms  
     http_req_duration..............: avg=264.63ms min=159.98ms med=250.02ms max=833.77ms p(90)=301.63ms p(95)=413.82ms p(99.9)=696.63ms
       { expected_response:true }...: avg=264.63ms min=159.98ms med=250.02ms max=833.77ms p(90)=301.63ms p(95)=413.82ms p(99.9)=696.63ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11397
     http_req_receiving.............: avg=102.41µs min=29.24µs  med=73.15µs  max=8.13ms   p(90)=126.77µs p(95)=169.86µs p(99.9)=3.95ms  
     http_req_sending...............: avg=80.44µs  min=6.91µs   med=14.07µs  max=226.2ms  p(90)=29.78µs  p(95)=43.94µs  p(99.9)=2.86ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=264.44ms min=159.9ms  med=249.91ms max=832.46ms p(90)=301.3ms  p(95)=413.59ms p(99.9)=695.61ms
     http_reqs......................: 11397   149.064158/s
     iteration_duration.............: avg=266.04ms min=176.86ms med=250.58ms max=864.51ms p(90)=302.87ms p(95)=414.55ms p(99.9)=786.65ms
     iterations.....................: 11297   147.756234/s
     success_rate...................: 100.00% ✓ 11297      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 32544      ✗ 0    
     data_received..................: 962 MB  13 MB/s
     data_sent......................: 13 MB   167 kB/s
     http_req_blocked...............: avg=34.63µs  min=1.63µs   med=4.06µs   max=11.91ms  p(90)=5.93µs   p(95)=7.42µs   p(99.9)=9.52ms  
     http_req_connecting............: avg=28.18µs  min=0s       med=0s       max=11.85ms  p(90)=0s       p(95)=0s       p(99.9)=9.47ms  
     http_req_duration..............: avg=275.28ms min=160.38ms med=260.02ms max=851.36ms p(90)=313.89ms p(95)=429.17ms p(99.9)=761.01ms
       { expected_response:true }...: avg=275.28ms min=160.38ms med=260.02ms max=851.36ms p(90)=313.89ms p(95)=429.17ms p(99.9)=761.01ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10948
     http_req_receiving.............: avg=111.72µs min=30.37µs  med=80.15µs  max=10.92ms  p(90)=140.34µs p(95)=187.75µs p(99.9)=4.07ms  
     http_req_sending...............: avg=100.69µs min=7.21µs   med=16.46µs  max=278.96ms p(90)=36.54µs  p(95)=57.52µs  p(99.9)=4.45ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=275.07ms min=160.25ms med=259.85ms max=851.18ms p(90)=313.31ms p(95)=428.96ms p(99.9)=760.03ms
     http_reqs......................: 10948   143.131163/s
     iteration_duration.............: avg=277.02ms min=181.53ms med=260.58ms max=900.23ms p(90)=316.45ms p(95)=430.24ms p(99.9)=856.57ms
     iterations.....................: 10848   141.82379/s
     success_rate...................: 100.00% ✓ 10848      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 32982      ✗ 0    
     data_received..................: 973 MB  12 MB/s
     data_sent......................: 13 MB   158 kB/s
     http_req_blocked...............: avg=22.14µs  min=1.42µs   med=2.63µs   max=7.61ms   p(90)=3.87µs   p(95)=4.64µs   p(99.9)=6.06ms  
     http_req_connecting............: avg=18.05µs  min=0s       med=0s       max=7.58ms   p(90)=0s       p(95)=0s       p(99.9)=6.05ms  
     http_req_duration..............: avg=273ms    min=169.03ms med=274.58ms max=675.41ms p(90)=304.14ms p(95)=312.53ms p(99.9)=588.71ms
       { expected_response:true }...: avg=273ms    min=169.03ms med=274.58ms max=675.41ms p(90)=304.14ms p(95)=312.53ms p(99.9)=588.71ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11094
     http_req_receiving.............: avg=129.96µs min=32.41µs  med=48.74µs  max=162.62ms p(90)=152.4µs  p(95)=429.22µs p(99.9)=3.99ms  
     http_req_sending...............: avg=113.64µs min=6.9µs    med=10.85µs  max=178.27ms p(90)=38.2µs   p(95)=124.15µs p(99.9)=4.72ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=272.75ms min=168.97ms med=274.39ms max=674.01ms p(90)=303.85ms p(95)=312.3ms  p(99.9)=587.16ms
     http_reqs......................: 11094   136.227352/s
     iteration_duration.............: avg=273.88ms min=169.46ms med=275.1ms  max=697.9ms  p(90)=304.54ms p(95)=312.91ms p(99.9)=619.42ms
     iterations.....................: 10994   134.999415/s
     success_rate...................: 100.00% ✓ 10994      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 30111      ✗ 0    
     data_received..................: 890 MB  11 MB/s
     data_sent......................: 12 MB   145 kB/s
     http_req_blocked...............: avg=31.07µs  min=1.37µs   med=3.42µs   max=10.47ms  p(90)=5.19µs   p(95)=6.15µs   p(99.9)=8.44ms  
     http_req_connecting............: avg=26.3µs   min=0s       med=0s       max=10.43ms  p(90)=0s       p(95)=0s       p(99.9)=8.41ms  
     http_req_duration..............: avg=297.99ms min=210.62ms med=295.9ms  max=818.39ms p(90)=318.27ms p(95)=325.49ms p(99.9)=727.53ms
       { expected_response:true }...: avg=297.99ms min=210.62ms med=295.9ms  max=818.39ms p(90)=318.27ms p(95)=325.49ms p(99.9)=727.53ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10137
     http_req_receiving.............: avg=81.86µs  min=30.47µs  med=62.38µs  max=5.32ms   p(90)=110.34µs p(95)=135.74µs p(99.9)=2.09ms  
     http_req_sending...............: avg=98.44µs  min=6.44µs   med=13.26µs  max=178.67ms p(90)=23.36µs  p(95)=39.57µs  p(99.9)=5.09ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=297.81ms min=210.54ms med=295.78ms max=817.1ms  p(90)=318.1ms  p(95)=325.28ms p(99.9)=726.25ms
     http_reqs......................: 10137   124.232986/s
     iteration_duration.............: avg=299.22ms min=223.59ms med=296.34ms max=837.88ms p(90)=318.69ms p(95)=325.77ms p(99.9)=759.67ms
     iterations.....................: 10037   123.007446/s
     success_rate...................: 100.00% ✓ 10037      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@renovate renovate bot force-pushed the renovate/pin-dependencies branch from cee24b3 to 2b46171 Compare September 4, 2025 09:05
@renovate renovate bot force-pushed the renovate/pin-dependencies branch from 2b46171 to 0039a59 Compare September 4, 2025 12:33
@ardatan ardatan merged commit a1f0268 into main Sep 5, 2025
33 checks passed
@ardatan ardatan deleted the renovate/pin-dependencies branch September 5, 2025 01:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant