Skip to content

Conversation

renovate[bot]
Copy link
Contributor

@renovate renovate bot commented Sep 4, 2025

This PR contains the following updates:

Package Change Age Confidence
vega-lite (source) 6.3.0 -> 6.3.1 age confidence

Release Notes

vega/vega-lite (vega-lite)

v6.3.1

Compare Source

Bug Fixes
Features

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.


  • If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

@renovate renovate bot added the dependencies Pull requests that update a dependency file label Sep 4, 2025
Copy link

github-actions bot commented Sep 4, 2025

Overview for: constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1848 111344 total, 0 failed avg: 27ms, p95: 48ms
grafbase 1715 103466 total, 0 failed avg: 29ms, p95: 50ms
cosmo 695 42008 total, 0 failed avg: 71ms, p95: 104ms
apollo-router 361 21965 total, 0 failed avg: 136ms, p95: 178ms
hive-gateway-bun 307 18724 total, 0 failed avg: 160ms, p95: 246ms
hive-gateway 305 18699 total, 0 failed avg: 160ms, p95: 224ms
apollo-gateway 122 7470 total, 0 failed avg: 402ms, p95: 474ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 333732      ✗ 0     
     data_received..................: 9.8 GB  162 MB/s
     data_sent......................: 130 MB  2.1 MB/s
     http_req_blocked...............: avg=5.12µs   min=1.15µs  med=2.57µs  max=8.95ms   p(90)=3.74µs   p(95)=4.47µs   p(99.9)=86.09µs
     http_req_connecting............: avg=2.02µs   min=0s      med=0s      max=8.92ms   p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_duration..............: avg=26.74ms  min=1.88ms  med=24.34ms max=430.85ms p(90)=41.23ms  p(95)=47.71ms  p(99.9)=81.38ms
       { expected_response:true }...: avg=26.74ms  min=1.88ms  med=24.34ms max=430.85ms p(90)=41.23ms  p(95)=47.71ms  p(99.9)=81.38ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 111344
     http_req_receiving.............: avg=113.43µs min=24.23µs med=42.87µs max=38.32ms  p(90)=112.54µs p(95)=343.05µs p(99.9)=10.67ms
     http_req_sending...............: avg=76.84µs  min=5.17µs  med=10.11µs max=298.95ms p(90)=30.34µs  p(95)=123.81µs p(99.9)=9.82ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=26.55ms  min=1.84ms  med=24.2ms  max=430.13ms p(90)=40.92ms  p(95)=47.33ms  p(99.9)=79.71ms
     http_reqs......................: 111344  1848.06629/s
     iteration_duration.............: avg=26.96ms  min=3.92ms  med=24.53ms max=456.26ms p(90)=41.44ms  p(95)=47.89ms  p(99.9)=82.01ms
     iterations.....................: 111244  1846.406509/s
     success_rate...................: 100.00% ✓ 111244      ✗ 0     
     vus............................: 50      min=50        max=50  
     vus_max........................: 50      min=50        max=50  

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 310098      ✗ 0     
     data_received..................: 9.1 GB  151 MB/s
     data_sent......................: 120 MB  2.0 MB/s
     http_req_blocked...............: avg=5.93µs   min=1.11µs  med=2.96µs  max=9.56ms   p(90)=4.05µs   p(95)=4.92µs   p(99.9)=110.97µs
     http_req_connecting............: avg=2.3µs    min=0s      med=0s      max=9.52ms   p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_duration..............: avg=28.77ms  min=2.5ms   med=25.88ms max=448.81ms p(90)=43.56ms  p(95)=50.01ms  p(99.9)=87.52ms 
       { expected_response:true }...: avg=28.77ms  min=2.5ms   med=25.88ms max=448.81ms p(90)=43.56ms  p(95)=50.01ms  p(99.9)=87.52ms 
     http_req_failed................: 0.00%   ✓ 0           ✗ 103466
     http_req_receiving.............: avg=132.79µs min=23.96µs med=46.48µs max=46.54ms  p(90)=140.01µs p(95)=366.74µs p(99.9)=14.44ms 
     http_req_sending...............: avg=92.87µs  min=5.18µs  med=11.56µs max=243.17ms p(90)=36.3µs   p(95)=127.75µs p(99.9)=12.41ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=28.54ms  min=2.46ms  med=25.72ms max=447.73ms p(90)=43.11ms  p(95)=49.55ms  p(99.9)=85.74ms 
     http_reqs......................: 103466  1715.019117/s
     iteration_duration.............: avg=29.01ms  min=6.93ms  med=26.1ms  max=458.48ms p(90)=43.78ms  p(95)=50.23ms  p(99.9)=88.2ms  
     iterations.....................: 103366  1713.361549/s
     success_rate...................: 100.00% ✓ 103366      ✗ 0     
     vus............................: 50      min=50        max=50  
     vus_max........................: 50      min=50        max=50  

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 125724    ✗ 0    
     data_received..................: 3.7 GB  61 MB/s
     data_sent......................: 49 MB   809 kB/s
     http_req_blocked...............: avg=8.88µs   min=1.43µs  med=2.71µs  max=9.41ms   p(90)=3.75µs   p(95)=4.39µs   p(99.9)=1.29ms  
     http_req_connecting............: avg=5.59µs   min=0s      med=0s      max=9.38ms   p(90)=0s       p(95)=0s       p(99.9)=1.27ms  
     http_req_duration..............: avg=71.18ms  min=2.91ms  med=70.12ms max=506.75ms p(90)=96.18ms  p(95)=103.98ms p(99.9)=283.03ms
       { expected_response:true }...: avg=71.18ms  min=2.91ms  med=70.12ms max=506.75ms p(90)=96.18ms  p(95)=103.98ms p(99.9)=283.03ms
     http_req_failed................: 0.00%   ✓ 0         ✗ 42008
     http_req_receiving.............: avg=180.42µs min=33.35µs med=69.76µs max=48.95ms  p(90)=144.92µs p(95)=347.6µs  p(99.9)=22.81ms 
     http_req_sending...............: avg=64.85µs  min=6.11µs  med=10.97µs max=391.28ms p(90)=27.6µs   p(95)=113.75µs p(99.9)=2.64ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=70.94ms  min=2.83ms  med=69.91ms max=505.73ms p(90)=95.92ms  p(95)=103.76ms p(99.9)=267.48ms
     http_reqs......................: 42008   695.32076/s
     iteration_duration.............: avg=71.6ms   min=4.51ms  med=70.39ms max=532.57ms p(90)=96.44ms  p(95)=104.24ms p(99.9)=300.6ms 
     iterations.....................: 41908   693.66555/s
     success_rate...................: 100.00% ✓ 41908     ✗ 0    
     vus............................: 50      min=50      max=50 
     vus_max........................: 50      min=50      max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 65595      ✗ 0    
     data_received..................: 1.9 GB  32 MB/s
     data_sent......................: 26 MB   420 kB/s
     http_req_blocked...............: avg=35.13µs  min=1.9µs   med=3µs      max=19.3ms   p(90)=4.71µs   p(95)=5.6µs    p(99.9)=14.35ms 
     http_req_connecting............: avg=31.03µs  min=0s      med=0s       max=19.15ms  p(90)=0s       p(95)=0s       p(99.9)=14.3ms  
     http_req_duration..............: avg=136.36ms min=6.06ms  med=135.55ms max=578.81ms p(90)=168.01ms p(95)=177.94ms p(99.9)=423.45ms
       { expected_response:true }...: avg=136.36ms min=6.06ms  med=135.55ms max=578.81ms p(90)=168.01ms p(95)=177.94ms p(99.9)=423.45ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 21965
     http_req_receiving.............: avg=99.46µs  min=27.04µs med=57.4µs   max=350.59ms p(90)=114.23µs p(95)=147.7µs  p(99.9)=1.58ms  
     http_req_sending...............: avg=49.04µs  min=7.76µs  med=12.06µs  max=332.19ms p(90)=21.58µs  p(95)=38.05µs  p(99.9)=4.14ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=136.21ms min=5.99ms  med=135.43ms max=557.61ms p(90)=167.87ms p(95)=177.79ms p(99.9)=407.22ms
     http_reqs......................: 21965   361.244146/s
     iteration_duration.............: avg=137.29ms min=18.72ms med=135.9ms  max=608.83ms p(90)=168.31ms p(95)=178.26ms p(99.9)=444.95ms
     iterations.....................: 21865   359.599511/s
     success_rate...................: 100.00% ✓ 21865      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 55872      ✗ 0    
     data_received..................: 1.6 GB  27 MB/s
     data_sent......................: 22 MB   357 kB/s
     http_req_blocked...............: avg=25.47µs  min=1.23µs  med=2.86µs   max=15.98ms  p(90)=4.73µs   p(95)=6.08µs   p(99.9)=10.4ms  
     http_req_connecting............: avg=21.37µs  min=0s      med=0s       max=15.94ms  p(90)=0s       p(95)=0s       p(99.9)=10.36ms 
     http_req_duration..............: avg=160.05ms min=7.11ms  med=148.75ms max=589.74ms p(90)=178.75ms p(95)=245.8ms  p(99.9)=474.25ms
       { expected_response:true }...: avg=160.05ms min=7.11ms  med=148.75ms max=589.74ms p(90)=178.75ms p(95)=245.8ms  p(99.9)=474.25ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 18724
     http_req_receiving.............: avg=96.94µs  min=27.25µs med=48.58µs  max=24.56ms  p(90)=113.49µs p(95)=277.79µs p(99.9)=3.54ms  
     http_req_sending...............: avg=99.25µs  min=5.81µs  med=11.38µs  max=326.55ms p(90)=33.85µs  p(95)=127.93µs p(99.9)=10.67ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=159.86ms min=7.06ms  med=148.61ms max=582.16ms p(90)=178.6ms  p(95)=241.5ms  p(99.9)=473.62ms
     http_reqs......................: 18724   307.101685/s
     iteration_duration.............: avg=161.16ms min=19.65ms med=149.09ms max=626.36ms p(90)=179.18ms p(95)=284.38ms p(99.9)=474.98ms
     iterations.....................: 18624   305.461535/s
     success_rate...................: 100.00% ✓ 18624      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 55797      ✗ 0    
     data_received..................: 1.6 GB  27 MB/s
     data_sent......................: 22 MB   356 kB/s
     http_req_blocked...............: avg=33.17µs  min=1.19µs  med=2.83µs   max=21.46ms  p(90)=4.6µs    p(95)=5.69µs   p(99.9)=11.83ms 
     http_req_connecting............: avg=28.25µs  min=0s      med=0s       max=21.26ms  p(90)=0s       p(95)=0s       p(99.9)=11.35ms 
     http_req_duration..............: avg=160.23ms min=6.91ms  med=150.05ms max=565.37ms p(90)=179.39ms p(95)=223.54ms p(99.9)=465.58ms
       { expected_response:true }...: avg=160.23ms min=6.91ms  med=150.05ms max=565.37ms p(90)=179.39ms p(95)=223.54ms p(99.9)=465.58ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 18699
     http_req_receiving.............: avg=99.94µs  min=25.69µs med=48.5µs   max=24.03ms  p(90)=111.86µs p(95)=214.87µs p(99.9)=4.69ms  
     http_req_sending...............: avg=90.36µs  min=5.48µs  med=11.39µs  max=203.2ms  p(90)=32.04µs  p(95)=122.9µs  p(99.9)=6.42ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=160.04ms min=6.75ms  med=149.93ms max=563.49ms p(90)=179.15ms p(95)=223.39ms p(99.9)=465.42ms
     http_reqs......................: 18699   305.708202/s
     iteration_duration.............: avg=161.41ms min=39.7ms  med=150.41ms max=594.47ms p(90)=179.83ms p(95)=226.97ms p(99.9)=481.08ms
     iterations.....................: 18599   304.073312/s
     success_rate...................: 100.00% ✓ 18599      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 22110      ✗ 0   
     data_received..................: 656 MB  11 MB/s
     data_sent......................: 8.7 MB  142 kB/s
     http_req_blocked...............: avg=77.54µs  min=1.39µs  med=2.92µs   max=17.61ms  p(90)=4.49µs   p(95)=5.2µs    p(99.9)=15.05ms 
     http_req_connecting............: avg=73.07µs  min=0s      med=0s       max=17.57ms  p(90)=0s       p(95)=0s       p(99.9)=14.71ms 
     http_req_duration..............: avg=402.02ms min=7.39ms  med=401.38ms max=819.88ms p(90)=455.36ms p(95)=474.16ms p(99.9)=744.57ms
       { expected_response:true }...: avg=402.02ms min=7.39ms  med=401.38ms max=819.88ms p(90)=455.36ms p(95)=474.16ms p(99.9)=744.57ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 7470
     http_req_receiving.............: avg=85.62µs  min=30.01µs med=50.98µs  max=181.05ms p(90)=91.63µs  p(95)=105.46µs p(99.9)=741.25µs
     http_req_sending...............: avg=111.87µs min=6.29µs  med=11.83µs  max=261.62ms p(90)=18.52µs  p(95)=22.36µs  p(99.9)=6.98ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=401.82ms min=7.33ms  med=401.28ms max=819.61ms p(90)=455.2ms  p(95)=473.96ms p(99.9)=722.75ms
     http_reqs......................: 7470    122.195007/s
     iteration_duration.............: avg=407.98ms min=151.9ms med=402ms    max=867.6ms  p(90)=456.25ms p(95)=474.89ms p(99.9)=838.93ms
     iterations.....................: 7370    120.559197/s
     success_rate...................: 100.00% ✓ 7370       ✗ 0   
     vus............................: 31      min=31       max=50
     vus_max........................: 50      min=50       max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Sep 4, 2025

Overview for: constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 173 13991 total, 0 failed avg: 216ms, p95: 227ms
hive-router 167 13543 total, 0 failed avg: 223ms, p95: 233ms
cosmo 158 12844 total, 0 failed avg: 235ms, p95: 261ms
hive-gateway 148 11381 total, 0 failed avg: 265ms, p95: 301ms
hive-gateway-bun 148 11336 total, 0 failed avg: 266ms, p95: 393ms
apollo-router 127 10378 total, 0 failed avg: 291ms, p95: 336ms
apollo-gateway 87 7152 total, 0 failed avg: 423ms, p95: 462ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41673      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   201 kB/s
     http_req_blocked...............: avg=43.96µs  min=1.28µs   med=2.04µs   max=16.04ms  p(90)=3.53µs   p(95)=4.96µs   p(99.9)=13.35ms 
     http_req_connecting............: avg=40.54µs  min=0s       med=0s       max=15.82ms  p(90)=0s       p(95)=0s       p(99.9)=13.32ms 
     http_req_duration..............: avg=215.74ms min=159.97ms med=215.01ms max=576.67ms p(90)=224.08ms p(95)=226.74ms p(99.9)=473.97ms
       { expected_response:true }...: avg=215.74ms min=159.97ms med=215.01ms max=576.67ms p(90)=224.08ms p(95)=226.74ms p(99.9)=473.97ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13991
     http_req_receiving.............: avg=75.85µs  min=24.74µs  med=44.99µs  max=15.58ms  p(90)=90.75µs  p(95)=257.41µs p(99.9)=1.41ms  
     http_req_sending...............: avg=112.53µs min=5.77µs   med=8.75µs   max=344.95ms p(90)=32.09µs  p(95)=92.74µs  p(99.9)=6.44ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=215.55ms min=159.85ms med=214.92ms max=572.23ms p(90)=223.93ms p(95)=226.54ms p(99.9)=470ms   
     http_reqs......................: 13991   173.043566/s
     iteration_duration.............: avg=216.02ms min=160.2ms  med=215.24ms max=600.89ms p(90)=224.25ms p(95)=226.92ms p(99.9)=494.48ms
     iterations.....................: 13891   171.806745/s
     success_rate...................: 100.00% ✓ 13891      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40329      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   195 kB/s
     http_req_blocked...............: avg=20.02µs  min=1.22µs   med=2.3µs    max=9.13ms   p(90)=3.43µs   p(95)=4.74µs   p(99.9)=6.8ms   
     http_req_connecting............: avg=17.26µs  min=0s       med=0s       max=9.09ms   p(90)=0s       p(95)=0s       p(99.9)=6.79ms  
     http_req_duration..............: avg=222.87ms min=123.73ms med=222ms    max=622.41ms p(90)=230.83ms p(95)=233.29ms p(99.9)=514.39ms
       { expected_response:true }...: avg=222.87ms min=123.73ms med=222ms    max=622.41ms p(90)=230.83ms p(95)=233.29ms p(99.9)=514.39ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13543
     http_req_receiving.............: avg=75.67µs  min=24.42µs  med=43.21µs  max=7.98ms   p(90)=92.08µs  p(95)=264.33µs p(99.9)=1.35ms  
     http_req_sending...............: avg=72.34µs  min=5.54µs   med=9.39µs   max=240.83ms p(90)=30.22µs  p(95)=96.61µs  p(99.9)=4.82ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=222.73ms min=121.53ms med=221.91ms max=620.76ms p(90)=230.71ms p(95)=233.14ms p(99.9)=513.33ms
     http_reqs......................: 13543   167.590249/s
     iteration_duration.............: avg=223.23ms min=123.91ms med=222.23ms max=637.58ms p(90)=231.01ms p(95)=233.47ms p(99.9)=532.63ms
     iterations.....................: 13443   166.352781/s
     success_rate...................: 100.00% ✓ 13443      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 38232      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 15 MB   184 kB/s
     http_req_blocked...............: avg=48.32µs  min=1.43µs   med=2.61µs   max=20.89ms  p(90)=3.71µs   p(95)=4.56µs   p(99.9)=16.11ms 
     http_req_connecting............: avg=44.63µs  min=0s       med=0s       max=20.7ms   p(90)=0s       p(95)=0s       p(99.9)=16.05ms 
     http_req_duration..............: avg=235.42ms min=162.85ms med=234.83ms max=625.5ms  p(90)=254.55ms p(95)=260.73ms p(99.9)=517.93ms
       { expected_response:true }...: avg=235.42ms min=162.85ms med=234.83ms max=625.5ms  p(90)=254.55ms p(95)=260.73ms p(99.9)=517.93ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12844
     http_req_receiving.............: avg=365.46µs min=33.09µs  med=60.94µs  max=330.75ms p(90)=169.51µs p(95)=422.85µs p(99.9)=32.56ms 
     http_req_sending...............: avg=64.21µs  min=7.14µs   med=10.8µs   max=223.81ms p(90)=27.82µs  p(95)=111.28µs p(99.9)=2.92ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=234.99ms min=162.79ms med=234.54ms max=624.95ms p(90)=253.93ms p(95)=259.84ms p(99.9)=510.99ms
     http_reqs......................: 12844   158.534693/s
     iteration_duration.............: avg=235.96ms min=163.03ms med=235.19ms max=649.74ms p(90)=254.82ms p(95)=261ms    p(99.9)=567.02ms
     iterations.....................: 12744   157.300383/s
     success_rate...................: 100.00% ✓ 12744      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 33843      ✗ 0    
     data_received..................: 1000 MB 13 MB/s
     data_sent......................: 13 MB   173 kB/s
     http_req_blocked...............: avg=26.54µs  min=1.17µs   med=2.69µs   max=10.79ms  p(90)=4.36µs   p(95)=6.03µs   p(99.9)=8.39ms  
     http_req_connecting............: avg=23.03µs  min=0s       med=0s       max=10.72ms  p(90)=0s       p(95)=0s       p(99.9)=8.35ms  
     http_req_duration..............: avg=264.95ms min=160.24ms med=254.56ms max=714.36ms p(90)=275.92ms p(95)=300.98ms p(99.9)=614.76ms
       { expected_response:true }...: avg=264.95ms min=160.24ms med=254.56ms max=714.36ms p(90)=275.92ms p(95)=300.98ms p(99.9)=614.76ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11381
     http_req_receiving.............: avg=93.7µs   min=25.72µs  med=48.02µs  max=15.99ms  p(90)=111.43µs p(95)=374.31µs p(99.9)=2.57ms  
     http_req_sending...............: avg=102.09µs min=5.51µs   med=11.42µs  max=205.46ms p(90)=36.95µs  p(95)=140.83µs p(99.9)=7.36ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=264.76ms min=160.11ms med=254.4ms  max=713.49ms p(90)=275.66ms p(95)=300.15ms p(99.9)=613.66ms
     http_reqs......................: 11381   148.97859/s
     iteration_duration.............: avg=266.24ms min=161.29ms med=254.89ms max=742.13ms p(90)=276.29ms p(95)=302.55ms p(99.9)=636ms   
     iterations.....................: 11281   147.669579/s
     success_rate...................: 100.00% ✓ 11281      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 33708      ✗ 0    
     data_received..................: 996 MB  13 MB/s
     data_sent......................: 13 MB   172 kB/s
     http_req_blocked...............: avg=34.3µs   min=1.22µs   med=2.76µs   max=12.7ms   p(90)=4.42µs   p(95)=5.83µs   p(99.9)=10.28ms 
     http_req_connecting............: avg=30.64µs  min=0s       med=0s       max=12.66ms  p(90)=0s       p(95)=0s       p(99.9)=10.25ms 
     http_req_duration..............: avg=266.24ms min=144.6ms  med=257.2ms  max=782.74ms p(90)=280.08ms p(95)=392.67ms p(99.9)=653.47ms
       { expected_response:true }...: avg=266.24ms min=144.6ms  med=257.2ms  max=782.74ms p(90)=280.08ms p(95)=392.67ms p(99.9)=653.47ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11336
     http_req_receiving.............: avg=95.19µs  min=25.91µs  med=48.06µs  max=9.93ms   p(90)=116.06µs p(95)=385.81µs p(99.9)=2.82ms  
     http_req_sending...............: avg=135.3µs  min=5.32µs   med=11.38µs  max=289.6ms  p(90)=38.42µs  p(95)=143.02µs p(99.9)=8.15ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=266.01ms min=137.06ms med=257.07ms max=782.03ms p(90)=279.87ms p(95)=392.02ms p(99.9)=652.52ms
     http_reqs......................: 11336   148.117023/s
     iteration_duration.............: avg=267.55ms min=144.86ms med=257.54ms max=809.75ms p(90)=280.56ms p(95)=393.59ms p(99.9)=693.28ms
     iterations.....................: 11236   146.810415/s
     success_rate...................: 100.00% ✓ 11236      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 30834      ✗ 0    
     data_received..................: 911 MB  11 MB/s
     data_sent......................: 12 MB   148 kB/s
     http_req_blocked...............: avg=56.46µs  min=1.6µs    med=2.66µs   max=18.06ms  p(90)=3.85µs   p(95)=4.54µs   p(99.9)=14.93ms 
     http_req_connecting............: avg=52.53µs  min=0s       med=0s       max=17.93ms  p(90)=0s       p(95)=0s       p(99.9)=14.88ms 
     http_req_duration..............: avg=291.11ms min=175.58ms med=292.88ms max=682.08ms p(90)=326.96ms p(95)=335.68ms p(99.9)=606.14ms
       { expected_response:true }...: avg=291.11ms min=175.58ms med=292.88ms max=682.08ms p(90)=326.96ms p(95)=335.68ms p(99.9)=606.14ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10378
     http_req_receiving.............: avg=78.18µs  min=33.58µs  med=49.84µs  max=2.82ms   p(90)=95.38µs  p(95)=173.18µs p(99.9)=1.29ms  
     http_req_sending...............: avg=106.78µs min=7.92µs   med=10.85µs  max=230.9ms  p(90)=21.09µs  p(95)=124.38µs p(99.9)=2.33ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=290.93ms min=175.46ms med=292.73ms max=681.26ms p(90)=326.8ms  p(95)=335.38ms p(99.9)=605.18ms
     http_reqs......................: 10378   127.464484/s
     iteration_duration.............: avg=292.3ms  min=175.85ms med=293.36ms max=712.62ms p(90)=327.27ms p(95)=336.02ms p(99.9)=668.85ms
     iterations.....................: 10278   126.236266/s
     success_rate...................: 100.00% ✓ 10278      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 21156     ✗ 0   
     data_received..................: 628 MB  7.7 MB/s
     data_sent......................: 8.3 MB  102 kB/s
     http_req_blocked...............: avg=99.83µs  min=1.25µs   med=3.11µs   max=20.1ms   p(90)=4.33µs   p(95)=5.25µs   p(99.9)=17.33ms 
     http_req_connecting............: avg=94.72µs  min=0s       med=0s       max=20.06ms  p(90)=0s       p(95)=0s       p(99.9)=17.29ms 
     http_req_duration..............: avg=422.81ms min=210.6ms  med=425.62ms max=813.15ms p(90)=449.83ms p(95)=462.37ms p(99.9)=761.73ms
       { expected_response:true }...: avg=422.81ms min=210.6ms  med=425.62ms max=813.15ms p(90)=449.83ms p(95)=462.37ms p(99.9)=761.73ms
     http_req_failed................: 0.00%   ✓ 0         ✗ 7152
     http_req_receiving.............: avg=60.84µs  min=30.73µs  med=52.2µs   max=2.66ms   p(90)=88.77µs  p(95)=102µs    p(99.9)=309.22µs
     http_req_sending...............: avg=108.36µs min=6.09µs   med=12.36µs  max=222.04ms p(90)=17.29µs  p(95)=23.38µs  p(99.9)=4.77ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=422.65ms min=210.52ms med=425.52ms max=808.94ms p(90)=449.63ms p(95)=462.24ms p(99.9)=761.31ms
     http_reqs......................: 7152    87.623835/s
     iteration_duration.............: avg=426.23ms min=253.57ms med=425.99ms max=841.96ms p(90)=450.44ms p(95)=463.01ms p(99.9)=802.97ms
     iterations.....................: 7052    86.398669/s
     success_rate...................: 100.00% ✓ 7052      ✗ 0   
     vus............................: 50      min=0       max=50
     vus_max........................: 50      min=50      max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Sep 4, 2025

Overview for: constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 172 13985 total, 0 failed avg: 216ms, p95: 227ms
hive-router 170 13742 total, 0 failed avg: 220ms, p95: 229ms
hive-gateway-bun 167 12829 total, 0 failed avg: 235ms, p95: 262ms
cosmo 166 13536 total, 0 failed avg: 224ms, p95: 247ms
hive-gateway 164 12566 total, 0 failed avg: 240ms, p95: 265ms
apollo-router 137 11167 total, 0 failed avg: 270ms, p95: 310ms ❌ 1 unexpected GraphQL errors
apollo-gateway 121 9895 total, 0 failed avg: 305ms, p95: 337ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41655      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   201 kB/s
     http_req_blocked...............: avg=43.65µs  min=1.19µs   med=2.01µs   max=15.58ms  p(90)=3.58µs   p(95)=5.32µs   p(99.9)=13.01ms 
     http_req_connecting............: avg=40.69µs  min=0s       med=0s       max=15.36ms  p(90)=0s       p(95)=0s       p(99.9)=12.99ms 
     http_req_duration..............: avg=215.92ms min=112.06ms med=215.14ms max=594.95ms p(90)=224.16ms p(95)=226.73ms p(99.9)=491.39ms
       { expected_response:true }...: avg=215.92ms min=112.06ms med=215.14ms max=594.95ms p(90)=224.16ms p(95)=226.73ms p(99.9)=491.39ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13985
     http_req_receiving.............: avg=81.7µs   min=27.09µs  med=45.93µs  max=12.91ms  p(90)=98.44µs  p(95)=289.18µs p(99.9)=4.18ms  
     http_req_sending...............: avg=133.86µs min=5.53µs   med=8.69µs   max=359.43ms p(90)=30.96µs  p(95)=100.72µs p(99.9)=6.75ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=215.7ms  min=111.93ms med=215.03ms max=589.6ms  p(90)=224.04ms p(95)=226.52ms p(99.9)=478.34ms
     http_reqs......................: 13985   172.771416/s
     iteration_duration.............: avg=216.23ms min=112.31ms med=215.35ms max=615.33ms p(90)=224.36ms p(95)=226.91ms p(99.9)=526.92ms
     iterations.....................: 13885   171.536011/s
     success_rate...................: 100.00% ✓ 13885      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40926      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   198 kB/s
     http_req_blocked...............: avg=18.76µs  min=1.13µs   med=2.01µs   max=8.7ms    p(90)=3.03µs   p(95)=4.12µs   p(99.9)=6.56ms  
     http_req_connecting............: avg=16.29µs  min=0s       med=0s       max=8.66ms   p(90)=0s       p(95)=0s       p(99.9)=6.54ms  
     http_req_duration..............: avg=219.69ms min=119.59ms med=218.7ms  max=604.58ms p(90)=226.71ms p(95)=229.36ms p(99.9)=512.81ms
       { expected_response:true }...: avg=219.69ms min=119.59ms med=218.7ms  max=604.58ms p(90)=226.71ms p(95)=229.36ms p(99.9)=512.81ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13742
     http_req_receiving.............: avg=70.93µs  min=23.42µs  med=41.13µs  max=11.65ms  p(90)=80.2µs   p(95)=237.41µs p(99.9)=2.07ms  
     http_req_sending...............: avg=149.62µs min=5.29µs   med=8.41µs   max=370.67ms p(90)=28.65µs  p(95)=90.99µs  p(99.9)=6.17ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=219.47ms min=116.11ms med=218.62ms max=603.88ms p(90)=226.52ms p(95)=229.17ms p(99.9)=498.01ms
     http_reqs......................: 13742   170.080288/s
     iteration_duration.............: avg=219.98ms min=119.75ms med=218.91ms max=612.87ms p(90)=226.89ms p(95)=229.52ms p(99.9)=523.27ms
     iterations.....................: 13642   168.842621/s
     success_rate...................: 100.00% ✓ 13642      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 38187      ✗ 0    
     data_received..................: 1.1 GB  15 MB/s
     data_sent......................: 15 MB   195 kB/s
     http_req_blocked...............: avg=24.45µs  min=1.14µs   med=2.59µs   max=10.84ms  p(90)=4.15µs   p(95)=5.39µs   p(99.9)=8.14ms  
     http_req_connecting............: avg=20.92µs  min=0s       med=0s       max=10.8ms   p(90)=0s       p(95)=0s       p(99.9)=8.11ms  
     http_req_duration..............: avg=235.42ms min=138.83ms med=227.16ms max=718.87ms p(90)=247.55ms p(95)=262.17ms p(99.9)=628.73ms
       { expected_response:true }...: avg=235.42ms min=138.83ms med=227.16ms max=718.87ms p(90)=247.55ms p(95)=262.17ms p(99.9)=628.73ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12829
     http_req_receiving.............: avg=87.57µs  min=25.36µs  med=43.98µs  max=83.54ms  p(90)=99.88µs  p(95)=169.43µs p(99.9)=3.33ms  
     http_req_sending...............: avg=59.74µs  min=5.46µs   med=10.82µs  max=87.11ms  p(90)=32.6µs   p(95)=117.1µs  p(99.9)=4.08ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=235.27ms min=138.77ms med=227.03ms max=695.28ms p(90)=247.43ms p(95)=262.06ms p(99.9)=628.14ms
     http_reqs......................: 12829   167.489737/s
     iteration_duration.............: avg=236.29ms min=139.01ms med=227.49ms max=737.37ms p(90)=247.95ms p(95)=262.81ms p(99.9)=632.8ms 
     iterations.....................: 12729   166.184181/s
     success_rate...................: 100.00% ✓ 12729      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40308      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   194 kB/s
     http_req_blocked...............: avg=45.44µs  min=1.43µs   med=2.82µs   max=19.68ms  p(90)=4.02µs   p(95)=4.93µs   p(99.9)=15.95ms 
     http_req_connecting............: avg=41.72µs  min=0s       med=0s       max=19.55ms  p(90)=0s       p(95)=0s       p(99.9)=15.88ms 
     http_req_duration..............: avg=223.5ms  min=128.21ms med=222.56ms max=599.5ms  p(90)=241.31ms p(95)=246.8ms  p(99.9)=500.88ms
       { expected_response:true }...: avg=223.5ms  min=128.21ms med=222.56ms max=599.5ms  p(90)=241.31ms p(95)=246.8ms  p(99.9)=500.88ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13536
     http_req_receiving.............: avg=439.28µs min=31.11µs  med=63.77µs  max=38.09ms  p(90)=332.23µs p(95)=713.09µs p(99.9)=24.08ms 
     http_req_sending...............: avg=89.55µs  min=6.29µs   med=11.36µs  max=321.79ms p(90)=31.22µs  p(95)=118.32µs p(99.9)=2.32ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=222.97ms min=128.15ms med=222.12ms max=599.01ms p(90)=240.84ms p(95)=246.22ms p(99.9)=493.39ms
     http_reqs......................: 13536   166.961189/s
     iteration_duration.............: avg=223.93ms min=128.4ms  med=222.9ms  max=624.53ms p(90)=241.6ms  p(95)=247.08ms p(99.9)=535.41ms
     iterations.....................: 13436   165.727728/s
     success_rate...................: 100.00% ✓ 13436      ✗ 0    
     vus............................: 47      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 37398      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 15 MB   191 kB/s
     http_req_blocked...............: avg=23.73µs  min=1.13µs   med=2.63µs   max=10.4ms   p(90)=4.3µs    p(95)=5.63µs   p(99.9)=7.83ms  
     http_req_connecting............: avg=20.26µs  min=0s       med=0s       max=10.36ms  p(90)=0s       p(95)=0s       p(99.9)=7.77ms  
     http_req_duration..............: avg=240.26ms min=160.28ms med=232.39ms max=786.04ms p(90)=254.15ms p(95)=265.25ms p(99.9)=658.09ms
       { expected_response:true }...: avg=240.26ms min=160.28ms med=232.39ms max=786.04ms p(90)=254.15ms p(95)=265.25ms p(99.9)=658.09ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12566
     http_req_receiving.............: avg=83.06µs  min=26.57µs  med=45.85µs  max=10.56ms  p(90)=99.9µs   p(95)=158.85µs p(99.9)=2.97ms  
     http_req_sending...............: avg=129.35µs min=5.39µs   med=10.91µs  max=179.8ms  p(90)=31.66µs  p(95)=115.83µs p(99.9)=5.71ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=240.05ms min=160.18ms med=232.29ms max=785.38ms p(90)=253.99ms p(95)=264.8ms  p(99.9)=657.33ms
     http_reqs......................: 12566   164.112812/s
     iteration_duration.............: avg=241.19ms min=185.61ms med=232.69ms max=812.32ms p(90)=254.47ms p(95)=265.59ms p(99.9)=701.72ms
     iterations.....................: 12466   162.806805/s
     success_rate...................: 100.00% ✓ 12466      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  99% — ✓ 11066 / ✗ 1
     ✓ valid response structure

     checks.........................: 99.99% ✓ 33200      ✗ 1    
     data_received..................: 980 MB 12 MB/s
     data_sent......................: 13 MB  160 kB/s
     http_req_blocked...............: avg=24.68µs  min=1.35µs   med=2.7µs    max=9.13ms   p(90)=3.96µs   p(95)=4.77µs   p(99.9)=7.16ms  
     http_req_connecting............: avg=20.7µs   min=0s       med=0s       max=9.1ms    p(90)=0s       p(95)=0s       p(99.9)=7.14ms  
     http_req_duration..............: avg=270.42ms min=149.18ms med=271.83ms max=681.71ms p(90)=302.6ms  p(95)=310.44ms p(99.9)=594.2ms 
       { expected_response:true }...: avg=270.42ms min=149.18ms med=271.83ms max=681.71ms p(90)=302.6ms  p(95)=310.44ms p(99.9)=594.2ms 
     http_req_failed................: 0.00%  ✓ 0          ✗ 11167
     http_req_receiving.............: avg=122.73µs min=29.67µs  med=49.95µs  max=11.77ms  p(90)=160.62µs p(95)=444.52µs p(99.9)=6.98ms  
     http_req_sending...............: avg=100.93µs min=5.93µs   med=11.03µs  max=204.98ms p(90)=84.18µs  p(95)=131.62µs p(99.9)=4.69ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=270.2ms  min=145.51ms med=271.69ms max=680.4ms  p(90)=302.38ms p(95)=310.11ms p(99.9)=593.14ms
     http_reqs......................: 11167  137.122162/s
     iteration_duration.............: avg=271.28ms min=149.38ms med=272.35ms max=700.99ms p(90)=302.94ms p(95)=310.93ms p(99.9)=610.39ms
     iterations.....................: 11067  135.894239/s
     success_rate...................: 99.99% ✓ 11066      ✗ 1    
     vus............................: 50     min=0        max=50 
     vus_max........................: 50     min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 29385      ✗ 0   
     data_received..................: 869 MB  11 MB/s
     data_sent......................: 12 MB   141 kB/s
     http_req_blocked...............: avg=70.05µs  min=1.43µs   med=4.45µs   max=22.5ms   p(90)=6.37µs   p(95)=7.62µs   p(99.9)=17.86ms 
     http_req_connecting............: avg=61.85µs  min=0s       med=0s       max=22.31ms  p(90)=0s       p(95)=0s       p(99.9)=17ms    
     http_req_duration..............: avg=305.33ms min=212.43ms med=303.66ms max=837.74ms p(90)=327.98ms p(95)=336.6ms  p(99.9)=716.59ms
       { expected_response:true }...: avg=305.33ms min=212.43ms med=303.66ms max=837.74ms p(90)=327.98ms p(95)=336.6ms  p(99.9)=716.59ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 9895
     http_req_receiving.............: avg=109.21µs min=32µs     med=90.91µs  max=6.16ms   p(90)=152.44µs p(95)=183.73µs p(99.9)=2.45ms  
     http_req_sending...............: avg=80.72µs  min=6.72µs   med=18.28µs  max=163.15ms p(90)=35.12µs  p(95)=47.8µs   p(99.9)=2.98ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=305.14ms min=212.26ms med=303.51ms max=836.64ms p(90)=327.75ms p(95)=336.45ms p(99.9)=715.78ms
     http_reqs......................: 9895    121.069549/s
     iteration_duration.............: avg=306.81ms min=221.75ms med=304.19ms max=880.14ms p(90)=328.38ms p(95)=337.06ms p(99.9)=820.29ms
     iterations.....................: 9795    119.846006/s
     success_rate...................: 100.00% ✓ 9795       ✗ 0   
     vus............................: 50      min=0        max=50
     vus_max........................: 50      min=50       max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Sep 4, 2025

Overview for: ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 500 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1999 124358 total, 0 failed avg: 112ms, p95: 275ms
grafbase 1691 107173 total, 0 failed avg: 130ms, p95: 306ms
cosmo 717 45763 total, 0 failed avg: 307ms, p95: 677ms
apollo-router 338 22868 total, 0 failed avg: 617ms, p95: 1471ms ❌ 12 unexpected GraphQL errors
hive-gateway 271 18867 total, 0 failed avg: 745ms, p95: 1635ms
hive-gateway-bun 266 18337 total, 0 failed avg: 765ms, p95: 1576ms
apollo-gateway 158 10866 total, 0 failed avg: 1204ms, p95: 2654ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 370074      ✗ 0     
     data_received..................: 11 GB   175 MB/s
     data_sent......................: 145 MB  2.3 MB/s
     http_req_blocked...............: avg=379.77µs min=1.11µs med=2.58µs   max=313.38ms p(90)=3.95µs   p(95)=4.69µs   p(99.9)=141.64ms
     http_req_connecting............: avg=376.19µs min=0s     med=0s       max=313.33ms p(90)=0s       p(95)=0s       p(99.9)=141.57ms
     http_req_duration..............: avg=112.01ms min=1.78ms med=99.48ms  max=424.35ms p(90)=231.2ms  p(95)=274.81ms p(99.9)=361.82ms
       { expected_response:true }...: avg=112.01ms min=1.78ms med=99.48ms  max=424.35ms p(90)=231.2ms  p(95)=274.81ms p(99.9)=361.82ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 124358
     http_req_receiving.............: avg=452.91µs min=22.3µs med=40.88µs  max=138.4ms  p(90)=147.4µs  p(95)=378.27µs p(99.9)=67.11ms 
     http_req_sending...............: avg=332.23µs min=5.27µs med=10.02µs  max=127.75ms p(90)=26.03µs  p(95)=123.18µs p(99.9)=58.88ms 
     http_req_tls_handshaking.......: avg=0s       min=0s     med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=111.23ms min=1.73ms med=98.8ms   max=398.79ms p(90)=229.41ms p(95)=273.05ms p(99.9)=359.56ms
     http_reqs......................: 124358  1999.3119/s
     iteration_duration.............: avg=113.55ms min=1.92ms med=100.77ms max=631.31ms p(90)=233.37ms p(95)=276.9ms  p(99.9)=378.42ms
     iterations.....................: 123358  1983.234833/s
     success_rate...................: 100.00% ✓ 123358      ✗ 0     
     vus............................: 70      min=0         max=495 
     vus_max........................: 500     min=500       max=500 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 318519      ✗ 0     
     data_received..................: 9.4 GB  149 MB/s
     data_sent......................: 125 MB  2.0 MB/s
     http_req_blocked...............: avg=507.36µs min=1.15µs  med=2.85µs   max=345.17ms p(90)=4.17µs   p(95)=5.17µs   p(99.9)=180ms   
     http_req_connecting............: avg=502.86µs min=0s      med=0s       max=345.1ms  p(90)=0s       p(95)=0s       p(99.9)=179.93ms
     http_req_duration..............: avg=129.94ms min=2.56ms  med=118.26ms max=450.51ms p(90)=259.34ms p(95)=305.74ms p(99.9)=395.62ms
       { expected_response:true }...: avg=129.94ms min=2.56ms  med=118.26ms max=450.51ms p(90)=259.34ms p(95)=305.74ms p(99.9)=395.62ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 107173
     http_req_receiving.............: avg=550.61µs min=23.18µs med=46.07µs  max=143.74ms p(90)=179.7µs  p(95)=416.07µs p(99.9)=74.88ms 
     http_req_sending...............: avg=435.3µs  min=4.98µs  med=11.47µs  max=142.17ms p(90)=32.03µs  p(95)=132.48µs p(99.9)=72.37ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=128.95ms min=2.52ms  med=117.45ms max=424.89ms p(90)=257ms    p(95)=303.62ms p(99.9)=391.43ms
     http_reqs......................: 107173  1691.196581/s
     iteration_duration.............: avg=131.98ms min=3.13ms  med=119.99ms max=794.53ms p(90)=261.88ms p(95)=308.62ms p(99.9)=446.36ms
     iterations.....................: 106173  1675.416519/s
     success_rate...................: 100.00% ✓ 106173      ✗ 0     
     vus............................: 76      min=0         max=493 
     vus_max........................: 500     min=500       max=500 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 134289     ✗ 0    
     data_received..................: 4.0 GB  63 MB/s
     data_sent......................: 53 MB   836 kB/s
     http_req_blocked...............: avg=89.97µs  min=1.14µs  med=2.7µs    max=115.81ms p(90)=3.99µs   p(95)=5.52µs   p(99.9)=27.23ms 
     http_req_connecting............: avg=85.85µs  min=0s      med=0s       max=115.74ms p(90)=0s       p(95)=0s       p(99.9)=27.19ms 
     http_req_duration..............: avg=306.8ms  min=2.8ms   med=290.35ms max=1.08s    p(90)=602.22ms p(95)=676.91ms p(99.9)=935.71ms
       { expected_response:true }...: avg=306.8ms  min=2.8ms   med=290.35ms max=1.08s    p(90)=602.22ms p(95)=676.91ms p(99.9)=935.71ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 45763
     http_req_receiving.............: avg=678.79µs min=26.38µs med=58.24µs  max=195.77ms p(90)=261.29µs p(95)=498µs    p(99.9)=75.82ms 
     http_req_sending...............: avg=134.22µs min=5.56µs  med=10.79µs  max=90.44ms  p(90)=32.21µs  p(95)=126.39µs p(99.9)=24.44ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=305.99ms min=2.69ms  med=289.37ms max=1.08s    p(90)=601.23ms p(95)=675.48ms p(99.9)=934.44ms
     http_reqs......................: 45763   717.873416/s
     iteration_duration.............: avg=314.09ms min=3.08ms  med=298.32ms max=1.08s    p(90)=605.21ms p(95)=679ms    p(99.9)=936.57ms
     iterations.....................: 44763   702.186651/s
     success_rate...................: 100.00% ✓ 44763      ✗ 0    
     vus............................: 94      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  99% — ✓ 21856 / ✗ 12
     ✓ valid response structure

     checks.........................: 99.98% ✓ 65592      ✗ 12   
     data_received..................: 2.0 GB 30 MB/s
     data_sent......................: 27 MB  396 kB/s
     http_req_blocked...............: avg=128.43µs min=1.66µs  med=3.31µs   max=226.75ms p(90)=5.72µs   p(95)=8.7µs    p(99.9)=26.94ms
     http_req_connecting............: avg=121.92µs min=0s      med=0s       max=226.49ms p(90)=0s       p(95)=0s       p(99.9)=26.86ms
     http_req_duration..............: avg=616.83ms min=6.18ms  med=564.68ms max=2.47s    p(90)=1.29s    p(95)=1.47s    p(99.9)=1.95s  
       { expected_response:true }...: avg=616.83ms min=6.18ms  med=564.68ms max=2.47s    p(90)=1.29s    p(95)=1.47s    p(99.9)=1.95s  
     http_req_failed................: 0.00%  ✓ 0          ✗ 22868
     http_req_receiving.............: avg=170.85µs min=37.29µs med=62.48µs  max=173.16ms p(90)=127.81µs p(95)=246.18µs p(99.9)=17.3ms 
     http_req_sending...............: avg=116.95µs min=7.32µs  med=12.41µs  max=102.64ms p(90)=32.38µs  p(95)=125.91µs p(99.9)=22.43ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=616.54ms min=6.14ms  med=564.33ms max=2.47s    p(90)=1.29s    p(95)=1.47s    p(99.9)=1.95s  
     http_reqs......................: 22868  338.934323/s
     iteration_duration.............: avg=645.54ms min=6.8ms   med=592.11ms max=2.47s    p(90)=1.3s     p(95)=1.48s    p(99.9)=1.97s  
     iterations.....................: 21868  324.112986/s
     success_rate...................: 99.94% ✓ 21856      ✗ 12   
     vus............................: 88     min=0        max=499
     vus_max........................: 500    min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 53601      ✗ 0    
     data_received..................: 1.7 GB  24 MB/s
     data_sent......................: 22 MB   317 kB/s
     http_req_blocked...............: avg=94.16µs  min=1.21µs med=2.72µs   max=85.5ms  p(90)=4.67µs p(95)=6.86µs   p(99.9)=26.67ms
     http_req_connecting............: avg=88.64µs  min=0s     med=0s       max=85.45ms p(90)=0s     p(95)=0s       p(99.9)=26.61ms
     http_req_duration..............: avg=744.5ms  min=6.97ms med=683.26ms max=4.57s   p(90)=1.5s   p(95)=1.63s    p(99.9)=3.77s  
       { expected_response:true }...: avg=744.5ms  min=6.97ms med=683.26ms max=4.57s   p(90)=1.5s   p(95)=1.63s    p(99.9)=3.77s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 18867
     http_req_receiving.............: avg=143.21µs min=25.3µs med=43.25µs  max=78.63ms p(90)=86.2µs p(95)=132.09µs p(99.9)=19.91ms
     http_req_sending...............: avg=132.34µs min=5.63µs med=10.75µs  max=69.3ms  p(90)=27.7µs p(95)=55.71µs  p(99.9)=28.04ms
     http_req_tls_handshaking.......: avg=0s       min=0s     med=0s       max=0s      p(90)=0s     p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=744.22ms min=6.92ms med=683.13ms max=4.57s   p(90)=1.5s   p(95)=1.63s    p(99.9)=3.74s  
     http_reqs......................: 18867   271.156404/s
     iteration_duration.............: avg=786.4ms  min=7.52ms med=713.59ms max=4.59s   p(90)=1.51s  p(95)=1.64s    p(99.9)=3.79s  
     iterations.....................: 17867   256.78441/s
     success_rate...................: 100.00% ✓ 17867      ✗ 0    
     vus............................: 93      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 52011      ✗ 0    
     data_received..................: 1.6 GB  23 MB/s
     data_sent......................: 22 MB   312 kB/s
     http_req_blocked...............: avg=136.19µs min=1.36µs  med=2.86µs   max=153.95ms p(90)=5.24µs  p(95)=8.27µs   p(99.9)=39.85ms
     http_req_connecting............: avg=130.06µs min=0s      med=0s       max=153.73ms p(90)=0s      p(95)=0s       p(99.9)=39.81ms
     http_req_duration..............: avg=764.91ms min=6.43ms  med=705.44ms max=4.56s    p(90)=1.48s   p(95)=1.57s    p(99.9)=3.77s  
       { expected_response:true }...: avg=764.91ms min=6.43ms  med=705.44ms max=4.56s    p(90)=1.48s   p(95)=1.57s    p(99.9)=3.77s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 18337
     http_req_receiving.............: avg=203.36µs min=26.73µs med=46.32µs  max=138.82ms p(90)=106.1µs p(95)=283.6µs  p(99.9)=35.96ms
     http_req_sending...............: avg=187.67µs min=6.15µs  med=11.43µs  max=83.1ms   p(90)=32.47µs p(95)=123.86µs p(99.9)=33.76ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=764.52ms min=6.38ms  med=704.96ms max=4.56s    p(90)=1.48s   p(95)=1.57s    p(99.9)=3.77s  
     http_reqs......................: 18337   266.072494/s
     iteration_duration.............: avg=809.44ms min=8.07ms  med=771.55ms max=4.57s    p(90)=1.49s   p(95)=1.58s    p(99.9)=3.82s  
     iterations.....................: 17337   251.562351/s
     success_rate...................: 100.00% ✓ 17337      ✗ 0    
     vus............................: 59      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 29598      ✗ 0    
     data_received..................: 954 MB  14 MB/s
     data_sent......................: 13 MB   189 kB/s
     http_req_blocked...............: avg=29.55µs min=1.32µs  med=3.04µs  max=17.76ms p(90)=5µs     p(95)=10.82µs  p(99.9)=7.66ms
     http_req_connecting............: avg=23.28µs min=0s      med=0s      max=17.7ms  p(90)=0s      p(95)=0s       p(99.9)=7.42ms
     http_req_duration..............: avg=1.2s    min=7.33ms  med=1.13s   max=15.41s  p(90)=2.19s   p(95)=2.65s    p(99.9)=13.79s
       { expected_response:true }...: avg=1.2s    min=7.33ms  med=1.13s   max=15.41s  p(90)=2.19s   p(95)=2.65s    p(99.9)=13.79s
     http_req_failed................: 0.00%   ✓ 0          ✗ 10866
     http_req_receiving.............: avg=70.8µs  min=27.57µs med=50.01µs max=12.26ms p(90)=95.45µs p(95)=119.98µs p(99.9)=1.67ms
     http_req_sending...............: avg=35.87µs min=6.23µs  med=12.23µs max=18.08ms p(90)=25.42µs p(95)=41.62µs  p(99.9)=4.91ms
     http_req_tls_handshaking.......: avg=0s      min=0s      med=0s      max=0s      p(90)=0s      p(95)=0s       p(99.9)=0s    
     http_req_waiting...............: avg=1.2s    min=7.28ms  med=1.13s   max=15.41s  p(90)=2.19s   p(95)=2.65s    p(99.9)=13.79s
     http_reqs......................: 10866   158.52916/s
     iteration_duration.............: avg=1.32s   min=7.65ms  med=1.25s   max=15.42s  p(90)=2.23s   p(95)=2.7s     p(99.9)=13.82s
     iterations.....................: 9866    143.939692/s
     success_rate...................: 100.00% ✓ 9866       ✗ 0    
     vus............................: 101     min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@renovate renovate bot changed the title Update dependency vega-lite to v6.3.0 Update dependency vega-lite to v6.3.0 - autoclosed Sep 4, 2025
@renovate renovate bot closed this Sep 4, 2025
@renovate renovate bot deleted the renovate/vega-lite-6.x branch September 4, 2025 08:48
@renovate renovate bot changed the title Update dependency vega-lite to v6.3.0 - autoclosed Update dependency vega-lite to v6.3.0 Sep 10, 2025
@renovate renovate bot reopened this Sep 10, 2025
@renovate renovate bot force-pushed the renovate/vega-lite-6.x branch from abb3bb1 to 6ab42a9 Compare September 10, 2025 05:57
@renovate renovate bot changed the title Update dependency vega-lite to v6.3.0 Update dependency vega-lite to v6.3.1 Sep 10, 2025
Copy link

💻 Website Preview

The latest changes are available as preview in: https://86cde523.federation-gateway-benchmark.pages.dev

@ardatan ardatan merged commit 6cd9ea0 into main Sep 10, 2025
34 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant