Skip to content

Conversation

ardatan
Copy link
Member

@ardatan ardatan commented Aug 29, 2025

No description provided.

Copy link

github-actions bot commented Aug 29, 2025

Overview for: constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 170 13793 total, 0 failed avg: 219ms, p95: 229ms
grafbase 168 13631 total, 0 failed avg: 222ms, p95: 235ms
cosmo 166 13495 total, 0 failed avg: 224ms, p95: 245ms
hive-gateway 163 12562 total, 0 failed avg: 240ms, p95: 276ms
hive-gateway-bun 160 12266 total, 0 failed avg: 246ms, p95: 289ms
apollo-router 136 11124 total, 0 failed avg: 272ms, p95: 313ms
apollo-gateway 125 10252 total, 0 failed avg: 295ms, p95: 328ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41079      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   198 kB/s
     http_req_blocked...............: avg=39.49µs  min=1.13µs   med=2.03µs   max=15.26ms  p(90)=3.1µs    p(95)=4.38µs   p(99.9)=12.76ms 
     http_req_connecting............: avg=36.91µs  min=0s       med=0s       max=15.12ms  p(90)=0s       p(95)=0s       p(99.9)=12.59ms 
     http_req_duration..............: avg=219.12ms min=156.95ms med=218.27ms max=581.64ms p(90)=226.63ms p(95)=229.18ms p(99.9)=485.21ms
       { expected_response:true }...: avg=219.12ms min=156.95ms med=218.27ms max=581.64ms p(90)=226.63ms p(95)=229.18ms p(99.9)=485.21ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13793
     http_req_receiving.............: avg=75.99µs  min=24.19µs  med=41.98µs  max=19.43ms  p(90)=85.76µs  p(95)=261.48µs p(99.9)=3.06ms  
     http_req_sending...............: avg=91.46µs  min=5.54µs   med=8.59µs   max=329.83ms p(90)=28.76µs  p(95)=94.97µs  p(99.9)=7.24ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=218.95ms min=156.9ms  med=218.19ms max=576.91ms p(90)=226.47ms p(95)=229ms    p(99.9)=471.8ms 
     http_reqs......................: 13793   170.558748/s
     iteration_duration.............: avg=219.42ms min=157.12ms med=218.48ms max=594.79ms p(90)=226.81ms p(95)=229.36ms p(99.9)=504.73ms
     iterations.....................: 13693   169.322188/s
     success_rate...................: 100.00% ✓ 13693      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40593      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   196 kB/s
     http_req_blocked...............: avg=18.38µs  min=1.33µs   med=3.11µs   max=7.94ms   p(90)=4.4µs    p(95)=5.27µs   p(99.9)=5.61ms  
     http_req_connecting............: avg=14.4µs   min=0s       med=0s       max=7.91ms   p(90)=0s       p(95)=0s       p(99.9)=5.6ms   
     http_req_duration..............: avg=221.68ms min=205.66ms med=219.88ms max=661.32ms p(90)=231.59ms p(95)=235.39ms p(99.9)=538.66ms
       { expected_response:true }...: avg=221.68ms min=205.66ms med=219.88ms max=661.32ms p(90)=231.59ms p(95)=235.39ms p(99.9)=538.66ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13631
     http_req_receiving.............: avg=86.24µs  min=28.24µs  med=56.85µs  max=9.41ms   p(90)=104.74µs p(95)=145.93µs p(99.9)=2.56ms  
     http_req_sending...............: avg=69.78µs  min=6.46µs   med=12.36µs  max=238.62ms p(90)=20.96µs  p(95)=37.28µs  p(99.9)=2.55ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=221.52ms min=205.6ms  med=219.77ms max=660.44ms p(90)=231.42ms p(95)=235.16ms p(99.9)=537.6ms 
     http_reqs......................: 13631   168.079283/s
     iteration_duration.............: avg=222.05ms min=205.83ms med=220.17ms max=674.82ms p(90)=231.87ms p(95)=235.68ms p(99.9)=554.49ms
     iterations.....................: 13531   166.846217/s
     success_rate...................: 100.00% ✓ 13531      ✗ 0    
     vus............................: 27      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40185      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   193 kB/s
     http_req_blocked...............: avg=21.07µs  min=1.33µs   med=2.68µs   max=9.41ms   p(90)=3.79µs   p(95)=4.86µs   p(99.9)=6.95ms  
     http_req_connecting............: avg=17.56µs  min=0s       med=0s       max=9.37ms   p(90)=0s       p(95)=0s       p(99.9)=6.93ms  
     http_req_duration..............: avg=223.73ms min=117.11ms med=222.43ms max=638.74ms p(90)=240.18ms p(95)=245.35ms p(99.9)=524ms   
       { expected_response:true }...: avg=223.73ms min=117.11ms med=222.43ms max=638.74ms p(90)=240.18ms p(95)=245.35ms p(99.9)=524ms   
     http_req_failed................: 0.00%   ✓ 0          ✗ 13495
     http_req_receiving.............: avg=481.08µs min=30.69µs  med=68.78µs  max=154.66ms p(90)=411.78µs p(95)=912.93µs p(99.9)=26.13ms 
     http_req_sending...............: avg=90µs     min=6.1µs    med=11.23µs  max=187.19ms p(90)=30.14µs  p(95)=123.34µs p(99.9)=3.56ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=223.15ms min=116.8ms  med=221.92ms max=637.88ms p(90)=239.59ms p(95)=244.78ms p(99.9)=523.05ms
     http_reqs......................: 13495   166.294489/s
     iteration_duration.............: avg=224.15ms min=117.35ms med=222.77ms max=658.46ms p(90)=240.48ms p(95)=245.64ms p(99.9)=554.97ms
     iterations.....................: 13395   165.062221/s
     success_rate...................: 100.00% ✓ 13395      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 37386      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 15 MB   190 kB/s
     http_req_blocked...............: avg=24.77µs  min=1.09µs   med=2.61µs   max=10.69ms  p(90)=4.3µs    p(95)=5.55µs   p(99.9)=8.27ms  
     http_req_connecting............: avg=21.34µs  min=0s       med=0s       max=10.65ms  p(90)=0s       p(95)=0s       p(99.9)=8.25ms  
     http_req_duration..............: avg=240.37ms min=161ms    med=233.2ms  max=750.14ms p(90)=259.26ms p(95)=275.86ms p(99.9)=635.65ms
       { expected_response:true }...: avg=240.37ms min=161ms    med=233.2ms  max=750.14ms p(90)=259.26ms p(95)=275.86ms p(99.9)=635.65ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12562
     http_req_receiving.............: avg=86.41µs  min=25.07µs  med=45.23µs  max=20.31ms  p(90)=101.62µs p(95)=241.52µs p(99.9)=2.81ms  
     http_req_sending...............: avg=73.36µs  min=5.64µs   med=10.93µs  max=236.2ms  p(90)=33.02µs  p(95)=124.85µs p(99.9)=4ms     
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=240.21ms min=160.92ms med=233.03ms max=748.97ms p(90)=259.04ms p(95)=275.33ms p(99.9)=634.58ms
     http_reqs......................: 12562   163.641543/s
     iteration_duration.............: avg=241.3ms  min=176.3ms  med=233.56ms max=784.01ms p(90)=259.58ms p(95)=277.7ms  p(99.9)=664.27ms
     iterations.....................: 12462   162.338872/s
     success_rate...................: 100.00% ✓ 12462      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 36498      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 14 MB   186 kB/s
     http_req_blocked...............: avg=34.96µs  min=1.08µs   med=2.74µs   max=13.75ms  p(90)=4.54µs   p(95)=5.9µs    p(99.9)=10.7ms  
     http_req_connecting............: avg=30.91µs  min=0s       med=0s       max=13.71ms  p(90)=0s       p(95)=0s       p(99.9)=10.65ms 
     http_req_duration..............: avg=245.85ms min=159.83ms med=238.78ms max=751.92ms p(90)=265.28ms p(95)=288.85ms p(99.9)=621.86ms
       { expected_response:true }...: avg=245.85ms min=159.83ms med=238.78ms max=751.92ms p(90)=265.28ms p(95)=288.85ms p(99.9)=621.86ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12266
     http_req_receiving.............: avg=111.98µs min=26.57µs  med=49.9µs   max=174.1ms  p(90)=113.09µs p(95)=242.15µs p(99.9)=3.88ms  
     http_req_sending...............: avg=154.82µs min=5.66µs   med=11.45µs  max=267.08ms p(90)=34.61µs  p(95)=129.78µs p(99.9)=12.76ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=245.58ms min=159.73ms med=238.64ms max=736.07ms p(90)=264.96ms p(95)=288.14ms p(99.9)=599.67ms
     http_reqs......................: 12266   160.27022/s
     iteration_duration.............: avg=246.85ms min=160.02ms med=239.16ms max=776.05ms p(90)=265.68ms p(95)=290.52ms p(99.9)=676.82ms
     iterations.....................: 12166   158.963599/s
     success_rate...................: 100.00% ✓ 12166      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 33072      ✗ 0    
     data_received..................: 976 MB  12 MB/s
     data_sent......................: 13 MB   159 kB/s
     http_req_blocked...............: avg=24.37µs  min=1.49µs   med=2.71µs   max=9ms      p(90)=4.02µs   p(95)=4.89µs   p(99.9)=7.09ms  
     http_req_connecting............: avg=20.48µs  min=0s       med=0s       max=8.97ms   p(90)=0s       p(95)=0s       p(99.9)=7.07ms  
     http_req_duration..............: avg=271.94ms min=169.31ms med=273.21ms max=690.3ms  p(90)=304.82ms p(95)=313.39ms p(99.9)=583.09ms
       { expected_response:true }...: avg=271.94ms min=169.31ms med=273.21ms max=690.3ms  p(90)=304.82ms p(95)=313.39ms p(99.9)=583.09ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11124
     http_req_receiving.............: avg=135.2µs  min=30.66µs  med=50.84µs  max=216.37ms p(90)=154.48µs p(95)=427.4µs  p(99.9)=4.38ms  
     http_req_sending...............: avg=130.8µs  min=6.44µs   med=11.13µs  max=249.96ms p(90)=44.5µs   p(95)=139.72µs p(99.9)=4.96ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=271.67ms min=169.25ms med=273.07ms max=683.41ms p(90)=304.63ms p(95)=313.09ms p(99.9)=576.65ms
     http_reqs......................: 11124   136.607716/s
     iteration_duration.............: avg=272.79ms min=169.5ms  med=273.77ms max=711.49ms p(90)=305.23ms p(95)=313.76ms p(99.9)=630.11ms
     iterations.....................: 11024   135.379671/s
     success_rate...................: 100.00% ✓ 11024      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 30456      ✗ 0    
     data_received..................: 900 MB  11 MB/s
     data_sent......................: 12 MB   146 kB/s
     http_req_blocked...............: avg=68.36µs  min=1.34µs   med=3.05µs   max=18.43ms  p(90)=4.66µs   p(95)=5.49µs   p(99.9)=15.9ms  
     http_req_connecting............: avg=64.18µs  min=0s       med=0s       max=18.39ms  p(90)=0s       p(95)=0s       p(99.9)=15.83ms 
     http_req_duration..............: avg=295.1ms  min=210.88ms med=292.53ms max=769.22ms p(90)=318.15ms p(95)=327.8ms  p(99.9)=686.48ms
       { expected_response:true }...: avg=295.1ms  min=210.88ms med=292.53ms max=769.22ms p(90)=318.15ms p(95)=327.8ms  p(99.9)=686.48ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10252
     http_req_receiving.............: avg=104.04µs min=29.77µs  med=54.74µs  max=269.36ms p(90)=105.6µs  p(95)=130.99µs p(99.9)=2.43ms  
     http_req_sending...............: avg=46.97µs  min=6.12µs   med=12.26µs  max=106.79ms p(90)=21.83µs  p(95)=37.35µs  p(99.9)=4.45ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=294.94ms min=210.8ms  med=292.45ms max=760.89ms p(90)=318.03ms p(95)=327.69ms p(99.9)=666.15ms
     http_reqs......................: 10252   125.730478/s
     iteration_duration.............: avg=296.36ms min=222.62ms med=292.97ms max=794.22ms p(90)=318.54ms p(95)=328.32ms p(99.9)=742.93ms
     iterations.....................: 10152   124.504078/s
     success_rate...................: 100.00% ✓ 10152      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Aug 29, 2025

Overview for: constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 168 13682 total, 0 failed avg: 221ms, p95: 234ms
hive-router 167 13540 total, 0 failed avg: 223ms, p95: 234ms
cosmo 156 12700 total, 0 failed avg: 238ms, p95: 266ms
hive-gateway-bun 148 11389 total, 0 failed avg: 265ms, p95: 363ms
hive-gateway 140 10815 total, 0 failed avg: 279ms, p95: 381ms
apollo-router 124 10131 total, 0 failed avg: 299ms, p95: 345ms
apollo-gateway 85 7024 total, 0 failed avg: 431ms, p95: 474ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40746      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   196 kB/s
     http_req_blocked...............: avg=45.03µs  min=1.46µs   med=3.2µs    max=18.37ms  p(90)=4.8µs    p(95)=5.77µs   p(99.9)=14.76ms 
     http_req_connecting............: avg=40.6µs   min=0s       med=0s       max=18.23ms  p(90)=0s       p(95)=0s       p(99.9)=14.67ms 
     http_req_duration..............: avg=220.78ms min=205.27ms med=219ms    max=619.79ms p(90)=230.29ms p(95)=234.28ms p(99.9)=505.11ms
       { expected_response:true }...: avg=220.78ms min=205.27ms med=219ms    max=619.79ms p(90)=230.29ms p(95)=234.28ms p(99.9)=505.11ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13682
     http_req_receiving.............: avg=85.12µs  min=30.74µs  med=61.53µs  max=5.1ms    p(90)=108.31µs p(95)=142.26µs p(99.9)=2.39ms  
     http_req_sending...............: avg=68.22µs  min=7.05µs   med=12.73µs  max=201.38ms p(90)=22.86µs  p(95)=37.98µs  p(99.9)=2.1ms   
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=220.63ms min=205.21ms med=218.9ms  max=618.15ms p(90)=230.19ms p(95)=234.17ms p(99.9)=504.62ms
     http_reqs......................: 13682   168.727676/s
     iteration_duration.............: avg=221.18ms min=205.42ms med=219.33ms max=648.17ms p(90)=230.6ms  p(95)=234.6ms  p(99.9)=531.78ms
     iterations.....................: 13582   167.494467/s
     success_rate...................: 100.00% ✓ 13582      ✗ 0    
     vus............................: 24      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40320      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   195 kB/s
     http_req_blocked...............: avg=44.03µs  min=1.19µs   med=2.16µs   max=15.01ms  p(90)=3.16µs   p(95)=4.49µs   p(99.9)=13.37ms 
     http_req_connecting............: avg=41.24µs  min=0s       med=0s       max=14.99ms  p(90)=0s       p(95)=0s       p(99.9)=13.23ms 
     http_req_duration..............: avg=223.12ms min=158.77ms med=222.18ms max=588.45ms p(90)=231.06ms p(95)=233.52ms p(99.9)=499.69ms
       { expected_response:true }...: avg=223.12ms min=158.77ms med=222.18ms max=588.45ms p(90)=231.06ms p(95)=233.52ms p(99.9)=499.69ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13540
     http_req_receiving.............: avg=76.57µs  min=24.86µs  med=42.59µs  max=8.69ms   p(90)=88.87µs  p(95)=253.16µs p(99.9)=3.24ms  
     http_req_sending...............: avg=156.92µs min=5.42µs   med=9.23µs   max=349.61ms p(90)=29.33µs  p(95)=92.24µs  p(99.9)=5.98ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=222.89ms min=158.72ms med=222.09ms max=585.8ms  p(90)=230.94ms p(95)=233.37ms p(99.9)=480.01ms
     http_reqs......................: 13540   167.366526/s
     iteration_duration.............: avg=223.48ms min=158.95ms med=222.41ms max=611.95ms p(90)=231.25ms p(95)=233.72ms p(99.9)=532.75ms
     iterations.....................: 13440   166.130437/s
     success_rate...................: 100.00% ✓ 13440      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 37800      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 15 MB   182 kB/s
     http_req_blocked...............: avg=23.42µs  min=1.33µs   med=2.63µs   max=9.91ms   p(90)=3.93µs   p(95)=4.98µs   p(99.9)=7.56ms  
     http_req_connecting............: avg=19.58µs  min=0s       med=0s       max=9.87ms   p(90)=0s       p(95)=0s       p(99.9)=7.53ms  
     http_req_duration..............: avg=237.8ms  min=163.7ms  med=237.13ms max=653.9ms  p(90)=259.74ms p(95)=266.01ms p(99.9)=546.76ms
       { expected_response:true }...: avg=237.8ms  min=163.7ms  med=237.13ms max=653.9ms  p(90)=259.74ms p(95)=266.01ms p(99.9)=546.76ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12700
     http_req_receiving.............: avg=285.48µs min=31.09µs  med=64.88µs  max=37.89ms  p(90)=181.22µs p(95)=423.38µs p(99.9)=28.92ms 
     http_req_sending...............: avg=129.56µs min=5.99µs   med=11.03µs  max=350.67ms p(90)=29.04µs  p(95)=119.36µs p(99.9)=3.83ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=237.38ms min=163.57ms med=236.78ms max=652.35ms p(90)=259.32ms p(95)=265.49ms p(99.9)=545.61ms
     http_reqs......................: 12700   156.687094/s
     iteration_duration.............: avg=238.31ms min=163.9ms  med=237.53ms max=682.14ms p(90)=260.04ms p(95)=266.28ms p(99.9)=565.83ms
     iterations.....................: 12600   155.453337/s
     success_rate...................: 100.00% ✓ 12600      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 33867      ✗ 0    
     data_received..................: 1.0 GB  13 MB/s
     data_sent......................: 13 MB   173 kB/s
     http_req_blocked...............: avg=30.3µs   min=1.16µs   med=2.64µs   max=11.73ms  p(90)=4.14µs   p(95)=5.6µs    p(99.9)=9.21ms  
     http_req_connecting............: avg=25.73µs  min=0s       med=0s       max=11.69ms  p(90)=0s       p(95)=0s       p(99.9)=9.18ms  
     http_req_duration..............: avg=264.92ms min=160.4ms  med=264.17ms max=835.08ms p(90)=295.47ms p(95)=362.71ms p(99.9)=732.89ms
       { expected_response:true }...: avg=264.92ms min=160.4ms  med=264.17ms max=835.08ms p(90)=295.47ms p(95)=362.71ms p(99.9)=732.89ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11389
     http_req_receiving.............: avg=103.15µs min=25.17µs  med=45.72µs  max=83.07ms  p(90)=105.71µs p(95)=339.11µs p(99.9)=4.74ms  
     http_req_sending...............: avg=105.74µs min=5.5µs    med=11.09µs  max=239.46ms p(90)=34.39µs  p(95)=130.08µs p(99.9)=5.29ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=264.71ms min=160.22ms med=264ms    max=834.22ms p(90)=295.18ms p(95)=362.48ms p(99.9)=732.28ms
     http_reqs......................: 11389   148.728008/s
     iteration_duration.............: avg=266.15ms min=182.04ms med=264.61ms max=878.66ms p(90)=295.87ms p(95)=363.32ms p(99.9)=745.67ms
     iterations.....................: 11289   147.422117/s
     success_rate...................: 100.00% ✓ 11289      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 32145      ✗ 0    
     data_received..................: 950 MB  12 MB/s
     data_sent......................: 13 MB   164 kB/s
     http_req_blocked...............: avg=35.39µs  min=1.17µs   med=2.82µs   max=12.45ms  p(90)=4.8µs    p(95)=7µs      p(99.9)=9.96ms  
     http_req_connecting............: avg=31.54µs  min=0s       med=0s       max=12.4ms   p(90)=0s       p(95)=0s       p(99.9)=9.92ms  
     http_req_duration..............: avg=279.1ms  min=130.69ms med=268.53ms max=753.97ms p(90)=310.1ms  p(95)=380.57ms p(99.9)=667.65ms
       { expected_response:true }...: avg=279.1ms  min=130.69ms med=268.53ms max=753.97ms p(90)=310.1ms  p(95)=380.57ms p(99.9)=667.65ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10815
     http_req_receiving.............: avg=110.02µs min=27.4µs   med=54.5µs   max=68.92ms  p(90)=130.06µs p(95)=420.3µs  p(99.9)=3.43ms  
     http_req_sending...............: avg=117.26µs min=5.62µs   med=11.62µs  max=265.44ms p(90)=41.4µs   p(95)=160.01µs p(99.9)=12.87ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=278.87ms min=130.63ms med=268.37ms max=752.32ms p(90)=309.85ms p(95)=380.38ms p(99.9)=667.36ms
     http_reqs......................: 10815   140.865945/s
     iteration_duration.............: avg=280.63ms min=130.86ms med=268.92ms max=811.5ms  p(90)=311.24ms p(95)=381.26ms p(99.9)=721.79ms
     iterations.....................: 10715   139.563439/s
     success_rate...................: 100.00% ✓ 10715      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 30093      ✗ 0    
     data_received..................: 889 MB  11 MB/s
     data_sent......................: 12 MB   144 kB/s
     http_req_blocked...............: avg=26.61µs  min=1.78µs   med=2.8µs    max=9.41ms   p(90)=4.27µs   p(95)=5.14µs   p(99.9)=7.48ms  
     http_req_connecting............: avg=23.08µs  min=0s       med=0s       max=9.36ms   p(90)=0s       p(95)=0s       p(99.9)=7.46ms  
     http_req_duration..............: avg=298.77ms min=161.59ms med=300.78ms max=723.68ms p(90)=335.05ms p(95)=344.51ms p(99.9)=623.24ms
       { expected_response:true }...: avg=298.77ms min=161.59ms med=300.78ms max=723.68ms p(90)=335.05ms p(95)=344.51ms p(99.9)=623.24ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10131
     http_req_receiving.............: avg=97.59µs  min=34.18µs  med=54.12µs  max=89.72ms  p(90)=110.55µs p(95)=232.35µs p(99.9)=1.63ms  
     http_req_sending...............: avg=136.27µs min=7.91µs   med=11.54µs  max=205.17ms p(90)=29.57µs  p(95)=136.53µs p(99.9)=4.59ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=298.54ms min=158.03ms med=300.62ms max=716.1ms  p(90)=334.86ms p(95)=344.31ms p(99.9)=622.22ms
     http_reqs......................: 10131   124.1812/s
     iteration_duration.............: avg=300.02ms min=161.82ms med=301.27ms max=738.53ms p(90)=335.47ms p(95)=344.88ms p(99.9)=683.63ms
     iterations.....................: 10031   122.955445/s
     success_rate...................: 100.00% ✓ 10031      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 20772     ✗ 0   
     data_received..................: 617 MB  7.6 MB/s
     data_sent......................: 8.2 MB  100 kB/s
     http_req_blocked...............: avg=45.93µs  min=1.42µs   med=3.09µs   max=11.62ms  p(90)=4.54µs   p(95)=5.44µs   p(99.9)=10.11ms 
     http_req_connecting............: avg=42.25µs  min=0s       med=0s       max=11.59ms  p(90)=0s       p(95)=0s       p(99.9)=10.08ms 
     http_req_duration..............: avg=431.32ms min=210.46ms med=434.62ms max=911.85ms p(90)=460.95ms p(95)=474.01ms p(99.9)=851.3ms 
       { expected_response:true }...: avg=431.32ms min=210.46ms med=434.62ms max=911.85ms p(90)=460.95ms p(95)=474.01ms p(99.9)=851.3ms 
     http_req_failed................: 0.00%   ✓ 0         ✗ 7024
     http_req_receiving.............: avg=63.82µs  min=31µs     med=52.79µs  max=2.41ms   p(90)=94.7µs   p(95)=111.66µs p(99.9)=326.2µs 
     http_req_sending...............: avg=111.36µs min=6.5µs    med=12.43µs  max=168.02ms p(90)=19.41µs  p(95)=25.64µs  p(99.9)=5.39ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=431.15ms min=210.38ms med=434.53ms max=911.11ms p(90)=460.8ms  p(95)=473.79ms p(99.9)=850.54ms
     http_reqs......................: 7024    85.974979/s
     iteration_duration.............: avg=434.96ms min=254.66ms med=435.12ms max=966.07ms p(90)=461.48ms p(95)=474.38ms p(99.9)=881.14ms
     iterations.....................: 6924    84.750961/s
     success_rate...................: 100.00% ✓ 6924      ✗ 0   
     vus............................: 50      min=0       max=50
     vus_max........................: 50      min=50      max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Aug 29, 2025

Overview for: constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1813 109261 total, 0 failed avg: 27ms, p95: 48ms
cosmo 681 41150 total, 0 failed avg: 73ms, p95: 106ms
grafbase 538 32506 total, 0 failed avg: 92ms, p95: 119ms
apollo-router 358 21788 total, 0 failed avg: 138ms, p95: 179ms
hive-gateway-bun 309 18851 total, 0 failed avg: 159ms, p95: 327ms
hive-gateway 294 18072 total, 0 failed avg: 166ms, p95: 309ms
apollo-gateway 119 7312 total, 0 failed avg: 411ms, p95: 484ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 327483      ✗ 0     
     data_received..................: 9.6 GB  159 MB/s
     data_sent......................: 127 MB  2.1 MB/s
     http_req_blocked...............: avg=5.3µs    min=1.18µs  med=2.69µs  max=9.14ms   p(90)=3.95µs   p(95)=4.8µs    p(99.9)=104.06µs
     http_req_connecting............: avg=2.11µs   min=0s      med=0s      max=9.1ms    p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_duration..............: avg=27.25ms  min=1.89ms  med=24.92ms max=448.67ms p(90)=41.67ms  p(95)=47.72ms  p(99.9)=80.52ms 
       { expected_response:true }...: avg=27.25ms  min=1.89ms  med=24.92ms max=448.67ms p(90)=41.67ms  p(95)=47.72ms  p(99.9)=80.52ms 
     http_req_failed................: 0.00%   ✓ 0           ✗ 109261
     http_req_receiving.............: avg=119.94µs min=24.24µs med=44.38µs max=80.16ms  p(90)=125.47µs p(95)=359.42µs p(99.9)=12.49ms 
     http_req_sending...............: avg=84.32µs  min=5.43µs  med=10.38µs max=265.66ms p(90)=31.64µs  p(95)=127.65µs p(99.9)=11.96ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=27.05ms  min=1.84ms  med=24.76ms max=446.79ms p(90)=41.28ms  p(95)=47.29ms  p(99.9)=78.85ms 
     http_reqs......................: 109261  1813.633961/s
     iteration_duration.............: avg=27.47ms  min=5.44ms  med=25.12ms max=464.87ms p(90)=41.88ms  p(95)=47.92ms  p(99.9)=81.09ms 
     iterations.....................: 109161  1811.974051/s
     success_rate...................: 100.00% ✓ 109161      ✗ 0     
     vus............................: 50      min=50        max=50  
     vus_max........................: 50      min=50        max=50  

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 123150     ✗ 0    
     data_received..................: 3.6 GB  60 MB/s
     data_sent......................: 48 MB   792 kB/s
     http_req_blocked...............: avg=11.25µs  min=1.17µs  med=2.68µs  max=13.2ms   p(90)=3.82µs  p(95)=4.49µs   p(99.9)=1.8ms   
     http_req_connecting............: avg=7.97µs   min=0s      med=0s      max=13.17ms  p(90)=0s      p(95)=0s       p(99.9)=1.78ms  
     http_req_duration..............: avg=72.68ms  min=2.88ms  med=71.63ms max=493.09ms p(90)=98.35ms p(95)=106.28ms p(99.9)=267.44ms
       { expected_response:true }...: avg=72.68ms  min=2.88ms  med=71.63ms max=493.09ms p(90)=98.35ms p(95)=106.28ms p(99.9)=267.44ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 41150
     http_req_receiving.............: avg=164.73µs min=24.99µs med=71.26µs max=42.81ms  p(90)=142.8µs p(95)=339.18µs p(99.9)=16.74ms 
     http_req_sending...............: avg=56.82µs  min=5.47µs  med=11.04µs max=339.2ms  p(90)=27.39µs p(95)=113.04µs p(99.9)=8.21ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=72.46ms  min=2.82ms  med=71.42ms max=472.99ms p(90)=98.02ms p(95)=105.96ms p(99.9)=260.86ms
     http_reqs......................: 41150   681.145513/s
     iteration_duration.............: avg=73.11ms  min=8.99ms  med=71.91ms max=528.54ms p(90)=98.62ms p(95)=106.51ms p(99.9)=281.09ms
     iterations.....................: 41050   679.490239/s
     success_rate...................: 100.00% ✓ 41050      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 97218      ✗ 0    
     data_received..................: 2.9 GB  47 MB/s
     data_sent......................: 38 MB   626 kB/s
     http_req_blocked...............: avg=13.34µs  min=1.44µs  med=3.54µs  max=9.35ms   p(90)=5.14µs   p(95)=7.24µs   p(99.9)=3.08ms  
     http_req_connecting............: avg=7.13µs   min=0s      med=0s      max=9.31ms   p(90)=0s       p(95)=0s       p(99.9)=2.99ms  
     http_req_duration..............: avg=91.96ms  min=2.66ms  med=90.86ms max=550.81ms p(90)=112.42ms p(95)=119.25ms p(99.9)=353.37ms
       { expected_response:true }...: avg=91.96ms  min=2.66ms  med=90.86ms max=550.81ms p(90)=112.42ms p(95)=119.25ms p(99.9)=353.37ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 32506
     http_req_receiving.............: avg=161.45µs min=28.95µs med=68.74µs max=26.32ms  p(90)=187.03µs p(95)=435.92µs p(99.9)=6.94ms  
     http_req_sending...............: avg=92.69µs  min=6.08µs  med=13.22µs max=321.83ms p(90)=105.02µs p(95)=139.74µs p(99.9)=7.07ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=91.71ms  min=2.59ms  med=90.62ms max=549.99ms p(90)=112.16ms p(95)=118.83ms p(99.9)=346.4ms 
     http_reqs......................: 32506   538.122316/s
     iteration_duration.............: avg=92.62ms  min=20.89ms med=91.23ms max=574.63ms p(90)=112.75ms p(95)=119.63ms p(99.9)=377.26ms
     iterations.....................: 32406   536.466861/s
     success_rate...................: 100.00% ✓ 32406      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 65064      ✗ 0    
     data_received..................: 1.9 GB  31 MB/s
     data_sent......................: 25 MB   417 kB/s
     http_req_blocked...............: avg=14.67µs  min=1.85µs  med=3.03µs   max=9.33ms   p(90)=4.53µs   p(95)=5.31µs   p(99.9)=5.32ms  
     http_req_connecting............: avg=10.84µs  min=0s      med=0s       max=9.29ms   p(90)=0s       p(95)=0s       p(99.9)=5.29ms  
     http_req_duration..............: avg=137.59ms min=6.09ms  med=136.61ms max=580.52ms p(90)=169.48ms p(95)=179.15ms p(99.9)=406.02ms
       { expected_response:true }...: avg=137.59ms min=6.09ms  med=136.61ms max=580.52ms p(90)=169.48ms p(95)=179.15ms p(99.9)=406.02ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 21788
     http_req_receiving.............: avg=82.9µs   min=36.51µs med=55.5µs   max=40.61ms  p(90)=103.47µs p(95)=131.37µs p(99.9)=1.7ms   
     http_req_sending...............: avg=65.65µs  min=7.37µs  med=11.91µs  max=302.56ms p(90)=20.48µs  p(95)=33.83µs  p(99.9)=2.05ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=137.44ms min=6.04ms  med=136.47ms max=547.67ms p(90)=169.32ms p(95)=179.03ms p(99.9)=403.83ms
     http_reqs......................: 21788   358.318785/s
     iteration_duration.............: avg=138.49ms min=45.91ms med=136.94ms max=632.5ms  p(90)=169.75ms p(95)=179.41ms p(99.9)=427.16ms
     iterations.....................: 21688   356.674216/s
     success_rate...................: 100.00% ✓ 21688      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 56253      ✗ 0    
     data_received..................: 1.7 GB  27 MB/s
     data_sent......................: 22 MB   360 kB/s
     http_req_blocked...............: avg=39.75µs  min=1.21µs  med=2.75µs   max=18.8ms   p(90)=4.54µs   p(95)=5.57µs   p(99.9)=14.96ms 
     http_req_connecting............: avg=35.81µs  min=0s      med=0s       max=18.76ms  p(90)=0s       p(95)=0s       p(99.9)=14.87ms 
     http_req_duration..............: avg=159.01ms min=6.75ms  med=147.67ms max=665.98ms p(90)=178.59ms p(95)=326.54ms p(99.9)=461.92ms
       { expected_response:true }...: avg=159.01ms min=6.75ms  med=147.67ms max=665.98ms p(90)=178.59ms p(95)=326.54ms p(99.9)=461.92ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 18851
     http_req_receiving.............: avg=89.57µs  min=26.48µs med=46.26µs  max=17.54ms  p(90)=105.89µs p(95)=187.16µs p(99.9)=3.18ms  
     http_req_sending...............: avg=85.32µs  min=5.43µs  med=11.31µs  max=255.1ms  p(90)=32.25µs  p(95)=120.91µs p(99.9)=4.17ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=158.83ms min=6.69ms  med=147.54ms max=662.74ms p(90)=178.39ms p(95)=326.24ms p(99.9)=460.38ms
     http_reqs......................: 18851   309.24617/s
     iteration_duration.............: avg=160.18ms min=39.02ms med=148.03ms max=700.28ms p(90)=179.14ms p(95)=327.12ms p(99.9)=513.49ms
     iterations.....................: 18751   307.605694/s
     success_rate...................: 100.00% ✓ 18751      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 53916      ✗ 0    
     data_received..................: 1.6 GB  26 MB/s
     data_sent......................: 21 MB   342 kB/s
     http_req_blocked...............: avg=19.67µs  min=1.2µs   med=2.8µs    max=11.67ms  p(90)=4.77µs   p(95)=5.9µs    p(99.9)=7.25ms  
     http_req_connecting............: avg=15.84µs  min=0s      med=0s       max=11.64ms  p(90)=0s       p(95)=0s       p(99.9)=7.2ms   
     http_req_duration..............: avg=165.8ms  min=7.31ms  med=155.18ms max=858.92ms p(90)=194.59ms p(95)=309.31ms p(99.9)=836.39ms
       { expected_response:true }...: avg=165.8ms  min=7.31ms  med=155.18ms max=858.92ms p(90)=194.59ms p(95)=309.31ms p(99.9)=836.39ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 18072
     http_req_receiving.............: avg=95.89µs  min=27.33µs med=47.98µs  max=18.2ms   p(90)=112.22µs p(95)=220.66µs p(99.9)=3.42ms  
     http_req_sending...............: avg=71.05µs  min=5.78µs  med=11.52µs  max=230.39ms p(90)=32.61µs  p(95)=126.07µs p(99.9)=4.23ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=165.64ms min=7.25ms  med=155.04ms max=858.87ms p(90)=194.37ms p(95)=309.12ms p(99.9)=836.31ms
     http_reqs......................: 18072   294.30224/s
     iteration_duration.............: avg=167.08ms min=40.2ms  med=155.59ms max=859.14ms p(90)=195.02ms p(95)=309.98ms p(99.9)=836.63ms
     iterations.....................: 17972   292.673742/s
     success_rate...................: 100.00% ✓ 17972      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 21636      ✗ 0   
     data_received..................: 642 MB  11 MB/s
     data_sent......................: 8.5 MB  139 kB/s
     http_req_blocked...............: avg=84.32µs  min=1.34µs  med=3.05µs   max=21.36ms  p(90)=4.61µs   p(95)=5.35µs   p(99.9)=16.58ms 
     http_req_connecting............: avg=80.54µs  min=0s      med=0s       max=21.32ms  p(90)=0s       p(95)=0s       p(99.9)=16.54ms 
     http_req_duration..............: avg=411.02ms min=7.49ms  med=410.3ms  max=855.48ms p(90)=465.8ms  p(95)=483.89ms p(99.9)=794.61ms
       { expected_response:true }...: avg=411.02ms min=7.49ms  med=410.3ms  max=855.48ms p(90)=465.8ms  p(95)=483.89ms p(99.9)=794.61ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 7312
     http_req_receiving.............: avg=81.67µs  min=30.98µs med=52.01µs  max=140.7ms  p(90)=94.57µs  p(95)=110.79µs p(99.9)=341.1µs 
     http_req_sending...............: avg=155.73µs min=6.38µs  med=12.35µs  max=227.93ms p(90)=19.78µs  p(95)=23.39µs  p(99.9)=13.98ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=410.78ms min=7.44ms  med=410.17ms max=855.28ms p(90)=465.62ms p(95)=483.38ms p(99.9)=792.5ms 
     http_reqs......................: 7312    119.540012/s
     iteration_duration.............: avg=417.28ms min=23.93ms med=411ms    max=939.14ms p(90)=466.3ms  p(95)=485.02ms p(99.9)=866.97ms
     iterations.....................: 7212    117.905165/s
     success_rate...................: 100.00% ✓ 7212       ✗ 0   
     vus............................: 38      min=38       max=50
     vus_max........................: 50      min=50       max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Aug 29, 2025

Overview for: ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 500 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1911 119145 total, 0 failed avg: 117ms, p95: 289ms
cosmo 696 44478 total, 0 failed avg: 316ms, p95: 697ms
grafbase 507 32160 total, 0 failed avg: 437ms, p95: 957ms
apollo-router 406 27252 total, 0 failed avg: 517ms, p95: 1174ms ❌ 15 unexpected GraphQL errors
hive-gateway-bun 272 19068 total, 0 failed avg: 736ms, p95: 1625ms
hive-gateway 250 17542 total, 0 failed avg: 798ms, p95: 1732ms
apollo-gateway 157 10768 total, 0 failed avg: 1215ms, p95: 2594ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 354435      ✗ 0     
     data_received..................: 11 GB   168 MB/s
     data_sent......................: 139 MB  2.2 MB/s
     http_req_blocked...............: avg=375.56µs min=1.1µs   med=2.4µs    max=308.42ms p(90)=3.91µs   p(95)=4.91µs   p(99.9)=141.68ms
     http_req_connecting............: avg=372.33µs min=0s      med=0s       max=308.3ms  p(90)=0s       p(95)=0s       p(99.9)=141.61ms
     http_req_duration..............: avg=116.97ms min=1.78ms  med=104.28ms max=451.72ms p(90)=241.28ms p(95)=289.47ms p(99.9)=383.93ms
       { expected_response:true }...: avg=116.97ms min=1.78ms  med=104.28ms max=451.72ms p(90)=241.28ms p(95)=289.47ms p(99.9)=383.93ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 119145
     http_req_receiving.............: avg=475.95µs min=24.02µs med=41.95µs  max=139.65ms p(90)=191.4µs  p(95)=396.16µs p(99.9)=69.49ms 
     http_req_sending...............: avg=348.3µs  min=5.33µs  med=10.05µs  max=134.47ms p(90)=29.4µs   p(95)=127.23µs p(99.9)=63.17ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=116.14ms min=1.7ms   med=103.6ms  max=417.08ms p(90)=239.31ms p(95)=287.88ms p(99.9)=382.54ms
     http_reqs......................: 119145  1911.300633/s
     iteration_duration.............: avg=118.59ms min=1.92ms  med=105.76ms max=681.44ms p(90)=243.52ms p(95)=291.44ms p(99.9)=396.72ms
     iterations.....................: 118145  1895.25883/s
     success_rate...................: 100.00% ✓ 118145      ✗ 0     
     vus............................: 76      min=0         max=494 
     vus_max........................: 500     min=500       max=500 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 130434     ✗ 0    
     data_received..................: 3.9 GB  61 MB/s
     data_sent......................: 52 MB   811 kB/s
     http_req_blocked...............: avg=96.72µs  min=1.27µs  med=2.98µs   max=128.19ms p(90)=4.48µs   p(95)=6.27µs   p(99.9)=28.02ms 
     http_req_connecting............: avg=92.05µs  min=0s      med=0s       max=127.99ms p(90)=0s       p(95)=0s       p(99.9)=27.88ms 
     http_req_duration..............: avg=315.84ms min=2.89ms  med=300.01ms max=1.14s    p(90)=620.01ms p(95)=697.17ms p(99.9)=974.95ms
       { expected_response:true }...: avg=315.84ms min=2.89ms  med=300.01ms max=1.14s    p(90)=620.01ms p(95)=697.17ms p(99.9)=974.95ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 44478
     http_req_receiving.............: avg=499.08µs min=26.96µs med=62.95µs  max=280.2ms  p(90)=180.45µs p(95)=444.45µs p(99.9)=75.65ms 
     http_req_sending...............: avg=137.18µs min=5.54µs  med=11.3µs   max=139.13ms p(90)=29.32µs  p(95)=126.52µs p(99.9)=25.71ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=315.2ms  min=2.82ms  med=299.56ms max=1.14s    p(90)=619.35ms p(95)=696.02ms p(99.9)=974.63ms
     http_reqs......................: 44478   696.369493/s
     iteration_duration.............: avg=323.55ms min=3.03ms  med=307.96ms max=1.14s    p(90)=623.19ms p(95)=699.62ms p(99.9)=977.48ms
     iterations.....................: 43478   680.713/s
     success_rate...................: 100.00% ✓ 43478      ✗ 0    
     vus............................: 57      min=0        max=498
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 93480      ✗ 0    
     data_received..................: 2.8 GB  45 MB/s
     data_sent......................: 38 MB   591 kB/s
     http_req_blocked...............: avg=347µs    min=1.35µs  med=3.32µs   max=215.67ms p(90)=5.21µs   p(95)=9.48µs   p(99.9)=99.45ms
     http_req_connecting............: avg=337.01µs min=0s      med=0s       max=215.59ms p(90)=0s       p(95)=0s       p(99.9)=97.82ms
     http_req_duration..............: avg=436.95ms min=2.62ms  med=423.07ms max=1.39s    p(90)=857.16ms p(95)=957.05ms p(99.9)=1.26s  
       { expected_response:true }...: avg=436.95ms min=2.62ms  med=423.07ms max=1.39s    p(90)=857.16ms p(95)=957.05ms p(99.9)=1.26s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 32160
     http_req_receiving.............: avg=361.08µs min=25.43µs med=52.94µs  max=181.47ms p(90)=177.47µs p(95)=480.35µs p(99.9)=59.39ms
     http_req_sending...............: avg=386.44µs min=6.05µs  med=12.56µs  max=205.58ms p(90)=77.56µs  p(95)=141.04µs p(99.9)=75.66ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=436.2ms  min=2.57ms  med=421.27ms max=1.39s    p(90)=856.59ms p(95)=956.67ms p(99.9)=1.26s  
     http_reqs......................: 32160   507.291712/s
     iteration_duration.............: avg=452.29ms min=2.91ms  med=443.91ms max=1.39s    p(90)=864.49ms p(95)=962.71ms p(99.9)=1.26s  
     iterations.....................: 31160   491.517716/s
     success_rate...................: 100.00% ✓ 31160      ✗ 0    
     vus............................: 83      min=0        max=499
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  99% — ✓ 26237 / ✗ 15
     ✓ valid response structure

     checks.........................: 99.98% ✓ 78741      ✗ 15   
     data_received..................: 2.4 GB 36 MB/s
     data_sent......................: 32 MB  474 kB/s
     http_req_blocked...............: avg=60.21µs  min=1.27µs  med=2.94µs   max=103.89ms p(90)=4.58µs  p(95)=6.36µs   p(99.9)=13.45ms
     http_req_connecting............: avg=54.73µs  min=0s      med=0s       max=103.77ms p(90)=0s      p(95)=0s       p(99.9)=12.92ms
     http_req_duration..............: avg=517.33ms min=6ms     med=484.57ms max=1.92s    p(90)=1.06s   p(95)=1.17s    p(99.9)=1.68s  
       { expected_response:true }...: avg=517.33ms min=6ms     med=484.57ms max=1.92s    p(90)=1.06s   p(95)=1.17s    p(99.9)=1.68s  
     http_req_failed................: 0.00%  ✓ 0          ✗ 27252
     http_req_receiving.............: avg=98.05µs  min=26.02µs med=50.57µs  max=46.52ms  p(90)=93.95µs p(95)=157.53µs p(99.9)=6.07ms 
     http_req_sending...............: avg=87.83µs  min=6.01µs  med=11.46µs  max=88.5ms   p(90)=25.8µs  p(95)=94.11µs  p(99.9)=14.53ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=517.14ms min=5.95ms  med=484.32ms max=1.92s    p(90)=1.06s   p(95)=1.17s    p(99.9)=1.68s  
     http_reqs......................: 27252  406.551705/s
     iteration_duration.............: avg=537.38ms min=6.15ms  med=505.64ms max=1.92s    p(90)=1.06s   p(95)=1.17s    p(99.9)=1.7s   
     iterations.....................: 26252  391.633471/s
     success_rate...................: 99.94% ✓ 26237      ✗ 15   
     vus............................: 64     min=0        max=497
     vus_max........................: 500    min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 54204      ✗ 0    
     data_received..................: 1.7 GB  24 MB/s
     data_sent......................: 22 MB   319 kB/s
     http_req_blocked...............: avg=85.68µs  min=1.26µs  med=2.9µs    max=66.18ms p(90)=5.23µs   p(95)=7.83µs  p(99.9)=22ms   
     http_req_connecting............: avg=79.83µs  min=0s      med=0s       max=66.12ms p(90)=0s       p(95)=0s      p(99.9)=21.93ms
     http_req_duration..............: avg=736.19ms min=7.16ms  med=682.96ms max=4.69s   p(90)=1.46s    p(95)=1.62s   p(99.9)=3.8s   
       { expected_response:true }...: avg=736.19ms min=7.16ms  med=682.96ms max=4.69s   p(90)=1.46s    p(95)=1.62s   p(99.9)=3.8s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 19068
     http_req_receiving.............: avg=157.38µs min=27.82µs med=46.87µs  max=68.09ms p(90)=103.11µs p(95)=171.4µs p(99.9)=23.14ms
     http_req_sending...............: avg=150.13µs min=5.94µs  med=11.45µs  max=81.48ms p(90)=31.42µs  p(95)=105.3µs p(99.9)=26.48ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s      p(90)=0s       p(95)=0s      p(99.9)=0s     
     http_req_waiting...............: avg=735.88ms min=7.08ms  med=682.69ms max=4.69s   p(90)=1.46s    p(95)=1.62s   p(99.9)=3.8s   
     http_reqs......................: 19068   272.297483/s
     iteration_duration.............: avg=777.14ms min=8.18ms  med=723.48ms max=4.7s    p(90)=1.48s    p(95)=1.63s   p(99.9)=3.85s  
     iterations.....................: 18068   258.017145/s
     success_rate...................: 100.00% ✓ 18068      ✗ 0    
     vus............................: 64      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 49626      ✗ 0    
     data_received..................: 1.5 GB  22 MB/s
     data_sent......................: 21 MB   294 kB/s
     http_req_blocked...............: avg=100.21µs min=1.27µs  med=2.86µs   max=93.63ms p(90)=5.08µs  p(95)=8.32µs   p(99.9)=25.62ms
     http_req_connecting............: avg=94.05µs  min=0s      med=0s       max=93.56ms p(90)=0s      p(95)=0s       p(99.9)=25.56ms
     http_req_duration..............: avg=797.78ms min=7ms     med=766.24ms max=5.64s   p(90)=1.55s   p(95)=1.73s    p(99.9)=4.49s  
       { expected_response:true }...: avg=797.78ms min=7ms     med=766.24ms max=5.64s   p(90)=1.55s   p(95)=1.73s    p(99.9)=4.49s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 17542
     http_req_receiving.............: avg=176.3µs  min=29.36µs med=46.41µs  max=95.59ms p(90)=102µs   p(95)=235.91µs p(99.9)=23.65ms
     http_req_sending...............: avg=160.54µs min=6.09µs  med=11.24µs  max=93.66ms p(90)=31.93µs p(95)=122.62µs p(99.9)=28.01ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s      p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=797.45ms min=6.93ms  med=765.97ms max=5.64s   p(90)=1.55s   p(95)=1.73s    p(99.9)=4.49s  
     http_reqs......................: 17542   250.267865/s
     iteration_duration.............: avg=846.22ms min=7.18ms  med=813.46ms max=5.65s   p(90)=1.56s   p(95)=1.74s    p(99.9)=4.57s  
     iterations.....................: 16542   236.001085/s
     success_rate...................: 100.00% ✓ 16542      ✗ 0    
     vus............................: 71      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 29304      ✗ 0    
     data_received..................: 946 MB  14 MB/s
     data_sent......................: 13 MB   188 kB/s
     http_req_blocked...............: avg=34.99µs min=1.28µs  med=3.2µs   max=27.61ms p(90)=5µs     p(95)=10.8µs  p(99.9)=9.69ms
     http_req_connecting............: avg=28.67µs min=0s      med=0s      max=27.55ms p(90)=0s      p(95)=0s      p(99.9)=9.63ms
     http_req_duration..............: avg=1.21s   min=7.26ms  med=1.18s   max=15.32s  p(90)=2.16s   p(95)=2.59s   p(99.9)=13.99s
       { expected_response:true }...: avg=1.21s   min=7.26ms  med=1.18s   max=15.32s  p(90)=2.16s   p(95)=2.59s   p(99.9)=13.99s
     http_req_failed................: 0.00%   ✓ 0          ✗ 10768
     http_req_receiving.............: avg=71.18µs min=27.28µs med=50.87µs max=8.88ms  p(90)=93.67µs p(95)=117.7µs p(99.9)=1.89ms
     http_req_sending...............: avg=41.23µs min=6.01µs  med=12.38µs max=16.85ms p(90)=25.1µs  p(95)=42.61µs p(99.9)=7.48ms
     http_req_tls_handshaking.......: avg=0s      min=0s      med=0s      max=0s      p(90)=0s      p(95)=0s      p(99.9)=0s    
     http_req_waiting...............: avg=1.21s   min=7.2ms   med=1.18s   max=15.32s  p(90)=2.16s   p(95)=2.59s   p(99.9)=13.99s
     http_reqs......................: 10768   157.567298/s
     iteration_duration.............: avg=1.33s   min=8.14ms  med=1.32s   max=15.33s  p(90)=2.21s   p(95)=2.63s   p(99.9)=14.05s
     iterations.....................: 9768    142.934377/s
     success_rate...................: 100.00% ✓ 9768       ✗ 0    
     vus............................: 87      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@ardatan ardatan closed this Sep 4, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant