Skip to content

Conversation

renovate[bot]
Copy link
Contributor

@renovate renovate bot commented Aug 25, 2025

This PR contains the following updates:

Update Change
lockFileMaintenance All locks refreshed

🔧 This Pull Request updates lock files to use the latest dependency versions.


Configuration

📅 Schedule: Branch creation - "before 4am on monday" (UTC), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

👻 Immortal: This PR will be recreated if closed unmerged. Get config help if that's undesired.


  • If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

@renovate renovate bot added the dependencies Pull requests that update a dependency file label Aug 25, 2025
Copy link

github-actions bot commented Aug 25, 2025

Overview for: constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1874 112913 total, 0 failed avg: 26ms, p95: 47ms
cosmo 688 41608 total, 0 failed avg: 72ms, p95: 105ms
grafbase 547 33063 total, 0 failed avg: 90ms, p95: 118ms
apollo-router 389 23637 total, 0 failed avg: 127ms, p95: 165ms
hive-gateway-bun 303 18505 total, 0 failed avg: 162ms, p95: 304ms
hive-gateway 301 18396 total, 0 failed avg: 163ms, p95: 304ms
apollo-gateway 118 7252 total, 0 failed avg: 414ms, p95: 489ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 338439      ✗ 0     
     data_received..................: 9.9 GB  164 MB/s
     data_sent......................: 131 MB  2.2 MB/s
     http_req_blocked...............: avg=4.91µs   min=1.14µs  med=2.5µs   max=8.78ms   p(90)=3.65µs   p(95)=4.31µs   p(99.9)=48.21µs
     http_req_connecting............: avg=1.94µs   min=0s      med=0s      max=8.74ms   p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_duration..............: avg=26.37ms  min=1.83ms  med=23.93ms max=437.37ms p(90)=40.64ms  p(95)=47.1ms   p(99.9)=81.39ms
       { expected_response:true }...: avg=26.37ms  min=1.83ms  med=23.93ms max=437.37ms p(90)=40.64ms  p(95)=47.1ms   p(99.9)=81.39ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 112913
     http_req_receiving.............: avg=111.93µs min=22.18µs med=42.61µs max=254.97ms p(90)=111.39µs p(95)=334.26µs p(99.9)=10.31ms
     http_req_sending...............: avg=84.38µs  min=5.01µs  med=10.03µs max=376.17ms p(90)=29.86µs  p(95)=121.34µs p(99.9)=10.88ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=26.17ms  min=1.79ms  med=23.78ms max=429.55ms p(90)=40.32ms  p(95)=46.74ms  p(99.9)=78.46ms
     http_reqs......................: 112913  1874.727832/s
     iteration_duration.............: avg=26.58ms  min=4.17ms  med=24.13ms max=446.66ms p(90)=40.85ms  p(95)=47.3ms   p(99.9)=81.74ms
     iterations.....................: 112813  1873.067503/s
     success_rate...................: 100.00% ✓ 112813      ✗ 0     
     vus............................: 50      min=50        max=50  
     vus_max........................: 50      min=50        max=50  

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 124524     ✗ 0    
     data_received..................: 3.7 GB  60 MB/s
     data_sent......................: 48 MB   800 kB/s
     http_req_blocked...............: avg=9.07µs   min=1.41µs med=2.84µs  max=9.8ms    p(90)=3.9µs    p(95)=4.49µs   p(99.9)=1.61ms  
     http_req_connecting............: avg=5.59µs   min=0s     med=0s      max=9.75ms   p(90)=0s       p(95)=0s       p(99.9)=1.42ms  
     http_req_duration..............: avg=71.88ms  min=2.86ms med=70.65ms max=515.66ms p(90)=97.43ms  p(95)=105.38ms p(99.9)=291.3ms 
       { expected_response:true }...: avg=71.88ms  min=2.86ms med=70.65ms max=515.66ms p(90)=97.43ms  p(95)=105.38ms p(99.9)=291.3ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 41608
     http_req_receiving.............: avg=166.86µs min=29.2µs med=70.18µs max=38.05ms  p(90)=147.41µs p(95)=371.31µs p(99.9)=18.21ms 
     http_req_sending...............: avg=50.58µs  min=5.84µs med=11.26µs max=360.95ms p(90)=28.63µs  p(95)=119.61µs p(99.9)=2.74ms  
     http_req_tls_handshaking.......: avg=0s       min=0s     med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=71.66ms  min=2.79ms med=70.46ms max=514.73ms p(90)=97.15ms  p(95)=105.15ms p(99.9)=287.34ms
     http_reqs......................: 41608   688.234126/s
     iteration_duration.............: avg=72.28ms  min=6.55ms med=70.94ms max=535.18ms p(90)=97.68ms  p(95)=105.65ms p(99.9)=296.66ms
     iterations.....................: 41508   686.580035/s
     success_rate...................: 100.00% ✓ 41508      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 98889      ✗ 0    
     data_received..................: 2.9 GB  48 MB/s
     data_sent......................: 39 MB   636 kB/s
     http_req_blocked...............: avg=24.32µs  min=1.56µs  med=3.48µs  max=18.15ms  p(90)=5.28µs   p(95)=8.16µs   p(99.9)=9.77ms  
     http_req_connecting............: avg=17.98µs  min=0s      med=0s      max=18.01ms  p(90)=0s       p(95)=0s       p(99.9)=9.74ms  
     http_req_duration..............: avg=90.35ms  min=3.01ms  med=88.91ms max=585.67ms p(90)=110.69ms p(95)=118.15ms p(99.9)=354.64ms
       { expected_response:true }...: avg=90.35ms  min=3.01ms  med=88.91ms max=585.67ms p(90)=110.69ms p(95)=118.15ms p(99.9)=354.64ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 33063
     http_req_receiving.............: avg=170.02µs min=28.27µs med=68.56µs max=30.29ms  p(90)=185.22µs p(95)=431.67µs p(99.9)=8.58ms  
     http_req_sending...............: avg=98.98µs  min=6.38µs  med=13.25µs max=265.75ms p(90)=104.85µs p(95)=135.43µs p(99.9)=8.36ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=90.08ms  min=2.97ms  med=88.67ms max=577.23ms p(90)=110.42ms p(95)=117.74ms p(99.9)=343.54ms
     http_reqs......................: 33063   547.099224/s
     iteration_duration.............: avg=91.02ms  min=14.83ms med=89.27ms max=624.11ms p(90)=111.08ms p(95)=118.56ms p(99.9)=374.42ms
     iterations.....................: 32963   545.444507/s
     success_rate...................: 100.00% ✓ 32963      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 70611      ✗ 0    
     data_received..................: 2.1 GB  34 MB/s
     data_sent......................: 28 MB   453 kB/s
     http_req_blocked...............: avg=18.96µs  min=1.79µs  med=3.02µs   max=21.12ms  p(90)=4.19µs   p(95)=4.89µs   p(99.9)=7.15ms  
     http_req_connecting............: avg=15.33µs  min=0s      med=0s       max=21.1ms   p(90)=0s       p(95)=0s       p(99.9)=7.12ms  
     http_req_duration..............: avg=126.73ms min=5.85ms  med=125.92ms max=542.02ms p(90)=155.84ms p(95)=165.27ms p(99.9)=393.78ms
       { expected_response:true }...: avg=126.73ms min=5.85ms  med=125.92ms max=542.02ms p(90)=155.84ms p(95)=165.27ms p(99.9)=393.78ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 23637
     http_req_receiving.............: avg=76.81µs  min=29.9µs  med=53.08µs  max=7.4ms    p(90)=100.16µs p(95)=125.83µs p(99.9)=1.6ms   
     http_req_sending...............: avg=67.45µs  min=7.42µs  med=11.68µs  max=264.39ms p(90)=18.46µs  p(95)=32.99µs  p(99.9)=8.93ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=126.58ms min=5.81ms  med=125.8ms  max=532.84ms p(90)=155.74ms p(95)=165.11ms p(99.9)=377.01ms
     http_reqs......................: 23637   389.131589/s
     iteration_duration.............: avg=127.52ms min=37.64ms med=126.27ms max=589.81ms p(90)=156.13ms p(95)=165.53ms p(99.9)=417.44ms
     iterations.....................: 23537   387.485307/s
     success_rate...................: 100.00% ✓ 23537      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 55215      ✗ 0    
     data_received..................: 1.6 GB  27 MB/s
     data_sent......................: 22 MB   353 kB/s
     http_req_blocked...............: avg=19.47µs  min=1.25µs  med=2.84µs   max=11.7ms   p(90)=4.8µs    p(95)=5.98µs   p(99.9)=7.25ms  
     http_req_connecting............: avg=15.56µs  min=0s      med=0s       max=11.66ms  p(90)=0s       p(95)=0s       p(99.9)=7.21ms  
     http_req_duration..............: avg=162.01ms min=6.74ms  med=149.83ms max=696.78ms p(90)=186.89ms p(95)=304.04ms p(99.9)=519.96ms
       { expected_response:true }...: avg=162.01ms min=6.74ms  med=149.83ms max=696.78ms p(90)=186.89ms p(95)=304.04ms p(99.9)=519.96ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 18505
     http_req_receiving.............: avg=95µs     min=27.44µs med=49.01µs  max=9.44ms   p(90)=114.26µs p(95)=197.59µs p(99.9)=4.71ms  
     http_req_sending...............: avg=81.48µs  min=5.91µs  med=11.53µs  max=246.19ms p(90)=32.47µs  p(95)=118.85µs p(99.9)=5.42ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=161.84ms min=6.65ms  med=149.68ms max=696.03ms p(90)=186.76ms p(95)=303.85ms p(99.9)=518.67ms
     http_reqs......................: 18505   303.549449/s
     iteration_duration.............: avg=163.17ms min=27.34ms med=150.2ms  max=733.98ms p(90)=187.49ms p(95)=304.6ms  p(99.9)=580.44ms
     iterations.....................: 18405   301.909084/s
     success_rate...................: 100.00% ✓ 18405      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 54888      ✗ 0    
     data_received..................: 1.6 GB  26 MB/s
     data_sent......................: 21 MB   350 kB/s
     http_req_blocked...............: avg=41.91µs  min=1.33µs  med=2.8µs    max=26.1ms   p(90)=4.73µs   p(95)=6.13µs   p(99.9)=15.49ms 
     http_req_connecting............: avg=37.57µs  min=0s      med=0s       max=26.05ms  p(90)=0s       p(95)=0s       p(99.9)=15.17ms 
     http_req_duration..............: avg=162.92ms min=7.6ms   med=151.59ms max=638.64ms p(90)=192.05ms p(95)=303.64ms p(99.9)=479.59ms
       { expected_response:true }...: avg=162.92ms min=7.6ms   med=151.59ms max=638.64ms p(90)=192.05ms p(95)=303.64ms p(99.9)=479.59ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 18396
     http_req_receiving.............: avg=98.42µs  min=26.3µs  med=49.16µs  max=21.34ms  p(90)=115.92µs p(95)=282.58µs p(99.9)=3.85ms  
     http_req_sending...............: avg=122.08µs min=5.95µs  med=11.42µs  max=389.68ms p(90)=33.87µs  p(95)=128.55µs p(99.9)=7.99ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=162.7ms  min=7.5ms   med=151.46ms max=626.65ms p(90)=191.69ms p(95)=303.4ms  p(99.9)=464.47ms
     http_reqs......................: 18396   301.059167/s
     iteration_duration.............: avg=164.16ms min=42.03ms med=151.94ms max=706.07ms p(90)=192.73ms p(95)=304.12ms p(99.9)=513.42ms
     iterations.....................: 18296   299.422621/s
     success_rate...................: 100.00% ✓ 18296      ✗ 0    
     vus............................: 32      min=32       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 21456      ✗ 0   
     data_received..................: 637 MB  10 MB/s
     data_sent......................: 8.4 MB  138 kB/s
     http_req_blocked...............: avg=43.59µs  min=1.36µs   med=3.11µs   max=11.83ms  p(90)=4.84µs   p(95)=5.52µs   p(99.9)=10.25ms 
     http_req_connecting............: avg=40.01µs  min=0s       med=0s       max=11.77ms  p(90)=0s       p(95)=0s       p(99.9)=10.22ms 
     http_req_duration..............: avg=414.28ms min=7.53ms   med=413.47ms max=867.91ms p(90)=469.87ms p(95)=488.73ms p(99.9)=776.46ms
       { expected_response:true }...: avg=414.28ms min=7.53ms   med=413.47ms max=867.91ms p(90)=469.87ms p(95)=488.73ms p(99.9)=776.46ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 7252
     http_req_receiving.............: avg=67.62µs  min=28.83µs  med=53.74µs  max=30.37ms  p(90)=97.46µs  p(95)=111.97µs p(99.9)=308.63µs
     http_req_sending...............: avg=128.18µs min=5.92µs   med=12.45µs  max=216.41ms p(90)=20.44µs  p(95)=24.08µs  p(99.9)=3.42ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=414.09ms min=7.44ms   med=413.41ms max=852.5ms  p(90)=469.79ms p(95)=488.66ms p(99.9)=775.24ms
     http_reqs......................: 7252    118.646163/s
     iteration_duration.............: avg=420.48ms min=110.89ms med=414.19ms max=884.59ms p(90)=470.52ms p(95)=489.28ms p(99.9)=833.78ms
     iterations.....................: 7152    117.010115/s
     success_rate...................: 100.00% ✓ 7152       ✗ 0   
     vus............................: 27      min=27       max=50
     vus_max........................: 50      min=50       max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Aug 25, 2025

Overview for: constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 170 13799 total, 0 failed avg: 219ms, p95: 230ms
hive-router 167 13539 total, 0 failed avg: 223ms, p95: 233ms
cosmo 157 12739 total, 0 failed avg: 237ms, p95: 265ms
hive-gateway 149 11461 total, 0 failed avg: 263ms, p95: 353ms
hive-gateway-bun 146 11251 total, 0 failed avg: 269ms, p95: 361ms
apollo-router 128 10456 total, 0 failed avg: 289ms, p95: 336ms
apollo-gateway 86 7056 total, 0 failed avg: 430ms, p95: 473ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41097      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   198 kB/s
     http_req_blocked...............: avg=20.48µs  min=1.4µs    med=2.97µs   max=9.16ms   p(90)=3.89µs   p(95)=4.51µs   p(99.9)=6.76ms  
     http_req_connecting............: avg=16.85µs  min=0s       med=0s       max=9.13ms   p(90)=0s       p(95)=0s       p(99.9)=6.74ms  
     http_req_duration..............: avg=218.97ms min=205.21ms med=217.5ms  max=632.47ms p(90)=226.92ms p(95)=230.17ms p(99.9)=512.12ms
       { expected_response:true }...: avg=218.97ms min=205.21ms med=217.5ms  max=632.47ms p(90)=226.92ms p(95)=230.17ms p(99.9)=512.12ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13799
     http_req_receiving.............: avg=75.09µs  min=28.82µs  med=50.42µs  max=11.06ms  p(90)=87.55µs  p(95)=117.07µs p(99.9)=2.84ms  
     http_req_sending...............: avg=65.41µs  min=6.3µs    med=11.89µs  max=298.65ms p(90)=16.68µs  p(95)=35.35µs  p(99.9)=3.53ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=218.83ms min=205.16ms med=217.39ms max=631.28ms p(90)=226.77ms p(95)=230.03ms p(99.9)=511.11ms
     http_reqs......................: 13799   170.321863/s
     iteration_duration.............: avg=219.3ms  min=205.33ms med=217.79ms max=648.61ms p(90)=227.18ms p(95)=230.45ms p(99.9)=528.15ms
     iterations.....................: 13699   169.087557/s
     success_rate...................: 100.00% ✓ 13699      ✗ 0    
     vus............................: 8       min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40317      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   195 kB/s
     http_req_blocked...............: avg=42.46µs  min=1.14µs   med=2.15µs   max=17.12ms  p(90)=3.09µs   p(95)=4.33µs   p(99.9)=12.81ms 
     http_req_connecting............: avg=39.76µs  min=0s       med=0s       max=17.09ms  p(90)=0s       p(95)=0s       p(99.9)=12.75ms 
     http_req_duration..............: avg=222.96ms min=161.89ms med=222.21ms max=584.76ms p(90)=230.76ms p(95)=233.2ms  p(99.9)=501.65ms
       { expected_response:true }...: avg=222.96ms min=161.89ms med=222.21ms max=584.76ms p(90)=230.76ms p(95)=233.2ms  p(99.9)=501.65ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13539
     http_req_receiving.............: avg=73.6µs   min=23.29µs  med=42.09µs  max=12ms     p(90)=85.34µs  p(95)=241.49µs p(99.9)=1.16ms  
     http_req_sending...............: avg=156.59µs min=5.55µs   med=9.37µs   max=343.88ms p(90)=28.96µs  p(95)=94.43µs  p(99.9)=5.75ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=222.73ms min=161.82ms med=222.11ms max=580.5ms  p(90)=230.62ms p(95)=233.02ms p(99.9)=476.09ms
     http_reqs......................: 13539   167.552719/s
     iteration_duration.............: avg=223.3ms  min=162.07ms med=222.44ms max=599.74ms p(90)=230.93ms p(95)=233.41ms p(99.9)=518.52ms
     iterations.....................: 13439   166.315163/s
     success_rate...................: 100.00% ✓ 13439      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 37917      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 15 MB   183 kB/s
     http_req_blocked...............: avg=47.9µs   min=1.4µs    med=2.63µs   max=16.3ms   p(90)=3.91µs   p(95)=4.82µs   p(99.9)=13.81ms 
     http_req_connecting............: avg=44.46µs  min=0s       med=0s       max=16.16ms  p(90)=0s       p(95)=0s       p(99.9)=13.75ms 
     http_req_duration..............: avg=237.42ms min=139ms    med=237.07ms max=631.83ms p(90)=258.67ms p(95)=264.91ms p(99.9)=522.08ms
       { expected_response:true }...: avg=237.42ms min=139ms    med=237.07ms max=631.83ms p(90)=258.67ms p(95)=264.91ms p(99.9)=522.08ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12739
     http_req_receiving.............: avg=321.77µs min=32.07µs  med=64.74µs  max=106.11ms p(90)=201.17µs p(95)=473.02µs p(99.9)=26.52ms 
     http_req_sending...............: avg=100.72µs min=6.46µs   med=10.93µs  max=177.41ms p(90)=30.52µs  p(95)=121.89µs p(99.9)=6.88ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=237ms    min=138.91ms med=236.73ms max=627.1ms  p(90)=258.26ms p(95)=264.45ms p(99.9)=516.34ms
     http_reqs......................: 12739   157.111886/s
     iteration_duration.............: avg=237.96ms min=139.26ms med=237.47ms max=656.95ms p(90)=258.98ms p(95)=265.22ms p(99.9)=569.53ms
     iterations.....................: 12639   155.878572/s
     success_rate...................: 100.00% ✓ 12639      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 34083      ✗ 0    
     data_received..................: 1.0 GB  13 MB/s
     data_sent......................: 13 MB   174 kB/s
     http_req_blocked...............: avg=40.81µs  min=1.12µs   med=2.62µs   max=14.65ms  p(90)=4.18µs   p(95)=5.59µs   p(99.9)=12.39ms 
     http_req_connecting............: avg=37.27µs  min=0s       med=0s       max=14.6ms   p(90)=0s       p(95)=0s       p(99.9)=12.35ms 
     http_req_duration..............: avg=263.32ms min=148.97ms med=255.37ms max=741.89ms p(90)=279.56ms p(95)=352.75ms p(99.9)=621.65ms
       { expected_response:true }...: avg=263.32ms min=148.97ms med=255.37ms max=741.89ms p(90)=279.56ms p(95)=352.75ms p(99.9)=621.65ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11461
     http_req_receiving.............: avg=91.07µs  min=25.8µs   med=46.29µs  max=17.33ms  p(90)=107.09µs p(95)=375.95µs p(99.9)=2.51ms  
     http_req_sending...............: avg=174.81µs min=5.52µs   med=10.83µs  max=248.69ms p(90)=36.88µs  p(95)=138.5µs  p(99.9)=12.91ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=263.05ms min=143.3ms  med=255.24ms max=739.17ms p(90)=279.28ms p(95)=352.28ms p(99.9)=612.72ms
     http_reqs......................: 11461   149.671525/s
     iteration_duration.............: avg=264.53ms min=149.21ms med=255.71ms max=766.83ms p(90)=280.25ms p(95)=353.5ms  p(99.9)=653.51ms
     iterations.....................: 11361   148.365605/s
     success_rate...................: 100.00% ✓ 11361      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 33453      ✗ 0    
     data_received..................: 988 MB  13 MB/s
     data_sent......................: 13 MB   171 kB/s
     http_req_blocked...............: avg=30.91µs  min=1.18µs   med=2.84µs   max=12.18ms  p(90)=4.47µs   p(95)=5.93µs   p(99.9)=9.95ms  
     http_req_connecting............: avg=27.23µs  min=0s       med=0s       max=12.14ms  p(90)=0s       p(95)=0s       p(99.9)=9.93ms  
     http_req_duration..............: avg=268.59ms min=160.67ms med=260.4ms  max=858.77ms p(90)=292.59ms p(95)=360.52ms p(99.9)=728.37ms
       { expected_response:true }...: avg=268.59ms min=160.67ms med=260.4ms  max=858.77ms p(90)=292.59ms p(95)=360.52ms p(99.9)=728.37ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11251
     http_req_receiving.............: avg=107.32µs min=26.11µs  med=48.84µs  max=17.99ms  p(90)=123.31µs p(95)=401.86µs p(99.9)=5.32ms  
     http_req_sending...............: avg=129.86µs min=5.33µs   med=11.5µs   max=255.69ms p(90)=37.36µs  p(95)=142.85µs p(99.9)=7.78ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=268.36ms min=160.57ms med=260.21ms max=857.26ms p(90)=292.25ms p(95)=360.02ms p(99.9)=727.19ms
     http_reqs......................: 11251   146.82129/s
     iteration_duration.............: avg=269.94ms min=203.23ms med=260.76ms max=881.33ms p(90)=293.14ms p(95)=361.04ms p(99.9)=798.15ms
     iterations.....................: 11151   145.516328/s
     success_rate...................: 100.00% ✓ 11151      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 31068      ✗ 0    
     data_received..................: 917 MB  11 MB/s
     data_sent......................: 12 MB   149 kB/s
     http_req_blocked...............: avg=22.53µs  min=1.71µs   med=2.77µs   max=7.81ms   p(90)=4.04µs   p(95)=4.93µs   p(99.9)=6.27ms  
     http_req_connecting............: avg=18.98µs  min=0s       med=0s       max=7.77ms   p(90)=0s       p(95)=0s       p(99.9)=6.25ms  
     http_req_duration..............: avg=289.23ms min=180.13ms med=290.12ms max=705.7ms  p(90)=327ms    p(95)=336.18ms p(99.9)=622.18ms
       { expected_response:true }...: avg=289.23ms min=180.13ms med=290.12ms max=705.7ms  p(90)=327ms    p(95)=336.18ms p(99.9)=622.18ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10456
     http_req_receiving.............: avg=81.95µs  min=36.15µs  med=50.24µs  max=4.16ms   p(90)=97.34µs  p(95)=187.86µs p(99.9)=1.6ms   
     http_req_sending...............: avg=103.44µs min=7.8µs    med=10.8µs   max=278.42ms p(90)=21.98µs  p(95)=127.23µs p(99.9)=3.61ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=289.04ms min=180.08ms med=289.91ms max=704.61ms p(90)=326.85ms p(95)=336.02ms p(99.9)=621.1ms 
     http_reqs......................: 10456   128.484769/s
     iteration_duration.............: avg=290.31ms min=180.29ms med=290.82ms max=726.61ms p(90)=327.33ms p(95)=336.67ms p(99.9)=647.68ms
     iterations.....................: 10356   127.255955/s
     success_rate...................: 100.00% ✓ 10356      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 20868     ✗ 0   
     data_received..................: 620 MB  7.6 MB/s
     data_sent......................: 8.2 MB  100 kB/s
     http_req_blocked...............: avg=88.74µs  min=1.48µs   med=3.13µs   max=18.02ms  p(90)=4.49µs   p(95)=5.32µs   p(99.9)=16.37ms 
     http_req_connecting............: avg=84.84µs  min=0s       med=0s       max=17.98ms  p(90)=0s       p(95)=0s       p(99.9)=16.33ms 
     http_req_duration..............: avg=429.74ms min=211.32ms med=432.68ms max=877.89ms p(90)=461.2ms  p(95)=472.62ms p(99.9)=829.91ms
       { expected_response:true }...: avg=429.74ms min=211.32ms med=432.68ms max=877.89ms p(90)=461.2ms  p(95)=472.62ms p(99.9)=829.91ms
     http_req_failed................: 0.00%   ✓ 0         ✗ 7056
     http_req_receiving.............: avg=68.24µs  min=30.37µs  med=52.67µs  max=22.57ms  p(90)=90.4µs   p(95)=105.45µs p(99.9)=382.6µs 
     http_req_sending...............: avg=116.99µs min=6.2µs    med=12.58µs  max=195.57ms p(90)=18.43µs  p(95)=23.9µs   p(99.9)=5.36ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=429.56ms min=211.23ms med=432.58ms max=877.74ms p(90)=460.93ms p(95)=472.48ms p(99.9)=824.94ms
     http_reqs......................: 7056    86.32004/s
     iteration_duration.............: avg=433.37ms min=296.53ms med=433.06ms max=929.88ms p(90)=461.65ms p(95)=472.98ms p(99.9)=896.49ms
     iterations.....................: 6956    85.096684/s
     success_rate...................: 100.00% ✓ 6956      ✗ 0   
     vus............................: 50      min=0       max=50
     vus_max........................: 50      min=50      max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Aug 25, 2025

Overview for: constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 169 13740 total, 0 failed avg: 220ms, p95: 230ms
grafbase 167 13600 total, 0 failed avg: 222ms, p95: 237ms
hive-gateway 167 12810 total, 0 failed avg: 236ms, p95: 270ms
cosmo 166 13482 total, 0 failed avg: 224ms, p95: 248ms
hive-gateway-bun 166 12701 total, 0 failed avg: 237ms, p95: 273ms
apollo-router 137 11167 total, 0 failed avg: 270ms, p95: 310ms ❌ 2 unexpected GraphQL errors
apollo-gateway 124 10118 total, 0 failed avg: 299ms, p95: 331ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40920      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   197 kB/s
     http_req_blocked...............: avg=18.66µs  min=1.18µs   med=2.03µs   max=8.84ms   p(90)=3.27µs   p(95)=4.53µs   p(99.9)=6.57ms  
     http_req_connecting............: avg=16.12µs  min=0s       med=0s       max=8.8ms    p(90)=0s       p(95)=0s       p(99.9)=6.54ms  
     http_req_duration..............: avg=220.24ms min=159.77ms med=219.37ms max=598.63ms p(90)=227.22ms p(95)=229.84ms p(99.9)=493.16ms
       { expected_response:true }...: avg=220.24ms min=159.77ms med=219.37ms max=598.63ms p(90)=227.22ms p(95)=229.84ms p(99.9)=493.16ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13740
     http_req_receiving.............: avg=87.01µs  min=25.09µs  med=42.33µs  max=147.75ms p(90)=89.07µs  p(95)=258.25µs p(99.9)=4.28ms  
     http_req_sending...............: avg=95.48µs  min=5.42µs   med=8.51µs   max=281.54ms p(90)=29.24µs  p(95)=93.97µs  p(99.9)=6.01ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=220.05ms min=159.68ms med=219.28ms max=592.22ms p(90)=227.08ms p(95)=229.65ms p(99.9)=486.33ms
     http_reqs......................: 13740   169.736749/s
     iteration_duration.............: avg=220.55ms min=159.91ms med=219.58ms max=611.85ms p(90)=227.4ms  p(95)=230.01ms p(99.9)=510.64ms
     iterations.....................: 13640   168.501401/s
     success_rate...................: 100.00% ✓ 13640      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40500      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   195 kB/s
     http_req_blocked...............: avg=20.52µs  min=1.24µs   med=2.92µs   max=8.88ms   p(90)=4.05µs   p(95)=4.78µs   p(99.9)=6.61ms  
     http_req_connecting............: avg=16.54µs  min=0s       med=0s       max=8.83ms   p(90)=0s       p(95)=0s       p(99.9)=6.59ms  
     http_req_duration..............: avg=222.37ms min=205.47ms med=220.88ms max=655ms    p(90)=232.89ms p(95)=236.81ms p(99.9)=547.29ms
       { expected_response:true }...: avg=222.37ms min=205.47ms med=220.88ms max=655ms    p(90)=232.89ms p(95)=236.81ms p(99.9)=547.29ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13600
     http_req_receiving.............: avg=91.81µs  min=28.07µs  med=52.98µs  max=186.45ms p(90)=96.46µs  p(95)=142.03µs p(99.9)=2.01ms  
     http_req_sending...............: avg=84.4µs   min=6.1µs    med=11.98µs  max=352.82ms p(90)=19.31µs  p(95)=35.87µs  p(99.9)=3.41ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=222.2ms  min=205.4ms  med=220.78ms max=648.01ms p(90)=232.75ms p(95)=236.69ms p(99.9)=527.68ms
     http_reqs......................: 13600   167.6859/s
     iteration_duration.............: avg=222.75ms min=205.59ms med=221.2ms  max=665.72ms p(90)=233.18ms p(95)=237.09ms p(99.9)=560.26ms
     iterations.....................: 13500   166.452915/s
     success_rate...................: 100.00% ✓ 13500      ✗ 0    
     vus............................: 40      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 38130      ✗ 0    
     data_received..................: 1.1 GB  15 MB/s
     data_sent......................: 15 MB   195 kB/s
     http_req_blocked...............: avg=21.36µs  min=1.1µs    med=2.55µs   max=9.45ms   p(90)=4.17µs   p(95)=5.38µs   p(99.9)=6.92ms  
     http_req_connecting............: avg=17.95µs  min=0s       med=0s       max=9.41ms   p(90)=0s       p(95)=0s       p(99.9)=6.9ms   
     http_req_duration..............: avg=235.55ms min=159.8ms  med=229.06ms max=707.03ms p(90)=249.54ms p(95)=270.21ms p(99.9)=592.73ms
       { expected_response:true }...: avg=235.55ms min=159.8ms  med=229.06ms max=707.03ms p(90)=249.54ms p(95)=270.21ms p(99.9)=592.73ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12810
     http_req_receiving.............: avg=85.8µs   min=25.46µs  med=45.28µs  max=9.84ms   p(90)=101.47µs p(95)=182.55µs p(99.9)=3.9ms   
     http_req_sending...............: avg=72.39µs  min=5.48µs   med=10.72µs  max=132.88ms p(90)=32.4µs   p(95)=118.03µs p(99.9)=4.37ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=235.39ms min=159.74ms med=228.93ms max=706.33ms p(90)=249.33ms p(95)=270.01ms p(99.9)=591.34ms
     http_reqs......................: 12810   167.390911/s
     iteration_duration.............: avg=236.49ms min=160.02ms med=229.38ms max=744.03ms p(90)=249.84ms p(95)=272.66ms p(99.9)=626.78ms
     iterations.....................: 12710   166.08419/s
     success_rate...................: 100.00% ✓ 12710      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40146      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   193 kB/s
     http_req_blocked...............: avg=20.88µs  min=1.28µs   med=2.64µs   max=9.28ms   p(90)=3.83µs   p(95)=4.89µs   p(99.9)=6.87ms  
     http_req_connecting............: avg=17.22µs  min=0s       med=0s       max=9.25ms   p(90)=0s       p(95)=0s       p(99.9)=6.85ms  
     http_req_duration..............: avg=224.26ms min=126.93ms med=223.25ms max=623.05ms p(90)=242.75ms p(95)=248.1ms  p(99.9)=521.45ms
       { expected_response:true }...: avg=224.26ms min=126.93ms med=223.25ms max=623.05ms p(90)=242.75ms p(95)=248.1ms  p(99.9)=521.45ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13482
     http_req_receiving.............: avg=483.26µs min=32.22µs  med=63.89µs  max=85.18ms  p(90)=355.54µs p(95)=726.25µs p(99.9)=24.93ms 
     http_req_sending...............: avg=99.48µs  min=6.39µs   med=11µs     max=177.61ms p(90)=31.31µs  p(95)=121.31µs p(99.9)=4.08ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=223.68ms min=126.86ms med=222.7ms  max=621.88ms p(90)=242.08ms p(95)=247.49ms p(99.9)=520.13ms
     http_reqs......................: 13482   166.220118/s
     iteration_duration.............: avg=224.68ms min=127.12ms med=223.56ms max=642.85ms p(90)=243.05ms p(95)=248.35ms p(99.9)=559.57ms
     iterations.....................: 13382   164.987214/s
     success_rate...................: 100.00% ✓ 13382      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 37803      ✗ 0    
     data_received..................: 1.1 GB  15 MB/s
     data_sent......................: 15 MB   193 kB/s
     http_req_blocked...............: avg=24.65µs  min=1.13µs   med=2.6µs    max=10.46ms  p(90)=4.1µs    p(95)=5.18µs   p(99.9)=8.05ms  
     http_req_connecting............: avg=21.29µs  min=0s       med=0s       max=10.41ms  p(90)=0s       p(95)=0s       p(99.9)=8.02ms  
     http_req_duration..............: avg=237.26ms min=130.64ms med=230.57ms max=820.63ms p(90)=254.8ms  p(95)=272.59ms p(99.9)=684.25ms
       { expected_response:true }...: avg=237.26ms min=130.64ms med=230.57ms max=820.63ms p(90)=254.8ms  p(95)=272.59ms p(99.9)=684.25ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12701
     http_req_receiving.............: avg=102.73µs min=24.08µs  med=44.92µs  max=103.85ms p(90)=106.47µs p(95)=187.59µs p(99.9)=4.54ms  
     http_req_sending...............: avg=80.65µs  min=5.53µs   med=10.78µs  max=196.74ms p(90)=32.32µs  p(95)=116.28µs p(99.9)=4.93ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=237.07ms min=130.59ms med=230.42ms max=777.03ms p(90)=254.66ms p(95)=272.09ms p(99.9)=682.69ms
     http_reqs......................: 12701   166.336055/s
     iteration_duration.............: avg=238.23ms min=130.74ms med=230.91ms max=849.98ms p(90)=255.1ms  p(95)=273.27ms p(99.9)=721.13ms
     iterations.....................: 12601   165.026425/s
     success_rate...................: 100.00% ✓ 12601      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  99% — ✓ 11065 / ✗ 2
     ✓ valid response structure

     checks.........................: 99.99% ✓ 33199      ✗ 2    
     data_received..................: 980 MB 12 MB/s
     data_sent......................: 13 MB  160 kB/s
     http_req_blocked...............: avg=59.99µs  min=1.47µs   med=2.73µs   max=16.97ms  p(90)=4.03µs   p(95)=4.99µs   p(99.9)=14.02ms 
     http_req_connecting............: avg=55.48µs  min=0s       med=0s       max=16.83ms  p(90)=0s       p(95)=0s       p(99.9)=14ms    
     http_req_duration..............: avg=270.41ms min=169.6ms  med=271.79ms max=688.48ms p(90)=302.08ms p(95)=310.34ms p(99.9)=600.15ms
       { expected_response:true }...: avg=270.41ms min=169.6ms  med=271.79ms max=688.48ms p(90)=302.08ms p(95)=310.34ms p(99.9)=600.15ms
     http_req_failed................: 0.00%  ✓ 0          ✗ 11167
     http_req_receiving.............: avg=120.76µs min=31.41µs  med=52.14µs  max=11.88ms  p(90)=159.14µs p(95)=455.3µs  p(99.9)=4.24ms  
     http_req_sending...............: avg=137.31µs min=7.15µs   med=11.26µs  max=283.73ms p(90)=68.98µs  p(95)=141.87µs p(99.9)=4.87ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=270.15ms min=169.5ms  med=271.64ms max=684.19ms p(90)=301.84ms p(95)=310.06ms p(99.9)=597.07ms
     http_reqs......................: 11167  137.271975/s
     iteration_duration.............: avg=271.34ms min=169.77ms med=272.3ms  max=708.55ms p(90)=302.53ms p(95)=310.72ms p(99.9)=646.99ms
     iterations.....................: 11067  136.04271/s
     success_rate...................: 99.98% ✓ 11065      ✗ 2    
     vus............................: 50     min=0        max=50 
     vus_max........................: 50     min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 30054      ✗ 0    
     data_received..................: 889 MB  11 MB/s
     data_sent......................: 12 MB   144 kB/s
     http_req_blocked...............: avg=27.77µs  min=1.37µs   med=3.17µs   max=9.83ms   p(90)=4.72µs   p(95)=5.62µs   p(99.9)=7.75ms  
     http_req_connecting............: avg=23.68µs  min=0s       med=0s       max=9.8ms    p(90)=0s       p(95)=0s       p(99.9)=7.72ms  
     http_req_duration..............: avg=299ms    min=210.85ms med=296.77ms max=815.06ms p(90)=321.86ms p(95)=330.84ms p(99.9)=735.92ms
       { expected_response:true }...: avg=299ms    min=210.85ms med=296.77ms max=815.06ms p(90)=321.86ms p(95)=330.84ms p(99.9)=735.92ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10118
     http_req_receiving.............: avg=90.77µs  min=29.38µs  med=58.06µs  max=116.37ms p(90)=106.09µs p(95)=131.75µs p(99.9)=2.41ms  
     http_req_sending...............: avg=113.56µs min=6.25µs   med=12.55µs  max=279.08ms p(90)=21.95µs  p(95)=37.75µs  p(99.9)=3.22ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=298.8ms  min=210.7ms  med=296.68ms max=814.27ms p(90)=321.71ms p(95)=330.7ms  p(99.9)=722.87ms
     http_reqs......................: 10118   124.108597/s
     iteration_duration.............: avg=300.23ms min=218.62ms med=297.18ms max=848.29ms p(90)=322.32ms p(95)=331.13ms p(99.9)=777.07ms
     iterations.....................: 10018   122.881985/s
     success_rate...................: 100.00% ✓ 10018      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Aug 25, 2025

Overview for: ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 500 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 2028 126185 total, 0 failed avg: 110ms, p95: 271ms
cosmo 670 42835 total, 0 failed avg: 328ms, p95: 712ms
grafbase 523 33129 total, 0 failed avg: 424ms, p95: 946ms
apollo-router 409 27429 total, 0 failed avg: 514ms, p95: 1150ms ❌ 22 unexpected GraphQL errors, non-compatible response structure (1)
hive-gateway 268 18629 total, 0 failed avg: 753ms, p95: 1635ms
hive-gateway-bun 257 18002 total, 0 failed avg: 779ms, p95: 1652ms
apollo-gateway 160 10999 total, 0 failed avg: 1193ms, p95: 2523ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 375555      ✗ 0     
     data_received..................: 11 GB   178 MB/s
     data_sent......................: 147 MB  2.4 MB/s
     http_req_blocked...............: avg=363.56µs min=1.08µs  med=2.44µs   max=336.68ms p(90)=3.79µs   p(95)=4.49µs   p(99.9)=137.15ms
     http_req_connecting............: avg=359.94µs min=0s      med=0s       max=336.59ms p(90)=0s       p(95)=0s       p(99.9)=137.07ms
     http_req_duration..............: avg=110.42ms min=1.67ms  med=99.16ms  max=425.63ms p(90)=224.56ms p(95)=270.57ms p(99.9)=373.92ms
       { expected_response:true }...: avg=110.42ms min=1.67ms  med=99.16ms  max=425.63ms p(90)=224.56ms p(95)=270.57ms p(99.9)=373.92ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 126185
     http_req_receiving.............: avg=456.57µs min=22.81µs med=40.14µs  max=122.98ms p(90)=148.87µs p(95)=379.75µs p(99.9)=66.59ms 
     http_req_sending...............: avg=339.47µs min=5.11µs  med=9.79µs   max=124.15ms p(90)=26.48µs  p(95)=122.78µs p(99.9)=58.46ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=109.63ms min=1.6ms   med=98.43ms  max=400.19ms p(90)=222.72ms p(95)=269.08ms p(99.9)=371.21ms
     http_reqs......................: 126185  2028.900077/s
     iteration_duration.............: avg=111.9ms  min=1.78ms  med=100.56ms max=635.55ms p(90)=226.74ms p(95)=272.61ms p(99.9)=388.6ms 
     iterations.....................: 125185  2012.821303/s
     success_rate...................: 100.00% ✓ 125185      ✗ 0     
     vus............................: 68      min=0         max=495 
     vus_max........................: 500     min=500       max=500 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 125505     ✗ 0    
     data_received..................: 3.8 GB  59 MB/s
     data_sent......................: 50 MB   781 kB/s
     http_req_blocked...............: avg=76.17µs  min=1.37µs  med=3.05µs   max=95.49ms  p(90)=4.65µs   p(95)=6.17µs   p(99.9)=27.44ms
     http_req_connecting............: avg=70.25µs  min=0s      med=0s       max=83.13ms  p(90)=0s       p(95)=0s       p(99.9)=27.36ms
     http_req_duration..............: avg=327.95ms min=2.89ms  med=312.26ms max=1.34s    p(90)=638.6ms  p(95)=712.28ms p(99.9)=1.06s  
       { expected_response:true }...: avg=327.95ms min=2.89ms  med=312.26ms max=1.34s    p(90)=638.6ms  p(95)=712.28ms p(99.9)=1.06s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 42835
     http_req_receiving.............: avg=525.18µs min=29.24µs med=65.72µs  max=150.86ms p(90)=173.55µs p(95)=490.46µs p(99.9)=78.16ms
     http_req_sending...............: avg=119.74µs min=6.02µs  med=11.64µs  max=66.78ms  p(90)=30.13µs  p(95)=129.33µs p(99.9)=21.03ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=327.3ms  min=2.8ms   med=311.52ms max=1.34s    p(90)=638.09ms p(95)=711.37ms p(99.9)=1.06s  
     http_reqs......................: 42835   670.676715/s
     iteration_duration.............: avg=336.2ms  min=3.19ms  med=320.86ms max=1.34s    p(90)=642.04ms p(95)=715.56ms p(99.9)=1.06s  
     iterations.....................: 41835   655.019502/s
     success_rate...................: 100.00% ✓ 41835      ✗ 0    
     vus............................: 55      min=0        max=498
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 96387      ✗ 0    
     data_received..................: 2.9 GB  46 MB/s
     data_sent......................: 39 MB   610 kB/s
     http_req_blocked...............: avg=489.53µs min=1.27µs  med=3.25µs   max=298.39ms p(90)=4.8µs    p(95)=9.14µs   p(99.9)=146.41ms
     http_req_connecting............: avg=480.1µs  min=0s      med=0s       max=298.34ms p(90)=0s       p(95)=0s       p(99.9)=146.31ms
     http_req_duration..............: avg=424.06ms min=2.57ms  med=393.77ms max=1.43s    p(90)=848.22ms p(95)=945.92ms p(99.9)=1.28s   
       { expected_response:true }...: avg=424.06ms min=2.57ms  med=393.77ms max=1.43s    p(90)=848.22ms p(95)=945.92ms p(99.9)=1.28s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 33129
     http_req_receiving.............: avg=385.17µs min=26.12µs med=52.09µs  max=229.69ms p(90)=176.66µs p(95)=484.03µs p(99.9)=68.43ms 
     http_req_sending...............: avg=529.2µs  min=5.58µs  med=12.41µs  max=242.32ms p(90)=105.7µs  p(95)=141.5µs  p(99.9)=109.97ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=423.14ms min=2.52ms  med=392.37ms max=1.43s    p(90)=847.23ms p(95)=943.77ms p(99.9)=1.28s   
     http_reqs......................: 33129   523.797337/s
     iteration_duration.............: avg=438.82ms min=2.82ms  med=410.13ms max=1.61s    p(90)=855.37ms p(95)=952.24ms p(99.9)=1.29s   
     iterations.....................: 32129   507.986497/s
     success_rate...................: 100.00% ✓ 32129      ✗ 0    
     vus............................: 72      min=0        max=495
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  99% — ✓ 26407 / ✗ 22
     ✗ valid response structure
      ↳  99% — ✓ 26428 / ✗ 1

     checks.........................: 99.97% ✓ 79264      ✗ 23   
     data_received..................: 2.4 GB 36 MB/s
     data_sent......................: 32 MB  478 kB/s
     http_req_blocked...............: avg=53.79µs  min=1.25µs med=2.83µs   max=83.46ms p(90)=4.4µs   p(95)=6.15µs   p(99.9)=13.45ms
     http_req_connecting............: avg=48.94µs  min=0s     med=0s       max=83.4ms  p(90)=0s      p(95)=0s       p(99.9)=13.22ms
     http_req_duration..............: avg=514.21ms min=6.01ms med=479ms    max=2.94s   p(90)=1.04s   p(95)=1.14s    p(99.9)=1.61s  
       { expected_response:true }...: avg=514.21ms min=6.01ms med=479ms    max=2.94s   p(90)=1.04s   p(95)=1.14s    p(99.9)=1.61s  
     http_req_failed................: 0.00%  ✓ 0          ✗ 27429
     http_req_receiving.............: avg=91.39µs  min=27.7µs med=50.05µs  max=49.82ms p(90)=96.3µs  p(95)=155.87µs p(99.9)=3.56ms 
     http_req_sending...............: avg=98.07µs  min=5.94µs med=11.28µs  max=64.86ms p(90)=26.22µs p(95)=104.67µs p(99.9)=19.22ms
     http_req_tls_handshaking.......: avg=0s       min=0s     med=0s       max=0s      p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=514.02ms min=5.96ms med=478.52ms max=2.94s   p(90)=1.04s   p(95)=1.14s    p(99.9)=1.61s  
     http_reqs......................: 27429  409.709902/s
     iteration_duration.............: avg=533.99ms min=6.3ms  med=501.14ms max=2.94s   p(90)=1.04s   p(95)=1.15s    p(99.9)=1.61s  
     iterations.....................: 26429  394.772795/s
     success_rate...................: 99.91% ✓ 26407      ✗ 22   
     vus............................: 62     min=0        max=498
     vus_max........................: 500    min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 52887      ✗ 0    
     data_received..................: 1.6 GB  24 MB/s
     data_sent......................: 22 MB   314 kB/s
     http_req_blocked...............: avg=130.83µs min=1.28µs  med=2.9µs    max=199.15ms p(90)=4.97µs  p(95)=8.13µs   p(99.9)=36.98ms
     http_req_connecting............: avg=120.6µs  min=0s      med=0s       max=199.08ms p(90)=0s      p(95)=0s       p(99.9)=36.87ms
     http_req_duration..............: avg=752.88ms min=6.84ms  med=687.91ms max=5.21s    p(90)=1.47s   p(95)=1.63s    p(99.9)=4.33s  
       { expected_response:true }...: avg=752.88ms min=6.84ms  med=687.91ms max=5.21s    p(90)=1.47s   p(95)=1.63s    p(99.9)=4.33s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 18629
     http_req_receiving.............: avg=195.12µs min=26.24µs med=45.74µs  max=164.5ms  p(90)=98.85µs p(95)=280.89µs p(99.9)=27.65ms
     http_req_sending...............: avg=205.11µs min=5.78µs  med=11.28µs  max=139.72ms p(90)=33.23µs p(95)=126.82µs p(99.9)=32.53ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=752.48ms min=6.76ms  med=687.86ms max=5.2s     p(90)=1.47s   p(95)=1.63s    p(99.9)=4.33s  
     http_reqs......................: 18629   268.266781/s
     iteration_duration.............: avg=795.9ms  min=8.39ms  med=733.28ms max=5.23s    p(90)=1.48s   p(95)=1.64s    p(99.9)=4.36s  
     iterations.....................: 17629   253.866288/s
     success_rate...................: 100.00% ✓ 17629      ✗ 0    
     vus............................: 85      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 51006      ✗ 0    
     data_received..................: 1.6 GB  23 MB/s
     data_sent......................: 21 MB   302 kB/s
     http_req_blocked...............: avg=132.26µs min=1.39µs  med=2.89µs   max=143.19ms p(90)=4.97µs  p(95)=7.87µs   p(99.9)=33.57ms
     http_req_connecting............: avg=123.65µs min=0s      med=0s       max=143.13ms p(90)=0s      p(95)=0s       p(99.9)=32.24ms
     http_req_duration..............: avg=778.55ms min=7.4ms   med=727.19ms max=5.43s    p(90)=1.53s   p(95)=1.65s    p(99.9)=4.04s  
       { expected_response:true }...: avg=778.55ms min=7.4ms   med=727.19ms max=5.43s    p(90)=1.53s   p(95)=1.65s    p(99.9)=4.04s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 18002
     http_req_receiving.............: avg=184.78µs min=26.68µs med=45.59µs  max=123.87ms p(90)=94.89µs p(95)=160.79µs p(99.9)=30.92ms
     http_req_sending...............: avg=186.53µs min=5.84µs  med=11.31µs  max=117ms    p(90)=30.37µs p(95)=108.75µs p(99.9)=30.87ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=778.18ms min=7.31ms  med=727.01ms max=5.43s    p(90)=1.53s   p(95)=1.65s    p(99.9)=4.04s  
     http_reqs......................: 18002   257.229664/s
     iteration_duration.............: avg=824.64ms min=8.68ms  med=787.16ms max=5.44s    p(90)=1.54s   p(95)=1.65s    p(99.9)=4.12s  
     iterations.....................: 17002   242.940715/s
     success_rate...................: 100.00% ✓ 17002      ✗ 0    
     vus............................: 64      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 29997      ✗ 0    
     data_received..................: 966 MB  14 MB/s
     data_sent......................: 13 MB   192 kB/s
     http_req_blocked...............: avg=37.9µs  min=1.31µs  med=3.18µs  max=20.43ms p(90)=5.22µs  p(95)=10.33µs  p(99.9)=11.13ms
     http_req_connecting............: avg=32.2µs  min=0s      med=0s      max=20.35ms p(90)=0s      p(95)=0s       p(99.9)=11.07ms
     http_req_duration..............: avg=1.19s   min=7.24ms  med=1.15s   max=15.21s  p(90)=2.16s   p(95)=2.52s    p(99.9)=13.81s 
       { expected_response:true }...: avg=1.19s   min=7.24ms  med=1.15s   max=15.21s  p(90)=2.16s   p(95)=2.52s    p(99.9)=13.81s 
     http_req_failed................: 0.00%   ✓ 0          ✗ 10999
     http_req_receiving.............: avg=71.5µs  min=26.36µs med=51.48µs max=5.97ms  p(90)=95.61µs p(95)=119.95µs p(99.9)=1.56ms 
     http_req_sending...............: avg=44.45µs min=6.16µs  med=12.42µs max=23.97ms p(90)=29.05µs p(95)=45.14µs  p(99.9)=9.41ms 
     http_req_tls_handshaking.......: avg=0s      min=0s      med=0s      max=0s      p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=1.19s   min=7.19ms  med=1.15s   max=15.21s  p(90)=2.16s   p(95)=2.52s    p(99.9)=13.81s 
     http_reqs......................: 10999   160.861113/s
     iteration_duration.............: avg=1.31s   min=7.47ms  med=1.27s   max=15.22s  p(90)=2.23s   p(95)=2.56s    p(99.9)=14.1s  
     iterations.....................: 9999    146.236046/s
     success_rate...................: 100.00% ✓ 9999       ✗ 0    
     vus............................: 94      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@renovate renovate bot force-pushed the renovate/lock-file-maintenance branch 5 times, most recently from 4ef60fd to baa4133 Compare September 4, 2025 23:55
@ardatan ardatan force-pushed the renovate/lock-file-maintenance branch from 95447d2 to 87e84fc Compare September 5, 2025 00:34
@ardatan ardatan force-pushed the renovate/lock-file-maintenance branch from 87e84fc to 73f2b7a Compare September 5, 2025 00:34
Copy link
Contributor Author

renovate bot commented Sep 5, 2025

Edited/Blocked Notification

Renovate will not automatically rebase this PR, because it does not recognize the last commit author and assumes somebody else may have edited the PR.

You can manually request rebase by checking the rebase/retry box above.

⚠️ Warning: custom changes will be lost.

@ardatan ardatan merged commit 0644190 into main Sep 5, 2025
@ardatan ardatan deleted the renovate/lock-file-maintenance branch September 5, 2025 01:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant