Skip to content

Conversation

@renovate
Copy link
Contributor

@renovate renovate bot commented Sep 14, 2025

This PR contains the following updates:

Package Type Update Change
serde (source) dependencies patch 1.0.219 -> 1.0.223

Release Notes

serde-rs/serde (serde)

v1.0.223

Compare Source

v1.0.222

Compare Source

  • Make serialize_with attribute produce code that works if respanned to 2024 edition (#​2950, thanks @​aytey)

v1.0.221

Compare Source

  • Documentation improvements (#​2973)
  • Deprecate serde_if_integer128! macro (#​2975)

v1.0.220

Compare Source


Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.


  • If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

@renovate renovate bot added the dependencies Pull requests that update a dependency file label Sep 14, 2025
@github-actions
Copy link

github-actions bot commented Sep 14, 2025

💻 Website Preview

The latest changes are available as preview in: https://f47d4dec.federation-gateway-benchmark.pages.dev

@github-actions
Copy link

github-actions bot commented Sep 14, 2025

Overview for: constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1913 115268 total, 0 failed avg: 26ms, p95: 46ms
grafbase 1705 102839 total, 0 failed avg: 29ms, p95: 50ms
cosmo 672 40608 total, 0 failed avg: 74ms, p95: 108ms
apollo-router 389 23674 total, 0 failed avg: 127ms, p95: 166ms
hive-gateway 312 19020 total, 0 failed avg: 158ms, p95: 229ms
hive-gateway-bun 299 18266 total, 0 failed avg: 164ms, p95: 241ms
apollo-gateway 118 7253 total, 0 failed avg: 415ms, p95: 487ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 345504      ✗ 0     
     data_received..................: 10 GB   168 MB/s
     data_sent......................: 134 MB  2.2 MB/s
     http_req_blocked...............: avg=4.74µs   min=1.11µs  med=2.44µs  max=8.39ms   p(90)=3.48µs   p(95)=4.03µs   p(99.9)=71.32µs
     http_req_connecting............: avg=1.85µs   min=0s      med=0s      max=8.36ms   p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_duration..............: avg=25.83ms  min=1.85ms  med=23.54ms max=423.07ms p(90)=39.53ms  p(95)=45.59ms  p(99.9)=77.94ms
       { expected_response:true }...: avg=25.83ms  min=1.85ms  med=23.54ms max=423.07ms p(90)=39.53ms  p(95)=45.59ms  p(99.9)=77.94ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 115268
     http_req_receiving.............: avg=105.36µs min=22.24µs med=40.23µs max=55.02ms  p(90)=100.18µs p(95)=309.92µs p(99.9)=10.54ms
     http_req_sending...............: avg=83.18µs  min=5.06µs  med=9.58µs  max=376.78ms p(90)=28.36µs  p(95)=114.35µs p(99.9)=10.3ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=25.64ms  min=1.78ms  med=23.4ms  max=410.73ms p(90)=39.22ms  p(95)=45.21ms  p(99.9)=76.36ms
     http_reqs......................: 115268  1913.698588/s
     iteration_duration.............: avg=26.04ms  min=5.12ms  med=23.73ms max=440.17ms p(90)=39.73ms  p(95)=45.79ms  p(99.9)=78.35ms
     iterations.....................: 115168  1912.038371/s
     success_rate...................: 100.00% ✓ 115168      ✗ 0     
     vus............................: 50      min=50        max=50  
     vus_max........................: 50      min=50        max=50  

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 308217      ✗ 0     
     data_received..................: 9.0 GB  150 MB/s
     data_sent......................: 120 MB  2.0 MB/s
     http_req_blocked...............: avg=6.01µs   min=1.13µs  med=2.9µs   max=9.62ms   p(90)=4.01µs   p(95)=4.91µs   p(99.9)=110.4µs
     http_req_connecting............: avg=2.47µs   min=0s      med=0s      max=9.59ms   p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_duration..............: avg=28.94ms  min=2.59ms  med=26.04ms max=449.41ms p(90)=43.92ms  p(95)=50.41ms  p(99.9)=86.94ms
       { expected_response:true }...: avg=28.94ms  min=2.59ms  med=26.04ms max=449.41ms p(90)=43.92ms  p(95)=50.41ms  p(99.9)=86.94ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 102839
     http_req_receiving.............: avg=131.31µs min=23.64µs med=46.43µs max=182.61ms p(90)=143.29µs p(95)=367.54µs p(99.9)=14.23ms
     http_req_sending...............: avg=94.27µs  min=5.24µs  med=11.37µs max=182.74ms p(90)=36.47µs  p(95)=128.25µs p(99.9)=13.12ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=28.72ms  min=2.54ms  med=25.89ms max=431.15ms p(90)=43.51ms  p(95)=49.92ms  p(99.9)=85.19ms
     http_reqs......................: 102839  1705.066216/s
     iteration_duration.............: avg=29.19ms  min=8.01ms  med=26.26ms max=466.86ms p(90)=44.14ms  p(95)=50.64ms  p(99.9)=87.75ms
     iterations.....................: 102739  1703.40822/s
     success_rate...................: 100.00% ✓ 102739      ✗ 0     
     vus............................: 50      min=50        max=50  
     vus_max........................: 50      min=50        max=50  

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 121524     ✗ 0    
     data_received..................: 3.6 GB  59 MB/s
     data_sent......................: 47 MB   782 kB/s
     http_req_blocked...............: avg=10.11µs  min=1.31µs  med=2.92µs  max=10.14ms  p(90)=4.06µs   p(95)=4.73µs   p(99.9)=2.11ms  
     http_req_connecting............: avg=6.54µs   min=0s      med=0s      max=10.09ms  p(90)=0s       p(95)=0s       p(99.9)=2.09ms  
     http_req_duration..............: avg=73.65ms  min=2.83ms  med=72.57ms max=510.79ms p(90)=99.62ms  p(95)=107.54ms p(99.9)=299.31ms
       { expected_response:true }...: avg=73.65ms  min=2.83ms  med=72.57ms max=510.79ms p(90)=99.62ms  p(95)=107.54ms p(99.9)=299.31ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 40608
     http_req_receiving.............: avg=160.52µs min=31.55µs med=75.01µs max=42.95ms  p(90)=153.15µs p(95)=379.6µs  p(99.9)=14.3ms  
     http_req_sending...............: avg=63.93µs  min=6.05µs  med=11.36µs max=284.22ms p(90)=29.77µs  p(95)=123.32µs p(99.9)=2.85ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=73.43ms  min=2.77ms  med=72.38ms max=509.72ms p(90)=99.41ms  p(95)=107.3ms  p(99.9)=290.27ms
     http_reqs......................: 40608   672.106097/s
     iteration_duration.............: avg=74.07ms  min=6.43ms  med=72.85ms max=530.34ms p(90)=99.86ms  p(95)=107.79ms p(99.9)=313.97ms
     iterations.....................: 40508   670.450989/s
     success_rate...................: 100.00% ✓ 40508      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 70722      ✗ 0    
     data_received..................: 2.1 GB  34 MB/s
     data_sent......................: 28 MB   453 kB/s
     http_req_blocked...............: avg=27.97µs  min=1.91µs  med=2.84µs   max=16.57ms  p(90)=4.07µs   p(95)=4.75µs   p(99.9)=11.86ms 
     http_req_connecting............: avg=24.39µs  min=0s      med=0s       max=16.46ms  p(90)=0s       p(95)=0s       p(99.9)=11.82ms 
     http_req_duration..............: avg=126.61ms min=5.91ms  med=125.78ms max=521.96ms p(90)=155.91ms p(95)=166.06ms p(99.9)=390.87ms
       { expected_response:true }...: avg=126.61ms min=5.91ms  med=125.78ms max=521.96ms p(90)=155.91ms p(95)=166.06ms p(99.9)=390.87ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 23674
     http_req_receiving.............: avg=74.78µs  min=34.55µs med=51.26µs  max=72.27ms  p(90)=93.57µs  p(95)=117.78µs p(99.9)=1.29ms  
     http_req_sending...............: avg=71.17µs  min=7.31µs  med=11.54µs  max=222.94ms p(90)=18.88µs  p(95)=32.72µs  p(99.9)=4.64ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=126.46ms min=5.84ms  med=125.67ms max=521.33ms p(90)=155.77ms p(95)=165.92ms p(99.9)=378.23ms
     http_reqs......................: 23674   389.590103/s
     iteration_duration.............: avg=127.4ms  min=32.05ms med=126.12ms max=567.87ms p(90)=156.17ms p(95)=166.34ms p(99.9)=420.35ms
     iterations.....................: 23574   387.944458/s
     success_rate...................: 100.00% ✓ 23574      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 56760      ✗ 0    
     data_received..................: 1.7 GB  27 MB/s
     data_sent......................: 22 MB   363 kB/s
     http_req_blocked...............: avg=32.31µs  min=1.17µs  med=2.7µs    max=24.65ms  p(90)=4.49µs   p(95)=5.57µs   p(99.9)=12.9ms  
     http_req_connecting............: avg=28.4µs   min=0s      med=0s       max=24.61ms  p(90)=0s       p(95)=0s       p(99.9)=12.73ms 
     http_req_duration..............: avg=157.52ms min=6.77ms  med=146.66ms max=598.34ms p(90)=174.78ms p(95)=228.83ms p(99.9)=492.9ms 
       { expected_response:true }...: avg=157.52ms min=6.77ms  med=146.66ms max=598.34ms p(90)=174.78ms p(95)=228.83ms p(99.9)=492.9ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 19020
     http_req_receiving.............: avg=106.5µs  min=25.92µs med=45.43µs  max=355.19ms p(90)=104.85µs p(95)=213µs    p(99.9)=2.97ms  
     http_req_sending...............: avg=126.01µs min=5.48µs  med=11.04µs  max=383.58ms p(90)=32.61µs  p(95)=125.19µs p(99.9)=8.4ms   
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=157.29ms min=6.72ms  med=146.52ms max=576.57ms p(90)=174.67ms p(95)=226.66ms p(99.9)=491.03ms
     http_reqs......................: 19020   312.185617/s
     iteration_duration.............: avg=158.65ms min=41.18ms med=147ms    max=668.97ms p(90)=175.14ms p(95)=240.66ms p(99.9)=500.81ms
     iterations.....................: 18920   310.544262/s
     success_rate...................: 100.00% ✓ 18920      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 54498      ✗ 0    
     data_received..................: 1.6 GB  26 MB/s
     data_sent......................: 21 MB   348 kB/s
     http_req_blocked...............: avg=27.65µs  min=1.2µs   med=2.77µs   max=16.43ms  p(90)=4.63µs   p(95)=5.66µs   p(99.9)=10.85ms 
     http_req_connecting............: avg=23.84µs  min=0s      med=0s       max=16.39ms  p(90)=0s       p(95)=0s       p(99.9)=10.79ms 
     http_req_duration..............: avg=164.17ms min=7.1ms   med=152.62ms max=612.36ms p(90)=180.91ms p(95)=240.65ms p(99.9)=502.46ms
       { expected_response:true }...: avg=164.17ms min=7.1ms   med=152.62ms max=612.36ms p(90)=180.91ms p(95)=240.65ms p(99.9)=502.46ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 18266
     http_req_receiving.............: avg=95.18µs  min=25.89µs med=46.41µs  max=20.66ms  p(90)=102.81µs p(95)=233.22µs p(99.9)=4.21ms  
     http_req_sending...............: avg=117.91µs min=5.56µs  med=11.3µs   max=264.22ms p(90)=32.55µs  p(95)=128.45µs p(99.9)=9.75ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=163.96ms min=7.03ms  med=152.48ms max=603.44ms p(90)=180.71ms p(95)=236.67ms p(99.9)=502.35ms
     http_reqs......................: 18266   299.020343/s
     iteration_duration.............: avg=165.37ms min=56.71ms med=152.94ms max=651.18ms p(90)=181.23ms p(95)=280.53ms p(99.9)=504.15ms
     iterations.....................: 18166   297.383311/s
     success_rate...................: 100.00% ✓ 18166      ✗ 0    
     vus............................: 24      min=24       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 21459      ✗ 0   
     data_received..................: 637 MB  10 MB/s
     data_sent......................: 8.4 MB  138 kB/s
     http_req_blocked...............: avg=46.38µs  min=1.39µs  med=3.2µs    max=11.86ms  p(90)=4.72µs   p(95)=5.51µs   p(99.9)=10.24ms 
     http_req_connecting............: avg=42.35µs  min=0s      med=0s       max=11.82ms  p(90)=0s       p(95)=0s       p(99.9)=10.2ms  
     http_req_duration..............: avg=414.59ms min=7.66ms  med=414.83ms max=730.8ms  p(90)=469.98ms p(95)=486.95ms p(99.9)=676.24ms
       { expected_response:true }...: avg=414.59ms min=7.66ms  med=414.83ms max=730.8ms  p(90)=469.98ms p(95)=486.95ms p(99.9)=676.24ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 7253
     http_req_receiving.............: avg=76.54µs  min=28.01µs med=52.73µs  max=96.25ms  p(90)=94.15µs  p(95)=109.95µs p(99.9)=751.73µs
     http_req_sending...............: avg=89.23µs  min=5.91µs  med=12.64µs  max=163.09ms p(90)=19.67µs  p(95)=24.05µs  p(99.9)=4.06ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=414.42ms min=7.6ms   med=414.75ms max=716.5ms  p(90)=469.86ms p(95)=486.82ms p(99.9)=660.96ms
     http_reqs......................: 7253    118.581976/s
     iteration_duration.............: avg=420.59ms min=176.8ms med=415.4ms  max=746.55ms p(90)=470.48ms p(95)=487.42ms p(99.9)=699.85ms
     iterations.....................: 7153    116.947039/s
     success_rate...................: 100.00% ✓ 7153       ✗ 0   
     vus............................: 34      min=34       max=50
     vus_max........................: 50      min=50       max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@github-actions
Copy link

github-actions bot commented Sep 14, 2025

Overview for: ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 500 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 2019 125698 total, 0 failed avg: 111ms, p95: 271ms
grafbase 1687 106932 total, 0 failed avg: 130ms, p95: 307ms
cosmo 664 42510 total, 0 failed avg: 330ms, p95: 727ms
apollo-router 400 26821 total, 0 failed avg: 526ms, p95: 1202ms ❌ 20 unexpected GraphQL errors, non-compatible response structure (1)
hive-gateway 278 19027 total, 0 failed avg: 738ms, p95: 1604ms
hive-gateway-bun 278 19372 total, 0 failed avg: 725ms, p95: 1594ms
apollo-gateway 157 10783 total, 0 failed avg: 1214ms, p95: 2661ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 374094      ✗ 0     
     data_received..................: 11 GB   177 MB/s
     data_sent......................: 146 MB  2.3 MB/s
     http_req_blocked...............: avg=355.47µs min=1.14µs  med=2.47µs   max=431.41ms p(90)=3.79µs   p(95)=4.49µs   p(99.9)=132.87ms
     http_req_connecting............: avg=351.92µs min=0s      med=0s       max=431.36ms p(90)=0s       p(95)=0s       p(99.9)=132.82ms
     http_req_duration..............: avg=110.66ms min=1.77ms  med=99.34ms  max=419.14ms p(90)=227.19ms p(95)=270.92ms p(99.9)=372.18ms
       { expected_response:true }...: avg=110.66ms min=1.77ms  med=99.34ms  max=419.14ms p(90)=227.19ms p(95)=270.92ms p(99.9)=372.18ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 125698
     http_req_receiving.............: avg=461.9µs  min=19.96µs med=39.9µs   max=127.6ms  p(90)=162.94µs p(95)=373.65µs p(99.9)=71.13ms 
     http_req_sending...............: avg=339.5µs  min=5.26µs  med=9.83µs   max=166.88ms p(90)=27.18µs  p(95)=121.31µs p(99.9)=62.27ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=109.86ms min=1.71ms  med=98.62ms  max=412.15ms p(90)=225.56ms p(95)=269.23ms p(99.9)=369.45ms
     http_reqs......................: 125698  2019.151815/s
     iteration_duration.............: avg=112.32ms min=1.92ms  med=100.61ms max=639.05ms p(90)=229.4ms  p(95)=273.97ms p(99.9)=390.36ms
     iterations.....................: 124698  2003.0883/s
     success_rate...................: 100.00% ✓ 124698      ✗ 0     
     vus............................: 72      min=0         max=495 
     vus_max........................: 500     min=500       max=500 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 317796      ✗ 0     
     data_received..................: 9.4 GB  148 MB/s
     data_sent......................: 124 MB  2.0 MB/s
     http_req_blocked...............: avg=522.25µs min=1.22µs  med=2.94µs   max=359.87ms p(90)=4.19µs   p(95)=5.16µs   p(99.9)=177.18ms
     http_req_connecting............: avg=518.15µs min=0s      med=0s       max=359.82ms p(90)=0s       p(95)=0s       p(99.9)=177.04ms
     http_req_duration..............: avg=130.2ms  min=2.54ms  med=120.58ms max=469.22ms p(90)=259.72ms p(95)=306.51ms p(99.9)=413.75ms
       { expected_response:true }...: avg=130.2ms  min=2.54ms  med=120.58ms max=469.22ms p(90)=259.72ms p(95)=306.51ms p(99.9)=413.75ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 106932
     http_req_receiving.............: avg=555.64µs min=23.69µs med=46.66µs  max=164.23ms p(90)=151.29µs p(95)=413.63µs p(99.9)=76.65ms 
     http_req_sending...............: avg=440.63µs min=5.21µs  med=11.63µs  max=159.26ms p(90)=32.03µs  p(95)=133.07µs p(99.9)=71.74ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=129.2ms  min=2.49ms  med=119.69ms max=469.16ms p(90)=257.36ms p(95)=304.34ms p(99.9)=406.36ms
     http_reqs......................: 106932  1687.825444/s
     iteration_duration.............: avg=132.26ms min=3ms     med=122.26ms max=768.65ms p(90)=262.59ms p(95)=309.08ms p(99.9)=452.72ms
     iterations.....................: 105932  1672.041344/s
     success_rate...................: 100.00% ✓ 105932      ✗ 0     
     vus............................: 76      min=0         max=493 
     vus_max........................: 500     min=500       max=500 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 124530     ✗ 0    
     data_received..................: 3.7 GB  58 MB/s
     data_sent......................: 50 MB   774 kB/s
     http_req_blocked...............: avg=124.72µs min=1.3µs   med=3.18µs   max=220.58ms p(90)=5.05µs   p(95)=7.22µs   p(99.9)=38.91ms
     http_req_connecting............: avg=118.5µs  min=0s      med=0s       max=175.27ms p(90)=0s       p(95)=0s       p(99.9)=38.86ms
     http_req_duration..............: avg=330.46ms min=2.86ms  med=313.09ms max=1.3s     p(90)=648.03ms p(95)=727.35ms p(99.9)=1.02s  
       { expected_response:true }...: avg=330.46ms min=2.86ms  med=313.09ms max=1.3s     p(90)=648.03ms p(95)=727.35ms p(99.9)=1.02s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 42510
     http_req_receiving.............: avg=460.13µs min=28.98µs med=66.38µs  max=199.86ms p(90)=209.61µs p(95)=479µs    p(99.9)=68.89ms
     http_req_sending...............: avg=186.61µs min=6.05µs  med=11.88µs  max=127.47ms p(90)=33.12µs  p(95)=138.13µs p(99.9)=39.77ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=329.82ms min=2.77ms  med=312.54ms max=1.3s     p(90)=647.29ms p(95)=725.99ms p(99.9)=1.02s  
     http_reqs......................: 42510   664.501422/s
     iteration_duration.............: avg=338.94ms min=3.19ms  med=323.4ms  max=1.3s     p(90)=651.58ms p(95)=731.43ms p(99.9)=1.03s  
     iterations.....................: 41510   648.869772/s
     success_rate...................: 100.00% ✓ 41510      ✗ 0    
     vus............................: 61      min=0        max=497
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  99% — ✓ 25801 / ✗ 20
     ✗ valid response structure
      ↳  99% — ✓ 25820 / ✗ 1

     checks.........................: 99.97% ✓ 77442      ✗ 21   
     data_received..................: 2.4 GB 35 MB/s
     data_sent......................: 31 MB  466 kB/s
     http_req_blocked...............: avg=70.78µs  min=1.56µs  med=2.9µs    max=80.38ms p(90)=4.63µs  p(95)=7.16µs   p(99.9)=18.63ms
     http_req_connecting............: avg=65.58µs  min=0s      med=0s       max=80.31ms p(90)=0s      p(95)=0s       p(99.9)=18.55ms
     http_req_duration..............: avg=525.99ms min=6.12ms  med=493.04ms max=1.91s   p(90)=1.06s   p(95)=1.2s     p(99.9)=1.66s  
       { expected_response:true }...: avg=525.99ms min=6.12ms  med=493.04ms max=1.91s   p(90)=1.06s   p(95)=1.2s     p(99.9)=1.66s  
     http_req_failed................: 0.00%  ✓ 0          ✗ 26821
     http_req_receiving.............: avg=106.21µs min=28.95µs med=51.76µs  max=51.87ms p(90)=99.74µs p(95)=163.33µs p(99.9)=5.62ms 
     http_req_sending...............: avg=88.58µs  min=6.95µs  med=11.43µs  max=76.14ms p(90)=26.34µs p(95)=93.8µs   p(99.9)=14.02ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s      p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=525.8ms  min=6.01ms  med=492.84ms max=1.91s   p(90)=1.06s   p(95)=1.2s     p(99.9)=1.66s  
     http_reqs......................: 26821  400.070566/s
     iteration_duration.............: avg=546.73ms min=6.42ms  med=517.93ms max=1.91s   p(90)=1.07s   p(95)=1.2s     p(99.9)=1.67s  
     iterations.....................: 25821  385.154248/s
     success_rate...................: 99.92% ✓ 25801      ✗ 20   
     vus............................: 67     min=0        max=497
     vus_max........................: 500    min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 54081      ✗ 0    
     data_received..................: 1.7 GB  24 MB/s
     data_sent......................: 22 MB   326 kB/s
     http_req_blocked...............: avg=99.29µs  min=1.3µs   med=2.64µs   max=122.15ms p(90)=4.48µs  p(95)=6.82µs   p(99.9)=26.42ms
     http_req_connecting............: avg=94.63µs  min=0s      med=0s       max=122.09ms p(90)=0s      p(95)=0s       p(99.9)=26.37ms
     http_req_duration..............: avg=738.11ms min=6.37ms  med=704.47ms max=4.73s    p(90)=1.45s   p(95)=1.6s     p(99.9)=3.49s  
       { expected_response:true }...: avg=738.11ms min=6.37ms  med=704.47ms max=4.73s    p(90)=1.45s   p(95)=1.6s     p(99.9)=3.49s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 19027
     http_req_receiving.............: avg=162.99µs min=27.38µs med=43.09µs  max=78.09ms  p(90)=92.21µs p(95)=169.69µs p(99.9)=21.04ms
     http_req_sending...............: avg=160.44µs min=5.6µs   med=10.67µs  max=91.57ms  p(90)=31.08µs p(95)=116.21µs p(99.9)=30.31ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=737.79ms min=6.32ms  med=703.91ms max=4.73s    p(90)=1.45s   p(95)=1.6s     p(99.9)=3.49s  
     http_reqs......................: 19027   278.171015/s
     iteration_duration.............: avg=779.38ms min=7.47ms  med=737.63ms max=4.77s    p(90)=1.46s   p(95)=1.61s    p(99.9)=3.52s  
     iterations.....................: 18027   263.551211/s
     success_rate...................: 100.00% ✓ 18027      ✗ 0    
     vus............................: 86      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 55116      ✗ 0    
     data_received..................: 1.7 GB  25 MB/s
     data_sent......................: 23 MB   327 kB/s
     http_req_blocked...............: avg=98.7µs   min=1.21µs  med=2.82µs   max=183.76ms p(90)=4.83µs  p(95)=7.59µs   p(99.9)=23.22ms
     http_req_connecting............: avg=92.18µs  min=0s      med=0s       max=183.56ms p(90)=0s      p(95)=0s       p(99.9)=23.17ms
     http_req_duration..............: avg=725.06ms min=6.83ms  med=680.15ms max=4.49s    p(90)=1.43s   p(95)=1.59s    p(99.9)=3.49s  
       { expected_response:true }...: avg=725.06ms min=6.83ms  med=680.15ms max=4.49s    p(90)=1.43s   p(95)=1.59s    p(99.9)=3.49s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 19372
     http_req_receiving.............: avg=165.37µs min=26.34µs med=45.38µs  max=73.06ms  p(90)=93.61µs p(95)=164.65µs p(99.9)=21.17ms
     http_req_sending...............: avg=177.12µs min=5.59µs  med=11.23µs  max=90.16ms  p(90)=29.66µs p(95)=99.81µs  p(99.9)=33.03ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=724.72ms min=6.74ms  med=679.18ms max=4.49s    p(90)=1.43s   p(95)=1.59s    p(99.9)=3.49s  
     http_reqs......................: 19372   278.946284/s
     iteration_duration.............: avg=764.81ms min=8.88ms  med=729.81ms max=4.61s    p(90)=1.45s   p(95)=1.61s    p(99.9)=3.55s  
     iterations.....................: 18372   264.546827/s
     success_rate...................: 100.00% ✓ 18372      ✗ 0    
     vus............................: 83      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 29349      ✗ 0    
     data_received..................: 947 MB  14 MB/s
     data_sent......................: 13 MB   188 kB/s
     http_req_blocked...............: avg=33.46µs min=1.32µs  med=3.4µs   max=20.57ms p(90)=5.6µs    p(95)=11.34µs  p(99.9)=5.86ms
     http_req_connecting............: avg=27.36µs min=0s      med=0s      max=20.25ms p(90)=0s       p(95)=0s       p(99.9)=5.81ms
     http_req_duration..............: avg=1.21s   min=7.13ms  med=1.16s   max=15.39s  p(90)=2.14s    p(95)=2.66s    p(99.9)=14.08s
       { expected_response:true }...: avg=1.21s   min=7.13ms  med=1.16s   max=15.39s  p(90)=2.14s    p(95)=2.66s    p(99.9)=14.08s
     http_req_failed................: 0.00%   ✓ 0          ✗ 10783
     http_req_receiving.............: avg=82.21µs min=27.82µs med=58.67µs max=12.47ms p(90)=108.02µs p(95)=138.08µs p(99.9)=1.75ms
     http_req_sending...............: avg=46.41µs min=5.89µs  med=13.24µs max=18.49ms p(90)=31.53µs  p(95)=50.65µs  p(99.9)=7.09ms
     http_req_tls_handshaking.......: avg=0s      min=0s      med=0s      max=0s      p(90)=0s       p(95)=0s       p(99.9)=0s    
     http_req_waiting...............: avg=1.21s   min=7.08ms  med=1.16s   max=15.39s  p(90)=2.14s    p(95)=2.66s    p(99.9)=14.07s
     http_reqs......................: 10783   157.409204/s
     iteration_duration.............: avg=1.33s   min=8.47ms  med=1.3s    max=15.39s  p(90)=2.19s    p(95)=2.7s     p(99.9)=14.13s
     iterations.....................: 9783    142.811299/s
     success_rate...................: 100.00% ✓ 9783       ✗ 0    
     vus............................: 102     min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@github-actions
Copy link

github-actions bot commented Sep 14, 2025

Overview for: constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 173 14061 total, 0 failed avg: 215ms, p95: 225ms
hive-router 169 13743 total, 0 failed avg: 220ms, p95: 230ms
cosmo 168 13643 total, 0 failed avg: 222ms, p95: 242ms
hive-gateway-bun 165 12666 total, 0 failed avg: 238ms, p95: 263ms
hive-gateway 161 12354 total, 0 failed avg: 244ms, p95: 271ms
apollo-router 138 11279 total, 0 failed avg: 268ms, p95: 310ms
apollo-gateway 125 10211 total, 0 failed avg: 296ms, p95: 328ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41883      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   202 kB/s
     http_req_blocked...............: avg=19.35µs  min=1.18µs   med=1.88µs   max=10.06ms  p(90)=3.29µs   p(95)=4.83µs   p(99.9)=6.68ms  
     http_req_connecting............: avg=16.8µs   min=0s       med=0s       max=10.02ms  p(90)=0s       p(95)=0s       p(99.9)=6.66ms  
     http_req_duration..............: avg=214.91ms min=158.71ms med=214.12ms max=597.45ms p(90)=222.63ms p(95)=225.07ms p(99.9)=491.07ms
       { expected_response:true }...: avg=214.91ms min=158.71ms med=214.12ms max=597.45ms p(90)=222.63ms p(95)=225.07ms p(99.9)=491.07ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 14061
     http_req_receiving.............: avg=76.73µs  min=25.63µs  med=44.3µs   max=53.22ms  p(90)=87.32µs  p(95)=249.31µs p(99.9)=1.53ms  
     http_req_sending...............: avg=113.51µs min=5.33µs   med=8.33µs   max=154.98ms p(90)=27.86µs  p(95)=91.73µs  p(99.9)=10.62ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=214.72ms min=158.64ms med=214.02ms max=589.09ms p(90)=222.49ms p(95)=224.9ms  p(99.9)=483.56ms
     http_reqs......................: 14061   173.49829/s
     iteration_duration.............: avg=215.18ms min=158.88ms med=214.32ms max=608.37ms p(90)=222.8ms  p(95)=225.25ms p(99.9)=508.22ms
     iterations.....................: 13961   172.264393/s
     success_rate...................: 100.00% ✓ 13961      ✗ 0    
     vus............................: 21      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40929      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   198 kB/s
     http_req_blocked...............: avg=18.64µs  min=1.19µs   med=2.06µs   max=8.71ms   p(90)=3.18µs   p(95)=4.43µs   p(99.9)=6.44ms  
     http_req_connecting............: avg=16.14µs  min=0s       med=0s       max=8.68ms   p(90)=0s       p(95)=0s       p(99.9)=6.42ms  
     http_req_duration..............: avg=219.91ms min=157.75ms med=218.92ms max=615.96ms p(90)=226.95ms p(95)=229.59ms p(99.9)=521.43ms
       { expected_response:true }...: avg=219.91ms min=157.75ms med=218.92ms max=615.96ms p(90)=226.95ms p(95)=229.59ms p(99.9)=521.43ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13743
     http_req_receiving.............: avg=74.78µs  min=24.66µs  med=41.1µs   max=17.52ms  p(90)=84.81µs  p(95)=251.86µs p(99.9)=2.2ms   
     http_req_sending...............: avg=136.45µs min=5.43µs   med=8.72µs   max=366.46ms p(90)=29.41µs  p(95)=94.42µs  p(99.9)=6.78ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=219.7ms  min=157.68ms med=218.84ms max=615.21ms p(90)=226.79ms p(95)=229.41ms p(99.9)=507.46ms
     http_reqs......................: 13743   169.941307/s
     iteration_duration.............: avg=220.22ms min=157.96ms med=219.13ms max=621.96ms p(90)=227.12ms p(95)=229.77ms p(99.9)=529.16ms
     iterations.....................: 13643   168.704741/s
     success_rate...................: 100.00% ✓ 13643      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40629      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   196 kB/s
     http_req_blocked...............: avg=20.14µs  min=1.31µs   med=2.66µs   max=9.01ms   p(90)=3.71µs   p(95)=4.43µs   p(99.9)=6.71ms  
     http_req_connecting............: avg=16.84µs  min=0s       med=0s       max=8.98ms   p(90)=0s       p(95)=0s       p(99.9)=6.69ms  
     http_req_duration..............: avg=221.63ms min=161.57ms med=220.53ms max=615.25ms p(90)=236.82ms p(95)=241.77ms p(99.9)=503.03ms
       { expected_response:true }...: avg=221.63ms min=161.57ms med=220.53ms max=615.25ms p(90)=236.82ms p(95)=241.77ms p(99.9)=503.03ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13643
     http_req_receiving.............: avg=483.08µs min=30.88µs  med=66.51µs  max=36.21ms  p(90)=388.16µs p(95)=980.82µs p(99.9)=24.29ms 
     http_req_sending...............: avg=82.65µs  min=6.52µs   med=10.91µs  max=190.67ms p(90)=29.58µs  p(95)=115.05µs p(99.9)=3.22ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=221.06ms min=160.93ms med=220.05ms max=614.07ms p(90)=236.23ms p(95)=241.22ms p(99.9)=502.1ms 
     http_reqs......................: 13643   168.324053/s
     iteration_duration.............: avg=221.98ms min=161.8ms  med=220.83ms max=630.48ms p(90)=237.09ms p(95)=242.06ms p(99.9)=517.86ms
     iterations.....................: 13543   167.090277/s
     success_rate...................: 100.00% ✓ 13543      ✗ 0    
     vus............................: 30      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 37698      ✗ 0    
     data_received..................: 1.1 GB  15 MB/s
     data_sent......................: 15 MB   193 kB/s
     http_req_blocked...............: avg=21.52µs  min=1.18µs   med=2.6µs    max=9.7ms    p(90)=4.26µs   p(95)=5.57µs   p(99.9)=6.83ms  
     http_req_connecting............: avg=18.04µs  min=0s       med=0s       max=9.63ms   p(90)=0s       p(95)=0s       p(99.9)=6.79ms  
     http_req_duration..............: avg=238.49ms min=142.41ms med=230.29ms max=655.39ms p(90)=251.98ms p(95)=263.4ms  p(99.9)=646.31ms
       { expected_response:true }...: avg=238.49ms min=142.41ms med=230.29ms max=655.39ms p(90)=251.98ms p(95)=263.4ms  p(99.9)=646.31ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12666
     http_req_receiving.............: avg=87.52µs  min=25.91µs  med=45.11µs  max=21.05ms  p(90)=102.15µs p(95)=206.3µs  p(99.9)=2.92ms  
     http_req_sending...............: avg=95.41µs  min=5.3µs    med=10.72µs  max=196.98ms p(90)=31.75µs  p(95)=117.11µs p(99.9)=5.44ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=238.3ms  min=138.23ms med=230.17ms max=654.65ms p(90)=251.8ms  p(95)=262.96ms p(99.9)=646.24ms
     http_reqs......................: 12666   165.601698/s
     iteration_duration.............: avg=239.36ms min=142.64ms med=230.61ms max=697.43ms p(90)=252.34ms p(95)=263.91ms p(99.9)=646.76ms
     iterations.....................: 12566   164.294247/s
     success_rate...................: 100.00% ✓ 12566      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 36762      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 14 MB   188 kB/s
     http_req_blocked...............: avg=55.49µs  min=1.14µs   med=2.5µs    max=19.39ms  p(90)=4.21µs   p(95)=5.35µs   p(99.9)=15.63ms 
     http_req_connecting............: avg=50.9µs   min=0s       med=0s       max=18.98ms  p(90)=0s       p(95)=0s       p(99.9)=15.3ms  
     http_req_duration..............: avg=243.95ms min=160.54ms med=235.89ms max=803.39ms p(90)=257.81ms p(95)=270.87ms p(99.9)=684.09ms
       { expected_response:true }...: avg=243.95ms min=160.54ms med=235.89ms max=803.39ms p(90)=257.81ms p(95)=270.87ms p(99.9)=684.09ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12354
     http_req_receiving.............: avg=88.4µs   min=26.27µs  med=45.49µs  max=22.84ms  p(90)=102.11µs p(95)=208.41µs p(99.9)=3.59ms  
     http_req_sending...............: avg=79.77µs  min=5.36µs   med=10.61µs  max=135.72ms p(90)=31.65µs  p(95)=119.89µs p(99.9)=4.34ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=243.78ms min=160.47ms med=235.75ms max=802.59ms p(90)=257.7ms  p(95)=270.65ms p(99.9)=683.35ms
     http_reqs......................: 12354   161.517219/s
     iteration_duration.............: avg=244.96ms min=184.82ms med=236.19ms max=827.22ms p(90)=258.09ms p(95)=271.27ms p(99.9)=731.6ms 
     iterations.....................: 12254   160.209811/s
     success_rate...................: 100.00% ✓ 12254      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 33537      ✗ 0    
     data_received..................: 990 MB  12 MB/s
     data_sent......................: 13 MB   161 kB/s
     http_req_blocked...............: avg=24.75µs  min=1.56µs   med=2.82µs   max=8.98ms   p(90)=4.02µs   p(95)=4.79µs   p(99.9)=7.08ms  
     http_req_connecting............: avg=20.3µs   min=0s       med=0s       max=8.95ms   p(90)=0s       p(95)=0s       p(99.9)=7.07ms  
     http_req_duration..............: avg=268.29ms min=175.85ms med=268.04ms max=697.08ms p(90)=300.63ms p(95)=309.94ms p(99.9)=599.94ms
       { expected_response:true }...: avg=268.29ms min=175.85ms med=268.04ms max=697.08ms p(90)=300.63ms p(95)=309.94ms p(99.9)=599.94ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11279
     http_req_receiving.............: avg=116.71µs min=30.41µs  med=49.16µs  max=13.41ms  p(90)=150.97µs p(95)=428.39µs p(99.9)=4.32ms  
     http_req_sending...............: avg=108.42µs min=6.56µs   med=10.97µs  max=281.5ms  p(90)=41.18µs  p(95)=133.16µs p(99.9)=5.31ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=268.06ms min=173.28ms med=267.91ms max=695.28ms p(90)=300.45ms p(95)=309.61ms p(99.9)=598.26ms
     http_reqs......................: 11279   138.598813/s
     iteration_duration.............: avg=269.14ms min=176.08ms med=268.57ms max=720.81ms p(90)=301.05ms p(95)=310.23ms p(99.9)=623.98ms
     iterations.....................: 11179   137.369991/s
     success_rate...................: 100.00% ✓ 11179      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 30333      ✗ 0    
     data_received..................: 897 MB  11 MB/s
     data_sent......................: 12 MB   146 kB/s
     http_req_blocked...............: avg=56.39µs  min=1.3µs    med=3.24µs   max=19.65ms  p(90)=4.7µs    p(95)=5.59µs   p(99.9)=15.17ms 
     http_req_connecting............: avg=51.57µs  min=0s       med=0s       max=19.51ms  p(90)=0s       p(95)=0s       p(99.9)=15.13ms 
     http_req_duration..............: avg=296.17ms min=211.03ms med=293.84ms max=765.63ms p(90)=318.52ms p(95)=327.77ms p(99.9)=688.55ms
       { expected_response:true }...: avg=296.17ms min=211.03ms med=293.84ms max=765.63ms p(90)=318.52ms p(95)=327.77ms p(99.9)=688.55ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10211
     http_req_receiving.............: avg=94.68µs  min=29.91µs  med=57.76µs  max=183.14ms p(90)=105.92µs p(95)=125.44µs p(99.9)=1.56ms  
     http_req_sending...............: avg=99.97µs  min=6.23µs   med=12.79µs  max=261.91ms p(90)=21.78µs  p(95)=38.67µs  p(99.9)=3.38ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=295.98ms min=210.95ms med=293.73ms max=754.04ms p(90)=318.38ms p(95)=327.45ms p(99.9)=672.44ms
     http_reqs......................: 10211   125.196222/s
     iteration_duration.............: avg=297.37ms min=218.97ms med=294.22ms max=801.81ms p(90)=318.9ms  p(95)=328.1ms  p(99.9)=720.96ms
     iterations.....................: 10111   123.97013/s
     success_rate...................: 100.00% ✓ 10111      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@github-actions
Copy link

github-actions bot commented Sep 14, 2025

Overview for: constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 171 13892 total, 0 failed avg: 217ms, p95: 229ms
hive-router 168 13590 total, 0 failed avg: 222ms, p95: 232ms
cosmo 159 12943 total, 0 failed avg: 233ms, p95: 256ms
hive-gateway 153 11745 total, 0 failed avg: 257ms, p95: 289ms
hive-gateway-bun 137 10534 total, 0 failed avg: 286ms, p95: 462ms
apollo-router 128 10441 total, 0 failed avg: 290ms, p95: 337ms
apollo-gateway 87 7146 total, 0 failed avg: 423ms, p95: 464ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41376      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   200 kB/s
     http_req_blocked...............: avg=20.27µs  min=1.29µs   med=2.06µs   max=9.57ms   p(90)=3.81µs   p(95)=5.35µs   p(99.9)=7.05ms  
     http_req_connecting............: avg=17.39µs  min=0s       med=0s       max=9.53ms   p(90)=0s       p(95)=0s       p(99.9)=7.03ms  
     http_req_duration..............: avg=217.29ms min=158.04ms med=216.43ms max=635.4ms  p(90)=225.93ms p(95)=228.75ms p(99.9)=533.57ms
       { expected_response:true }...: avg=217.29ms min=158.04ms med=216.43ms max=635.4ms  p(90)=225.93ms p(95)=228.75ms p(99.9)=533.57ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13892
     http_req_receiving.............: avg=87.75µs  min=28.51µs  med=47.51µs  max=14.64ms  p(90)=99.94µs  p(95)=267.43µs p(99.9)=5.42ms  
     http_req_sending...............: avg=116.49µs min=5.61µs   med=8.98µs   max=408.47ms p(90)=34.34µs  p(95)=99.09µs  p(99.9)=6.43ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=217.09ms min=157.99ms med=216.32ms max=633.82ms p(90)=225.76ms p(95)=228.5ms  p(99.9)=506.37ms
     http_reqs......................: 13892   171.645444/s
     iteration_duration.............: avg=217.59ms min=158.21ms med=216.67ms max=654.31ms p(90)=226.12ms p(95)=228.94ms p(99.9)=552.28ms
     iterations.....................: 13792   170.409873/s
     success_rate...................: 100.00% ✓ 13792      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40470      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   196 kB/s
     http_req_blocked...............: avg=19.14µs  min=1.2µs    med=2.14µs   max=8.88ms   p(90)=3.12µs   p(95)=4.36µs   p(99.9)=6.59ms  
     http_req_connecting............: avg=16.53µs  min=0s       med=0s       max=8.85ms   p(90)=0s       p(95)=0s       p(99.9)=6.57ms  
     http_req_duration..............: avg=222.28ms min=117.39ms med=221.3ms  max=606.63ms p(90)=230.02ms p(95)=232.42ms p(99.9)=513.86ms
       { expected_response:true }...: avg=222.28ms min=117.39ms med=221.3ms  max=606.63ms p(90)=230.02ms p(95)=232.42ms p(99.9)=513.86ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13590
     http_req_receiving.............: avg=70.84µs  min=25.49µs  med=41.29µs  max=10.9ms   p(90)=84.83µs  p(95)=233.71µs p(99.9)=1.61ms  
     http_req_sending...............: avg=168.05µs min=5.51µs   med=9.18µs   max=371.51ms p(90)=28.96µs  p(95)=91.66µs  p(99.9)=6.09ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=222.04ms min=113.47ms med=221.21ms max=605.5ms  p(90)=229.89ms p(95)=232.22ms p(99.9)=497.97ms
     http_reqs......................: 13590   168.13113/s
     iteration_duration.............: avg=222.6ms  min=117.56ms med=221.53ms max=614.46ms p(90)=230.18ms p(95)=232.6ms  p(99.9)=526.3ms 
     iterations.....................: 13490   166.893962/s
     success_rate...................: 100.00% ✓ 13490      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 38529      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 15 MB   186 kB/s
     http_req_blocked...............: avg=53.94µs  min=1.46µs   med=2.65µs   max=19.68ms  p(90)=4.06µs   p(95)=5.04µs   p(99.9)=14.98ms 
     http_req_connecting............: avg=50.06µs  min=0s       med=0s       max=19.66ms  p(90)=0s       p(95)=0s       p(99.9)=14.94ms 
     http_req_duration..............: avg=233.23ms min=160.06ms med=233.11ms max=631.33ms p(90)=249.98ms p(95)=255.67ms p(99.9)=526.29ms
       { expected_response:true }...: avg=233.23ms min=160.06ms med=233.11ms max=631.33ms p(90)=249.98ms p(95)=255.67ms p(99.9)=526.29ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12943
     http_req_receiving.............: avg=286.39µs min=29.1µs   med=70.81µs  max=71.25ms  p(90)=191.2µs  p(95)=456.66µs p(99.9)=25.28ms 
     http_req_sending...............: avg=67.82µs  min=5.87µs   med=11.11µs  max=182.48ms p(90)=27.79µs  p(95)=96.46µs  p(99.9)=5.4ms   
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=232.88ms min=159.69ms med=232.81ms max=626.14ms p(90)=249.47ms p(95)=255.08ms p(99.9)=522.64ms
     http_reqs......................: 12943   159.741026/s
     iteration_duration.............: avg=233.71ms min=160.25ms med=233.45ms max=665.67ms p(90)=250.29ms p(95)=255.98ms p(99.9)=562.12ms
     iterations.....................: 12843   158.506837/s
     success_rate...................: 100.00% ✓ 12843      ✗ 0    
     vus............................: 14      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 34935      ✗ 0    
     data_received..................: 1.0 GB  14 MB/s
     data_sent......................: 14 MB   178 kB/s
     http_req_blocked...............: avg=28.48µs  min=1.13µs   med=2.53µs   max=11.75ms  p(90)=4.05µs   p(95)=5.34µs   p(99.9)=9.27ms  
     http_req_connecting............: avg=25.11µs  min=0s       med=0s       max=11.71ms  p(90)=0s       p(95)=0s       p(99.9)=9.23ms  
     http_req_duration..............: avg=257.13ms min=152.19ms med=249.35ms max=697.69ms p(90)=265ms    p(95)=289.29ms p(99.9)=598.43ms
       { expected_response:true }...: avg=257.13ms min=152.19ms med=249.35ms max=697.69ms p(90)=265ms    p(95)=289.29ms p(99.9)=598.43ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11745
     http_req_receiving.............: avg=102.47µs min=26.02µs  med=44.55µs  max=136.77ms p(90)=106.31µs p(95)=367.51µs p(99.9)=4ms     
     http_req_sending...............: avg=84.03µs  min=5.4µs    med=10.56µs  max=313.89ms p(90)=35µs     p(95)=143.42µs p(99.9)=5.32ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=256.94ms min=150.77ms med=249.23ms max=691.81ms p(90)=264.72ms p(95)=289.04ms p(99.9)=584.41ms
     http_reqs......................: 11745   153.316254/s
     iteration_duration.............: avg=258.25ms min=152.34ms med=249.69ms max=735.61ms p(90)=265.28ms p(95)=289.98ms p(99.9)=662.65ms
     iterations.....................: 11645   152.010879/s
     success_rate...................: 100.00% ✓ 11645      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 31302      ✗ 0    
     data_received..................: 925 MB  12 MB/s
     data_sent......................: 12 MB   160 kB/s
     http_req_blocked...............: avg=28.1µs   min=1.17µs   med=2.65µs   max=10.31ms  p(90)=4.38µs   p(95)=5.7µs    p(99.9)=8.25ms  
     http_req_connecting............: avg=24.57µs  min=0s       med=0s       max=10.25ms  p(90)=0s       p(95)=0s       p(99.9)=8.23ms  
     http_req_duration..............: avg=286.29ms min=156.68ms med=296.12ms max=817.02ms p(90)=326.47ms p(95)=462.01ms p(99.9)=715.11ms
       { expected_response:true }...: avg=286.29ms min=156.68ms med=296.12ms max=817.02ms p(90)=326.47ms p(95)=462.01ms p(99.9)=715.11ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10534
     http_req_receiving.............: avg=123.48µs min=25.42µs  med=45.85µs  max=114.18ms p(90)=146.87µs p(95)=406.7µs  p(99.9)=4.84ms  
     http_req_sending...............: avg=127.33µs min=5.54µs   med=11.16µs  max=289.97ms p(90)=91.33µs  p(95)=152.7µs  p(99.9)=8.82ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=286.04ms min=156.62ms med=295.96ms max=807.98ms p(90)=326.25ms p(95)=461.57ms p(99.9)=697.84ms
     http_reqs......................: 10534   137.72948/s
     iteration_duration.............: avg=287.85ms min=156.86ms med=296.61ms max=841.05ms p(90)=326.94ms p(95)=464.44ms p(99.9)=730.99ms
     iterations.....................: 10434   136.422004/s
     success_rate...................: 100.00% ✓ 10434      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 31023      ✗ 0    
     data_received..................: 916 MB  11 MB/s
     data_sent......................: 12 MB   149 kB/s
     http_req_blocked...............: avg=63.99µs  min=1.75µs   med=2.8µs    max=19.89ms  p(90)=4.08µs   p(95)=4.95µs   p(99.9)=14.79ms 
     http_req_connecting............: avg=60.28µs  min=0s       med=0s       max=19.85ms  p(90)=0s       p(95)=0s       p(99.9)=14.77ms 
     http_req_duration..............: avg=289.9ms  min=179.73ms med=290.85ms max=707.01ms p(90)=328.4ms  p(95)=337.27ms p(99.9)=627.38ms
       { expected_response:true }...: avg=289.9ms  min=179.73ms med=290.85ms max=707.01ms p(90)=328.4ms  p(95)=337.27ms p(99.9)=627.38ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10441
     http_req_receiving.............: avg=97.53µs  min=35.58µs  med=51.3µs   max=151.85ms p(90)=99.47µs  p(95)=178.24µs p(99.9)=1.42ms  
     http_req_sending...............: avg=117.28µs min=7.53µs   med=11.05µs  max=234.04ms p(90)=22.47µs  p(95)=127.98µs p(99.9)=4.25ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=289.69ms min=179.63ms med=290.68ms max=702.63ms p(90)=328.11ms p(95)=337.11ms p(99.9)=605.17ms
     http_reqs......................: 10441   128.214059/s
     iteration_duration.............: avg=291.02ms min=179.91ms med=291.5ms  max=737.63ms p(90)=328.73ms p(95)=337.69ms p(99.9)=676.72ms
     iterations.....................: 10341   126.986072/s
     success_rate...................: 100.00% ✓ 10341      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 21138     ✗ 0   
     data_received..................: 628 MB  7.7 MB/s
     data_sent......................: 8.3 MB  102 kB/s
     http_req_blocked...............: avg=43.77µs  min=1.4µs    med=2.98µs   max=11.31ms  p(90)=4.36µs   p(95)=5.09µs   p(99.9)=9.75ms  
     http_req_connecting............: avg=40.34µs  min=0s       med=0s       max=11.27ms  p(90)=0s       p(95)=0s       p(99.9)=9.71ms  
     http_req_duration..............: avg=423.15ms min=210.85ms med=424.84ms max=902.79ms p(90)=451.31ms p(95)=463.83ms p(99.9)=849.55ms
       { expected_response:true }...: avg=423.15ms min=210.85ms med=424.84ms max=902.79ms p(90)=451.31ms p(95)=463.83ms p(99.9)=849.55ms
     http_req_failed................: 0.00%   ✓ 0         ✗ 7146
     http_req_receiving.............: avg=61.94µs  min=30.42µs  med=51µs     max=1.31ms   p(90)=91.53µs  p(95)=106.94µs p(99.9)=639.1µs 
     http_req_sending...............: avg=75.05µs  min=6.52µs   med=12.17µs  max=181.83ms p(90)=18.85µs  p(95)=22.79µs  p(99.9)=1.3ms   
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=423.01ms min=210.75ms med=424.75ms max=901.56ms p(90)=451.2ms  p(95)=463.68ms p(99.9)=848.5ms 
     http_reqs......................: 7146    87.632585/s
     iteration_duration.............: avg=426.62ms min=246.94ms med=425.36ms max=937.67ms p(90)=451.84ms p(95)=464.34ms p(99.9)=911.24ms
     iterations.....................: 7046    86.406269/s
     success_rate...................: 100.00% ✓ 7046      ✗ 0   
     vus............................: 50      min=0       max=50
     vus_max........................: 50      min=50      max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@renovate renovate bot changed the title Update Rust crate serde to v1.0.221 Update Rust crate serde to v1.0.223 Sep 14, 2025
@renovate renovate bot force-pushed the renovate/serde-monorepo branch from 1bc9249 to e478174 Compare September 14, 2025 21:40
@ardatan ardatan merged commit 0368e8b into main Sep 14, 2025
34 checks passed
@ardatan ardatan deleted the renovate/serde-monorepo branch September 14, 2025 23:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant