Skip to content

Conversation

@renovate
Copy link
Contributor

@renovate renovate bot commented Sep 16, 2025

Coming soon: The Renovate bot (GitHub App) will be renamed to Mend. PRs from Renovate will soon appear from 'Mend'. Learn more here.

This PR contains the following updates:

Package Change Age Confidence
capture-website-cli 5.0.0 -> 5.1.0 age confidence

Release Notes

sindresorhus/capture-website-cli (capture-website-cli)

v5.1.0

Compare Source

  • Add --auto-output flag for automatic filename generation 84244c0
  • Add --insecure flag 11f31c1
  • Add --local-storage flag 3f1d402


Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.


  • If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

@renovate renovate bot added the dependencies Pull requests that update a dependency file label Sep 16, 2025
@github-actions
Copy link

💻 Website Preview

The latest changes are available as preview in: https://05e2653e.federation-gateway-benchmark.pages.dev

@github-actions
Copy link

Overview for: constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1820 109683 total, 0 failed avg: 27ms, p95: 48ms
grafbase 1658 100059 total, 0 failed avg: 30ms, p95: 52ms
cosmo 658 39795 total, 0 failed avg: 75ms, p95: 109ms
apollo-router 377 22972 total, 0 failed avg: 130ms, p95: 170ms
hive-gateway 309 18943 total, 0 failed avg: 158ms, p95: 212ms
hive-gateway-bun 292 17827 total, 0 failed avg: 168ms, p95: 288ms
apollo-gateway 122 7483 total, 0 failed avg: 402ms, p95: 472ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 328749      ✗ 0     
     data_received..................: 9.6 GB  160 MB/s
     data_sent......................: 128 MB  2.1 MB/s
     http_req_blocked...............: avg=6.6µs    min=1.14µs  med=2.6µs   max=15.01ms  p(90)=3.84µs   p(95)=4.6µs    p(99.9)=103.83µs
     http_req_connecting............: avg=3.47µs   min=0s      med=0s      max=14.88ms  p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_duration..............: avg=27.14ms  min=1.86ms  med=24.71ms max=423.52ms p(90)=41.65ms  p(95)=48.02ms  p(99.9)=87.73ms 
       { expected_response:true }...: avg=27.14ms  min=1.86ms  med=24.71ms max=423.52ms p(90)=41.65ms  p(95)=48.02ms  p(99.9)=87.73ms 
     http_req_failed................: 0.00%   ✓ 0           ✗ 109683
     http_req_receiving.............: avg=116.04µs min=23.82µs med=44.37µs max=114.91ms p(90)=118.99µs p(95)=349.58µs p(99.9)=11.31ms 
     http_req_sending...............: avg=94.62µs  min=5.21µs  med=10.29µs max=353.55ms p(90)=31.26µs  p(95)=125.44µs p(99.9)=13.34ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=26.93ms  min=1.8ms   med=24.56ms max=390.84ms p(90)=41.28ms  p(95)=47.66ms  p(99.9)=84.24ms 
     http_reqs......................: 109683  1820.328228/s
     iteration_duration.............: avg=27.36ms  min=4.2ms   med=24.91ms max=473.65ms p(90)=41.87ms  p(95)=48.23ms  p(99.9)=88.28ms 
     iterations.....................: 109583  1818.668601/s
     success_rate...................: 100.00% ✓ 109583      ✗ 0     
     vus............................: 50      min=50        max=50  
     vus_max........................: 50      min=50        max=50  

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 299877      ✗ 0     
     data_received..................: 8.8 GB  146 MB/s
     data_sent......................: 116 MB  1.9 MB/s
     http_req_blocked...............: avg=6.49µs   min=1.19µs  med=3µs     max=10.72ms  p(90)=4.24µs   p(95)=5.32µs   p(99.9)=114.66µs
     http_req_connecting............: avg=2.79µs   min=0s      med=0s      max=10.68ms  p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_duration..............: avg=29.75ms  min=2.62ms  med=26.69ms max=470.9ms  p(90)=45.22ms  p(95)=51.89ms  p(99.9)=87.52ms 
       { expected_response:true }...: avg=29.75ms  min=2.62ms  med=26.69ms max=470.9ms  p(90)=45.22ms  p(95)=51.89ms  p(99.9)=87.52ms 
     http_req_failed................: 0.00%   ✓ 0           ✗ 100059
     http_req_receiving.............: avg=146.87µs min=26.79µs med=49.61µs max=105.79ms p(90)=153.98µs p(95)=393.71µs p(99.9)=16.27ms 
     http_req_sending...............: avg=100.73µs min=5.77µs  med=11.97µs max=262.58ms p(90)=39.25µs  p(95)=136.71µs p(99.9)=14.06ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=29.5ms   min=2.54ms  med=26.51ms max=458.32ms p(90)=44.76ms  p(95)=51.39ms  p(99.9)=86.37ms 
     http_reqs......................: 100059  1658.169432/s
     iteration_duration.............: avg=30ms     min=7.06ms  med=26.91ms max=493.87ms p(90)=45.45ms  p(95)=52.13ms  p(99.9)=88.39ms 
     iterations.....................: 99959   1656.512241/s
     success_rate...................: 100.00% ✓ 99959       ✗ 0     
     vus............................: 50      min=50        max=50  
     vus_max........................: 50      min=50        max=50  

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 119085     ✗ 0    
     data_received..................: 3.5 GB  58 MB/s
     data_sent......................: 46 MB   766 kB/s
     http_req_blocked...............: avg=10.86µs  min=1.22µs  med=2.9µs   max=10.89ms  p(90)=4.2µs    p(95)=5µs      p(99.9)=2.57ms  
     http_req_connecting............: avg=6.93µs   min=0s      med=0s      max=10.86ms  p(90)=0s       p(95)=0s       p(99.9)=2.19ms  
     http_req_duration..............: avg=75.14ms  min=2.87ms  med=74.04ms max=533.1ms  p(90)=101.39ms p(95)=109.16ms p(99.9)=306.69ms
       { expected_response:true }...: avg=75.14ms  min=2.87ms  med=74.04ms max=533.1ms  p(90)=101.39ms p(95)=109.16ms p(99.9)=306.69ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 39795
     http_req_receiving.............: avg=162.34µs min=28.38µs med=77.16µs max=385.04ms p(90)=150.12µs p(95)=354.82µs p(99.9)=12.38ms 
     http_req_sending...............: avg=49µs     min=5.58µs  med=11.38µs max=340.08ms p(90)=28.39µs  p(95)=116.68µs p(99.9)=2.49ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=74.93ms  min=2.8ms   med=73.87ms max=517.72ms p(90)=101.18ms p(95)=108.91ms p(99.9)=293.93ms
     http_reqs......................: 39795   658.684406/s
     iteration_duration.............: avg=75.58ms  min=6.19ms  med=74.32ms max=554ms    p(90)=101.66ms p(95)=109.42ms p(99.9)=321.94ms
     iterations.....................: 39695   657.029212/s
     success_rate...................: 100.00% ✓ 39695      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 68616      ✗ 0    
     data_received..................: 2.0 GB  33 MB/s
     data_sent......................: 27 MB   440 kB/s
     http_req_blocked...............: avg=13.55µs  min=1.9µs   med=2.84µs   max=9.47ms   p(90)=4.27µs   p(95)=4.97µs   p(99.9)=4.82ms  
     http_req_connecting............: avg=10.01µs  min=0s      med=0s       max=9.44ms   p(90)=0s       p(95)=0s       p(99.9)=4.8ms   
     http_req_duration..............: avg=130.48ms min=5.88ms  med=129.73ms max=584.23ms p(90)=160.63ms p(95)=169.9ms  p(99.9)=411.78ms
       { expected_response:true }...: avg=130.48ms min=5.88ms  med=129.73ms max=584.23ms p(90)=160.63ms p(95)=169.9ms  p(99.9)=411.78ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 22972
     http_req_receiving.............: avg=88.2µs   min=36.62µs med=53.12µs  max=257.13ms p(90)=103.39µs p(95)=134.5µs  p(99.9)=1.38ms  
     http_req_sending...............: avg=37.6µs   min=7.55µs  med=11.6µs   max=103.98ms p(90)=19.83µs  p(95)=35.45µs  p(99.9)=1.96ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=130.36ms min=5.81ms  med=129.62ms max=567ms    p(90)=160.53ms p(95)=169.79ms p(99.9)=402.53ms
     http_reqs......................: 22972   377.903917/s
     iteration_duration.............: avg=131.3ms  min=28.77ms med=130.04ms max=611ms    p(90)=160.89ms p(95)=170.15ms p(99.9)=431.22ms
     iterations.....................: 22872   376.258854/s
     success_rate...................: 100.00% ✓ 22872      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 56529      ✗ 0    
     data_received..................: 1.7 GB  27 MB/s
     data_sent......................: 22 MB   361 kB/s
     http_req_blocked...............: avg=36.1µs   min=1.28µs  med=2.75µs   max=19.81ms  p(90)=4.48µs   p(95)=5.47µs   p(99.9)=13.04ms 
     http_req_connecting............: avg=31.87µs  min=0s      med=0s       max=19.73ms  p(90)=0s       p(95)=0s       p(99.9)=13ms    
     http_req_duration..............: avg=158.16ms min=6.71ms  med=147.3ms  max=576.17ms p(90)=176.12ms p(95)=211.59ms p(99.9)=512.75ms
       { expected_response:true }...: avg=158.16ms min=6.71ms  med=147.3ms  max=576.17ms p(90)=176.12ms p(95)=211.59ms p(99.9)=512.75ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 18943
     http_req_receiving.............: avg=99.57µs  min=25.73µs med=46.73µs  max=27.77ms  p(90)=108.87µs p(95)=266.25µs p(99.9)=4.2ms   
     http_req_sending...............: avg=90.64µs  min=5.74µs  med=11.3µs   max=345.95ms p(90)=33.14µs  p(95)=128.42µs p(99.9)=4.01ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=157.97ms min=6.66ms  med=147.17ms max=575.48ms p(90)=175.92ms p(95)=210.56ms p(99.9)=512.58ms
     http_reqs......................: 18943   309.986174/s
     iteration_duration.............: avg=159.29ms min=34.9ms  med=147.65ms max=623.22ms p(90)=176.46ms p(95)=213.48ms p(99.9)=530.35ms
     iterations.....................: 18843   308.349759/s
     success_rate...................: 100.00% ✓ 18843      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 53181      ✗ 0    
     data_received..................: 1.6 GB  26 MB/s
     data_sent......................: 21 MB   340 kB/s
     http_req_blocked...............: avg=19.07µs  min=1.19µs  med=2.81µs   max=11ms     p(90)=4.68µs   p(95)=5.91µs   p(99.9)=6.95ms  
     http_req_connecting............: avg=15.13µs  min=0s      med=0s       max=10.96ms  p(90)=0s       p(95)=0s       p(99.9)=6.91ms  
     http_req_duration..............: avg=168.03ms min=7.39ms  med=182.02ms max=670.94ms p(90)=242.95ms p(95)=288ms    p(99.9)=545.62ms
       { expected_response:true }...: avg=168.03ms min=7.39ms  med=182.02ms max=670.94ms p(90)=242.95ms p(95)=288ms    p(99.9)=545.62ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 17827
     http_req_receiving.............: avg=92.24µs  min=26.65µs med=48.29µs  max=12.37ms  p(90)=107.9µs  p(95)=193.94µs p(99.9)=3.64ms  
     http_req_sending...............: avg=73.98µs  min=5.47µs  med=11.29µs  max=239.79ms p(90)=30.59µs  p(95)=119.18µs p(99.9)=4.99ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=167.86ms min=7.33ms  med=181.71ms max=669.7ms  p(90)=242.82ms p(95)=287.34ms p(99.9)=545.53ms
     http_reqs......................: 17827   292.03615/s
     iteration_duration.............: avg=169.31ms min=40.38ms med=183.91ms max=692.37ms p(90)=243.37ms p(95)=289ms    p(99.9)=571.17ms
     iterations.....................: 17727   290.397982/s
     success_rate...................: 100.00% ✓ 17727      ✗ 0    
     vus............................: 36      min=36       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 22149      ✗ 0   
     data_received..................: 657 MB  11 MB/s
     data_sent......................: 8.7 MB  143 kB/s
     http_req_blocked...............: avg=88.97µs  min=1.36µs   med=3.02µs   max=20.49ms  p(90)=4.35µs   p(95)=5.1µs    p(99.9)=19ms    
     http_req_connecting............: avg=83.14µs  min=0s       med=0s       max=20.3ms   p(90)=0s       p(95)=0s       p(99.9)=18.89ms 
     http_req_duration..............: avg=401.5ms  min=7.29ms   med=401.13ms max=778.67ms p(90)=454.54ms p(95)=472.18ms p(99.9)=722.62ms
       { expected_response:true }...: avg=401.5ms  min=7.29ms   med=401.13ms max=778.67ms p(90)=454.54ms p(95)=472.18ms p(99.9)=722.62ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 7483
     http_req_receiving.............: avg=68.38µs  min=27.55µs  med=50.79µs  max=55.18ms  p(90)=90.73µs  p(95)=105.63µs p(99.9)=388.37µs
     http_req_sending...............: avg=91.39µs  min=6.21µs   med=12.13µs  max=120.75ms p(90)=17.98µs  p(95)=22.35µs  p(99.9)=6.61ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=401.34ms min=7.21ms   med=401.04ms max=777.99ms p(90)=454.46ms p(95)=472.11ms p(99.9)=721.97ms
     http_reqs......................: 7483    122.4919/s
     iteration_duration.............: avg=407.28ms min=137.47ms med=401.85ms max=827.62ms p(90)=455.31ms p(95)=472.76ms p(99.9)=755.01ms
     iterations.....................: 7383    120.854964/s
     success_rate...................: 100.00% ✓ 7383       ✗ 0   
     vus............................: 24      min=24       max=50
     vus_max........................: 50      min=50       max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@github-actions
Copy link

Overview for: ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 500 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 2000 124449 total, 0 failed avg: 112ms, p95: 269ms
grafbase 1714 108309 total, 0 failed avg: 129ms, p95: 309ms
cosmo 697 44502 total, 0 failed avg: 316ms, p95: 693ms
apollo-router 393 26404 total, 0 failed avg: 534ms, p95: 1209ms ❌ 20 unexpected GraphQL errors, non-compatible response structure (1)
hive-gateway-bun 270 18588 total, 0 failed avg: 755ms, p95: 1598ms
hive-gateway 231 16242 total, 0 failed avg: 858ms, p95: 1854ms
apollo-gateway 155 10668 total, 0 failed avg: 1220ms, p95: 2581ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 370347      ✗ 0     
     data_received..................: 11 GB   176 MB/s
     data_sent......................: 145 MB  2.3 MB/s
     http_req_blocked...............: avg=373.9µs  min=1.12µs  med=2.46µs   max=307.23ms p(90)=3.82µs   p(95)=4.65µs   p(99.9)=140.03ms
     http_req_connecting............: avg=370.35µs min=0s      med=0s       max=307.17ms p(90)=0s       p(95)=0s       p(99.9)=139.9ms 
     http_req_duration..............: avg=111.94ms min=1.64ms  med=101.6ms  max=394.86ms p(90)=228.26ms p(95)=269.11ms p(99.9)=359.23ms
       { expected_response:true }...: avg=111.94ms min=1.64ms  med=101.6ms  max=394.86ms p(90)=228.26ms p(95)=269.11ms p(99.9)=359.23ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 124449
     http_req_receiving.............: avg=456.01µs min=21.79µs med=40.45µs  max=154.8ms  p(90)=169.48µs p(95)=376.05µs p(99.9)=66.89ms 
     http_req_sending...............: avg=328.5µs  min=5.16µs  med=9.8µs    max=145.01ms p(90)=27.44µs  p(95)=121.76µs p(99.9)=60.29ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=111.15ms min=1.6ms   med=100.97ms max=373.48ms p(90)=226.51ms p(95)=267.44ms p(99.9)=358.07ms
     http_reqs......................: 124449  2000.604903/s
     iteration_duration.............: avg=113.46ms min=1.77ms  med=102.81ms max=692.05ms p(90)=230.38ms p(95)=271.26ms p(99.9)=369.23ms
     iterations.....................: 123449  1984.529203/s
     success_rate...................: 100.00% ✓ 123449      ✗ 0     
     vus............................: 70      min=0         max=496 
     vus_max........................: 500     min=500       max=500 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 321927      ✗ 0     
     data_received..................: 9.5 GB  151 MB/s
     data_sent......................: 126 MB  2.0 MB/s
     http_req_blocked...............: avg=488.86µs min=1.11µs  med=2.86µs   max=345.39ms p(90)=4.17µs   p(95)=5.21µs   p(99.9)=167.9ms 
     http_req_connecting............: avg=484.72µs min=0s      med=0s       max=345.31ms p(90)=0s       p(95)=0s       p(99.9)=167.77ms
     http_req_duration..............: avg=128.58ms min=2.48ms  med=118ms    max=446.19ms p(90)=259.61ms p(95)=308.5ms  p(99.9)=397.59ms
       { expected_response:true }...: avg=128.58ms min=2.48ms  med=118ms    max=446.19ms p(90)=259.61ms p(95)=308.5ms  p(99.9)=397.59ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 108309
     http_req_receiving.............: avg=531.77µs min=21.39µs med=45.62µs  max=159.2ms  p(90)=151.07µs p(95)=408.47µs p(99.9)=79.61ms 
     http_req_sending...............: avg=434.51µs min=5.08µs  med=11.45µs  max=138.89ms p(90)=30.88µs  p(95)=131.39µs p(99.9)=71.6ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=127.61ms min=2.44ms  med=117.08ms max=422.86ms p(90)=257.66ms p(95)=306.57ms p(99.9)=394.89ms
     http_reqs......................: 108309  1714.836252/s
     iteration_duration.............: avg=130.58ms min=2.68ms  med=119.71ms max=795.2ms  p(90)=262.49ms p(95)=311.03ms p(99.9)=446.08ms
     iterations.....................: 107309  1699.003438/s
     success_rate...................: 100.00% ✓ 107309      ✗ 0     
     vus............................: 65      min=0         max=496 
     vus_max........................: 500     min=500       max=500 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 130506     ✗ 0    
     data_received..................: 3.9 GB  61 MB/s
     data_sent......................: 52 MB   812 kB/s
     http_req_blocked...............: avg=95.93µs  min=1.14µs med=2.81µs   max=143.64ms p(90)=4.3µs    p(95)=5.93µs   p(99.9)=28.75ms 
     http_req_connecting............: avg=90.99µs  min=0s     med=0s       max=143.58ms p(90)=0s       p(95)=0s       p(99.9)=28.64ms 
     http_req_duration..............: avg=315.59ms min=2.89ms med=301.34ms max=1.18s    p(90)=609.45ms p(95)=693.28ms p(99.9)=1.05s   
       { expected_response:true }...: avg=315.59ms min=2.89ms med=301.34ms max=1.18s    p(90)=609.45ms p(95)=693.28ms p(99.9)=1.05s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 44502
     http_req_receiving.............: avg=621.79µs min=27.2µs med=60.82µs  max=156.53ms p(90)=198.3µs  p(95)=502.43µs p(99.9)=102.23ms
     http_req_sending...............: avg=153.49µs min=5.72µs med=11.27µs  max=125.82ms p(90)=30.73µs  p(95)=127.97µs p(99.9)=34.18ms 
     http_req_tls_handshaking.......: avg=0s       min=0s     med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=314.81ms min=2.8ms  med=300.68ms max=1.18s    p(90)=608.34ms p(95)=692.52ms p(99.9)=1.05s   
     http_reqs......................: 44502   697.101238/s
     iteration_duration.............: avg=323.29ms min=3.16ms med=309.37ms max=1.18s    p(90)=612.28ms p(95)=696.29ms p(99.9)=1.05s   
     iterations.....................: 43502   681.436746/s
     success_rate...................: 100.00% ✓ 43502      ✗ 0    
     vus............................: 53      min=0        max=499
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  99% — ✓ 25384 / ✗ 20
     ✗ valid response structure
      ↳  99% — ✓ 25403 / ✗ 1

     checks.........................: 99.97% ✓ 76191      ✗ 21   
     data_received..................: 2.3 GB 35 MB/s
     data_sent......................: 31 MB  459 kB/s
     http_req_blocked...............: avg=76.08µs  min=1.44µs  med=2.99µs   max=82.37ms p(90)=4.92µs   p(95)=7.4µs    p(99.9)=20.92ms
     http_req_connecting............: avg=70.98µs  min=0s      med=0s       max=82.33ms p(90)=0s       p(95)=0s       p(99.9)=20.86ms
     http_req_duration..............: avg=534.01ms min=6.17ms  med=493.3ms  max=1.97s   p(90)=1.07s    p(95)=1.2s     p(99.9)=1.76s  
       { expected_response:true }...: avg=534.01ms min=6.17ms  med=493.3ms  max=1.97s   p(90)=1.07s    p(95)=1.2s     p(99.9)=1.76s  
     http_req_failed................: 0.00%  ✓ 0          ✗ 26404
     http_req_receiving.............: avg=114.06µs min=27.72µs med=53.3µs   max=94.78ms p(90)=106.92µs p(95)=229.56µs p(99.9)=9.65ms 
     http_req_sending...............: avg=94.46µs  min=6.41µs  med=11.74µs  max=56.64ms p(90)=30.32µs  p(95)=122.04µs p(99.9)=16.05ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s      p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=533.8ms  min=6.12ms  med=493ms    max=1.97s   p(90)=1.07s    p(95)=1.2s     p(99.9)=1.76s  
     http_reqs......................: 26404  393.86328/s
     iteration_duration.............: avg=555.41ms min=6.43ms  med=518.68ms max=1.97s   p(90)=1.08s    p(95)=1.21s    p(99.9)=1.76s  
     iterations.....................: 25404  378.946477/s
     success_rate...................: 99.92% ✓ 25384      ✗ 20   
     vus............................: 67     min=0        max=497
     vus_max........................: 500    min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 52764      ✗ 0    
     data_received..................: 1.6 GB  24 MB/s
     data_sent......................: 22 MB   316 kB/s
     http_req_blocked...............: avg=84.25µs  min=1.23µs  med=2.73µs   max=111.92ms p(90)=4.65µs  p(95)=7.8µs    p(99.9)=17.9ms 
     http_req_connecting............: avg=77.38µs  min=0s      med=0s       max=111.74ms p(90)=0s      p(95)=0s       p(99.9)=17.33ms
     http_req_duration..............: avg=754.67ms min=6.52ms  med=702.49ms max=4.93s    p(90)=1.47s   p(95)=1.59s    p(99.9)=4.02s  
       { expected_response:true }...: avg=754.67ms min=6.52ms  med=702.49ms max=4.93s    p(90)=1.47s   p(95)=1.59s    p(99.9)=4.02s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 18588
     http_req_receiving.............: avg=143.74µs min=25.76µs med=43.83µs  max=79.27ms  p(90)=92.02µs p(95)=171.84µs p(99.9)=18.2ms 
     http_req_sending...............: avg=138.18µs min=5.8µs   med=10.81µs  max=75.94ms  p(90)=31.14µs p(95)=118.49µs p(99.9)=22.63ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=754.38ms min=6.46ms  med=702.27ms max=4.92s    p(90)=1.47s   p(95)=1.59s    p(99.9)=4.02s  
     http_reqs......................: 18588   270.055123/s
     iteration_duration.............: avg=797.78ms min=7.6ms   med=764.79ms max=4.96s    p(90)=1.49s   p(95)=1.6s     p(99.9)=4.1s   
     iterations.....................: 17588   255.526657/s
     success_rate...................: 100.00% ✓ 17588      ✗ 0    
     vus............................: 56      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 45726      ✗ 0    
     data_received..................: 1.4 GB  20 MB/s
     data_sent......................: 19 MB   272 kB/s
     http_req_blocked...............: avg=146.17µs min=1.32µs  med=2.9µs    max=144.01ms p(90)=5.87µs   p(95)=9.82µs   p(99.9)=37.28ms
     http_req_connecting............: avg=136.92µs min=0s      med=0s       max=143.93ms p(90)=0s       p(95)=0s       p(99.9)=37.01ms
     http_req_duration..............: avg=858.2ms  min=6.68ms  med=786.57ms max=6.42s    p(90)=1.66s    p(95)=1.85s    p(99.9)=5.32s  
       { expected_response:true }...: avg=858.2ms  min=6.68ms  med=786.57ms max=6.42s    p(90)=1.66s    p(95)=1.85s    p(99.9)=5.32s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 16242
     http_req_receiving.............: avg=216.51µs min=30.25µs med=54.2µs   max=131.08ms p(90)=140.17µs p(95)=403.28µs p(99.9)=27.41ms
     http_req_sending...............: avg=215.32µs min=6.46µs  med=11.95µs  max=104.63ms p(90)=40.7µs   p(95)=163.31µs p(99.9)=39.64ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=857.77ms min=6.61ms  med=786.48ms max=6.42s    p(90)=1.66s    p(95)=1.85s    p(99.9)=5.32s  
     http_reqs......................: 16242   231.679991/s
     iteration_duration.............: avg=914.88ms min=7.17ms  med=875.62ms max=6.57s    p(90)=1.69s    p(95)=1.9s     p(99.9)=5.47s  
     iterations.....................: 15242   217.415739/s
     success_rate...................: 100.00% ✓ 15242      ✗ 0    
     vus............................: 74      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 29004      ✗ 0    
     data_received..................: 937 MB  14 MB/s
     data_sent......................: 13 MB   185 kB/s
     http_req_blocked...............: avg=42.19µs min=1.36µs  med=3.57µs  max=37.6ms  p(90)=6.08µs   p(95)=12.05µs  p(99.9)=9.75ms 
     http_req_connecting............: avg=35.13µs min=0s      med=0s      max=37.53ms p(90)=0s       p(95)=0s       p(99.9)=9.69ms 
     http_req_duration..............: avg=1.21s   min=7.42ms  med=1.18s   max=15.52s  p(90)=2.2s     p(95)=2.58s    p(99.9)=14.3s  
       { expected_response:true }...: avg=1.21s   min=7.42ms  med=1.18s   max=15.52s  p(90)=2.2s     p(95)=2.58s    p(99.9)=14.3s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 10668
     http_req_receiving.............: avg=80.65µs min=28.78µs med=59.54µs max=19.98ms p(90)=109.15µs p(95)=134.71µs p(99.9)=1.3ms  
     http_req_sending...............: avg=58.05µs min=6.11µs  med=13.56µs max=31.47ms p(90)=31.52µs  p(95)=47.92µs  p(99.9)=11.32ms
     http_req_tls_handshaking.......: avg=0s      min=0s      med=0s      max=0s      p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=1.21s   min=7.37ms  med=1.18s   max=15.52s  p(90)=2.2s     p(95)=2.58s    p(99.9)=14.3s  
     http_reqs......................: 10668   155.082849/s
     iteration_duration.............: avg=1.34s   min=7.99ms  med=1.32s   max=15.53s  p(90)=2.25s    p(95)=2.62s    p(99.9)=14.42s 
     iterations.....................: 9668    140.545649/s
     success_rate...................: 100.00% ✓ 9668       ✗ 0    
     vus............................: 115     min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@github-actions
Copy link

Overview for: constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 173 14091 total, 0 failed avg: 215ms, p95: 225ms
hive-router 170 13791 total, 0 failed avg: 219ms, p95: 229ms
hive-gateway 166 12755 total, 0 failed avg: 237ms, p95: 263ms
cosmo 165 13449 total, 0 failed avg: 225ms, p95: 250ms
hive-gateway-bun 158 12173 total, 0 failed avg: 248ms, p95: 275ms
apollo-router 142 11599 total, 0 failed avg: 261ms, p95: 304ms ❌ 1 unexpected GraphQL errors
apollo-gateway 122 10025 total, 0 failed avg: 302ms, p95: 331ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41973      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   202 kB/s
     http_req_blocked...............: avg=40.7µs   min=1.16µs   med=1.95µs   max=21.12ms  p(90)=3.57µs   p(95)=5.31µs   p(99.9)=12.88ms 
     http_req_connecting............: avg=37.93µs  min=0s       med=0s       max=21.08ms  p(90)=0s       p(95)=0s       p(99.9)=12.84ms 
     http_req_duration..............: avg=214.82ms min=161.45ms med=214.06ms max=574.72ms p(90)=222.79ms p(95)=225.47ms p(99.9)=483.25ms
       { expected_response:true }...: avg=214.82ms min=161.45ms med=214.06ms max=574.72ms p(90)=222.79ms p(95)=225.47ms p(99.9)=483.25ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 14091
     http_req_receiving.............: avg=84.11µs  min=25.57µs  med=45.73µs  max=20.85ms  p(90)=95.82µs  p(95)=267.9µs  p(99.9)=4.83ms  
     http_req_sending...............: avg=125.17µs min=5.42µs   med=8.41µs   max=328.34ms p(90)=26.94µs  p(95)=96.88µs  p(99.9)=6.67ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=214.61ms min=161.39ms med=213.97ms max=569.79ms p(90)=222.61ms p(95)=225.25ms p(99.9)=462.94ms
     http_reqs......................: 14091   173.860986/s
     iteration_duration.............: avg=215.08ms min=161.65ms med=214.27ms max=591.12ms p(90)=222.99ms p(95)=225.66ms p(99.9)=504.12ms
     iterations.....................: 13991   172.627142/s
     success_rate...................: 100.00% ✓ 13991      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41073      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   198 kB/s
     http_req_blocked...............: avg=18.63µs  min=1.19µs   med=2.03µs   max=8.73ms   p(90)=3.06µs   p(95)=4.38µs   p(99.9)=6.44ms  
     http_req_connecting............: avg=16.04µs  min=0s       med=0s       max=8.69ms   p(90)=0s       p(95)=0s       p(99.9)=6.42ms  
     http_req_duration..............: avg=219.28ms min=159.28ms med=218.38ms max=601.14ms p(90)=226.59ms p(95)=229.2ms  p(99.9)=509.33ms
       { expected_response:true }...: avg=219.28ms min=159.28ms med=218.38ms max=601.14ms p(90)=226.59ms p(95)=229.2ms  p(99.9)=509.33ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13791
     http_req_receiving.............: avg=71.99µs  min=24.42µs  med=40.82µs  max=11.06ms  p(90)=85.28µs  p(95)=251.21µs p(99.9)=2.2ms   
     http_req_sending...............: avg=148.1µs  min=5.39µs   med=8.57µs   max=370.63ms p(90)=28.96µs  p(95)=92.74µs  p(99.9)=4.62ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=219.06ms min=159.22ms med=218.3ms  max=600.49ms p(90)=226.44ms p(95)=228.98ms p(99.9)=493.38ms
     http_reqs......................: 13791   170.440332/s
     iteration_duration.............: avg=219.59ms min=159.47ms med=218.59ms max=619.85ms p(90)=226.79ms p(95)=229.39ms p(99.9)=523.31ms
     iterations.....................: 13691   169.204451/s
     success_rate...................: 100.00% ✓ 13691      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 37965      ✗ 0    
     data_received..................: 1.1 GB  15 MB/s
     data_sent......................: 15 MB   193 kB/s
     http_req_blocked...............: avg=22.03µs  min=1.16µs   med=2.52µs   max=9.76ms   p(90)=4.14µs   p(95)=5.17µs   p(99.9)=7.11ms  
     http_req_connecting............: avg=18.74µs  min=0s       med=0s       max=9.72ms   p(90)=0s       p(95)=0s       p(99.9)=7.09ms  
     http_req_duration..............: avg=236.59ms min=160.76ms med=229.24ms max=713.24ms p(90)=250.47ms p(95)=263.38ms p(99.9)=577.61ms
       { expected_response:true }...: avg=236.59ms min=160.76ms med=229.24ms max=713.24ms p(90)=250.47ms p(95)=263.38ms p(99.9)=577.61ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12755
     http_req_receiving.............: avg=88.41µs  min=25.36µs  med=44.35µs  max=11.75ms  p(90)=99.02µs  p(95)=218.24µs p(99.9)=4.32ms  
     http_req_sending...............: avg=65.77µs  min=5.5µs    med=10.55µs  max=160.17ms p(90)=32.35µs  p(95)=116.83µs p(99.9)=3.85ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=236.44ms min=152.46ms med=229.11ms max=712.41ms p(90)=250.28ms p(95)=263.19ms p(99.9)=576.24ms
     http_reqs......................: 12755   166.320523/s
     iteration_duration.............: avg=237.49ms min=169.02ms med=229.56ms max=734.7ms  p(90)=250.77ms p(95)=263.83ms p(99.9)=611.93ms
     iterations.....................: 12655   165.01656/s
     success_rate...................: 100.00% ✓ 12655      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40047      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   193 kB/s
     http_req_blocked...............: avg=21.14µs  min=1.28µs   med=2.68µs   max=9.29ms   p(90)=3.85µs   p(95)=4.8µs    p(99.9)=6.95ms  
     http_req_connecting............: avg=17.69µs  min=0s       med=0s       max=9.25ms   p(90)=0s       p(95)=0s       p(99.9)=6.93ms  
     http_req_duration..............: avg=224.71ms min=161.45ms med=223.56ms max=623.9ms  p(90)=243.79ms p(95)=249.55ms p(99.9)=531.08ms
       { expected_response:true }...: avg=224.71ms min=161.45ms med=223.56ms max=623.9ms  p(90)=243.79ms p(95)=249.55ms p(99.9)=531.08ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13449
     http_req_receiving.............: avg=476.8µs  min=29.54µs  med=64.49µs  max=35.54ms  p(90)=370.29µs p(95)=802.82µs p(99.9)=27.08ms 
     http_req_sending...............: avg=128.32µs min=6.09µs   med=11.04µs  max=364.69ms p(90)=31.81µs  p(95)=119.65µs p(99.9)=4.13ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=224.11ms min=161.31ms med=223.01ms max=622.91ms p(90)=243.22ms p(95)=248.9ms  p(99.9)=513.42ms
     http_reqs......................: 13449   165.971976/s
     iteration_duration.............: avg=225.08ms min=161.69ms med=223.93ms max=638.68ms p(90)=244.1ms  p(95)=249.79ms p(99.9)=537.7ms 
     iterations.....................: 13349   164.737892/s
     success_rate...................: 100.00% ✓ 13349      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 36219      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 14 MB   185 kB/s
     http_req_blocked...............: avg=30.25µs  min=1.22µs   med=2.82µs   max=12.19ms  p(90)=4.65µs   p(95)=6.23µs   p(99.9)=9.59ms  
     http_req_connecting............: avg=26.22µs  min=0s       med=0s       max=12.15ms  p(90)=0s       p(95)=0s       p(99.9)=9.55ms  
     http_req_duration..............: avg=247.96ms min=160.66ms med=239.56ms max=838.57ms p(90)=261.98ms p(95)=274.62ms p(99.9)=836.32ms
       { expected_response:true }...: avg=247.96ms min=160.66ms med=239.56ms max=838.57ms p(90)=261.98ms p(95)=274.62ms p(99.9)=836.32ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12173
     http_req_receiving.............: avg=98.56µs  min=27.2µs   med=50.45µs  max=50.43ms  p(90)=107.03µs p(95)=190.05µs p(99.9)=3.65ms  
     http_req_sending...............: avg=93.29µs  min=5.78µs   med=11.46µs  max=140.28ms p(90)=33.09µs  p(95)=124.77µs p(99.9)=5.48ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=247.77ms min=160.52ms med=239.43ms max=838.51ms p(90)=261.84ms p(95)=274.25ms p(99.9)=836.27ms
     http_reqs......................: 12173   158.8628/s
     iteration_duration.............: avg=249.02ms min=168.95ms med=239.91ms max=838.77ms p(90)=262.32ms p(95)=274.95ms p(99.9)=836.58ms
     iterations.....................: 12073   157.557758/s
     success_rate...................: 100.00% ✓ 12073      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  99% — ✓ 11498 / ✗ 1
     ✓ valid response structure

     checks.........................: 99.99% ✓ 34496      ✗ 1    
     data_received..................: 1.0 GB 13 MB/s
     data_sent......................: 14 MB  166 kB/s
     http_req_blocked...............: avg=57.95µs  min=1.36µs   med=2.72µs   max=17.11ms  p(90)=4.12µs   p(95)=4.94µs   p(99.9)=14.58ms 
     http_req_connecting............: avg=53.78µs  min=0s       med=0s       max=16.95ms  p(90)=0s       p(95)=0s       p(99.9)=14.42ms 
     http_req_duration..............: avg=260.61ms min=177.08ms med=257.28ms max=689.88ms p(90)=294.95ms p(95)=303.67ms p(99.9)=579.6ms 
       { expected_response:true }...: avg=260.61ms min=177.08ms med=257.28ms max=689.88ms p(90)=294.95ms p(95)=303.67ms p(99.9)=579.6ms 
     http_req_failed................: 0.00%  ✓ 0          ✗ 11599
     http_req_receiving.............: avg=126.32µs min=33.51µs  med=51.56µs  max=137.57ms p(90)=149.6µs  p(95)=425.64µs p(99.9)=4.29ms  
     http_req_sending...............: avg=92.18µs  min=6.46µs   med=11.18µs  max=219.27ms p(90)=35.32µs  p(95)=133.44µs p(99.9)=3.75ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=260.39ms min=177.02ms med=257.14ms max=679.45ms p(90)=294.69ms p(95)=303.44ms p(99.9)=570.69ms
     http_reqs......................: 11599  142.452033/s
     iteration_duration.............: avg=261.4ms  min=177.24ms med=257.86ms max=705.39ms p(90)=295.28ms p(95)=304.04ms p(99.9)=630.05ms
     iterations.....................: 11499  141.223892/s
     success_rate...................: 99.99% ✓ 11498      ✗ 1    
     vus............................: 50     min=0        max=50 
     vus_max........................: 50     min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 29775      ✗ 0    
     data_received..................: 881 MB  11 MB/s
     data_sent......................: 12 MB   143 kB/s
     http_req_blocked...............: avg=31.28µs  min=1.35µs   med=3.82µs   max=10.6ms   p(90)=5.91µs   p(95)=7.02µs   p(99.9)=8.47ms  
     http_req_connecting............: avg=25.58µs  min=0s       med=0s       max=10.56ms  p(90)=0s       p(95)=0s       p(99.9)=8.44ms  
     http_req_duration..............: avg=301.54ms min=210.41ms med=299.98ms max=803.22ms p(90)=323.02ms p(95)=330.85ms p(99.9)=700.14ms
       { expected_response:true }...: avg=301.54ms min=210.41ms med=299.98ms max=803.22ms p(90)=323.02ms p(95)=330.85ms p(99.9)=700.14ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10025
     http_req_receiving.............: avg=107.35µs min=31.74µs  med=72.62µs  max=205.28ms p(90)=121.38µs p(95)=150.44µs p(99.9)=1.7ms   
     http_req_sending...............: avg=125.74µs min=6.37µs   med=15.15µs  max=287.32ms p(90)=30.99µs  p(95)=44.14µs  p(99.9)=4.77ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=301.3ms  min=210.33ms med=299.86ms max=783.02ms p(90)=322.91ms p(95)=330.65ms p(99.9)=689.63ms
     http_reqs......................: 10025   122.832096/s
     iteration_duration.............: avg=302.89ms min=222.88ms med=300.46ms max=833.75ms p(90)=323.48ms p(95)=331.23ms p(99.9)=748.83ms
     iterations.....................: 9925    121.606838/s
     success_rate...................: 100.00% ✓ 9925       ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@github-actions
Copy link

Overview for: constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 172 13982 total, 0 failed avg: 216ms, p95: 227ms
hive-router 166 13484 total, 0 failed avg: 224ms, p95: 234ms
cosmo 157 12743 total, 0 failed avg: 237ms, p95: 263ms
hive-gateway-bun 150 11522 total, 0 failed avg: 262ms, p95: 363ms
hive-gateway 147 11309 total, 0 failed avg: 267ms, p95: 406ms
apollo-router 124 10109 total, 0 failed avg: 299ms, p95: 348ms
apollo-gateway 86 7085 total, 0 failed avg: 427ms, p95: 469ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41646      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   201 kB/s
     http_req_blocked...............: avg=42.33µs  min=1.21µs   med=2.04µs   max=16.66ms  p(90)=3.47µs   p(95)=5.02µs   p(99.9)=14.03ms 
     http_req_connecting............: avg=39.32µs  min=0s       med=0s       max=16.54ms  p(90)=0s       p(95)=0s       p(99.9)=14.01ms 
     http_req_duration..............: avg=215.87ms min=159.08ms med=215.11ms max=569.14ms p(90)=224.43ms p(95)=227.17ms p(99.9)=491.27ms
       { expected_response:true }...: avg=215.87ms min=159.08ms med=215.11ms max=569.14ms p(90)=224.43ms p(95)=227.17ms p(99.9)=491.27ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13982
     http_req_receiving.............: avg=83.64µs  min=24.85µs  med=45.09µs  max=19.12ms  p(90)=91.67µs  p(95)=267.63µs p(99.9)=5.81ms  
     http_req_sending...............: avg=140.05µs min=5.67µs   med=8.8µs    max=351.69ms p(90)=31.86µs  p(95)=94.8µs   p(99.9)=6.74ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=215.65ms min=159.03ms med=215.01ms max=568.88ms p(90)=224.27ms p(95)=226.97ms p(99.9)=464.45ms
     http_reqs......................: 13982   172.895024/s
     iteration_duration.............: avg=216.17ms min=159.28ms med=215.34ms max=599.88ms p(90)=224.63ms p(95)=227.36ms p(99.9)=519.17ms
     iterations.....................: 13882   171.65847/s
     success_rate...................: 100.00% ✓ 13882      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40152      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   194 kB/s
     http_req_blocked...............: avg=44.47µs  min=1.2µs    med=2.35µs   max=15.12ms  p(90)=3.5µs    p(95)=4.82µs   p(99.9)=13.24ms 
     http_req_connecting............: avg=41.45µs  min=0s       med=0s       max=14.97ms  p(90)=0s       p(95)=0s       p(99.9)=13.09ms 
     http_req_duration..............: avg=223.85ms min=123.89ms med=223.24ms max=604.3ms  p(90)=231.34ms p(95)=233.71ms p(99.9)=513.08ms
       { expected_response:true }...: avg=223.85ms min=123.89ms med=223.24ms max=604.3ms  p(90)=231.34ms p(95)=233.71ms p(99.9)=513.08ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13484
     http_req_receiving.............: avg=78.33µs  min=25.86µs  med=43.67µs  max=12.39ms  p(90)=93.96µs  p(95)=272.19µs p(99.9)=1.39ms  
     http_req_sending...............: avg=151.55µs min=5.57µs   med=9.65µs   max=374.41ms p(90)=30.79µs  p(95)=98.19µs  p(99.9)=7.02ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=223.62ms min=123.84ms med=223.14ms max=601.29ms p(90)=231.17ms p(95)=233.53ms p(99.9)=489.04ms
     http_reqs......................: 13484   166.72274/s
     iteration_duration.............: avg=224.24ms min=124.02ms med=223.47ms max=617.94ms p(90)=231.52ms p(95)=233.92ms p(99.9)=542.12ms
     iterations.....................: 13384   165.486291/s
     success_rate...................: 100.00% ✓ 13384      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 37929      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 15 MB   183 kB/s
     http_req_blocked...............: avg=22.48µs  min=1.5µs    med=2.63µs   max=9.71ms   p(90)=3.84µs   p(95)=4.84µs   p(99.9)=7.35ms  
     http_req_connecting............: avg=19.21µs  min=0s       med=0s       max=9.68ms   p(90)=0s       p(95)=0s       p(99.9)=7.33ms  
     http_req_duration..............: avg=237.22ms min=132.37ms med=236.25ms max=663.03ms p(90)=256.96ms p(95)=262.87ms p(99.9)=559.58ms
       { expected_response:true }...: avg=237.22ms min=132.37ms med=236.25ms max=663.03ms p(90)=256.96ms p(95)=262.87ms p(99.9)=559.58ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12743
     http_req_receiving.............: avg=318.05µs min=31.39µs  med=62.39µs  max=124.06ms p(90)=202.35µs p(95)=464.65µs p(99.9)=27.54ms 
     http_req_sending...............: avg=98.28µs  min=6.6µs    med=10.82µs  max=243.28ms p(90)=29.12µs  p(95)=118.04µs p(99.9)=3.66ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=236.8ms  min=128.35ms med=235.98ms max=661.59ms p(90)=256.51ms p(95)=262.19ms p(99.9)=558.05ms
     http_reqs......................: 12743   157.071535/s
     iteration_duration.............: avg=237.77ms min=132.69ms med=236.61ms max=689.51ms p(90)=257.26ms p(95)=263.13ms p(99.9)=580.44ms
     iterations.....................: 12643   155.838925/s
     success_rate...................: 100.00% ✓ 12643      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 34266      ✗ 0    
     data_received..................: 1.0 GB  13 MB/s
     data_sent......................: 13 MB   175 kB/s
     http_req_blocked...............: avg=28.13µs  min=1.16µs   med=2.56µs   max=11.45ms  p(90)=4.06µs   p(95)=5.24µs   p(99.9)=9ms     
     http_req_connecting............: avg=24.74µs  min=0s       med=0s       max=11.42ms  p(90)=0s       p(95)=0s       p(99.9)=8.96ms  
     http_req_duration..............: avg=261.76ms min=160.3ms  med=258ms    max=698.65ms p(90)=281.72ms p(95)=363.45ms p(99.9)=612.67ms
       { expected_response:true }...: avg=261.76ms min=160.3ms  med=258ms    max=698.65ms p(90)=281.72ms p(95)=363.45ms p(99.9)=612.67ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11522
     http_req_receiving.............: avg=103.5µs  min=25.53µs  med=47.51µs  max=138.46ms p(90)=118.07µs p(95)=322.63µs p(99.9)=2.23ms  
     http_req_sending...............: avg=125.28µs min=5.59µs   med=10.63µs  max=361.9ms  p(90)=33.99µs  p(95)=129.79µs p(99.9)=6.01ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=261.53ms min=160.21ms med=257.86ms max=697.89ms p(90)=281.35ms p(95)=361.05ms p(99.9)=587.14ms
     http_reqs......................: 11522   150.800341/s
     iteration_duration.............: avg=262.96ms min=170.73ms med=258.36ms max=729.18ms p(90)=282.17ms p(95)=365.58ms p(99.9)=647.02ms
     iterations.....................: 11422   149.491538/s
     success_rate...................: 100.00% ✓ 11422      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 33627      ✗ 0    
     data_received..................: 993 MB  13 MB/s
     data_sent......................: 13 MB   172 kB/s
     http_req_blocked...............: avg=29.88µs  min=1.14µs   med=2.66µs   max=11.92ms  p(90)=4.31µs   p(95)=5.97µs   p(99.9)=9.51ms  
     http_req_connecting............: avg=26.39µs  min=0s       med=0s       max=11.89ms  p(90)=0s       p(95)=0s       p(99.9)=9.48ms  
     http_req_duration..............: avg=266.88ms min=161.5ms  med=256.29ms max=747.77ms p(90)=282.04ms p(95)=406ms    p(99.9)=652.8ms 
       { expected_response:true }...: avg=266.88ms min=161.5ms  med=256.29ms max=747.77ms p(90)=282.04ms p(95)=406ms    p(99.9)=652.8ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 11309
     http_req_receiving.............: avg=98.91µs  min=25.94µs  med=49.83µs  max=12.86ms  p(90)=126.18µs p(95)=402.57µs p(99.9)=3.17ms  
     http_req_sending...............: avg=190.77µs min=5.22µs   med=11µs     max=337.59ms p(90)=38.34µs  p(95)=149.08µs p(99.9)=9.22ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=266.59ms min=161.44ms med=256.16ms max=746.92ms p(90)=281.59ms p(95)=401.53ms p(99.9)=651.63ms
     http_reqs......................: 11309   147.461065/s
     iteration_duration.............: avg=268.15ms min=161.67ms med=256.58ms max=812.85ms p(90)=282.36ms p(95)=410.87ms p(99.9)=692.43ms
     iterations.....................: 11209   146.157139/s
     success_rate...................: 100.00% ✓ 11209      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 30027      ✗ 0    
     data_received..................: 887 MB  11 MB/s
     data_sent......................: 12 MB   145 kB/s
     http_req_blocked...............: avg=23.4µs   min=1.75µs   med=2.69µs   max=8.4ms    p(90)=3.97µs   p(95)=4.98µs   p(99.9)=6.36ms  
     http_req_connecting............: avg=20.03µs  min=0s       med=0s       max=8.36ms   p(90)=0s       p(95)=0s       p(99.9)=6.35ms  
     http_req_duration..............: avg=298.74ms min=169.59ms med=299.79ms max=725.48ms p(90)=338.19ms p(95)=347.79ms p(99.9)=618.05ms
       { expected_response:true }...: avg=298.74ms min=169.59ms med=299.79ms max=725.48ms p(90)=338.19ms p(95)=347.79ms p(99.9)=618.05ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10109
     http_req_receiving.............: avg=87.31µs  min=35.16µs  med=51.8µs   max=3.06ms   p(90)=108.13µs p(95)=241.04µs p(99.9)=1.56ms  
     http_req_sending...............: avg=123.62µs min=7.67µs   med=10.93µs  max=251.73ms p(90)=28.33µs  p(95)=138.87µs p(99.9)=11.3ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=298.53ms min=169.46ms med=299.68ms max=717.77ms p(90)=337.94ms p(95)=347.58ms p(99.9)=612.25ms
     http_reqs......................: 10109   124.322736/s
     iteration_duration.............: avg=299.99ms min=169.83ms med=300.5ms  max=744.21ms p(90)=338.57ms p(95)=348.2ms  p(99.9)=681.93ms
     iterations.....................: 10009   123.092913/s
     success_rate...................: 100.00% ✓ 10009      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 20955     ✗ 0   
     data_received..................: 622 MB  7.6 MB/s
     data_sent......................: 8.2 MB  101 kB/s
     http_req_blocked...............: avg=99.72µs  min=1.36µs   med=3.04µs   max=20.94ms  p(90)=4.36µs   p(95)=5.01µs   p(99.9)=17.15ms 
     http_req_connecting............: avg=95.98µs  min=0s       med=0s       max=20.9ms   p(90)=0s       p(95)=0s       p(99.9)=17.05ms 
     http_req_duration..............: avg=427.09ms min=211.83ms med=429.87ms max=878.31ms p(90)=456.04ms p(95)=469.36ms p(99.9)=831.48ms
       { expected_response:true }...: avg=427.09ms min=211.83ms med=429.87ms max=878.31ms p(90)=456.04ms p(95)=469.36ms p(99.9)=831.48ms
     http_req_failed................: 0.00%   ✓ 0         ✗ 7085
     http_req_receiving.............: avg=60.4µs   min=29.75µs  med=51.36µs  max=1.2ms    p(90)=88.07µs  p(95)=102.21µs p(99.9)=407.82µs
     http_req_sending...............: avg=82.77µs  min=6.45µs   med=12.37µs  max=148.53ms p(90)=18.07µs  p(95)=23.33µs  p(99.9)=4ms     
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=426.94ms min=211.67ms med=429.77ms max=877.95ms p(90)=455.91ms p(95)=469.22ms p(99.9)=831.09ms
     http_reqs......................: 7085    86.711148/s
     iteration_duration.............: avg=430.63ms min=272.45ms med=430.33ms max=910.2ms  p(90)=456.62ms p(95)=469.94ms p(99.9)=863.9ms 
     iterations.....................: 6985    85.487278/s
     success_rate...................: 100.00% ✓ 6985      ✗ 0   
     vus............................: 50      min=0       max=50
     vus_max........................: 50      min=50      max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@ardatan ardatan merged commit 21fb882 into main Sep 16, 2025
34 checks passed
@ardatan ardatan deleted the renovate/capture-website-cli-5.x branch September 16, 2025 14:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant