Skip to content

Update docker/bake-action digest to 3acf805 #754

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

renovate[bot]
Copy link
Contributor

@renovate renovate bot commented Aug 20, 2025

This PR contains the following updates:

Package Type Update Change
docker/bake-action action digest 37816e7 -> 3acf805

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.


  • If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

@renovate renovate bot added the dependencies Pull requests that update a dependency file label Aug 20, 2025
Copy link

Overview for: federation/constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 500 VUs over 30s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
cosmo 175 5491 total, 0 failed avg: 1339ms, p95: 2818ms
apollo-router 157 5092 total, 19 failed avg: 1550ms, p95: 4279ms ❌ 19 failed requests, 19 non-200 responses, 20 unexpected GraphQL errors, non-compatible response structure (1)
grafbase 155 4895 total, 0 failed avg: 1508ms, p95: 3582ms
hive-gateway 93 3242 total, 0 failed avg: 4889ms, p95: 32832ms
apollo-server 90 3163 total, 0 failed avg: 5070ms, p95: 32964ms
hive-gateway-bun 85 2936 total, 0 failed avg: 5325ms, p95: 9245ms
mercurius 76 2513 total, 0 failed avg: 6186ms, p95: 8348ms
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 16413      ✗ 0    
     data_received..................: 482 MB  15 MB/s
     data_sent......................: 6.5 MB  208 kB/s
     http_req_blocked...............: avg=4.03ms   min=1.57µs  med=3.38µs  max=2.02s  p(90)=24.34µs  p(95)=21.72ms
     http_req_connecting............: avg=3.56ms   min=0s      med=0s      max=2.02s  p(90)=0s       p(95)=21.32ms
     http_req_duration..............: avg=1.33s    min=3.19ms  med=1.15s   max=7.36s  p(90)=2.27s    p(95)=2.81s  
       { expected_response:true }...: avg=1.33s    min=3.19ms  med=1.15s   max=7.36s  p(90)=2.27s    p(95)=2.81s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 5491 
     http_req_receiving.............: avg=247.34ms min=35.53µs med=80.46µs max=5.67s  p(90)=1.06s    p(95)=1.38s  
     http_req_sending...............: avg=26.04ms  min=8.13µs  med=14.93µs max=3.2s   p(90)=565.63µs p(95)=3.32ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s     p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=1.06s    min=3.08ms  med=1.02s   max=4.3s   p(90)=1.61s    p(95)=1.91s  
     http_reqs......................: 5491    175.092134/s
     iteration_duration.............: avg=2.75s    min=37.78ms med=2.37s   max=14.45s p(90)=5.13s    p(95)=6.26s  
     iterations.....................: 5471    174.454391/s
     vus............................: 165     min=165      max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✗ response code was 200
      ↳  99% — ✓ 5053 / ✗ 19
     ✗ no graphql errors
      ↳  99% — ✓ 5052 / ✗ 20
     ✗ valid response structure
      ↳  99% — ✓ 5052 / ✗ 1

     █ setup

     checks.........................: 99.73% ✓ 15157      ✗ 40   
     data_received..................: 445 MB 14 MB/s
     data_sent......................: 6.0 MB 187 kB/s
     http_req_blocked...............: avg=14.52ms  min=1.64µs  med=3.65µs  max=4.2s   p(90)=461.68µs p(95)=6.95ms 
     http_req_connecting............: avg=13.58ms  min=0s      med=0s      max=4.2s   p(90)=371.5µs  p(95)=6.73ms 
     http_req_duration..............: avg=1.54s    min=7.44ms  med=1.2s    max=10.73s p(90)=2.93s    p(95)=4.27s  
       { expected_response:true }...: avg=1.54s    min=7.44ms  med=1.2s    max=10.73s p(90)=2.93s    p(95)=4.27s  
     http_req_failed................: 0.37%  ✓ 19         ✗ 5073 
     http_req_receiving.............: avg=408.29ms min=0s      med=86.52µs max=8.99s  p(90)=1.67s    p(95)=2.82s  
     http_req_sending...............: avg=43.66ms  min=8.36µs  med=17.71µs max=5.18s  p(90)=613.12µs p(95)=13.24ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s     p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=1.09s    min=7.23ms  med=1.07s   max=5.46s  p(90)=1.84s    p(95)=2.2s   
     http_reqs......................: 5092   157.417736/s
     iteration_duration.............: avg=3.06s    min=63.28ms med=2.59s   max=15.86s p(90)=6.15s    p(95)=7.18s  
     iterations.....................: 5072   156.799441/s
     vus............................: 159    min=159      max=500
     vus_max........................: 500    min=500      max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 14625      ✗ 0    
     data_received..................: 430 MB  14 MB/s
     data_sent......................: 5.8 MB  184 kB/s
     http_req_blocked...............: avg=4.11ms   min=1.68µs  med=4.63µs   max=2.75s  p(90)=498.6µs  p(95)=24.18ms
     http_req_connecting............: avg=3.65ms   min=0s      med=0s       max=2.75s  p(90)=209.82µs p(95)=23.87ms
     http_req_duration..............: avg=1.5s     min=3.7ms   med=1.28s    max=5.91s  p(90)=3.03s    p(95)=3.58s  
       { expected_response:true }...: avg=1.5s     min=3.7ms   med=1.28s    max=5.91s  p(90)=3.03s    p(95)=3.58s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 4895 
     http_req_receiving.............: avg=532.42ms min=30.98µs med=142.77µs max=5.32s  p(90)=2.02s    p(95)=2.51s  
     http_req_sending...............: avg=27.51ms  min=8.67µs  med=23.45µs  max=3.36s  p(90)=975.67µs p(95)=4.86ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=947.9ms  min=3.58ms  med=855.16ms max=3.16s  p(90)=1.8s     p(95)=2.25s  
     http_reqs......................: 4895    155.342292/s
     iteration_duration.............: avg=3.13s    min=23.6ms  med=2.74s    max=13.47s p(90)=6.43s    p(95)=7.57s  
     iterations.....................: 4875    154.707595/s
     vus............................: 286     min=286      max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 9666      ✗ 0    
     data_received..................: 285 MB  8.2 MB/s
     data_sent......................: 3.8 MB  110 kB/s
     http_req_blocked...............: avg=3.03ms   min=1.93µs   med=4.16µs  max=60.89ms  p(90)=17.86ms p(95)=23.79ms
     http_req_connecting............: avg=2.91ms   min=0s       med=0s      max=40.04ms  p(90)=17.49ms p(95)=23.51ms
     http_req_duration..............: avg=4.88s    min=11.79ms  med=2.17s   max=34.37s   p(90)=12.14s  p(95)=32.83s 
       { expected_response:true }...: avg=4.88s    min=11.79ms  med=2.17s   max=34.37s   p(90)=12.14s  p(95)=32.83s 
     http_req_failed................: 0.00%   ✓ 0         ✗ 3242 
     http_req_receiving.............: avg=7.89ms   min=39.71µs  med=89.03µs max=464.92ms p(90)=1.75ms  p(95)=18.97ms
     http_req_sending...............: avg=978.35µs min=9.3µs    med=22.85µs max=181.66ms p(90)=1.18ms  p(95)=2.28ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s      max=0s       p(90)=0s      p(95)=0s     
     http_req_waiting...............: avg=4.87s    min=11.65ms  med=2.16s   max=34.36s   p(90)=12.14s  p(95)=32.83s 
     http_reqs......................: 3242    93.012543/s
     iteration_duration.............: avg=5.01s    min=187.78ms med=2.26s   max=34.39s   p(90)=12.37s  p(95)=33.16s 
     iterations.....................: 3222    92.438746/s
     vus............................: 91      min=91      max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 9429      ✗ 0    
     data_received..................: 278 MB  8.0 MB/s
     data_sent......................: 3.8 MB  108 kB/s
     http_req_blocked...............: avg=5.25ms min=1.49µs   med=2.92µs  max=95.92ms  p(90)=20.19ms  p(95)=42.66ms 
     http_req_connecting............: avg=5.17ms min=0s       med=0s      max=95.89ms  p(90)=19.54ms  p(95)=42.21ms 
     http_req_duration..............: avg=5.07s  min=10.32ms  med=2.09s   max=34.44s   p(90)=12.7s    p(95)=32.96s  
       { expected_response:true }...: avg=5.07s  min=10.32ms  med=2.09s   max=34.44s   p(90)=12.7s    p(95)=32.96s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 3163 
     http_req_receiving.............: avg=1.66ms min=40.5µs   med=97.46µs max=475.34ms p(90)=220.91µs p(95)=468.19µs
     http_req_sending...............: avg=1.83ms min=8.06µs   med=14.84µs max=75.98ms  p(90)=1.67ms   p(95)=9.44ms  
     http_req_tls_handshaking.......: avg=0s     min=0s       med=0s      max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=5.06s  min=10.23ms  med=2.09s   max=34.44s   p(90)=12.7s    p(95)=32.96s  
     http_reqs......................: 3163    90.626615/s
     iteration_duration.............: avg=5.12s  min=351.14ms med=2.11s   max=34.45s   p(90)=13.56s   p(95)=33.01s  
     iterations.....................: 3143    90.053573/s
     vus............................: 103     min=103     max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8748      ✗ 0    
     data_received..................: 258 MB  7.5 MB/s
     data_sent......................: 3.5 MB  101 kB/s
     http_req_blocked...............: avg=5.57ms min=2.15µs   med=4.45µs   max=223.9ms  p(90)=29.34ms p(95)=36.33ms 
     http_req_connecting............: avg=5.14ms min=0s       med=0s       max=77.23ms  p(90)=28.79ms p(95)=35.46ms 
     http_req_duration..............: avg=5.32s  min=15.89ms  med=4.95s    max=12.48s   p(90)=8.34s   p(95)=9.24s   
       { expected_response:true }...: avg=5.32s  min=15.89ms  med=4.95s    max=12.48s   p(90)=8.34s   p(95)=9.24s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 2936 
     http_req_receiving.............: avg=80.7ms min=40.43µs  med=122.85µs max=3.36s    p(90)=13.52ms p(95)=294.12ms
     http_req_sending...............: avg=2.26ms min=10.13µs  med=25.35µs  max=456.16ms p(90)=2.04ms  p(95)=7.95ms  
     http_req_tls_handshaking.......: avg=0s     min=0s       med=0s       max=0s       p(90)=0s      p(95)=0s      
     http_req_waiting...............: avg=5.24s  min=15.69ms  med=4.87s    max=12.46s   p(90)=8.26s   p(95)=9.23s   
     http_reqs......................: 2936    85.191498/s
     iteration_duration.............: avg=5.48s  min=133.89ms med=5.08s    max=12.49s   p(90)=8.4s    p(95)=9.33s   
     iterations.....................: 2916    84.611175/s
     vus............................: 116     min=116     max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 7479      ✗ 0    
     data_received..................: 221 MB  6.7 MB/s
     data_sent......................: 3.0 MB  91 kB/s
     http_req_blocked...............: avg=17.14ms min=1.67µs   med=3.87µs  max=161.64ms p(90)=98.11ms  p(95)=116.05ms
     http_req_connecting............: avg=16.88ms min=0s       med=0s      max=161.61ms p(90)=97.4ms   p(95)=115.53ms
     http_req_duration..............: avg=6.18s   min=10.98ms  med=6.23s   max=10.43s   p(90)=7.57s    p(95)=8.34s   
       { expected_response:true }...: avg=6.18s   min=10.98ms  med=6.23s   max=10.43s   p(90)=7.57s    p(95)=8.34s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 2513 
     http_req_receiving.............: avg=12ms    min=38.97µs  med=98.26µs max=854.27ms p(90)=348.17µs p(95)=1.6ms   
     http_req_sending...............: avg=4.17ms  min=8.92µs   med=22.46µs max=128.12ms p(90)=11.92ms  p(95)=34.84ms 
     http_req_tls_handshaking.......: avg=0s      min=0s       med=0s      max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=6.16s   min=10.9ms   med=6.23s   max=10.43s   p(90)=7.57s    p(95)=8.34s   
     http_reqs......................: 2513    76.28479/s
     iteration_duration.............: avg=6.3s    min=407.03ms med=6.25s   max=10.52s   p(90)=7.59s    p(95)=8.45s   
     iterations.....................: 2493    75.677668/s
     vus............................: 296     min=296     max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

Copy link

Overview for: federation/constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 300 VUs over 30s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
cosmo 172 5302 total, 0 failed avg: 871ms, p95: 2148ms
grafbase 164 5073 total, 0 failed avg: 845ms, p95: 2278ms
apollo-router 147 4562 total, 0 failed avg: 1056ms, p95: 3158ms
apollo-server 90 2997 total, 0 failed avg: 3117ms, p95: 23375ms
hive-gateway 89 2956 total, 0 failed avg: 3142ms, p95: 15185ms
hive-gateway-bun 84 2786 total, 0 failed avg: 3269ms, p95: 5312ms
mercurius 80 2560 total, 0 failed avg: 3574ms, p95: 5387ms
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 15846      ✗ 0    
     data_received..................: 465 MB  15 MB/s
     data_sent......................: 6.3 MB  205 kB/s
     http_req_blocked...............: avg=1.24ms   min=1.85µs  med=4.12µs   max=1.46s p(90)=7.25µs   p(95)=918.44µs
     http_req_connecting............: avg=1.01ms   min=0s      med=0s       max=1.3s  p(90)=0s       p(95)=699.03µs
     http_req_duration..............: avg=871.43ms min=3.39ms  med=729.77ms max=5.4s  p(90)=1.74s    p(95)=2.14s   
       { expected_response:true }...: avg=871.43ms min=3.39ms  med=729.77ms max=5.4s  p(90)=1.74s    p(95)=2.14s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 5302 
     http_req_receiving.............: avg=300.61ms min=36.83µs med=109.26µs max=4.41s p(90)=1.01s    p(95)=1.51s   
     http_req_sending...............: avg=21.42ms  min=8.46µs  med=21.48µs  max=4.36s p(90)=161.92µs p(95)=1.02ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s    p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=549.4ms  min=3.25ms  med=514.88ms max=2.21s p(90)=959.44ms p(95)=1.11s   
     http_reqs......................: 5302    172.319038/s
     iteration_duration.............: avg=1.7s     min=21.57ms med=1.45s    max=7.42s p(90)=3.43s    p(95)=4.03s   
     iterations.....................: 5282    171.669023/s
     vus............................: 300     min=300      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 15159      ✗ 0    
     data_received..................: 446 MB  14 MB/s
     data_sent......................: 6.0 MB  195 kB/s
     http_req_blocked...............: avg=2.1ms    min=1.57µs  med=3.8µs    max=1.97s  p(90)=6.88µs   p(95)=863.21µs
     http_req_connecting............: avg=1.75ms   min=0s      med=0s       max=1.97s  p(90)=0s       p(95)=653.36µs
     http_req_duration..............: avg=844.67ms min=3.16ms  med=635.12ms max=7.75s  p(90)=1.96s    p(95)=2.27s   
       { expected_response:true }...: avg=844.67ms min=3.16ms  med=635.12ms max=7.75s  p(90)=1.96s    p(95)=2.27s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 5073 
     http_req_receiving.............: avg=300.04ms min=36.53µs med=97.88µs  max=6.67s  p(90)=1.21s    p(95)=1.7s    
     http_req_sending...............: avg=23.8ms   min=8.56µs  med=17.7µs   max=2.47s  p(90)=832.34µs p(95)=27.02ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=520.82ms min=3.09ms  med=431.6ms  max=2.67s  p(90)=1s       p(95)=1.33s   
     http_reqs......................: 5073    164.038804/s
     iteration_duration.............: avg=1.79s    min=23.18ms med=1.46s    max=12.82s p(90)=3.63s    p(95)=4.61s   
     iterations.....................: 5053    163.39209/s
     vus............................: 300     min=300      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 13626      ✗ 0    
     data_received..................: 400 MB  13 MB/s
     data_sent......................: 5.4 MB  175 kB/s
     http_req_blocked...............: avg=4.77ms   min=1.94µs  med=4.62µs   max=2.39s  p(90)=9.62µs p(95)=19.54ms
     http_req_connecting............: avg=3.98ms   min=0s      med=0s       max=2.39s  p(90)=0s     p(95)=18.93ms
     http_req_duration..............: avg=1.05s    min=6.84ms  med=790.52ms max=5.1s   p(90)=2.6s   p(95)=3.15s  
       { expected_response:true }...: avg=1.05s    min=6.84ms  med=790.52ms max=5.1s   p(90)=2.6s   p(95)=3.15s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 4562 
     http_req_receiving.............: avg=469.24ms min=42.61µs med=119.48µs max=4.8s   p(90)=1.98s  p(95)=2.76s  
     http_req_sending...............: avg=27.12ms  min=8.76µs  med=24.68µs  max=3.66s  p(90)=1.77ms p(95)=17.91ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s     p(95)=0s     
     http_req_waiting...............: avg=559.31ms min=6.74ms  med=496.71ms max=3.06s  p(90)=1.08s  p(95)=1.26s  
     http_reqs......................: 4562    147.67322/s
     iteration_duration.............: avg=1.99s    min=24.65ms med=1.66s    max=11.81s p(90)=4.21s  p(95)=5.01s  
     iterations.....................: 4542    147.025814/s
     vus............................: 300     min=300      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8931      ✗ 0    
     data_received..................: 263 MB  8.0 MB/s
     data_sent......................: 3.6 MB  108 kB/s
     http_req_blocked...............: avg=2.68ms   min=1.5µs    med=2.82µs   max=63.46ms p(90)=95.26µs  p(95)=22.32ms 
     http_req_connecting............: avg=2.61ms   min=0s       med=0s       max=63.42ms p(90)=65.45µs  p(95)=21.99ms 
     http_req_duration..............: avg=3.11s    min=9.79ms   med=1.38s    max=32.59s  p(90)=2.01s    p(95)=23.37s  
       { expected_response:true }...: avg=3.11s    min=9.79ms   med=1.38s    max=32.59s  p(90)=2.01s    p(95)=23.37s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2997 
     http_req_receiving.............: avg=256.39µs min=42.51µs  med=101.09µs max=40.38ms p(90)=223.96µs p(95)=389.11µs
     http_req_sending...............: avg=292.67µs min=8.33µs   med=14.76µs  max=44.56ms p(90)=66.02µs  p(95)=993.99µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.11s    min=9.71ms   med=1.38s    max=32.59s  p(90)=2.01s    p(95)=23.37s  
     http_reqs......................: 2997    90.746556/s
     iteration_duration.............: avg=3.15s    min=283.71ms med=1.39s    max=32.61s  p(90)=2.05s    p(95)=23.78s  
     iterations.....................: 2977    90.140974/s
     vus............................: 6       min=6       max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8808      ✗ 0    
     data_received..................: 260 MB  7.8 MB/s
     data_sent......................: 3.5 MB  106 kB/s
     http_req_blocked...............: avg=1.88ms   min=2.1µs    med=4.89µs   max=51.59ms  p(90)=3.77ms   p(95)=16.73ms
     http_req_connecting............: avg=1.64ms   min=0s       med=0s       max=51.55ms  p(90)=166.42µs p(95)=16.36ms
     http_req_duration..............: avg=3.14s    min=14.02ms  med=1.72s    max=32.59s   p(90)=3.04s    p(95)=15.18s 
       { expected_response:true }...: avg=3.14s    min=14.02ms  med=1.72s    max=32.59s   p(90)=3.04s    p(95)=15.18s 
     http_req_failed................: 0.00%   ✓ 0         ✗ 2956 
     http_req_receiving.............: avg=968.13µs min=48.25µs  med=110.58µs max=171.77ms p(90)=551.51µs p(95)=1.46ms 
     http_req_sending...............: avg=859.63µs min=9.83µs   med=28.19µs  max=84.69ms  p(90)=344.72µs p(95)=4.92ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=3.14s    min=13.83ms  med=1.72s    max=32.59s   p(90)=3.04s    p(95)=15.16s 
     http_reqs......................: 2956    89.182447/s
     iteration_duration.............: avg=3.19s    min=337.84ms med=1.76s    max=32.61s   p(90)=3.08s    p(95)=15.38s 
     iterations.....................: 2936    88.579048/s
     vus............................: 22      min=22      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8298      ✗ 0    
     data_received..................: 245 MB  7.4 MB/s
     data_sent......................: 3.3 MB  100 kB/s
     http_req_blocked...............: avg=699.82µs min=1.93µs   med=4.65µs   max=30.11ms p(90)=558.76µs p(95)=6.07ms  
     http_req_connecting............: avg=672.25µs min=0s       med=0s       max=15.13ms p(90)=464.58µs p(95)=5.94ms  
     http_req_duration..............: avg=3.26s    min=17.82ms  med=3.1s     max=6.94s   p(90)=4.85s    p(95)=5.31s   
       { expected_response:true }...: avg=3.26s    min=17.82ms  med=3.1s     max=6.94s   p(90)=4.85s    p(95)=5.31s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 2786 
     http_req_receiving.............: avg=88.82ms  min=40.61µs  med=160.62µs max=1.89s   p(90)=213.17ms p(95)=827.75ms
     http_req_sending...............: avg=2.23ms   min=8.78µs   med=25.26µs  max=1.09s   p(90)=316.48µs p(95)=1.01ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.17s    min=17.52ms  med=2.97s    max=6.84s   p(90)=4.67s    p(95)=5.19s   
     http_reqs......................: 2786    84.007824/s
     iteration_duration.............: avg=3.39s    min=170.21ms med=3.17s    max=7.01s   p(90)=5.06s    p(95)=5.5s    
     iterations.....................: 2766    83.404752/s
     vus............................: 27      min=27      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 7620      ✗ 0    
     data_received..................: 225 MB  7.1 MB/s
     data_sent......................: 3.0 MB  95 kB/s
     http_req_blocked...............: avg=423.27µs min=1.6µs    med=3.21µs  max=13.18ms  p(90)=255.4µs  p(95)=3.83ms  
     http_req_connecting............: avg=407.72µs min=0s       med=0s      max=13.15ms  p(90)=189.76µs p(95)=3.69ms  
     http_req_duration..............: avg=3.57s    min=11.38ms  med=3.62s   max=7.94s    p(90)=4.34s    p(95)=5.38s   
       { expected_response:true }...: avg=3.57s    min=11.38ms  med=3.62s   max=7.94s    p(90)=4.34s    p(95)=5.38s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 2560 
     http_req_receiving.............: avg=6.79ms   min=40.35µs  med=96.43µs max=760.49ms p(90)=345.48µs p(95)=1.36ms  
     http_req_sending...............: avg=244.86µs min=8.69µs   med=17.61µs max=92.8ms   p(90)=127.42µs p(95)=815.67µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s      max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.56s    min=11.3ms   med=3.62s   max=7.94s    p(90)=4.28s    p(95)=5.38s   
     http_reqs......................: 2560    80.372329/s
     iteration_duration.............: avg=3.63s    min=222.28ms med=3.65s   max=7.97s    p(90)=4.41s    p(95)=5.45s   
     iterations.....................: 2540    79.74442/s
     vus............................: 211     min=211     max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

Copy link

Overview for: federation/constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 300 VUs over 30s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
cosmo 180 5580 total, 0 failed avg: 853ms, p95: 2021ms
grafbase 167 5175 total, 0 failed avg: 862ms, p95: 2462ms
apollo-router 156 4848 total, 0 failed avg: 915ms, p95: 2215ms
hive-gateway 91 3023 total, 0 failed avg: 3060ms, p95: 15035ms
hive-gateway-bun 90 2977 total, 0 failed avg: 3051ms, p95: 5329ms
apollo-server 87 2914 total, 0 failed avg: 3224ms, p95: 25513ms
mercurius 73 2353 total, 0 failed avg: 3906ms, p95: 6241ms
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 16680      ✗ 0    
     data_received..................: 490 MB  16 MB/s
     data_sent......................: 6.6 MB  214 kB/s
     http_req_blocked...............: avg=1.4ms    min=1.48µs  med=3.22µs   max=2.47s p(90)=5.5µs    p(95)=317.42µs
     http_req_connecting............: avg=1.14ms   min=0s      med=0s       max=2.47s p(90)=0s       p(95)=147.96µs
     http_req_duration..............: avg=853.1ms  min=3.14ms  med=752.06ms max=4.9s  p(90)=1.71s    p(95)=2.02s   
       { expected_response:true }...: avg=853.1ms  min=3.14ms  med=752.06ms max=4.9s  p(90)=1.71s    p(95)=2.02s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 5580 
     http_req_receiving.............: avg=269.98ms min=31.92µs med=94.29µs  max=3.98s p(90)=1.08s    p(95)=1.53s   
     http_req_sending...............: avg=13.8ms   min=8.05µs  med=14.66µs  max=2.7s  p(90)=123.18µs p(95)=1.38ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s    p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=569.31ms min=3.02ms  med=551.05ms max=2.55s p(90)=1s       p(95)=1.15s   
     http_reqs......................: 5580    180.393517/s
     iteration_duration.............: avg=1.63s    min=21.31ms med=1.42s    max=8.99s p(90)=3.24s    p(95)=4.02s   
     iterations.....................: 5560    179.746945/s
     vus............................: 300     min=300      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 15465      ✗ 0    
     data_received..................: 455 MB  15 MB/s
     data_sent......................: 6.1 MB  199 kB/s
     http_req_blocked...............: avg=2.23ms   min=1.57µs  med=3.67µs   max=1.27s p(90)=6.46µs  p(95)=5.34ms 
     http_req_connecting............: avg=2.01ms   min=0s      med=0s       max=1.27s p(90)=0s      p(95)=3.02ms 
     http_req_duration..............: avg=862.41ms min=3.58ms  med=685.4ms  max=5.25s p(90)=1.86s   p(95)=2.46s  
       { expected_response:true }...: avg=862.41ms min=3.58ms  med=685.4ms  max=5.25s p(90)=1.86s   p(95)=2.46s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 5175 
     http_req_receiving.............: avg=288.03ms min=36.75µs med=88.66µs  max=4.35s p(90)=1.26s   p(95)=1.63s  
     http_req_sending...............: avg=25.41ms  min=7.27µs  med=16.56µs  max=3.29s p(90)=643.2µs p(95)=40.92ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s    p(90)=0s      p(95)=0s     
     http_req_waiting...............: avg=548.96ms min=3.52ms  med=501.44ms max=2.46s p(90)=1.03s   p(95)=1.28s  
     http_reqs......................: 5175    167.864016/s
     iteration_duration.............: avg=1.76s    min=17.97ms med=1.43s    max=8.21s p(90)=3.6s    p(95)=4.48s  
     iterations.....................: 5155    167.215267/s
     vus............................: 300     min=300      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 14484      ✗ 0    
     data_received..................: 425 MB  14 MB/s
     data_sent......................: 5.8 MB  186 kB/s
     http_req_blocked...............: avg=2.08ms   min=1.5µs   med=3.49µs   max=1.4s  p(90)=6.19µs   p(95)=1ms     
     http_req_connecting............: avg=1.62ms   min=0s      med=0s       max=1.4s  p(90)=0s       p(95)=805.51µs
     http_req_duration..............: avg=914.83ms min=6.8ms   med=772.77ms max=5.01s p(90)=1.81s    p(95)=2.21s   
       { expected_response:true }...: avg=914.83ms min=6.8ms   med=772.77ms max=5.01s p(90)=1.81s    p(95)=2.21s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 4848 
     http_req_receiving.............: avg=287.57ms min=34.05µs med=94.71µs  max=4.23s p(90)=1.07s    p(95)=1.46s   
     http_req_sending...............: avg=24.2ms   min=8.48µs  med=17.14µs  max=3.7s  p(90)=303.76µs p(95)=12.81ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s    p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=603.05ms min=6.72ms  med=531.28ms max=2.97s p(90)=1.17s    p(95)=1.47s   
     http_reqs......................: 4848    156.993561/s
     iteration_duration.............: avg=1.87s    min=33.38ms med=1.6s     max=9.39s p(90)=3.77s    p(95)=4.64s   
     iterations.....................: 4828    156.345898/s
     vus............................: 300     min=300      max=300
     vus_max........................: 300     min=300      max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 9009      ✗ 0    
     data_received..................: 266 MB  8.0 MB/s
     data_sent......................: 3.6 MB  109 kB/s
     http_req_blocked...............: avg=532.82µs min=2.06µs   med=4.18µs   max=21.06ms  p(90)=104.43µs p(95)=4.65ms
     http_req_connecting............: avg=503.51µs min=0s       med=0s       max=13.11ms  p(90)=0s       p(95)=4.45ms
     http_req_duration..............: avg=3.05s    min=12.39ms  med=1.67s    max=32.58s   p(90)=2.58s    p(95)=15.03s
       { expected_response:true }...: avg=3.05s    min=12.39ms  med=1.67s    max=32.58s   p(90)=2.58s    p(95)=15.03s
     http_req_failed................: 0.00%   ✓ 0         ✗ 3023 
     http_req_receiving.............: avg=2.47ms   min=45.73µs  med=101.28µs max=279.17ms p(90)=644.8µs  p(95)=3.13ms
     http_req_sending...............: avg=495.92µs min=9.72µs   med=23.66µs  max=80.69ms  p(90)=233.58µs p(95)=1.25ms
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s    
     http_req_waiting...............: avg=3.05s    min=12.28ms  med=1.67s    max=32.58s   p(90)=2.57s    p(95)=15.03s
     http_reqs......................: 3023    91.577757/s
     iteration_duration.............: avg=3.12s    min=114.91ms med=1.72s    max=32.59s   p(90)=2.63s    p(95)=15.16s
     iterations.....................: 3003    90.971884/s
     vus............................: 5       min=5       max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8871      ✗ 0    
     data_received..................: 261 MB  8.0 MB/s
     data_sent......................: 3.5 MB  108 kB/s
     http_req_blocked...............: avg=735.64µs min=1.9µs   med=3.88µs   max=20.12ms  p(90)=161.1µs  p(95)=6.16ms  
     http_req_connecting............: avg=705.37µs min=0s      med=0s       max=18.23ms  p(90)=89.57µs  p(95)=6.01ms  
     http_req_duration..............: avg=3.05s    min=13.38ms med=2.81s    max=6.74s    p(90)=4.83s    p(95)=5.32s   
       { expected_response:true }...: avg=3.05s    min=13.38ms med=2.81s    max=6.74s    p(90)=4.83s    p(95)=5.32s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 2977 
     http_req_receiving.............: avg=81.43ms  min=34.89µs med=175.71µs max=1.92s    p(90)=280.07ms p(95)=629.3ms 
     http_req_sending...............: avg=1.58ms   min=9.73µs  med=20.08µs  max=480.72ms p(90)=298.31µs p(95)=866.03µs
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=2.96s    min=13.16ms med=2.76s    max=6.74s    p(90)=4.74s    p(95)=5.27s   
     http_reqs......................: 2977    90.812641/s
     iteration_duration.............: avg=3.17s    min=293.1ms med=2.95s    max=7.08s    p(90)=5.07s    p(95)=5.59s   
     iterations.....................: 2957    90.202546/s
     vus............................: 132     min=132     max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 8682      ✗ 0    
     data_received..................: 256 MB  7.7 MB/s
     data_sent......................: 3.5 MB  104 kB/s
     http_req_blocked...............: avg=231.55µs min=1.74µs   med=3.68µs   max=10.72ms  p(90)=121.26µs p(95)=1.47ms  
     http_req_connecting............: avg=216.7µs  min=0s       med=0s       max=8.69ms   p(90)=79.82µs  p(95)=1.39ms  
     http_req_duration..............: avg=3.22s    min=11ms     med=1.41s    max=32.82s   p(90)=2.06s    p(95)=25.51s  
       { expected_response:true }...: avg=3.22s    min=11ms     med=1.41s    max=32.82s   p(90)=2.06s    p(95)=25.51s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2914 
     http_req_receiving.............: avg=474.09µs min=44.65µs  med=107.04µs max=115.72ms p(90)=253.46µs p(95)=511.87µs
     http_req_sending...............: avg=136.11µs min=8.58µs   med=18.78µs  max=20.27ms  p(90)=112.74µs p(95)=391.91µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.22s    min=10.89ms  med=1.41s    max=32.82s   p(90)=2.06s    p(95)=25.51s  
     http_reqs......................: 2914    87.714206/s
     iteration_duration.............: avg=3.26s    min=362.89ms med=1.43s    max=32.83s   p(90)=2.08s    p(95)=26.11s  
     iterations.....................: 2894    87.112186/s
     vus............................: 30      min=30      max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 6999      ✗ 0    
     data_received..................: 207 MB  6.5 MB/s
     data_sent......................: 2.8 MB  87 kB/s
     http_req_blocked...............: avg=778.89µs min=2.13µs   med=4.79µs   max=16.46ms  p(90)=2.35ms   p(95)=6.01ms
     http_req_connecting............: avg=747.44µs min=0s       med=0s       max=16.4ms   p(90)=2.03ms   p(95)=5.73ms
     http_req_duration..............: avg=3.9s     min=12.15ms  med=3.93s    max=9.1s     p(90)=5.17s    p(95)=6.24s 
       { expected_response:true }...: avg=3.9s     min=12.15ms  med=3.93s    max=9.1s     p(90)=5.17s    p(95)=6.24s 
     http_req_failed................: 0.00%   ✓ 0         ✗ 2353 
     http_req_receiving.............: avg=17.92ms  min=41.35µs  med=115.67µs max=769.21ms p(90)=407.73µs p(95)=3.44ms
     http_req_sending...............: avg=360.1µs  min=10.15µs  med=27.64µs  max=9.07ms   p(90)=580.16µs p(95)=2.46ms
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s    
     http_req_waiting...............: avg=3.88s    min=11.94ms  med=3.93s    max=9.1s     p(90)=5.17s    p(95)=6.23s 
     http_reqs......................: 2353    73.619384/s
     iteration_duration.............: avg=3.96s    min=257.12ms med=3.95s    max=9.12s    p(90)=5.18s    p(95)=6.29s 
     iterations.....................: 2333    72.993635/s
     vus............................: 232     min=232     max=300
     vus_max........................: 300     min=300     max=300

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

Copy link

Overview for: federation/ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was trying to reach 2000 concurrent VUs over 60s

Comparison

Comparison

Gateway duration(p95)⬇️ RPS Requests Durations Notes
cosmo 4591ms 177 12476 total, 0 failed avg: 2131ms, p95: 4592ms, max: 9826ms, med: 1971ms
grafbase 6278ms 165 11750 total, 0 failed avg: 3064ms, p95: 6278ms, max: 15713ms, med: 2931ms
apollo-router 6478ms 162 12212 total, 888 failed avg: 2834ms, p95: 6478ms, max: 15620ms, med: 2701ms ❌ 888 failed requests, 888 non-200 responses, 888 unexpected GraphQL errors
hive-gateway-bun 28374ms 90 7344 total, 0 failed avg: 11566ms, p95: 28375ms, max: 37059ms, med: 10474ms
mercurius 43099ms 53 4943 total, 0 failed avg: 21814ms, p95: 43099ms, max: 44010ms, med: 19425ms
hive-gateway 49326ms 96 8178 total, 0 failed avg: 10952ms, p95: 49327ms, max: 57047ms, med: 3173ms
apollo-server 59999ms 83 7764 total, 538 failed avg: 11992ms, p95: 60000ms, max: 60150ms, med: 2178ms ❌ 538 failed requests, 538 non-200 responses, 538 unexpected GraphQL errors
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 37368      ✗ 0     
     data_received..................: 1.1 GB  16 MB/s
     data_sent......................: 15 MB   211 kB/s
     http_req_blocked...............: avg=186.72ms min=1.58µs  med=3.64µs  max=8.97s  p(90)=730.28ms p(95)=1.33s   
     http_req_connecting............: avg=183.73ms min=0s      med=0s      max=7.86s  p(90)=721.11ms p(95)=1.33s   
     http_req_duration..............: avg=2.13s    min=3.05ms  med=1.97s   max=9.82s  p(90)=4.03s    p(95)=4.59s   
       { expected_response:true }...: avg=2.13s    min=3.05ms  med=1.97s   max=9.82s  p(90)=4.03s    p(95)=4.59s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 12476 
     http_req_receiving.............: avg=143.91ms min=33.54µs med=72.04µs max=6.13s  p(90)=212.3ms  p(95)=735.05ms
     http_req_sending...............: avg=88.91ms  min=7.71µs  med=16.96µs max=6.75s  p(90)=160.42ms p(95)=602.72ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s     p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=1.89s    min=2.97ms  med=1.74s   max=7.33s  p(90)=3.77s    p(95)=4.27s   
     http_reqs......................: 12476   177.95094/s
     iteration_duration.............: avg=5.56s    min=8.75ms  med=5.01s   max=26.58s p(90)=11.18s   p(95)=12.6s   
     iterations.....................: 12456   177.665671/s
     vus............................: 4       min=4        max=1999
     vus_max........................: 2000    min=2000     max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 35190      ✗ 0     
     data_received..................: 1.0 GB  15 MB/s
     data_sent......................: 14 MB   197 kB/s
     http_req_blocked...............: avg=371.72ms min=1.47µs  med=4.08µs  max=12.08s p(90)=939.74ms p(95)=3.47s   
     http_req_connecting............: avg=366.58ms min=0s      med=0s      max=12.08s p(90)=937.4ms  p(95)=3.42s   
     http_req_duration..............: avg=3.06s    min=3.33ms  med=2.93s   max=15.71s p(90)=5.72s    p(95)=6.27s   
       { expected_response:true }...: avg=3.06s    min=3.33ms  med=2.93s   max=15.71s p(90)=5.72s    p(95)=6.27s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 11750 
     http_req_receiving.............: avg=161.71ms min=32.74µs med=83.36µs max=9.32s  p(90)=459.82ms p(95)=1.25s   
     http_req_sending...............: avg=154.62ms min=8.59µs  med=19.9µs  max=7.52s  p(90)=428.47ms p(95)=892.03ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s     p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=2.74s    min=3.27ms  med=2.36s   max=11.89s p(90)=5.45s    p(95)=5.85s   
     http_reqs......................: 11750   165.939404/s
     iteration_duration.............: avg=6.29s    min=25.89ms med=5.48s   max=33.26s p(90)=12.14s   p(95)=14.31s  
     iterations.....................: 11730   165.656954/s
     vus............................: 63      min=63       max=1975
     vus_max........................: 2000    min=2000     max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✗ response code was 200
      ↳  92% — ✓ 11304 / ✗ 888
     ✗ no graphql errors
      ↳  92% — ✓ 11304 / ✗ 888
     ✓ valid response structure

     █ setup

     checks.........................: 95.02% ✓ 33912      ✗ 1776  
     data_received..................: 994 MB 13 MB/s
     data_sent......................: 15 MB  193 kB/s
     http_req_blocked...............: avg=620.77ms min=1.81µs med=4.79µs  max=14.08s p(90)=3.02s    p(95)=3.83s  
     http_req_connecting............: avg=609.22ms min=0s     med=0s      max=10.22s p(90)=3.01s    p(95)=3.81s  
     http_req_duration..............: avg=2.83s    min=7.73ms med=2.7s    max=15.61s p(90)=4.93s    p(95)=6.47s  
       { expected_response:true }...: avg=2.8s     min=7.73ms med=2.67s   max=15.46s p(90)=4.85s    p(95)=6.46s  
     http_req_failed................: 7.27%  ✓ 888        ✗ 11324 
     http_req_receiving.............: avg=307.95ms min=0s     med=93.72µs max=12.17s p(90)=890.53ms p(95)=2.79s  
     http_req_sending...............: avg=195.16ms min=9.08µs med=26.91µs max=10.97s p(90)=500.21ms p(95)=909.9ms
     http_req_tls_handshaking.......: avg=0s       min=0s     med=0s      max=0s     p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=2.33s    min=7.57ms med=2.2s    max=15.61s p(90)=4.24s    p(95)=4.78s  
     http_reqs......................: 12212  162.295811/s
     iteration_duration.............: avg=6.7s     min=35.9ms med=6.14s   max=32s    p(90)=13.21s   p(95)=15.17s 
     iterations.....................: 12192  162.030014/s
     vus............................: 388    min=63       max=1864
     vus_max........................: 2000   min=2000     max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 21972     ✗ 0     
     data_received..................: 645 MB  7.9 MB/s
     data_sent......................: 8.7 MB  107 kB/s
     http_req_blocked...............: avg=18.25ms  min=2.14µs   med=5.19µs   max=965.59ms p(90)=30.57ms  p(95)=128.69ms
     http_req_connecting............: avg=17.99ms  min=0s       med=0s       max=965.49ms p(90)=30.53ms  p(95)=126.68ms
     http_req_duration..............: avg=11.56s   min=19.02ms  med=10.47s   max=37.05s   p(90)=24.24s   p(95)=28.37s  
       { expected_response:true }...: avg=11.56s   min=19.02ms  med=10.47s   max=37.05s   p(90)=24.24s   p(95)=28.37s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 7344  
     http_req_receiving.............: avg=163.23ms min=38.51µs  med=128.46µs max=8.37s    p(90)=240.62ms p(95)=987.01ms
     http_req_sending...............: avg=18.58ms  min=10.05µs  med=29.8µs   max=2.73s    p(90)=15.25ms  p(95)=53.53ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=11.38s   min=18.8ms   med=10.36s   max=37.05s   p(90)=24.2s    p(95)=28.15s  
     http_reqs......................: 7344    90.36083/s
     iteration_duration.............: avg=11.86s   min=314.74ms med=10.61s   max=39.23s   p(90)=24.72s   p(95)=28.74s  
     iterations.....................: 7324    90.114749/s
     vus............................: 151     min=0       max=2000
     vus_max........................: 2000    min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 14667     ✗ 0     
     data_received..................: 434 MB  4.7 MB/s
     data_sent......................: 6.0 MB  65 kB/s
     http_req_blocked...............: avg=242.93µs min=1.76µs   med=4.6µs    max=40.72ms p(90)=532.13µs p(95)=816.76µs
     http_req_connecting............: avg=208.6µs  min=0s       med=0s       max=40.64ms p(90)=450.08µs p(95)=709µs   
     http_req_duration..............: avg=21.81s   min=12.26ms  med=19.42s   max=44s     p(90)=41.57s   p(95)=43.09s  
       { expected_response:true }...: avg=21.81s   min=12.26ms  med=19.42s   max=44s     p(90)=41.57s   p(95)=43.09s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 4943  
     http_req_receiving.............: avg=37.59ms  min=40.64µs  med=108.49µs max=2.87s   p(90)=584.02µs p(95)=2.48ms  
     http_req_sending...............: avg=62.98µs  min=9.26µs   med=28.17µs  max=14.94ms p(90)=70.7µs   p(95)=98.45µs 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=21.77s   min=12.14ms  med=19.42s   max=44s     p(90)=41.55s   p(95)=43.08s  
     http_reqs......................: 4943    53.603791/s
     iteration_duration.............: avg=21.69s   min=221.83ms med=18.97s   max=44.25s  p(90)=41.82s   p(95)=43.28s  
     iterations.....................: 4823    52.302465/s
     vus............................: 435     min=61      max=2000
     vus_max........................: 2000    min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     █ setup

     checks.........................: 100.00% ✓ 24474     ✗ 0     
     data_received..................: 718 MB  8.4 MB/s
     data_sent......................: 9.7 MB  114 kB/s
     http_req_blocked...............: avg=13.76ms min=1.7µs   med=4.38µs  max=738.25ms p(90)=34.91ms  p(95)=102.64ms
     http_req_connecting............: avg=13.42ms min=0s      med=0s      max=560.22ms p(90)=33.88ms  p(95)=101.23ms
     http_req_duration..............: avg=10.95s  min=12.54ms med=3.17s   max=57.04s   p(90)=42.07s   p(95)=49.32s  
       { expected_response:true }...: avg=10.95s  min=12.54ms med=3.17s   max=57.04s   p(90)=42.07s   p(95)=49.32s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 8178  
     http_req_receiving.............: avg=5.03ms  min=38.38µs med=87.29µs max=637.2ms  p(90)=757.01µs p(95)=4.51ms  
     http_req_sending...............: avg=7.03ms  min=9.3µs   med=23.85µs max=736.38ms p(90)=16.15ms  p(95)=40.64ms 
     http_req_tls_handshaking.......: avg=0s      min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=10.93s  min=12.43ms med=3.16s   max=56.94s   p(90)=41.8s    p(95)=49.28s  
     http_reqs......................: 8178    96.203883/s
     iteration_duration.............: avg=11.12s  min=84.35ms med=3.27s   max=57.37s   p(90)=42.21s   p(95)=49.48s  
     iterations.....................: 8158    95.968609/s
     vus............................: 39      min=39      max=1997
     vus_max........................: 2000    min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✗ response code was 200
      ↳  93% — ✓ 7206 / ✗ 538
     ✗ no graphql errors
      ↳  93% — ✓ 7206 / ✗ 538
     ✓ valid response structure

     █ setup

     checks.........................: 95.25% ✓ 21618     ✗ 1076  
     data_received..................: 635 MB 6.8 MB/s
     data_sent......................: 9.3 MB 100 kB/s
     http_req_blocked...............: avg=669.39µs min=1.69µs  med=4.64µs  max=149.5ms  p(90)=382.37µs p(95)=673.86µs
     http_req_connecting............: avg=642.34µs min=0s      med=0s      max=149.41ms p(90)=305.85µs p(95)=530.95µs
     http_req_duration..............: avg=11.99s   min=11.94ms med=2.17s   max=1m0s     p(90)=56.05s   p(95)=59.99s  
       { expected_response:true }...: avg=8.41s    min=11.94ms med=2.07s   max=59.97s   p(90)=36.8s    p(95)=43.25s  
     http_req_failed................: 6.92%  ✓ 538       ✗ 7226  
     http_req_receiving.............: avg=257.53µs min=0s      med=112.8µs max=269.33ms p(90)=237.44µs p(95)=397.39µs
     http_req_sending...............: avg=269.28µs min=9.16µs  med=26.76µs max=84.35ms  p(90)=73.2µs   p(95)=147.29µs
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=11.99s   min=11.81ms med=2.17s   max=1m0s     p(90)=56.05s   p(95)=59.99s  
     http_reqs......................: 7764   83.680439/s
     iteration_duration.............: avg=12.03s   min=57.73ms med=2.19s   max=1m0s     p(90)=56.1s    p(95)=1m0s    
     iterations.....................: 7744   83.464879/s
     vus............................: 10     min=10      max=2000
     vus_max........................: 2000   min=2000    max=2000

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
dependencies Pull requests that update a dependency file
Projects
None yet
Development

Successfully merging this pull request may close these issues.

0 participants