Skip to content

Conversation

renovate[bot]
Copy link
Contributor

@renovate renovate bot commented Sep 4, 2025

This PR contains the following updates:

Package Change Age Confidence
@graphql-hive/gateway (source) 1.16.5 -> 2.0.0 age confidence

Release Notes

graphql-hive/gateway (@​graphql-hive/gateway)

v2.0.0

Compare Source

Major Changes
  • #​956 46d2661 Thanks @​EmrysMyrddin! - Sane security defaults, max token and depths limits enabled by default

    Max token limit defaults to 1000 (can be configured via maxTokens option) and max depth limit defaults to 8 (can be configured via maxDepth option).

  • #​956 46d2661 Thanks @​EmrysMyrddin! - Drop Node 18 support

    Least supported Node version is now v20.

  • #​956 46d2661 Thanks @​EmrysMyrddin! - useDeduplicateRequest() plugin has been removed in favour of the built-in inflight request deduplication

    To migrate, simply remove the plugin from your configuration and you're good to go!

    import {
      defineConfig,
    - useDeduplicateRequest,
    } from '@​graphql-hive/gateway'
    
    export const gatewayConfig = defineConfig({
    - plugins: ctx => [useDeduplicateRequest(ctx)]
    })

    If you still want to use the deprecated plugin, you need to install it separately and use it as before:

    npm i @​graphql-hive/plugin-deduplicate-request
    import {
      defineConfig,
      useDeduplicateRequest,
      type HTTPTransportOptions, // only for typedefs, otherwise not necessary
    } from '@​graphql-hive/gateway'
    import { useDeduplicateRequest } from '@​graphql-hive/plugin-deduplicate-request'
    
    export const gatewayConfig = defineConfig({
      transportEntries: {
        '*.http': {
          options: {
            // disable the built in deduplication
            deduplicateInflightRequests: false,
          } as HTTPTransportOptions,
        },
      },
      plugins: ctx => [useDeduplicateRequest(ctx)]
    })
  • #​956 46d2661 Thanks @​EmrysMyrddin! - Introduce and use the new Hive Logger

  • #​956 46d2661 Thanks @​EmrysMyrddin! - Disable forking even if NODE_ENV=production

    Forking workers for concurrent processing is a delicate process and if not done carefully can lead to performance degradations. It should be configured with careful consideration by advanced users.

  • #​956 46d2661 Thanks @​EmrysMyrddin! - Remove mocking plugin from Hive Gateway built-ins

    There is no need to provide the useMock plugin alongside Hive Gateway built-ins. Not only is the mock plugin 2MB in size (minified), but installing and using it is very simple.

  • #​956 46d2661 Thanks @​EmrysMyrddin! - Load schema on initialization

    Failing to start if the schema is not loaded for whatever reason.

Minor Changes
Patch Changes

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.


  • If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

@renovate renovate bot added the dependencies Pull requests that update a dependency file label Sep 4, 2025
Copy link

github-actions bot commented Sep 4, 2025

Overview for: ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 500 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 2024 126121 total, 0 failed avg: 110ms, p95: 269ms
cosmo 717 45705 total, 0 failed avg: 307ms, p95: 679ms
grafbase 511 32456 total, 0 failed avg: 433ms, p95: 955ms
apollo-router 389 26118 total, 0 failed avg: 540ms, p95: 1244ms ❌ 21 unexpected GraphQL errors
hive-gateway 289 19865 total, 0 failed avg: 708ms, p95: 1547ms
hive-gateway-bun 277 19380 total, 0 failed avg: 725ms, p95: 1621ms
apollo-gateway 153 10600 total, 0 failed avg: 1231ms, p95: 2554ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 375363      ✗ 0     
     data_received..................: 11 GB   178 MB/s
     data_sent......................: 147 MB  2.4 MB/s
     http_req_blocked...............: avg=367.11µs min=1.12µs  med=2.42µs   max=310.71ms p(90)=3.76µs   p(95)=4.45µs   p(99.9)=131.82ms
     http_req_connecting............: avg=363.8µs  min=0s      med=0s       max=310.64ms p(90)=0s       p(95)=0s       p(99.9)=131.79ms
     http_req_duration..............: avg=110.48ms min=1.83ms  med=99.46ms  max=406.05ms p(90)=224.1ms  p(95)=268.93ms p(99.9)=355.58ms
       { expected_response:true }...: avg=110.48ms min=1.83ms  med=99.46ms  max=406.05ms p(90)=224.1ms  p(95)=268.93ms p(99.9)=355.58ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 126121
     http_req_receiving.............: avg=453.33µs min=22.57µs med=40.44µs  max=129.7ms  p(90)=162.52µs p(95)=371.03µs p(99.9)=65.69ms 
     http_req_sending...............: avg=343.18µs min=5.08µs  med=9.93µs   max=145.97ms p(90)=27.86µs  p(95)=121.13µs p(99.9)=60.51ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=109.68ms min=1.77ms  med=98.75ms  max=390.42ms p(90)=221.98ms p(95)=267.18ms p(99.9)=353.3ms 
     http_reqs......................: 126121  2024.135634/s
     iteration_duration.............: avg=111.96ms min=1.95ms  med=100.67ms max=652.31ms p(90)=226.34ms p(95)=271.39ms p(99.9)=375.04ms
     iterations.....................: 125121  2008.086478/s
     success_rate...................: 100.00% ✓ 125121      ✗ 0     
     vus............................: 73      min=0         max=494 
     vus_max........................: 500     min=500       max=500 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 134115     ✗ 0    
     data_received..................: 4.0 GB  63 MB/s
     data_sent......................: 53 MB   835 kB/s
     http_req_blocked...............: avg=89.38µs  min=1.21µs  med=2.75µs   max=127.47ms p(90)=4µs      p(95)=5.3µs    p(99.9)=25.16ms
     http_req_connecting............: avg=84.15µs  min=0s      med=0s       max=127.31ms p(90)=0s       p(95)=0s       p(99.9)=24.73ms
     http_req_duration..............: avg=307.28ms min=2.81ms  med=285.88ms max=1.29s    p(90)=603.54ms p(95)=678.75ms p(99.9)=1s     
       { expected_response:true }...: avg=307.28ms min=2.81ms  med=285.88ms max=1.29s    p(90)=603.54ms p(95)=678.75ms p(99.9)=1s     
     http_req_failed................: 0.00%   ✓ 0          ✗ 45705
     http_req_receiving.............: avg=391.22µs min=26.83µs med=57.85µs  max=270.91ms p(90)=197.39µs p(95)=450.89µs p(99.9)=52.37ms
     http_req_sending...............: avg=139.87µs min=5.5µs   med=10.87µs  max=94.25ms  p(90)=29.2µs   p(95)=125.03µs p(99.9)=27.83ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=306.74ms min=2.72ms  med=285.47ms max=1.29s    p(90)=602.49ms p(95)=677.91ms p(99.9)=1s     
     http_reqs......................: 45705   717.320156/s
     iteration_duration.............: avg=314.58ms min=2.97ms  med=294.13ms max=1.29s    p(90)=607.61ms p(95)=682ms    p(99.9)=1s     
     iterations.....................: 44705   701.62559/s
     success_rate...................: 100.00% ✓ 44705      ✗ 0    
     vus............................: 94      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 94368      ✗ 0    
     data_received..................: 2.9 GB  45 MB/s
     data_sent......................: 38 MB   596 kB/s
     http_req_blocked...............: avg=358.08µs min=1.28µs  med=3.25µs   max=217.37ms p(90)=5.34µs   p(95)=9.41µs   p(99.9)=99.24ms
     http_req_connecting............: avg=348.91µs min=0s      med=0s       max=217.31ms p(90)=0s       p(95)=0s       p(99.9)=95.62ms
     http_req_duration..............: avg=432.81ms min=2.77ms  med=406.26ms max=1.46s    p(90)=858.85ms p(95)=954.8ms  p(99.9)=1.27s  
       { expected_response:true }...: avg=432.81ms min=2.77ms  med=406.26ms max=1.46s    p(90)=858.85ms p(95)=954.8ms  p(99.9)=1.27s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 32456
     http_req_receiving.............: avg=348.72µs min=26.97µs med=55.4µs   max=205.1ms  p(90)=244.36µs p(95)=516.23µs p(99.9)=53.41ms
     http_req_sending...............: avg=374.86µs min=5.91µs  med=12.7µs   max=182.51ms p(90)=114.94µs p(95)=143.33µs p(99.9)=70.53ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=432.09ms min=2.71ms  med=405.15ms max=1.46s    p(90)=858.36ms p(95)=954.17ms p(99.9)=1.27s  
     http_reqs......................: 32456   511.06764/s
     iteration_duration.............: avg=447.88ms min=2.91ms  med=427.63ms max=1.46s    p(90)=865.78ms p(95)=960.73ms p(99.9)=1.28s  
     iterations.....................: 31456   495.321164/s
     success_rate...................: 100.00% ✓ 31456      ✗ 0    
     vus............................: 85      min=0        max=498
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  99% — ✓ 25097 / ✗ 21
     ✓ valid response structure

     checks.........................: 99.97% ✓ 75333      ✗ 21   
     data_received..................: 2.3 GB 34 MB/s
     data_sent......................: 31 MB  454 kB/s
     http_req_blocked...............: avg=82.23µs  min=1.67µs  med=3.08µs   max=131.7ms  p(90)=4.89µs  p(95)=6.94µs   p(99.9)=24.12ms
     http_req_connecting............: avg=76.63µs  min=0s      med=0s       max=131.66ms p(90)=0s      p(95)=0s       p(99.9)=24.06ms
     http_req_duration..............: avg=540.02ms min=6.09ms  med=491.49ms max=1.89s    p(90)=1.11s   p(95)=1.24s    p(99.9)=1.62s  
       { expected_response:true }...: avg=540.02ms min=6.09ms  med=491.49ms max=1.89s    p(90)=1.11s   p(95)=1.24s    p(99.9)=1.62s  
     http_req_failed................: 0.00%  ✓ 0          ✗ 26118
     http_req_receiving.............: avg=108.38µs min=29.56µs med=52.7µs   max=55.83ms  p(90)=105.6µs p(95)=189.07µs p(99.9)=6.57ms 
     http_req_sending...............: avg=106.08µs min=6.79µs  med=11.64µs  max=132.14ms p(90)=30.23µs p(95)=115.99µs p(99.9)=20.36ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=539.8ms  min=6.05ms  med=491.19ms max=1.89s    p(90)=1.11s   p(95)=1.24s    p(99.9)=1.62s  
     http_reqs......................: 26118  389.241113/s
     iteration_duration.............: avg=561.89ms min=6.23ms  med=515.5ms  max=1.89s    p(90)=1.12s   p(95)=1.24s    p(99.9)=1.62s  
     iterations.....................: 25118  374.337939/s
     success_rate...................: 99.91% ✓ 25097      ✗ 21   
     vus............................: 68     min=0        max=496
     vus_max........................: 500    min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 56595      ✗ 0    
     data_received..................: 1.7 GB  25 MB/s
     data_sent......................: 23 MB   338 kB/s
     http_req_blocked...............: avg=92.57µs  min=1.27µs med=2.75µs   max=68.57ms  p(90)=4.54µs  p(95)=6.66µs   p(99.9)=24.21ms
     http_req_connecting............: avg=87.75µs  min=0s     med=0s       max=68.49ms  p(90)=0s      p(95)=0s       p(99.9)=24.15ms
     http_req_duration..............: avg=708.12ms min=6.46ms med=665.24ms max=4.09s    p(90)=1.39s   p(95)=1.54s    p(99.9)=3.06s  
       { expected_response:true }...: avg=708.12ms min=6.46ms med=665.24ms max=4.09s    p(90)=1.39s   p(95)=1.54s    p(99.9)=3.06s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 19865
     http_req_receiving.............: avg=175.67µs min=26.4µs med=43.17µs  max=88.39ms  p(90)=88.73µs p(95)=168.94µs p(99.9)=27.74ms
     http_req_sending...............: avg=178.65µs min=5.85µs med=10.81µs  max=108.63ms p(90)=29.41µs p(95)=114.95µs p(99.9)=31.86ms
     http_req_tls_handshaking.......: avg=0s       min=0s     med=0s       max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=707.77ms min=6.41ms med=664.64ms max=4.09s    p(90)=1.39s   p(95)=1.54s    p(99.9)=3.06s  
     http_reqs......................: 19865   289.254355/s
     iteration_duration.............: avg=745.95ms min=7.74ms med=708.09ms max=4.11s    p(90)=1.4s    p(95)=1.56s    p(99.9)=3.08s  
     iterations.....................: 18865   274.693351/s
     success_rate...................: 100.00% ✓ 18865      ✗ 0    
     vus............................: 101     min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 55140      ✗ 0    
     data_received..................: 1.7 GB  24 MB/s
     data_sent......................: 23 MB   325 kB/s
     http_req_blocked...............: avg=104.87µs min=1.27µs  med=2.74µs   max=154.23ms p(90)=4.71µs  p(95)=7.79µs   p(99.9)=26.6ms 
     http_req_connecting............: avg=97.59µs  min=0s      med=0s       max=154.18ms p(90)=0s      p(95)=0s       p(99.9)=26.41ms
     http_req_duration..............: avg=724.66ms min=7.01ms  med=678.17ms max=4.14s    p(90)=1.47s   p(95)=1.62s    p(99.9)=3.28s  
       { expected_response:true }...: avg=724.66ms min=7.01ms  med=678.17ms max=4.14s    p(90)=1.47s   p(95)=1.62s    p(99.9)=3.28s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 19380
     http_req_receiving.............: avg=173.65µs min=27.09µs med=44.56µs  max=92.73ms  p(90)=94µs    p(95)=180.56µs p(99.9)=25.4ms 
     http_req_sending...............: avg=171.77µs min=6.19µs  med=11.11µs  max=126.27ms p(90)=31.44µs p(95)=113.75µs p(99.9)=28.53ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=724.32ms min=6.96ms  med=677.59ms max=4.14s    p(90)=1.47s   p(95)=1.61s    p(99.9)=3.28s  
     http_reqs......................: 19380   277.841011/s
     iteration_duration.............: avg=764.4ms  min=7.22ms  med=722.65ms max=4.15s    p(90)=1.48s   p(95)=1.63s    p(99.9)=3.35s  
     iterations.....................: 18380   263.504529/s
     success_rate...................: 100.00% ✓ 18380      ✗ 0    
     vus............................: 107     min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 28800      ✗ 0    
     data_received..................: 931 MB  14 MB/s
     data_sent......................: 13 MB   184 kB/s
     http_req_blocked...............: avg=28.12µs min=1.29µs  med=3.23µs  max=32.22ms p(90)=5.2µs   p(95)=10.64µs p(99.9)=3.69ms
     http_req_connecting............: avg=22.19µs min=0s      med=0s      max=32.15ms p(90)=0s      p(95)=0s      p(99.9)=3.64ms
     http_req_duration..............: avg=1.23s   min=7.36ms  med=1.19s   max=15.55s  p(90)=2.28s   p(95)=2.55s   p(99.9)=14.36s
       { expected_response:true }...: avg=1.23s   min=7.36ms  med=1.19s   max=15.55s  p(90)=2.28s   p(95)=2.55s   p(99.9)=14.36s
     http_req_failed................: 0.00%   ✓ 0          ✗ 10600
     http_req_receiving.............: avg=75.63µs min=27.71µs med=53.67µs max=14.46ms p(90)=100µs   p(95)=128.2µs p(99.9)=1.45ms
     http_req_sending...............: avg=40.72µs min=5.98µs  med=12.63µs max=20.65ms p(90)=29.63µs p(95)=45.46µs p(99.9)=5.22ms
     http_req_tls_handshaking.......: avg=0s      min=0s      med=0s      max=0s      p(90)=0s      p(95)=0s      p(99.9)=0s    
     http_req_waiting...............: avg=1.23s   min=7.31ms  med=1.19s   max=15.55s  p(90)=2.28s   p(95)=2.55s   p(99.9)=14.36s
     http_reqs......................: 10600   153.631465/s
     iteration_duration.............: avg=1.35s   min=7.77ms  med=1.35s   max=15.57s  p(90)=2.33s   p(95)=2.64s   p(99.9)=14.56s
     iterations.....................: 9600    139.13793/s
     success_rate...................: 100.00% ✓ 9600       ✗ 0    
     vus............................: 70      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Sep 4, 2025

Overview for: constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1827 110107 total, 0 failed avg: 27ms, p95: 48ms
cosmo 686 41455 total, 0 failed avg: 72ms, p95: 106ms
grafbase 563 34019 total, 0 failed avg: 88ms, p95: 114ms
apollo-router 359 21879 total, 0 failed avg: 137ms, p95: 179ms
hive-gateway-bun 300 18337 total, 0 failed avg: 164ms, p95: 352ms
hive-gateway 294 17972 total, 0 failed avg: 167ms, p95: 311ms
apollo-gateway 118 7257 total, 0 failed avg: 414ms, p95: 487ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 330021      ✗ 0     
     data_received..................: 9.7 GB  160 MB/s
     data_sent......................: 128 MB  2.1 MB/s
     http_req_blocked...............: avg=5.13µs   min=1.13µs  med=2.61µs  max=8.86ms   p(90)=3.84µs   p(95)=4.8µs    p(99.9)=84.34µs
     http_req_connecting............: avg=2µs      min=0s      med=0s      max=8.83ms   p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_duration..............: avg=27.03ms  min=1.92ms  med=24.55ms max=440.47ms p(90)=41.4ms   p(95)=47.67ms  p(99.9)=94.37ms
       { expected_response:true }...: avg=27.03ms  min=1.92ms  med=24.55ms max=440.47ms p(90)=41.4ms   p(95)=47.67ms  p(99.9)=94.37ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 110107
     http_req_receiving.............: avg=116.98µs min=23.41µs med=43.41µs max=99.84ms  p(90)=122.96µs p(95)=348.17µs p(99.9)=11.71ms
     http_req_sending...............: avg=85.78µs  min=5.28µs  med=10.27µs max=355.46ms p(90)=32.26µs  p(95)=124.98µs p(99.9)=12.16ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=26.83ms  min=1.87ms  med=24.4ms  max=425.7ms  p(90)=41.03ms  p(95)=47.26ms  p(99.9)=92.41ms
     http_reqs......................: 110107  1827.381175/s
     iteration_duration.............: avg=27.26ms  min=4.7ms   med=24.74ms max=460.63ms p(90)=41.59ms  p(95)=47.88ms  p(99.9)=95.25ms
     iterations.....................: 110007  1825.721533/s
     success_rate...................: 100.00% ✓ 110007      ✗ 0     
     vus............................: 50      min=50        max=50  
     vus_max........................: 50      min=50        max=50  

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 124065     ✗ 0    
     data_received..................: 3.6 GB  60 MB/s
     data_sent......................: 48 MB   798 kB/s
     http_req_blocked...............: avg=13.22µs  min=1.25µs  med=2.79µs  max=16.84ms  p(90)=3.96µs  p(95)=4.67µs   p(99.9)=2.97ms  
     http_req_connecting............: avg=9.78µs   min=0s      med=0s      max=16.79ms  p(90)=0s      p(95)=0s       p(99.9)=2.91ms  
     http_req_duration..............: avg=72.12ms  min=2.85ms  med=71.04ms max=484.74ms p(90)=97.86ms p(95)=105.63ms p(99.9)=271.06ms
       { expected_response:true }...: avg=72.12ms  min=2.85ms  med=71.04ms max=484.74ms p(90)=97.86ms p(95)=105.63ms p(99.9)=271.06ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 41455
     http_req_receiving.............: avg=149.77µs min=28.54µs med=71.01µs max=96.23ms  p(90)=145.3µs p(95)=358.93µs p(99.9)=13.5ms  
     http_req_sending...............: avg=58.45µs  min=5.78µs  med=11.18µs max=271.21ms p(90)=28.63µs p(95)=118.68µs p(99.9)=7.39ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=71.91ms  min=2.78ms  med=70.86ms max=463.11ms p(90)=97.62ms p(95)=105.43ms p(99.9)=260.82ms
     http_reqs......................: 41455   686.391202/s
     iteration_duration.............: avg=72.54ms  min=5.89ms  med=71.31ms max=547.02ms p(90)=98.12ms p(95)=105.88ms p(99.9)=284.6ms 
     iterations.....................: 41355   684.735452/s
     success_rate...................: 100.00% ✓ 41355      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 101757     ✗ 0    
     data_received..................: 3.0 GB  50 MB/s
     data_sent......................: 40 MB   656 kB/s
     http_req_blocked...............: avg=14.47µs  min=1.29µs  med=3.31µs  max=13.11ms  p(90)=4.59µs   p(95)=6.46µs   p(99.9)=3.06ms  
     http_req_connecting............: avg=8.74µs   min=0s      med=0s      max=13.07ms  p(90)=0s       p(95)=0s       p(99.9)=3.04ms  
     http_req_duration..............: avg=87.86ms  min=2.52ms  med=86.57ms max=506.31ms p(90)=107.61ms p(95)=114.38ms p(99.9)=317.62ms
       { expected_response:true }...: avg=87.86ms  min=2.52ms  med=86.57ms max=506.31ms p(90)=107.61ms p(95)=114.38ms p(99.9)=317.62ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 34019
     http_req_receiving.............: avg=166.71µs min=28.93µs med=65.96µs max=140.51ms p(90)=178.76µs p(95)=421.63µs p(99.9)=7.51ms  
     http_req_sending...............: avg=115.17µs min=5.97µs  med=12.67µs max=357.34ms p(90)=107.18µs p(95)=132.82µs p(99.9)=11.83ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=87.58ms  min=2.46ms  med=86.36ms max=493.69ms p(90)=107.34ms p(95)=113.98ms p(99.9)=292.78ms
     http_reqs......................: 34019   563.737195/s
     iteration_duration.............: avg=88.45ms  min=20.9ms  med=86.97ms max=525.69ms p(90)=107.94ms p(95)=114.77ms p(99.9)=326.38ms
     iterations.....................: 33919   562.080071/s
     success_rate...................: 100.00% ✓ 33919      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 65337      ✗ 0    
     data_received..................: 1.9 GB  32 MB/s
     data_sent......................: 25 MB   419 kB/s
     http_req_blocked...............: avg=15.86µs  min=1.33µs  med=3.27µs   max=10.53ms  p(90)=4.8µs    p(95)=5.6µs    p(99.9)=5.79ms  
     http_req_connecting............: avg=11.87µs  min=0s      med=0s       max=10.49ms  p(90)=0s       p(95)=0s       p(99.9)=5.77ms  
     http_req_duration..............: avg=136.99ms min=6.24ms  med=135.95ms max=610.02ms p(90)=169.12ms p(95)=179.46ms p(99.9)=425.73ms
       { expected_response:true }...: avg=136.99ms min=6.24ms  med=135.95ms max=610.02ms p(90)=169.12ms p(95)=179.46ms p(99.9)=425.73ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 21879
     http_req_receiving.............: avg=99.03µs  min=32.57µs med=56.86µs  max=326.77ms p(90)=111.41µs p(95)=143.12µs p(99.9)=1.67ms  
     http_req_sending...............: avg=70.47µs  min=6.17µs  med=12.38µs  max=390.36ms p(90)=21.42µs  p(95)=40.02µs  p(99.9)=1.97ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=136.82ms min=6.17ms  med=135.82ms max=598.29ms p(90)=168.93ms p(95)=179.29ms p(99.9)=425.1ms 
     http_reqs......................: 21879   359.809353/s
     iteration_duration.............: avg=137.87ms min=17.57ms med=136.34ms max=638.03ms p(90)=169.43ms p(95)=179.75ms p(99.9)=426.25ms
     iterations.....................: 21779   358.164811/s
     success_rate...................: 100.00% ✓ 21779      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 54711      ✗ 0    
     data_received..................: 1.6 GB  26 MB/s
     data_sent......................: 21 MB   350 kB/s
     http_req_blocked...............: avg=29.2µs   min=1.23µs  med=2.78µs   max=23.18ms  p(90)=4.74µs   p(95)=5.96µs   p(99.9)=11.08ms 
     http_req_connecting............: avg=25.13µs  min=0s      med=0s       max=22.66ms  p(90)=0s       p(95)=0s       p(99.9)=11.05ms 
     http_req_duration..............: avg=163.5ms  min=6.86ms  med=151.31ms max=547.6ms  p(90)=183.87ms p(95)=352.07ms p(99.9)=460.94ms
       { expected_response:true }...: avg=163.5ms  min=6.86ms  med=151.31ms max=547.6ms  p(90)=183.87ms p(95)=352.07ms p(99.9)=460.94ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 18337
     http_req_receiving.............: avg=99.84µs  min=28.18µs med=49.78µs  max=19.39ms  p(90)=116.42µs p(95)=208.85µs p(99.9)=4.16ms  
     http_req_sending...............: avg=86.81µs  min=5.63µs  med=11.41µs  max=308.94ms p(90)=32.46µs  p(95)=125.28µs p(99.9)=8.57ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=163.31ms min=6.8ms   med=151.14ms max=538.26ms p(90)=183.71ms p(95)=351.8ms  p(99.9)=459.34ms
     http_reqs......................: 18337   300.526268/s
     iteration_duration.............: avg=164.68ms min=59.12ms med=151.66ms max=619.55ms p(90)=184.31ms p(95)=353.28ms p(99.9)=477.21ms
     iterations.....................: 18237   298.887362/s
     success_rate...................: 100.00% ✓ 18237      ✗ 0    
     vus............................: 28      min=28       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 53616      ✗ 0    
     data_received..................: 1.6 GB  26 MB/s
     data_sent......................: 21 MB   343 kB/s
     http_req_blocked...............: avg=45.9µs   min=1.19µs  med=2.81µs   max=21.26ms  p(90)=4.65µs   p(95)=5.78µs   p(99.9)=16.98ms 
     http_req_connecting............: avg=41.74µs  min=0s      med=0s       max=21.22ms  p(90)=0s       p(95)=0s       p(99.9)=16.95ms 
     http_req_duration..............: avg=166.68ms min=6.91ms  med=154.65ms max=1.02s    p(90)=200.52ms p(95)=311.17ms p(99.9)=832.34ms
       { expected_response:true }...: avg=166.68ms min=6.91ms  med=154.65ms max=1.02s    p(90)=200.52ms p(95)=311.17ms p(99.9)=832.34ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 17972
     http_req_receiving.............: avg=100.27µs min=25.38µs med=47.88µs  max=40.91ms  p(90)=110.48µs p(95)=239.63µs p(99.9)=4.04ms  
     http_req_sending...............: avg=60.09µs  min=5.88µs  med=11.47µs  max=237.75ms p(90)=32.93µs  p(95)=124.02µs p(99.9)=3.45ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=166.52ms min=6.86ms  med=154.53ms max=1.02s    p(90)=200.35ms p(95)=311.08ms p(99.9)=829.76ms
     http_reqs......................: 17972   294.589745/s
     iteration_duration.............: avg=168.07ms min=60.73ms med=155.1ms  max=1.1s     p(90)=201.04ms p(95)=311.52ms p(99.9)=962.18ms
     iterations.....................: 17872   292.950585/s
     success_rate...................: 100.00% ✓ 17872      ✗ 0    
     vus............................: 21      min=21       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 21471      ✗ 0   
     data_received..................: 637 MB  10 MB/s
     data_sent......................: 8.4 MB  138 kB/s
     http_req_blocked...............: avg=44.34µs  min=1.38µs  med=2.96µs   max=11.77ms  p(90)=4.7µs    p(95)=5.35µs   p(99.9)=10.28ms 
     http_req_connecting............: avg=40.91µs  min=0s      med=0s       max=11.74ms  p(90)=0s       p(95)=0s       p(99.9)=10.25ms 
     http_req_duration..............: avg=414.41ms min=7.5ms   med=414.12ms max=840.94ms p(90)=469.77ms p(95)=487.46ms p(99.9)=752.83ms
       { expected_response:true }...: avg=414.41ms min=7.5ms   med=414.12ms max=840.94ms p(90)=469.77ms p(95)=487.46ms p(99.9)=752.83ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 7257
     http_req_receiving.............: avg=62.65µs  min=29.7µs  med=51.14µs  max=4.67ms   p(90)=95.09µs  p(95)=111.95µs p(99.9)=353.73µs
     http_req_sending...............: avg=55.61µs  min=6.38µs  med=11.98µs  max=124.74ms p(90)=19.8µs   p(95)=23.03µs  p(99.9)=2.66ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=414.29ms min=7.45ms  med=414.04ms max=839.98ms p(90)=469.69ms p(95)=487.31ms p(99.9)=751.85ms
     http_reqs......................: 7257    118.632647/s
     iteration_duration.............: avg=420.64ms min=139.8ms med=414.7ms  max=908.96ms p(90)=470.48ms p(95)=488.45ms p(99.9)=856.99ms
     iterations.....................: 7157    116.997913/s
     success_rate...................: 100.00% ✓ 7157       ✗ 0   
     vus............................: 39      min=39       max=50
     vus_max........................: 50      min=50       max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Sep 4, 2025

Overview for: constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 168 13645 total, 0 failed avg: 221ms, p95: 231ms
cosmo 167 13539 total, 0 failed avg: 223ms, p95: 246ms
grafbase 167 13607 total, 0 failed avg: 222ms, p95: 236ms
hive-gateway-bun 166 12734 total, 0 failed avg: 237ms, p95: 264ms
hive-gateway 160 12269 total, 0 failed avg: 246ms, p95: 286ms
apollo-router 135 10995 total, 0 failed avg: 275ms, p95: 315ms ❌ 1 unexpected GraphQL errors
apollo-gateway 119 9760 total, 0 failed avg: 310ms, p95: 345ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40635      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   196 kB/s
     http_req_blocked...............: avg=19.04µs  min=1.11µs   med=2.02µs   max=8.86ms   p(90)=3.24µs   p(95)=4.56µs   p(99.9)=6.58ms  
     http_req_connecting............: avg=16.49µs  min=0s       med=0s       max=8.83ms   p(90)=0s       p(95)=0s       p(99.9)=6.56ms  
     http_req_duration..............: avg=221.3ms  min=162.67ms med=220.34ms max=608.97ms p(90)=228.64ms p(95)=231.34ms p(99.9)=501.39ms
       { expected_response:true }...: avg=221.3ms  min=162.67ms med=220.34ms max=608.97ms p(90)=228.64ms p(95)=231.34ms p(99.9)=501.39ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13645
     http_req_receiving.............: avg=90.45µs  min=24.55µs  med=42.69µs  max=215.54ms p(90)=88.58µs  p(95)=246.61µs p(99.9)=3.4ms   
     http_req_sending...............: avg=66.76µs  min=5.4µs    med=8.71µs   max=276.16ms p(90)=28.54µs  p(95)=97.22µs  p(99.9)=4.52ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=221.14ms min=162.62ms med=220.25ms max=594.94ms p(90)=228.5ms  p(95)=231.15ms p(99.9)=486.75ms
     http_reqs......................: 13645   168.69647/s
     iteration_duration.............: avg=221.61ms min=162.84ms med=220.55ms max=624.89ms p(90)=228.84ms p(95)=231.53ms p(99.9)=514.71ms
     iterations.....................: 13545   167.460145/s
     success_rate...................: 100.00% ✓ 13545      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40317      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   194 kB/s
     http_req_blocked...............: avg=47.22µs  min=1.23µs   med=2.69µs   max=20.49ms  p(90)=3.84µs   p(95)=4.72µs   p(99.9)=13.99ms 
     http_req_connecting............: avg=43.06µs  min=0s       med=0s       max=20.46ms  p(90)=0s       p(95)=0s       p(99.9)=13.82ms 
     http_req_duration..............: avg=222.95ms min=116.23ms med=221.75ms max=602.1ms  p(90)=240.3ms  p(95)=245.82ms p(99.9)=507.34ms
       { expected_response:true }...: avg=222.95ms min=116.23ms med=221.75ms max=602.1ms  p(90)=240.3ms  p(95)=245.82ms p(99.9)=507.34ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13539
     http_req_receiving.............: avg=499.02µs min=29.75µs  med=61.29µs  max=40.51ms  p(90)=326.97µs p(95)=723.34µs p(99.9)=29.21ms 
     http_req_sending...............: avg=126.66µs min=6.13µs   med=11.07µs  max=342.84ms p(90)=30.18µs  p(95)=115.56µs p(99.9)=5.93ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=222.32ms min=116.18ms med=221.32ms max=598.93ms p(90)=239.6ms  p(95)=245.2ms  p(99.9)=493.76ms
     http_reqs......................: 13539   167.108573/s
     iteration_duration.............: avg=223.34ms min=116.42ms med=222.13ms max=624.86ms p(90)=240.6ms  p(95)=246.14ms p(99.9)=521.62ms
     iterations.....................: 13439   165.874298/s
     success_rate...................: 100.00% ✓ 13439      ✗ 0    
     vus............................: 5       min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40521      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   195 kB/s
     http_req_blocked...............: avg=20.11µs  min=1.36µs   med=3.19µs   max=8.54ms   p(90)=4.77µs   p(95)=5.61µs   p(99.9)=6.3ms   
     http_req_connecting............: avg=16µs     min=0s       med=0s       max=8.5ms    p(90)=0s       p(95)=0s       p(99.9)=6.28ms  
     http_req_duration..............: avg=222.03ms min=205.54ms med=220.24ms max=644.06ms p(90)=232.22ms p(95)=236.34ms p(99.9)=534.31ms
       { expected_response:true }...: avg=222.03ms min=205.54ms med=220.24ms max=644.06ms p(90)=232.22ms p(95)=236.34ms p(99.9)=534.31ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13607
     http_req_receiving.............: avg=88.25µs  min=27.52µs  med=60.89µs  max=32.74ms  p(90)=106.86µs p(95)=148.49µs p(99.9)=2.31ms  
     http_req_sending...............: avg=68.59µs  min=6.06µs   med=12.76µs  max=356.31ms p(90)=22.29µs  p(95)=36.4µs   p(99.9)=3.06ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=221.88ms min=205.49ms med=220.13ms max=626.37ms p(90)=232.08ms p(95)=236.21ms p(99.9)=520.04ms
     http_reqs......................: 13607   167.782933/s
     iteration_duration.............: avg=222.4ms  min=205.66ms med=220.55ms max=661.52ms p(90)=232.51ms p(95)=236.64ms p(99.9)=546.58ms
     iterations.....................: 13507   166.549869/s
     success_rate...................: 100.00% ✓ 13507      ✗ 0    
     vus............................: 25      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 37902      ✗ 0    
     data_received..................: 1.1 GB  15 MB/s
     data_sent......................: 15 MB   194 kB/s
     http_req_blocked...............: avg=47.21µs  min=1.15µs   med=2.52µs   max=19.51ms  p(90)=4.04µs   p(95)=5.07µs   p(99.9)=14.46ms 
     http_req_connecting............: avg=43.33µs  min=0s       med=0s       max=19.39ms  p(90)=0s       p(95)=0s       p(99.9)=13.95ms 
     http_req_duration..............: avg=236.79ms min=145.31ms med=228.67ms max=980.82ms p(90)=251.27ms p(95)=263.76ms p(99.9)=967.52ms
       { expected_response:true }...: avg=236.79ms min=145.31ms med=228.67ms max=980.82ms p(90)=251.27ms p(95)=263.76ms p(99.9)=967.52ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12734
     http_req_receiving.............: avg=87.92µs  min=24.6µs   med=43.98µs  max=87.72ms  p(90)=96.23µs  p(95)=182.44µs p(99.9)=3.09ms  
     http_req_sending...............: avg=95.5µs   min=5.33µs   med=10.65µs  max=186.66ms p(90)=31.97µs  p(95)=115.75µs p(99.9)=5.2ms   
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=236.6ms  min=143.91ms med=228.55ms max=980.74ms p(90)=251.06ms p(95)=263.45ms p(99.9)=967.01ms
     http_reqs......................: 12734   166.574623/s
     iteration_duration.............: avg=237.78ms min=145.65ms med=228.99ms max=980.92ms p(90)=251.56ms p(95)=264.05ms p(99.9)=968ms   
     iterations.....................: 12634   165.266514/s
     success_rate...................: 100.00% ✓ 12634      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 36507      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 14 MB   186 kB/s
     http_req_blocked...............: avg=23.85µs  min=1.17µs   med=2.72µs   max=10.38ms  p(90)=4.52µs   p(95)=5.93µs   p(99.9)=7.64ms  
     http_req_connecting............: avg=20.06µs  min=0s       med=0s       max=10.34ms  p(90)=0s       p(95)=0s       p(99.9)=7.59ms  
     http_req_duration..............: avg=245.77ms min=160.99ms med=238.52ms max=827.16ms p(90)=262.61ms p(95)=285.5ms  p(99.9)=673.23ms
       { expected_response:true }...: avg=245.77ms min=160.99ms med=238.52ms max=827.16ms p(90)=262.61ms p(95)=285.5ms  p(99.9)=673.23ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12269
     http_req_receiving.............: avg=100.3µs  min=24.38µs  med=45.92µs  max=102.78ms p(90)=104.83µs p(95)=171.89µs p(99.9)=3.03ms  
     http_req_sending...............: avg=79.46µs  min=5.53µs   med=11.02µs  max=170.06ms p(90)=31.69µs  p(95)=120.03µs p(99.9)=5.02ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=245.59ms min=160.9ms  med=238.42ms max=788.9ms  p(90)=262.44ms p(95)=284.88ms p(99.9)=671.83ms
     http_reqs......................: 12269   160.186406/s
     iteration_duration.............: avg=246.79ms min=176.23ms med=238.88ms max=867.89ms p(90)=262.89ms p(95)=287.32ms p(99.9)=718.75ms
     iterations.....................: 12169   158.880787/s
     success_rate...................: 100.00% ✓ 12169      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  99% — ✓ 10894 / ✗ 1
     ✓ valid response structure

     checks.........................: 99.99% ✓ 32684      ✗ 1    
     data_received..................: 965 MB 12 MB/s
     data_sent......................: 13 MB  157 kB/s
     http_req_blocked...............: avg=22.98µs  min=1.53µs   med=2.87µs   max=7.84ms   p(90)=4.2µs    p(95)=5.38µs   p(99.9)=6.21ms  
     http_req_connecting............: avg=18.52µs  min=0s       med=0s       max=7.8ms    p(90)=0s       p(95)=0s       p(99.9)=6.19ms  
     http_req_duration..............: avg=274.76ms min=167.84ms med=276.06ms max=694.38ms p(90)=306.96ms p(95)=314.97ms p(99.9)=611ms   
       { expected_response:true }...: avg=274.76ms min=167.84ms med=276.06ms max=694.38ms p(90)=306.96ms p(95)=314.97ms p(99.9)=611ms   
     http_req_failed................: 0.00%  ✓ 0          ✗ 10995
     http_req_receiving.............: avg=130.07µs min=29.29µs  med=52.51µs  max=11.46ms  p(90)=158.71µs p(95)=453.78µs p(99.9)=6.2ms   
     http_req_sending...............: avg=127.45µs min=6.14µs   med=11.39µs  max=250.96ms p(90)=88.91µs  p(95)=137.56µs p(99.9)=4.98ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=274.5ms  min=167.78ms med=275.9ms  max=692.79ms p(90)=306.77ms p(95)=314.69ms p(99.9)=610.22ms
     http_reqs......................: 10995  135.197232/s
     iteration_duration.............: avg=275.73ms min=168.03ms med=276.59ms max=727.46ms p(90)=307.45ms p(95)=315.39ms p(99.9)=634.11ms
     iterations.....................: 10895  133.967607/s
     success_rate...................: 99.99% ✓ 10894      ✗ 1    
     vus............................: 50     min=0        max=50 
     vus_max........................: 50     min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 28980      ✗ 0   
     data_received..................: 857 MB  11 MB/s
     data_sent......................: 11 MB   139 kB/s
     http_req_blocked...............: avg=63.43µs  min=1.34µs   med=4.02µs   max=22.43ms  p(90)=5.94µs   p(95)=7.19µs   p(99.9)=17.62ms 
     http_req_connecting............: avg=56.93µs  min=0s       med=0s       max=22.39ms  p(90)=0s       p(95)=0s       p(99.9)=17.49ms 
     http_req_duration..............: avg=309.65ms min=211.92ms med=307.66ms max=803.65ms p(90)=334.84ms p(95)=344.99ms p(99.9)=726.12ms
       { expected_response:true }...: avg=309.65ms min=211.92ms med=307.66ms max=803.65ms p(90)=334.84ms p(95)=344.99ms p(99.9)=726.12ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 9760
     http_req_receiving.............: avg=109.6µs  min=31.77µs  med=82.67µs  max=108.59ms p(90)=140.35µs p(95)=170.33µs p(99.9)=2.11ms  
     http_req_sending...............: avg=150.47µs min=6.33µs   med=16.32µs  max=349.96ms p(90)=29.85µs  p(95)=45.95µs  p(99.9)=4.76ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=309.39ms min=211.83ms med=307.53ms max=802.43ms p(90)=334.7ms  p(95)=344.61ms p(99.9)=712.97ms
     http_reqs......................: 9760    119.540101/s
     iteration_duration.............: avg=311.14ms min=221.62ms med=308.18ms max=874.1ms  p(90)=335.34ms p(95)=345.61ms p(99.9)=764.08ms
     iterations.....................: 9660    118.315305/s
     success_rate...................: 100.00% ✓ 9660       ✗ 0   
     vus............................: 50      min=0        max=50
     vus_max........................: 50      min=50       max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Sep 4, 2025

Overview for: constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 168 13652 total, 0 failed avg: 221ms, p95: 234ms
hive-router 167 13591 total, 0 failed avg: 223ms, p95: 233ms
cosmo 160 13038 total, 0 failed avg: 232ms, p95: 254ms
hive-gateway 150 11508 total, 0 failed avg: 262ms, p95: 363ms
hive-gateway-bun 150 11518 total, 0 failed avg: 262ms, p95: 374ms
apollo-router 126 10267 total, 0 failed avg: 295ms, p95: 340ms
apollo-gateway 84 6947 total, 0 failed avg: 435ms, p95: 481ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40656      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   196 kB/s
     http_req_blocked...............: avg=49.28µs  min=1.53µs   med=3.56µs   max=17.1ms   p(90)=5.64µs   p(95)=6.53µs   p(99.9)=14.18ms 
     http_req_connecting............: avg=44.1µs   min=0s       med=0s       max=16.85ms  p(90)=0s       p(95)=0s       p(99.9)=14.16ms 
     http_req_duration..............: avg=221.26ms min=205.69ms med=219.43ms max=661.33ms p(90)=230.35ms p(95)=234.37ms p(99.9)=535.15ms
       { expected_response:true }...: avg=221.26ms min=205.69ms med=219.43ms max=661.33ms p(90)=230.35ms p(95)=234.37ms p(99.9)=535.15ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13652
     http_req_receiving.............: avg=95.17µs  min=30.35µs  med=70.71µs  max=42.04ms  p(90)=121.13µs p(95)=158.88µs p(99.9)=2.63ms  
     http_req_sending...............: avg=102.11µs min=6.41µs   med=13.97µs  max=321.82ms p(90)=27.44µs  p(95)=42.32µs  p(99.9)=5.32ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=221.06ms min=205.63ms med=219.31ms max=653.56ms p(90)=230.2ms  p(95)=234.17ms p(99.9)=532.49ms
     http_reqs......................: 13652   168.261651/s
     iteration_duration.............: avg=221.74ms min=205.88ms med=219.77ms max=683.67ms p(90)=230.64ms p(95)=234.63ms p(99.9)=571.52ms
     iterations.....................: 13552   167.029146/s
     success_rate...................: 100.00% ✓ 13552      ✗ 0    
     vus............................: 35      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40473      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   195 kB/s
     http_req_blocked...............: avg=20.32µs  min=1.19µs   med=2.27µs   max=9.51ms   p(90)=3.18µs   p(95)=4.51µs   p(99.9)=6.99ms  
     http_req_connecting............: avg=17.59µs  min=0s       med=0s       max=9.48ms   p(90)=0s       p(95)=0s       p(99.9)=6.97ms  
     http_req_duration..............: avg=222.76ms min=159.7ms  med=221.97ms max=611.9ms  p(90)=230.58ms p(95)=232.93ms p(99.9)=525.07ms
       { expected_response:true }...: avg=222.76ms min=159.7ms  med=221.97ms max=611.9ms  p(90)=230.58ms p(95)=232.93ms p(99.9)=525.07ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13591
     http_req_receiving.............: avg=74.23µs  min=23.78µs  med=42.73µs  max=10.93ms  p(90)=85.33µs  p(95)=251.98µs p(99.9)=1.19ms  
     http_req_sending...............: avg=179.6µs  min=5.75µs   med=9.58µs   max=379.91ms p(90)=30.12µs  p(95)=94.33µs  p(99.9)=5.67ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=222.51ms min=159.39ms med=221.86ms max=610ms    p(90)=230.44ms p(95)=232.79ms p(99.9)=505.73ms
     http_reqs......................: 13591   167.839491/s
     iteration_duration.............: avg=223.09ms min=159.89ms med=222.2ms  max=628.49ms p(90)=230.76ms p(95)=233.11ms p(99.9)=530.09ms
     iterations.....................: 13491   166.60456/s
     success_rate...................: 100.00% ✓ 13491      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 38814      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 15 MB   187 kB/s
     http_req_blocked...............: avg=52.86µs  min=1.5µs    med=2.58µs   max=17.35ms  p(90)=3.81µs   p(95)=4.62µs   p(99.9)=15.14ms 
     http_req_connecting............: avg=49.52µs  min=0s       med=0s       max=17.13ms  p(90)=0s       p(95)=0s       p(99.9)=15.11ms 
     http_req_duration..............: avg=231.81ms min=160.9ms  med=232.01ms max=620.06ms p(90)=248.53ms p(95)=254.21ms p(99.9)=506.05ms
       { expected_response:true }...: avg=231.81ms min=160.9ms  med=232.01ms max=620.06ms p(90)=248.53ms p(95)=254.21ms p(99.9)=506.05ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13038
     http_req_receiving.............: avg=316.22µs min=32.28µs  med=65.53µs  max=94.2ms   p(90)=176.63µs p(95)=444.99µs p(99.9)=27.35ms 
     http_req_sending...............: avg=110.67µs min=6.54µs   med=10.86µs  max=259.83ms p(90)=26.59µs  p(95)=91.79µs  p(99.9)=6.22ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=231.38ms min=160.5ms  med=231.72ms max=615.63ms p(90)=247.93ms p(95)=253.58ms p(99.9)=503.49ms
     http_reqs......................: 13038   160.84499/s
     iteration_duration.............: avg=232.31ms min=161.11ms med=232.33ms max=644.13ms p(90)=248.8ms  p(95)=254.53ms p(99.9)=541.31ms
     iterations.....................: 12938   159.611327/s
     success_rate...................: 100.00% ✓ 12938      ✗ 0    
     vus............................: 49      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 34224      ✗ 0    
     data_received..................: 1.0 GB  13 MB/s
     data_sent......................: 13 MB   175 kB/s
     http_req_blocked...............: avg=28.3µs   min=1.13µs   med=2.68µs   max=11.96ms  p(90)=4.19µs   p(95)=5.52µs   p(99.9)=9.06ms  
     http_req_connecting............: avg=24.78µs  min=0s       med=0s       max=11.88ms  p(90)=0s       p(95)=0s       p(99.9)=9.01ms  
     http_req_duration..............: avg=262.33ms min=160.98ms med=253.54ms max=848.53ms p(90)=278.66ms p(95)=362.96ms p(99.9)=718.6ms 
       { expected_response:true }...: avg=262.33ms min=160.98ms med=253.54ms max=848.53ms p(90)=278.66ms p(95)=362.96ms p(99.9)=718.6ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 11508
     http_req_receiving.............: avg=97.62µs  min=24.84µs  med=46.3µs   max=39.93ms  p(90)=109.65µs p(95)=358.19µs p(99.9)=3.55ms  
     http_req_sending...............: avg=146.64µs min=5.34µs   med=11.06µs  max=287.05ms p(90)=36.08µs  p(95)=133.53µs p(99.9)=9.2ms   
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=262.08ms min=160.88ms med=253.4ms  max=836.11ms p(90)=278.39ms p(95)=362.71ms p(99.9)=717.71ms
     http_reqs......................: 11508   150.226802/s
     iteration_duration.............: avg=263.54ms min=207.32ms med=253.88ms max=868.4ms  p(90)=279.12ms p(95)=363.42ms p(99.9)=734.41ms
     iterations.....................: 11408   148.92139/s
     success_rate...................: 100.00% ✓ 11408      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 34254      ✗ 0    
     data_received..................: 1.0 GB  13 MB/s
     data_sent......................: 13 MB   175 kB/s
     http_req_blocked...............: avg=27.62µs  min=1.16µs   med=2.59µs   max=11.3ms   p(90)=4.18µs   p(95)=5.59µs   p(99.9)=8.8ms   
     http_req_connecting............: avg=24.23µs  min=0s       med=0s       max=11.27ms  p(90)=0s       p(95)=0s       p(99.9)=8.75ms  
     http_req_duration..............: avg=261.85ms min=160.83ms med=252.35ms max=717.88ms p(90)=274.12ms p(95)=374.06ms p(99.9)=636.14ms
       { expected_response:true }...: avg=261.85ms min=160.83ms med=252.35ms max=717.88ms p(90)=274.12ms p(95)=374.06ms p(99.9)=636.14ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11518
     http_req_receiving.............: avg=90.14µs  min=24.48µs  med=45.53µs  max=12.08ms  p(90)=110.6µs  p(95)=368.84µs p(99.9)=3.28ms  
     http_req_sending...............: avg=102.39µs min=5.73µs   med=10.91µs  max=189.61ms p(90)=36.98µs  p(95)=135.73µs p(99.9)=7.15ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=261.66ms min=160.74ms med=252.21ms max=717.09ms p(90)=273.8ms  p(95)=373.83ms p(99.9)=635.11ms
     http_reqs......................: 11518   150.329873/s
     iteration_duration.............: avg=263.06ms min=178.68ms med=252.63ms max=772.64ms p(90)=274.48ms p(95)=375.17ms p(99.9)=673.43ms
     iterations.....................: 11418   149.0247/s
     success_rate...................: 100.00% ✓ 11418      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 30501      ✗ 0    
     data_received..................: 901 MB  11 MB/s
     data_sent......................: 12 MB   147 kB/s
     http_req_blocked...............: avg=22.46µs  min=1.76µs   med=2.81µs   max=7.59ms   p(90)=4.17µs   p(95)=5.12µs   p(99.9)=6.13ms  
     http_req_connecting............: avg=19.01µs  min=0s       med=0s       max=7.56ms   p(90)=0s       p(95)=0s       p(99.9)=6.12ms  
     http_req_duration..............: avg=295.02ms min=183.84ms med=296.34ms max=713.42ms p(90)=330.88ms p(95)=340.4ms  p(99.9)=605.7ms 
       { expected_response:true }...: avg=295.02ms min=183.84ms med=296.34ms max=713.42ms p(90)=330.88ms p(95)=340.4ms  p(99.9)=605.7ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 10267
     http_req_receiving.............: avg=87.14µs  min=34.31µs  med=51.45µs  max=10.67ms  p(90)=102.95µs p(95)=238.75µs p(99.9)=1.47ms  
     http_req_sending...............: avg=133.23µs min=7.79µs   med=11.06µs  max=252.67ms p(90)=29.36µs  p(95)=136.04µs p(99.9)=3.97ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=294.8ms  min=178.79ms med=296.22ms max=703.91ms p(90)=330.63ms p(95)=340.13ms p(99.9)=604.36ms
     http_reqs......................: 10267   126.039507/s
     iteration_duration.............: avg=296.2ms  min=184.05ms med=296.96ms max=727.96ms p(90)=331.29ms p(95)=340.75ms p(99.9)=650.65ms
     iterations.....................: 10167   124.811889/s
     success_rate...................: 100.00% ✓ 10167      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 20541     ✗ 0   
     data_received..................: 610 MB  7.5 MB/s
     data_sent......................: 8.1 MB  99 kB/s
     http_req_blocked...............: avg=106.97µs min=1.42µs   med=3.4µs    max=22ms     p(90)=5.29µs   p(95)=6µs      p(99.9)=18.39ms
     http_req_connecting............: avg=102.36µs min=0s       med=0s       max=21.95ms  p(90)=0s       p(95)=0s       p(99.9)=18.26ms
     http_req_duration..............: avg=435.43ms min=212.02ms med=438.48ms max=1s       p(90)=465.85ms p(95)=480.68ms p(99.9)=913.6ms
       { expected_response:true }...: avg=435.43ms min=212.02ms med=438.48ms max=1s       p(90)=465.85ms p(95)=480.68ms p(99.9)=913.6ms
     http_req_failed................: 0.00%   ✓ 0         ✗ 6947
     http_req_receiving.............: avg=123.02µs min=31.61µs  med=67.97µs  max=322.75ms p(90)=113.35µs p(95)=132.89µs p(99.9)=462.4µs
     http_req_sending...............: avg=49.19µs  min=6.79µs   med=14.38µs  max=114.2ms  p(90)=22.76µs  p(95)=32.06µs  p(99.9)=3.11ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=435.26ms min=211.92ms med=438.38ms max=997.03ms p(90)=465.7ms  p(95)=480.56ms p(99.9)=886.9ms
     http_reqs......................: 6947    84.973163/s
     iteration_duration.............: avg=439.43ms min=265.24ms med=438.97ms max=1.04s    p(90)=466.41ms p(95)=481.35ms p(99.9)=1.02s  
     iterations.....................: 6847    83.749999/s
     success_rate...................: 100.00% ✓ 6847      ✗ 0   
     vus............................: 50      min=0       max=50
     vus_max........................: 50      min=50      max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@ardatan ardatan force-pushed the renovate/major-graphql-hive-gateway-monorepo branch from 9064339 to 5b5ce4b Compare September 4, 2025 23:35
Copy link
Contributor Author

renovate bot commented Sep 4, 2025

Edited/Blocked Notification

Renovate will not automatically rebase this PR, because it does not recognize the last commit author and assumes somebody else may have edited the PR.

You can manually request rebase by checking the rebase/retry box above.

⚠️ Warning: custom changes will be lost.

@ardatan ardatan merged commit 350052f into main Sep 4, 2025
33 checks passed
@ardatan ardatan deleted the renovate/major-graphql-hive-gateway-monorepo branch September 4, 2025 23:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant