Skip to content

Conversation

@renovate
Copy link
Contributor

@renovate renovate bot commented Sep 7, 2025

This PR contains the following updates:

Package Change Age Confidence
@graphql-hive/gateway (source) 2.0.4 -> 2.1.0 age confidence

Release Notes

graphql-hive/gateway (@​graphql-hive/gateway)

v2.1.0

Compare Source

Minor Changes
  • #​1458 6495780 Thanks @​ardatan! - New directive @pubsubPublish to publish the payload to the pubsub engine directly

            extend schema
              @​link(
                url: "https://specs.apollo.dev/federation/v2.6"
                import: ["@​key", "@​composeDirective"]
              )
              @​link(
                url: "https://the-guild.dev/mesh/v1.0"
                import: ["@​pubsubOperation", "@​pubsubPublish"]
              )
              @​composeDirective(name: "@​pubsubOperation")
              @​composeDirective(name: "@​pubsubPublish")
    
            directive @​pubsubOperation(
              pubsubTopic: String!
              filterBy: String
              result: String
            ) on FIELD_DEFINITION
    
            directive @​pubsubPublish(pubsubTopic: String!) on FIELD_DEFINITION
    
            type Query {
              hello: String!
            }
            type Product @​key(fields: "id") {
              id: ID!
              name: String!
              price: Float!
            }
    
            type Mutation {
              createProduct(name: String!, price: Float!): Product!
                @​pubsubPublish(pubsubTopic: "new_product")
            }
    
            type Subscription {
              newProductSubgraph: Product!
                @​pubsubOperation(pubsubTopic: "new_product")
            }
Patch Changes

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.


  • If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

@renovate renovate bot added the dependencies Pull requests that update a dependency file label Sep 7, 2025
@github-actions
Copy link

github-actions bot commented Sep 7, 2025

💻 Website Preview

The latest changes are available as preview in: https://7d4d43d1.federation-gateway-benchmark.pages.dev

@github-actions
Copy link

github-actions bot commented Sep 7, 2025

Overview for: constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1905 114816 total, 0 failed avg: 26ms, p95: 46ms
grafbase 1700 102553 total, 0 failed avg: 29ms, p95: 51ms
cosmo 673 40691 total, 0 failed avg: 74ms, p95: 107ms
apollo-router 379 23049 total, 0 failed avg: 130ms, p95: 170ms
hive-gateway 314 19202 total, 0 failed avg: 156ms, p95: 197ms
hive-gateway-bun 304 18634 total, 0 failed avg: 161ms, p95: 336ms
apollo-gateway 117 7196 total, 0 failed avg: 418ms, p95: 492ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 344148      ✗ 0     
     data_received..................: 10 GB   167 MB/s
     data_sent......................: 134 MB  2.2 MB/s
     http_req_blocked...............: avg=4.87µs   min=1.11µs  med=2.44µs  max=8.75ms   p(90)=3.52µs   p(95)=4.16µs   p(99.9)=85.28µs
     http_req_connecting............: avg=1.95µs   min=0s      med=0s      max=8.72ms   p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_duration..............: avg=25.93ms  min=1.85ms  med=23.65ms max=434.49ms p(90)=39.47ms  p(95)=45.55ms  p(99.9)=84.31ms
       { expected_response:true }...: avg=25.93ms  min=1.85ms  med=23.65ms max=434.49ms p(90)=39.47ms  p(95)=45.55ms  p(99.9)=84.31ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 114816
     http_req_receiving.............: avg=107.24µs min=22.35µs med=41.03µs max=65.68ms  p(90)=102.86µs p(95)=318.27µs p(99.9)=11.22ms
     http_req_sending...............: avg=82.61µs  min=5.1µs   med=9.81µs  max=374.91ms p(90)=28.44µs  p(95)=116.9µs  p(99.9)=10.31ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=25.74ms  min=1.81ms  med=23.51ms max=420.26ms p(90)=39.13ms  p(95)=45.2ms   p(99.9)=82.66ms
     http_reqs......................: 114816  1905.559306/s
     iteration_duration.............: avg=26.14ms  min=5.26ms  med=23.84ms max=449.9ms  p(90)=39.67ms  p(95)=45.76ms  p(99.9)=85.75ms
     iterations.....................: 114716  1903.899642/s
     success_rate...................: 100.00% ✓ 114716      ✗ 0     
     vus............................: 50      min=50        max=50  
     vus_max........................: 50      min=50        max=50  

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 307359      ✗ 0     
     data_received..................: 9.0 GB  149 MB/s
     data_sent......................: 119 MB  2.0 MB/s
     http_req_blocked...............: avg=6.13µs   min=1.14µs  med=2.97µs  max=9.97ms   p(90)=4.08µs   p(95)=5µs      p(99.9)=115.05µs
     http_req_connecting............: avg=2.5µs    min=0s      med=0s      max=9.93ms   p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_duration..............: avg=29.02ms  min=2.55ms  med=26.05ms max=445.63ms p(90)=44.28ms  p(95)=50.85ms  p(99.9)=82.57ms 
       { expected_response:true }...: avg=29.02ms  min=2.55ms  med=26.05ms max=445.63ms p(90)=44.28ms  p(95)=50.85ms  p(99.9)=82.57ms 
     http_req_failed................: 0.00%   ✓ 0           ✗ 102553
     http_req_receiving.............: avg=134.31µs min=25.16µs med=47.55µs max=109.11ms p(90)=144.48µs p(95)=375.97µs p(99.9)=13.86ms 
     http_req_sending...............: avg=98.37µs  min=5.04µs  med=11.41µs max=323.65ms p(90)=36.98µs  p(95)=129.75µs p(99.9)=12.94ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=28.79ms  min=2.51ms  med=25.89ms max=433.89ms p(90)=43.86ms  p(95)=50.4ms   p(99.9)=80.13ms 
     http_reqs......................: 102553  1700.159513/s
     iteration_duration.............: avg=29.27ms  min=7.22ms  med=26.27ms max=468.93ms p(90)=44.49ms  p(95)=51.07ms  p(99.9)=84.33ms 
     iterations.....................: 102453  1698.501678/s
     success_rate...................: 100.00% ✓ 102453      ✗ 0     
     vus............................: 50      min=50        max=50  
     vus_max........................: 50      min=50        max=50  

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 121773     ✗ 0    
     data_received..................: 3.6 GB  59 MB/s
     data_sent......................: 47 MB   783 kB/s
     http_req_blocked...............: avg=14.11µs min=1.31µs med=2.81µs  max=20.26ms  p(90)=4.01µs   p(95)=4.77µs   p(99.9)=3.8ms   
     http_req_connecting............: avg=10.63µs min=0s     med=0s      max=20.23ms  p(90)=0s       p(95)=0s       p(99.9)=3.75ms  
     http_req_duration..............: avg=73.5ms  min=2.82ms med=72.58ms max=491.69ms p(90)=99.45ms  p(95)=107.11ms p(99.9)=273.89ms
       { expected_response:true }...: avg=73.5ms  min=2.82ms med=72.58ms max=491.69ms p(90)=99.45ms  p(95)=107.11ms p(99.9)=273.89ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 40691
     http_req_receiving.............: avg=162.2µs min=29.5µs med=74.21µs max=65.11ms  p(90)=152.76µs p(95)=366.42µs p(99.9)=14.22ms 
     http_req_sending...............: avg=70.53µs min=5.62µs med=11.34µs max=268.66ms p(90)=29.45µs  p(95)=120.84µs p(99.9)=7.7ms   
     http_req_tls_handshaking.......: avg=0s      min=0s     med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=73.27ms min=2.75ms med=72.4ms  max=461.08ms p(90)=99.19ms  p(95)=106.72ms p(99.9)=262.87ms
     http_reqs......................: 40691   673.241163/s
     iteration_duration.............: avg=73.93ms min=7.4ms  med=72.87ms max=552.21ms p(90)=99.68ms  p(95)=107.36ms p(99.9)=282.89ms
     iterations.....................: 40591   671.586642/s
     success_rate...................: 100.00% ✓ 40591      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 68847      ✗ 0    
     data_received..................: 2.0 GB  33 MB/s
     data_sent......................: 27 MB   441 kB/s
     http_req_blocked...............: avg=18.93µs  min=1.88µs  med=2.97µs   max=13.42ms  p(90)=4.28µs   p(95)=5µs      p(99.9)=7.57ms  
     http_req_connecting............: avg=15.41µs  min=0s      med=0s       max=13.27ms  p(90)=0s       p(95)=0s       p(99.9)=7.53ms  
     http_req_duration..............: avg=129.96ms min=5.92ms  med=129.15ms max=553.03ms p(90)=160.88ms p(95)=169.96ms p(99.9)=386.84ms
       { expected_response:true }...: avg=129.96ms min=5.92ms  med=129.15ms max=553.03ms p(90)=160.88ms p(95)=169.96ms p(99.9)=386.84ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 23049
     http_req_receiving.............: avg=76.44µs  min=37.11µs med=53.59µs  max=10.91ms  p(90)=100.19µs p(95)=125.04µs p(99.9)=1.41ms  
     http_req_sending...............: avg=95.54µs  min=7.45µs  med=11.71µs  max=277.23ms p(90)=19.49µs  p(95)=34.08µs  p(99.9)=8.83ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=129.79ms min=5.85ms  med=129.03ms max=544.08ms p(90)=160.77ms p(95)=169.83ms p(99.9)=382.72ms
     http_reqs......................: 23049   379.452116/s
     iteration_duration.............: avg=130.78ms min=16.21ms med=129.49ms max=625.42ms p(90)=161.17ms p(95)=170.25ms p(99.9)=405.61ms
     iterations.....................: 22949   377.805832/s
     success_rate...................: 100.00% ✓ 22949      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 57306      ✗ 0    
     data_received..................: 1.7 GB  28 MB/s
     data_sent......................: 22 MB   366 kB/s
     http_req_blocked...............: avg=36.18µs  min=1.16µs  med=2.73µs   max=18.23ms  p(90)=4.5µs    p(95)=5.6µs    p(99.9)=14.2ms  
     http_req_connecting............: avg=32.06µs  min=0s      med=0s       max=18.19ms  p(90)=0s       p(95)=0s       p(99.9)=14.17ms 
     http_req_duration..............: avg=156.08ms min=7.21ms  med=144.66ms max=949.92ms p(90)=172.03ms p(95)=196.87ms p(99.9)=942.63ms
       { expected_response:true }...: avg=156.08ms min=7.21ms  med=144.66ms max=949.92ms p(90)=172.03ms p(95)=196.87ms p(99.9)=942.63ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 19202
     http_req_receiving.............: avg=103.38µs min=25.72µs med=45.89µs  max=245.48ms p(90)=106.04µs p(95)=197.67µs p(99.9)=3.88ms  
     http_req_sending...............: avg=91.39µs  min=5.55µs  med=11.21µs  max=422.91ms p(90)=32.59µs  p(95)=121.24µs p(99.9)=7.47ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=155.88ms min=7.15ms  med=144.53ms max=949.84ms p(90)=171.85ms p(95)=196.52ms p(99.9)=942.57ms
     http_reqs......................: 19202   314.901736/s
     iteration_duration.............: avg=157.21ms min=33.97ms med=145ms    max=950.13ms p(90)=172.48ms p(95)=197.47ms p(99.9)=942.92ms
     iterations.....................: 19102   313.261794/s
     success_rate...................: 100.00% ✓ 19102      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 55602      ✗ 0    
     data_received..................: 1.6 GB  27 MB/s
     data_sent......................: 22 MB   354 kB/s
     http_req_blocked...............: avg=39.7µs   min=1.21µs  med=2.81µs   max=22.8ms   p(90)=4.56µs   p(95)=5.39µs   p(99.9)=14.55ms 
     http_req_connecting............: avg=35.81µs  min=0s      med=0s       max=22.77ms  p(90)=0s       p(95)=0s       p(99.9)=14.44ms 
     http_req_duration..............: avg=160.96ms min=7.27ms  med=176.62ms max=588.44ms p(90)=238.57ms p(95)=335.69ms p(99.9)=500.55ms
       { expected_response:true }...: avg=160.96ms min=7.27ms  med=176.62ms max=588.44ms p(90)=238.57ms p(95)=335.69ms p(99.9)=500.55ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 18634
     http_req_receiving.............: avg=97.35µs  min=26.18µs med=45.58µs  max=125.97ms p(90)=98.83µs  p(95)=144.54µs p(99.9)=3.14ms  
     http_req_sending...............: avg=100.36µs min=5.88µs  med=11.48µs  max=267.31ms p(90)=28.83µs  p(95)=77.94µs  p(99.9)=6.83ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=160.77ms min=7.22ms  med=176.28ms max=570.41ms p(90)=238.32ms p(95)=334.71ms p(99.9)=498.87ms
     http_reqs......................: 18634   304.368672/s
     iteration_duration.............: avg=162.08ms min=35.75ms med=177.79ms max=627.46ms p(90)=239.09ms p(95)=344ms    p(99.9)=502.38ms
     iterations.....................: 18534   302.735267/s
     success_rate...................: 100.00% ✓ 18534      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 21288      ✗ 0   
     data_received..................: 632 MB  10 MB/s
     data_sent......................: 8.4 MB  137 kB/s
     http_req_blocked...............: avg=111.74µs min=1.15µs  med=3.09µs   max=30.82ms  p(90)=4.6µs    p(95)=5.39µs   p(99.9)=25.56ms 
     http_req_connecting............: avg=107.47µs min=0s      med=0s       max=29.7ms   p(90)=0s       p(95)=0s       p(99.9)=25.36ms 
     http_req_duration..............: avg=417.86ms min=7.44ms  med=417.18ms max=790.44ms p(90)=474.36ms p(95)=492.11ms p(99.9)=736.28ms
       { expected_response:true }...: avg=417.86ms min=7.44ms  med=417.18ms max=790.44ms p(90)=474.36ms p(95)=492.11ms p(99.9)=736.28ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 7196
     http_req_receiving.............: avg=61.82µs  min=31.05µs med=52.1µs   max=1.11ms   p(90)=92.73µs  p(95)=107.5µs  p(99.9)=270.03µs
     http_req_sending...............: avg=112.26µs min=5.67µs  med=12.4µs   max=97.34ms  p(90)=19.11µs  p(95)=24.28µs  p(99.9)=9.23ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=417.69ms min=7.39ms  med=417.1ms  max=782.11ms p(90)=474.1ms  p(95)=492.05ms p(99.9)=727.92ms
     http_reqs......................: 7196    117.580739/s
     iteration_duration.............: avg=424.13ms min=30.15ms med=417.97ms max=819.23ms p(90)=474.92ms p(95)=492.73ms p(99.9)=769.76ms
     iterations.....................: 7096    115.946765/s
     success_rate...................: 100.00% ✓ 7096       ✗ 0   
     vus............................: 38      min=38       max=50
     vus_max........................: 50      min=50       max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@github-actions
Copy link

github-actions bot commented Sep 7, 2025

Overview for: ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 500 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1997 124366 total, 0 failed avg: 112ms, p95: 274ms
grafbase 1656 104994 total, 0 failed avg: 133ms, p95: 312ms
cosmo 686 43845 total, 0 failed avg: 320ms, p95: 710ms
apollo-router 392 26343 total, 0 failed avg: 535ms, p95: 1215ms ❌ 26 unexpected GraphQL errors
hive-gateway 276 19067 total, 0 failed avg: 736ms, p95: 1694ms
hive-gateway-bun 268 18827 total, 0 failed avg: 746ms, p95: 1613ms
apollo-gateway 144 9962 total, 0 failed avg: 1290ms, p95: 2625ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 370098      ✗ 0     
     data_received..................: 11 GB   175 MB/s
     data_sent......................: 145 MB  2.3 MB/s
     http_req_blocked...............: avg=367.88µs min=1.07µs  med=2.43µs   max=318.07ms p(90)=3.82µs   p(95)=4.53µs   p(99.9)=141ms   
     http_req_connecting............: avg=364.08µs min=0s      med=0s       max=318.03ms p(90)=0s       p(95)=0s       p(99.9)=140.36ms
     http_req_duration..............: avg=112.04ms min=1.82ms  med=99.4ms   max=469.66ms p(90)=230.89ms p(95)=273.61ms p(99.9)=361.65ms
       { expected_response:true }...: avg=112.04ms min=1.82ms  med=99.4ms   max=469.66ms p(90)=230.89ms p(95)=273.61ms p(99.9)=361.65ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 124366
     http_req_receiving.............: avg=454.38µs min=22.16µs med=40.46µs  max=297.38ms p(90)=156.16µs p(95)=379.83µs p(99.9)=66.63ms 
     http_req_sending...............: avg=338.22µs min=5.26µs  med=9.94µs   max=122.16ms p(90)=27.87µs  p(95)=123.19µs p(99.9)=62.53ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=111.25ms min=1.78ms  med=98.66ms  max=412.8ms  p(90)=228.98ms p(95)=271.81ms p(99.9)=359.26ms
     http_reqs......................: 124366  1997.96565/s
     iteration_duration.............: avg=113.55ms min=1.99ms  med=100.72ms max=694.69ms p(90)=232.84ms p(95)=275.88ms p(99.9)=385.83ms
     iterations.....................: 123366  1981.900442/s
     success_rate...................: 100.00% ✓ 123366      ✗ 0     
     vus............................: 70      min=0         max=495 
     vus_max........................: 500     min=500       max=500 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 311982      ✗ 0     
     data_received..................: 9.2 GB  146 MB/s
     data_sent......................: 122 MB  1.9 MB/s
     http_req_blocked...............: avg=533.97µs min=1.15µs  med=2.96µs   max=358.18ms p(90)=4.36µs   p(95)=5.5µs    p(99.9)=183.22ms
     http_req_connecting............: avg=529.43µs min=0s      med=0s       max=358.13ms p(90)=0s       p(95)=0s       p(99.9)=183.18ms
     http_req_duration..............: avg=132.6ms  min=2.58ms  med=122.28ms max=463.4ms  p(90)=263.57ms p(95)=312.33ms p(99.9)=412.33ms
       { expected_response:true }...: avg=132.6ms  min=2.58ms  med=122.28ms max=463.4ms  p(90)=263.57ms p(95)=312.33ms p(99.9)=412.33ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 104994
     http_req_receiving.............: avg=562.93µs min=25.11µs med=46.98µs  max=150.45ms p(90)=165.12µs p(95)=428.08µs p(99.9)=77.04ms 
     http_req_sending...............: avg=451.94µs min=5.41µs  med=11.71µs  max=135.65ms p(90)=32.59µs  p(95)=137.05µs p(99.9)=72.28ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=131.59ms min=2.53ms  med=121.24ms max=444.74ms p(90)=261.23ms p(95)=310.42ms p(99.9)=409.04ms
     http_reqs......................: 104994  1656.175495/s
     iteration_duration.............: avg=134.74ms min=3.04ms  med=124.27ms max=826.77ms p(90)=266.43ms p(95)=315.19ms p(99.9)=466.6ms 
     iterations.....................: 103994  1640.401494/s
     success_rate...................: 100.00% ✓ 103994      ✗ 0     
     vus............................: 79      min=0         max=494 
     vus_max........................: 500     min=500       max=500 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 128535     ✗ 0    
     data_received..................: 3.8 GB  60 MB/s
     data_sent......................: 51 MB   800 kB/s
     http_req_blocked...............: avg=89.65µs  min=1.18µs  med=2.82µs   max=144.78ms p(90)=4.31µs   p(95)=6.09µs   p(99.9)=29.48ms
     http_req_connecting............: avg=85.01µs  min=0s      med=0s       max=144.72ms p(90)=0s       p(95)=0s       p(99.9)=29.42ms
     http_req_duration..............: avg=320.37ms min=2.9ms   med=302.26ms max=1.17s    p(90)=632.38ms p(95)=709.76ms p(99.9)=1.02s  
       { expected_response:true }...: avg=320.37ms min=2.9ms   med=302.26ms max=1.17s    p(90)=632.38ms p(95)=709.76ms p(99.9)=1.02s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 43845
     http_req_receiving.............: avg=569.34µs min=28.02µs med=62.94µs  max=162.33ms p(90)=207.42µs p(95)=481.11µs p(99.9)=78.65ms
     http_req_sending...............: avg=143.71µs min=5.38µs  med=11.35µs  max=120.53ms p(90)=30.78µs  p(95)=128.34µs p(99.9)=30.27ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=319.66ms min=2.81ms  med=301.7ms  max=1.17s    p(90)=631.04ms p(95)=709.03ms p(99.9)=1.02s  
     http_reqs......................: 43845   686.604202/s
     iteration_duration.............: avg=328.3ms  min=3.15ms  med=311.06ms max=1.17s    p(90)=635.34ms p(95)=713.15ms p(99.9)=1.03s  
     iterations.....................: 42845   670.944396/s
     success_rate...................: 100.00% ✓ 42845      ✗ 0    
     vus............................: 54      min=0        max=499
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  99% — ✓ 25317 / ✗ 26
     ✓ valid response structure

     checks.........................: 99.96% ✓ 76003      ✗ 26   
     data_received..................: 2.3 GB 34 MB/s
     data_sent......................: 31 MB  457 kB/s
     http_req_blocked...............: avg=57.63µs  min=1.83µs  med=2.95µs   max=83.13ms p(90)=4.77µs  p(95)=6.68µs   p(99.9)=16.08ms
     http_req_connecting............: avg=51.94µs  min=0s      med=0s       max=83.09ms p(90)=0s      p(95)=0s       p(99.9)=15.12ms
     http_req_duration..............: avg=535.3ms  min=6.07ms  med=500.54ms max=1.85s   p(90)=1.07s   p(95)=1.21s    p(99.9)=1.65s  
       { expected_response:true }...: avg=535.3ms  min=6.07ms  med=500.54ms max=1.85s   p(90)=1.07s   p(95)=1.21s    p(99.9)=1.65s  
     http_req_failed................: 0.00%  ✓ 0          ✗ 26343
     http_req_receiving.............: avg=100.44µs min=31.82µs med=52.28µs  max=63.78ms p(90)=99.66µs p(95)=156.56µs p(99.9)=5.82ms 
     http_req_sending...............: avg=87.77µs  min=7.27µs  med=11.6µs   max=58.78ms p(90)=27.38µs p(95)=87.27µs  p(99.9)=14.93ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s      p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=535.11ms min=6.02ms  med=500.16ms max=1.85s   p(90)=1.07s   p(95)=1.21s    p(99.9)=1.65s  
     http_reqs......................: 26343  392.101161/s
     iteration_duration.............: avg=556.75ms min=6.46ms  med=529.61ms max=1.85s   p(90)=1.08s   p(95)=1.22s    p(99.9)=1.65s  
     iterations.....................: 25343  377.216708/s
     success_rate...................: 99.89% ✓ 25317      ✗ 26   
     vus............................: 73     min=0        max=495
     vus_max........................: 500    min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 54201      ✗ 0    
     data_received..................: 1.7 GB  24 MB/s
     data_sent......................: 22 MB   323 kB/s
     http_req_blocked...............: avg=130.34µs min=1.18µs  med=2.82µs   max=194.78ms p(90)=4.84µs   p(95)=7.66µs   p(99.9)=32.65ms
     http_req_connecting............: avg=124.7µs  min=0s      med=0s       max=194.74ms p(90)=0s       p(95)=0s       p(99.9)=32.6ms 
     http_req_duration..............: avg=736.34ms min=6.56ms  med=659.29ms max=4.77s    p(90)=1.48s    p(95)=1.69s    p(99.9)=3.43s  
       { expected_response:true }...: avg=736.34ms min=6.56ms  med=659.29ms max=4.77s    p(90)=1.48s    p(95)=1.69s    p(99.9)=3.43s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 19067
     http_req_receiving.............: avg=203.7µs  min=25.35µs med=45.02µs  max=123ms    p(90)=100.98µs p(95)=356.46µs p(99.9)=33.38ms
     http_req_sending...............: avg=208.68µs min=5.63µs  med=11.09µs  max=119.37ms p(90)=33.91µs  p(95)=129.97µs p(99.9)=42.37ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=735.93ms min=6.51ms  med=658.95ms max=4.77s    p(90)=1.48s    p(95)=1.69s    p(99.9)=3.41s  
     http_reqs......................: 19067   276.063762/s
     iteration_duration.............: avg=777.49ms min=8.69ms  med=704.63ms max=4.84s    p(90)=1.51s    p(95)=1.7s     p(99.9)=3.53s  
     iterations.....................: 18067   261.585146/s
     success_rate...................: 100.00% ✓ 18067      ✗ 0    
     vus............................: 66      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 53481      ✗ 0    
     data_received..................: 1.7 GB  24 MB/s
     data_sent......................: 22 MB   315 kB/s
     http_req_blocked...............: avg=128.5µs  min=1.27µs  med=2.76µs   max=303.79ms p(90)=4.62µs  p(95)=6.82µs   p(99.9)=23.36ms
     http_req_connecting............: avg=122.95µs min=0s      med=0s       max=303.73ms p(90)=0s      p(95)=0s       p(99.9)=23.31ms
     http_req_duration..............: avg=746.28ms min=7ms     med=707.84ms max=4.4s     p(90)=1.48s   p(95)=1.61s    p(99.9)=3.19s  
       { expected_response:true }...: avg=746.28ms min=7ms     med=707.84ms max=4.4s     p(90)=1.48s   p(95)=1.61s    p(99.9)=3.19s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 18827
     http_req_receiving.............: avg=178.08µs min=26.33µs med=43.86µs  max=194.88ms p(90)=91.08µs p(95)=154.4µs  p(99.9)=20.73ms
     http_req_sending...............: avg=162.46µs min=5.76µs  med=11.11µs  max=113.64ms p(90)=30.32µs p(95)=109.67µs p(99.9)=28.65ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=745.94ms min=6.94ms  med=707.71ms max=4.4s     p(90)=1.48s   p(95)=1.61s    p(99.9)=3.19s  
     http_reqs......................: 18827   268.990077/s
     iteration_duration.............: avg=788.41ms min=7.97ms  med=742.4ms  max=4.41s    p(90)=1.5s    p(95)=1.61s    p(99.9)=3.29s  
     iterations.....................: 17827   254.702614/s
     success_rate...................: 100.00% ✓ 17827      ✗ 0    
     vus............................: 65      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 26886      ✗ 0    
     data_received..................: 875 MB  13 MB/s
     data_sent......................: 12 MB   173 kB/s
     http_req_blocked...............: avg=45.38µs min=1.37µs  med=3.46µs  max=26.66ms p(90)=6.35µs   p(95)=15.04µs  p(99.9)=11.3ms 
     http_req_connecting............: avg=37.54µs min=0s      med=0s      max=26.4ms  p(90)=0s       p(95)=0s       p(99.9)=11.22ms
     http_req_duration..............: avg=1.28s   min=7.41ms  med=1.27s   max=16.81s  p(90)=2.32s    p(95)=2.62s    p(99.9)=15.6s  
       { expected_response:true }...: avg=1.28s   min=7.41ms  med=1.27s   max=16.81s  p(90)=2.32s    p(95)=2.62s    p(99.9)=15.6s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 9962 
     http_req_receiving.............: avg=88.31µs min=29.37µs med=63.5µs  max=16.87ms p(90)=121.87µs p(95)=162.33µs p(99.9)=2.03ms 
     http_req_sending...............: avg=40.47µs min=6.13µs  med=13.53µs max=15.96ms p(90)=33.53µs  p(95)=52.2µs   p(99.9)=4.79ms 
     http_req_tls_handshaking.......: avg=0s      min=0s      med=0s      max=0s      p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=1.28s   min=7.37ms  med=1.27s   max=16.81s  p(90)=2.32s    p(95)=2.62s    p(99.9)=15.6s  
     http_reqs......................: 9962    144.495135/s
     iteration_duration.............: avg=1.43s   min=8.56ms  med=1.41s   max=16.82s  p(90)=2.37s    p(95)=2.68s    p(99.9)=15.67s 
     iterations.....................: 8962    129.990504/s
     success_rate...................: 100.00% ✓ 8962       ✗ 0    
     vus............................: 69      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@github-actions
Copy link

github-actions bot commented Sep 7, 2025

Overview for: constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 173 14039 total, 0 failed avg: 216ms, p95: 226ms
hive-router 169 13740 total, 0 failed avg: 220ms, p95: 230ms
cosmo 167 13588 total, 0 failed avg: 222ms, p95: 242ms
hive-gateway 167 12798 total, 0 failed avg: 236ms, p95: 259ms
hive-gateway-bun 167 12757 total, 0 failed avg: 236ms, p95: 262ms
apollo-router 133 10924 total, 0 failed avg: 277ms, p95: 321ms
apollo-gateway 126 10302 total, 0 failed avg: 294ms, p95: 322ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41817      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   201 kB/s
     http_req_blocked...............: avg=40.37µs  min=1.15µs   med=1.92µs   max=19.97ms  p(90)=3.48µs   p(95)=5.26µs   p(99.9)=13.42ms 
     http_req_connecting............: avg=36.21µs  min=0s       med=0s       max=17.42ms  p(90)=0s       p(95)=0s       p(99.9)=12.84ms 
     http_req_duration..............: avg=215.58ms min=157.96ms med=214.8ms  max=581.32ms p(90)=223.67ms p(95)=226.21ms p(99.9)=488.56ms
       { expected_response:true }...: avg=215.58ms min=157.96ms med=214.8ms  max=581.32ms p(90)=223.67ms p(95)=226.21ms p(99.9)=488.56ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 14039
     http_req_receiving.............: avg=78µs     min=27.75µs  med=46.34µs  max=16.25ms  p(90)=96.86µs  p(95)=268.09µs p(99.9)=1.99ms  
     http_req_sending...............: avg=128.74µs min=5.32µs   med=8.58µs   max=346.29ms p(90)=30.43µs  p(95)=98.02µs  p(99.9)=8.39ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=215.38ms min=157.91ms med=214.7ms  max=578.51ms p(90)=223.5ms  p(95)=225.97ms p(99.9)=475.63ms
     http_reqs......................: 14039   173.165156/s
     iteration_duration.............: avg=215.86ms min=158.13ms med=215.02ms max=598.27ms p(90)=223.85ms p(95)=226.41ms p(99.9)=503.99ms
     iterations.....................: 13939   171.931698/s
     success_rate...................: 100.00% ✓ 13939      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40920      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   197 kB/s
     http_req_blocked...............: avg=43.32µs  min=1.13µs   med=2µs      max=15.03ms  p(90)=3.04µs   p(95)=4.21µs   p(99.9)=13.05ms 
     http_req_connecting............: avg=40.43µs  min=0s       med=0s       max=15ms     p(90)=0s       p(95)=0s       p(99.9)=13.03ms 
     http_req_duration..............: avg=220.32ms min=124.22ms med=219.4ms  max=578.17ms p(90)=227.41ms p(95)=230.04ms p(99.9)=494.15ms
       { expected_response:true }...: avg=220.32ms min=124.22ms med=219.4ms  max=578.17ms p(90)=227.41ms p(95)=230.04ms p(99.9)=494.15ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13740
     http_req_receiving.............: avg=70.69µs  min=23.36µs  med=40.83µs  max=10.87ms  p(90)=82.14µs  p(95)=247.28µs p(99.9)=2.13ms  
     http_req_sending...............: avg=137.61µs min=5.29µs   med=8.32µs   max=328.37ms p(90)=27.94µs  p(95)=92.05µs  p(99.9)=5.6ms   
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=220.12ms min=123.82ms med=219.31ms max=575.69ms p(90)=227.26ms p(95)=229.85ms p(99.9)=474.27ms
     http_reqs......................: 13740   169.708679/s
     iteration_duration.............: avg=220.64ms min=124.33ms med=219.62ms max=595.63ms p(90)=227.58ms p(95)=230.21ms p(99.9)=510.26ms
     iterations.....................: 13640   168.473535/s
     success_rate...................: 100.00% ✓ 13640      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40464      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   195 kB/s
     http_req_blocked...............: avg=47.22µs  min=1.42µs   med=2.71µs   max=22.64ms  p(90)=3.93µs   p(95)=4.75µs   p(99.9)=14.04ms 
     http_req_connecting............: avg=43.7µs   min=0s       med=0s       max=22.62ms  p(90)=0s       p(95)=0s       p(99.9)=13.92ms 
     http_req_duration..............: avg=222.03ms min=157.4ms  med=220.93ms max=630.37ms p(90)=236.54ms p(95)=242.15ms p(99.9)=524.8ms 
       { expected_response:true }...: avg=222.03ms min=157.4ms  med=220.93ms max=630.37ms p(90)=236.54ms p(95)=242.15ms p(99.9)=524.8ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 13588
     http_req_receiving.............: avg=481.05µs min=32.86µs  med=66.08µs  max=51.23ms  p(90)=372.91µs p(95)=1.01ms   p(99.9)=24.32ms 
     http_req_sending...............: avg=90.36µs  min=5.97µs   med=11.13µs  max=245.75ms p(90)=30.02µs  p(95)=110.04µs p(99.9)=6.19ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=221.46ms min=157.32ms med=220.47ms max=624.1ms  p(90)=235.96ms p(95)=241.5ms  p(99.9)=519.18ms
     http_reqs......................: 13588   167.918259/s
     iteration_duration.............: avg=222.46ms min=157.65ms med=221.23ms max=656.03ms p(90)=236.79ms p(95)=242.46ms p(99.9)=573.04ms
     iterations.....................: 13488   166.682476/s
     success_rate...................: 100.00% ✓ 13488      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 38094      ✗ 0    
     data_received..................: 1.1 GB  15 MB/s
     data_sent......................: 15 MB   195 kB/s
     http_req_blocked...............: avg=27.84µs  min=1.12µs   med=2.57µs   max=13.5ms   p(90)=4.12µs   p(95)=5.42µs   p(99.9)=9.08ms  
     http_req_connecting............: avg=24.44µs  min=0s       med=0s       max=13.45ms  p(90)=0s       p(95)=0s       p(99.9)=9.05ms  
     http_req_duration..............: avg=235.8ms  min=151ms    med=227.23ms max=801.27ms p(90)=247.61ms p(95)=258.8ms  p(99.9)=667.66ms
       { expected_response:true }...: avg=235.8ms  min=151ms    med=227.23ms max=801.27ms p(90)=247.61ms p(95)=258.8ms  p(99.9)=667.66ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12798
     http_req_receiving.............: avg=82.23µs  min=25.4µs   med=45.41µs  max=15.87ms  p(90)=99.47µs  p(95)=165.95µs p(99.9)=3.25ms  
     http_req_sending...............: avg=113.91µs min=5.56µs   med=10.9µs   max=169.88ms p(90)=32.39µs  p(95)=118.88µs p(99.9)=13.08ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=235.6ms  min=149.78ms med=227.12ms max=797.75ms p(90)=247.47ms p(95)=258.64ms p(99.9)=654.35ms
     http_reqs......................: 12798   167.316698/s
     iteration_duration.............: avg=236.73ms min=151.25ms med=227.54ms max=826.42ms p(90)=247.91ms p(95)=259.21ms p(99.9)=698.58ms
     iterations.....................: 12698   166.009332/s
     success_rate...................: 100.00% ✓ 12698      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 37971      ✗ 0    
     data_received..................: 1.1 GB  15 MB/s
     data_sent......................: 15 MB   194 kB/s
     http_req_blocked...............: avg=25.75µs  min=1.11µs   med=2.62µs   max=11.27ms  p(90)=4.19µs   p(95)=5.52µs   p(99.9)=8.69ms  
     http_req_connecting............: avg=22.32µs  min=0s       med=0s       max=11.24ms  p(90)=0s       p(95)=0s       p(99.9)=8.66ms  
     http_req_duration..............: avg=236.45ms min=136.5ms  med=227.66ms max=706.18ms p(90)=248.8ms  p(95)=261.84ms p(99.9)=651.43ms
       { expected_response:true }...: avg=236.45ms min=136.5ms  med=227.66ms max=706.18ms p(90)=248.8ms  p(95)=261.84ms p(99.9)=651.43ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12757
     http_req_receiving.............: avg=83.13µs  min=26.11µs  med=43.85µs  max=55.72ms  p(90)=94.1µs   p(95)=160.68µs p(99.9)=2.3ms   
     http_req_sending...............: avg=77.04µs  min=5.54µs   med=10.93µs  max=176.99ms p(90)=32.36µs  p(95)=108.42µs p(99.9)=4.94ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=236.29ms min=136.45ms med=227.55ms max=680.4ms  p(90)=248.67ms p(95)=261.69ms p(99.9)=651.03ms
     http_reqs......................: 12757   167.022461/s
     iteration_duration.............: avg=237.34ms min=136.65ms med=227.97ms max=731.4ms  p(90)=249.13ms p(95)=262.31ms p(99.9)=652.99ms
     iterations.....................: 12657   165.7132/s
     success_rate...................: 100.00% ✓ 12657      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 32472      ✗ 0    
     data_received..................: 959 MB  12 MB/s
     data_sent......................: 13 MB   156 kB/s
     http_req_blocked...............: avg=48.77µs  min=1.29µs   med=2.83µs   max=18.44ms  p(90)=4.49µs   p(95)=5.64µs   p(99.9)=13.05ms 
     http_req_connecting............: avg=44.13µs  min=0s       med=0s       max=18.14ms  p(90)=0s       p(95)=0s       p(99.9)=12.91ms 
     http_req_duration..............: avg=276.91ms min=175.07ms med=277.78ms max=703.54ms p(90)=312.04ms p(95)=321.37ms p(99.9)=597.91ms
       { expected_response:true }...: avg=276.91ms min=175.07ms med=277.78ms max=703.54ms p(90)=312.04ms p(95)=321.37ms p(99.9)=597.91ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10924
     http_req_receiving.............: avg=142.31µs min=32.37µs  med=59.15µs  max=20.76ms  p(90)=172.31µs p(95)=493.17µs p(99.9)=6.25ms  
     http_req_sending...............: avg=153.36µs min=6.28µs   med=11.49µs  max=227.26ms p(90)=75.13µs  p(95)=151.45µs p(99.9)=5.11ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=276.61ms min=175.01ms med=277.58ms max=702.75ms p(90)=311.62ms p(95)=321.07ms p(99.9)=595.31ms
     http_reqs......................: 10924   133.870135/s
     iteration_duration.............: avg=277.88ms min=175.23ms med=278.35ms max=735.92ms p(90)=312.43ms p(95)=321.78ms p(99.9)=631.94ms
     iterations.....................: 10824   132.644667/s
     success_rate...................: 100.00% ✓ 10824      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 30606      ✗ 0    
     data_received..................: 905 MB  11 MB/s
     data_sent......................: 12 MB   147 kB/s
     http_req_blocked...............: avg=66.69µs  min=1.33µs   med=3.1µs    max=19.29ms  p(90)=4.41µs   p(95)=5.25µs   p(99.9)=15.29ms 
     http_req_connecting............: avg=62.08µs  min=0s       med=0s       max=19.24ms  p(90)=0s       p(95)=0s       p(99.9)=15.22ms 
     http_req_duration..............: avg=293.5ms  min=210.18ms med=291.61ms max=809.13ms p(90)=314.96ms p(95)=322.46ms p(99.9)=700.22ms
       { expected_response:true }...: avg=293.5ms  min=210.18ms med=291.61ms max=809.13ms p(90)=314.96ms p(95)=322.46ms p(99.9)=700.22ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10302
     http_req_receiving.............: avg=75.27µs  min=28.74µs  med=53.48µs  max=9.74ms   p(90)=99.27µs  p(95)=120.59µs p(99.9)=1.95ms  
     http_req_sending...............: avg=99.64µs  min=6.1µs    med=12.41µs  max=245.76ms p(90)=20.25µs  p(95)=37.09µs  p(99.9)=5.43ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=293.33ms min=210.12ms med=291.49ms max=808.66ms p(90)=314.85ms p(95)=322.07ms p(99.9)=699.81ms
     http_reqs......................: 10302   126.393373/s
     iteration_duration.............: avg=294.71ms min=220.13ms med=292.06ms max=839.06ms p(90)=315.3ms  p(95)=322.82ms p(99.9)=767.95ms
     iterations.....................: 10202   125.166491/s
     success_rate...................: 100.00% ✓ 10202      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@github-actions
Copy link

github-actions bot commented Sep 7, 2025

Overview for: constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 172 13984 total, 0 failed avg: 216ms, p95: 228ms
hive-router 166 13444 total, 0 failed avg: 224ms, p95: 235ms
cosmo 157 12775 total, 0 failed avg: 237ms, p95: 263ms
hive-gateway 150 11525 total, 0 failed avg: 262ms, p95: 298ms
hive-gateway-bun 147 11319 total, 0 failed avg: 267ms, p95: 387ms
apollo-router 126 10259 total, 0 failed avg: 295ms, p95: 339ms
apollo-gateway 83 6811 total, 0 failed avg: 445ms, p95: 496ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41652      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   201 kB/s
     http_req_blocked...............: avg=75.67µs  min=1.16µs   med=2.15µs   max=26.99ms  p(90)=3.92µs   p(95)=5.47µs   p(99.9)=24.45ms 
     http_req_connecting............: avg=72.24µs  min=0s       med=0s       max=26.94ms  p(90)=0s       p(95)=0s       p(99.9)=24.2ms  
     http_req_duration..............: avg=216.25ms min=119.29ms med=215.17ms max=593.39ms p(90)=225.03ms p(95)=228.04ms p(99.9)=493.8ms 
       { expected_response:true }...: avg=216.25ms min=119.29ms med=215.17ms max=593.39ms p(90)=225.03ms p(95)=228.04ms p(99.9)=493.8ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 13984
     http_req_receiving.............: avg=105.24µs min=26.58µs  med=46.99µs  max=331.88ms p(90)=102.91µs p(95)=283.28µs p(99.9)=2.57ms  
     http_req_sending...............: avg=83.46µs  min=6.04µs   med=9.23µs   max=324.44ms p(90)=33.4µs   p(95)=99.27µs  p(99.9)=5.71ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=216.06ms min=119.23ms med=215.05ms max=588.22ms p(90)=224.88ms p(95)=227.87ms p(99.9)=480.88ms
     http_reqs......................: 13984   172.566043/s
     iteration_duration.............: avg=216.58ms min=119.46ms med=215.4ms  max=634.19ms p(90)=225.21ms p(95)=228.23ms p(99.9)=524.07ms
     iterations.....................: 13884   171.332018/s
     success_rate...................: 100.00% ✓ 13884      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40032      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   193 kB/s
     http_req_blocked...............: avg=48.68µs  min=1.22µs   med=2.3µs    max=17.63ms  p(90)=3.42µs   p(95)=4.66µs   p(99.9)=14.92ms 
     http_req_connecting............: avg=45.58µs  min=0s       med=0s       max=17.5ms   p(90)=0s       p(95)=0s       p(99.9)=14.86ms 
     http_req_duration..............: avg=224.45ms min=118.83ms med=223.54ms max=616.6ms  p(90)=232.5ms  p(95)=235.09ms p(99.9)=517.64ms
       { expected_response:true }...: avg=224.45ms min=118.83ms med=223.54ms max=616.6ms  p(90)=232.5ms  p(95)=235.09ms p(99.9)=517.64ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13444
     http_req_receiving.............: avg=81.45µs  min=27.01µs  med=44.92µs  max=11.66ms  p(90)=95.31µs  p(95)=275.25µs p(99.9)=3.26ms  
     http_req_sending...............: avg=101.68µs min=5.81µs   med=9.64µs   max=366.93ms p(90)=30.93µs  p(95)=97.74µs  p(99.9)=4.73ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=224.26ms min=118.74ms med=223.44ms max=615.01ms p(90)=232.36ms p(95)=234.89ms p(99.9)=503.48ms
     http_reqs......................: 13444   166.213124/s
     iteration_duration.............: avg=224.84ms min=119.14ms med=223.77ms max=636.33ms p(90)=232.7ms  p(95)=235.27ms p(99.9)=552.33ms
     iterations.....................: 13344   164.976787/s
     success_rate...................: 100.00% ✓ 13344      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 38025      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 15 MB   183 kB/s
     http_req_blocked...............: avg=48.14µs  min=1.42µs   med=2.57µs   max=15.8ms   p(90)=3.7µs    p(95)=4.65µs   p(99.9)=13.41ms 
     http_req_connecting............: avg=44.85µs  min=0s       med=0s       max=15.66ms  p(90)=0s       p(95)=0s       p(99.9)=13.39ms 
     http_req_duration..............: avg=236.82ms min=135.57ms med=236.69ms max=623.82ms p(90)=257.12ms p(95)=263.37ms p(99.9)=512.12ms
       { expected_response:true }...: avg=236.82ms min=135.57ms med=236.69ms max=623.82ms p(90)=257.12ms p(95)=263.37ms p(99.9)=512.12ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12775
     http_req_receiving.............: avg=353.68µs min=31.51µs  med=60µs     max=40.46ms  p(90)=176.88µs p(95)=436.98µs p(99.9)=29.56ms 
     http_req_sending...............: avg=92.63µs  min=6.64µs   med=10.52µs  max=200.93ms p(90)=28.55µs  p(95)=115.64µs p(99.9)=5.84ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=236.37ms min=135.49ms med=236.4ms  max=618.67ms p(90)=256.42ms p(95)=262.51ms p(99.9)=509.69ms
     http_reqs......................: 12775   157.495235/s
     iteration_duration.............: avg=237.33ms min=135.77ms med=237.07ms max=643.91ms p(90)=257.43ms p(95)=263.68ms p(99.9)=540.91ms
     iterations.....................: 12675   156.262395/s
     success_rate...................: 100.00% ✓ 12675      ✗ 0    
     vus............................: 40      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 34275      ✗ 0    
     data_received..................: 1.0 GB  13 MB/s
     data_sent......................: 13 MB   175 kB/s
     http_req_blocked...............: avg=28.25µs  min=1.12µs   med=2.62µs   max=11.5ms   p(90)=4.07µs   p(95)=5.36µs   p(99.9)=9.05ms  
     http_req_connecting............: avg=24.8µs   min=0s       med=0s       max=11.46ms  p(90)=0s       p(95)=0s       p(99.9)=9.01ms  
     http_req_duration..............: avg=261.99ms min=160.23ms med=252.19ms max=1s       p(90)=271.09ms p(95)=298.01ms p(99.9)=997.43ms
       { expected_response:true }...: avg=261.99ms min=160.23ms med=252.19ms max=1s       p(90)=271.09ms p(95)=298.01ms p(99.9)=997.43ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11525
     http_req_receiving.............: avg=92.05µs  min=25.74µs  med=45.57µs  max=18.75ms  p(90)=105.81µs p(95)=371.67µs p(99.9)=2.29ms  
     http_req_sending...............: avg=102.36µs min=5.53µs   med=10.97µs  max=222.63ms p(90)=37.18µs  p(95)=141.15µs p(99.9)=5.39ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=261.8ms  min=160.09ms med=252.06ms max=1s       p(90)=270.85ms p(95)=297.35ms p(99.9)=997.15ms
     http_reqs......................: 11525   150.472348/s
     iteration_duration.............: avg=263.17ms min=173.43ms med=252.51ms max=1s       p(90)=271.44ms p(95)=299.15ms p(99.9)=997.64ms
     iterations.....................: 11425   149.166731/s
     success_rate...................: 100.00% ✓ 11425      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 33657      ✗ 0    
     data_received..................: 994 MB  13 MB/s
     data_sent......................: 13 MB   172 kB/s
     http_req_blocked...............: avg=41.98µs  min=1.15µs   med=2.79µs   max=16.5ms   p(90)=4.52µs   p(95)=6.18µs   p(99.9)=12.22ms 
     http_req_connecting............: avg=38.15µs  min=0s       med=0s       max=16.47ms  p(90)=0s       p(95)=0s       p(99.9)=12ms    
     http_req_duration..............: avg=266.98ms min=147.97ms med=257.28ms max=689.84ms p(90)=281.8ms  p(95)=387.43ms p(99.9)=594.15ms
       { expected_response:true }...: avg=266.98ms min=147.97ms med=257.28ms max=689.84ms p(90)=281.8ms  p(95)=387.43ms p(99.9)=594.15ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11319
     http_req_receiving.............: avg=121.93µs min=26.41µs  med=50.84µs  max=200.96ms p(90)=123.95µs p(95)=407.53µs p(99.9)=4.06ms  
     http_req_sending...............: avg=136.97µs min=5.24µs   med=11.4µs   max=201.16ms p(90)=38.79µs  p(95)=145.78µs p(99.9)=11.19ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=266.72ms min=147.92ms med=257.15ms max=682.81ms p(90)=281.6ms  p(95)=375.01ms p(99.9)=586.89ms
     http_reqs......................: 11319   147.933058/s
     iteration_duration.............: avg=268.2ms  min=148.17ms med=257.6ms  max=703.37ms p(90)=282.2ms  p(95)=397.17ms p(99.9)=624.83ms
     iterations.....................: 11219   146.626114/s
     success_rate...................: 100.00% ✓ 11219      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 30477      ✗ 0    
     data_received..................: 900 MB  11 MB/s
     data_sent......................: 12 MB   147 kB/s
     http_req_blocked...............: avg=22.11µs  min=1.74µs   med=2.68µs   max=7.56ms   p(90)=3.9µs    p(95)=4.57µs   p(99.9)=6.05ms  
     http_req_connecting............: avg=18.88µs  min=0s       med=0s       max=7.53ms   p(90)=0s       p(95)=0s       p(99.9)=6.04ms  
     http_req_duration..............: avg=295.13ms min=167.64ms med=297.24ms max=721.67ms p(90)=330.63ms p(95)=339.09ms p(99.9)=632.39ms
       { expected_response:true }...: avg=295.13ms min=167.64ms med=297.24ms max=721.67ms p(90)=330.63ms p(95)=339.09ms p(99.9)=632.39ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10259
     http_req_receiving.............: avg=82.19µs  min=34.04µs  med=48.95µs  max=3.13ms   p(90)=98.71µs  p(95)=225.65µs p(99.9)=1.36ms  
     http_req_sending...............: avg=70.49µs  min=7.6µs    med=10.67µs  max=307.66ms p(90)=21.81µs  p(95)=128.89µs p(99.9)=2.26ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=294.98ms min=167.58ms med=297.12ms max=721.01ms p(90)=330.52ms p(95)=339ms    p(99.9)=630.88ms
     http_reqs......................: 10259   126.040732/s
     iteration_duration.............: avg=296.32ms min=167.82ms med=297.78ms max=755.34ms p(90)=330.96ms p(95)=339.44ms p(99.9)=665.65ms
     iterations.....................: 10159   124.812145/s
     success_rate...................: 100.00% ✓ 10159      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 20133     ✗ 0   
     data_received..................: 598 MB  7.3 MB/s
     data_sent......................: 7.9 MB  97 kB/s
     http_req_blocked...............: avg=47.58µs  min=1.48µs   med=3.81µs   max=11.83ms  p(90)=5.66µs   p(95)=6.52µs   p(99.9)=10.23ms 
     http_req_connecting............: avg=42.95µs  min=0s       med=0s       max=11.79ms  p(90)=0s       p(95)=0s       p(99.9)=10.2ms  
     http_req_duration..............: avg=444.53ms min=211.23ms med=448.44ms max=1.01s    p(90)=479.61ms p(95)=496.33ms p(99.9)=931.64ms
       { expected_response:true }...: avg=444.53ms min=211.23ms med=448.44ms max=1.01s    p(90)=479.61ms p(95)=496.33ms p(99.9)=931.64ms
     http_req_failed................: 0.00%   ✓ 0         ✗ 6811
     http_req_receiving.............: avg=80.12µs  min=32.95µs  med=72.04µs  max=12.28ms  p(90)=113.05µs p(95)=130.32µs p(99.9)=440.01µs
     http_req_sending...............: avg=87.32µs  min=6.96µs   med=15.62µs  max=275.17ms p(90)=22.59µs  p(95)=29.76µs  p(99.9)=3.19ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=444.36ms min=211.15ms med=448.34ms max=1s       p(90)=479.43ms p(95)=496.17ms p(99.9)=930.62ms
     http_reqs......................: 6811    83.310539/s
     iteration_duration.............: avg=448.57ms min=295.26ms med=449.01ms max=1.07s    p(90)=480.07ms p(95)=497ms    p(99.9)=993.19ms
     iterations.....................: 6711    82.087363/s
     success_rate...................: 100.00% ✓ 6711      ✗ 0   
     vus............................: 50      min=0       max=50
     vus_max........................: 50      min=50      max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@ardatan ardatan merged commit d9e290d into main Sep 7, 2025
34 checks passed
@ardatan ardatan deleted the renovate/graphql-hive-gateway-monorepo branch September 7, 2025 08:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant