Skip to content

Conversation

renovate[bot]
Copy link
Contributor

@renovate renovate bot commented Mar 30, 2024

This PR contains the following updates:

Package Change Age Adoption Passing Confidence
@types/node (source) 20.11.30 -> 20.16.10 age adoption passing confidence

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

Rebasing: Whenever PR is behind base branch, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.


  • If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

@renovate renovate bot force-pushed the renovate/node-20.x-lockfile branch from 6d65a70 to 628313d Compare March 30, 2024 07:14
@renovate renovate bot changed the title Update dependency @types/node to v20.12.1 Update dependency @types/node to v20.12.2 Mar 30, 2024
@renovate renovate bot force-pushed the renovate/node-20.x-lockfile branch from 628313d to 67c6208 Compare April 2, 2024 22:49
@renovate renovate bot changed the title Update dependency @types/node to v20.12.2 Update dependency @types/node to v20.12.3 Apr 2, 2024
@renovate renovate bot force-pushed the renovate/node-20.x-lockfile branch from 67c6208 to 8f555cf Compare April 4, 2024 00:48
@renovate renovate bot changed the title Update dependency @types/node to v20.12.3 Update dependency @types/node to v20.12.4 Apr 4, 2024
@renovate renovate bot force-pushed the renovate/node-20.x-lockfile branch from 8f555cf to c97e6dd Compare April 5, 2024 23:22
@renovate renovate bot changed the title Update dependency @types/node to v20.12.4 Update dependency @types/node to v20.12.5 Apr 5, 2024
@renovate renovate bot force-pushed the renovate/node-20.x-lockfile branch 3 times, most recently from 14d0296 to 19b2d2a Compare April 9, 2024 05:36
@renovate renovate bot changed the title Update dependency @types/node to v20.12.5 Update dependency @types/node to v20.12.6 Apr 9, 2024
@renovate renovate bot force-pushed the renovate/node-20.x-lockfile branch from 19b2d2a to 8e44318 Compare April 9, 2024 22:04
@renovate renovate bot changed the title Update dependency @types/node to v20.12.6 Update dependency @types/node to v20.12.7 Apr 9, 2024
@renovate renovate bot force-pushed the renovate/node-20.x-lockfile branch from 8e44318 to 4fc12ba Compare May 1, 2024 22:43
@renovate renovate bot changed the title Update dependency @types/node to v20.12.7 Update dependency @types/node to v20.12.8 May 1, 2024
@renovate renovate bot force-pushed the renovate/node-20.x-lockfile branch from 4fc12ba to 6617f00 Compare May 6, 2024 20:30
@renovate renovate bot changed the title Update dependency @types/node to v20.12.8 Update dependency @types/node to v20.12.10 May 6, 2024
@renovate renovate bot force-pushed the renovate/node-20.x-lockfile branch from 6617f00 to f70ad3b Compare May 8, 2024 14:06
@renovate renovate bot changed the title Update dependency @types/node to v20.12.10 Update dependency @types/node to v20.12.11 May 8, 2024
@renovate renovate bot force-pushed the renovate/node-20.x-lockfile branch from f70ad3b to 9a2ceaa Compare May 14, 2024 09:19
@renovate renovate bot changed the title Update dependency @types/node to v20.12.11 Update dependency @types/node to v20.12.12 May 14, 2024
@renovate renovate bot force-pushed the renovate/node-20.x-lockfile branch from 9a2ceaa to 33df07c Compare May 29, 2024 19:29
@renovate renovate bot changed the title Update dependency @types/node to v20.12.12 Update dependency @types/node to v20.12.13 May 29, 2024
@renovate renovate bot force-pushed the renovate/node-20.x-lockfile branch from 33df07c to 4f48857 Compare May 31, 2024 19:04
@renovate renovate bot changed the title Update dependency @types/node to v20.12.13 Update dependency @types/node to v20.12.14 May 31, 2024
@renovate renovate bot force-pushed the renovate/node-20.x-lockfile branch from 4f48857 to 1164a72 Compare May 31, 2024 22:09
@renovate renovate bot changed the title Update dependency @types/node to v20.12.14 Update dependency @types/node to v20.13.0 May 31, 2024
@renovate renovate bot force-pushed the renovate/node-20.x-lockfile branch from 1164a72 to 794b71a Compare June 2, 2024 21:34
@renovate renovate bot changed the title Update dependency @types/node to v20.13.0 Update dependency @types/node to v20.14.0 Jun 2, 2024
@renovate renovate bot changed the title Update dependency @types/node to v20.16.0 Update dependency @types/node to v20.16.1 Aug 19, 2024
@renovate renovate bot force-pushed the renovate/node-20.x-lockfile branch from a124e84 to 4f1591b Compare August 28, 2024 04:48
@renovate renovate bot changed the title Update dependency @types/node to v20.16.1 Update dependency @types/node to v20.16.2 Aug 28, 2024
@renovate renovate bot force-pushed the renovate/node-20.x-lockfile branch from 4f1591b to 615e066 Compare September 1, 2024 15:52
@renovate renovate bot changed the title Update dependency @types/node to v20.16.2 Update dependency @types/node to v20.16.3 Sep 1, 2024
@renovate renovate bot force-pushed the renovate/node-20.x-lockfile branch from 615e066 to 2a32bc9 Compare September 4, 2024 01:38
@renovate renovate bot changed the title Update dependency @types/node to v20.16.3 Update dependency @types/node to v20.16.4 Sep 4, 2024
@renovate renovate bot force-pushed the renovate/node-20.x-lockfile branch from 2a32bc9 to 526f544 Compare September 5, 2024 00:16
@renovate renovate bot changed the title Update dependency @types/node to v20.16.4 Update dependency @types/node to v20.16.5 Sep 5, 2024
@renovate renovate bot force-pushed the renovate/node-20.x-lockfile branch from 526f544 to 5bce481 Compare September 23, 2024 23:27
@renovate renovate bot changed the title Update dependency @types/node to v20.16.5 Update dependency @types/node to v20.16.6 Sep 23, 2024
@renovate renovate bot force-pushed the renovate/node-20.x-lockfile branch from 5bce481 to 07bd3a0 Compare September 25, 2024 01:41
@renovate renovate bot changed the title Update dependency @types/node to v20.16.6 Update dependency @types/node to v20.16.7 Sep 25, 2024
@renovate renovate bot force-pushed the renovate/node-20.x-lockfile branch from 07bd3a0 to 30475a6 Compare September 25, 2024 19:13
@renovate renovate bot changed the title Update dependency @types/node to v20.16.7 Update dependency @types/node to v20.16.8 Sep 25, 2024
@renovate renovate bot force-pushed the renovate/node-20.x-lockfile branch from 30475a6 to 7367f15 Compare September 26, 2024 00:10
@renovate renovate bot changed the title Update dependency @types/node to v20.16.8 Update dependency @types/node to v20.16.9 Sep 26, 2024
@renovate renovate bot force-pushed the renovate/node-20.x-lockfile branch from 7367f15 to 2ef188b Compare September 27, 2024 16:45
@renovate renovate bot changed the title Update dependency @types/node to v20.16.9 Update dependency @types/node to v20.16.10 Sep 27, 2024
@renovate renovate bot force-pushed the renovate/node-20.x-lockfile branch from 2ef188b to 6aa1b10 Compare October 2, 2024 13:00
@github-actions
Copy link

github-actions bot commented Oct 2, 2024

Overview for: federation-v1/constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
cosmo 172 5252 total, 0 failed avg: 502ms, p95: 670ms
apollo-router 158 4832 total, 0 failed avg: 553ms, p95: 743ms
wundergraph 155 4710 total, 0 failed avg: 531ms, p95: 1004ms
mesh-supergraph-bun 81 2511 total, 0 failed avg: 1191ms, p95: 2040ms
apollo-server 49 1565 total, 0 failed avg: 1959ms, p95: 2226ms
mercurius 29 921 total, 0 failed avg: 3304ms, p95: 4370ms
mesh-supergraph 28 928 total, 0 failed avg: 3359ms, p95: 5509ms
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 15756      ✗ 0    
     data_received..................: 461 MB  15 MB/s
     data_sent......................: 6.2 MB  205 kB/s
     http_req_blocked...............: avg=110.65µs min=1.45µs  med=2.72µs   max=321.4ms  p(90)=3.99µs   p(95)=5.22µs  
     http_req_connecting............: avg=90µs     min=0s      med=0s       max=321.33ms p(90)=0s       p(95)=0s      
     http_req_duration..............: avg=501.61ms min=53.14ms med=503.96ms max=1.25s    p(90)=609ms    p(95)=669.94ms
       { expected_response:true }...: avg=501.61ms min=53.14ms med=503.96ms max=1.25s    p(90)=609ms    p(95)=669.94ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 5252 
     http_req_receiving.............: avg=22.36ms  min=37.69µs med=74.2µs   max=756.16ms p(90)=53.43ms  p(95)=149.53ms
     http_req_sending...............: avg=1.82ms   min=8.19µs  med=13.11µs  max=550.02ms p(90)=66.44µs  p(95)=863.25µs
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=477.43ms min=53.07ms med=494.39ms max=886.97ms p(90)=577.98ms p(95)=607.23ms
     http_reqs......................: 5252    172.659171/s
     iteration_duration.............: avg=575.76ms min=73.42ms med=546.81ms max=2.12s    p(90)=767ms    p(95)=910.64ms
     iterations.....................: 5252    172.659171/s
     vus............................: 100     min=100      max=100
     vus_max........................: 100     min=100      max=100

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 14496      ✗ 0    
     data_received..................: 424 MB  14 MB/s
     data_sent......................: 5.7 MB  188 kB/s
     http_req_blocked...............: avg=58.08µs  min=1.61µs  med=4.08µs   max=34.26ms  p(90)=6.79µs   p(95)=9.79µs  
     http_req_connecting............: avg=31.6µs   min=0s      med=0s       max=4.1ms    p(90)=0s       p(95)=0s      
     http_req_duration..............: avg=553.2ms  min=13.92ms med=549.55ms max=1.81s    p(90)=692.86ms p(95)=743.2ms 
       { expected_response:true }...: avg=553.2ms  min=13.92ms med=549.55ms max=1.81s    p(90)=692.86ms p(95)=743.2ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 4832 
     http_req_receiving.............: avg=24.04ms  min=37.19µs med=91.81µs  max=1.29s    p(90)=40.32ms  p(95)=109.32ms
     http_req_sending...............: avg=1.54ms   min=8.81µs  med=20.37µs  max=1.23s    p(90)=61.04µs  p(95)=233.97µs
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=527.61ms min=13.82ms med=538.01ms max=883.72ms p(90)=655.38ms p(95)=697.63ms
     http_reqs......................: 4832    158.643717/s
     iteration_duration.............: avg=626.34ms min=36.67ms med=599.87ms max=2.54s    p(90)=789.45ms p(95)=910.11ms
     iterations.....................: 4832    158.643717/s
     vus............................: 100     min=100      max=100
     vus_max........................: 100     min=100      max=100

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `wundergraph`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 14130      ✗ 0    
     data_received..................: 413 MB  14 MB/s
     data_sent......................: 5.6 MB  184 kB/s
     http_req_blocked...............: avg=55.37µs  min=1.07µs  med=2.8µs    max=4.16ms   p(90)=4.4µs    p(95)=5.45µs  
     http_req_connecting............: avg=48.93µs  min=0s      med=0s       max=4.12ms   p(90)=0s       p(95)=0s      
     http_req_duration..............: avg=530.64ms min=15.03ms med=479.03ms max=2.12s    p(90)=848.83ms p(95)=1s      
       { expected_response:true }...: avg=530.64ms min=15.03ms med=479.03ms max=2.12s    p(90)=848.83ms p(95)=1s      
     http_req_failed................: 0.00%   ✓ 0          ✗ 4710 
     http_req_receiving.............: avg=42.34ms  min=39.04µs med=84.8µs   max=1.49s    p(90)=137.11ms p(95)=289.33ms
     http_req_sending...............: avg=2.37ms   min=7.64µs  med=13.22µs  max=480.06ms p(90)=36.85µs  p(95)=1.1ms   
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=485.92ms min=14.71ms med=454.28ms max=1.33s    p(90)=766.85ms p(95)=876.98ms
     http_reqs......................: 4710    155.191886/s
     iteration_duration.............: avg=641.25ms min=32.21ms med=577.77ms max=2.24s    p(90)=1.03s    p(95)=1.24s   
     iterations.....................: 4710    155.191886/s
     vus............................: 100     min=100      max=100
     vus_max........................: 100     min=100      max=100

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mesh-supergraph-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 7533      ✗ 0    
     data_received..................: 220 MB  7.1 MB/s
     data_sent......................: 3.0 MB  97 kB/s
     http_req_blocked...............: avg=74.43µs  min=1.3µs    med=2.77µs  max=4.37ms   p(90)=4.73µs  p(95)=10.84µs
     http_req_connecting............: avg=63.37µs  min=0s       med=0s      max=4.32ms   p(90)=0s      p(95)=0s     
     http_req_duration..............: avg=1.19s    min=385.85ms med=1.03s   max=3.06s    p(90)=1.89s   p(95)=2.04s  
       { expected_response:true }...: avg=1.19s    min=385.85ms med=1.03s   max=3.06s    p(90)=1.89s   p(95)=2.04s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2511 
     http_req_receiving.............: avg=11.14ms  min=38.56µs  med=99.69µs max=654.37ms p(90)=1.28ms  p(95)=34.76ms
     http_req_sending...............: avg=345.65µs min=8.07µs   med=13.57µs max=56.08ms  p(90)=36.71µs p(95)=151.5µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s      max=0s       p(90)=0s      p(95)=0s     
     http_req_waiting...............: avg=1.17s    min=384.66ms med=1.03s   max=3.06s    p(90)=1.88s   p(95)=2.03s  
     http_reqs......................: 2511    81.383664/s
     iteration_duration.............: avg=1.21s    min=397.1ms  med=1.06s   max=3.08s    p(90)=1.91s   p(95)=2.07s  
     iterations.....................: 2511    81.383664/s
     vus............................: 100     min=100     max=100
     vus_max........................: 100     min=100     max=100

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 4695      ✗ 0    
     data_received..................: 138 MB  4.4 MB/s
     data_sent......................: 1.9 MB  59 kB/s
     http_req_blocked...............: avg=142.39µs min=1.4µs    med=3.05µs   max=5.37ms p(90)=5.24µs   p(95)=158.82µs
     http_req_connecting............: avg=135.48µs min=0s       med=0s       max=5.22ms p(90)=0s       p(95)=129.94µs
     http_req_duration..............: avg=1.95s    min=804.73ms med=1.67s    max=20.51s p(90)=1.98s    p(95)=2.22s   
       { expected_response:true }...: avg=1.95s    min=804.73ms med=1.67s    max=20.51s p(90)=1.98s    p(95)=2.22s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 1565 
     http_req_receiving.............: avg=260.78µs min=50.56µs  med=116.41µs max=54.4ms p(90)=187.09µs p(95)=250.19µs
     http_req_sending...............: avg=34.65µs  min=8.45µs   med=14.92µs  max=4.73ms p(90)=34.92µs  p(95)=101.99µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s     p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=1.95s    min=804.34ms med=1.67s    max=20.51s p(90)=1.98s    p(95)=2.22s   
     http_reqs......................: 1565    49.804668/s
     iteration_duration.............: avg=1.97s    min=818.19ms med=1.68s    max=20.52s p(90)=1.99s    p(95)=2.25s   
     iterations.....................: 1565    49.804668/s
     vus............................: 39      min=39      max=100
     vus_max........................: 100     min=100     max=100

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 2763      ✗ 0    
     data_received..................: 81 MB   2.6 MB/s
     data_sent......................: 1.1 MB  36 kB/s
     http_req_blocked...............: avg=258.88µs min=1.88µs  med=4.12µs   max=5.08ms  p(90)=528.17µs p(95)=2.39ms  
     http_req_connecting............: avg=246.83µs min=0s      med=0s       max=4.98ms  p(90)=417.88µs p(95)=2.34ms  
     http_req_duration..............: avg=3.3s     min=1.03s   med=3.09s    max=7.19s   p(90)=4.18s    p(95)=4.36s   
       { expected_response:true }...: avg=3.3s     min=1.03s   med=3.09s    max=7.19s   p(90)=4.18s    p(95)=4.36s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 921  
     http_req_receiving.............: avg=207.09µs min=44.11µs med=109.08µs max=28.08ms p(90)=172.4µs  p(95)=235.47µs
     http_req_sending...............: avg=58.5µs   min=9.15µs  med=22.25µs  max=1.71ms  p(90)=86.91µs  p(95)=221.6µs 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.3s     min=1.03s   med=3.09s    max=7.19s   p(90)=4.18s    p(95)=4.36s   
     http_reqs......................: 921     29.914113/s
     iteration_duration.............: avg=3.31s    min=1.04s   med=3.1s     max=7.2s    p(90)=4.2s     p(95)=4.37s   
     iterations.....................: 921     29.914113/s
     vus............................: 100     min=100     max=100
     vus_max........................: 100     min=100     max=100

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mesh-supergraph`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 2784      ✗ 0    
     data_received..................: 81 MB   2.5 MB/s
     data_sent......................: 1.1 MB  34 kB/s
     http_req_blocked...............: avg=147.81µs min=1.5µs   med=3.73µs  max=12.16ms p(90)=148.41µs p(95)=552.1µs 
     http_req_connecting............: avg=129.32µs min=0s      med=0s      max=12.12ms p(90)=94.82µs  p(95)=443.99µs
     http_req_duration..............: avg=3.35s    min=1.25s   med=3.21s   max=7.54s   p(90)=4.83s    p(95)=5.5s    
       { expected_response:true }...: avg=3.35s    min=1.25s   med=3.21s   max=7.54s   p(90)=4.83s    p(95)=5.5s    
     http_req_failed................: 0.00%   ✓ 0         ✗ 928  
     http_req_receiving.............: avg=1.65ms   min=44.11µs med=134µs   max=76.13ms p(90)=2.34ms   p(95)=4.13ms  
     http_req_sending...............: avg=49.43µs  min=8.31µs  med=20.49µs max=2.64ms  p(90)=73.04µs  p(95)=174.38µs
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.35s    min=1.25s   med=3.21s   max=7.54s   p(90)=4.83s    p(95)=5.5s    
     http_reqs......................: 928     28.933688/s
     iteration_duration.............: avg=3.37s    min=1.28s   med=3.22s   max=7.58s   p(90)=4.85s    p(95)=5.52s   
     iterations.....................: 928     28.933688/s
     vus............................: 9       min=9       max=100
     vus_max........................: 100     min=100     max=100

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

@github-actions
Copy link

github-actions bot commented Oct 2, 2024

Overview for: federation-v1/constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
cosmo 171 5210 total, 0 failed avg: 511ms, p95: 680ms
apollo-router 168 5108 total, 0 failed avg: 504ms, p95: 716ms
wundergraph 148 4509 total, 0 failed avg: 548ms, p95: 970ms
mesh-supergraph-bun 80 2467 total, 0 failed avg: 1211ms, p95: 2133ms
apollo-server 49 1543 total, 0 failed avg: 1987ms, p95: 2732ms
mercurius 30 927 total, 0 failed avg: 3263ms, p95: 4655ms
mesh-supergraph 29 934 total, 0 failed avg: 3349ms, p95: 5533ms
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 15630      ✗ 0    
     data_received..................: 457 MB  15 MB/s
     data_sent......................: 6.2 MB  204 kB/s
     http_req_blocked...............: avg=43.65µs  min=1.48µs  med=2.85µs   max=70.35ms  p(90)=4.41µs   p(95)=5.47µs  
     http_req_connecting............: avg=14.88µs  min=0s      med=0s       max=2.06ms   p(90)=0s       p(95)=0s      
     http_req_duration..............: avg=510.67ms min=25.23ms med=515.57ms max=1.33s    p(90)=616.79ms p(95)=680.35ms
       { expected_response:true }...: avg=510.67ms min=25.23ms med=515.57ms max=1.33s    p(90)=616.79ms p(95)=680.35ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 5210 
     http_req_receiving.............: avg=24.5ms   min=33.64µs med=79.7µs   max=1.15s    p(90)=50.27ms  p(95)=137.47ms
     http_req_sending...............: avg=1.38ms   min=8.25µs  med=13.44µs  max=678.66ms p(90)=35.39µs  p(95)=258.91µs
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=484.78ms min=25.13ms med=501.46ms max=847.58ms p(90)=588.48ms p(95)=619.05ms
     http_reqs......................: 5210    171.480275/s
     iteration_duration.............: avg=579.99ms min=34.91ms med=555.39ms max=2.6s     p(90)=750.98ms p(95)=883.85ms
     iterations.....................: 5210    171.480275/s
     vus............................: 100     min=100      max=100
     vus_max........................: 100     min=100      max=100

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 15324      ✗ 0    
     data_received..................: 448 MB  15 MB/s
     data_sent......................: 6.1 MB  200 kB/s
     http_req_blocked...............: avg=22.75µs  min=1.6µs   med=3.19µs   max=5.19ms   p(90)=5.01µs   p(95)=6.09µs  
     http_req_connecting............: avg=15.65µs  min=0s      med=0s       max=5.15ms   p(90)=0s       p(95)=0s      
     http_req_duration..............: avg=503.68ms min=35.25ms med=502.73ms max=1.74s    p(90)=657.07ms p(95)=716.1ms 
       { expected_response:true }...: avg=503.68ms min=35.25ms med=502.73ms max=1.74s    p(90)=657.07ms p(95)=716.1ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 5108 
     http_req_receiving.............: avg=25.62ms  min=38.1µs  med=79.68µs  max=1.47s    p(90)=48.82ms  p(95)=138.15ms
     http_req_sending...............: avg=1.53ms   min=9.25µs  med=16.23µs  max=636.54ms p(90)=47.15µs  p(95)=351.53µs
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=476.53ms min=34.38ms med=491.01ms max=921.46ms p(90)=615.41ms p(95)=657.87ms
     http_reqs......................: 5108    168.742457/s
     iteration_duration.............: avg=590.11ms min=65.8ms  med=556.24ms max=2.92s    p(90)=792.3ms  p(95)=968.43ms
     iterations.....................: 5108    168.742457/s
     vus............................: 94      min=94       max=100
     vus_max........................: 100     min=100      max=100

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `wundergraph`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 13527      ✗ 0    
     data_received..................: 396 MB  13 MB/s
     data_sent......................: 5.4 MB  176 kB/s
     http_req_blocked...............: avg=188.23µs min=1.54µs  med=3.29µs   max=167.17ms p(90)=5.41µs  p(95)=7.01µs  
     http_req_connecting............: avg=59.18µs  min=0s      med=0s       max=40.2ms   p(90)=0s      p(95)=0s      
     http_req_duration..............: avg=547.51ms min=12.17ms med=523.32ms max=2.05s    p(90)=870.1ms p(95)=970.17ms
       { expected_response:true }...: avg=547.51ms min=12.17ms med=523.32ms max=2.05s    p(90)=870.1ms p(95)=970.17ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 4509 
     http_req_receiving.............: avg=47.37ms  min=38.8µs  med=99.99µs  max=1.81s    p(90)=128.4ms p(95)=327.45ms
     http_req_sending...............: avg=2.28ms   min=7.73µs  med=15.71µs  max=637.18ms p(90)=82.02µs p(95)=1.04ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s      p(95)=0s      
     http_req_waiting...............: avg=497.85ms min=11.98ms med=477.98ms max=1.23s    p(90)=807.3ms p(95)=903.9ms 
     http_reqs......................: 4509    148.521657/s
     iteration_duration.............: avg=670.39ms min=33.58ms med=610.68ms max=2.61s    p(90)=1.07s   p(95)=1.27s   
     iterations.....................: 4509    148.521657/s
     vus............................: 100     min=100      max=100
     vus_max........................: 100     min=100      max=100

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mesh-supergraph-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 7401      ✗ 0    
     data_received..................: 216 MB  7.0 MB/s
     data_sent......................: 2.9 MB  95 kB/s
     http_req_blocked...............: avg=68.97µs  min=1.31µs   med=3.01µs   max=7.01ms   p(90)=5.38µs p(95)=12.43µs 
     http_req_connecting............: avg=56.74µs  min=0s       med=0s       max=4.85ms   p(90)=0s     p(95)=0s      
     http_req_duration..............: avg=1.21s    min=541.38ms med=1.04s    max=2.97s    p(90)=1.94s  p(95)=2.13s   
       { expected_response:true }...: avg=1.21s    min=541.38ms med=1.04s    max=2.97s    p(90)=1.94s  p(95)=2.13s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 2467 
     http_req_receiving.............: avg=12.17ms  min=40.38µs  med=102.29µs max=689.63ms p(90)=1.64ms p(95)=49.04ms 
     http_req_sending...............: avg=391.37µs min=8.27µs   med=14.31µs  max=91.7ms   p(90)=51.9µs p(95)=441.35µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s     p(95)=0s      
     http_req_waiting...............: avg=1.19s    min=539.82ms med=1.03s    max=2.96s    p(90)=1.93s  p(95)=2.11s   
     http_reqs......................: 2467    80.239414/s
     iteration_duration.............: avg=1.23s    min=552.1ms  med=1.06s    max=3.01s    p(90)=1.97s  p(95)=2.17s   
     iterations.....................: 2467    80.239414/s
     vus............................: 100     min=100     max=100
     vus_max........................: 100     min=100     max=100

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 4629      ✗ 0    
     data_received..................: 136 MB  4.3 MB/s
     data_sent......................: 1.8 MB  58 kB/s
     http_req_blocked...............: avg=29.51µs  min=1.54µs   med=3.2µs    max=3.33ms   p(90)=5.27µs  p(95)=129.46µs
     http_req_connecting............: avg=17.22µs  min=0s       med=0s       max=911.49µs p(90)=0s      p(95)=94.67µs 
     http_req_duration..............: avg=1.98s    min=638.29ms med=1.65s    max=20.8s    p(90)=2.02s   p(95)=2.73s   
       { expected_response:true }...: avg=1.98s    min=638.29ms med=1.65s    max=20.8s    p(90)=2.02s   p(95)=2.73s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 1543 
     http_req_receiving.............: avg=224.65µs min=53.37µs  med=120.72µs max=46.09ms  p(90)=194.9µs p(95)=258.15µs
     http_req_sending...............: avg=32.69µs  min=8.73µs   med=16.65µs  max=2.32ms   p(90)=34.8µs  p(95)=77.69µs 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s      p(95)=0s      
     http_req_waiting...............: avg=1.98s    min=638.11ms med=1.65s    max=20.8s    p(90)=2.02s   p(95)=2.73s   
     http_reqs......................: 1543    49.097434/s
     iteration_duration.............: avg=1.99s    min=647.12ms med=1.66s    max=20.81s   p(90)=2.03s   p(95)=2.73s   
     iterations.....................: 1543    49.097434/s
     vus............................: 40      min=40      max=100
     vus_max........................: 100     min=100     max=100

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 2781      ✗ 0    
     data_received..................: 81 MB   2.7 MB/s
     data_sent......................: 1.1 MB  36 kB/s
     http_req_blocked...............: avg=104.88µs min=1.71µs   med=3.65µs   max=2.54ms  p(90)=128.78µs p(95)=969.57µs
     http_req_connecting............: avg=93.09µs  min=0s       med=0s       max=2.43ms  p(90)=94.79µs  p(95)=903.03µs
     http_req_duration..............: avg=3.26s    min=580.24ms med=3.04s    max=7.69s   p(90)=4.27s    p(95)=4.65s   
       { expected_response:true }...: avg=3.26s    min=580.24ms med=3.04s    max=7.69s   p(90)=4.27s    p(95)=4.65s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 927  
     http_req_receiving.............: avg=182.43µs min=45.05µs  med=109.65µs max=10.71ms p(90)=182.17µs p(95)=271.63µs
     http_req_sending...............: avg=60.98µs  min=8.58µs   med=20.77µs  max=1.74ms  p(90)=49.92µs  p(95)=377.52µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.26s    min=580.02ms med=3.04s    max=7.69s   p(90)=4.27s    p(95)=4.65s   
     http_reqs......................: 927     30.266293/s
     iteration_duration.............: avg=3.27s    min=590.57ms med=3.05s    max=7.7s    p(90)=4.28s    p(95)=4.66s   
     iterations.....................: 927     30.266293/s
     vus............................: 100     min=100     max=100
     vus_max........................: 100     min=100     max=100

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mesh-supergraph`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 2802     ✗ 0    
     data_received..................: 82 MB   2.6 MB/s
     data_sent......................: 1.1 MB  35 kB/s
     http_req_blocked...............: avg=351.61µs min=1.41µs  med=3.84µs   max=6.36ms  p(90)=157.29µs p(95)=3.38ms  
     http_req_connecting............: avg=335.6µs  min=0s      med=0s       max=6.31ms  p(90)=112.87µs p(95)=3.33ms  
     http_req_duration..............: avg=3.34s    min=1.56s   med=3.08s    max=7.44s   p(90)=4.83s    p(95)=5.53s   
       { expected_response:true }...: avg=3.34s    min=1.56s   med=3.08s    max=7.44s   p(90)=4.83s    p(95)=5.53s   
     http_req_failed................: 0.00%   ✓ 0        ✗ 934  
     http_req_receiving.............: avg=2.25ms   min=42.88µs med=142.48µs max=78.18ms p(90)=2.6ms    p(95)=5ms     
     http_req_sending...............: avg=93.66µs  min=8.79µs  med=21.65µs  max=11.28ms p(90)=79.15µs  p(95)=344.56µs
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.34s    min=1.56s   med=3.08s    max=7.44s   p(90)=4.82s    p(95)=5.53s   
     http_reqs......................: 934     29.11251/s
     iteration_duration.............: avg=3.36s    min=1.57s   med=3.1s     max=7.45s   p(90)=4.85s    p(95)=5.55s   
     iterations.....................: 934     29.11251/s
     vus............................: 17      min=17     max=100
     vus_max........................: 100     min=100    max=100

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

@github-actions
Copy link

github-actions bot commented Oct 2, 2024

Overview for: federation-v1/constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
apollo-router 167 5090 total, 0 failed avg: 344ms, p95: 912ms
cosmo 163 4985 total, 0 failed avg: 354ms, p95: 909ms
wundergraph 155 4710 total, 0 failed avg: 358ms, p95: 1006ms
mesh-supergraph-bun 94 2938 total, 0 failed avg: 1001ms, p95: 1673ms
apollo-server 65 2014 total, 0 failed avg: 1504ms, p95: 1968ms
mesh-supergraph 57 1786 total, 0 failed avg: 1683ms, p95: 2587ms
mercurius 46 1418 total, 0 failed avg: 2126ms, p95: 2663ms
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 15270      ✗ 0    
     data_received..................: 447 MB  15 MB/s
     data_sent......................: 6.0 MB  199 kB/s
     http_req_blocked...............: avg=178.78µs min=1.54µs  med=3.33µs   max=209.79ms p(90)=5.31µs   p(95)=6.71µs  
     http_req_connecting............: avg=168.13µs min=0s      med=0s       max=209.72ms p(90)=0s       p(95)=0s      
     http_req_duration..............: avg=343.9ms  min=12.24ms med=258.35ms max=1.82s    p(90)=748.73ms p(95)=912.09ms
       { expected_response:true }...: avg=343.9ms  min=12.24ms med=258.35ms max=1.82s    p(90)=748.73ms p(95)=912.09ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 5090 
     http_req_receiving.............: avg=131.86ms min=35.68µs med=92.78µs  max=1.74s    p(90)=530.49ms p(95)=700.03ms
     http_req_sending...............: avg=5.8ms    min=8.7µs   med=15.3µs   max=1.14s    p(90)=98.11µs  p(95)=1.31ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=206.24ms min=12.15ms med=204.24ms max=726.82ms p(90)=334.11ms p(95)=393.16ms
     http_reqs......................: 5090    167.946541/s
     iteration_duration.............: avg=592.77ms min=24.89ms med=481.75ms max=3.06s    p(90)=1.2s     p(95)=1.48s   
     iterations.....................: 5090    167.946541/s
     vus............................: 100     min=100      max=100
     vus_max........................: 100     min=100      max=100

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 14955      ✗ 0    
     data_received..................: 437 MB  14 MB/s
     data_sent......................: 5.9 MB  194 kB/s
     http_req_blocked...............: avg=236.78µs min=1.68µs  med=3.24µs   max=179.78ms p(90)=5.19µs   p(95)=7.38µs  
     http_req_connecting............: avg=127.82µs min=0s      med=0s       max=132.2ms  p(90)=0s       p(95)=0s      
     http_req_duration..............: avg=354.15ms min=20.32ms med=269.34ms max=1.97s    p(90)=757.07ms p(95)=908.7ms 
       { expected_response:true }...: avg=354.15ms min=20.32ms med=269.34ms max=1.97s    p(90)=757.07ms p(95)=908.7ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 4985 
     http_req_receiving.............: avg=141.56ms min=38.06µs med=142.95µs max=1.8s     p(90)=554.81ms p(95)=681.18ms
     http_req_sending...............: avg=5.7ms    min=8.8µs   med=15.33µs  max=1.09s    p(90)=105.54µs p(95)=2.39ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=206.88ms min=16.5ms  med=198.93ms max=769.23ms p(90)=338.6ms  p(95)=388.46ms
     http_reqs......................: 4985    163.712533/s
     iteration_duration.............: avg=607.59ms min=31.36ms med=509.63ms max=2.92s    p(90)=1.2s     p(95)=1.46s   
     iterations.....................: 4985    163.712533/s
     vus............................: 100     min=100      max=100
     vus_max........................: 100     min=100      max=100

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `wundergraph`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 14130      ✗ 0    
     data_received..................: 413 MB  14 MB/s
     data_sent......................: 5.6 MB  184 kB/s
     http_req_blocked...............: avg=192.37µs min=1.71µs  med=3.25µs   max=339.02ms p(90)=5.12µs   p(95)=6.75µs  
     http_req_connecting............: avg=101.11µs min=0s      med=0s       max=338.96ms p(90)=0s       p(95)=0s      
     http_req_duration..............: avg=358.12ms min=12.56ms med=242.73ms max=2.57s    p(90)=806.94ms p(95)=1s      
       { expected_response:true }...: avg=358.12ms min=12.56ms med=242.73ms max=2.57s    p(90)=806.94ms p(95)=1s      
     http_req_failed................: 0.00%   ✓ 0          ✗ 4710 
     http_req_receiving.............: avg=164.6ms  min=33.72µs med=134.49µs max=2.16s    p(90)=605.14ms p(95)=800.72ms
     http_req_sending...............: avg=6.92ms   min=8.52µs  med=14.83µs  max=1.52s    p(90)=107.3µs  p(95)=1.82ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=186.59ms min=12.38ms med=173.79ms max=962.08ms p(90)=322.45ms p(95)=376.09ms
     http_reqs......................: 4710    155.372857/s
     iteration_duration.............: avg=640.32ms min=26.31ms med=522.81ms max=3.51s    p(90)=1.33s    p(95)=1.65s   
     iterations.....................: 4710    155.372857/s
     vus............................: 100     min=100      max=100
     vus_max........................: 100     min=100      max=100

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mesh-supergraph-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 8814      ✗ 0    
     data_received..................: 258 MB  8.3 MB/s
     data_sent......................: 3.5 MB  112 kB/s
     http_req_blocked...............: avg=55.69µs  min=1.73µs   med=3.53µs   max=5ms      p(90)=5.84µs  p(95)=12.51µs 
     http_req_connecting............: avg=40.51µs  min=0s       med=0s       max=4.65ms   p(90)=0s      p(95)=0s      
     http_req_duration..............: avg=1s       min=218.55ms med=866.19ms max=2.7s     p(90)=1.54s   p(95)=1.67s   
       { expected_response:true }...: avg=1s       min=218.55ms med=866.19ms max=2.7s     p(90)=1.54s   p(95)=1.67s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 2938 
     http_req_receiving.............: avg=15.04ms  min=41.69µs  med=106.53µs max=639.58ms p(90)=21.77ms p(95)=112.97ms
     http_req_sending...............: avg=605.78µs min=9.29µs   med=16.24µs  max=161.77ms p(90)=53.21µs p(95)=298.13µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s      p(95)=0s      
     http_req_waiting...............: avg=985.64ms min=218.46ms med=858.55ms max=2.06s    p(90)=1.52s   p(95)=1.66s   
     http_reqs......................: 2938    94.725988/s
     iteration_duration.............: avg=1.04s    min=232ms    med=900.89ms max=2.71s    p(90)=1.58s   p(95)=1.71s   
     iterations.....................: 2938    94.725988/s
     vus............................: 7       min=7       max=100
     vus_max........................: 100     min=100     max=100

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 6042      ✗ 0    
     data_received..................: 177 MB  5.7 MB/s
     data_sent......................: 2.4 MB  77 kB/s
     http_req_blocked...............: avg=67.94µs  min=1.66µs   med=3.72µs   max=6.6ms   p(90)=5.42µs   p(95)=126.88µs
     http_req_connecting............: avg=57.43µs  min=0s       med=0s       max=6.54ms  p(90)=0s       p(95)=0s      
     http_req_duration..............: avg=1.5s     min=284.64ms med=1.32s    max=15.75s  p(90)=1.73s    p(95)=1.96s   
       { expected_response:true }...: avg=1.5s     min=284.64ms med=1.32s    max=15.75s  p(90)=1.73s    p(95)=1.96s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 2014 
     http_req_receiving.............: avg=198.58µs min=47.62µs  med=119.71µs max=21.18ms p(90)=200.26µs p(95)=267.37µs
     http_req_sending...............: avg=55.5µs   min=9.9µs    med=20.49µs  max=7.11ms  p(90)=36.59µs  p(95)=127.63µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=1.5s     min=284.5ms  med=1.32s    max=15.75s  p(90)=1.73s    p(95)=1.96s   
     http_reqs......................: 2014    65.057097/s
     iteration_duration.............: avg=1.51s    min=296.29ms med=1.33s    max=15.77s  p(90)=1.74s    p(95)=1.99s   
     iterations.....................: 2014    65.057097/s
     vus............................: 100     min=100     max=100
     vus_max........................: 100     min=100     max=100

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mesh-supergraph`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 5358      ✗ 0    
     data_received..................: 157 MB  5.1 MB/s
     data_sent......................: 2.1 MB  69 kB/s
     http_req_blocked...............: avg=57.13µs  min=1.82µs   med=4.83µs   max=4.96ms   p(90)=6.76µs  p(95)=163.2µs 
     http_req_connecting............: avg=42.95µs  min=0s       med=0s       max=4.92ms   p(90)=0s      p(95)=88.41µs 
     http_req_duration..............: avg=1.68s    min=853.36ms med=1.58s    max=3.33s    p(90)=2.2s    p(95)=2.58s   
       { expected_response:true }...: avg=1.68s    min=853.36ms med=1.58s    max=3.33s    p(90)=2.2s    p(95)=2.58s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 1786 
     http_req_receiving.............: avg=1.72ms   min=42.7µs   med=146.29µs max=118.62ms p(90)=2.98ms  p(95)=6.97ms  
     http_req_sending...............: avg=138.28µs min=9.24µs   med=27.65µs  max=24.56ms  p(90)=55.18µs p(95)=156.05µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s      p(95)=0s      
     http_req_waiting...............: avg=1.68s    min=852.19ms med=1.58s    max=3.33s    p(90)=2.2s    p(95)=2.58s   
     http_reqs......................: 1786    57.702802/s
     iteration_duration.............: avg=1.7s     min=869.55ms med=1.61s    max=3.34s    p(90)=2.23s   p(95)=2.62s   
     iterations.....................: 1786    57.702802/s
     vus............................: 100     min=100     max=100
     vus_max........................: 100     min=100     max=100

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 4254      ✗ 0    
     data_received..................: 125 MB  4.1 MB/s
     data_sent......................: 1.7 MB  55 kB/s
     http_req_blocked...............: avg=116.3µs  min=1.57µs   med=3.72µs   max=6.38ms  p(90)=5.89µs   p(95)=480.96µs
     http_req_connecting............: avg=100.51µs min=0s       med=0s       max=6.28ms  p(90)=0s       p(95)=437.51µs
     http_req_duration..............: avg=2.12s    min=595.77ms med=2.09s    max=4.36s   p(90)=2.55s    p(95)=2.66s   
       { expected_response:true }...: avg=2.12s    min=595.77ms med=2.09s    max=4.36s   p(90)=2.55s    p(95)=2.66s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 1418 
     http_req_receiving.............: avg=260.63µs min=44.34µs  med=112.29µs max=44.39ms p(90)=240.89µs p(95)=445.57µs
     http_req_sending...............: avg=49.24µs  min=8.48µs   med=21.28µs  max=3.06ms  p(90)=42.57µs  p(95)=165.48µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=2.12s    min=595.65ms med=2.09s    max=4.36s   p(90)=2.55s    p(95)=2.66s   
     http_reqs......................: 1418    46.359355/s
     iteration_duration.............: avg=2.13s    min=604.09ms med=2.1s     max=4.37s   p(90)=2.56s    p(95)=2.67s   
     iterations.....................: 1418    46.359355/s
     vus............................: 100     min=100     max=100
     vus_max........................: 100     min=100     max=100

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

@github-actions
Copy link

github-actions bot commented Oct 2, 2024

Overview for: federation-v1/ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was trying to reach 500 concurrent VUs over 60s

Comparison

Comparison

Gateway duration(p95)⬇️ RPS Requests Durations Notes
wundergraph 2071ms 161 11282 total, 0 failed avg: 800ms, p95: 2071ms, max: 5785ms, med: 647ms
cosmo 2377ms 161 11322 total, 0 failed avg: 838ms, p95: 2377ms, max: 5975ms, med: 616ms
apollo-router 2379ms 166 11645 total, 0 failed avg: 887ms, p95: 2380ms, max: 6660ms, med: 736ms
mesh-supergraph-bun 6516ms 99 6960 total, 0 failed avg: 2674ms, p95: 6517ms, max: 10351ms, med: 2481ms
mesh-supergraph 6744ms 67 4725 total, 0 failed avg: 4042ms, p95: 6744ms, max: 8341ms, med: 4233ms
apollo-server 23775ms 68 5006 total, 0 failed avg: 4169ms, p95: 23776ms, max: 45038ms, med: 2201ms
Summary for: `wundergraph`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 33846      ✗ 0    
     data_received..................: 990 MB  14 MB/s
     data_sent......................: 13 MB   191 kB/s
     http_req_blocked...............: avg=25.69ms  min=1.53µs  med=3.17µs   max=3.46s p(90)=5.08µs   p(95)=28.52µs 
     http_req_connecting............: avg=24.84ms  min=0s      med=0s       max=3.46s p(90)=0s       p(95)=0s      
     http_req_duration..............: avg=800.33ms min=6.29ms  med=646.91ms max=5.78s p(90)=1.69s    p(95)=2.07s   
       { expected_response:true }...: avg=800.33ms min=6.29ms  med=646.91ms max=5.78s p(90)=1.69s    p(95)=2.07s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 11282
     http_req_receiving.............: avg=210.74ms min=31.79µs med=78.95µs  max=4.07s p(90)=959.89ms p(95)=1.36s   
     http_req_sending...............: avg=31.42ms  min=8.04µs  med=14.72µs  max=3.18s p(90)=665.48µs p(95)=107.42ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s    p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=558.16ms min=6.2ms   med=460.75ms max=3.17s p(90)=1.11s    p(95)=1.33s   
     http_reqs......................: 11282   161.145567/s
     iteration_duration.............: avg=1.62s    min=12.1ms  med=1.24s    max=9.24s p(90)=3.6s     p(95)=4.41s   
     iterations.....................: 11282   161.145567/s
     vus............................: 1       min=1        max=495
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 33966     ✗ 0    
     data_received..................: 993 MB  14 MB/s
     data_sent......................: 13 MB   192 kB/s
     http_req_blocked...............: avg=20.47ms  min=1.86µs  med=4µs      max=5.04s  p(90)=6.69µs   p(95)=27.69µs 
     http_req_connecting............: avg=19.54ms  min=0s      med=0s       max=5.04s  p(90)=0s       p(95)=0s      
     http_req_duration..............: avg=838.33ms min=7.33ms  med=615.75ms max=5.97s  p(90)=1.91s    p(95)=2.37s   
       { expected_response:true }...: avg=838.33ms min=7.33ms  med=615.75ms max=5.97s  p(90)=1.91s    p(95)=2.37s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 11322
     http_req_receiving.............: avg=272.37ms min=34.85µs med=106.14µs max=4.28s  p(90)=1.19s    p(95)=1.63s   
     http_req_sending...............: avg=35.28ms  min=8.65µs  med=20.71µs  max=3.67s  p(90)=479.01µs p(95)=113.22ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=530.67ms min=7.22ms  med=380.32ms max=3.39s  p(90)=1.15s    p(95)=1.45s   
     http_reqs......................: 11322   161.73992/s
     iteration_duration.............: avg=1.62s    min=13.08ms med=1.18s    max=10.05s p(90)=3.77s    p(95)=4.65s   
     iterations.....................: 11322   161.73992/s
     vus............................: 1       min=1       max=499
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 34935      ✗ 0    
     data_received..................: 1.0 GB  15 MB/s
     data_sent......................: 14 MB   197 kB/s
     http_req_blocked...............: avg=27.38ms  min=1.66µs  med=3.62µs   max=5.64s  p(90)=5.95µs p(95)=23.11µs 
     http_req_connecting............: avg=26.28ms  min=0s      med=0s       max=5.63s  p(90)=0s     p(95)=0s      
     http_req_duration..............: avg=887.23ms min=6.13ms  med=735.86ms max=6.66s  p(90)=1.9s   p(95)=2.37s   
       { expected_response:true }...: avg=887.23ms min=6.13ms  med=735.86ms max=6.66s  p(90)=1.9s   p(95)=2.37s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 11645
     http_req_receiving.............: avg=245.81ms min=31.04µs med=86.25µs  max=4.25s  p(90)=1.03s  p(95)=1.41s   
     http_req_sending...............: avg=36.57ms  min=8.56µs  med=16.87µs  max=3.9s   p(90)=7.69ms p(95)=160.24ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s     p(95)=0s      
     http_req_waiting...............: avg=604.84ms min=6.06ms  med=490.98ms max=4s     p(90)=1.23s  p(95)=1.49s   
     http_reqs......................: 11645   166.330783/s
     iteration_duration.............: avg=1.59s    min=11.98ms med=1.23s    max=10.45s p(90)=3.49s  p(95)=4.32s   
     iterations.....................: 11645   166.330783/s
     vus............................: 1       min=1        max=499
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mesh-supergraph-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 20880     ✗ 0    
     data_received..................: 611 MB  8.7 MB/s
     data_sent......................: 8.3 MB  118 kB/s
     http_req_blocked...............: avg=2.31ms  min=1.58µs  med=3.17µs  max=386.52ms p(90)=6.32µs  p(95)=241.83µs
     http_req_connecting............: avg=2.19ms  min=0s      med=0s      max=386.45ms p(90)=0s      p(95)=164.78µs
     http_req_duration..............: avg=2.67s   min=8.21ms  med=2.48s   max=10.35s   p(90)=5.48s   p(95)=6.51s   
       { expected_response:true }...: avg=2.67s   min=8.21ms  med=2.48s   max=10.35s   p(90)=5.48s   p(95)=6.51s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 6960 
     http_req_receiving.............: avg=26.11ms min=34.2µs  med=79.36µs max=1.68s    p(90)=12.27ms p(95)=148.58ms
     http_req_sending...............: avg=2.84ms  min=8.71µs  med=14.67µs max=792.17ms p(90)=96.08µs p(95)=10.77ms 
     http_req_tls_handshaking.......: avg=0s      min=0s      med=0s      max=0s       p(90)=0s      p(95)=0s      
     http_req_waiting...............: avg=2.64s   min=8.04ms  med=2.44s   max=10.35s   p(90)=5.46s   p(95)=6.48s   
     http_reqs......................: 6960    99.414583/s
     iteration_duration.............: avg=2.74s   min=14.72ms med=2.52s   max=10.47s   p(90)=5.57s   p(95)=6.61s   
     iterations.....................: 6960    99.414583/s
     vus............................: 1       min=1       max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mesh-supergraph`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 14175     ✗ 0    
     data_received..................: 415 MB  5.9 MB/s
     data_sent......................: 5.6 MB  80 kB/s
     http_req_blocked...............: avg=340.97µs min=1.51µs  med=3.65µs   max=91.4ms   p(90)=164.82µs p(95)=272.81µs
     http_req_connecting............: avg=323.96µs min=0s      med=0s       max=91.31ms  p(90)=110.04µs p(95)=184.51µs
     http_req_duration..............: avg=4.04s    min=19.05ms med=4.23s    max=8.34s    p(90)=6.29s    p(95)=6.74s   
       { expected_response:true }...: avg=4.04s    min=19.05ms med=4.23s    max=8.34s    p(90)=6.29s    p(95)=6.74s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 4725 
     http_req_receiving.............: avg=2.47ms   min=36.79µs med=106.49µs max=238.37ms p(90)=2.43ms   p(95)=5.42ms  
     http_req_sending...............: avg=341.56µs min=8.2µs   med=20.24µs  max=182.29ms p(90)=46.06µs  p(95)=74.62µs 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=4.03s    min=18.85ms med=4.23s    max=8.34s    p(90)=6.29s    p(95)=6.74s   
     http_reqs......................: 4725    67.480705/s
     iteration_duration.............: avg=4.07s    min=26.4ms  med=4.25s    max=8.37s    p(90)=6.35s    p(95)=6.76s   
     iterations.....................: 4725    67.480705/s
     vus............................: 1       min=1       max=499
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 15018     ✗ 0    
     data_received..................: 440 MB  6.0 MB/s
     data_sent......................: 5.9 MB  81 kB/s
     http_req_blocked...............: avg=88.9µs   min=1.5µs   med=3.09µs   max=38.39ms  p(90)=107.38µs p(95)=228.37µs
     http_req_connecting............: avg=78.44µs  min=0s      med=0s       max=38.3ms   p(90)=0s       p(95)=155.92µs
     http_req_duration..............: avg=4.16s    min=88.37ms med=2.2s     max=45.03s   p(90)=3.51s    p(95)=23.77s  
       { expected_response:true }...: avg=4.16s    min=88.37ms med=2.2s     max=45.03s   p(90)=3.51s    p(95)=23.77s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 5006 
     http_req_receiving.............: avg=374.62µs min=46.96µs med=111.57µs max=152.97ms p(90)=194.59µs p(95)=286.73µs
     http_req_sending...............: avg=56.31µs  min=8.91µs  med=16.27µs  max=28.63ms  p(90)=40.73µs  p(95)=58.62µs 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=4.16s    min=88.23ms med=2.2s     max=45.03s   p(90)=3.51s    p(95)=23.77s  
     http_reqs......................: 5006    68.401811/s
     iteration_duration.............: avg=4.18s    min=96.47ms med=2.21s    max=45.04s   p(90)=3.52s    p(95)=23.78s  
     iterations.....................: 5006    68.401811/s
     vus............................: 22      min=22      max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

@renovate renovate bot force-pushed the renovate/node-20.x-lockfile branch 2 times, most recently from 09f335a to 40adb50 Compare October 2, 2024 14:40
@renovate renovate bot force-pushed the renovate/node-20.x-lockfile branch from 40adb50 to 9c96a7a Compare October 2, 2024 15:10
@renovate renovate bot merged commit df9fc5e into main Oct 2, 2024
33 checks passed
@renovate renovate bot deleted the renovate/node-20.x-lockfile branch October 2, 2024 16:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants