Skip to content

Conversation

@renovate
Copy link
Contributor

@renovate renovate bot commented Apr 8, 2024

This PR contains the following updates:

Package Change Age Adoption Passing Confidence
tablemark 3.0.0 -> 3.1.0 age adoption passing confidence

Release Notes

haltcase/tablemark (tablemark)

v3.1.0

Compare Source

FEATURES


Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

Rebasing: Whenever PR is behind base branch, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.


  • If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

@renovate renovate bot force-pushed the renovate/tablemark-3.x branch from 4d3e49d to 3f5aa4c Compare October 2, 2024 13:01
@github-actions
Copy link

github-actions bot commented Oct 2, 2024

Overview for: federation-v1/constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
cosmo 194 5933 total, 0 failed avg: 337ms, p95: 789ms
apollo-router 175 5327 total, 0 failed avg: 482ms, p95: 728ms
wundergraph 150 4588 total, 0 failed avg: 549ms, p95: 1011ms
mesh-supergraph-bun 78 2412 total, 0 failed avg: 1227ms, p95: 2160ms
apollo-server 53 1682 total, 0 failed avg: 1816ms, p95: 2110ms
mercurius 29 906 total, 0 failed avg: 3353ms, p95: 4779ms
mesh-supergraph 25 825 total, 0 failed avg: 3737ms, p95: 6126ms
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 17799      ✗ 0    
     data_received..................: 521 MB  17 MB/s
     data_sent......................: 7.0 MB  231 kB/s
     http_req_blocked...............: avg=247.63µs min=1.41µs  med=2.7µs    max=555.51ms p(90)=4µs      p(95)=4.97µs  
     http_req_connecting............: avg=100.14µs min=0s      med=0s       max=215.6ms  p(90)=0s       p(95)=0s      
     http_req_duration..............: avg=336.76ms min=9.77ms  med=290.21ms max=2.25s    p(90)=604.42ms p(95)=788.95ms
       { expected_response:true }...: avg=336.76ms min=9.77ms  med=290.21ms max=2.25s    p(90)=604.42ms p(95)=788.95ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 5933 
     http_req_receiving.............: avg=82.68ms  min=39.37µs med=78.06µs  max=2.02s    p(90)=321.97ms p(95)=543.62ms
     http_req_sending...............: avg=4.94ms   min=7.46µs  med=13.09µs  max=924.05ms p(90)=98.54µs  p(95)=8.69ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=249.13ms min=9.26ms  med=236.78ms max=771.03ms p(90)=428.11ms p(95)=493.62ms
     http_reqs......................: 5933    194.975197/s
     iteration_duration.............: avg=509.64ms min=19.78ms med=435.42ms max=2.56s    p(90)=968.84ms p(95)=1.21s   
     iterations.....................: 5933    194.975197/s
     vus............................: 100     min=100      max=100
     vus_max........................: 100     min=100      max=100

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 15981      ✗ 0    
     data_received..................: 467 MB  15 MB/s
     data_sent......................: 6.3 MB  208 kB/s
     http_req_blocked...............: avg=36.23µs  min=1.4µs   med=2.78µs   max=81.17ms  p(90)=4.34µs   p(95)=5.54µs  
     http_req_connecting............: avg=14.22µs  min=0s      med=0s       max=2.88ms   p(90)=0s       p(95)=0s      
     http_req_duration..............: avg=481.74ms min=28.48ms med=479.61ms max=1.96s    p(90)=624.31ms p(95)=727.61ms
       { expected_response:true }...: avg=481.74ms min=28.48ms med=479.61ms max=1.96s    p(90)=624.31ms p(95)=727.61ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 5327 
     http_req_receiving.............: avg=37.15ms  min=36.01µs med=74.83µs  max=1.77s    p(90)=82.64ms  p(95)=201.03ms
     http_req_sending...............: avg=2.53ms   min=8.03µs  med=13.51µs  max=1.16s    p(90)=43.45µs  p(95)=227.54µs
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=442.06ms min=17.99ms med=464.1ms  max=927.39ms p(90)=578.51ms p(95)=609.64ms
     http_reqs......................: 5327    175.505151/s
     iteration_duration.............: avg=566.56ms min=41.5ms  med=527.1ms  max=2.81s    p(90)=767.13ms p(95)=962.6ms 
     iterations.....................: 5327    175.505151/s
     vus............................: 100     min=100      max=100
     vus_max........................: 100     min=100      max=100

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `wundergraph`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 13764      ✗ 0    
     data_received..................: 403 MB  13 MB/s
     data_sent......................: 5.4 MB  179 kB/s
     http_req_blocked...............: avg=30.27µs  min=1.38µs  med=3.03µs   max=24.54ms p(90)=4.69µs   p(95)=6.41µs  
     http_req_connecting............: avg=12.42µs  min=0s      med=0s       max=2ms     p(90)=0s       p(95)=0s      
     http_req_duration..............: avg=549.06ms min=23.29ms med=512.36ms max=1.94s   p(90)=891.09ms p(95)=1.01s   
       { expected_response:true }...: avg=549.06ms min=23.29ms med=512.36ms max=1.94s   p(90)=891.09ms p(95)=1.01s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 4588 
     http_req_receiving.............: avg=44.96ms  min=39.68µs med=86.68µs  max=1.71s   p(90)=122.94ms p(95)=336.47ms
     http_req_sending...............: avg=3.14ms   min=7.76µs  med=13.87µs  max=867.3ms p(90)=45.94µs  p(95)=492.1µs 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=500.95ms min=20.8ms  med=469.78ms max=1.59s   p(90)=823.15ms p(95)=919.06ms
     http_reqs......................: 4588    150.835347/s
     iteration_duration.............: avg=659.89ms min=34.48ms med=602.06ms max=2.55s   p(90)=1.08s    p(95)=1.21s   
     iterations.....................: 4588    150.835347/s
     vus............................: 100     min=100      max=100
     vus_max........................: 100     min=100      max=100

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mesh-supergraph-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 7236      ✗ 0    
     data_received..................: 212 MB  6.9 MB/s
     data_sent......................: 2.9 MB  93 kB/s
     http_req_blocked...............: avg=166.57µs min=1.43µs   med=3.13µs  max=44.15ms  p(90)=5.13µs  p(95)=11.96µs 
     http_req_connecting............: avg=142.01µs min=0s       med=0s      max=9.55ms   p(90)=0s      p(95)=0s      
     http_req_duration..............: avg=1.22s    min=558.35ms med=1.05s   max=3.18s    p(90)=1.95s   p(95)=2.15s   
       { expected_response:true }...: avg=1.22s    min=558.35ms med=1.05s   max=3.18s    p(90)=1.95s   p(95)=2.15s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 2412 
     http_req_receiving.............: avg=15.05ms  min=40.98µs  med=113.9µs max=588.85ms p(90)=3.03ms  p(95)=78.71ms 
     http_req_sending...............: avg=683.46µs min=8.63µs   med=14.71µs max=185.49ms p(90)=41.61µs p(95)=487.34µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s      max=0s       p(90)=0s      p(95)=0s      
     http_req_waiting...............: avg=1.21s    min=558.29ms med=1.05s   max=3.18s    p(90)=1.92s   p(95)=2.15s   
     http_reqs......................: 2412    78.536682/s
     iteration_duration.............: avg=1.26s    min=569.09ms med=1.08s   max=3.21s    p(90)=1.97s   p(95)=2.22s   
     iterations.....................: 2412    78.536682/s
     vus............................: 100     min=100     max=100
     vus_max........................: 100     min=100     max=100

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 5046      ✗ 0    
     data_received..................: 148 MB  4.7 MB/s
     data_sent......................: 2.0 MB  64 kB/s
     http_req_blocked...............: avg=63.89µs  min=1.54µs   med=3.13µs   max=2.93ms  p(90)=5.22µs   p(95)=192.61µs
     http_req_connecting............: avg=49.51µs  min=0s       med=0s       max=2.75ms  p(90)=0s       p(95)=148.01µs
     http_req_duration..............: avg=1.81s    min=848.24ms med=1.55s    max=18.75s  p(90)=1.77s    p(95)=2.11s   
       { expected_response:true }...: avg=1.81s    min=848.24ms med=1.55s    max=18.75s  p(90)=1.77s    p(95)=2.11s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 1682 
     http_req_receiving.............: avg=209.89µs min=47.22µs  med=121.13µs max=18.01ms p(90)=204.67µs p(95)=326.47µs
     http_req_sending...............: avg=58.72µs  min=8.75µs   med=15.9µs   max=10.78ms p(90)=35.31µs  p(95)=162.95µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=1.81s    min=848.06ms med=1.55s    max=18.75s  p(90)=1.77s    p(95)=2.11s   
     http_reqs......................: 1682    53.841553/s
     iteration_duration.............: avg=1.82s    min=888.87ms med=1.56s    max=18.78s  p(90)=1.79s    p(95)=2.12s   
     iterations.....................: 1682    53.841553/s
     vus............................: 38      min=38      max=100
     vus_max........................: 100     min=100     max=100

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 2718      ✗ 0    
     data_received..................: 80 MB   2.6 MB/s
     data_sent......................: 1.1 MB  35 kB/s
     http_req_blocked...............: avg=118.98µs min=1.48µs   med=4.21µs   max=5.61ms p(90)=154.19µs p(95)=797.81µs
     http_req_connecting............: avg=100.07µs min=0s       med=0s       max=3.9ms  p(90)=101.36µs p(95)=669.55µs
     http_req_duration..............: avg=3.35s    min=559.47ms med=3.16s    max=8.09s  p(90)=4.18s    p(95)=4.77s   
       { expected_response:true }...: avg=3.35s    min=559.47ms med=3.16s    max=8.09s  p(90)=4.18s    p(95)=4.77s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 906  
     http_req_receiving.............: avg=267.93µs min=45.87µs  med=113.05µs max=72.1ms p(90)=203.08µs p(95)=309.55µs
     http_req_sending...............: avg=102.61µs min=9.12µs   med=22.92µs  max=2.23ms p(90)=66.84µs  p(95)=389.55µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s     p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.35s    min=559.22ms med=3.16s    max=8.09s  p(90)=4.18s    p(95)=4.77s   
     http_reqs......................: 906     29.435115/s
     iteration_duration.............: avg=3.36s    min=572.06ms med=3.17s    max=8.1s   p(90)=4.19s    p(95)=4.78s   
     iterations.....................: 906     29.435115/s
     vus............................: 100     min=100     max=100
     vus_max........................: 100     min=100     max=100

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mesh-supergraph`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 2475      ✗ 0    
     data_received..................: 72 MB   2.3 MB/s
     data_sent......................: 979 kB  31 kB/s
     http_req_blocked...............: avg=195.49µs min=1.41µs  med=3.65µs  max=5ms     p(90)=208.07µs p(95)=1.87ms  
     http_req_connecting............: avg=182.75µs min=0s      med=0s      max=4.97ms  p(90)=156.64µs p(95)=1.7ms   
     http_req_duration..............: avg=3.73s    min=1.27s   med=3.59s   max=8.74s   p(90)=5.4s     p(95)=6.12s   
       { expected_response:true }...: avg=3.73s    min=1.27s   med=3.59s   max=8.74s   p(90)=5.4s     p(95)=6.12s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 825  
     http_req_receiving.............: avg=2.55ms   min=38.67µs med=143.2µs max=76.12ms p(90)=2.51ms   p(95)=5.07ms  
     http_req_sending...............: avg=88.94µs  min=8.52µs  med=20.56µs max=1.28ms  p(90)=112.73µs p(95)=821.65µs
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.73s    min=1.26s   med=3.59s   max=8.74s   p(90)=5.39s    p(95)=6.12s   
     http_reqs......................: 825     25.771146/s
     iteration_duration.............: avg=3.75s    min=1.29s   med=3.61s   max=8.75s   p(90)=5.42s    p(95)=6.15s   
     iterations.....................: 825     25.771146/s
     vus............................: 5       min=5       max=100
     vus_max........................: 100     min=100     max=100

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

@github-actions
Copy link

github-actions bot commented Oct 2, 2024

Overview for: federation-v1/constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
cosmo 182 5545 total, 0 failed avg: 292ms, p95: 873ms
apollo-router 171 5195 total, 0 failed avg: 337ms, p95: 902ms
wundergraph 155 4705 total, 0 failed avg: 347ms, p95: 938ms
mesh-supergraph-bun 85 2661 total, 0 failed avg: 1114ms, p95: 1888ms
apollo-server 73 2272 total, 0 failed avg: 1333ms, p95: 1529ms
mesh-supergraph 53 1671 total, 0 failed avg: 1814ms, p95: 2671ms
mercurius 47 1445 total, 0 failed avg: 2088ms, p95: 2788ms
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 16635      ✗ 0    
     data_received..................: 487 MB  16 MB/s
     data_sent......................: 6.6 MB  217 kB/s
     http_req_blocked...............: avg=43.16µs  min=1.51µs  med=3.03µs   max=14.12ms  p(90)=4.45µs   p(95)=5.86µs  
     http_req_connecting............: avg=33.4µs   min=0s      med=0s       max=13.31ms  p(90)=0s       p(95)=0s      
     http_req_duration..............: avg=292.35ms min=9.02ms  med=202.71ms max=2.3s     p(90)=709.12ms p(95)=873.47ms
       { expected_response:true }...: avg=292.35ms min=9.02ms  med=202.71ms max=2.3s     p(90)=709.12ms p(95)=873.47ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 5545 
     http_req_receiving.............: avg=132.6ms  min=33.75µs med=100.8µs  max=1.97s    p(90)=525.05ms p(95)=709.05ms
     http_req_sending...............: avg=6.62ms   min=8.48µs  med=14.16µs  max=1.4s     p(90)=78.44µs  p(95)=3.26ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=153.12ms min=7.51ms  med=140.26ms max=733.23ms p(90)=283.43ms p(95)=319.48ms
     http_reqs......................: 5545    182.886586/s
     iteration_duration.............: avg=544.3ms  min=20.95ms med=397.42ms max=3.34s    p(90)=1.18s    p(95)=1.48s   
     iterations.....................: 5545    182.886586/s
     vus............................: 100     min=100      max=100
     vus_max........................: 100     min=100      max=100

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 15585      ✗ 0    
     data_received..................: 456 MB  15 MB/s
     data_sent......................: 6.2 MB  203 kB/s
     http_req_blocked...............: avg=28.78µs  min=1.67µs  med=2.99µs   max=11.05ms  p(90)=4.59µs   p(95)=5.94µs  
     http_req_connecting............: avg=20.54µs  min=0s      med=0s       max=2.87ms   p(90)=0s       p(95)=0s      
     http_req_duration..............: avg=337.29ms min=9.87ms  med=245.68ms max=1.8s     p(90)=733.94ms p(95)=901.53ms
       { expected_response:true }...: avg=337.29ms min=9.87ms  med=245.68ms max=1.8s     p(90)=733.94ms p(95)=901.53ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 5195 
     http_req_receiving.............: avg=134.72ms min=35.39µs med=85.87µs  max=1.6s     p(90)=509.75ms p(95)=675.31ms
     http_req_sending...............: avg=7.61ms   min=8.68µs  med=14.09µs  max=1.21s    p(90)=56.5µs   p(95)=2.39ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=194.95ms min=9.79ms  med=184.79ms max=883.62ms p(90)=329.98ms p(95)=393.28ms
     http_reqs......................: 5195    171.138577/s
     iteration_duration.............: avg=580.59ms min=30.61ms med=458.26ms max=3.33s    p(90)=1.2s     p(95)=1.47s   
     iterations.....................: 5195    171.138577/s
     vus............................: 100     min=100      max=100
     vus_max........................: 100     min=100      max=100

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `wundergraph`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 14115      ✗ 0    
     data_received..................: 413 MB  14 MB/s
     data_sent......................: 5.6 MB  184 kB/s
     http_req_blocked...............: avg=191.26µs min=1.49µs  med=3.09µs   max=249.94ms p(90)=4.48µs   p(95)=8.02µs  
     http_req_connecting............: avg=125.95µs min=0s      med=0s       max=212.16ms p(90)=0s       p(95)=0s      
     http_req_duration..............: avg=347.05ms min=13.75ms med=268.77ms max=3.68s    p(90)=745.25ms p(95)=938.32ms
       { expected_response:true }...: avg=347.05ms min=13.75ms med=268.77ms max=3.68s    p(90)=745.25ms p(95)=938.32ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 4705 
     http_req_receiving.............: avg=134.08ms min=38.46µs med=104.63µs max=2.62s    p(90)=531.6ms  p(95)=719.38ms
     http_req_sending...............: avg=6.2ms    min=9.15µs  med=14.19µs  max=2.63s    p(90)=119.64µs p(95)=2.05ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=206.75ms min=10.18ms med=195.62ms max=684.27ms p(90)=347.99ms p(95)=410.54ms
     http_reqs......................: 4705    155.139402/s
     iteration_duration.............: avg=641.06ms min=27.14ms med=517.87ms max=3.7s     p(90)=1.31s    p(95)=1.57s   
     iterations.....................: 4705    155.139402/s
     vus............................: 100     min=100      max=100
     vus_max........................: 100     min=100      max=100

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mesh-supergraph-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 7983      ✗ 0    
     data_received..................: 233 MB  7.5 MB/s
     data_sent......................: 3.2 MB  102 kB/s
     http_req_blocked...............: avg=29.44µs min=1.61µs   med=2.85µs   max=3.96ms   p(90)=4.59µs  p(95)=9.92µs 
     http_req_connecting............: avg=22.27µs min=0s       med=0s       max=3.92ms   p(90)=0s      p(95)=0s     
     http_req_duration..............: avg=1.11s   min=278.53ms med=964.99ms max=2.34s    p(90)=1.74s   p(95)=1.88s  
       { expected_response:true }...: avg=1.11s   min=278.53ms med=964.99ms max=2.34s    p(90)=1.74s   p(95)=1.88s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2661 
     http_req_receiving.............: avg=13.15ms min=37.35µs  med=94.58µs  max=518.23ms p(90)=6.5ms   p(95)=99.31ms
     http_req_sending...............: avg=530.1µs min=8.87µs   med=13.72µs  max=166.36ms p(90)=43.74µs p(95)=148.5µs
     http_req_tls_handshaking.......: avg=0s      min=0s       med=0s       max=0s       p(90)=0s      p(95)=0s     
     http_req_waiting...............: avg=1.1s    min=278.03ms med=956.52ms max=2.34s    p(90)=1.72s   p(95)=1.87s  
     http_reqs......................: 2661    85.850837/s
     iteration_duration.............: avg=1.15s   min=291.76ms med=1s       max=2.46s    p(90)=1.78s   p(95)=1.92s  
     iterations.....................: 2661    85.850837/s
     vus............................: 1       min=1       max=100
     vus_max........................: 100     min=100     max=100

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 6816      ✗ 0    
     data_received..................: 200 MB  6.4 MB/s
     data_sent......................: 2.7 MB  87 kB/s
     http_req_blocked...............: avg=143.44µs min=1.42µs   med=2.75µs   max=7.09ms  p(90)=4.58µs   p(95)=15.51µs
     http_req_connecting............: avg=135.07µs min=0s       med=0s       max=7.06ms  p(90)=0s       p(95)=0s     
     http_req_duration..............: avg=1.33s    min=489.82ms med=1.23s    max=13.91s  p(90)=1.36s    p(95)=1.52s  
       { expected_response:true }...: avg=1.33s    min=489.82ms med=1.23s    max=13.91s  p(90)=1.36s    p(95)=1.52s  
     http_req_failed................: 0.00%   ✓ 0         ✗ 2272 
     http_req_receiving.............: avg=170.09µs min=43.58µs  med=111.55µs max=13.27ms p(90)=184.65µs p(95)=267.8µs
     http_req_sending...............: avg=47.81µs  min=8.39µs   med=13.99µs  max=10.82ms p(90)=30.25µs  p(95)=64.46µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=1.33s    min=489.68ms med=1.23s    max=13.91s  p(90)=1.36s    p(95)=1.52s  
     http_reqs......................: 2272    73.320801/s
     iteration_duration.............: avg=1.34s    min=499.09ms med=1.24s    max=13.92s  p(90)=1.37s    p(95)=1.54s  
     iterations.....................: 2272    73.320801/s
     vus............................: 100     min=100     max=100
     vus_max........................: 100     min=100     max=100

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mesh-supergraph`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 5013      ✗ 0    
     data_received..................: 147 MB  4.7 MB/s
     data_sent......................: 2.0 MB  64 kB/s
     http_req_blocked...............: avg=51.34µs  min=1.52µs   med=4.31µs   max=7.02ms   p(90)=6.49µs  p(95)=148.27µs
     http_req_connecting............: avg=39.58µs  min=0s       med=0s       max=5.47ms   p(90)=0s      p(95)=104.02µs
     http_req_duration..............: avg=1.81s    min=777.99ms med=1.76s    max=4.09s    p(90)=2.43s   p(95)=2.67s   
       { expected_response:true }...: avg=1.81s    min=777.99ms med=1.76s    max=4.09s    p(90)=2.43s   p(95)=2.67s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 1671 
     http_req_receiving.............: avg=1.89ms   min=43.17µs  med=135.78µs max=149.56ms p(90)=2.72ms  p(95)=5.86ms  
     http_req_sending...............: avg=151.14µs min=9.01µs   med=22.96µs  max=34.62ms  p(90)=48.82µs p(95)=165.12µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s      p(95)=0s      
     http_req_waiting...............: avg=1.81s    min=764.73ms med=1.76s    max=4.09s    p(90)=2.43s   p(95)=2.67s   
     http_reqs......................: 1671    53.670969/s
     iteration_duration.............: avg=1.84s    min=803.54ms med=1.79s    max=4.13s    p(90)=2.46s   p(95)=2.69s   
     iterations.....................: 1671    53.670969/s
     vus............................: 34      min=34      max=100
     vus_max........................: 100     min=100     max=100

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 4335      ✗ 0    
     data_received..................: 127 MB  4.1 MB/s
     data_sent......................: 1.7 MB  56 kB/s
     http_req_blocked...............: avg=49.92µs  min=1.58µs   med=4.08µs   max=4.42ms  p(90)=6.03µs   p(95)=258.24µs
     http_req_connecting............: avg=33.24µs  min=0s       med=0s       max=2.82ms  p(90)=0s       p(95)=181.51µs
     http_req_duration..............: avg=2.08s    min=350.36ms med=2.05s    max=4.99s   p(90)=2.62s    p(95)=2.78s   
       { expected_response:true }...: avg=2.08s    min=350.36ms med=2.05s    max=4.99s   p(90)=2.62s    p(95)=2.78s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 1445 
     http_req_receiving.............: avg=254.58µs min=47.12µs  med=115.08µs max=37.64ms p(90)=206.11µs p(95)=319.31µs
     http_req_sending...............: avg=46.19µs  min=9.26µs   med=22µs     max=4.09ms  p(90)=39.21µs  p(95)=126.07µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=2.08s    min=350.1ms  med=2.05s    max=4.99s   p(90)=2.62s    p(95)=2.78s   
     http_reqs......................: 1445    47.178758/s
     iteration_duration.............: avg=2.09s    min=362.1ms  med=2.06s    max=5.03s   p(90)=2.63s    p(95)=2.8s    
     iterations.....................: 1445    47.178758/s
     vus............................: 100     min=100     max=100
     vus_max........................: 100     min=100     max=100

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

@github-actions
Copy link

github-actions bot commented Oct 2, 2024

Overview for: federation-v1/constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
cosmo 191 5809 total, 0 failed avg: 337ms, p95: 709ms
apollo-router 171 5230 total, 0 failed avg: 489ms, p95: 731ms
wundergraph 153 4682 total, 0 failed avg: 533ms, p95: 1021ms
mesh-supergraph-bun 67 2076 total, 0 failed avg: 1443ms, p95: 2509ms
apollo-server 54 1703 total, 0 failed avg: 1791ms, p95: 2329ms
mercurius 29 933 total, 0 failed avg: 3298ms, p95: 4280ms
mesh-supergraph 24 779 total, 0 failed avg: 3949ms, p95: 6414ms
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 17427      ✗ 0    
     data_received..................: 510 MB  17 MB/s
     data_sent......................: 6.9 MB  227 kB/s
     http_req_blocked...............: avg=120.31µs min=1.49µs  med=3.08µs   max=240.27ms p(90)=4.98µs   p(95)=5.99µs  
     http_req_connecting............: avg=91.27µs  min=0s      med=0s       max=240.21ms p(90)=0s       p(95)=0s      
     http_req_duration..............: avg=336.56ms min=10.57ms med=300.19ms max=2.19s    p(90)=575.59ms p(95)=708.62ms
       { expected_response:true }...: avg=336.56ms min=10.57ms med=300.19ms max=2.19s    p(90)=575.59ms p(95)=708.62ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 5809 
     http_req_receiving.............: avg=77.14ms  min=39.51µs med=84.71µs  max=2.04s    p(90)=324.15ms p(95)=457.99ms
     http_req_sending...............: avg=4.12ms   min=8.9µs   med=14.45µs  max=859.83ms p(90)=60.02µs  p(95)=2.21ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=255.3ms  min=10ms    med=240.02ms max=723.35ms p(90)=424.53ms p(95)=486.96ms
     http_reqs......................: 5809    191.483439/s
     iteration_duration.............: avg=519.76ms min=24.34ms med=464.85ms max=2.57s    p(90)=930.31ms p(95)=1.12s   
     iterations.....................: 5809    191.483439/s
     vus............................: 100     min=100      max=100
     vus_max........................: 100     min=100      max=100

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 15690      ✗ 0    
     data_received..................: 459 MB  15 MB/s
     data_sent......................: 6.2 MB  204 kB/s
     http_req_blocked...............: avg=45.61µs  min=1.46µs  med=2.91µs   max=41.9ms   p(90)=4.36µs   p(95)=5.45µs  
     http_req_connecting............: avg=26.71µs  min=0s      med=0s       max=4.07ms   p(90)=0s       p(95)=0s      
     http_req_duration..............: avg=488.65ms min=17.04ms med=482.49ms max=1.87s    p(90)=645.57ms p(95)=730.92ms
       { expected_response:true }...: avg=488.65ms min=17.04ms med=482.49ms max=1.87s    p(90)=645.57ms p(95)=730.92ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 5230 
     http_req_receiving.............: avg=36.32ms  min=34.98µs med=75.19µs  max=1.59s    p(90)=83.14ms  p(95)=255.63ms
     http_req_sending...............: avg=1.59ms   min=8.55µs  med=13.82µs  max=876.13ms p(90)=45.1µs   p(95)=163.15µs
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=450.72ms min=16.17ms med=466.95ms max=821.63ms p(90)=597.79ms p(95)=635.42ms
     http_reqs......................: 5230    171.713836/s
     iteration_duration.............: avg=578.17ms min=29.59ms med=537.9ms  max=2.53s    p(90)=816.2ms  p(95)=1.02s   
     iterations.....................: 5230    171.713836/s
     vus............................: 100     min=100      max=100
     vus_max........................: 100     min=100      max=100

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `wundergraph`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 14046      ✗ 0    
     data_received..................: 411 MB  14 MB/s
     data_sent......................: 5.6 MB  183 kB/s
     http_req_blocked...............: avg=49µs     min=1.1µs   med=2.89µs   max=4.81ms p(90)=4.65µs   p(95)=5.91µs  
     http_req_connecting............: avg=42.68µs  min=0s      med=0s       max=4.78ms p(90)=0s       p(95)=0s      
     http_req_duration..............: avg=532.97ms min=20.74ms med=491.68ms max=2.5s   p(90)=884.23ms p(95)=1.02s   
       { expected_response:true }...: avg=532.97ms min=20.74ms med=491.68ms max=2.5s   p(90)=884.23ms p(95)=1.02s   
     http_req_failed................: 0.00%   ✓ 0          ✗ 4682 
     http_req_receiving.............: avg=57.63ms  min=35.02µs med=90.21µs  max=2.34s  p(90)=173.82ms p(95)=412.86ms
     http_req_sending...............: avg=3.36ms   min=7.32µs  med=13.43µs  max=1.93s  p(90)=47.41µs  p(95)=1.01ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=471.97ms min=17.04ms med=446.72ms max=1.26s  p(90)=800.61ms p(95)=917.82ms
     http_reqs......................: 4682    153.915087/s
     iteration_duration.............: avg=645.64ms min=34.13ms med=577.11ms max=3.19s  p(90)=1.07s    p(95)=1.3s    
     iterations.....................: 4682    153.915087/s
     vus............................: 100     min=100      max=100
     vus_max........................: 100     min=100      max=100

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mesh-supergraph-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 6228      ✗ 0    
     data_received..................: 182 MB  5.9 MB/s
     data_sent......................: 2.5 MB  80 kB/s
     http_req_blocked...............: avg=55.87µs  min=1.6µs    med=3.32µs   max=3.02ms   p(90)=5.52µs  p(95)=27.7µs  
     http_req_connecting............: avg=48.41µs  min=0s       med=0s       max=2.84ms   p(90)=0s      p(95)=0s      
     http_req_duration..............: avg=1.44s    min=666.4ms  med=1.24s    max=3.38s    p(90)=2.36s   p(95)=2.5s    
       { expected_response:true }...: avg=1.44s    min=666.4ms  med=1.24s    max=3.38s    p(90)=2.36s   p(95)=2.5s    
     http_req_failed................: 0.00%   ✓ 0         ✗ 2076 
     http_req_receiving.............: avg=15.11ms  min=40.9µs   med=148.41µs max=596.44ms p(90)=2.13ms  p(95)=52.48ms 
     http_req_sending...............: avg=289.49µs min=8.9µs    med=16.88µs  max=60.91ms  p(90)=46.23µs p(95)=263.81µs
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s      p(95)=0s      
     http_req_waiting...............: avg=1.42s    min=665.28ms med=1.23s    max=3.32s    p(90)=2.36s   p(95)=2.49s   
     http_reqs......................: 2076    67.292098/s
     iteration_duration.............: avg=1.46s    min=675.61ms med=1.26s    max=3.4s     p(90)=2.38s   p(95)=2.53s   
     iterations.....................: 2076    67.292098/s
     vus............................: 100     min=100     max=100
     vus_max........................: 100     min=100     max=100

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 5109     ✗ 0    
     data_received..................: 150 MB  4.8 MB/s
     data_sent......................: 2.0 MB  65 kB/s
     http_req_blocked...............: avg=51.62µs  min=1.58µs   med=3.17µs   max=2.72ms  p(90)=5.07µs   p(95)=154.63µs
     http_req_connecting............: avg=43.05µs  min=0s       med=0s       max=2.26ms  p(90)=0s       p(95)=103.69µs
     http_req_duration..............: avg=1.79s    min=337.1ms  med=1.5s     max=19.58s  p(90)=1.82s    p(95)=2.32s   
       { expected_response:true }...: avg=1.79s    min=337.1ms  med=1.5s     max=19.58s  p(90)=1.82s    p(95)=2.32s   
     http_req_failed................: 0.00%   ✓ 0        ✗ 1703 
     http_req_receiving.............: avg=329.97µs min=41.32µs  med=121.15µs max=69.27ms p(90)=204.39µs p(95)=299.12µs
     http_req_sending...............: avg=55.11µs  min=8.65µs   med=16.69µs  max=6.52ms  p(90)=33.72µs  p(95)=100.3µs 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=1.79s    min=336.93ms med=1.5s     max=19.58s  p(90)=1.82s    p(95)=2.32s   
     http_reqs......................: 1703    54.52862/s
     iteration_duration.............: avg=1.8s     min=344.07ms med=1.51s    max=19.59s  p(90)=1.84s    p(95)=2.33s   
     iterations.....................: 1703    54.52862/s
     vus............................: 36      min=36     max=100
     vus_max........................: 100     min=100    max=100

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mercurius`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 2799     ✗ 0    
     data_received..................: 82 MB   2.6 MB/s
     data_sent......................: 1.1 MB  36 kB/s
     http_req_blocked...............: avg=323.51µs min=1.43µs  med=3.64µs   max=6.77ms  p(90)=320.29µs p(95)=3.58ms  
     http_req_connecting............: avg=288.68µs min=0s      med=0s       max=6.63ms  p(90)=191.76µs p(95)=3.04ms  
     http_req_duration..............: avg=3.29s    min=1.06s   med=3.08s    max=7.05s   p(90)=4.08s    p(95)=4.28s   
       { expected_response:true }...: avg=3.29s    min=1.06s   med=3.08s    max=7.05s   p(90)=4.08s    p(95)=4.28s   
     http_req_failed................: 0.00%   ✓ 0        ✗ 933  
     http_req_receiving.............: avg=635.77µs min=40.08µs med=111.14µs max=67.12ms p(90)=202.26µs p(95)=411.05µs
     http_req_sending...............: avg=63.03µs  min=8.64µs  med=19.76µs  max=4.3ms   p(90)=58.64µs  p(95)=256.34µs
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.29s    min=1.06s   med=3.08s    max=7.05s   p(90)=4.08s    p(95)=4.27s   
     http_reqs......................: 933     29.89515/s
     iteration_duration.............: avg=3.31s    min=1.07s   med=3.1s     max=7.06s   p(90)=4.09s    p(95)=4.28s   
     iterations.....................: 933     29.89515/s
     vus............................: 33      min=33     max=100
     vus_max........................: 100     min=100    max=100

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mesh-supergraph`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 2337      ✗ 0    
     data_received..................: 68 MB   2.2 MB/s
     data_sent......................: 925 kB  29 kB/s
     http_req_blocked...............: avg=161.42µs min=1.56µs  med=4.12µs   max=7.68ms  p(90)=252.58µs p(95)=1.07ms  
     http_req_connecting............: avg=128.97µs min=0s      med=0s       max=3.92ms  p(90)=173.95µs p(95)=889.18µs
     http_req_duration..............: avg=3.94s    min=1.89s   med=3.69s    max=7.4s    p(90)=5.8s     p(95)=6.41s   
       { expected_response:true }...: avg=3.94s    min=1.89s   med=3.69s    max=7.4s    p(90)=5.8s     p(95)=6.41s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 779  
     http_req_receiving.............: avg=2.53ms   min=45.56µs med=171.93µs max=86.04ms p(90)=2.99ms   p(95)=6.37ms  
     http_req_sending...............: avg=60.5µs   min=7.81µs  med=22.26µs  max=2.55ms  p(90)=104.84µs p(95)=325.06µs
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s      p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.94s    min=1.89s   med=3.69s    max=7.4s    p(90)=5.8s     p(95)=6.41s   
     http_reqs......................: 779     24.689409/s
     iteration_duration.............: avg=3.96s    min=1.9s    med=3.71s    max=7.41s   p(90)=5.82s    p(95)=6.43s   
     iterations.....................: 779     24.689409/s
     vus............................: 46      min=46      max=100
     vus_max........................: 100     min=100     max=100

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

@github-actions
Copy link

github-actions bot commented Oct 2, 2024

Overview for: federation-v1/ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was trying to reach 500 concurrent VUs over 60s

Comparison

Comparison

Gateway duration(p95)⬇️ RPS Requests Durations Notes
cosmo 2250ms 182 12797 total, 0 failed avg: 748ms, p95: 2251ms, max: 9271ms, med: 501ms
wundergraph 2422ms 159 11175 total, 0 failed avg: 865ms, p95: 2423ms, max: 7279ms, med: 675ms
apollo-router 2847ms 168 11793 total, 0 failed avg: 861ms, p95: 2848ms, max: 9163ms, med: 551ms
mesh-supergraph-bun 7823ms 85 6013 total, 0 failed avg: 3122ms, p95: 7824ms, max: 12433ms, med: 2861ms
mesh-supergraph 8243ms 55 3904 total, 0 failed avg: 4948ms, p95: 8244ms, max: 10212ms, med: 5166ms
apollo-server 22308ms 71 5195 total, 0 failed avg: 3994ms, p95: 22309ms, max: 44210ms, med: 2187ms
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 38391      ✗ 0    
     data_received..................: 1.1 GB  16 MB/s
     data_sent......................: 15 MB   217 kB/s
     http_req_blocked...............: avg=19.44ms  min=1.39µs  med=3.04µs   max=4.3s   p(90)=4.67µs   p(95)=17.21µs
     http_req_connecting............: avg=18.79ms  min=0s      med=0s       max=3.77s  p(90)=0s       p(95)=0s     
     http_req_duration..............: avg=748.49ms min=3.58ms  med=501.27ms max=9.27s  p(90)=1.76s    p(95)=2.25s  
       { expected_response:true }...: avg=748.49ms min=3.58ms  med=501.27ms max=9.27s  p(90)=1.76s    p(95)=2.25s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 12797
     http_req_receiving.............: avg=260.95ms min=33.97µs med=81.78µs  max=6.72s  p(90)=1.01s    p(95)=1.61s  
     http_req_sending...............: avg=30.08ms  min=8.14µs  med=13.96µs  max=3.27s  p(90)=319.38µs p(95)=76.24ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=457.45ms min=3.48ms  med=302.55ms max=3.28s  p(90)=1.05s    p(95)=1.27s  
     http_reqs......................: 12797   182.790768/s
     iteration_duration.............: avg=1.43s    min=9.03ms  med=970.93ms max=11.48s p(90)=3.4s     p(95)=4.32s  
     iterations.....................: 12797   182.790768/s
     vus............................: 1       min=1        max=499
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `wundergraph`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 33525     ✗ 0    
     data_received..................: 981 MB  14 MB/s
     data_sent......................: 13 MB   190 kB/s
     http_req_blocked...............: avg=31.17ms  min=1.45µs  med=3.17µs   max=3.82s p(90)=5.14µs p(95)=36µs    
     http_req_connecting............: avg=29.94ms  min=0s      med=0s       max=3.82s p(90)=0s     p(95)=0s      
     http_req_duration..............: avg=865.37ms min=6.08ms  med=675.1ms  max=7.27s p(90)=1.9s   p(95)=2.42s   
       { expected_response:true }...: avg=865.37ms min=6.08ms  med=675.1ms  max=7.27s p(90)=1.9s   p(95)=2.42s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 11175
     http_req_receiving.............: avg=251.56ms min=32.98µs med=83.64µs  max=6.74s p(90)=1.04s  p(95)=1.47s   
     http_req_sending...............: avg=36.25ms  min=8.08µs  med=14.95µs  max=4.58s p(90)=2.57ms p(95)=133.98ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s    p(90)=0s     p(95)=0s      
     http_req_waiting...............: avg=577.56ms min=6.01ms  med=475.46ms max=3.2s  p(90)=1.19s  p(95)=1.45s   
     http_reqs......................: 11175   159.61647/s
     iteration_duration.............: avg=1.64s    min=11.49ms med=1.24s    max=10.1s p(90)=3.66s  p(95)=4.61s   
     iterations.....................: 11175   159.61647/s
     vus............................: 1       min=1       max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 35379      ✗ 0    
     data_received..................: 1.0 GB  15 MB/s
     data_sent......................: 14 MB   200 kB/s
     http_req_blocked...............: avg=18.79ms  min=1.55µs  med=3.08µs   max=4.19s  p(90)=4.94µs   p(95)=21.95µs
     http_req_connecting............: avg=17.62ms  min=0s      med=0s       max=3.47s  p(90)=0s       p(95)=0s     
     http_req_duration..............: avg=860.57ms min=6.21ms  med=550.68ms max=9.16s  p(90)=2.14s    p(95)=2.84s  
       { expected_response:true }...: avg=860.57ms min=6.21ms  med=550.68ms max=9.16s  p(90)=2.14s    p(95)=2.84s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 11793
     http_req_receiving.............: avg=347.44ms min=32.44µs med=79.45µs  max=7.26s  p(90)=1.42s    p(95)=2.14s  
     http_req_sending...............: avg=39.55ms  min=8.41µs  med=14.47µs  max=4.64s  p(90)=371.1µs  p(95)=73.63ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s     p(90)=0s       p(95)=0s     
     http_req_waiting...............: avg=473.58ms min=6.13ms  med=372.53ms max=2.87s  p(90)=986.87ms p(95)=1.19s  
     http_reqs......................: 11793   168.461512/s
     iteration_duration.............: avg=1.57s    min=11.8ms  med=986.93ms max=12.48s p(90)=3.9s     p(95)=4.89s  
     iterations.....................: 11793   168.461512/s
     vus............................: 1       min=1        max=499
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mesh-supergraph-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 18039     ✗ 0    
     data_received..................: 528 MB  7.5 MB/s
     data_sent......................: 7.1 MB  102 kB/s
     http_req_blocked...............: avg=1.61ms  min=1.61µs  med=3.18µs  max=423.01ms p(90)=11µs     p(95)=251.08µs
     http_req_connecting............: avg=1.51ms  min=0s      med=0s      max=316.22ms p(90)=0s       p(95)=165.42µs
     http_req_duration..............: avg=3.12s   min=10.85ms med=2.86s   max=12.43s   p(90)=5.24s    p(95)=7.82s   
       { expected_response:true }...: avg=3.12s   min=10.85ms med=2.86s   max=12.43s   p(90)=5.24s    p(95)=7.82s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 6013 
     http_req_receiving.............: avg=26.55ms min=37.65µs med=80.29µs max=1.82s    p(90)=3.03ms   p(95)=152.89ms
     http_req_sending...............: avg=2.59ms  min=7.93µs  med=15.03µs max=449.79ms p(90)=100.91µs p(95)=9.6ms   
     http_req_tls_handshaking.......: avg=0s      min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.09s   min=10.71ms med=2.85s   max=12.43s   p(90)=5.07s    p(95)=7.82s   
     http_reqs......................: 6013    85.886641/s
     iteration_duration.............: avg=3.18s   min=16.94ms med=2.91s   max=12.67s   p(90)=5.27s    p(95)=7.9s    
     iterations.....................: 6013    85.886641/s
     vus............................: 1       min=1       max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `mesh-supergraph`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 11712     ✗ 0    
     data_received..................: 343 MB  4.9 MB/s
     data_sent......................: 4.6 MB  66 kB/s
     http_req_blocked...............: avg=390.08µs min=1.71µs  med=4.39µs   max=145.52ms p(90)=208.06µs p(95)=471.06µs
     http_req_connecting............: avg=360.74µs min=0s      med=0s       max=145.44ms p(90)=145.61µs p(95)=384.48µs
     http_req_duration..............: avg=4.94s    min=12.8ms  med=5.16s    max=10.21s   p(90)=7.72s    p(95)=8.24s   
       { expected_response:true }...: avg=4.94s    min=12.8ms  med=5.16s    max=10.21s   p(90)=7.72s    p(95)=8.24s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 3904 
     http_req_receiving.............: avg=1.95ms   min=40.2µs  med=124.64µs max=253.47ms p(90)=2.39ms   p(95)=5.18ms  
     http_req_sending...............: avg=343.35µs min=8.45µs  med=25.23µs  max=90.69ms  p(90)=57.57µs  p(95)=106.43µs
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=4.94s    min=12.71ms med=5.16s    max=10.21s   p(90)=7.71s    p(95)=8.24s   
     http_reqs......................: 3904    55.769571/s
     iteration_duration.............: avg=4.98s    min=18.65ms med=5.19s    max=10.24s   p(90)=7.74s    p(95)=8.28s   
     iterations.....................: 3904    55.769571/s
     vus............................: 1       min=1       max=499
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-server`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 15585     ✗ 0    
     data_received..................: 457 MB  6.3 MB/s
     data_sent......................: 6.2 MB  85 kB/s
     http_req_blocked...............: avg=110.98µs min=1.42µs  med=3.39µs   max=51.7ms   p(90)=19.11µs  p(95)=251.15µs
     http_req_connecting............: avg=100.24µs min=0s      med=0s       max=51.63ms  p(90)=0s       p(95)=175.87µs
     http_req_duration..............: avg=3.99s    min=72.06ms med=2.18s    max=44.2s    p(90)=3.37s    p(95)=22.3s   
       { expected_response:true }...: avg=3.99s    min=72.06ms med=2.18s    max=44.2s    p(90)=3.37s    p(95)=22.3s   
     http_req_failed................: 0.00%   ✓ 0         ✗ 5195 
     http_req_receiving.............: avg=333.61µs min=45.87µs med=112.78µs max=138.38ms p(90)=213.35µs p(95)=332.34µs
     http_req_sending...............: avg=72.87µs  min=8.84µs  med=18.07µs  max=30.21ms  p(90)=42.83µs  p(95)=62.09µs 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s      
     http_req_waiting...............: avg=3.99s    min=71.94ms med=2.18s    max=44.2s    p(90)=3.37s    p(95)=22.3s   
     http_reqs......................: 5195    71.267016/s
     iteration_duration.............: avg=4s       min=84.01ms med=2.19s    max=44.21s   p(90)=3.38s    p(95)=22.32s  
     iterations.....................: 5195    71.267016/s
     vus............................: 70      min=57      max=500
     vus_max........................: 500     min=500     max=500

Performance Overview

Performance Overview

Subgraphs Overview

Subgraphs Overview

HTTP Overview

HTTP Overview

@renovate renovate bot force-pushed the renovate/tablemark-3.x branch 7 times, most recently from 7b76d77 to d2339ed Compare October 2, 2024 21:31
@renovate renovate bot force-pushed the renovate/tablemark-3.x branch from d2339ed to 3ccccc8 Compare October 3, 2024 01:51
@renovate renovate bot merged commit fef2699 into main Oct 3, 2024
33 checks passed
@renovate renovate bot deleted the renovate/tablemark-3.x branch October 3, 2024 03:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant