Skip to content

Custom build on top of v1.51.1 #9213

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
wants to merge 5 commits into from
Closed

Custom build on top of v1.51.1 #9213

wants to merge 5 commits into from

Conversation

kr-igor
Copy link
Contributor

@kr-igor kr-igor commented Jul 22, 2025 •
edited
Loading

This is v1.51.1 with the following PRs merged in:
#9151
#9137

See this ticket for details.

manuel-alvarez-alvarez and others added 5 commits July 15, 2025 13:25
@manuel-alvarez-alvarez
Fix NPE in AppSecConfigServiceImpl (#9172)
3a9d442 
(cherry picked from commit 9a188f8)
@daniel-mohedano
Avoid race conditions and multiple agent discovery feature states (#9175
f7e20c7 
)
@daniel-mohedano @nikita-tkachenko-datadog
🍒 Avoid race conditions on feature discovery during Writer creation (#…
ce41a21 
…9177)

* fix: avoid race conditions on feature discovery

(cherry picked from commit ff2c775)

* commit suggestion

Co-authored-by: Nikita Tkachenko <[email protected]>
(cherry picked from commit a304e94)

* fix: spotless and issue with groovy mocking

(cherry picked from commit 4e880c7)

---------

Co-authored-by: Nikita Tkachenko <[email protected]>
@kr-igor
DSM optimizations for high throughput scenarios (#9137)
01b7451 
* Avoid long to string conversion
* Use synchronized
@kr-igor
DSM optimizations - major refactoring to get rid of LinkedHashMap (#9151
da96233 
)

* DSM optimizations - major refactoring to get rid of LinkedHashMap

* Refactored DSM tags for all integrations

* Removed tests which no longer needed

* Fixed some more tests

* Fixed payload writer tests

* Fixed http tests

* Removed DataStreamsTagsBuilder, updated all integraions and tests

* Spotless apply

* Fixed more tests

* Add base hash support and service name overrides

* Fixed more tests

* Spotless apply

* Added tests for tags

* Improved coverage

* Removed unused imports

* Fixed even more tests

* Updated multiple tests

* Fixed more tests

* Spotless apply

* Fixed even more tests

* Fixed http tests, improved test coverage

* Spotless apply

* One more refactoring

* Some fixes in tests

* Improved test coverage

* Spotless apply

* Removed unused import

* Fixed all tags

* Fixed kafka tests
@kr-igor kr-igor marked this pull request as ready for review July 22, 2025 14:18
@kr-igor kr-igor requested review from a team as code owners July 22, 2025 14:18
@pr-commenter
Copy link

pr-commenter bot commented Jul 22, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master kr-igor/dsm-improvements-custom-build
git_commit_date 1753187273 1753193350
git_commit_sha 766af68 da96233
release_version 1.51.1-SNAPSHOT~766af685ed 1.52.0-SNAPSHOT~da962336df
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1753195636 1753195636
ci_job_id 1041134076 1041134076
ci_pipeline_id 71315686 71315686
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-gydqojof 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-gydqojof 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 10 performance improvements and 3 performance regressions! Performance is the same for 30 metrics, 10 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:insecure-bank:iast:Agent.start better
[-67.425ms; -33.745ms] or [-5.710%; -2.858%]		 1.130s 1.181s
scenario:startup:insecure-bank:iast:BytebuddyAgent better
[-60.247ms; -33.104ms] or [-7.070%; -3.885%]		 805.480ms 852.155ms
scenario:startup:insecure-bank:tracing:Agent.start better
[-48.176ms; -22.056ms] or [-4.653%; -2.130%]		 1.000s 1.035s
scenario:startup:insecure-bank:tracing:BytebuddyAgent better
[-46.563ms; -27.374ms] or [-6.401%; -3.763%]		 690.427ms 727.395ms
scenario:startup:insecure-bank:tracing:Remote Config worse
[+19.963µs; +66.679µs] or [+3.107%; +10.379%]		 685.796µs 642.475µs
scenario:startup:petclinic:appsec:Agent.start better
[-46.609ms; -38.861ms] or [-3.833%; -3.196%]		 1.173s 1.216s
scenario:startup:petclinic:appsec:BytebuddyAgent better
[-44.447ms; -38.833ms] or [-5.923%; -5.175%]		 708.741ms 750.381ms
scenario:startup:petclinic:iast:BytebuddyAgent better
[-47.633ms; -23.932ms] or [-5.627%; -2.827%]		 810.760ms 846.542ms
scenario:startup:petclinic:profiling:Agent.start worse
[+56.215ms; +63.807ms] or [+4.759%; +5.402%]		 1.241s 1.181s
scenario:startup:petclinic:profiling:BytebuddyAgent better
[-84.841ms; -79.749ms] or [-11.190%; -10.518%]		 675.900ms 758.195ms
scenario:startup:petclinic:profiling:GlobalTracer worse
[+139.331ms; +141.558ms] or [+63.304%; +64.316%]		 360.542ms 220.097ms
scenario:startup:petclinic:tracing:Agent.start better
[-63.793ms; -25.881ms] or [-6.105%; -2.477%]		 1.000s 1.045s
scenario:startup:petclinic:tracing:BytebuddyAgent better
[-57.372ms; -30.412ms] or [-7.816%; -4.143%]		 690.171ms 734.063ms
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.52.0-SNAPSHOT~da962336df, baseline=1.51.1-SNAPSHOT~766af685ed

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.035 s) : 0, 1035303
Total [baseline] (8.597 s) : 0, 8596773
Agent [candidate] (1.0 s) : 0, 1000187
Total [candidate] (8.553 s) : 0, 8553123
section iast
Agent [baseline] (1.181 s) : 0, 1180834
Total [baseline] (9.303 s) : 0, 9303156
Agent [candidate] (1.13 s) : 0, 1130249
Total [candidate] (9.271 s) : 0, 9270600
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.035 s -
Agent iast 1.181 s 145.531 ms (14.1%)
Total tracing 8.597 s -
Total iast 9.303 s 706.383 ms (8.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.0 s -
Agent iast 1.13 s 130.062 ms (13.0%)
Total tracing 8.553 s -
Total iast 9.271 s 717.476 ms (8.4%) 
gantt
    title insecure-bank - break down per module: candidate=1.52.0-SNAPSHOT~da962336df, baseline=1.51.1-SNAPSHOT~766af685ed

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (727.395 ms) : 0, 727395
BytebuddyAgent [candidate] (690.427 ms) : 0, 690427
GlobalTracer [baseline] (240.61 ms) : 0, 240610
GlobalTracer [candidate] (243.293 ms) : 0, 243293
AppSec [baseline] (30.294 ms) : 0, 30294
AppSec [candidate] (30.617 ms) : 0, 30617
Debugger [baseline] (5.951 ms) : 0, 5951
Debugger [candidate] (5.982 ms) : 0, 5982
Remote Config [baseline] (642.475 µs) : 0, 642
Remote Config [candidate] (685.796 µs) : 0, 686
Telemetry [baseline] (8.152 ms) : 0, 8152
Telemetry [candidate] (8.323 ms) : 0, 8323
crashtracking [baseline] (1.419 ms) : 0, 1419
section iast
BytebuddyAgent [baseline] (852.155 ms) : 0, 852155
BytebuddyAgent [candidate] (805.48 ms) : 0, 805480
GlobalTracer [baseline] (232.941 ms) : 0, 232941
GlobalTracer [candidate] (231.864 ms) : 0, 231864
IAST [baseline] (30.419 ms) : 0, 30419
IAST [candidate] (26.199 ms) : 0, 26199
AppSec [baseline] (28.321 ms) : 0, 28321
AppSec [candidate] (30.967 ms) : 0, 30967
Debugger [baseline] (5.845 ms) : 0, 5845
Debugger [candidate] (6.592 ms) : 0, 6592
Remote Config [baseline] (600.401 µs) : 0, 600
Remote Config [candidate] (577.158 µs) : 0, 577
Telemetry [baseline] (8.102 ms) : 0, 8102
Telemetry [candidate] (7.921 ms) : 0, 7921
crashtracking [baseline] (1.434 ms) : 0, 1434
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.52.0-SNAPSHOT~da962336df, baseline=1.51.1-SNAPSHOT~766af685ed

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.045 s) : 0, 1044989
Total [baseline] (10.7 s) : 0, 10699593
Agent [candidate] (1.0 s) : 0, 1000152
Total [candidate] (10.753 s) : 0, 10752933
section appsec
Agent [baseline] (1.216 s) : 0, 1216017
Total [baseline] (10.845 s) : 0, 10845100
Agent [candidate] (1.173 s) : 0, 1173282
Total [candidate] (10.719 s) : 0, 10718970
section iast
Agent [baseline] (1.173 s) : 0, 1172603
Total [baseline] (10.844 s) : 0, 10844304
Agent [candidate] (1.137 s) : 0, 1137114
Total [candidate] (10.801 s) : 0, 10801323
section profiling
Agent [baseline] (1.181 s) : 0, 1181172
Total [baseline] (10.877 s) : 0, 10876623
Agent [candidate] (1.241 s) : 0, 1241183
Total [candidate] (10.935 s) : 0, 10935407
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.045 s -
Agent appsec 1.216 s 171.028 ms (16.4%)
Agent iast 1.173 s 127.614 ms (12.2%)
Agent profiling 1.181 s 136.183 ms (13.0%)
Total tracing 10.7 s -
Total appsec 10.845 s 145.507 ms (1.4%)
Total iast 10.844 s 144.711 ms (1.4%)
Total profiling 10.877 s 177.031 ms (1.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.0 s -
Agent appsec 1.173 s 173.13 ms (17.3%)
Agent iast 1.137 s 136.962 ms (13.7%)
Agent profiling 1.241 s 241.031 ms (24.1%)
Total tracing 10.753 s -
Total appsec 10.719 s -33.963 ms (-0.3%)
Total iast 10.801 s 48.39 ms (0.5%)
Total profiling 10.935 s 182.474 ms (1.7%) 
gantt
    title petclinic - break down per module: candidate=1.52.0-SNAPSHOT~da962336df, baseline=1.51.1-SNAPSHOT~766af685ed

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (734.063 ms) : 0, 734063
BytebuddyAgent [candidate] (690.171 ms) : 0, 690171
GlobalTracer [baseline] (242.666 ms) : 0, 242666
GlobalTracer [candidate] (243.454 ms) : 0, 243454
AppSec [baseline] (30.722 ms) : 0, 30722
AppSec [candidate] (30.743 ms) : 0, 30743
Debugger [baseline] (6.069 ms) : 0, 6069
Debugger [candidate] (6.032 ms) : 0, 6032
Remote Config [baseline] (657.201 µs) : 0, 657
Remote Config [candidate] (682.713 µs) : 0, 683
Telemetry [baseline] (8.282 ms) : 0, 8282
Telemetry [candidate] (8.262 ms) : 0, 8262
crashtracking [baseline] (1.445 ms) : 0, 1445
section appsec
BytebuddyAgent [baseline] (750.381 ms) : 0, 750381
BytebuddyAgent [candidate] (708.741 ms) : 0, 708741
GlobalTracer [baseline] (234.254 ms) : 0, 234254
GlobalTracer [candidate] (234.778 ms) : 0, 234778
IAST [baseline] (23.498 ms) : 0, 23498
IAST [candidate] (23.193 ms) : 0, 23193
AppSec [baseline] (167.804 ms) : 0, 167804
AppSec [candidate] (171.286 ms) : 0, 171286
Debugger [baseline] (8.648 ms) : 0, 8648
Debugger [candidate] (5.734 ms) : 0, 5734
Remote Config [baseline] (612.249 µs) : 0, 612
Remote Config [candidate] (610.644 µs) : 0, 611
Telemetry [baseline] (8.131 ms) : 0, 8131
Telemetry [candidate] (8.104 ms) : 0, 8104
crashtracking [baseline] (1.417 ms) : 0, 1417
section iast
BytebuddyAgent [baseline] (846.542 ms) : 0, 846542
BytebuddyAgent [candidate] (810.76 ms) : 0, 810760
GlobalTracer [baseline] (231.153 ms) : 0, 231153
GlobalTracer [candidate] (233.128 ms) : 0, 233128
IAST [baseline] (27.421 ms) : 0, 27421
IAST [candidate] (26.493 ms) : 0, 26493
AppSec [baseline] (28.176 ms) : 0, 28176
AppSec [candidate] (30.877 ms) : 0, 30877
Debugger [baseline] (8.437 ms) : 0, 8437
Debugger [candidate] (6.604 ms) : 0, 6604
Remote Config [baseline] (594.819 µs) : 0, 595
Remote Config [candidate] (577.255 µs) : 0, 577
Telemetry [baseline] (7.891 ms) : 0, 7891
Telemetry [candidate] (7.85 ms) : 0, 7850
crashtracking [baseline] (1.429 ms) : 0, 1429
section profiling
BytebuddyAgent [baseline] (758.195 ms) : 0, 758195
BytebuddyAgent [candidate] (675.9 ms) : 0, 675900
GlobalTracer [baseline] (220.097 ms) : 0, 220097
GlobalTracer [candidate] (360.542 ms) : 0, 360542
AppSec [baseline] (30.221 ms) : 0, 30221
AppSec [candidate] (35.223 ms) : 0, 35223
Debugger [baseline] (6.243 ms) : 0, 6243
Debugger [candidate] (9.107 ms) : 0, 9107
Remote Config [baseline] (658.135 µs) : 0, 658
Remote Config [candidate] (656.199 µs) : 0, 656
Telemetry [baseline] (12.425 ms) : 0, 12425
Telemetry [candidate] (7.951 ms) : 0, 7951
crashtracking [baseline] (1.394 ms) : 0, 1394
ProfilingAgent [baseline] (103.695 ms) : 0, 103695
ProfilingAgent [candidate] (103.353 ms) : 0, 103353
Profiling [baseline] (103.718 ms) : 0, 103718
Profiling [candidate] (103.379 ms) : 0, 103379
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master kr-igor/dsm-improvements-custom-build
git_commit_date 1753187273 1753193350
git_commit_sha 766af68 da96233
release_version 1.51.1-SNAPSHOT~766af685ed 1.52.0-SNAPSHOT~da962336df
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1753195311 1753195311
ci_job_id 1041134077 1041134077
ci_pipeline_id 71315686 71315686
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-sfti2d9z 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-sfti2d9z 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 4 performance improvements and 1 performance regressions! Performance is the same for 7 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:insecure-bank:profiling:high_load better
[-740.947µs; -393.513µs] or [-7.904%; -4.198%]		 unstable
[-39.443op/s; +102.630op/s] or [-7.965%; +20.726%]		 8.807ms 526.781op/s 9.374ms 495.188op/s
scenario:load:petclinic:no_agent:high_load worse
[+0.831ms; +1.498ms] or [+2.231%; +4.020%]		 unstable
[-12.941op/s; +5.441op/s] or [-10.314%; +4.337%]		 38.425ms 121.725op/s 37.261ms 125.475op/s
scenario:load:petclinic:profiling:high_load better
[-2.086ms; -1.086ms] or [-4.152%; -2.162%]		 unstable
[-2.815op/s; +11.225op/s] or [-3.021%; +12.044%]		 48.645ms 97.405op/s 50.231ms 93.200op/s
scenario:load:petclinic:code_origins:high_load better
[-2.558ms; -1.740ms] or [-5.568%; -3.787%]		 unstable
[-3.016op/s; +12.991op/s] or [-2.961%; +12.756%]		 43.798ms 106.825op/s 45.948ms 101.838op/s
scenario:load:petclinic:appsec:high_load better
[-2.946ms; -2.005ms] or [-5.933%; -4.038%]		 unstable
[-1.005op/s; +13.366op/s] or [-1.066%; +14.178%]		 47.177ms 100.456op/s 49.653ms 94.275op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.52.0-SNAPSHOT~da962336df, baseline=1.51.1-SNAPSHOT~766af685ed
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.348 ms) : 4295, 4401
.   : milestone, 4348,
iast (9.163 ms) : 9002, 9323
.   : milestone, 9163,
iast_FULL (14.394 ms) : 14105, 14684
.   : milestone, 14394,
iast_GLOBAL (10.199 ms) : 10007, 10392
.   : milestone, 10199,
profiling (9.374 ms) : 9199, 9548
.   : milestone, 9374,
tracing (7.544 ms) : 7429, 7658
.   : milestone, 7544,
section candidate
no_agent (4.48 ms) : 4430, 4530
.   : milestone, 4480,
iast (9.432 ms) : 9276, 9588
.   : milestone, 9432,
iast_FULL (14.036 ms) : 13758, 14314
.   : milestone, 14036,
iast_GLOBAL (10.496 ms) : 10303, 10690
.   : milestone, 10496,
profiling (8.807 ms) : 8659, 8954
.   : milestone, 8807,
tracing (7.485 ms) : 7381, 7589
.   : milestone, 7485,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.348 ms [4.295 ms, 4.401 ms] -
iast 9.163 ms [9.002 ms, 9.323 ms] 4.815 ms (110.7%)
iast_FULL 14.394 ms [14.105 ms, 14.684 ms] 10.046 ms (231.1%)
iast_GLOBAL 10.199 ms [10.007 ms, 10.392 ms] 5.851 ms (134.6%)
profiling 9.374 ms [9.199 ms, 9.548 ms] 5.026 ms (115.6%)
tracing 7.544 ms [7.429 ms, 7.658 ms] 3.196 ms (73.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.48 ms [4.43 ms, 4.53 ms] -
iast 9.432 ms [9.276 ms, 9.588 ms] 4.952 ms (110.5%)
iast_FULL 14.036 ms [13.758 ms, 14.314 ms] 9.555 ms (213.3%)
iast_GLOBAL 10.496 ms [10.303 ms, 10.69 ms] 6.016 ms (134.3%)
profiling 8.807 ms [8.659 ms, 8.954 ms] 4.326 ms (96.6%)
tracing 7.485 ms [7.381 ms, 7.589 ms] 3.005 ms (67.1%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.52.0-SNAPSHOT~da962336df, baseline=1.51.1-SNAPSHOT~766af685ed
    dateFormat X
    axisFormat %s
section baseline
no_agent (37.261 ms) : 36958, 37563
.   : milestone, 37261,
appsec (49.653 ms) : 49208, 50098
.   : milestone, 49653,
code_origins (45.948 ms) : 45546, 46349
.   : milestone, 45948,
iast (44.743 ms) : 44358, 45129
.   : milestone, 44743,
profiling (50.231 ms) : 49768, 50694
.   : milestone, 50231,
tracing (42.833 ms) : 42461, 43205
.   : milestone, 42833,
section candidate
no_agent (38.425 ms) : 38108, 38742
.   : milestone, 38425,
appsec (47.177 ms) : 46748, 47607
.   : milestone, 47177,
code_origins (43.798 ms) : 43441, 44156
.   : milestone, 43798,
iast (44.029 ms) : 43652, 44406
.   : milestone, 44029,
profiling (48.645 ms) : 48179, 49112
.   : milestone, 48645,
tracing (42.291 ms) : 41926, 42657
.   : milestone, 42291,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 37.261 ms [36.958 ms, 37.563 ms] -
appsec 49.653 ms [49.208 ms, 50.098 ms] 12.392 ms (33.3%)
code_origins 45.948 ms [45.546 ms, 46.349 ms] 8.687 ms (23.3%)
iast 44.743 ms [44.358 ms, 45.129 ms] 7.483 ms (20.1%)
profiling 50.231 ms [49.768 ms, 50.694 ms] 12.971 ms (34.8%)
tracing 42.833 ms [42.461 ms, 43.205 ms] 5.573 ms (15.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 38.425 ms [38.108 ms, 38.742 ms] -
appsec 47.177 ms [46.748 ms, 47.607 ms] 8.752 ms (22.8%)
code_origins 43.798 ms [43.441 ms, 44.156 ms] 5.373 ms (14.0%)
iast 44.029 ms [43.652 ms, 44.406 ms] 5.604 ms (14.6%)
profiling 48.645 ms [48.179 ms, 49.112 ms] 10.22 ms (26.6%)
tracing 42.291 ms [41.926 ms, 42.657 ms] 3.866 ms (10.1%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master kr-igor/dsm-improvements-custom-build
git_commit_date 1753187273 1753193350
git_commit_sha 766af68 da96233
release_version 1.51.1-SNAPSHOT~766af685ed 1.52.0-SNAPSHOT~da962336df
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1753195756 1753195756
ci_job_id 1041134078 1041134078
ci_pipeline_id 71315686 71315686
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-hl13wf7x 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-hl13wf7x 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 0 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:dacapo:tomcat:appsec better
[-1.432ms; -1.091ms] or [-38.950%; -29.689%]		 2.415ms 3.676ms
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.52.0-SNAPSHOT~da962336df, baseline=1.51.1-SNAPSHOT~766af685ed
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.488 s) : 15488000, 15488000
.   : milestone, 15488000,
appsec (15.232 s) : 15232000, 15232000
.   : milestone, 15232000,
iast (18.437 s) : 18437000, 18437000
.   : milestone, 18437000,
iast_GLOBAL (17.757 s) : 17757000, 17757000
.   : milestone, 17757000,
profiling (15.033 s) : 15033000, 15033000
.   : milestone, 15033000,
tracing (14.818 s) : 14818000, 14818000
.   : milestone, 14818000,
section candidate
no_agent (15.529 s) : 15529000, 15529000
.   : milestone, 15529000,
appsec (14.94 s) : 14940000, 14940000
.   : milestone, 14940000,
iast (18.269 s) : 18269000, 18269000
.   : milestone, 18269000,
iast_GLOBAL (17.954 s) : 17954000, 17954000
.   : milestone, 17954000,
profiling (15.105 s) : 15105000, 15105000
.   : milestone, 15105000,
tracing (14.867 s) : 14867000, 14867000
.   : milestone, 14867000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.488 s [15.488 s, 15.488 s] -
appsec 15.232 s [15.232 s, 15.232 s] -256.0 ms (-1.7%)
iast 18.437 s [18.437 s, 18.437 s] 2.949 s (19.0%)
iast_GLOBAL 17.757 s [17.757 s, 17.757 s] 2.269 s (14.7%)
profiling 15.033 s [15.033 s, 15.033 s] -455.0 ms (-2.9%)
tracing 14.818 s [14.818 s, 14.818 s] -670.0 ms (-4.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.529 s [15.529 s, 15.529 s] -
appsec 14.94 s [14.94 s, 14.94 s] -589.0 ms (-3.8%)
iast 18.269 s [18.269 s, 18.269 s] 2.74 s (17.6%)
iast_GLOBAL 17.954 s [17.954 s, 17.954 s] 2.425 s (15.6%)
profiling 15.105 s [15.105 s, 15.105 s] -424.0 ms (-2.7%)
tracing 14.867 s [14.867 s, 14.867 s] -662.0 ms (-4.3%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.52.0-SNAPSHOT~da962336df, baseline=1.51.1-SNAPSHOT~766af685ed
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.471 ms) : 1459, 1482
.   : milestone, 1471,
appsec (3.676 ms) : 3458, 3894
.   : milestone, 3676,
iast (2.191 ms) : 2129, 2254
.   : milestone, 2191,
iast_GLOBAL (2.246 ms) : 2183, 2309
.   : milestone, 2246,
profiling (2.038 ms) : 1987, 2089
.   : milestone, 2038,
tracing (2.013 ms) : 1965, 2062
.   : milestone, 2013,
section candidate
no_agent (1.472 ms) : 1461, 1484
.   : milestone, 1472,
appsec (2.415 ms) : 2365, 2464
.   : milestone, 2415,
iast (2.203 ms) : 2141, 2266
.   : milestone, 2203,
iast_GLOBAL (2.238 ms) : 2175, 2300
.   : milestone, 2238,
profiling (2.044 ms) : 1994, 2094
.   : milestone, 2044,
tracing (2.02 ms) : 1971, 2069
.   : milestone, 2020,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.471 ms [1.459 ms, 1.482 ms] -
appsec 3.676 ms [3.458 ms, 3.894 ms] 2.205 ms (149.9%)
iast 2.191 ms [2.129 ms, 2.254 ms] 720.622 µs (49.0%)
iast_GLOBAL 2.246 ms [2.183 ms, 2.309 ms] 775.118 µs (52.7%)
profiling 2.038 ms [1.987 ms, 2.089 ms] 567.21 µs (38.6%)
tracing 2.013 ms [1.965 ms, 2.062 ms] 542.302 µs (36.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.472 ms [1.461 ms, 1.484 ms] -
appsec 2.415 ms [2.365 ms, 2.464 ms] 942.241 µs (64.0%)
iast 2.203 ms [2.141 ms, 2.266 ms] 731.067 µs (49.7%)
iast_GLOBAL 2.238 ms [2.175 ms, 2.3 ms] 765.401 µs (52.0%)
profiling 2.044 ms [1.994 ms, 2.094 ms] 571.39 µs (38.8%)
tracing 2.02 ms [1.971 ms, 2.069 ms] 547.962 µs (37.2%)

@pr-commenter
Copy link

pr-commenter bot commented Jul 22, 2025

Kafka / consumer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master kr-igor/dsm-improvements-custom-build
git_commit_date 1752068033 1753193350
git_commit_sha 1126e5e da96233
See matching parameters
Baseline Candidate
ci_job_date 1753194916 1753194916
ci_job_id 1041134082 1041134082
ci_pipeline_id 71315686 71315686
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaConsumerBenchmark.benchConsume same

ygree
ygree approved these changes Jul 28, 2025
View reviewed changes
Copy link
Contributor

@ygree ygree left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approved because all the commits have already been approved and merged in separate pull requests.

@kr-igor kr-igor closed this Aug 12, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@ygree ygree ygree approved these changes

@robertpi robertpi Awaiting requested review from robertpi robertpi is a code owner automatically assigned from DataDog/asm-java

@sezen-datadog sezen-datadog Awaiting requested review from sezen-datadog sezen-datadog is a code owner automatically assigned from DataDog/asm-java

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@kr-igor @ygree @manuel-alvarez-alvarez @daniel-mohedano