Skip to content

Conversation

sarahchen6
Copy link
Contributor

What Does This Do

Built on #9264 to address failing instrumentation tests

Motivation

Update AgentTestRunner to use JUnit5, necessary to support Java 25 and test JUnit6

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

amarziali and others added 30 commits August 8, 2025 13:59
* Support async servlet for RUM injection

* Move isRumEnabled to instrumenter config
* chore: Update Gradle dependencies

* chore: Update Gradle dependencies

* chore: Update Gradle dependencies

* chore: Update Gradle dependencies

* chore: Update Gradle dependencies

* chore: Update Gradle dependencies

* chore: Update Gradle dependencies

* chore: Update Gradle dependencies

* chore: Update Gradle dependencies

* chore: Update Gradle dependencies

* chore: Update Gradle dependencies

* chore: Update Gradle dependencies

* chore: Update Gradle dependencies

* chore: Update Gradle dependencies

* chore: Update Gradle dependencies

* chore: Update Gradle dependencies

* chore: Update Gradle dependencies

* chore: Update Gradle dependencies

* chore: Update Gradle dependencies

* chore: Update Gradle dependencies

* chore: Update Gradle dependencies

* chore: Update Gradle dependencies

* chore: Update Gradle dependencies

* chore: Update Gradle dependencies

* chore: Update Gradle dependencies

* chore: Update Gradle dependencies

* chore: Update Gradle dependencies

* chore: Update Gradle dependencies

* chore: Update Gradle dependencies

* chore: Update Gradle dependencies

* chore: Update Gradle dependencies

* chore: Update Gradle dependencies

* chore: Update Gradle dependencies

* chore: Update Gradle dependencies

* chore: Update Gradle dependencies

* chore: Update Gradle dependencies

* chore: Update Gradle dependencies

* chore: Update Gradle dependencies

* chore: Update Gradle dependencies

* chore: Update Gradle dependencies

* chore: Update Gradle dependencies

* chore: Update Gradle dependencies

* chore: Update Gradle dependencies

* chore: Update Gradle dependencies

* chore: Update Gradle dependencies

* chore: Update Gradle dependencies

* chore: Update Gradle dependencies

* chore: Update Gradle dependencies

* chore: Update Gradle dependencies

* Rollback some dependencies to fix compilation.

* Added dependency of `compilePlayRoutes` on `fixPlayRoutesDirectory`.

* Rollback some dependencies to fix compilation.

---------

Co-authored-by: dd-octo-sts[bot] <200755185+dd-octo-sts[bot]@users.noreply.github.com>
Co-authored-by: Alexey Kuznetsov <[email protected]>
Bumps the gh-actions-packages group with 3 updates: [actions/checkout](https://github.com/actions/checkout), [actions/cache](https://github.com/actions/cache) and [github/codeql-action](https://github.com/github/codeql-action).


Updates `actions/checkout` from 4.2.2 to 5.0.0
- [Release notes](https://github.com/actions/checkout/releases)
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md)
- [Commits](actions/checkout@11bd719...08c6903)

Updates `actions/cache` from 4.2.3 to 4.2.4
- [Release notes](https://github.com/actions/cache/releases)
- [Changelog](https://github.com/actions/cache/blob/main/RELEASES.md)
- [Commits](actions/cache@5a3ec84...0400d5f)

Updates `github/codeql-action` from 3.29.7 to 3.29.8
- [Release notes](https://github.com/github/codeql-action/releases)
- [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md)
- [Commits](github/codeql-action@51f7732...76621b6)

---
updated-dependencies:
- dependency-name: actions/checkout
  dependency-version: 5.0.0
  dependency-type: direct:production
  update-type: version-update:semver-major
  dependency-group: gh-actions-packages
- dependency-name: actions/cache
  dependency-version: 4.2.4
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: gh-actions-packages
- dependency-name: github/codeql-action
  dependency-version: 3.29.8
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: gh-actions-packages
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Avoid NPE on featureDiscovery creation

* Review
What Does This Do
Modifies WafModule#buildEvents to safely handle actionWithData.data being null.

Motivation
Fix #9346

Additional Notes
The current version of libddwaf may return null in the data field of actionWithData. This was previously not handled and could cause unexpected logged exceptions. The method now explicitly checks for null to prevent this.
#9351)

* use magic mirror depot

* remove separate cache name used for testing
by eliminating the chance identity hash might collide even after 3 rehashes
the easiest way to do this is to bump the size of the cache used in testing

note this is only necessary because we want to keep both keys in the cache
to test the 'visit' method - otherwise we'd need to relax that assertion
* Add dependency to OCI publish jobs

* Override new publishing-gate job

* Change stage order because publishing-gate depends on deploy_to_maven_central

* Add verify_maven_central_deployment job

* Test verify_maven_central_deployment job by temporarily removing dependency

* Change to registry.ddbuild image

* Test failing version

* Clean

* Change image for verify_maven_central_deployment job

* Fix verify_maven_central_deployment script

* Remove publishing-gate rules

* Test verify job

* Add manual trigger

* Fix verify script

* Add test-job to see what happens when verify job fails

* Clean test code

* Change retry rate

* Try test-job again

* Clean again

* Create a separate job to skip the verify maven job

---------

Co-authored-by: Laplie Anderson <[email protected]>
* feat(env): Migrate internal apis to environment component
* feat(env): Add new API to EnvironmentVariables and SystemProperties
* Refactor matchOperator to use method reference comparator for efficiency

* Implement better exception handling and debug logging for StableConfig parsing errors

* Add a debug log about no rules getting applied

* Improve test file logic and cleanup in StableConfigSourceTest class

* Github suggestions: Use static factory methods  as constructors for Rule and Selector classes

* Improve exception message: include value of object that caused the failure

* Add more test cases to StableConfigSourceTest to improve codecov

* Add test coverage for StableConfigMappingException

* Update internal-api/src/main/java/datadog/trace/bootstrap/config/provider/stableconfig/Rule.java

Co-authored-by: Alexey Kuznetsov <[email protected]>

* Update internal-api/src/main/java/datadog/trace/bootstrap/config/provider/stableconfig/Rule.java

Co-authored-by: Alexey Kuznetsov <[email protected]>

* Use safeToString when printing stableconfig map

* rearrange logic in selectors creation for better readability

* delete superfluous else

* Use constant to represent max length in safeToString

* use throwStableConfigMappingException helper function

* refactor exception catching in StableConfigSource

* restore semicolon in calls to throwStableConfigMappingException

* Use static import for throwStableConfigMappingException

* test other kinds of exceptions in StableConfigSource

* remove duplicate cfg assignments

* fix missing operator test case

* Update internal-api/src/main/java/datadog/trace/bootstrap/config/provider/stableconfig/Rule.java

Co-authored-by: Alexey Kuznetsov <[email protected]>

* Improve readability of StableConfigMappingException and its function invocations

* modify safeToString logic to print first 50 and last 50 chars

* remove extra placeholder in string message when printing exception

* Update internal-api/src/main/java/datadog/trace/bootstrap/config/provider/StableConfigSource.java

Co-authored-by: Alexey Kuznetsov <[email protected]>

* refactor Rules.from to perform type assertions before heavyweight list manipulation

* run spotless

---------

Co-authored-by: Alexey Kuznetsov <[email protected]>
* Add stage for publishing-gate

* Allow publishing-gate to run when populating cache
* chore: Update Gradle dependencies

* chore: Update Gradle dependencies

* chore: Update Gradle dependencies

* chore: Update Gradle dependencies

* chore: Update Gradle dependencies

* Rollback some dependencies to fix compilation.

---------

Co-authored-by: dd-octo-sts[bot] <200755185+dd-octo-sts[bot]@users.noreply.github.com>
Co-authored-by: Alexey Kuznetsov <[email protected]>
* feat(bootstrap): Migrate Spray instrumentation to Context API
* feat(bootstrap): Migrate Tomcat instrumentation to Context API
* feat(bootstrap): Migrate Liberty instrumentations to Context API
* feat(bootstrap): Migrate instrumentations to Context API
* fix(bootstrap): Fix unexpected call to IG callback
* feat(play): Simplify testing
* fix(bootstrap): Fix import
Do not stop on git log check
Fix next patch release version compute
…generated keys (#9321)

* Prevent crash in SQL Server JDBC when tracing execute methods with generated keys

When tracing the JDBC statement execute methods, we prepend a comment to
the SQL query used for DBM trace propagation.
However, there is a bug in the SQL Server JDBC driver that prevents the
generated keys from being returned when the SQL comment is prepended to
the SQL query.
I decided to only append the comment in this specific case to avoid the
comment from being truncated.

@see microsoft/mssql-jdbc#2729

* remove dynamic typing when packing all the JDBC arguments

* move JDBC test on injection with generated keys to SQL Server file

* remove useless constant in StatementAdvice
…#9382)

Bumps the gh-actions-packages group with 1 update: [github/codeql-action](https://github.com/github/codeql-action).


Updates `github/codeql-action` from 3.29.8 to 3.29.10
- [Release notes](https://github.com/github/codeql-action/releases)
- [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md)
- [Commits](github/codeql-action@76621b6...96f518a)

---
updated-dependencies:
- dependency-name: github/codeql-action
  dependency-version: 3.29.10
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: gh-actions-packages
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* feat(dsm): Improve code style
* feat(aws): Refactor AWS instrumentation around Context
rachelyangdog and others added 20 commits August 19, 2025 16:43
* Add RumInjectorHealthMetrics

* Add telemetry collector and methods to RumInjector

* Initialize health metrics and telemetry collector

* Get injectionsucceed count

* Add comments

* Reorganize classes

* Connect rum injector, telemetry collector, and statsdclient

* Add tests

* Get and test metrics for injection failures and skips

* Add Content Security Policy and HTTP response size telemetry

* Add injection duration telemetry

* Fix some things

* Fix content-length retrieval and add test for injection timing

* Add injection initialization success telemetry

* Fix CoreTracer compilation with InstrumenterConfig

* Add tags to all metrics

* Update InjectingPipeOutputStreamTest

* Tweaks

* Address jacoco coverage and injectingpipeoutstream interface updates

* Add content-length detection for InjectingPipeWriter and improve tests

* Address review comments

* Fix header retrieval

* Add lots of improvements from review comments

* Fix constructors and address review comment

* Clarify bytes written and address review comment

* Use dynamic servlet version retrieval

* Change injection timing logic

* Clean up

* Use dynamic servlet version retrieval for tagging as well

* Add a telemetry check to HttpServerTest

* Clean up
* Use origin CALCULATED for merged methods

* fix javadoc for ConfigOrigin.CALCULATED

* apply github suggestions
…9370)

* throw IllegalArgumentException in ConfigConverter.booleanValueOf

* modify get to only catch IllegalArgumentException

* Fix failing ConfigTest tests

* Update dd-java-agent/agent-bootstrap/src/main/java/datadog/trace/bootstrap/instrumentation/decorator/BaseDecorator.java

Co-authored-by: Stuart McCulloch <[email protected]>

* Use InvalidBooleanValueException; return false when encountered

---------

Co-authored-by: Stuart McCulloch <[email protected]>
* Add ErrorPriorities for manual instrumentation and tag interceptor

(cherry picked from commit c26ef68)

* Set resource name and error priority to manual instrumentation for otel spans

(cherry picked from commit f573ade)

* remove tag interceptor error priority

* Test on new error priorities level

---------

Co-authored-by: DJ Gregor <[email protected]>
…current thread is not the original. (#9403)

This mitigates a potential issue if the swapped out scope-stack is ever restored more than once on different threads.
* initial introduction of config_id

* fix tests, fix NPE in ConfigSetting.equals, include configId in telemetryrequestbody when nonnull

* report config id for stableconfigsources in get

* Fix call to outdated ConfigSetting constructor in EventSourceTest

* fix config_id report

* fix where null config id was getting treated as string 'null'

* report config id for all get methods

* remove superfluous file

* simplify configId resolution logic in configProvider

* report sourceValue instead of value to ConfigCollector in get method

* add tests for configid and no configid
Copy link

datadog-official bot commented Aug 22, 2025

🎯 Code Coverage
Patch Coverage: 82.59%
Total Coverage: 59.88% (+0.28%)

View detailed report

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: fa5ebf0 | Docs | Was this helpful? Give us feedback!

@pr-commenter
Copy link

pr-commenter bot commented Aug 22, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/experiment
git_commit_date 1756232046 1756257878
git_commit_sha 646403a fa5ebf0
release_version 1.53.0-SNAPSHOT~646403a00c 1.53.0-SNAPSHOT~fa5ebf0c1d
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1756263740 1756263740
ci_job_id 1100339257 1100339257
ci_pipeline_id 74809748 74809748
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-raxvwi49 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-raxvwi49 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 46 metrics, 13 unstable metrics.

Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.53.0-SNAPSHOT~fa5ebf0c1d, baseline=1.53.0-SNAPSHOT~646403a00c

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.049 s) : 0, 1048878
Total [baseline] (8.619 s) : 0, 8618589
Agent [candidate] (1.049 s) : 0, 1049266
Total [candidate] (8.636 s) : 0, 8635984
section iast
Agent [baseline] (1.183 s) : 0, 1183355
Total [baseline] (9.332 s) : 0, 9331614
Agent [candidate] (1.182 s) : 0, 1182349
Total [candidate] (9.329 s) : 0, 9329160
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.049 s -
Agent iast 1.183 s 134.477 ms (12.8%)
Total tracing 8.619 s -
Total iast 9.332 s 713.026 ms (8.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.049 s -
Agent iast 1.182 s 133.083 ms (12.7%)
Total tracing 8.636 s -
Total iast 9.329 s 693.175 ms (8.0%)
gantt
    title insecure-bank - break down per module: candidate=1.53.0-SNAPSHOT~fa5ebf0c1d, baseline=1.53.0-SNAPSHOT~646403a00c

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.464 ms) : 0, 1464
crashtracking [candidate] (1.452 ms) : 0, 1452
BytebuddyAgent [baseline] (732.886 ms) : 0, 732886
BytebuddyAgent [candidate] (734.533 ms) : 0, 734533
GlobalTracer [baseline] (242.954 ms) : 0, 242954
GlobalTracer [candidate] (243.218 ms) : 0, 243218
AppSec [baseline] (30.152 ms) : 0, 30152
AppSec [candidate] (29.975 ms) : 0, 29975
Debugger [baseline] (6.086 ms) : 0, 6086
Debugger [candidate] (6.118 ms) : 0, 6118
Remote Config [baseline] (672.502 µs) : 0, 673
Remote Config [candidate] (683.087 µs) : 0, 683
Telemetry [baseline] (13.646 ms) : 0, 13646
Telemetry [candidate] (12.243 ms) : 0, 12243
section iast
crashtracking [baseline] (1.456 ms) : 0, 1456
crashtracking [candidate] (1.457 ms) : 0, 1457
BytebuddyAgent [baseline] (853.799 ms) : 0, 853799
BytebuddyAgent [candidate] (853.303 ms) : 0, 853303
GlobalTracer [baseline] (234.017 ms) : 0, 234017
GlobalTracer [candidate] (233.988 ms) : 0, 233988
AppSec [baseline] (27.031 ms) : 0, 27031
AppSec [candidate] (26.848 ms) : 0, 26848
Debugger [baseline] (5.784 ms) : 0, 5784
Debugger [candidate] (6.594 ms) : 0, 6594
Remote Config [baseline] (609.247 µs) : 0, 609
Remote Config [candidate] (603.282 µs) : 0, 603
Telemetry [baseline] (8.434 ms) : 0, 8434
Telemetry [candidate] (8.274 ms) : 0, 8274
IAST [baseline] (31.112 ms) : 0, 31112
IAST [candidate] (30.283 ms) : 0, 30283
Loading
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.53.0-SNAPSHOT~fa5ebf0c1d, baseline=1.53.0-SNAPSHOT~646403a00c

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.049 s) : 0, 1048720
Total [baseline] (10.811 s) : 0, 10811129
Agent [candidate] (1.049 s) : 0, 1048826
Total [candidate] (10.731 s) : 0, 10730686
section appsec
Agent [baseline] (1.226 s) : 0, 1225976
Total [baseline] (10.792 s) : 0, 10792234
Agent [candidate] (1.224 s) : 0, 1224325
Total [candidate] (10.769 s) : 0, 10769089
section iast
Agent [baseline] (1.185 s) : 0, 1184805
Total [baseline] (10.989 s) : 0, 10989334
Agent [candidate] (1.182 s) : 0, 1182411
Total [candidate] (11.059 s) : 0, 11058917
section profiling
Agent [baseline] (1.204 s) : 0, 1203834
Total [baseline] (10.955 s) : 0, 10954820
Agent [candidate] (1.199 s) : 0, 1198641
Total [candidate] (10.958 s) : 0, 10957865
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.049 s -
Agent appsec 1.226 s 177.255 ms (16.9%)
Agent iast 1.185 s 136.085 ms (13.0%)
Agent profiling 1.204 s 155.113 ms (14.8%)
Total tracing 10.811 s -
Total appsec 10.792 s -18.895 ms (-0.2%)
Total iast 10.989 s 178.204 ms (1.6%)
Total profiling 10.955 s 143.691 ms (1.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.049 s -
Agent appsec 1.224 s 175.499 ms (16.7%)
Agent iast 1.182 s 133.584 ms (12.7%)
Agent profiling 1.199 s 149.815 ms (14.3%)
Total tracing 10.731 s -
Total appsec 10.769 s 38.404 ms (0.4%)
Total iast 11.059 s 328.231 ms (3.1%)
Total profiling 10.958 s 227.18 ms (2.1%)
gantt
    title petclinic - break down per module: candidate=1.53.0-SNAPSHOT~fa5ebf0c1d, baseline=1.53.0-SNAPSHOT~646403a00c

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.459 ms) : 0, 1459
crashtracking [candidate] (1.453 ms) : 0, 1453
BytebuddyAgent [baseline] (734.294 ms) : 0, 734294
BytebuddyAgent [candidate] (733.137 ms) : 0, 733137
GlobalTracer [baseline] (243.124 ms) : 0, 243124
GlobalTracer [candidate] (242.894 ms) : 0, 242894
AppSec [baseline] (30.148 ms) : 0, 30148
AppSec [candidate] (29.957 ms) : 0, 29957
Debugger [baseline] (6.105 ms) : 0, 6105
Debugger [candidate] (6.056 ms) : 0, 6056
Remote Config [baseline] (684.525 µs) : 0, 685
Remote Config [candidate] (657.931 µs) : 0, 658
Telemetry [baseline] (11.68 ms) : 0, 11680
Telemetry [candidate] (13.641 ms) : 0, 13641
section appsec
crashtracking [baseline] (1.443 ms) : 0, 1443
crashtracking [candidate] (1.458 ms) : 0, 1458
BytebuddyAgent [baseline] (757.9 ms) : 0, 757900
BytebuddyAgent [candidate] (756.417 ms) : 0, 756417
GlobalTracer [baseline] (235.832 ms) : 0, 235832
GlobalTracer [candidate] (235.432 ms) : 0, 235432
IAST [baseline] (23.504 ms) : 0, 23504
IAST [candidate] (23.73 ms) : 0, 23730
AppSec [baseline] (170.515 ms) : 0, 170515
AppSec [candidate] (169.949 ms) : 0, 169949
Debugger [baseline] (6.546 ms) : 0, 6546
Debugger [candidate] (6.461 ms) : 0, 6461
Remote Config [baseline] (644.195 µs) : 0, 644
Remote Config [candidate] (622.991 µs) : 0, 623
Telemetry [baseline] (8.456 ms) : 0, 8456
Telemetry [candidate] (9.176 ms) : 0, 9176
section iast
crashtracking [baseline] (1.461 ms) : 0, 1461
crashtracking [candidate] (1.458 ms) : 0, 1458
BytebuddyAgent [baseline] (854.577 ms) : 0, 854577
BytebuddyAgent [candidate] (852.834 ms) : 0, 852834
GlobalTracer [baseline] (234.398 ms) : 0, 234398
GlobalTracer [candidate] (234.777 ms) : 0, 234777
IAST [baseline] (29.606 ms) : 0, 29606
IAST [candidate] (28.744 ms) : 0, 28744
AppSec [baseline] (27.746 ms) : 0, 27746
AppSec [candidate] (27.882 ms) : 0, 27882
Debugger [baseline] (6.64 ms) : 0, 6640
Debugger [candidate] (6.532 ms) : 0, 6532
Remote Config [baseline] (603.159 µs) : 0, 603
Remote Config [candidate] (597.654 µs) : 0, 598
Telemetry [baseline] (8.445 ms) : 0, 8445
Telemetry [candidate] (8.451 ms) : 0, 8451
section profiling
crashtracking [baseline] (1.456 ms) : 0, 1456
crashtracking [candidate] (1.438 ms) : 0, 1438
BytebuddyAgent [baseline] (767.347 ms) : 0, 767347
BytebuddyAgent [candidate] (763.571 ms) : 0, 763571
GlobalTracer [baseline] (223.081 ms) : 0, 223081
GlobalTracer [candidate] (222.216 ms) : 0, 222216
AppSec [baseline] (30.349 ms) : 0, 30349
AppSec [candidate] (29.965 ms) : 0, 29965
Debugger [baseline] (6.287 ms) : 0, 6287
Debugger [candidate] (7.044 ms) : 0, 7044
Remote Config [baseline] (734.613 µs) : 0, 735
Remote Config [candidate] (714.674 µs) : 0, 715
Telemetry [baseline] (16.568 ms) : 0, 16568
Telemetry [candidate] (15.587 ms) : 0, 15587
ProfilingAgent [baseline] (108.081 ms) : 0, 108081
ProfilingAgent [candidate] (108.375 ms) : 0, 108375
Profiling [baseline] (108.741 ms) : 0, 108741
Profiling [candidate] (109.011 ms) : 0, 109011
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/experiment
git_commit_date 1756232046 1756257878
git_commit_sha 646403a fa5ebf0
release_version 1.53.0-SNAPSHOT~646403a00c 1.53.0-SNAPSHOT~fa5ebf0c1d
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1756263413 1756263413
ci_job_id 1100339258 1100339258
ci_pipeline_id 74809748 74809748
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-6glbrs36 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-6glbrs36 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 2 performance regressions! Performance is the same for 8 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:insecure-bank:profiling:high_load worse
[+329.779µs; +622.112µs] or [+3.888%; +7.334%]
unstable
[-98.556op/s; +41.743op/s] or [-18.029%; +7.636%]
8.958ms 518.250op/s 8.482ms 546.656op/s
scenario:load:insecure-bank:iast_GLOBAL:high_load better
[-677.317µs; -298.117µs] or [-6.538%; -2.878%]
unstable
[-34.844op/s; +78.531op/s] or [-7.767%; +17.506%]
9.872ms 470.438op/s 10.360ms 448.594op/s
scenario:load:petclinic:iast:high_load worse
[+1.237ms; +2.083ms] or [+2.775%; +4.671%]
unstable
[-11.101op/s; +3.626op/s] or [-10.579%; +3.456%]
46.249ms 101.200op/s 44.589ms 104.938op/s
scenario:load:petclinic:appsec:high_load better
[-2.129ms; -1.154ms] or [-4.199%; -2.276%]
unstable
[-3.982op/s; +10.132op/s] or [-4.312%; +10.972%]
49.059ms 95.425op/s 50.700ms 92.350op/s
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.53.0-SNAPSHOT~fa5ebf0c1d, baseline=1.53.0-SNAPSHOT~646403a00c
    dateFormat X
    axisFormat %s
section baseline
no_agent (37.07 ms) : 36772, 37368
.   : milestone, 37070,
appsec (50.7 ms) : 50228, 51172
.   : milestone, 50700,
code_origins (45.194 ms) : 44795, 45593
.   : milestone, 45194,
iast (44.589 ms) : 44208, 44970
.   : milestone, 44589,
profiling (50.294 ms) : 49831, 50757
.   : milestone, 50294,
tracing (45.026 ms) : 44643, 45409
.   : milestone, 45026,
section candidate
no_agent (36.497 ms) : 36205, 36789
.   : milestone, 36497,
appsec (49.059 ms) : 48626, 49492
.   : milestone, 49059,
code_origins (45.146 ms) : 44776, 45516
.   : milestone, 45146,
iast (46.249 ms) : 45845, 46653
.   : milestone, 46249,
profiling (49.94 ms) : 49471, 50409
.   : milestone, 49940,
tracing (45.366 ms) : 44981, 45752
.   : milestone, 45366,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 37.07 ms [36.772 ms, 37.368 ms] -
appsec 50.7 ms [50.228 ms, 51.172 ms] 13.63 ms (36.8%)
code_origins 45.194 ms [44.795 ms, 45.593 ms] 8.124 ms (21.9%)
iast 44.589 ms [44.208 ms, 44.97 ms] 7.519 ms (20.3%)
profiling 50.294 ms [49.831 ms, 50.757 ms] 13.224 ms (35.7%)
tracing 45.026 ms [44.643 ms, 45.409 ms] 7.955 ms (21.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 36.497 ms [36.205 ms, 36.789 ms] -
appsec 49.059 ms [48.626 ms, 49.492 ms] 12.562 ms (34.4%)
code_origins 45.146 ms [44.776 ms, 45.516 ms] 8.649 ms (23.7%)
iast 46.249 ms [45.845 ms, 46.653 ms] 9.752 ms (26.7%)
profiling 49.94 ms [49.471 ms, 50.409 ms] 13.443 ms (36.8%)
tracing 45.366 ms [44.981 ms, 45.752 ms] 8.87 ms (24.3%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.53.0-SNAPSHOT~fa5ebf0c1d, baseline=1.53.0-SNAPSHOT~646403a00c
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.465 ms) : 4408, 4522
.   : milestone, 4465,
iast (9.588 ms) : 9420, 9755
.   : milestone, 9588,
iast_FULL (14.22 ms) : 13943, 14498
.   : milestone, 14220,
iast_GLOBAL (10.36 ms) : 10180, 10540
.   : milestone, 10360,
profiling (8.482 ms) : 8355, 8610
.   : milestone, 8482,
tracing (7.632 ms) : 7518, 7746
.   : milestone, 7632,
section candidate
no_agent (4.464 ms) : 4412, 4516
.   : milestone, 4464,
iast (9.408 ms) : 9255, 9561
.   : milestone, 9408,
iast_FULL (13.968 ms) : 13693, 14242
.   : milestone, 13968,
iast_GLOBAL (9.872 ms) : 9700, 10045
.   : milestone, 9872,
profiling (8.958 ms) : 8814, 9102
.   : milestone, 8958,
tracing (7.518 ms) : 7412, 7623
.   : milestone, 7518,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.465 ms [4.408 ms, 4.522 ms] -
iast 9.588 ms [9.42 ms, 9.755 ms] 5.123 ms (114.7%)
iast_FULL 14.22 ms [13.943 ms, 14.498 ms] 9.755 ms (218.5%)
iast_GLOBAL 10.36 ms [10.18 ms, 10.54 ms] 5.895 ms (132.0%)
profiling 8.482 ms [8.355 ms, 8.61 ms] 4.017 ms (90.0%)
tracing 7.632 ms [7.518 ms, 7.746 ms] 3.167 ms (70.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.464 ms [4.412 ms, 4.516 ms] -
iast 9.408 ms [9.255 ms, 9.561 ms] 4.944 ms (110.8%)
iast_FULL 13.968 ms [13.693 ms, 14.242 ms] 9.504 ms (212.9%)
iast_GLOBAL 9.872 ms [9.7 ms, 10.045 ms] 5.409 ms (121.2%)
profiling 8.958 ms [8.814 ms, 9.102 ms] 4.495 ms (100.7%)
tracing 7.518 ms [7.412 ms, 7.623 ms] 3.054 ms (68.4%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/experiment
git_commit_date 1756232046 1756257878
git_commit_sha 646403a fa5ebf0
release_version 1.53.0-SNAPSHOT~646403a00c 1.53.0-SNAPSHOT~fa5ebf0c1d
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1756263913 1756263913
ci_job_id 1100339259 1100339259
ci_pipeline_id 74809748 74809748
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-09emzjgz 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-09emzjgz 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.53.0-SNAPSHOT~fa5ebf0c1d, baseline=1.53.0-SNAPSHOT~646403a00c
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.625 s) : 15625000, 15625000
.   : milestone, 15625000,
appsec (14.689 s) : 14689000, 14689000
.   : milestone, 14689000,
iast (18.274 s) : 18274000, 18274000
.   : milestone, 18274000,
iast_GLOBAL (17.969 s) : 17969000, 17969000
.   : milestone, 17969000,
profiling (15.686 s) : 15686000, 15686000
.   : milestone, 15686000,
tracing (14.899 s) : 14899000, 14899000
.   : milestone, 14899000,
section candidate
no_agent (14.987 s) : 14987000, 14987000
.   : milestone, 14987000,
appsec (14.798 s) : 14798000, 14798000
.   : milestone, 14798000,
iast (18.305 s) : 18305000, 18305000
.   : milestone, 18305000,
iast_GLOBAL (17.784 s) : 17784000, 17784000
.   : milestone, 17784000,
profiling (15.293 s) : 15293000, 15293000
.   : milestone, 15293000,
tracing (14.889 s) : 14889000, 14889000
.   : milestone, 14889000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.625 s [15.625 s, 15.625 s] -
appsec 14.689 s [14.689 s, 14.689 s] -936.0 ms (-6.0%)
iast 18.274 s [18.274 s, 18.274 s] 2.649 s (17.0%)
iast_GLOBAL 17.969 s [17.969 s, 17.969 s] 2.344 s (15.0%)
profiling 15.686 s [15.686 s, 15.686 s] 61.0 ms (0.4%)
tracing 14.899 s [14.899 s, 14.899 s] -726.0 ms (-4.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.987 s [14.987 s, 14.987 s] -
appsec 14.798 s [14.798 s, 14.798 s] -189.0 ms (-1.3%)
iast 18.305 s [18.305 s, 18.305 s] 3.318 s (22.1%)
iast_GLOBAL 17.784 s [17.784 s, 17.784 s] 2.797 s (18.7%)
profiling 15.293 s [15.293 s, 15.293 s] 306.0 ms (2.0%)
tracing 14.889 s [14.889 s, 14.889 s] -98.0 ms (-0.7%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.53.0-SNAPSHOT~fa5ebf0c1d, baseline=1.53.0-SNAPSHOT~646403a00c
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.474 ms) : 1463, 1486
.   : milestone, 1474,
appsec (2.451 ms) : 2398, 2503
.   : milestone, 2451,
iast (2.187 ms) : 2125, 2250
.   : milestone, 2187,
iast_GLOBAL (2.228 ms) : 2165, 2291
.   : milestone, 2228,
profiling (2.027 ms) : 1977, 2077
.   : milestone, 2027,
tracing (2.013 ms) : 1964, 2062
.   : milestone, 2013,
section candidate
no_agent (1.468 ms) : 1457, 1480
.   : milestone, 1468,
appsec (3.653 ms) : 3437, 3870
.   : milestone, 3653,
iast (2.188 ms) : 2126, 2250
.   : milestone, 2188,
iast_GLOBAL (2.235 ms) : 2172, 2299
.   : milestone, 2235,
profiling (2.032 ms) : 1982, 2083
.   : milestone, 2032,
tracing (2.001 ms) : 1952, 2049
.   : milestone, 2001,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.474 ms [1.463 ms, 1.486 ms] -
appsec 2.451 ms [2.398 ms, 2.503 ms] 976.78 µs (66.3%)
iast 2.187 ms [2.125 ms, 2.25 ms] 713.288 µs (48.4%)
iast_GLOBAL 2.228 ms [2.165 ms, 2.291 ms] 753.855 µs (51.1%)
profiling 2.027 ms [1.977 ms, 2.077 ms] 552.722 µs (37.5%)
tracing 2.013 ms [1.964 ms, 2.062 ms] 538.665 µs (36.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.468 ms [1.457 ms, 1.48 ms] -
appsec 3.653 ms [3.437 ms, 3.87 ms] 2.185 ms (148.8%)
iast 2.188 ms [2.126 ms, 2.25 ms] 719.764 µs (49.0%)
iast_GLOBAL 2.235 ms [2.172 ms, 2.299 ms] 767.137 µs (52.2%)
profiling 2.032 ms [1.982 ms, 2.083 ms] 564.069 µs (38.4%)
tracing 2.001 ms [1.952 ms, 2.049 ms] 532.476 µs (36.3%)

@pr-commenter
Copy link

pr-commenter bot commented Aug 22, 2025

Kafka / producer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch nikita-tkachenko/junit-6 sarahchen6/experiment
git_commit_date 1754670324 1756257878
git_commit_sha 7c7286a fa5ebf0
See matching parameters
Baseline Candidate
ci_job_date 1756263152 1756263152
ci_job_id 1100339262 1100339262
ci_pipeline_id 74809748 74809748
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaProduceBenchmark.benchProduce unsure
[+4906.672op/s; +61307.595op/s] or [+0.274%; +3.418%]
scenario:only-tracing-dsm-disabled-benchmarks/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaProduceBenchmark.benchProduce same

@pr-commenter
Copy link

pr-commenter bot commented Aug 22, 2025

Kafka / consumer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch nikita-tkachenko/junit-6 sarahchen6/experiment
git_commit_date 1754670324 1756257878
git_commit_sha 7c7286a fa5ebf0
See matching parameters
Baseline Candidate
ci_job_date 1756263187 1756263187
ci_job_id 1100339263 1100339263
ci_pipeline_id 74809748 74809748
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaConsumerBenchmark.benchConsume same

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.