Skip to content

Split dependabot files into separate projects #7459

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 3 commits into from
Sep 3, 2025
Merged

Split dependabot files into separate projects #7459

merged 3 commits into from
Sep 3, 2025

Conversation

andrewlock
Copy link
Member

Summary of changes

Splits the existing Datadog.Dependabot.Integrations.csproj into separate files

Reason for change

Dependabot often errors out due to interactions between the dependencies in the Datadog.Dependabot.Integrations.csproj, which will increasingly become an issue as we add more and more integrations. By splitting each package into its own file we should avoid all those issues, which means we should getter faster notifications when something changes (currently we're relying on the scheduled update once a week).

Implementation details

Minor changes to spit each line in the existing file into a separate project. This should work with the existing dependabot config as far as I can tell, but I wasn't sure, so decided to be specific about it.

Test coverage

The output files match the input, so I think we're ok.

Other details

This doesn't update any actual versions

@andrewlock andrewlock added the area:builds project files, build scripts, pipelines, versioning, releases, packages label Sep 2, 2025
@andrewlock andrewlock requested review from a team as code owners September 2, 2025 13:53
@andrewlock andrewlock added the area:dependabot dependabot updates label Sep 2, 2025
@andrewlock andrewlock force-pushed the andrew/ci/split-dependabot branch from c00bf4e to cdea42a Compare September 2, 2025 13:54
@pr-commenter
Copy link

pr-commenter bot commented Sep 2, 2025 •
edited
Loading

Benchmarks

Benchmarks Report for benchmark platform 🐌

Benchmarks for #7459 compared to master:

  • All benchmarks have the same speed
  • 2 benchmarks have fewer allocations
  • 5 benchmarks have more allocations

The following thresholds were used for comparing the benchmark speeds:

  • Mann–Whitney U test with statistical test for significance of 5%
  • Only results indicating a difference greater than 10% and 0.3 ns are considered.

Allocation changes below 0.5% are ignored.

Benchmark details

Benchmarks.Trace.ActivityBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master StartStopWithChild net6.0 10.8μs 56.6ns 283ns 0 0 0 5.51 KB
master StartStopWithChild netcoreapp3.1 13.5μs 50.6ns 196ns 0 0 0 5.71 KB
master StartStopWithChild net472 22.1μs 123ns 767ns 1.07 0.427 0.107 6.09 KB
#7459 StartStopWithChild net6.0 10.9μs 59.9ns 349ns 0 0 0 5.5 KB
#7459 StartStopWithChild netcoreapp3.1 13.4μs 67.1ns 307ns 0 0 0 5.69 KB
#7459 StartStopWithChild net472 21.8μs 98.5ns 462ns 0.87 0.217 0 6.1 KB
Benchmarks.Trace.AgentWriterBenchmark - Same speed ✔️ Fewer allocations 🎉

Fewer allocations 🎉 in #7459

Benchmark Base Allocated Diff Allocated Change Change %
Benchmarks.Trace.AgentWriterBenchmark.WriteAndFlushEnrichedTraces‑net472 3.35 KB 3.31 KB -46 B -1.37%

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master WriteAndFlushEnrichedTraces net6.0 919μs 128ns 460ns 0 0 0 2.7 KB
master WriteAndFlushEnrichedTraces netcoreapp3.1 1.03ms 2.03μs 7.85μs 0 0 0 2.7 KB
master WriteAndFlushEnrichedTraces net472 1.23ms 580ns 2.25μs 0 0 0 3.35 KB
#7459 WriteAndFlushEnrichedTraces net6.0 946μs 118ns 455ns 0 0 0 2.7 KB
#7459 WriteAndFlushEnrichedTraces netcoreapp3.1 1.02ms 751ns 2.91μs 0 0 0 2.7 KB
#7459 WriteAndFlushEnrichedTraces net472 1.22ms 53.1ns 199ns 0 0 0 3.31 KB
Benchmarks.Trace.Asm.AppSecBodyBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master AllCycleSimpleBody net6.0 321μs 1.52μs 6.25μs 0 0 0 172.07 KB
master AllCycleSimpleBody netcoreapp3.1 463μs 1.79μs 6.71μs 0 0 0 174.18 KB
master AllCycleSimpleBody net472 427μs 94.8ns 355ns 29.2 0 0 194.24 KB
master AllCycleMoreComplexBody net6.0 328μs 1.58μs 6.69μs 0 0 0 175.58 KB
master AllCycleMoreComplexBody netcoreapp3.1 463μs 2.11μs 8.42μs 0 0 0 177.6 KB
master AllCycleMoreComplexBody net472 436μs 111ns 428ns 30.2 0 0 197.76 KB
master ObjectExtractorSimpleBody net6.0 318ns 1.71ns 8.56ns 0 0 0 280 B
master ObjectExtractorSimpleBody netcoreapp3.1 408ns 2.23ns 12.2ns 0 0 0 272 B
master ObjectExtractorSimpleBody net472 301ns 0.0295ns 0.111ns 0.044 0 0 281 B
master ObjectExtractorMoreComplexBody net6.0 6.23μs 29ns 108ns 0 0 0 3.78 KB
master ObjectExtractorMoreComplexBody netcoreapp3.1 7.71μs 37ns 153ns 0 0 0 3.69 KB
master ObjectExtractorMoreComplexBody net472 6.67μs 2.25ns 8.71ns 0.601 0 0 3.8 KB
#7459 AllCycleSimpleBody net6.0 323μs 215ns 831ns 0 0 0 172.07 KB
#7459 AllCycleSimpleBody netcoreapp3.1 461μs 1.39μs 5.39μs 0 0 0 174.18 KB
#7459 AllCycleSimpleBody net472 425μs 185ns 666ns 29.2 0 0 194.24 KB
#7459 AllCycleMoreComplexBody net6.0 331μs 1.66μs 7.62μs 0 0 0 175.58 KB
#7459 AllCycleMoreComplexBody netcoreapp3.1 469μs 1.2μs 4.14μs 0 0 0 177.6 KB
#7459 AllCycleMoreComplexBody net472 433μs 157ns 607ns 30.2 0 0 197.76 KB
#7459 ObjectExtractorSimpleBody net6.0 320ns 0.126ns 0.486ns 0 0 0 280 B
#7459 ObjectExtractorSimpleBody netcoreapp3.1 397ns 2.18ns 12.7ns 0 0 0 272 B
#7459 ObjectExtractorSimpleBody net472 299ns 0.0573ns 0.222ns 0.0436 0 0 281 B
#7459 ObjectExtractorMoreComplexBody net6.0 6.28μs 29ns 112ns 0 0 0 3.78 KB
#7459 ObjectExtractorMoreComplexBody netcoreapp3.1 7.82μs 4.18ns 15.6ns 0 0 0 3.69 KB
#7459 ObjectExtractorMoreComplexBody net472 6.72μs 1.72ns 6.65ns 0.572 0 0 3.8 KB
Benchmarks.Trace.Asm.AppSecEncoderBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master EncodeArgs net6.0 76.2μs 214ns 830ns 0 0 0 32.4 KB
master EncodeArgs netcoreapp3.1 96.3μs 248ns 959ns 0 0 0 32.4 KB
master EncodeArgs net472 111μs 42.6ns 165ns 5.03 0 0 32.51 KB
master EncodeLegacyArgs net6.0 142μs 21.2ns 82.1ns 0 0 0 2.14 KB
master EncodeLegacyArgs netcoreapp3.1 201μs 156ns 604ns 0 0 0 2.14 KB
master EncodeLegacyArgs net472 264μs 35.6ns 138ns 0 0 0 2.16 KB
#7459 EncodeArgs net6.0 76.9μs 283ns 1.06μs 0 0 0 32.4 KB
#7459 EncodeArgs netcoreapp3.1 97.2μs 306ns 1.18μs 0 0 0 32.4 KB
#7459 EncodeArgs net472 110μs 16.1ns 62.4ns 4.93 0 0 32.5 KB
#7459 EncodeLegacyArgs net6.0 147μs 121ns 469ns 0 0 0 2.15 KB
#7459 EncodeLegacyArgs netcoreapp3.1 200μs 538ns 2.08μs 0 0 0 2.14 KB
#7459 EncodeLegacyArgs net472 262μs 24.2ns 90.4ns 0 0 0 2.16 KB
Benchmarks.Trace.Asm.AppSecWafBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master RunWafRealisticBenchmark net6.0 400μs 56.1ns 202ns 0 0 0 4.56 KB
master RunWafRealisticBenchmark netcoreapp3.1 418μs 147ns 510ns 0 0 0 4.48 KB
master RunWafRealisticBenchmark net472 435μs 50.1ns 194ns 0 0 0 4.66 KB
master RunWafRealisticBenchmarkWithAttack net6.0 295μs 76.3ns 295ns 0 0 0 2.24 KB
master RunWafRealisticBenchmarkWithAttack netcoreapp3.1 719μs 5.11μs 50.8μs 0 0 0 2.22 KB
master RunWafRealisticBenchmarkWithAttack net472 315μs 40.3ns 151ns 0 0 0 2.29 KB
#7459 RunWafRealisticBenchmark net6.0 410μs 153ns 593ns 0 0 0 4.55 KB
#7459 RunWafRealisticBenchmark netcoreapp3.1 418μs 155ns 557ns 0 0 0 4.48 KB
#7459 RunWafRealisticBenchmark net472 433μs 60ns 233ns 0 0 0 4.66 KB
#7459 RunWafRealisticBenchmarkWithAttack net6.0 295μs 73.8ns 286ns 0 0 0 2.24 KB
#7459 RunWafRealisticBenchmarkWithAttack netcoreapp3.1 723μs 3.51μs 13.1μs 0 0 0 2.22 KB
#7459 RunWafRealisticBenchmarkWithAttack net472 312μs 68.1ns 264ns 0 0 0 2.29 KB
Benchmarks.Trace.AspNetCoreBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master SendRequest net6.0 60.6μs 48.5ns 188ns 0 0 0 14.52 KB
master SendRequest netcoreapp3.1 70.7μs 325ns 1.26μs 0 0 0 17.42 KB
master SendRequest net472 0.00161ns 0.00102ns 0.00395ns 0 0 0 0 b
#7459 SendRequest net6.0 61.7μs 59ns 221ns 0 0 0 14.52 KB
#7459 SendRequest netcoreapp3.1 71.3μs 349ns 2.1μs 0 0 0 17.42 KB
#7459 SendRequest net472 0.00339ns 0.0014ns 0.0054ns 0 0 0 0 b
Benchmarks.Trace.CharSliceBenchmark - Same speed ✔️ More allocations ⚠️

More allocations ⚠️ in #7459

Benchmark Base Allocated Diff Allocated Change Change %
Benchmarks.Trace.CharSliceBenchmark.OptimizedCharSliceWithPool‑net6.0 1 B 3 B 2 B 200.00%

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master OriginalCharSlice net6.0 1.88ms 1.07μs 4.13μs 0 0 0 640.01 KB
master OriginalCharSlice netcoreapp3.1 2.1ms 9.35μs 36.2μs 0 0 0 640 KB
master OriginalCharSlice net472 2.71ms 146ns 566ns 100 0 0 641.95 KB
master OptimizedCharSlice net6.0 1.51ms 179ns 692ns 0 0 0 4 B
master OptimizedCharSlice netcoreapp3.1 1.78ms 224ns 868ns 0 0 0 1 B
master OptimizedCharSlice net472 1.97ms 706ns 2.73μs 0 0 0 0 b
master OptimizedCharSliceWithPool net6.0 900μs 40ns 150ns 0 0 0 1 B
master OptimizedCharSliceWithPool netcoreapp3.1 811μs 60.4ns 234ns 0 0 0 0 b
master OptimizedCharSliceWithPool net472 1.14ms 110ns 425ns 0 0 0 0 b
#7459 OriginalCharSlice net6.0 1.93ms 2.64μs 9.87μs 0 0 0 640.01 KB
#7459 OriginalCharSlice netcoreapp3.1 2.11ms 7.07μs 27.4μs 0 0 0 640 KB
#7459 OriginalCharSlice net472 2.62ms 211ns 817ns 100 0 0 641.95 KB
#7459 OptimizedCharSlice net6.0 1.5ms 387ns 1.5μs 0 0 0 4 B
#7459 OptimizedCharSlice netcoreapp3.1 1.67ms 182ns 656ns 0 0 0 1 B
#7459 OptimizedCharSlice net472 1.95ms 1.08μs 4.17μs 0 0 0 0 b
#7459 OptimizedCharSliceWithPool net6.0 835μs 41.6ns 161ns 0 0 0 3 B
#7459 OptimizedCharSliceWithPool netcoreapp3.1 808μs 59.1ns 229ns 0 0 0 0 b
#7459 OptimizedCharSliceWithPool net472 1.18ms 33ns 114ns 0 0 0 0 b
Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark - Same speed ✔️ More allocations ⚠️

More allocations ⚠️ in #7459

Benchmark Base Allocated Diff Allocated Change Change %
Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark.WriteAndFlushEnrichedTraces‑net472 55.67 KB 56.05 KB 375 B 0.67%

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master WriteAndFlushEnrichedTraces net6.0 679μs 625ns 2.42μs 0 0 0 41.78 KB
master WriteAndFlushEnrichedTraces netcoreapp3.1 695μs 1.03μs 3.99μs 0 0 0 41.94 KB
master WriteAndFlushEnrichedTraces net472 886μs 2.99μs 11.6μs 8.33 0 0 55.67 KB
#7459 WriteAndFlushEnrichedTraces net6.0 655μs 1.46μs 5.05μs 0 0 0 41.78 KB
#7459 WriteAndFlushEnrichedTraces netcoreapp3.1 696μs 1.29μs 4.84μs 0 0 0 41.88 KB
#7459 WriteAndFlushEnrichedTraces net472 900μs 4.29μs 17.2μs 8.33 0 0 56.05 KB
Benchmarks.Trace.DbCommandBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master ExecuteNonQuery net6.0 1.86μs 8.51ns 30.7ns 0 0 0 1.02 KB
master ExecuteNonQuery netcoreapp3.1 2.56μs 2.89ns 11.2ns 0 0 0 1.02 KB
master ExecuteNonQuery net472 2.92μs 2.43ns 9.41ns 0.156 0.0142 0 987 B
#7459 ExecuteNonQuery net6.0 1.88μs 6.44ns 24.9ns 0 0 0 1.02 KB
#7459 ExecuteNonQuery netcoreapp3.1 2.57μs 6.68ns 25.9ns 0 0 0 1.02 KB
#7459 ExecuteNonQuery net472 2.74μs 2.92ns 11.3ns 0.151 0.0138 0 987 B
Benchmarks.Trace.ElasticsearchBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master CallElasticsearch net6.0 1.75μs 1.09ns 4.21ns 0 0 0 1.03 KB
master CallElasticsearch netcoreapp3.1 2.3μs 6.53ns 25.3ns 0 0 0 1.03 KB
master CallElasticsearch net472 3.55μs 2.03ns 7.86ns 0.161 0 0 1.04 KB
master CallElasticsearchAsync net6.0 1.89μs 7.62ns 29.5ns 0 0 0 1.01 KB
master CallElasticsearchAsync netcoreapp3.1 2.44μs 7.95ns 29.7ns 0 0 0 1.08 KB
master CallElasticsearchAsync net472 3.79μs 2.13ns 7.98ns 0.17 0 0 1.1 KB
#7459 CallElasticsearch net6.0 1.75μs 0.579ns 2.24ns 0 0 0 1.03 KB
#7459 CallElasticsearch netcoreapp3.1 2.23μs 10.1ns 39.2ns 0 0 0 1.03 KB
#7459 CallElasticsearch net472 3.59μs 1.38ns 5.35ns 0.16 0 0 1.04 KB
#7459 CallElasticsearchAsync net6.0 1.86μs 1.98ns 7.66ns 0 0 0 1.01 KB
#7459 CallElasticsearchAsync netcoreapp3.1 2.37μs 11.3ns 42.1ns 0 0 0 1.08 KB
#7459 CallElasticsearchAsync net472 3.79μs 4.2ns 16.3ns 0.169 0 0 1.1 KB
Benchmarks.Trace.GraphQLBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master ExecuteAsync net6.0 1.84μs 3.94ns 15.3ns 0 0 0 952 B
master ExecuteAsync netcoreapp3.1 2.19μs 9.56ns 37ns 0 0 0 952 B
master ExecuteAsync net472 2.62μs 2.37ns 9.18ns 0.143 0 0 915 B
#7459 ExecuteAsync net6.0 1.89μs 7.4ns 26.7ns 0 0 0 952 B
#7459 ExecuteAsync netcoreapp3.1 2.27μs 10.4ns 40.2ns 0 0 0 952 B
#7459 ExecuteAsync net472 2.58μs 4.32ns 16.7ns 0.142 0 0 915 B
Benchmarks.Trace.HttpClientBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master SendAsync net6.0 7.04μs 8.11ns 31.4ns 0 0 0 2.36 KB
master SendAsync netcoreapp3.1 8.45μs 9.47ns 36.7ns 0 0 0 2.9 KB
master SendAsync net472 12.5μs 9.23ns 35.7ns 0.5 0 0 3.18 KB
#7459 SendAsync net6.0 6.9μs 8.21ns 30.7ns 0 0 0 2.36 KB
#7459 SendAsync netcoreapp3.1 8.43μs 11.3ns 43.6ns 0 0 0 2.9 KB
#7459 SendAsync net472 12.2μs 16.8ns 64.9ns 0.484 0 0 3.18 KB
Benchmarks.Trace.Iast.StringAspectsBenchmark - Same speed ✔️ More allocations ⚠️

More allocations ⚠️ in #7459

Benchmark Base Allocated Diff Allocated Change Change %
Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatAspectBenchmark‑net472 278.53 KB 303.1 KB 24.58 KB 8.82%
Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatAspectBenchmark‑net6.0 260.42 KB 279.65 KB 19.23 KB 7.39%
Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatBenchmark‑net6.0 43.54 KB 44.07 KB 536 B 1.23%

Fewer allocations 🎉 in #7459

Benchmark Base Allocated Diff Allocated Change Change %
Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatBenchmark‑netcoreapp3.1 45.5 KB 42.78 KB -2.72 KB -5.98%

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master StringConcatBenchmark net6.0 44.3μs 245ns 1.39μs 0 0 0 43.54 KB
master StringConcatBenchmark netcoreapp3.1 53.7μs 677ns 6.63μs 0 0 0 45.5 KB
master StringConcatBenchmark net472 57.2μs 220ns 823ns 0 0 0 65.54 KB
master StringConcatAspectBenchmark net6.0 482μs 1.62μs 5.83μs 0 0 0 260.42 KB
master StringConcatAspectBenchmark netcoreapp3.1 511μs 2.63μs 12.3μs 0 0 0 258.48 KB
master StringConcatAspectBenchmark net472 407μs 2.32μs 15.7μs 0 0 0 278.53 KB
#7459 StringConcatBenchmark net6.0 43.9μs 233ns 1.12μs 0 0 0 44.07 KB
#7459 StringConcatBenchmark netcoreapp3.1 48μs 276ns 2.56μs 0 0 0 42.78 KB
#7459 StringConcatBenchmark net472 57.3μs 178ns 642ns 0 0 0 65.54 KB
#7459 StringConcatAspectBenchmark net6.0 520μs 2.41μs 11.6μs 0 0 0 279.65 KB
#7459 StringConcatAspectBenchmark netcoreapp3.1 505μs 2.01μs 6.97μs 0 0 0 259.19 KB
#7459 StringConcatAspectBenchmark net472 404μs 2.22μs 13.1μs 0 0 0 303.1 KB
Benchmarks.Trace.ILoggerBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master EnrichedLog net6.0 2.51μs 11ns 42.8ns 0 0 0 1.7 KB
master EnrichedLog netcoreapp3.1 3.5μs 16.9ns 71.7ns 0 0 0 1.7 KB
master EnrichedLog net472 4.01μs 4.36ns 16.9ns 0.241 0 0 1.64 KB
#7459 EnrichedLog net6.0 2.51μs 13.1ns 61.5ns 0 0 0 1.7 KB
#7459 EnrichedLog netcoreapp3.1 3.46μs 13.1ns 50.6ns 0 0 0 1.7 KB
#7459 EnrichedLog net472 3.97μs 2.21ns 8.54ns 0.258 0 0 1.64 KB
Benchmarks.Trace.Log4netBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master EnrichedLog net6.0 124μs 48ns 180ns 0 0 0 4.31 KB
master EnrichedLog netcoreapp3.1 128μs 223ns 804ns 0 0 0 4.31 KB
master EnrichedLog net472 167μs 93.4ns 362ns 0 0 0 4.52 KB
#7459 EnrichedLog net6.0 123μs 91.2ns 353ns 0 0 0 4.31 KB
#7459 EnrichedLog netcoreapp3.1 128μs 215ns 831ns 0 0 0 4.31 KB
#7459 EnrichedLog net472 167μs 49.7ns 193ns 0 0 0 4.52 KB
Benchmarks.Trace.NLogBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master EnrichedLog net6.0 4.9μs 15ns 58.2ns 0 0 0 2.26 KB
master EnrichedLog netcoreapp3.1 6.81μs 8.99ns 33.6ns 0 0 0 2.26 KB
master EnrichedLog net472 7.35μs 3.51ns 13.6ns 0.294 0 0 2.08 KB
#7459 EnrichedLog net6.0 4.87μs 16.1ns 60.1ns 0 0 0 2.26 KB
#7459 EnrichedLog netcoreapp3.1 6.65μs 6.36ns 24.6ns 0 0 0 2.26 KB
#7459 EnrichedLog net472 7.45μs 3.62ns 14ns 0.299 0 0 2.08 KB
Benchmarks.Trace.RedisBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master SendReceive net6.0 1.98μs 10.6ns 52.8ns 0 0 0 1.2 KB
master SendReceive netcoreapp3.1 2.63μs 2.39ns 8.94ns 0 0 0 1.2 KB
master SendReceive net472 3.16μs 4.68ns 18.1ns 0.189 0 0 1.2 KB
#7459 SendReceive net6.0 1.99μs 2.52ns 9.45ns 0 0 0 1.2 KB
#7459 SendReceive netcoreapp3.1 2.63μs 5.08ns 19.7ns 0 0 0 1.2 KB
#7459 SendReceive net472 3.13μs 1.46ns 5.05ns 0.188 0 0 1.2 KB
Benchmarks.Trace.SerilogBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master EnrichedLog net6.0 4.14μs 1.59ns 6.14ns 0 0 0 1.58 KB
master EnrichedLog netcoreapp3.1 5.57μs 17.2ns 66.8ns 0 0 0 1.63 KB
master EnrichedLog net472 6.71μs 8.5ns 31.8ns 0.301 0 0 2.03 KB
#7459 EnrichedLog net6.0 4.25μs 14.8ns 57.2ns 0 0 0 1.58 KB
#7459 EnrichedLog netcoreapp3.1 5.54μs 15.1ns 58.5ns 0 0 0 1.63 KB
#7459 EnrichedLog net472 6.59μs 9.01ns 34.9ns 0.296 0 0 2.03 KB
Benchmarks.Trace.SpanBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master StartFinishSpan net6.0 734ns 4.06ns 19.9ns 0 0 0 576 B
master StartFinishSpan netcoreapp3.1 918ns 4.9ns 26.8ns 0 0 0 576 B
master StartFinishSpan net472 899ns 0.452ns 1.75ns 0.0897 0 0 578 B
master StartFinishScope net6.0 887ns 4.45ns 17.8ns 0 0 0 696 B
master StartFinishScope netcoreapp3.1 1.1μs 5.87ns 28.7ns 0 0 0 696 B
master StartFinishScope net472 1.11μs 0.668ns 2.59ns 0.0993 0 0 658 B
#7459 StartFinishSpan net6.0 758ns 3.67ns 15.1ns 0 0 0 576 B
#7459 StartFinishSpan netcoreapp3.1 942ns 4.81ns 21.5ns 0 0 0 576 B
#7459 StartFinishSpan net472 901ns 0.0662ns 0.239ns 0.0908 0 0 578 B
#7459 StartFinishScope net6.0 880ns 4.6ns 21.6ns 0 0 0 696 B
#7459 StartFinishScope netcoreapp3.1 1.1μs 5.6ns 25ns 0 0 0 696 B
#7459 StartFinishScope net472 1.1μs 0.0888ns 0.344ns 0.0997 0 0 658 B
Benchmarks.Trace.TraceAnnotationsBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch Method Toolchain Mean StdError StdDev Gen 0 Gen 1 Gen 2 Allocated
master RunOnMethodBegin net6.0 1.07μs 4.03ns 15.1ns 0 0 0 696 B
master RunOnMethodBegin netcoreapp3.1 1.39μs 5.28ns 20.5ns 0 0 0 696 B
master RunOnMethodBegin net472 1.36μs 0.801ns 3.1ns 0.102 0 0 658 B
#7459 RunOnMethodBegin net6.0 1.02μs 3.78ns 14.6ns 0 0 0 696 B
#7459 RunOnMethodBegin netcoreapp3.1 1.36μs 6.41ns 26.4ns 0 0 0 696 B
#7459 RunOnMethodBegin net472 1.41μs 1.79ns 6.93ns 0.0983 0 0 658 B

@dd-trace-dotnet-ci-bot
Copy link

Execution-Time Benchmarks Report ⏱️

Execution-time results for samples comparing the following branches/commits:

Execution-time benchmarks measure the whole time it takes to execute a program. And are intended to measure the one-off costs. Cases where the execution time results for the PR are worse than latest master results are shown in red. The following thresholds were used for comparing the execution times:

  • Welch test with statistical test for significance of 5%
  • Only results indicating a difference greater than 5% and 5 ms are considered.

Note that these results are based on a single point-in-time result for each branch. For full results, see the dashboard.

Graphs show the p99 interval based on the mean and StdDev of the test run, as well as the mean value of the run (shown as a diamond below the graph).

gantt
    title Execution time (ms) FakeDbCommand (.NET Framework 4.8) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Bailout
    This PR (7459) - mean (75ms)  : 73, 77
     .   : milestone, 75,
    master - mean (73ms)  : 72, 75
     .   : milestone, 73,

    section Baseline
    This PR (7459) - mean (72ms)  : 66, 78
     .   : milestone, 72,
    master - mean (70ms)  : 65, 76
     .   : milestone, 70,

    section CallTarget+Inlining+NGEN
    This PR (7459) - mean (1,006ms)  : 977, 1035
     .   : milestone, 1006,
    master - mean (999ms)  : 973, 1024
     .   : milestone, 999,
Loading 
gantt
    title Execution time (ms) FakeDbCommand (.NET Core 3.1) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Bailout
    This PR (7459) - mean (110ms)  : 107, 112
     .   : milestone, 110,
    master - mean (110ms)  : 108, 111
     .   : milestone, 110,

    section Baseline
    This PR (7459) - mean (109ms)  : 107, 111
     .   : milestone, 109,
    master - mean (109ms)  : 105, 112
     .   : milestone, 109,

    section CallTarget+Inlining+NGEN
    This PR (7459) - mean (709ms)  : 687, 730
     .   : milestone, 709,
    master - mean (707ms)  : 686, 728
     .   : milestone, 707,
Loading 
gantt
    title Execution time (ms) FakeDbCommand (.NET 6) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Bailout
    This PR (7459) - mean (97ms)  : 95, 98
     .   : milestone, 97,
    master - mean (96ms)  : 95, 98
     .   : milestone, 96,

    section Baseline
    This PR (7459) - mean (96ms)  : 94, 98
     .   : milestone, 96,
    master - mean (95ms)  : 93, 98
     .   : milestone, 95,

    section CallTarget+Inlining+NGEN
    This PR (7459) - mean (661ms)  : 639, 684
     .   : milestone, 661,
    master - mean (659ms)  : 641, 677
     .   : milestone, 659,
Loading 
gantt
    title Execution time (ms) FakeDbCommand (.NET 8) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Bailout
    This PR (7459) - mean (96ms)  : 94, 97
     .   : milestone, 96,
    master - mean (96ms)  : 94, 98
     .   : milestone, 96,

    section Baseline
    This PR (7459) - mean (95ms)  : 92, 97
     .   : milestone, 95,
    master - mean (95ms)  : 92, 98
     .   : milestone, 95,

    section CallTarget+Inlining+NGEN
    This PR (7459) - mean (594ms)  : 582, 606
     .   : milestone, 594,
    master - mean (603ms)  : 589, 616
     .   : milestone, 603,
Loading 
gantt
    title Execution time (ms) HttpMessageHandler (.NET Framework 4.8) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Bailout
    This PR (7459) - mean (196ms)  : 192, 200
     .   : milestone, 196,
    master - mean (194ms)  : 192, 196
     .   : milestone, 194,

    section Baseline
    This PR (7459) - mean (192ms)  : 187, 197
     .   : milestone, 192,
    master - mean (190ms)  : 186, 194
     .   : milestone, 190,

    section CallTarget+Inlining+NGEN
    This PR (7459) - mean (1,107ms)  : 1075, 1140
     .   : milestone, 1107,
    master - mean (1,104ms)  : 1074, 1134
     .   : milestone, 1104,
Loading 
gantt
    title Execution time (ms) HttpMessageHandler (.NET Core 3.1) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Bailout
    This PR (7459) - mean (278ms)  : 273, 284
     .   : milestone, 278,
    master - mean (276ms)  : 272, 279
     .   : milestone, 276,

    section Baseline
    This PR (7459) - mean (279ms)  : 274, 285
     .   : milestone, 279,
    master - mean (275ms)  : 269, 280
     .   : milestone, 275,

    section CallTarget+Inlining+NGEN
    This PR (7459) - mean (902ms)  : 864, 940
     .   : milestone, 902,
    master - mean (892ms)  : 849, 935
     .   : milestone, 892,
Loading 
gantt
    title Execution time (ms) HttpMessageHandler (.NET 6) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Bailout
    This PR (7459) - mean (276ms)  : 270, 283
     .   : milestone, 276,
    master - mean (267ms)  : 263, 271
     .   : milestone, 267,

    section Baseline
    This PR (7459) - mean (274ms)  : 260, 288
     .   : milestone, 274,
    master - mean (266ms)  : 261, 270
     .   : milestone, 266,

    section CallTarget+Inlining+NGEN
    This PR (7459) - mean (881ms)  : 848, 914
     .   : milestone, 881,
    master - mean (876ms)  : 837, 916
     .   : milestone, 876,
Loading 
gantt
    title Execution time (ms) HttpMessageHandler (.NET 8) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Bailout
    This PR (7459) - mean (272ms)  : 264, 279
     .   : milestone, 272,
    master - mean (268ms)  : 263, 272
     .   : milestone, 268,

    section Baseline
    This PR (7459) - mean (271ms)  : 263, 278
     .   : milestone, 271,
    master - mean (267ms)  : 263, 271
     .   : milestone, 267,

    section CallTarget+Inlining+NGEN
    This PR (7459) - mean (800ms)  : 775, 826
     .   : milestone, 800,
    master - mean (787ms)  : 765, 809
     .   : milestone, 787,
Loading

@andrewlock andrewlock merged commit 30ec6f9 into master Sep 3, 2025
149 of 151 checks passed
@andrewlock andrewlock deleted the andrew/ci/split-dependabot branch September 3, 2025 17:02
@github-actions github-actions bot added this to the vNext-v3 milestone Sep 3, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@bouwkast bouwkast bouwkast approved these changes

@NachoEchevarria NachoEchevarria NachoEchevarria approved these changes

Assignees
No one assigned
Labels
area:builds project files, build scripts, pipelines, versioning, releases, packages area:dependabot dependabot updates
Projects
None yet
Milestone
3.26.0
Development

Successfully merging this pull request may close these issues.
3 participants
@andrewlock @bouwkast @NachoEchevarria