Skip to content

Conversation

ganeshnj
Copy link
Contributor

Conflicts:

LICENSE-3rdparty.yml# What does this PR do?

A brief description of the change being made with this pull request.

Motivation

What inspired you to submit this pull request?

Additional Notes

Anything else we should know when reviewing?

How to test the change?

Describe here in detail how the change can be validated.

@ganeshnj ganeshnj changed the title fix(tests): remove unnecessary Some wrapper in telemetry config [TEST] v20 with telemetry logging Sep 25, 2025
@pr-commenter
Copy link

pr-commenter bot commented Sep 25, 2025

Benchmarks

Comparison

Benchmark execution time: 2025-09-26 09:21:38

Comparing candidate commit faa7206 in PR branch ganeshnj/chore/v20-tele-logging with baseline commit 8719ad8 in branch main.

Found 14 performance improvements and 4 performance regressions! Performance is the same for 35 metrics, 2 unstable metrics.

scenario:benching deserializing traces from msgpack to their internal representation

  • 🟩 execution_time [-3.576ms; -2.728ms] or [-5.694%; -4.345%]

scenario:concentrator/add_spans_to_concentrator

  • 🟩 execution_time [-2.175ms; -2.170ms] or [-20.689%; -20.643%]

scenario:credit_card/is_card_number/37828224631000521389798

  • 🟩 execution_time [-6.474µs; -6.448µs] or [-12.402%; -12.352%]
  • 🟩 throughput [+2700029.806op/s; +2711964.085op/s] or [+14.095%; +14.157%]

scenario:credit_card/is_card_number/x371413321323331

  • 🟥 execution_time [+584.090ns; +589.855ns] or [+9.675%; +9.770%]
  • 🟥 throughput [-14748361.986op/s; -14604694.604op/s] or [-8.904%; -8.817%]

scenario:credit_card/is_card_number_no_luhn/ 378282246310005

  • 🟩 execution_time [-4.683µs; -4.625µs] or [-8.065%; -7.965%]
  • 🟩 throughput [+1491652.282op/s; +1508870.230op/s] or [+8.662%; +8.762%]

scenario:credit_card/is_card_number_no_luhn/378282246310005

  • 🟩 execution_time [-4.696µs; -4.637µs] or [-8.560%; -8.452%]
  • 🟩 throughput [+1684430.733op/s; +1704216.479op/s] or [+9.241%; +9.349%]

scenario:credit_card/is_card_number_no_luhn/37828224631000521389798

  • 🟩 execution_time [-6.520µs; -6.494µs] or [-12.484%; -12.435%]
  • 🟩 throughput [+2719587.773op/s; +2731202.531op/s] or [+14.203%; +14.263%]

scenario:credit_card/is_card_number_no_luhn/x371413321323331

  • 🟥 execution_time [+579.391ns; +585.017ns] or [+9.597%; +9.691%]
  • 🟥 throughput [-14638507.317op/s; -14500642.852op/s] or [-8.837%; -8.754%]

scenario:normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...

  • 🟩 execution_time [-39.583µs; -39.271µs] or [-7.400%; -7.342%]
  • 🟩 throughput [+148149.241op/s; +149389.177op/s] or [+7.925%; +7.991%]

scenario:normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters

  • 🟩 execution_time [-26.518µs; -26.412µs] or [-13.665%; -13.610%]
  • 🟩 throughput [+812223.415op/s; +815288.660op/s] or [+15.762%; +15.821%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz faa7206 1758877761 ganeshnj/chore/v20-tele-logging
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.217µs 3.231µs ± 1.495µs 2.987µs ± 0.040µs 3.030µs 3.650µs 14.286µs 16.017µs 436.17% 7.375 55.861 46.15% 0.106µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.024µs; 3.439µs] or [-6.412%; +6.412%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz faa7206 1758877761 ganeshnj/chore/v20-tele-logging
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 33.964µs 34.460µs ± 0.753µs 34.128µs ± 0.062µs 34.199µs 36.046µs 36.089µs 37.628µs 10.25% 1.805 1.786 2.18% 0.053µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [34.356µs; 34.564µs] or [-0.303%; +0.303%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz faa7206 1758877761 ganeshnj/chore/v20-tele-logging
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 8.324ms 8.339ms ± 0.009ms 8.338ms ± 0.006ms 8.345ms 8.354ms 8.370ms 8.385ms 0.56% 1.215 3.287 0.11% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [8.338ms; 8.341ms] or [-0.015%; +0.015%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz faa7206 1758877761 ganeshnj/chore/v20-tele-logging
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 88.443µs 89.069µs ± 0.237µs 89.076µs ± 0.088µs 89.143µs 89.270µs 89.384µs 91.792µs 3.05% 7.454 84.872 0.27% 0.017µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [89.036µs; 89.102µs] or [-0.037%; +0.037%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz faa7206 1758877761 ganeshnj/chore/v20-tele-logging
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 185.354µs 185.945µs ± 0.283µs 185.945µs ± 0.194µs 186.123µs 186.381µs 186.743µs 186.925µs 0.53% 0.411 0.110 0.15% 0.020µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 5349746.355op/s 5377951.055op/s ± 8174.252op/s 5377935.423op/s ± 5616.400op/s 5383931.703op/s 5389931.350op/s 5394335.071op/s 5395078.205op/s 0.32% -0.402 0.094 0.15% 578.007op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 17.787µs 17.850µs ± 0.034µs 17.845µs ± 0.020µs 17.868µs 17.912µs 17.943µs 17.988µs 0.80% 1.019 1.588 0.19% 0.002µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 55592799.097op/s 56023520.212op/s ± 106646.382op/s 56039201.148op/s ± 62309.587op/s 56096922.283op/s 56163944.548op/s 56212340.336op/s 56220437.026op/s 0.32% -1.004 1.540 0.19% 7541.038op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.228µs 10.387µs ± 0.054µs 10.385µs ± 0.033µs 10.426µs 10.477µs 10.518µs 10.555µs 1.64% 0.102 0.193 0.52% 0.004µs 1 200
normalization/normalize_name/normalize_name/good throughput 94741965.556op/s 96275102.237op/s ± 502871.572op/s 96292517.601op/s ± 308918.792op/s 96572149.594op/s 97089558.946op/s 97519379.446op/s 97771992.728op/s 1.54% -0.068 0.185 0.52% 35558.390op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [185.906µs; 185.984µs] or [-0.021%; +0.021%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [5376818.182op/s; 5379083.927op/s] or [-0.021%; +0.021%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [17.845µs; 17.854µs] or [-0.026%; +0.026%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [56008740.050op/s; 56038300.375op/s] or [-0.026%; +0.026%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.380µs; 10.395µs] or [-0.072%; +0.072%] None None None
normalization/normalize_name/normalize_name/good throughput [96205409.073op/s; 96344795.400op/s] or [-0.072%; +0.072%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz faa7206 1758877761 ganeshnj/chore/v20-tele-logging
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.895µs 3.914µs ± 0.002µs 3.913µs ± 0.001µs 3.915µs 3.917µs 3.919µs 3.919µs 0.15% -1.975 16.607 0.06% 0.000µs 1 200
credit_card/is_card_number/ throughput 255139717.205op/s 255520885.577op/s ± 154171.214op/s 255529628.661op/s ± 96015.857op/s 255614054.991op/s 255702797.890op/s 255735577.732op/s 256720526.399op/s 0.47% 2.002 16.849 0.06% 10901.551op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 77.868µs 78.691µs ± 0.493µs 78.634µs ± 0.380µs 79.064µs 79.572µs 79.752µs 79.947µs 1.67% 0.312 -0.717 0.62% 0.035µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 12508243.280op/s 12708399.152op/s ± 79473.691op/s 12717110.601op/s ± 61707.231op/s 12765301.749op/s 12830843.687op/s 12840537.958op/s 12842220.983op/s 0.98% -0.290 -0.735 0.62% 5619.639op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 71.668µs 71.989µs ± 0.210µs 71.946µs ± 0.103µs 72.074µs 72.348µs 72.785µs 73.147µs 1.67% 2.177 7.554 0.29% 0.015µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 13671097.971op/s 13891069.589op/s ± 40297.405op/s 13899291.841op/s ± 19954.248op/s 13915522.069op/s 13935647.318op/s 13946968.011op/s 13953202.165op/s 0.39% -2.136 7.300 0.29% 2849.457op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.896µs 3.914µs ± 0.003µs 3.913µs ± 0.001µs 3.915µs 3.919µs 3.921µs 3.922µs 0.22% -0.589 9.853 0.07% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 254969714.865op/s 255507013.930op/s ± 173323.524op/s 255532450.001op/s ± 83077.142op/s 255608134.730op/s 255695337.285op/s 255750299.336op/s 256665959.396op/s 0.44% 0.613 9.994 0.07% 12255.824op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 68.209µs 68.464µs ± 0.222µs 68.384µs ± 0.120µs 68.570µs 68.908µs 69.205µs 69.379µs 1.46% 1.494 2.302 0.32% 0.016µs 1 200
credit_card/is_card_number/378282246310005 throughput 14413508.458op/s 14606422.498op/s ± 47061.742op/s 14623351.703op/s ± 25765.322op/s 14641129.849op/s 14652277.825op/s 14656594.747op/s 14660851.129op/s 0.26% -1.474 2.216 0.32% 3327.768op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 45.502µs 45.740µs ± 0.085µs 45.749µs ± 0.058µs 45.803µs 45.860µs 45.918µs 45.956µs 0.45% -0.361 -0.060 0.19% 0.006µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 21759955.105op/s 21862548.913op/s ± 40884.632op/s 21858436.197op/s ± 27869.628op/s 21888547.918op/s 21934389.524op/s 21969161.295op/s 21977058.159op/s 0.54% 0.371 -0.052 0.19% 2890.980op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.567µs 6.624µs ± 0.015µs 6.630µs ± 0.009µs 6.635µs 6.641µs 6.645µs 6.646µs 0.24% -1.164 1.112 0.23% 0.001µs 1 200
credit_card/is_card_number/x371413321323331 throughput 150466386.128op/s 150958214.094op/s ± 351254.058op/s 150833096.154op/s ± 196624.826op/s 151151119.926op/s 151648101.406op/s 152052494.204op/s 152278817.785op/s 0.96% 1.177 1.155 0.23% 24837.413op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.897µs 3.915µs ± 0.003µs 3.914µs ± 0.002µs 3.916µs 3.920µs 3.923µs 3.924µs 0.24% -0.378 6.166 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 254860071.846op/s 255445465.455op/s ± 191557.300op/s 255469049.925op/s ± 110179.637op/s 255561679.814op/s 255672635.344op/s 255751018.611op/s 256599090.886op/s 0.44% 0.396 6.257 0.07% 13545.147op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 65.270µs 65.668µs ± 0.100µs 65.687µs ± 0.053µs 65.728µs 65.808µs 65.847µs 65.863µs 0.27% -0.968 1.504 0.15% 0.007µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15183142.940op/s 15228178.077op/s ± 23284.525op/s 15223688.976op/s ± 12365.216op/s 15240020.249op/s 15270805.886op/s 15304612.592op/s 15321058.795op/s 0.64% 0.980 1.540 0.15% 1646.465op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 53.356µs 53.414µs ± 0.033µs 53.412µs ± 0.022µs 53.434µs 53.479µs 53.513µs 53.528µs 0.22% 0.759 0.651 0.06% 0.002µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 18681828.096op/s 18721522.173op/s ± 11682.551op/s 18722294.987op/s ± 7841.184op/s 18730684.295op/s 18737396.205op/s 18740564.524op/s 18741920.662op/s 0.10% -0.755 0.641 0.06% 826.081op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.899µs 3.915µs ± 0.003µs 3.915µs ± 0.002µs 3.917µs 3.919µs 3.922µs 3.922µs 0.19% -0.671 5.173 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 254959740.310op/s 255425693.252op/s ± 177541.105op/s 255433829.950op/s ± 118856.707op/s 255556810.283op/s 255665056.085op/s 255713286.362op/s 256480808.259op/s 0.41% 0.685 5.252 0.07% 12554.052op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 50.136µs 50.195µs ± 0.032µs 50.187µs ± 0.018µs 50.215µs 50.254µs 50.286µs 50.330µs 0.28% 1.052 1.337 0.06% 0.002µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 19868839.828op/s 19922301.104op/s ± 12790.887op/s 19925395.335op/s ± 7344.624op/s 19930827.075op/s 19937461.666op/s 19943532.739op/s 19945564.565op/s 0.10% -1.048 1.322 0.06% 904.452op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 45.530µs 45.717µs ± 0.080µs 45.724µs ± 0.058µs 45.776µs 45.839µs 45.885µs 45.905µs 0.40% -0.117 -0.607 0.17% 0.006µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 21784307.898op/s 21873827.050op/s ± 38275.685op/s 21870556.763op/s ± 27936.235op/s 21900960.385op/s 21937649.335op/s 21955943.877op/s 21963542.725op/s 0.43% 0.125 -0.606 0.17% 2706.500op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.571µs 6.619µs ± 0.016µs 6.623µs ± 0.011µs 6.633µs 6.638µs 6.642µs 6.643µs 0.31% -0.827 0.015 0.25% 0.001µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 150524677.491op/s 151077481.660op/s ± 373129.325op/s 150988872.338op/s ± 242792.391op/s 151289216.883op/s 151734964.337op/s 152123585.557op/s 152187205.753op/s 0.79% 0.837 0.039 0.25% 26384.228op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.913µs; 3.914µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/ throughput [255499518.930op/s; 255542252.225op/s] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [78.623µs; 78.760µs] or [-0.087%; +0.087%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12697384.863op/s; 12719413.441op/s] or [-0.087%; +0.087%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [71.960µs; 72.018µs] or [-0.040%; +0.040%] None None None
credit_card/is_card_number/ 378282246310005 throughput [13885484.757op/s; 13896654.422op/s] or [-0.040%; +0.040%] None None None
credit_card/is_card_number/37828224631 execution_time [3.913µs; 3.914µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/37828224631 throughput [255482992.957op/s; 255531034.904op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/378282246310005 execution_time [68.433µs; 68.494µs] or [-0.045%; +0.045%] None None None
credit_card/is_card_number/378282246310005 throughput [14599900.193op/s; 14612944.803op/s] or [-0.045%; +0.045%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [45.729µs; 45.752µs] or [-0.026%; +0.026%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [21856882.697op/s; 21868215.130op/s] or [-0.026%; +0.026%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.622µs; 6.627µs] or [-0.032%; +0.032%] None None None
credit_card/is_card_number/x371413321323331 throughput [150909533.660op/s; 151006894.529op/s] or [-0.032%; +0.032%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.914µs; 3.915µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ throughput [255418917.456op/s; 255472013.455op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [65.654µs; 65.682µs] or [-0.021%; +0.021%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15224951.065op/s; 15231405.088op/s] or [-0.021%; +0.021%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [53.410µs; 53.419µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [18719903.084op/s; 18723141.263op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.915µs; 3.915µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255401087.762op/s; 255450298.741op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [50.191µs; 50.199µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [19920528.410op/s; 19924073.798op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [45.706µs; 45.728µs] or [-0.024%; +0.024%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [21868522.408op/s; 21879131.692op/s] or [-0.024%; +0.024%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.617µs; 6.621µs] or [-0.034%; +0.034%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [151025769.524op/s; 151129193.796op/s] or [-0.034%; +0.034%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz faa7206 1758877761 ganeshnj/chore/v20-tele-logging
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 155.268µs 156.043µs ± 0.252µs 156.042µs ± 0.151µs 156.190µs 156.436µs 156.788µs 156.948µs 0.58% 0.164 1.271 0.16% 0.018µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [156.008µs; 156.078µs] or [-0.022%; +0.022%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz faa7206 1758877761 ganeshnj/chore/v20-tele-logging
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 59.216ms 59.646ms ± 2.140ms 59.336ms ± 0.061ms 59.433ms 59.723ms 71.608ms 79.360ms 33.75% 8.299 69.209 3.58% 0.151ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [59.349ms; 59.942ms] or [-0.497%; +0.497%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz faa7206 1758877761 ganeshnj/chore/v20-tele-logging
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.303µs 2.371µs ± 0.018µs 2.373µs ± 0.004µs 2.377µs 2.399µs 2.403µs 2.405µs 1.35% -1.969 5.337 0.74% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.368µs; 2.373µs] or [-0.103%; +0.103%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz faa7206 1758877761 ganeshnj/chore/v20-tele-logging
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 4.970µs 5.043µs ± 0.034µs 5.046µs ± 0.032µs 5.072µs 5.092µs 5.096µs 5.101µs 1.10% 0.077 -1.272 0.67% 0.002µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.038µs; 5.047µs] or [-0.093%; +0.093%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz faa7206 1758877761 ganeshnj/chore/v20-tele-logging
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.827µs 26.182µs ± 10.096µs 18.231µs ± 0.192µs 35.331µs 46.450µs 57.131µs 60.130µs 229.82% 0.908 0.002 38.46% 0.714µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [24.783µs; 27.581µs] or [-5.344%; +5.344%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz faa7206 1758877761 ganeshnj/chore/v20-tele-logging
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 242.100ns 252.437ns ± 13.334ns 247.847ns ± 3.683ns 252.067ns 290.712ns 297.627ns 302.767ns 22.16% 2.213 4.192 5.27% 0.943ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [250.589ns; 254.285ns] or [-0.732%; +0.732%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz faa7206 1758877761 ganeshnj/chore/v20-tele-logging
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching serializing traces from their internal representation to msgpack execution_time 14.496ms 14.554ms ± 0.036ms 14.549ms ± 0.016ms 14.565ms 14.613ms 14.738ms 14.741ms 1.32% 2.406 9.152 0.25% 0.003ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching serializing traces from their internal representation to msgpack execution_time [14.549ms; 14.559ms] or [-0.035%; +0.035%] None None None

Group 14

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz faa7206 1758877761 ganeshnj/chore/v20-tele-logging
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 494.398µs 495.480µs ± 1.058µs 495.256µs ± 0.285µs 495.528µs 498.220µs 499.321µs 502.849µs 1.53% 3.559 15.401 0.21% 0.075µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1988669.226op/s 2018253.960op/s ± 4276.625op/s 2019157.882op/s ± 1160.368op/s 2020332.401op/s 2021450.805op/s 2022097.893op/s 2022661.904op/s 0.17% -3.530 15.102 0.21% 302.403op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 370.519µs 371.326µs ± 0.374µs 371.313µs ± 0.253µs 371.582µs 371.884µs 372.096µs 373.756µs 0.66% 1.362 7.587 0.10% 0.026µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2675543.889op/s 2693051.367op/s ± 2705.740op/s 2693144.098op/s ± 1834.396op/s 2694877.898op/s 2696924.013op/s 2697921.087op/s 2698918.825op/s 0.21% -1.338 7.416 0.10% 191.325op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 166.632µs 167.590µs ± 0.187µs 167.571µs ± 0.098µs 167.672µs 167.919µs 168.076µs 168.190µs 0.37% -0.170 3.613 0.11% 0.013µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5945664.097op/s 5966941.810op/s ± 6676.500op/s 5967603.960op/s ± 3500.383op/s 5971076.315op/s 5974076.426op/s 5984007.160op/s 6001231.509op/s 0.56% 0.188 3.674 0.11% 472.100op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 36.333µs 36.600µs ± 0.093µs 36.599µs ± 0.053µs 36.647µs 36.749µs 36.845µs 36.873µs 0.75% 0.096 0.539 0.25% 0.007µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 27120333.076op/s 27322805.322op/s ± 69768.200op/s 27323148.753op/s ± 39341.086op/s 27364345.048op/s 27438761.733op/s 27489941.223op/s 27523531.820op/s 0.73% -0.076 0.535 0.25% 4933.357op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 45.484µs 45.607µs ± 0.126µs 45.596µs ± 0.029µs 45.626µs 45.677µs 45.765µs 47.243µs 3.61% 11.123 142.286 0.27% 0.009µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 21167340.114op/s 21926588.070op/s ± 58607.900op/s 21931740.645op/s ± 13888.519op/s 21945061.600op/s 21963628.454op/s 21979908.676op/s 21985981.927op/s 0.25% -10.953 139.331 0.27% 4144.204op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [495.333µs; 495.627µs] or [-0.030%; +0.030%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [2017661.261op/s; 2018846.659op/s] or [-0.029%; +0.029%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [371.275µs; 371.378µs] or [-0.014%; +0.014%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2692676.377op/s; 2693426.356op/s] or [-0.014%; +0.014%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [167.564µs; 167.616µs] or [-0.016%; +0.016%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5966016.512op/s; 5967867.109op/s] or [-0.016%; +0.016%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [36.587µs; 36.613µs] or [-0.035%; +0.035%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [27313136.120op/s; 27332474.523op/s] or [-0.035%; +0.035%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [45.590µs; 45.624µs] or [-0.038%; +0.038%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [21918465.579op/s; 21934710.561op/s] or [-0.037%; +0.037%] None None None

Baseline

Omitted due to size.

# Conflicts:
#	data-pipeline/Cargo.toml
#	data-pipeline/examples/send-traces-with-stats.rs
#	examples/ffi/README.md
@ganeshnj ganeshnj force-pushed the ganeshnj/chore/v20-tele-logging branch from a9ebc53 to 69d9f02 Compare September 26, 2025 07:55
@datadog-datadog-prod-us1
Copy link

datadog-datadog-prod-us1 bot commented Sep 26, 2025

⚠️ Tests

⚠️ Warnings

🧪 3 Tests failed

test_ddog_sidecar_register_app from datadog-sidecar-ffi::sidecar (Datadog) (✨ Fix with BitsAI)
thread 'test_ddog_sidecar_register_app' panicked at D:\a\libdatadog\libdatadog\ddcommon-ffi\src\option.rs:34:32

thread 'test_ddog_sidecar_register_app' panicked at D:\a\libdatadog\libdatadog\ddcommon-ffi\src\option.rs:34:32:
Called ffi::Option::unwrap_none but option was Some(_)
stack backtrace:
   0:     0x7ff6edb243e2 - std::backtrace_rs::backtrace::win64::trace
                               at /rustc/29483883eed69d5fb4db01964cdf2af4d86e9cb2/library\std\src\..\..\backtrace\src\backtrace\win64.rs:85
   1:     0x7ff6edb243e2 - std::backtrace_rs::backtrace::trace_unsynchronized
                               at /rustc/29483883eed69d5fb4db01964cdf2af4d86e9cb2/library\std\src\..\..\backtrace\src\backtrace\mod.rs:66
   2:     0x7ff6edb243e2 - std::sys::backtrace::_print_fmt
...
tracing_integration_tests::uds_snapshot_test from datadog-trace-utils::test_send_data (Datadog) (✨ Fix with BitsAI)
thread 'tracing_integration_tests::uds_snapshot_test' panicked at /home/runner/work/libdatadog/libdatadog/datadog-trace-utils/src/test_utils/datadog_test_agent.rs:213:18

thread 'tracing_integration_tests::uds_snapshot_test' panicked at /home/runner/work/libdatadog/libdatadog/datadog-trace-utils/src/test_utils/datadog_test_agent.rs:213:18:
Unable to start DatadogTestAgent, is the Docker Daemon running?: WaitContainer(StartupTimeout)
stack backtrace:
   0:     0x55bee15526fa - std::backtrace_rs::backtrace::libunwind::trace::h886f3b0575353f6e
                               at /rustc/e71f9a9a98b0faf423844bf0ba7438f29dc27d58/library/std/src/../../backtrace/src/backtrace/libunwind.rs:116:5
   1:     0x55bee15526fa - std::backtrace_rs::backtrace::trace_unsynchronized::h652d1041ec67eb09
                               at /rustc/e71f9a9a98b0faf423844bf0ba7438f29dc27d58/library/std/src/../../backtrace/src/backtrace/mod.rs:66:5
   2:     0x55bee15526fa - std::sys::backtrace::_print_fmt::hd0317245a04c3039
...
tracing_integration_tests::uds_snapshot_test from data-pipeline::test_trace_exporter (Datadog) (✨ Fix with BitsAI)
thread 'tracing_integration_tests::uds_snapshot_test' panicked at /home/runner/work/libdatadog/libdatadog/datadog-trace-utils/src/test_utils/datadog_test_agent.rs:213:18

thread 'tracing_integration_tests::uds_snapshot_test' panicked at /home/runner/work/libdatadog/libdatadog/datadog-trace-utils/src/test_utils/datadog_test_agent.rs:213:18:
Unable to start DatadogTestAgent, is the Docker Daemon running?: WaitContainer(StartupTimeout)
stack backtrace:
   0:     0x5604d66e9a2a - std::backtrace_rs::backtrace::libunwind::trace::h886f3b0575353f6e
                               at /rustc/e71f9a9a98b0faf423844bf0ba7438f29dc27d58/library/std/src/../../backtrace/src/backtrace/libunwind.rs:116:5
   1:     0x5604d66e9a2a - std::backtrace_rs::backtrace::trace_unsynchronized::h652d1041ec67eb09
                               at /rustc/e71f9a9a98b0faf423844bf0ba7438f29dc27d58/library/std/src/../../backtrace/src/backtrace/mod.rs:66:5
   2:     0x5604d66e9a2a - std::sys::backtrace::_print_fmt::hd0317245a04c3039
...

ℹ️ Info

❄️ No new flaky tests detected

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: faa7206 | Docs | Was this helpful? Give us feedback!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant