Skip to content

Conversation

gleocadie
Copy link
Contributor

@gleocadie gleocadie commented Sep 11, 2025

What does this PR do?

A brief description of the change being made with this pull request.

Motivation

What inspired you to submit this pull request?

receiver_entry_point/report/2598
                        time:   [1.1760 ms 1.1926 ms 1.2122 ms]
                        change: [-6.6611% -5.1212% -3.4009%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 12 outliers among 200 measurements (6.00%)
  6 (3.00%) high mild
  6 (3.00%) high severe

Additional Notes

Anything else we should know when reviewing?

How to test the change?

Describe here in detail how the change can be validated.

@pr-commenter
Copy link

pr-commenter bot commented Sep 11, 2025

Benchmarks

Comparison

Benchmark execution time: 2025-09-17 07:29:49

Comparing candidate commit 75dbfe7 in PR branch gleocadie/optimize-receiver-in-crashtracker with baseline commit 6e9fc38 in branch main.

Found 0 performance improvements and 1 performance regressions! Performance is the same for 52 metrics, 2 unstable metrics.

scenario:ip_address/quantize_peer_ip_address_benchmark

  • 🟥 execution_time [+484.970ns; +499.870ns] or [+9.554%; +9.847%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 75dbfe7 1758093397 gleocadie/optimize-receiver-in-crashtracker
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.390µs 2.431µs ± 0.022µs 2.425µs ± 0.007µs 2.434µs 2.486µs 2.513µs 2.519µs 3.88% 2.046 4.601 0.89% 0.002µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.428µs; 2.434µs] or [-0.123%; +0.123%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 75dbfe7 1758093397 gleocadie/optimize-receiver-in-crashtracker
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 5.497µs 5.569µs ± 0.043µs 5.568µs ± 0.034µs 5.601µs 5.641µs 5.666µs 5.679µs 1.99% 0.373 -0.685 0.78% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.563µs; 5.575µs] or [-0.108%; +0.108%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 75dbfe7 1758093397 gleocadie/optimize-receiver-in-crashtracker
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 33.077µs 33.830µs ± 1.018µs 33.217µs ± 0.083µs 34.665µs 35.575µs 35.615µs 36.618µs 10.24% 1.020 -0.781 3.00% 0.072µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [33.689µs; 33.971µs] or [-0.417%; +0.417%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 75dbfe7 1758093397 gleocadie/optimize-receiver-in-crashtracker
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 8.139ms 8.159ms ± 0.012ms 8.157ms ± 0.007ms 8.165ms 8.182ms 8.202ms 8.215ms 0.72% 1.749 5.065 0.15% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [8.157ms; 8.161ms] or [-0.020%; +0.020%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 75dbfe7 1758093397 gleocadie/optimize-receiver-in-crashtracker
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 185.329µs 185.924µs ± 0.290µs 185.901µs ± 0.202µs 186.128µs 186.324µs 186.508µs 187.712µs 0.97% 1.185 5.697 0.16% 0.021µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 5327304.955op/s 5378550.622op/s ± 8385.814op/s 5379199.617op/s ± 5836.657op/s 5384401.873op/s 5390247.961op/s 5392825.882op/s 5395805.247op/s 0.31% -1.156 5.492 0.16% 592.967op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 17.989µs 18.089µs ± 0.051µs 18.089µs ± 0.038µs 18.125µs 18.173µs 18.197µs 18.277µs 1.04% 0.375 0.129 0.28% 0.004µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 54712492.747op/s 55282444.955op/s ± 155489.878op/s 55283345.864op/s ± 117300.702op/s 55406053.641op/s 55525239.611op/s 55549453.156op/s 55590409.860op/s 0.56% -0.358 0.090 0.28% 10994.795op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.333µs 10.453µs ± 0.042µs 10.449µs ± 0.029µs 10.483µs 10.523µs 10.542µs 10.558µs 1.04% 0.080 -0.380 0.40% 0.003µs 1 200
normalization/normalize_name/normalize_name/good throughput 94715179.973op/s 95663959.420op/s ± 381379.654op/s 95700856.574op/s ± 268363.483op/s 95940063.631op/s 96245997.810op/s 96496877.680op/s 96781430.869op/s 1.13% -0.061 -0.371 0.40% 26967.614op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [185.884µs; 185.964µs] or [-0.022%; +0.022%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [5377388.429op/s; 5379712.815op/s] or [-0.022%; +0.022%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [18.082µs; 18.096µs] or [-0.039%; +0.039%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [55260895.553op/s; 55303994.357op/s] or [-0.039%; +0.039%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.448µs; 10.459µs] or [-0.055%; +0.055%] None None None
normalization/normalize_name/normalize_name/good throughput [95611103.868op/s; 95716814.973op/s] or [-0.055%; +0.055%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 75dbfe7 1758093397 gleocadie/optimize-receiver-in-crashtracker
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 60.552ms 61.005ms ± 1.882ms 60.685ms ± 0.069ms 60.820ms 61.239ms 72.816ms 77.628ms 27.92% 8.067 64.986 3.08% 0.133ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [60.744ms; 61.266ms] or [-0.427%; +0.427%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 75dbfe7 1758093397 gleocadie/optimize-receiver-in-crashtracker
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 86.314µs 86.612µs ± 0.278µs 86.580µs ± 0.065µs 86.656µs 86.786µs 87.076µs 90.212µs 4.20% 10.989 139.349 0.32% 0.020µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [86.574µs; 86.651µs] or [-0.044%; +0.044%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 75dbfe7 1758093397 gleocadie/optimize-receiver-in-crashtracker
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 239.568ns 250.986ns ± 12.580ns 246.306ns ± 4.384ns 252.894ns 283.672ns 287.598ns 290.193ns 17.82% 1.687 1.857 5.00% 0.890ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [249.242ns; 252.730ns] or [-0.695%; +0.695%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 75dbfe7 1758093397 gleocadie/optimize-receiver-in-crashtracker
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 158.971µs 159.771µs ± 0.269µs 159.742µs ± 0.136µs 159.889µs 160.301µs 160.573µs 160.674µs 0.58% 0.417 1.607 0.17% 0.019µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [159.734µs; 159.809µs] or [-0.023%; +0.023%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 75dbfe7 1758093397 gleocadie/optimize-receiver-in-crashtracker
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.218µs 3.213µs ± 1.419µs 3.001µs ± 0.029µs 3.027µs 3.689µs 13.812µs 14.895µs 396.27% 7.297 54.662 44.04% 0.100µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.017µs; 3.410µs] or [-6.119%; +6.119%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 75dbfe7 1758093397 gleocadie/optimize-receiver-in-crashtracker
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.896µs 3.911µs ± 0.003µs 3.911µs ± 0.002µs 3.913µs 3.916µs 3.917µs 3.921µs 0.25% -0.526 6.695 0.07% 0.000µs 1 200
credit_card/is_card_number/ throughput 255023295.685op/s 255659027.656op/s ± 171148.957op/s 255673128.755op/s ± 99765.220op/s 255756196.030op/s 255876161.782op/s 255944424.943op/s 256705824.763op/s 0.40% 0.542 6.779 0.07% 12102.059op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 76.631µs 78.198µs ± 0.698µs 78.167µs ± 0.476µs 78.631µs 79.362µs 79.706µs 80.468µs 2.94% 0.272 -0.250 0.89% 0.049µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 12427287.021op/s 12788982.762op/s ± 113853.219op/s 12793103.895op/s ± 78414.782op/s 12874025.353op/s 12962993.308op/s 13016854.105op/s 13049603.685op/s 2.00% -0.227 -0.294 0.89% 8050.638op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 69.834µs 71.189µs ± 0.660µs 71.151µs ± 0.429µs 71.577µs 72.295µs 72.935µs 73.404µs 3.17% 0.464 0.281 0.92% 0.047µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 13623146.286op/s 14048377.095op/s ± 129712.885op/s 14054569.308op/s ± 84583.756op/s 14142037.576op/s 14245948.994op/s 14297674.485op/s 14319730.537op/s 1.89% -0.408 0.189 0.92% 9172.086op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.891µs 3.913µs ± 0.003µs 3.912µs ± 0.002µs 3.915µs 3.918µs 3.919µs 3.920µs 0.20% -1.232 9.449 0.08% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 255077152.609op/s 255581155.151op/s ± 205435.705op/s 255593021.547op/s ± 140325.287op/s 255727298.891op/s 255815133.445op/s 255881749.249op/s 256990555.170op/s 0.55% 1.256 9.633 0.08% 14526.498op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 66.957µs 68.397µs ± 0.644µs 68.362µs ± 0.486µs 68.822µs 69.462µs 69.832µs 70.167µs 2.64% 0.204 -0.445 0.94% 0.046µs 1 200
credit_card/is_card_number/378282246310005 throughput 14251632.248op/s 14621826.306op/s ± 137481.596op/s 14628034.011op/s ± 104566.871op/s 14732537.936op/s 14842953.375op/s 14901932.245op/s 14934899.080op/s 2.10% -0.162 -0.468 0.94% 9721.417op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 52.151µs 52.207µs ± 0.030µs 52.206µs ± 0.022µs 52.226µs 52.256µs 52.285µs 52.297µs 0.17% 0.399 -0.152 0.06% 0.002µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 19121563.347op/s 19154630.859op/s ± 10874.395op/s 19154776.530op/s ± 8148.322op/s 19163304.667op/s 19171373.401op/s 19174124.021op/s 19174988.145op/s 0.11% -0.396 -0.156 0.06% 768.936op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.028µs 6.036µs ± 0.005µs 6.036µs ± 0.003µs 6.039µs 6.043µs 6.049µs 6.069µs 0.55% 2.401 12.826 0.08% 0.000µs 1 200
credit_card/is_card_number/x371413321323331 throughput 164770726.702op/s 165666275.764op/s ± 139652.610op/s 165672142.524op/s ± 85702.564op/s 165764360.670op/s 165830147.104op/s 165862283.620op/s 165893563.970op/s 0.13% -2.378 12.649 0.08% 9874.931op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.896µs 3.912µs ± 0.003µs 3.912µs ± 0.002µs 3.914µs 3.917µs 3.918µs 3.920µs 0.20% -0.769 5.847 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 255099444.887op/s 255596355.771op/s ± 178620.195op/s 255598578.484op/s ± 121278.170op/s 255716749.451op/s 255837560.020op/s 255879711.518op/s 256691651.187op/s 0.43% 0.784 5.941 0.07% 12630.355op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 64.155µs 64.448µs ± 0.152µs 64.419µs ± 0.101µs 64.546µs 64.705µs 64.855µs 64.938µs 0.81% 0.693 0.293 0.24% 0.011µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15399249.227op/s 15516356.142op/s ± 36501.618op/s 15523379.734op/s ± 24289.923op/s 15542566.719op/s 15566930.873op/s 15577672.757op/s 15587220.038op/s 0.41% -0.680 0.267 0.23% 2581.054op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 58.124µs 58.381µs ± 0.154µs 58.355µs ± 0.090µs 58.458µs 58.641µs 58.925µs 59.148µs 1.36% 1.455 3.845 0.26% 0.011µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 16906641.623op/s 17128982.675op/s ± 44934.538op/s 17136585.534op/s ± 26512.159op/s 17161008.275op/s 17187522.109op/s 17193046.169op/s 17204668.929op/s 0.40% -1.425 3.697 0.26% 3177.352op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.896µs 3.912µs ± 0.002µs 3.911µs ± 0.001µs 3.913µs 3.916µs 3.917µs 3.919µs 0.20% -0.789 7.360 0.06% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 255151418.292op/s 255654180.952op/s ± 160652.574op/s 255667560.153op/s ± 93543.794op/s 255746958.620op/s 255855410.225op/s 255928276.131op/s 256678563.323op/s 0.40% 0.806 7.461 0.06% 11359.852op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 54.574µs 54.766µs ± 0.165µs 54.724µs ± 0.061µs 54.801µs 55.066µs 55.538µs 55.769µs 1.91% 3.068 13.677 0.30% 0.012µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 17931243.968op/s 18259523.620op/s ± 54486.885op/s 18273524.405op/s ± 20247.481op/s 18291764.134op/s 18309767.438op/s 18318159.547op/s 18323881.515op/s 0.28% -3.012 13.228 0.30% 3852.805op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 52.140µs 52.211µs ± 0.034µs 52.208µs ± 0.018µs 52.231µs 52.270µs 52.288µs 52.410µs 0.39% 1.261 4.960 0.06% 0.002µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 19080352.831op/s 19152888.095op/s ± 12464.522op/s 19154331.286op/s ± 6723.926op/s 19160578.547op/s 19170498.999op/s 19175656.332op/s 19179129.272op/s 0.13% -1.251 4.896 0.06% 881.375op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.028µs 6.036µs ± 0.006µs 6.035µs ± 0.003µs 6.039µs 6.043µs 6.061µs 6.077µs 0.70% 3.085 16.855 0.09% 0.000µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 164554421.760op/s 165677620.000op/s ± 157113.657op/s 165709456.353op/s ± 83239.660op/s 165778838.353op/s 165846590.453op/s 165882528.881op/s 165888850.068op/s 0.11% -3.059 16.622 0.09% 11109.613op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.911µs; 3.912µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/ throughput [255635308.056op/s; 255682747.255op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [78.102µs; 78.295µs] or [-0.124%; +0.124%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12773203.801op/s; 12804761.724op/s] or [-0.123%; +0.123%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [71.097µs; 71.280µs] or [-0.128%; +0.128%] None None None
credit_card/is_card_number/ 378282246310005 throughput [14030400.136op/s; 14066354.053op/s] or [-0.128%; +0.128%] None None None
credit_card/is_card_number/37828224631 execution_time [3.912µs; 3.913µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/37828224631 throughput [255552683.738op/s; 255609626.564op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/378282246310005 execution_time [68.308µs; 68.486µs] or [-0.131%; +0.131%] None None None
credit_card/is_card_number/378282246310005 throughput [14602772.679op/s; 14640879.933op/s] or [-0.130%; +0.130%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [52.203µs; 52.211µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [19153123.772op/s; 19156137.946op/s] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.036µs; 6.037µs] or [-0.012%; +0.012%] None None None
credit_card/is_card_number/x371413321323331 throughput [165646921.255op/s; 165685630.273op/s] or [-0.012%; +0.012%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.912µs; 3.913µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ throughput [255571600.730op/s; 255621110.812op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [64.427µs; 64.470µs] or [-0.033%; +0.033%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15511297.369op/s; 15521414.915op/s] or [-0.033%; +0.033%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [58.360µs; 58.402µs] or [-0.036%; +0.036%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [17122755.180op/s; 17135210.170op/s] or [-0.036%; +0.036%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.911µs; 3.912µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255631916.050op/s; 255676445.853op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [54.744µs; 54.789µs] or [-0.042%; +0.042%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [18251972.262op/s; 18267074.978op/s] or [-0.041%; +0.041%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [52.207µs; 52.216µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [19151160.633op/s; 19154615.558op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.035µs; 6.037µs] or [-0.013%; +0.013%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [165655845.558op/s; 165699394.441op/s] or [-0.013%; +0.013%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 75dbfe7 1758093397 gleocadie/optimize-receiver-in-crashtracker
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.918µs 26.649µs ± 10.885µs 18.069µs ± 0.092µs 36.229µs 46.313µs 50.145µs 78.970µs 337.04% 1.095 1.549 40.75% 0.770µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [25.140µs; 28.157µs] or [-5.661%; +5.661%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 75dbfe7 1758093397 gleocadie/optimize-receiver-in-crashtracker
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
receiver_entry_point/report/2597 execution_time 5.997ms 6.038ms ± 0.022ms 6.034ms ± 0.012ms 6.049ms 6.074ms 6.103ms 6.170ms 2.26% 1.634 6.568 0.36% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
receiver_entry_point/report/2597 execution_time [6.035ms; 6.041ms] or [-0.050%; +0.050%] None None None

Group 14

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 75dbfe7 1758093397 gleocadie/optimize-receiver-in-crashtracker
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 533.771µs 534.969µs ± 1.002µs 534.665µs ± 0.375µs 535.125µs 537.188µs 538.640µs 539.840µs 0.97% 2.029 4.566 0.19% 0.071µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1852399.500op/s 1869273.010op/s ± 3488.277op/s 1870331.666op/s ± 1311.378op/s 1871522.821op/s 1872383.413op/s 1872982.574op/s 1873464.241op/s 0.17% -2.015 4.487 0.19% 246.658op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 380.212µs 380.857µs ± 0.308µs 380.836µs ± 0.204µs 381.051µs 381.405µs 381.488µs 381.753µs 0.24% 0.261 -0.341 0.08% 0.022µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2619494.208op/s 2625658.431op/s ± 2121.195op/s 2625804.881op/s ± 1407.446op/s 2627157.042op/s 2629045.904op/s 2629817.331op/s 2630112.524op/s 0.16% -0.258 -0.344 0.08% 149.991op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 189.999µs 190.280µs ± 0.166µs 190.259µs ± 0.100µs 190.374µs 190.594µs 190.762µs 190.849µs 0.31% 0.819 0.678 0.09% 0.012µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5239745.214op/s 5255413.631op/s ± 4576.854op/s 5255984.292op/s ± 2769.308op/s 5258580.234op/s 5261617.824op/s 5263058.294op/s 5263192.699op/s 0.14% -0.814 0.665 0.09% 323.632op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 36.818µs 37.053µs ± 0.126µs 37.082µs ± 0.087µs 37.138µs 37.213µs 37.318µs 37.539µs 1.23% 0.133 0.286 0.34% 0.009µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 26639095.725op/s 26988442.213op/s ± 91526.755op/s 26967238.504op/s ± 62961.702op/s 27065927.394op/s 27136295.706op/s 27157345.979op/s 27160879.642op/s 0.72% -0.110 0.223 0.34% 6471.919op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 45.967µs 46.101µs ± 0.110µs 46.088µs ± 0.038µs 46.131µs 46.187µs 46.284µs 47.427µs 2.90% 8.780 102.276 0.24% 0.008µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 21085116.353op/s 21691560.596op/s ± 50901.401op/s 21697516.766op/s ± 17797.227op/s 21712209.855op/s 21736197.517op/s 21745571.501op/s 21754525.636op/s 0.26% -8.586 99.153 0.23% 3599.273op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [534.830µs; 535.108µs] or [-0.026%; +0.026%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1868789.569op/s; 1869756.452op/s] or [-0.026%; +0.026%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [380.814µs; 380.900µs] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2625364.454op/s; 2625952.409op/s] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [190.257µs; 190.303µs] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5254779.323op/s; 5256047.939op/s] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [37.036µs; 37.071µs] or [-0.047%; +0.047%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [26975757.485op/s; 27001126.941op/s] or [-0.047%; +0.047%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [46.086µs; 46.116µs] or [-0.033%; +0.033%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [21684506.152op/s; 21698615.041op/s] or [-0.033%; +0.033%] None None None

Group 15

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 75dbfe7 1758093397 gleocadie/optimize-receiver-in-crashtracker
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching serializing traces from their internal representation to msgpack execution_time 13.987ms 14.034ms ± 0.034ms 14.028ms ± 0.013ms 14.042ms 14.112ms 14.159ms 14.222ms 1.38% 2.511 8.090 0.24% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching serializing traces from their internal representation to msgpack execution_time [14.030ms; 14.039ms] or [-0.033%; +0.033%] None None None

Baseline

Omitted due to size.

@codecov-commenter
Copy link

codecov-commenter commented Sep 11, 2025

Codecov Report

❌ Patch coverage is 29.59184% with 69 lines in your changes missing coverage. Please review.
✅ Project coverage is 71.56%. Comparing base (6e9fc38) to head (75dbfe7).

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #1212      +/-   ##
==========================================
- Coverage   71.62%   71.56%   -0.07%     
==========================================
  Files         354      354              
  Lines       55939    56007      +68     
==========================================
+ Hits        40068    40080      +12     
- Misses      15871    15927      +56     
Components Coverage Δ
datadog-crashtracker 48.95% <29.59%> (-0.36%) ⬇️
datadog-crashtracker-ffi 5.86% <0.00%> (-0.07%) ⬇️
datadog-alloc 98.73% <ø> (ø)
data-pipeline 90.21% <ø> (-0.02%) ⬇️
data-pipeline-ffi 88.19% <ø> (ø)
ddcommon 84.29% <ø> (ø)
ddcommon-ffi 73.84% <ø> (ø)
ddtelemetry 59.98% <ø> (ø)
ddtelemetry-ffi 21.24% <ø> (ø)
dogstatsd-client 83.26% <ø> (ø)
datadog-ipc 82.39% <ø> (-0.11%) ⬇️
datadog-profiling 76.90% <ø> (ø)
datadog-profiling-ffi 62.12% <ø> (ø)
datadog-sidecar 37.05% <ø> (ø)
datdog-sidecar-ffi 11.26% <ø> (ø)
spawn-worker 55.35% <ø> (ø)
tinybytes 92.22% <ø> (ø)
datadog-trace-normalization 98.24% <ø> (ø)
datadog-trace-obfuscation 94.17% <ø> (ø)
datadog-trace-protobuf 77.10% <ø> (ø)
datadog-trace-utils 89.78% <ø> (ø)
datadog-tracer-flare 56.08% <ø> (ø)
datadog-log 76.31% <ø> (ø)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@gleocadie gleocadie force-pushed the gleocadie/optimize-receiver-in-crashtracker branch from d554c22 to c1624b0 Compare September 11, 2025 13:42
@gleocadie gleocadie force-pushed the gleocadie/optimize-receiver-in-crashtracker branch from c1624b0 to 75dbfe7 Compare September 17, 2025 07:16
@gyuheon0h
Copy link
Contributor

Artifact Size Benchmark Report

aarch64-alpine-linux-musl
Artifact Baseline Commit Change
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so 6.75 MB 6.75 MB 0% (0 B) 👌
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.a 70.47 MB 70.48 MB +.02% (+16.51 KB) 🔍
aarch64-unknown-linux-gnu
Artifact Baseline Commit Change
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so 8.80 MB 8.80 MB +0% (+104 B) 👌
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.a 82.75 MB 82.76 MB +.01% (+10.16 KB) 🔍
libdatadog-x64-windows
Artifact Baseline Commit Change
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.dll 17.89 MB 17.89 MB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.lib 65.01 KB 65.01 KB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.pdb 124.62 MB 124.63 MB +.01% (+16.00 KB) 🔍
/libdatadog-x64-windows/debug/static/datadog_profiling_ffi.lib 647.28 MB 647.28 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.dll 5.55 MB 5.55 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.lib 65.01 KB 65.01 KB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.pdb 17.23 MB 17.23 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/static/datadog_profiling_ffi.lib 31.57 MB 31.57 MB 0% (0 B) 👌
libdatadog-x86-windows
Artifact Baseline Commit Change
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.dll 15.23 MB 15.23 MB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.lib 66.01 KB 66.01 KB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.pdb 126.80 MB 126.82 MB +.01% (+16.00 KB) 🔍
/libdatadog-x86-windows/debug/static/datadog_profiling_ffi.lib 637.65 MB 637.65 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.dll 4.23 MB 4.23 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.lib 66.01 KB 66.01 KB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.pdb 18.35 MB 18.35 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/static/datadog_profiling_ffi.lib 29.68 MB 29.68 MB 0% (0 B) 👌
x86_64-alpine-linux-musl
Artifact Baseline Commit Change
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.a 63.02 MB 63.03 MB +.02% (+15.36 KB) 🔍
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so 8.06 MB 8.06 MB +.04% (+4.00 KB) 🔍
x86_64-unknown-linux-gnu
Artifact Baseline Commit Change
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.a 77.38 MB 77.40 MB +.02% (+19.02 KB) 🔍
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so 9.40 MB 9.40 MB +.04% (+4.04 KB) 🔍

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants