Skip to content

[experimental] do not merge #937

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
wants to merge 3 commits into
base: main
Choose a base branch
from
Draft

[experimental] do not merge #937

wants to merge 3 commits into from

Conversation

duncanista
Copy link
Contributor

What does this PR do?

A brief description of the change being made with this pull request.

Motivation

What inspired you to submit this pull request?

Additional Notes

Anything else we should know when reviewing?

How to test the change?

Describe here in detail how the change can be validated.

@pr-commenter
Copy link

pr-commenter bot commented Mar 17, 2025 •
edited
Loading

Benchmarks

Comparison

Benchmark execution time: 2025-03-17 20:04:58

Comparing candidate commit 2b587dd in PR branch jordan.gonzalez/experimental with baseline commit 99c1190 in branch main.

Found 0 performance improvements and 1 performance regressions! Performance is the same for 51 metrics, 2 unstable metrics.

scenario:concentrator/add_spans_to_concentrator

  • 🟥 execution_time [+308.108µs; +310.813µs] or [+5.102%; +5.147%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2b587dd 1742241205 jordan.gonzalez/experimental
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 65.428µs 65.636µs ± 0.240µs 65.592µs ± 0.074µs 65.693µs 65.853µs 66.186µs 68.498µs 4.43% 8.662 98.897 0.37% 0.017µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [65.603µs; 65.670µs] or [-0.051%; +0.051%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2b587dd 1742241205 jordan.gonzalez/experimental
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 148.379µs 149.565µs ± 0.309µs 149.533µs ± 0.152µs 149.689µs 150.033µs 150.728µs 151.242µs 1.14% 1.325 6.273 0.21% 0.022µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [149.522µs; 149.608µs] or [-0.029%; +0.029%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2b587dd 1742241205 jordan.gonzalez/experimental
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 53.956ms 54.298ms ± 0.382ms 54.124ms ± 0.092ms 54.330ms 55.064ms 55.250ms 55.526ms 2.59% 1.446 0.665 0.70% 0.027ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [54.245ms; 54.351ms] or [-0.097%; +0.097%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2b587dd 1742241205 jordan.gonzalez/experimental
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 31.869µs 32.804µs ± 1.312µs 31.968µs ± 0.061µs 34.164µs 35.011µs 35.185µs 36.028µs 12.70% 0.963 -0.959 3.99% 0.093µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [32.622µs; 32.986µs] or [-0.554%; +0.554%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2b587dd 1742241205 jordan.gonzalez/experimental
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.415µs 2.442µs ± 0.019µs 2.437µs ± 0.008µs 2.446µs 2.493µs 2.505µs 2.514µs 3.15% 1.786 3.223 0.80% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.439µs; 2.444µs] or [-0.111%; +0.111%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2b587dd 1742241205 jordan.gonzalez/experimental
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.189µs 3.181µs ± 1.427µs 2.980µs ± 0.028µs 3.017µs 3.675µs 13.866µs 14.986µs 402.84% 7.368 55.345 44.75% 0.101µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [2.983µs; 3.379µs] or [-6.217%; +6.217%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2b587dd 1742241205 jordan.gonzalez/experimental
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 5.007µs 5.087µs ± 0.040µs 5.086µs ± 0.041µs 5.129µs 5.136µs 5.139µs 5.155µs 1.34% -0.220 -1.391 0.79% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.081µs; 5.093µs] or [-0.110%; +0.110%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2b587dd 1742241205 jordan.gonzalez/experimental
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 245.345ns 254.763ns ± 11.991ns 249.245ns ± 2.036ns 254.176ns 278.049ns 293.176ns 297.097ns 19.20% 1.876 2.620 4.69% 0.848ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [253.101ns; 256.424ns] or [-0.652%; +0.652%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2b587dd 1742241205 jordan.gonzalez/experimental
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 6.338ms 6.348ms ± 0.006ms 6.348ms ± 0.003ms 6.350ms 6.356ms 6.359ms 6.396ms 0.76% 2.999 22.643 0.09% 0.000ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [6.347ms; 6.349ms] or [-0.013%; +0.013%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2b587dd 1742241205 jordan.gonzalez/experimental
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 208.540µs 209.028µs ± 0.214µs 209.012µs ± 0.096µs 209.114µs 209.298µs 209.394µs 211.082µs 0.99% 4.457 41.259 0.10% 0.015µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 4737505.356op/s 4784046.912op/s ± 4865.093op/s 4784405.072op/s ± 2195.582op/s 4786495.700op/s 4790223.537op/s 4792761.639op/s 4795233.538op/s 0.23% -4.386 40.393 0.10% 344.014op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 18.282µs 18.336µs ± 0.025µs 18.330µs ± 0.010µs 18.345µs 18.383µs 18.426µs 18.443µs 0.62% 1.364 3.383 0.13% 0.002µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 54222459.126op/s 54537668.750op/s ± 72765.362op/s 54556571.813op/s ± 28714.892op/s 54577648.210op/s 54641992.406op/s 54670853.547op/s 54699041.701op/s 0.26% -1.350 3.334 0.13% 5145.288op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.690µs 10.748µs ± 0.036µs 10.743µs ± 0.024µs 10.770µs 10.820µs 10.846µs 10.903µs 1.49% 0.968 1.236 0.33% 0.003µs 1 200
normalization/normalize_name/normalize_name/good throughput 91716452.238op/s 93038873.569op/s ± 309692.659op/s 93083202.331op/s ± 206672.278op/s 93270698.472op/s 93440139.249op/s 93473076.356op/s 93549139.204op/s 0.50% -0.945 1.152 0.33% 21898.578op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [208.999µs; 209.058µs] or [-0.014%; +0.014%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [4783372.657op/s; 4784721.167op/s] or [-0.014%; +0.014%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [18.333µs; 18.339µs] or [-0.019%; +0.019%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [54527584.170op/s; 54547753.329op/s] or [-0.018%; +0.018%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.743µs; 10.753µs] or [-0.046%; +0.046%] None None None
normalization/normalize_name/normalize_name/good throughput [92995953.145op/s; 93081793.994op/s] or [-0.046%; +0.046%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2b587dd 1742241205 jordan.gonzalez/experimental
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 504.464µs 505.739µs ± 0.541µs 505.718µs ± 0.302µs 506.030µs 506.409µs 507.112µs 510.134µs 0.87% 2.613 20.640 0.11% 0.038µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1960268.836op/s 1977307.362op/s ± 2109.012op/s 1977386.390op/s ± 1178.505op/s 1978419.456op/s 1980368.019op/s 1981751.600op/s 1982302.226op/s 0.25% -2.563 20.155 0.11% 149.130op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 452.311µs 453.236µs ± 0.307µs 453.214µs ± 0.200µs 453.419µs 453.827µs 453.962µs 454.047µs 0.18% 0.338 0.030 0.07% 0.022µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2202417.109op/s 2206358.786op/s ± 1494.813op/s 2206463.415op/s ± 972.537op/s 2207411.229op/s 2208453.045op/s 2209386.997op/s 2210870.385op/s 0.20% -0.335 0.029 0.07% 105.699op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 175.680µs 176.777µs ± 0.336µs 176.813µs ± 0.228µs 177.035µs 177.242µs 177.364µs 177.419µs 0.34% -0.637 0.198 0.19% 0.024µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5636369.485op/s 5656867.558op/s ± 10779.379op/s 5655685.326op/s ± 7287.094op/s 5663701.963op/s 5677076.102op/s 5685774.815op/s 5692157.304op/s 0.64% 0.647 0.217 0.19% 762.217op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 37.559µs 37.662µs ± 0.049µs 37.660µs ± 0.030µs 37.688µs 37.746µs 37.802µs 37.878µs 0.58% 0.874 1.732 0.13% 0.003µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 26400703.118op/s 26551819.743op/s ± 34662.299op/s 26553620.290op/s ± 21025.466op/s 26576010.539op/s 26602504.109op/s 26610278.175op/s 26624954.238op/s 0.27% -0.862 1.693 0.13% 2450.995op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 48.224µs 48.339µs ± 0.047µs 48.333µs ± 0.028µs 48.363µs 48.426µs 48.466µs 48.519µs 0.39% 0.858 1.335 0.10% 0.003µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 20610622.481op/s 20687370.141op/s ± 19933.919op/s 20689990.007op/s ± 11968.957op/s 20700550.135op/s 20714552.977op/s 20722612.632op/s 20736723.961op/s 0.23% -0.851 1.317 0.10% 1409.541op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [505.664µs; 505.814µs] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1977015.074op/s; 1977599.651op/s] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [453.193µs; 453.278µs] or [-0.009%; +0.009%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2206151.619op/s; 2206565.953op/s] or [-0.009%; +0.009%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [176.730µs; 176.824µs] or [-0.026%; +0.026%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5655373.639op/s; 5658361.476op/s] or [-0.026%; +0.026%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [37.655µs; 37.669µs] or [-0.018%; +0.018%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [26547015.881op/s; 26556623.604op/s] or [-0.018%; +0.018%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [48.332µs; 48.345µs] or [-0.013%; +0.013%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [20684607.491op/s; 20690132.790op/s] or [-0.013%; +0.013%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2b587dd 1742241205 jordan.gonzalez/experimental
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.993µs 26.783µs ± 11.219µs 18.451µs ± 0.358µs 35.947µs 46.379µs 47.522µs 89.645µs 385.86% 1.519 4.170 41.78% 0.793µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [25.228µs; 28.338µs] or [-5.805%; +5.805%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2b587dd 1742241205 jordan.gonzalez/experimental
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.899µs 3.915µs ± 0.003µs 3.915µs ± 0.002µs 3.916µs 3.919µs 3.920µs 3.923µs 0.20% -1.094 5.583 0.07% 0.000µs 1 200
credit_card/is_card_number/ throughput 254918882.239op/s 255449141.590op/s ± 171912.029op/s 255438741.524op/s ± 100567.997op/s 255537706.311op/s 255718314.715op/s 255879471.176op/s 256458263.224op/s 0.40% 1.107 5.651 0.07% 12156.016op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 81.741µs 82.076µs ± 0.230µs 81.992µs ± 0.120µs 82.206µs 82.493µs 82.724µs 83.255µs 1.54% 1.416 3.043 0.28% 0.016µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 12011284.700op/s 12183975.102op/s ± 34052.021op/s 12196355.735op/s ± 17869.562op/s 12209504.491op/s 12221557.732op/s 12226682.893op/s 12233722.255op/s 0.31% -1.391 2.899 0.28% 2407.841op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 76.408µs 76.800µs ± 0.249µs 76.771µs ± 0.189µs 76.957µs 77.237µs 77.421µs 77.733µs 1.25% 0.781 0.328 0.32% 0.018µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 12864496.102op/s 13021033.065op/s ± 42062.230op/s 13025790.770op/s ± 32031.266op/s 13057932.564op/s 13073810.741op/s 13083406.172op/s 13087585.117op/s 0.47% -0.764 0.277 0.32% 2974.249op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.894µs 3.915µs ± 0.003µs 3.915µs ± 0.001µs 3.916µs 3.918µs 3.920µs 3.922µs 0.18% -2.515 19.290 0.07% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 254984446.947op/s 255451156.892op/s ± 170517.257op/s 255452639.088op/s ± 89552.007op/s 255532708.187op/s 255693332.324op/s 255795847.976op/s 256820648.822op/s 0.54% 2.545 19.578 0.07% 12057.391op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 71.857µs 72.362µs ± 0.355µs 72.342µs ± 0.275µs 72.562µs 73.011µs 73.287µs 73.784µs 1.99% 0.910 0.732 0.49% 0.025µs 1 200
credit_card/is_card_number/378282246310005 throughput 13553145.197op/s 13819680.305op/s ± 67415.099op/s 13823246.424op/s ± 52805.593op/s 13876876.302op/s 13898925.657op/s 13911769.304op/s 13916548.167op/s 0.67% -0.882 0.635 0.49% 4766.967op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 51.917µs 52.151µs ± 0.095µs 52.156µs ± 0.063µs 52.210µs 52.303µs 52.362µs 52.465µs 0.59% 0.072 0.098 0.18% 0.007µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 19060286.196op/s 19175259.024op/s ± 35035.600op/s 19173189.172op/s ± 23036.826op/s 19200303.863op/s 19230701.734op/s 19253065.513op/s 19261436.277op/s 0.46% -0.061 0.087 0.18% 2477.391op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.430µs 6.449µs ± 0.022µs 6.444µs ± 0.003µs 6.447µs 6.482µs 6.561µs 6.567µs 1.91% 3.691 14.448 0.34% 0.002µs 1 200
credit_card/is_card_number/x371413321323331 throughput 152283676.230op/s 155057120.716op/s ± 526185.110op/s 155195026.001op/s ± 77330.919op/s 155272147.204op/s 155397817.556op/s 155468280.962op/s 155524517.458op/s 0.21% -3.662 14.231 0.34% 37206.906op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.892µs 3.915µs ± 0.005µs 3.915µs ± 0.002µs 3.916µs 3.921µs 3.924µs 3.960µs 1.15% 3.750 42.830 0.12% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 252539279.989op/s 255417359.969op/s ± 304197.817op/s 255438847.942op/s ± 99775.967op/s 255522172.937op/s 255732135.740op/s 255906605.384op/s 256907648.387op/s 0.58% -3.640 41.858 0.12% 21510.034op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 63.963µs 64.260µs ± 0.095µs 64.247µs ± 0.049µs 64.307µs 64.420µs 64.530µs 64.718µs 0.73% 1.146 4.182 0.15% 0.007µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15451771.159op/s 15561923.620op/s ± 22859.736op/s 15565008.305op/s ± 11862.666op/s 15575428.984op/s 15591328.809op/s 15602667.954op/s 15633939.720op/s 0.44% -1.124 4.102 0.15% 1616.427op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 58.151µs 58.296µs ± 0.124µs 58.271µs ± 0.027µs 58.302µs 58.484µs 58.819µs 59.353µs 1.86% 4.855 32.392 0.21% 0.009µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 16848356.271op/s 17153830.306op/s ± 35983.145op/s 17161162.573op/s ± 8069.306op/s 17167925.165op/s 17183460.492op/s 17195964.434op/s 17196601.951op/s 0.21% -4.787 31.584 0.21% 2544.393op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.897µs 3.915µs ± 0.003µs 3.915µs ± 0.002µs 3.917µs 3.920µs 3.921µs 3.921µs 0.16% -1.058 4.998 0.08% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 255006435.045op/s 255402699.200op/s ± 201471.070op/s 255401746.948op/s ± 122417.851op/s 255522485.979op/s 255735350.687op/s 255879052.005op/s 256581130.250op/s 0.46% 1.072 5.081 0.08% 14246.156op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 54.575µs 54.818µs ± 0.253µs 54.692µs ± 0.055µs 55.009µs 55.246µs 55.692µs 55.924µs 2.25% 1.660 2.630 0.46% 0.018µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 17881441.936op/s 18242539.367op/s ± 83592.266op/s 18284172.308op/s ± 18280.222op/s 18298009.178op/s 18311227.172op/s 18320265.989op/s 18323545.756op/s 0.22% -1.634 2.491 0.46% 5910.866op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 51.857µs 52.151µs ± 0.096µs 52.157µs ± 0.060µs 52.209µs 52.296µs 52.360µs 52.502µs 0.66% -0.126 0.777 0.18% 0.007µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 19046778.193op/s 19175283.380op/s ± 35366.158op/s 19172969.002op/s ± 21989.442op/s 19196739.914op/s 19238535.215op/s 19262246.305op/s 19283859.721op/s 0.58% 0.142 0.770 0.18% 2500.765op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.430µs 6.453µs ± 0.027µs 6.444µs ± 0.004µs 6.450µs 6.504µs 6.551µs 6.628µs 2.86% 3.667 16.976 0.42% 0.002µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 150869769.565op/s 154977297.454op/s ± 635204.256op/s 155183294.404op/s ± 98381.670op/s 155271822.046op/s 155385879.469op/s 155471336.285op/s 155512025.095op/s 0.21% -3.599 16.323 0.41% 44915.724op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.914µs; 3.915µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/ throughput [255425316.236op/s; 255472966.943op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [82.044µs; 82.108µs] or [-0.039%; +0.039%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12179255.820op/s; 12188694.385op/s] or [-0.039%; +0.039%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [76.765µs; 76.834µs] or [-0.045%; +0.045%] None None None
credit_card/is_card_number/ 378282246310005 throughput [13015203.644op/s; 13026862.485op/s] or [-0.045%; +0.045%] None None None
credit_card/is_card_number/37828224631 execution_time [3.914µs; 3.915µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/37828224631 throughput [255427524.840op/s; 255474788.944op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/378282246310005 execution_time [72.313µs; 72.411µs] or [-0.068%; +0.068%] None None None
credit_card/is_card_number/378282246310005 throughput [13810337.221op/s; 13829023.389op/s] or [-0.068%; +0.068%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [52.138µs; 52.164µs] or [-0.025%; +0.025%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [19170403.427op/s; 19180114.621op/s] or [-0.025%; +0.025%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.446µs; 6.452µs] or [-0.048%; +0.048%] None None None
credit_card/is_card_number/x371413321323331 throughput [154984196.521op/s; 155130044.912op/s] or [-0.047%; +0.047%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.915µs; 3.916µs] or [-0.017%; +0.017%] None None None
credit_card/is_card_number_no_luhn/ throughput [255375201.077op/s; 255459518.861op/s] or [-0.017%; +0.017%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [64.246µs; 64.273µs] or [-0.020%; +0.020%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15558755.480op/s; 15565091.760op/s] or [-0.020%; +0.020%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [58.279µs; 58.313µs] or [-0.029%; +0.029%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [17148843.388op/s; 17158817.224op/s] or [-0.029%; +0.029%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.915µs; 3.916µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255374777.248op/s; 255430621.153op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [54.783µs; 54.853µs] or [-0.064%; +0.064%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [18230954.283op/s; 18254124.451op/s] or [-0.064%; +0.064%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [52.137µs; 52.164µs] or [-0.026%; +0.026%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [19170381.970op/s; 19180184.789op/s] or [-0.026%; +0.026%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.449µs; 6.456µs] or [-0.058%; +0.058%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [154889264.253op/s; 155065330.655op/s] or [-0.057%; +0.057%] None None None

Baseline

Omitted due to size.

@codecov-commenter
Copy link

codecov-commenter commented Mar 17, 2025 •
edited
Loading

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 72.87%. Comparing base (99c1190) to head (2b587dd).

Additional details and impacted files 
@@            Coverage Diff             @@
##             main     #937      +/-   ##
==========================================
+ Coverage   72.85%   72.87%   +0.02%     
==========================================
  Files         334      334              
  Lines       50974    51027      +53     
==========================================
+ Hits        37135    37186      +51     
- Misses      13839    13841       +2
Components Coverage Δ
crashtracker 42.85% <ø> (ø)
crashtracker-ffi 6.25% <ø> (ø)
datadog-alloc 98.73% <ø> (ø)
data-pipeline 91.96% <ø> (ø)
data-pipeline-ffi 90.28% <ø> (ø)
ddcommon 81.37% <ø> (ø)
ddcommon-ffi 66.10% <ø> (ø)
ddtelemetry 61.87% <ø> (ø)
ddtelemetry-ffi 22.46% <ø> (ø)
dogstatsd 90.04% <100.00%> (+0.34%) ⬆️
dogstatsd-client 82.57% <ø> (ø)
ipc 82.47% <ø> (-0.05%) ⬇️
profiling 81.86% <ø> (ø)
profiling-ffi 70.68% <ø> (ø)
serverless 0.00% <ø> (ø)
sidecar 41.53% <ø> (ø)
sidecar-ffi 5.58% <ø> (ø)
spawn-worker 54.37% <ø> (ø)
tinybytes 91.24% <ø> (ø)
trace-mini-agent 74.66% <ø> (ø)
trace-normalization 98.24% <ø> (ø)
trace-obfuscation 96.00% <ø> (ø)
trace-protobuf 78.13% <ø> (ø)
trace-utils 92.87% <ø> (ø)
🚀 New features to boost your workflow:
  • ❄ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@duncanista @codecov-commenter