Skip to content

chore: Apply clippy lints from 1.59.0 #11595

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 3 commits into from
Feb 28, 2022
Merged

chore: Apply clippy lints from 1.59.0 #11595

merged 3 commits into from
Feb 28, 2022

Conversation

jszwedko
Copy link
Member

@jszwedko jszwedko commented Feb 25, 2022

The upgrade to 1.59.0 is blocked by rust-lang/rust-clippy#8470 but I figured I'd apply the lints so far anyway.

Signed-off-by: Jesse Szwedko [email protected]

@netlify
Copy link

netlify bot commented Feb 25, 2022

✔️ Deploy Preview for vector-project canceled.

🔨 Explore the source changes: e301977

🔍 Inspect the deploy log: https://app.netlify.com/sites/vector-project/deploys/621cf451936a6700085a346c

@github-actions github-actions bot added domain: core Anything related to core crates i.e. vector-core, core-common, etc domain: sinks Anything related to the Vector's sinks domain: sources Anything related to the Vector's sources domain: transforms Anything related to Vector's transform components domain: vrl Anything related to the Vector Remap Language labels Feb 25, 2022
@jszwedko jszwedko enabled auto-merge (squash) February 25, 2022 23:47
@github-actions
Copy link

Soak Test Results

Baseline: 13b4071
Comparison: c647690
Total Vector CPUs: 4

Explanation

A soak test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their throughput performance between baseline and comparision SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±5% change in mean throughput are discarded. An experiment is erratic if its coefficient of variation is greater than 0.3. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in throughput with confidence ≥ 90.00% and absolute Δ mean >= ±5%:

Fine details of change detection per experiment.
experiment Δ mean Δ mean % confidence baseline mean baseline stdev baseline stderr baseline outlier % baseline CoV comparison mean comparison stdev comparison stderr comparison outlier % comparison CoV erratic declared erratic
http_to_http_noack 602.99KiB 3.15 100.00% 18.71MiB 1.76MiB 72.69KiB 0 0.0937851 19.3MiB 931.7KiB 36.92KiB 0 0.0471084 False False
syslog_loki 221.7KiB 3.09 100.00% 7.01MiB 692.64KiB 31.55KiB 0 0.096358 7.23MiB 48.41KiB 1.98KiB 0 0.00653416 False False
http_to_http_json 270.76KiB 1.67 100.00% 15.85MiB 908.34KiB 36.19KiB 0 0.0559353 16.11MiB 883.41KiB 35.0KiB 0 0.0535081 False False
http_pipelines_blackhole 4.54KiB 1 16.39% 455.48KiB 352.54KiB 15.31KiB 0 0.77326 460.02KiB 361.72KiB 15.71KiB 0 0.78557 True True
syslog_humio_logs 106.99KiB 0.9 100.00% 11.55MiB 182.78KiB 7.42KiB 0 0.0154422 11.65MiB 153.35KiB 6.2KiB 0 0.0128397 False False
syslog_log2metric_splunk_hec_metrics 82.19KiB 0.67 100.00% 11.97MiB 271.74KiB 11.05KiB 0 0.0221574 12.05MiB 216.36KiB 8.8KiB 0 0.0175245 False False
http_to_http_acks 40.19KiB 0.43 12.33% 9.13MiB 4.38MiB 183.16KiB 0 0.480033 9.17MiB 4.42MiB 182.94KiB 0 0.481754 True True
http_datadog_filter_blackhole 17.34KiB 0.42 31.78% 4.01MiB 719.13KiB 29.19KiB 0 0.1751 4.02MiB 754.57KiB 30.65KiB 0 0.182955 False True
splunk_transforms_splunk3 19.27KiB 0.29 15.13% 6.52MiB 1.73MiB 71.87KiB 0 0.2653 6.54MiB 1.71MiB 70.99KiB 0 0.260666 False False
splunk_hec_indexer_ack_blackhole 9.44KiB 0.04 28.76% 23.83MiB 445.99KiB 18.06KiB 0 0.0182591 23.84MiB 453.99KiB 18.13KiB 0 0.0185801 False False
fluent_remap_aws_firehose 6.01KiB 0.01 83.26% 79.47MiB 52.39KiB 2.12KiB 0 0.00064322 79.48MiB 93.59KiB 3.79KiB 0 0.00114905 False False
splunk_hec_route_s3 -917.42B -0.01 0.54% 10.86MiB 2.25MiB 93.19KiB 0 0.207114 10.86MiB 2.24MiB 92.79KiB 0 0.206239 False False
fluent_elasticsearch -56.33KiB -0.07 99.56% 79.56MiB 433.69KiB 17.53KiB 0 0.0053191 79.5MiB 224.38KiB 9.07KiB 0 0.00275382 False False
splunk_hec_to_splunk_hec_logs_noack -33.2KiB -0.14 87.16% 23.88MiB 423.58KiB 16.85KiB 0 0.0173083 23.85MiB 342.8KiB 13.86KiB 0 0.0140262 False False
datadog_agent_remap_blackhole -84.68KiB -0.24 98.65% 34.96MiB 607.93KiB 24.7KiB 0 0.0169682 34.88MiB 582.38KiB 23.72KiB 0 0.0162936 False False
syslog_regex_logs2metric_ddmetrics -22.74KiB -0.26 98.64% 8.55MiB 171.86KiB 6.84KiB 0 0.0196151 8.53MiB 150.8KiB 6.16KiB 0 0.0172559 False False
splunk_hec_to_splunk_hec_logs_acks -116.68KiB -0.48 79.79% 23.85MiB 1.65MiB 68.88KiB 0 0.0690196 23.74MiB 1.45MiB 60.12KiB 0 0.0609772 False False
syslog_log2metric_humio_metrics -73.63KiB -0.61 100.00% 11.74MiB 277.55KiB 11.27KiB 0 0.0230708 11.67MiB 174.27KiB 7.11KiB 0 0.0145744 False False
syslog_splunk_hec_logs -92.73KiB -0.78 100.00% 11.56MiB 249.46KiB 10.08KiB 0 0.0210653 11.46MiB 276.95KiB 11.26KiB 0 0.023571 False False
http_pipelines_no_grok_blackhole -33.38KiB -0.87 54.70% 3.73MiB 770.43KiB 31.32KiB 0 0.201327 3.7MiB 772.94KiB 31.56KiB 0 0.20376 False False
datadog_agent_remap_datadog_logs -423.75KiB -0.96 100.00% 43.26MiB 678.56KiB 27.7KiB 0 0.0153052 42.85MiB 710.25KiB 28.34KiB 0 0.0161755 False False
http_pipelines_blackhole_acks -18.98KiB -1.36 35.97% 1.36MiB 724.67KiB 29.44KiB 0 0.520679 1.34MiB 688.45KiB 27.97KiB 0 0.501498 True True
datadog_agent_remap_blackhole_acks -771.97KiB -2.16 100.00% 34.95MiB 917.28KiB 37.29KiB 0 0.0256086 34.2MiB 817.64KiB 33.38KiB 0 0.0233299 False False
socket_to_socket_blackhole -282.71KiB -2.3 100.00% 12.0MiB 247.66KiB 10.06KiB 0 0.0201384 11.72MiB 1021.58KiB 45.96KiB 0 0.0850097 False False
datadog_agent_remap_datadog_logs_acks -1.08MiB -2.41 100.00% 44.97MiB 675.7KiB 27.38KiB 0 0.0146625 43.88MiB 666.75KiB 27.08KiB 0 0.0148248 False False
Fine details of each soak run.
(experiment, variant, run_id) total samples mean std min median p90 p95 p99 max skewness
('fluent_elasticsearch', 'baseline', '2282e108-086a-4e3d-9b85-34d9bd2daedf') 204 79.73MiB 716.7KiB 75.29MiB 79.49MiB 80.91MiB 81.25MiB 81.69MiB 82.02MiB 0.252229
('fluent_elasticsearch', 'comparison', '02173aec-efad-4106-872f-47537813e14a') 204 79.56MiB 372.46KiB 79.15MiB 79.48MiB 79.57MiB 80.35MiB 81.28MiB 81.53MiB 3.93659
('fluent_remap_aws_firehose', 'comparison', '7be18340-2eea-4f31-a3eb-63072e9c88d4') 203 79.49MiB 140.79KiB 79.12MiB 79.47MiB 79.55MiB 79.57MiB 79.91MiB 80.82MiB 6.47997
('fluent_remap_aws_firehose', 'comparison', '1ac9d21e-8e11-4d17-81d2-121b2a9e0eba') 203 79.47MiB 60.74KiB 79.35MiB 79.47MiB 79.56MiB 79.57MiB 79.6MiB 79.64MiB 0.142933
('fluent_remap_aws_firehose', 'comparison', '6b433f28-6668-4e5b-86cd-a051436a6e93') 203 79.47MiB 52.26KiB 79.34MiB 79.47MiB 79.54MiB 79.56MiB 79.59MiB 79.59MiB 0.107621
('fluent_elasticsearch', 'comparison', '4923b4b7-794d-435e-a091-db50e3101fd9') 204 79.47MiB 59.03KiB 79.34MiB 79.47MiB 79.54MiB 79.57MiB 79.62MiB 79.65MiB 0.188597
('fluent_remap_aws_firehose', 'baseline', '4c07b3a0-4b7f-4af8-8bcd-03b1c9ceda59') 203 79.47MiB 50.67KiB 79.36MiB 79.47MiB 79.54MiB 79.56MiB 79.57MiB 79.6MiB 0.10232
('fluent_elasticsearch', 'baseline', '4b902a4f-3442-4861-a5e7-a7a11deb13f0') 204 79.47MiB 50.55KiB 79.35MiB 79.47MiB 79.54MiB 79.56MiB 79.59MiB 79.6MiB 0.115193
('fluent_elasticsearch', 'comparison', '22cd1625-c41b-48e1-a399-9fd78b3ddbb9') 204 79.47MiB 58.84KiB 79.22MiB 79.47MiB 79.54MiB 79.57MiB 79.59MiB 79.75MiB 0.18191
('fluent_remap_aws_firehose', 'baseline', '9682f2af-c3f1-458a-abb6-51f1471e49a6') 203 79.47MiB 55.39KiB 79.33MiB 79.47MiB 79.54MiB 79.56MiB 79.59MiB 79.6MiB -0.013903
('fluent_remap_aws_firehose', 'baseline', '348f7d0c-6985-4582-8977-2cec3d4ecfc2') 203 79.47MiB 51.23KiB 79.3MiB 79.47MiB 79.54MiB 79.55MiB 79.59MiB 79.61MiB 0.0502342
('fluent_elasticsearch', 'baseline', '1737eeb1-c91e-472b-a627-1f6b28a33198') 204 79.47MiB 53.82KiB 79.29MiB 79.47MiB 79.54MiB 79.56MiB 79.6MiB 79.62MiB 0.0196738
('datadog_agent_remap_datadog_logs_acks', 'baseline', 'e3cd847e-6e47-403d-aaec-aa933860e861') 203 45.29MiB 370.14KiB 44.49MiB 45.3MiB 45.76MiB 45.9MiB 46.16MiB 46.24MiB 0.16003
('datadog_agent_remap_datadog_logs_acks', 'baseline', '33bdcfae-2de1-412e-b01d-faf583a86d65') 203 45.11MiB 519.65KiB 44.03MiB 45.24MiB 45.71MiB 45.81MiB 45.99MiB 46.11MiB -0.174836
('datadog_agent_remap_datadog_logs_acks', 'baseline', 'aa46a299-db35-4028-b1ea-7c691218402f') 203 44.5MiB 781.46KiB 43.41MiB 44.15MiB 45.72MiB 45.81MiB 46.05MiB 46.12MiB 0.657867
('datadog_agent_remap_datadog_logs_acks', 'comparison', 'e396c681-b529-4584-93d5-7c277420ce14') 202 44.03MiB 650.45KiB 42.97MiB 43.82MiB 44.87MiB 45.05MiB 45.22MiB 45.29MiB 0.215739
('datadog_agent_remap_datadog_logs_acks', 'comparison', '758cb9ca-0f94-4b61-af0d-3b5b6ee9ae20') 202 43.85MiB 784.59KiB 42.78MiB 43.53MiB 45.01MiB 45.1MiB 45.38MiB 45.4MiB 0.567844
('datadog_agent_remap_datadog_logs_acks', 'comparison', 'c14b6b78-3ed6-49d4-b97e-831c76c8ce1b') 202 43.78MiB 515.64KiB 43.03MiB 43.65MiB 44.7MiB 45.05MiB 45.28MiB 45.3MiB 1.57682
('datadog_agent_remap_datadog_logs', 'baseline', '684241c3-a7fd-4bdf-bf28-794b833cba30') 200 43.43MiB 640.14KiB 42.63MiB 43.15MiB 44.51MiB 44.65MiB 44.87MiB 44.96MiB 1.0083
('datadog_agent_remap_datadog_logs', 'baseline', 'e7319300-58b0-4ec6-a77d-02f8fec86102') 200 43.36MiB 654.13KiB 42.46MiB 43.07MiB 44.36MiB 44.48MiB 44.66MiB 44.91MiB 0.679994
('datadog_agent_remap_datadog_logs', 'comparison', 'c2fcce82-3d17-4f81-86f9-40b06ec72351') 228 43.33MiB 407.39KiB 42.57MiB 43.29MiB 43.92MiB 44.01MiB 44.11MiB 44.57MiB 0.320313
('datadog_agent_remap_datadog_logs', 'baseline', '09f7eaca-9ad6-4462-8467-009a55d847e4') 200 42.99MiB 659.25KiB 42.02MiB 42.75MiB 44.09MiB 44.27MiB 44.38MiB 44.74MiB 0.910961
('datadog_agent_remap_datadog_logs', 'comparison', 'd2f423d3-7d2d-4b52-ac73-62db214b45cd') 200 42.89MiB 618.71KiB 41.85MiB 42.86MiB 43.74MiB 43.85MiB 44.04MiB 44.1MiB 0.212051
('datadog_agent_remap_datadog_logs', 'comparison', '26c6382a-2b67-4c4d-81eb-d07cf0789664') 200 42.26MiB 606.74KiB 41.39MiB 42.04MiB 43.23MiB 43.49MiB 43.68MiB 43.94MiB 0.9962
('datadog_agent_remap_blackhole_acks', 'baseline', '95b38800-043d-4659-ba41-ff4a0d041ba8') 205 36.01MiB 435.34KiB 31.42MiB 36.02MiB 36.38MiB 36.5MiB 36.64MiB 36.89MiB -6.12849
('datadog_agent_remap_blackhole', 'baseline', 'c2820614-d516-42b1-84c2-97d3ea5c1671') 202 35.36MiB 212.22KiB 34.89MiB 35.34MiB 35.61MiB 35.68MiB 35.85MiB 35.96MiB 0.166865
('datadog_agent_remap_blackhole', 'comparison', 'bf1e2c53-4fa5-4f6b-b25c-512751c412cc') 201 35.28MiB 201.23KiB 34.82MiB 35.26MiB 35.53MiB 35.61MiB 35.72MiB 35.97MiB 0.427351
('datadog_agent_remap_blackhole', 'baseline', 'a749ae83-77d9-4b8d-adf2-2e8205bb8cb3') 202 35.19MiB 422.96KiB 34.28MiB 35.15MiB 35.76MiB 35.92MiB 36.1MiB 36.18MiB 0.258843
('datadog_agent_remap_blackhole', 'comparison', 'b262d55c-debb-4570-bdce-656ab2f77313') 201 34.96MiB 405.68KiB 34.0MiB 34.95MiB 35.46MiB 35.71MiB 35.86MiB 36.06MiB 0.212429
('datadog_agent_remap_blackhole_acks', 'comparison', 'e28bc058-e188-4260-9703-e6e09e422997') 200 34.74MiB 480.24KiB 33.85MiB 34.67MiB 35.37MiB 35.52MiB 35.85MiB 35.92MiB 0.254346
('datadog_agent_remap_blackhole_acks', 'baseline', '3902466f-5f67-48b9-be79-2a97daaedba8') 200 34.62MiB 463.91KiB 33.85MiB 34.54MiB 35.28MiB 35.43MiB 35.68MiB 35.75MiB 0.545012
('datadog_agent_remap_blackhole_acks', 'comparison', '5dc0358b-a851-4337-b34c-0b025becdd19') 200 34.55MiB 443.17KiB 33.59MiB 34.59MiB 35.09MiB 35.25MiB 35.36MiB 35.54MiB -0.186766
('datadog_agent_remap_blackhole', 'comparison', '34d78f58-0776-46a7-870f-35396fc5da81') 201 34.39MiB 626.16KiB 33.37MiB 34.25MiB 35.33MiB 35.48MiB 35.8MiB 35.95MiB 0.575163
('datadog_agent_remap_blackhole', 'baseline', '71b27854-f7b1-4e37-b6ff-c27cf5906b06') 202 34.33MiB 507.25KiB 33.45MiB 34.25MiB 35.04MiB 35.33MiB 35.75MiB 35.88MiB 0.911608
('datadog_agent_remap_blackhole_acks', 'baseline', '6eb68b0b-c4df-4344-af0b-f01ebb3b840d') 200 34.19MiB 461.91KiB 32.88MiB 34.2MiB 34.77MiB 34.83MiB 35.01MiB 35.12MiB -0.239063
('datadog_agent_remap_blackhole_acks', 'comparison', 'd057b2ec-2fcc-4910-99d5-b3f96cf7e904') 200 33.3MiB 542.15KiB 32.13MiB 33.36MiB 33.92MiB 34.07MiB 34.19MiB 34.39MiB -0.262893
('splunk_hec_to_splunk_hec_logs_noack', 'baseline', '1e676a43-cef3-41b4-ad56-13eadfef0beb') 232 23.95MiB 541.98KiB 22.9MiB 23.87MiB 24.45MiB 24.75MiB 25.59MiB 27.14MiB 2.07791
('splunk_hec_to_splunk_hec_logs_acks', 'baseline', '3ececd79-d1e5-4c3e-9b95-e961382c58ee') 200 23.9MiB 1.78MiB 19.49MiB 24.19MiB 25.87MiB 26.09MiB 26.88MiB 27.13MiB -0.886214
('splunk_hec_to_splunk_hec_logs_acks', 'comparison', 'bc5d6f39-b251-463d-a366-e4130476a79b') 203 23.9MiB 1.81MiB 19.23MiB 23.94MiB 26.15MiB 26.46MiB 27.23MiB 27.58MiB -0.53875
('splunk_hec_to_splunk_hec_logs_acks', 'baseline', '0e0295dc-0792-4093-ae93-3773daf54e78') 200 23.9MiB 1.86MiB 19.68MiB 24.07MiB 26.16MiB 26.38MiB 27.03MiB 27.64MiB -0.642618
('splunk_hec_indexer_ack_blackhole', 'comparison', 'c4826b1b-af52-4cc0-9c28-6a8a37c1a58e') 227 23.85MiB 462.91KiB 22.87MiB 23.82MiB 24.34MiB 24.45MiB 24.83MiB 26.94MiB 1.36241
('splunk_hec_to_splunk_hec_logs_noack', 'comparison', 'ae418b5d-5559-4543-89fc-c093d04fa685') 204 23.85MiB 347.84KiB 23.11MiB 23.84MiB 24.31MiB 24.39MiB 24.69MiB 24.7MiB 0.193107
('splunk_hec_to_splunk_hec_logs_noack', 'comparison', 'b02c38a3-4d62-4cc1-bdec-9fbc74f430b4') 204 23.85MiB 357.06KiB 22.91MiB 23.87MiB 24.28MiB 24.33MiB 24.65MiB 24.91MiB -0.0380157
('splunk_hec_to_splunk_hec_logs_noack', 'comparison', '0c5f87e6-2a9d-48e0-9d4e-4c2fa45da03c') 204 23.85MiB 324.36KiB 23.05MiB 23.84MiB 24.27MiB 24.33MiB 24.54MiB 24.69MiB -0.0315094
('splunk_hec_to_splunk_hec_logs_noack', 'baseline', '4d0c1c8a-ff46-46f4-8e23-3d356641c92a') 200 23.84MiB 326.71KiB 23.05MiB 23.87MiB 24.26MiB 24.36MiB 24.55MiB 24.63MiB -0.0191984
('splunk_hec_indexer_ack_blackhole', 'comparison', '856e0faa-0ed8-4898-8561-662f4f5ae7f7') 200 23.84MiB 436.14KiB 22.87MiB 23.82MiB 24.36MiB 24.6MiB 24.75MiB 24.9MiB 0.0641907
('splunk_hec_to_splunk_hec_logs_noack', 'baseline', 'f25479da-81e6-4c66-9944-e06296483460') 200 23.84MiB 334.29KiB 23.03MiB 23.87MiB 24.24MiB 24.33MiB 24.6MiB 24.64MiB -0.0905936
('splunk_hec_indexer_ack_blackhole', 'baseline', 'f086e7ed-3f4f-4050-acd7-a7d3d9e56a7c') 200 23.84MiB 417.54KiB 22.72MiB 23.87MiB 24.35MiB 24.45MiB 24.63MiB 24.69MiB -0.278816
('splunk_hec_indexer_ack_blackhole', 'baseline', '8b57f7bd-3a24-4cfe-9bef-3a5e9cea6c8c') 205 23.84MiB 431.45KiB 22.15MiB 23.85MiB 24.35MiB 24.54MiB 24.74MiB 24.81MiB -0.23496
('splunk_hec_indexer_ack_blackhole', 'comparison', 'cd062d17-461b-4e1b-ac07-11fa767db0fd') 200 23.84MiB 463.24KiB 21.99MiB 23.84MiB 24.39MiB 24.6MiB 24.81MiB 24.9MiB -0.261487
('splunk_hec_indexer_ack_blackhole', 'baseline', '62f24d61-ca94-4e4a-bf90-037a9f594338') 205 23.83MiB 487.32KiB 20.92MiB 23.85MiB 24.39MiB 24.59MiB 24.69MiB 24.93MiB -1.11217
('splunk_hec_to_splunk_hec_logs_acks', 'baseline', '12e43a82-0cc2-4424-ab39-e315775970cf') 200 23.76MiB 1.25MiB 20.56MiB 24.12MiB 25.03MiB 25.34MiB 25.76MiB 26.37MiB -0.807888
('splunk_hec_to_splunk_hec_logs_acks', 'comparison', '01bcb32e-0aee-4bff-a2b1-6001f252bea9') 203 23.69MiB 1.24MiB 19.98MiB 24.02MiB 24.91MiB 25.16MiB 25.4MiB 26.49MiB -0.960052
('splunk_hec_to_splunk_hec_logs_acks', 'comparison', 'b5124a5d-c764-4b1c-87ce-e71dd162b5fb') 203 23.63MiB 1.21MiB 20.26MiB 23.99MiB 24.82MiB 24.93MiB 25.78MiB 26.0MiB -0.958745
('http_to_http_noack', 'baseline', '4f43a884-3192-4567-b823-537fcad0d88c') 204 20.02MiB 744.99KiB 17.42MiB 20.04MiB 20.94MiB 21.24MiB 21.77MiB 22.58MiB 0.175326
('http_to_http_noack', 'comparison', '852a8a31-cb01-45df-9b3f-e3667b87d1c4') 204 19.65MiB 774.95KiB 17.39MiB 19.66MiB 20.68MiB 20.82MiB 21.21MiB 21.62MiB -0.0931029
('http_to_http_noack', 'baseline', '41df4ef0-405c-453d-a851-9f6aed3f7532') 204 19.58MiB 899.82KiB 17.41MiB 19.62MiB 20.55MiB 20.96MiB 21.48MiB 21.82MiB -0.106001
('http_to_http_noack', 'comparison', '35e07391-4868-4542-a682-e0ad99a77f81') 229 19.5MiB 886.44KiB 17.02MiB 19.51MiB 20.56MiB 20.9MiB 21.59MiB 21.86MiB -0.109091
('http_to_http_noack', 'comparison', 'bfff8898-2a91-43dc-af5d-fd1ec4536d93') 204 18.72MiB 843.05KiB 16.34MiB 18.8MiB 19.69MiB 19.96MiB 20.24MiB 20.9MiB -0.486823
('http_to_http_noack', 'baseline', 'fdd00297-f42f-4281-8a6b-fbbda1976074') 204 16.53MiB 861.07KiB 13.79MiB 16.52MiB 17.66MiB 18.0MiB 18.47MiB 18.62MiB 0.0964871
('http_to_http_json', 'comparison', 'beb641fa-f3c9-40fc-99b3-7a94e9229c84') 204 16.2MiB 896.84KiB 13.74MiB 16.16MiB 17.35MiB 17.64MiB 17.96MiB 18.53MiB -0.078157
('http_to_http_json', 'comparison', '6939973f-d429-4e10-ae51-efa961f22415') 204 16.12MiB 812.65KiB 13.74MiB 16.12MiB 17.07MiB 17.32MiB 17.96MiB 18.39MiB -0.0484088
('http_to_http_json', 'comparison', '2c947c78-990a-4589-a48e-8e132aca29d3') 229 16.02MiB 926.23KiB 13.15MiB 15.93MiB 17.26MiB 17.52MiB 18.09MiB 18.25MiB 0.0450144
('http_to_http_json', 'baseline', 'b463b0ab-9bf3-4585-b82f-7520b73c090d') 201 15.89MiB 921.51KiB 13.46MiB 15.9MiB 16.98MiB 17.35MiB 18.31MiB 18.56MiB 0.117942
('http_to_http_json', 'baseline', '0676cb32-883d-4cae-bf10-b2caa919693c') 229 15.89MiB 800.18KiB 13.88MiB 15.8MiB 16.92MiB 17.28MiB 17.64MiB 17.97MiB 0.196205
('http_to_http_json', 'baseline', '11a4f4dc-847a-4f29-8bc0-0e790df53d97') 200 15.75MiB 1003.73KiB 12.34MiB 15.65MiB 17.11MiB 17.48MiB 18.03MiB 18.41MiB 0.209187
('socket_to_socket_blackhole', 'baseline', '0b084f8c-858b-4b91-9cd4-11289f54aa51') 202 12.33MiB 37.22KiB 12.24MiB 12.33MiB 12.37MiB 12.39MiB 12.41MiB 12.43MiB -0.0737379
('syslog_log2metric_splunk_hec_metrics', 'comparison', 'efe26b85-352d-4ead-86b3-0fc3311a1926') 200 12.23MiB 62.32KiB 12.09MiB 12.24MiB 12.31MiB 12.34MiB 12.39MiB 12.42MiB 0.423556
('syslog_log2metric_splunk_hec_metrics', 'baseline', '49a6b763-2d8a-4cbd-af0a-350421cac1b6') 205 12.22MiB 45.5KiB 12.03MiB 12.22MiB 12.28MiB 12.29MiB 12.3MiB 12.33MiB -0.282751
('syslog_log2metric_splunk_hec_metrics', 'comparison', '5f2d7bcd-81d6-466f-8752-21951ed6d9a9') 204 12.14MiB 58.12KiB 12.0MiB 12.14MiB 12.22MiB 12.23MiB 12.24MiB 12.26MiB -0.294012
('syslog_log2metric_splunk_hec_metrics', 'baseline', 'aa682099-441e-4b1e-9075-a11f99d1e7d3') 200 12.06MiB 89.57KiB 11.9MiB 12.03MiB 12.19MiB 12.2MiB 12.23MiB 12.26MiB 0.279146
('syslog_log2metric_humio_metrics', 'baseline', '389be41b-6e62-46b3-aa57-a5b6baffd9fb') 202 12.01MiB 52.53KiB 11.91MiB 12.0MiB 12.08MiB 12.09MiB 12.13MiB 12.15MiB 0.528215
('socket_to_socket_blackhole', 'baseline', 'a9bbcd60-b50c-4494-9bfb-35838eff3e24') 202 11.84MiB 70.53KiB 11.66MiB 11.84MiB 11.93MiB 11.95MiB 12.0MiB 12.02MiB 0.031239
('socket_to_socket_blackhole', 'baseline', '18fe37f5-b797-4ca9-94c2-0fa4121184d4') 202 11.83MiB 77.57KiB 11.62MiB 11.84MiB 11.93MiB 11.96MiB 12.01MiB 12.03MiB 0.0274422
('socket_to_socket_blackhole', 'comparison', '178e9708-543b-4e1d-9f01-0d663facd0aa') 202 11.81MiB 101.64KiB 11.44MiB 11.81MiB 11.92MiB 11.95MiB 12.0MiB 12.08MiB -0.618029
('socket_to_socket_blackhole', 'comparison', '31eddb2d-716e-4463-83bc-be517a3fa83e') 202 11.8MiB 76.86KiB 11.54MiB 11.8MiB 11.9MiB 11.92MiB 11.98MiB 12.03MiB 0.117257
('syslog_log2metric_humio_metrics', 'baseline', '77ad12ae-aa5a-4fa8-a9c7-a63987052835') 202 11.79MiB 166.24KiB 11.56MiB 11.8MiB 12.0MiB 12.02MiB 12.06MiB 12.08MiB 0.111734
('syslog_humio_logs', 'comparison', 'f90ea10d-1d8b-4898-a915-c3d1bea4fe75') 204 11.78MiB 121.22KiB 11.47MiB 11.8MiB 11.92MiB 11.95MiB 11.96MiB 11.98MiB -0.767449
('syslog_splunk_hec_logs', 'baseline', 'beca1554-f552-4257-9cbd-f0b014eca1b7') 204 11.77MiB 49.41KiB 11.64MiB 11.77MiB 11.83MiB 11.84MiB 11.87MiB 11.89MiB -0.185517
('syslog_log2metric_splunk_hec_metrics', 'comparison', 'dbc93981-cc2c-46b2-b9f5-c4eceb36fe27') 200 11.76MiB 46.33KiB 11.64MiB 11.76MiB 11.81MiB 11.84MiB 11.87MiB 11.89MiB 0.0261372
('syslog_log2metric_humio_metrics', 'comparison', '46b421ca-bd38-4f5e-9e63-a3b8ab1f026c') 200 11.75MiB 160.29KiB 11.5MiB 11.76MiB 11.96MiB 11.97MiB 12.0MiB 12.01MiB 0.0699237
('syslog_splunk_hec_logs', 'comparison', '1c18c5ac-4bdf-4112-8f1b-5cd7084d8c0b') 200 11.7MiB 118.86KiB 11.46MiB 11.68MiB 11.86MiB 11.9MiB 11.95MiB 11.96MiB 0.298709
('syslog_log2metric_humio_metrics', 'comparison', '784f8ff6-b646-44d6-9065-edcfdef5129f') 200 11.7MiB 157.01KiB 11.52MiB 11.63MiB 11.94MiB 11.97MiB 12.02MiB 12.03MiB 0.803309
('syslog_humio_logs', 'comparison', '90b610e8-638b-4445-b29c-1c73856d9040') 204 11.68MiB 77.97KiB 11.55MiB 11.67MiB 11.74MiB 11.87MiB 11.96MiB 12.0MiB 1.93585
('syslog_humio_logs', 'baseline', '4243e9b1-367e-4b2a-876e-c8a330f319cb') 202 11.67MiB 57.62KiB 11.56MiB 11.67MiB 11.75MiB 11.78MiB 11.84MiB 11.86MiB 0.783587
('syslog_splunk_hec_logs', 'baseline', '7aaa4be8-1550-427a-9eba-70b9abaa7f6e') 204 11.65MiB 123.84KiB 11.39MiB 11.63MiB 11.81MiB 11.86MiB 11.92MiB 11.96MiB 0.364583
('syslog_log2metric_splunk_hec_metrics', 'baseline', '0e0798e7-2867-431e-9b9c-feda087db963') 200 11.61MiB 71.16KiB 11.46MiB 11.61MiB 11.73MiB 11.75MiB 11.78MiB 11.79MiB 0.575448
('syslog_humio_logs', 'baseline', 'fdc740ee-e2f3-4100-bb4f-2aff4fb72c32') 202 11.61MiB 187.24KiB 11.4MiB 11.52MiB 11.9MiB 11.94MiB 11.97MiB 11.98MiB 0.818822
('syslog_log2metric_humio_metrics', 'comparison', 'b4d8c4e1-c1ac-4bf6-8312-d2d5285327ad') 200 11.55MiB 134.07KiB 11.29MiB 11.58MiB 11.71MiB 11.73MiB 11.75MiB 11.77MiB -0.434365
('syslog_humio_logs', 'comparison', 'f3821cde-3852-4e3b-82f7-82b966d7d3dd') 204 11.5MiB 77.44KiB 11.24MiB 11.5MiB 11.59MiB 11.61MiB 11.65MiB 11.69MiB -0.274032
('syslog_splunk_hec_logs', 'comparison', '1a65033c-d4c0-49b4-ac08-5955444996bd') 205 11.47MiB 285.73KiB 11.1MiB 11.28MiB 11.83MiB 11.86MiB 11.89MiB 11.94MiB 0.209678
('syslog_log2metric_humio_metrics', 'baseline', 'b85de32b-72e8-44a0-97a3-039cfbd7a5ab') 202 11.42MiB 115.44KiB 11.16MiB 11.44MiB 11.56MiB 11.57MiB 11.58MiB 11.62MiB -0.616814
('syslog_humio_logs', 'baseline', '388bc1e3-f9e8-4ee7-8c36-58aea4a3f20a') 202 11.36MiB 73.5KiB 11.17MiB 11.35MiB 11.47MiB 11.5MiB 11.53MiB 11.55MiB 0.416192
('socket_to_socket_blackhole', 'comparison', '872c30b6-ba09-43ca-b5f4-e1988afdfd0d') 90 11.36MiB 2.31MiB 429.25B 11.87MiB 11.92MiB 11.93MiB 11.95MiB 11.96MiB -4.54065
('syslog_splunk_hec_logs', 'baseline', '91f9259c-5954-490c-a4cd-9c320ed513c8') 204 11.24MiB 103.0KiB 11.04MiB 11.22MiB 11.39MiB 11.42MiB 11.45MiB 11.45MiB 0.338854
('syslog_splunk_hec_logs', 'comparison', '27e16d50-5b41-4afb-9105-e15b6c138c13') 200 11.22MiB 94.12KiB 11.02MiB 11.19MiB 11.35MiB 11.39MiB 11.43MiB 11.44MiB 0.69108
('splunk_hec_route_s3', 'baseline', 'd2840d17-cf75-479b-9243-31ceb3f44c97') 204 10.92MiB 2.21MiB 7.64MiB 10.88MiB 14.09MiB 14.48MiB 15.12MiB 15.51MiB 0.230795
('splunk_hec_route_s3', 'comparison', '53f4073d-723b-4b9f-ad20-417aede28760') 204 10.91MiB 2.24MiB 7.36MiB 10.79MiB 14.22MiB 14.52MiB 15.21MiB 15.39MiB 0.238764
('splunk_hec_route_s3', 'comparison', '4fbdd2de-f3fa-4152-ab07-7d6169168b82') 204 10.89MiB 2.22MiB 7.54MiB 10.79MiB 14.04MiB 14.43MiB 15.12MiB 15.73MiB 0.216683
('splunk_hec_route_s3', 'baseline', '095342a5-e873-418a-b8ef-aec2096582a9') 204 10.89MiB 2.27MiB 7.61MiB 10.66MiB 14.11MiB 14.73MiB 15.36MiB 15.51MiB 0.295363
('splunk_hec_route_s3', 'comparison', 'c0aee5dc-bf3d-4e9c-8f3d-63c02493333c') 204 10.78MiB 2.27MiB 7.17MiB 10.68MiB 13.86MiB 14.6MiB 15.25MiB 15.63MiB 0.293667
('splunk_hec_route_s3', 'baseline', '6c950602-c7ee-406f-a067-872d971d8451') 204 10.78MiB 2.28MiB 7.18MiB 10.73MiB 13.95MiB 14.52MiB 15.11MiB 15.72MiB 0.240164
('http_to_http_acks', 'comparison', '16705211-6a63-4086-bb44-fe736315aa57') 204 9.45MiB 4.79MiB 1.65MiB 9.02MiB 17.39MiB 18.78MiB 19.27MiB 19.61MiB 0.505051
('http_to_http_acks', 'comparison', '163fb11e-6aaa-40c1-bfdf-100000c69eab') 204 9.44MiB 4.51MiB 2.05MiB 9.32MiB 16.64MiB 17.66MiB 19.09MiB 19.11MiB 0.450215
('http_to_http_acks', 'baseline', '0756d097-20c6-4c01-87ac-48448aa55fca') 200 9.29MiB 4.56MiB 2.35MiB 9.17MiB 17.28MiB 17.8MiB 18.8MiB 19.27MiB 0.46318
('http_to_http_acks', 'baseline', '80e2b0d2-5255-4665-bc74-847562e3a7d6') 201 9.25MiB 4.59MiB 2.19MiB 9.02MiB 17.25MiB 18.45MiB 19.3MiB 20.08MiB 0.609428
('http_to_http_acks', 'baseline', '9772b97b-2611-40a6-8af9-8197af61d56c') 200 8.84MiB 3.99MiB 2.17MiB 9.08MiB 15.35MiB 17.46MiB 18.05MiB 19.15MiB 0.561532
('syslog_regex_logs2metric_ddmetrics', 'baseline', '32000936-10fa-4037-89a7-07345be41eba') 200 8.65MiB 88.31KiB 8.49MiB 8.64MiB 8.77MiB 8.78MiB 8.81MiB 9.25MiB 1.8634
('http_to_http_acks', 'comparison', 'ba0474aa-fd65-4e36-adb8-83d014bdf8a1') 204 8.61MiB 3.88MiB 1.34MiB 9.07MiB 12.95MiB 17.03MiB 19.05MiB 19.15MiB 0.615001
('syslog_regex_logs2metric_ddmetrics', 'comparison', '6e323383-58ce-455c-85fa-481e5707fc33') 200 8.58MiB 110.84KiB 8.42MiB 8.54MiB 8.77MiB 8.78MiB 8.81MiB 8.85MiB 0.816367
('syslog_regex_logs2metric_ddmetrics', 'baseline', 'd4e024ca-cd98-429b-b3e7-199f4876bbc5') 232 8.52MiB 159.11KiB 7.66MiB 8.47MiB 8.76MiB 8.77MiB 8.8MiB 9.36MiB 0.463837
('syslog_regex_logs2metric_ddmetrics', 'comparison', 'e1f00f93-f26b-49b1-9249-74a51ce902c0') 200 8.5MiB 172.07KiB 8.14MiB 8.47MiB 8.76MiB 8.77MiB 8.81MiB 9.4MiB 1.07469
('syslog_regex_logs2metric_ddmetrics', 'comparison', '6d7c0d94-4993-4836-8832-e4c99459a167') 200 8.5MiB 147.92KiB 7.94MiB 8.44MiB 8.76MiB 8.77MiB 8.79MiB 8.81MiB 0.647195
('syslog_regex_logs2metric_ddmetrics', 'baseline', '534f320c-e6e5-45db-9c7b-c16c2e33cb91') 200 8.48MiB 198.03KiB 8.11MiB 8.51MiB 8.76MiB 8.77MiB 8.8MiB 8.8MiB -0.030437
('syslog_loki', 'comparison', 'f0e92a48-2b24-4457-82d4-c0903531c3b0') 200 7.25MiB 29.25KiB 7.17MiB 7.25MiB 7.29MiB 7.3MiB 7.31MiB 7.33MiB -0.0241327
('syslog_loki', 'comparison', '1d729f75-84fd-4538-8b21-0602485833d3') 200 7.25MiB 44.13KiB 7.15MiB 7.25MiB 7.31MiB 7.32MiB 7.34MiB 7.36MiB 0.137134
('syslog_loki', 'comparison', '5736c206-6462-44e2-80cb-fff8ff12d3db') 200 7.18MiB 28.28KiB 7.11MiB 7.18MiB 7.21MiB 7.23MiB 7.25MiB 7.25MiB 0.00706037
('syslog_loki', 'baseline', 'b33a6386-10e1-4063-bdcc-d6f59b45f946') 202 7.16MiB 43.37KiB 7.06MiB 7.16MiB 7.21MiB 7.23MiB 7.25MiB 7.27MiB 0.0119886
('syslog_loki', 'baseline', 'fdb25554-679c-4889-abaa-4d6f7f8712bf') 202 6.96MiB 90.71KiB 6.74MiB 6.97MiB 7.06MiB 7.1MiB 7.13MiB 7.18MiB -0.151014
('syslog_loki', 'baseline', '09695646-32d9-4ffd-a304-1ac25f36129d') 78 6.77MiB 1.64MiB 24.75KiB 7.2MiB 7.23MiB 7.23MiB 7.25MiB 7.25MiB -3.76676
('splunk_transforms_splunk3', 'baseline', '35bcf590-f0c2-4d3b-b2b1-c3bc737bd14a') 203 6.61MiB 1.71MiB 3.84MiB 5.87MiB 9.03MiB 9.29MiB 9.58MiB 9.8MiB 0.299767
('splunk_transforms_splunk3', 'comparison', 'c263dec9-62ca-48bd-a134-05c85c7dd39e') 202 6.59MiB 1.74MiB 3.86MiB 5.8MiB 9.03MiB 9.33MiB 9.68MiB 10.06MiB 0.333455
('splunk_transforms_splunk3', 'comparison', 'f1bd5dd1-12cf-4e12-953e-d3c0ffcc7a11') 202 6.56MiB 1.71MiB 4.08MiB 5.97MiB 8.95MiB 9.23MiB 9.58MiB 9.94MiB 0.314647
('splunk_transforms_splunk3', 'baseline', '0046150a-455b-4b6a-944e-fbef746a811c') 203 6.49MiB 1.75MiB 3.84MiB 5.91MiB 8.98MiB 9.22MiB 9.68MiB 11.5MiB 0.373716
('splunk_transforms_splunk3', 'baseline', '9afd42d8-2463-464a-aa4c-96871dad7a10') 203 6.48MiB 1.73MiB 3.84MiB 5.84MiB 8.98MiB 9.22MiB 9.58MiB 9.67MiB 0.294236
('splunk_transforms_splunk3', 'comparison', '1bd7033e-dfdf-4dda-b4c6-ee9601940597') 202 6.48MiB 1.68MiB 3.81MiB 5.77MiB 8.82MiB 9.17MiB 9.55MiB 9.57MiB 0.308333
('http_datadog_filter_blackhole', 'comparison', '77c15bf7-b49b-497d-9b2f-02daca80078c') 202 4.09MiB 696.42KiB 2.08MiB 4.19MiB 4.93MiB 5.15MiB 5.41MiB 5.77MiB -0.282493
('http_datadog_filter_blackhole', 'baseline', '43678e0f-4d15-4828-9bc1-d02bb7e3a268') 202 4.02MiB 695.46KiB 1.93MiB 4.08MiB 4.81MiB 5.19MiB 5.29MiB 5.41MiB -0.48056
('http_datadog_filter_blackhole', 'baseline', 'cc835098-6041-49e2-b533-de468f8c7278') 202 4.01MiB 728.12KiB 1.92MiB 4.09MiB 4.87MiB 5.27MiB 5.41MiB 5.41MiB -0.31569
('http_datadog_filter_blackhole', 'comparison', '2e2fdc10-1126-4c37-bbb8-4badff756ae1') 202 4.01MiB 828.25KiB 1.46MiB 4.08MiB 4.97MiB 5.18MiB 5.41MiB 8.99MiB 0.688834
('http_datadog_filter_blackhole', 'baseline', 'd9a2798f-5375-4297-b7ae-2d23f11ad09d') 203 3.99MiB 736.33KiB 1.98MiB 4.08MiB 4.96MiB 5.23MiB 5.41MiB 5.65MiB -0.366086
('http_datadog_filter_blackhole', 'comparison', 'b51baf88-5f16-48b0-a61f-f718be1d9e05') 202 3.97MiB 731.67KiB 1.9MiB 4.08MiB 4.87MiB 5.18MiB 5.31MiB 5.41MiB -0.3619
('http_pipelines_no_grok_blackhole', 'baseline', '5ea557d1-a064-4dc4-8777-80f951f91abd') 200 3.77MiB 778.74KiB 1.75MiB 3.82MiB 4.63MiB 4.96MiB 5.29MiB 5.43MiB -0.503654
('http_pipelines_no_grok_blackhole', 'baseline', '2bf9477b-a872-49e7-abd1-b44c809ea363') 205 3.75MiB 774.39KiB 1.48MiB 3.79MiB 4.61MiB 4.93MiB 5.22MiB 5.41MiB -0.466676
('http_pipelines_no_grok_blackhole', 'comparison', 'e63acae0-b393-47ce-b318-3cf4218de313') 200 3.72MiB 777.97KiB 553.97KiB 3.8MiB 4.5MiB 4.95MiB 5.29MiB 5.29MiB -0.651594
('http_pipelines_no_grok_blackhole', 'comparison', '762cc1e2-e41d-4939-a86d-0e1191915022') 200 3.72MiB 757.71KiB 1.23MiB 3.83MiB 4.5MiB 4.81MiB 5.29MiB 5.29MiB -0.469258
('http_pipelines_no_grok_blackhole', 'baseline', 'c5814f05-53a0-45d7-bf13-1798b43103ea') 200 3.68MiB 758.53KiB 1.43MiB 3.74MiB 4.5MiB 4.87MiB 5.27MiB 5.29MiB -0.43247
('http_pipelines_no_grok_blackhole', 'comparison', 'e250bace-9163-42ba-abd2-514111cf8568') 200 3.66MiB 784.79KiB 1.83MiB 3.73MiB 4.5MiB 4.99MiB 5.29MiB 5.41MiB -0.299063
('http_pipelines_blackhole_acks', 'comparison', '392d5a6a-7dc4-4295-b53a-581f9ad4a3ab') 202 1.4MiB 700.81KiB 245.0KiB 1.44MiB 2.23MiB 2.43MiB 3.11MiB 3.56MiB 0.449139
('http_pipelines_blackhole_acks', 'baseline', 'ef048feb-47ab-4a33-b8a8-24a76a72cb08') 202 1.39MiB 750.61KiB 78.86KiB 1.35MiB 2.44MiB 2.73MiB 3.11MiB 3.26MiB 0.460646
('http_pipelines_blackhole_acks', 'baseline', '8dbd9d7f-ac62-4b8d-b1a3-df786a7b8b0c') 202 1.37MiB 719.2KiB 245.0KiB 1.33MiB 2.26MiB 2.67MiB 3.11MiB 3.14MiB 0.516616
('http_pipelines_blackhole_acks', 'comparison', 'ad8c1a32-17ff-46a3-b9e3-6e9c0edfb6ca') 202 1.31MiB 687.11KiB 123.02KiB 1.33MiB 2.17MiB 2.35MiB 2.91MiB 3.55MiB 0.352581
('http_pipelines_blackhole_acks', 'comparison', '8b5c95c7-32ca-45ac-af74-9916c65e300a') 202 1.31MiB 676.36KiB 123.02KiB 1.32MiB 2.19MiB 2.53MiB 2.91MiB 3.14MiB 0.389658
('http_pipelines_blackhole_acks', 'baseline', '2bbfa8ca-57e3-436c-a2a9-f58120ed8412') 202 1.31MiB 703.91KiB 123.02KiB 1.34MiB 2.24MiB 2.43MiB 3.06MiB 3.14MiB 0.423349
('http_pipelines_blackhole', 'baseline', 'e05dad0d-aa09-41f6-93b3-ae80f7e9d184') 174 463.07KiB 355.18KiB 15.99KiB 368.53KiB 1003.83KiB 1.11MiB 1.43MiB 1.48MiB 0.928205
('http_pipelines_blackhole', 'comparison', '0d53c197-b2a3-44aa-b69b-a3f466081d78') 176 462.89KiB 374.59KiB 15.99KiB 368.02KiB 1008.08KiB 1.12MiB 1.51MiB 1.57MiB 1.07251
('http_pipelines_blackhole', 'comparison', '33cd9316-2ceb-4d40-a0ac-67f1b7d25e9d') 177 460.27KiB 359.03KiB 15.99KiB 368.02KiB 1023.97KiB 1.11MiB 1.45MiB 1.49MiB 1.07609
('http_pipelines_blackhole', 'comparison', '76e55ce3-f241-4c5b-b651-f28ff23c544f') 177 456.92KiB 353.3KiB 15.99KiB 340.37KiB 986.0KiB 1.09MiB 1.48MiB 1.49MiB 1.15744
('http_pipelines_blackhole', 'baseline', '192f6f8a-e808-442f-ace7-8fe79cdfcd4c') 177 454.99KiB 327.09KiB 15.99KiB 368.02KiB 1013.94KiB 1.07MiB 1.2MiB 1.22MiB 0.753083
('http_pipelines_blackhole', 'baseline', '061ab6d7-6dba-4cae-9efa-42464532ac20') 179 448.59KiB 375.32KiB 15.99KiB 338.25KiB 995.62KiB 1.21MiB 1.5MiB 1.91MiB 1.39162

Signed-off-by: Jesse Szwedko <[email protected]>
@github-actions
Copy link

Soak Test Results

Baseline: 258c49a
Comparison: 678f7d8
Total Vector CPUs: 4

Explanation

A soak test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their throughput performance between baseline and comparision SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±5% change in mean throughput are discarded. An experiment is erratic if its coefficient of variation is greater than 0.3. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in throughput with confidence ≥ 90.00% and absolute Δ mean >= ±5%:

Fine details of change detection per experiment.
experiment Δ mean Δ mean % confidence baseline mean baseline stdev baseline stderr baseline outlier % baseline CoV comparison mean comparison stdev comparison stderr comparison outlier % comparison CoV erratic declared erratic
http_pipelines_blackhole_acks 43.34KiB 3.34 71.86% 1.27MiB 698.81KiB 28.36KiB 0 0.538034 1.31MiB 701.38KiB 28.52KiB 0 0.522557 True True
syslog_regex_logs2metric_ddmetrics 266.47KiB 3.09 100.00% 8.43MiB 1.11MiB 51.81KiB 0 0.131601 8.69MiB 106.17KiB 4.33KiB 0 0.0119183 False False
syslog_splunk_hec_logs 320.63KiB 2.74 100.00% 11.44MiB 165.03KiB 6.67KiB 0 0.0140776 11.75MiB 238.67KiB 9.74KiB 0 0.0198165 False False
syslog_humio_logs 243.01KiB 2.06 100.00% 11.53MiB 273.48KiB 11.11KiB 0 0.023144 11.77MiB 168.83KiB 6.82KiB 0 0.0139995 False False
datadog_agent_remap_blackhole 707.81KiB 2.02 100.00% 34.21MiB 527.51KiB 21.43KiB 0 0.0150479 34.9MiB 485.81KiB 19.7KiB 0 0.0135838 False False
datadog_agent_remap_datadog_logs 738.33KiB 1.71 100.00% 42.23MiB 820.63KiB 33.5KiB 0 0.0189597 42.95MiB 524.25KiB 20.92KiB 0 0.0119093 False False
http_pipelines_blackhole 2.47KiB 0.55 9.17% 449.85KiB 346.57KiB 15.1KiB 0 0.769688 452.32KiB 354.11KiB 15.25KiB 0 0.782162 True True
splunk_hec_to_splunk_hec_logs_acks 92.02KiB 0.38 65.94% 23.59MiB 1.67MiB 69.96KiB 0 0.0708904 23.68MiB 1.64MiB 66.5KiB 0 0.0691175 False False
syslog_loki 14.01KiB 0.19 99.01% 7.11MiB 51.53KiB 2.09KiB 0 0.00706773 7.13MiB 122.42KiB 5.0KiB 0 0.0167591 False False
syslog_log2metric_humio_metrics 14.48KiB 0.12 78.48% 11.55MiB 154.6KiB 6.28KiB 0 0.0130568 11.57MiB 241.2KiB 9.85KiB 0 0.020345 False False
splunk_hec_indexer_ack_blackhole 3.0KiB 0.01 9.80% 23.84MiB 424.2KiB 17.32KiB 0 0.0173643 23.84MiB 419.45KiB 17.12KiB 0 0.0171678 False False
fluent_remap_aws_firehose -444.56B -0 10.88% 79.47MiB 54.65KiB 2.21KiB 0 0.000670978 79.47MiB 56.13KiB 2.27KiB 0 0.000689113 False False
splunk_hec_to_splunk_hec_logs_noack -3.51KiB -0.01 12.17% 23.88MiB 414.08KiB 16.47KiB 0 0.0169187 23.88MiB 402.44KiB 15.92KiB 0 0.0164455 False False
fluent_elasticsearch -54.93KiB -0.07 99.86% 79.56MiB 360.29KiB 14.56KiB 0 0.00441887 79.51MiB 223.36KiB 9.03KiB 0 0.00274123 False False
splunk_transforms_splunk3 -13.5KiB -0.21 10.93% 6.4MiB 1.67MiB 69.1KiB 0 0.260149 6.38MiB 1.68MiB 69.82KiB 0 0.262751 False False
http_to_http_json -117.84KiB -0.71 98.13% 16.15MiB 832.05KiB 33.12KiB 0 0.0502848 16.03MiB 928.28KiB 37.52KiB 0 0.0565019 False False
splunk_hec_route_s3 -114.22KiB -1.02 61.22% 10.93MiB 2.28MiB 94.54KiB 0 0.208723 10.82MiB 2.23MiB 92.41KiB 0 0.206119 False False
socket_to_socket_blackhole -149.77KiB -1.18 99.71% 12.35MiB 1.07MiB 49.61KiB 0 0.0869484 12.2MiB 165.09KiB 6.71KiB 0 0.0132039 False False
http_to_http_acks -105.25KiB -1.19 34.64% 8.65MiB 4.12MiB 171.52KiB 0 0.476206 8.55MiB 3.86MiB 159.81KiB 0 0.451243 True True
syslog_log2metric_splunk_hec_metrics -169.83KiB -1.39 99.05% 11.95MiB 1.39MiB 65.13KiB 0 0.11665 11.78MiB 88.03KiB 3.5KiB 0 0.00729175 False False
datadog_agent_remap_datadog_logs_acks -770.64KiB -1.68 100.00% 44.69MiB 527.89KiB 21.39KiB 0 0.0115246 43.94MiB 422.64KiB 17.17KiB 0 0.00938486 False False
http_to_http_noack -357.58KiB -1.76 100.00% 19.88MiB 833.09KiB 33.68KiB 0 0.0408833 19.53MiB 880.69KiB 35.6KiB 0 0.043992 False False
http_pipelines_no_grok_blackhole -90.59KiB -2.36 95.81% 3.74MiB 778.35KiB 31.78KiB 0 0.202798 3.66MiB 779.65KiB 31.11KiB 0 0.20806 False False
datadog_agent_remap_blackhole_acks -904.03KiB -2.5 100.00% 35.38MiB 407.03KiB 16.62KiB 0 0.0112249 34.5MiB 782.9KiB 31.83KiB 0 0.022143 False False
http_datadog_filter_blackhole -127.82KiB -3.08 99.84% 4.06MiB 701.68KiB 28.5KiB 0 0.168746 3.93MiB 704.89KiB 28.63KiB 0 0.174898 False True
Fine details of each soak run.
(experiment, variant, run_id) total samples mean std min median p90 p95 p99 max skewness
('fluent_elasticsearch', 'baseline', '45aebaae-691f-4eb2-9478-3d0e5a51bd1a') 204 79.73MiB 581.16KiB 74.31MiB 79.6MiB 80.35MiB 80.51MiB 80.78MiB 81.66MiB -3.85137
('fluent_elasticsearch', 'comparison', '0708da8c-5971-4c12-a36d-d48e2488d8b3') 204 79.57MiB 370.34KiB 79.34MiB 79.47MiB 79.58MiB 80.36MiB 81.31MiB 81.78MiB 3.94998
('fluent_elasticsearch', 'baseline', 'f90f442e-a63c-40d1-8a32-730427b90e57') 204 79.47MiB 55.05KiB 79.36MiB 79.47MiB 79.55MiB 79.56MiB 79.6MiB 79.61MiB 0.240523
('fluent_remap_aws_firehose', 'baseline', '805e2ea2-568c-4e04-acd8-64fdc1d3d3ec') 203 79.47MiB 56.57KiB 79.34MiB 79.47MiB 79.55MiB 79.57MiB 79.6MiB 79.62MiB 0.252281
('fluent_remap_aws_firehose', 'comparison', '049682da-d486-4eb5-9ccf-2f0fd0e07833') 203 79.47MiB 54.38KiB 79.32MiB 79.47MiB 79.54MiB 79.56MiB 79.58MiB 79.6MiB -0.146966
('fluent_remap_aws_firehose', 'comparison', 'f3fb6fa1-be4d-4b7e-a243-4aca2644df8a') 203 79.47MiB 58.98KiB 79.33MiB 79.47MiB 79.56MiB 79.57MiB 79.6MiB 79.62MiB 0.157994
('fluent_remap_aws_firehose', 'baseline', '6ec44459-a0df-48d6-bf35-45b1c83fb073') 203 79.47MiB 53.36KiB 79.34MiB 79.47MiB 79.54MiB 79.56MiB 79.57MiB 79.59MiB -0.0788184
('fluent_remap_aws_firehose', 'baseline', 'ff0df87b-a25a-4411-9a68-298d06a7c1cd') 203 79.47MiB 54.24KiB 79.33MiB 79.47MiB 79.55MiB 79.56MiB 79.58MiB 79.62MiB 0.0438518
('fluent_elasticsearch', 'comparison', 'afb56e25-d3e5-45d3-ab45-f37180155466') 204 79.47MiB 53.63KiB 79.34MiB 79.47MiB 79.54MiB 79.57MiB 79.59MiB 79.6MiB 0.0191488
('fluent_remap_aws_firehose', 'comparison', '5b71b614-9917-4a51-b599-7e3f0280f2e6') 203 79.47MiB 55.18KiB 79.33MiB 79.47MiB 79.55MiB 79.57MiB 79.59MiB 79.61MiB 0.115684
('fluent_elasticsearch', 'baseline', '2033bedf-3a1e-4b76-8d0e-6bb1defee9e8') 204 79.47MiB 54.93KiB 79.29MiB 79.47MiB 79.54MiB 79.56MiB 79.6MiB 79.62MiB 0.0761216
('fluent_elasticsearch', 'comparison', '93b4d2ac-97c4-497f-b2d1-d16f23291131') 204 79.47MiB 56.62KiB 79.25MiB 79.47MiB 79.54MiB 79.56MiB 79.6MiB 79.62MiB -0.113115
('datadog_agent_remap_datadog_logs_acks', 'baseline', 'a7d21112-28a8-400a-a44f-c4e19bb868d1') 203 45.12MiB 285.99KiB 44.2MiB 45.12MiB 45.44MiB 45.51MiB 45.74MiB 45.9MiB -0.24132
('datadog_agent_remap_datadog_logs_acks', 'baseline', '39199a21-9a68-4c76-abaf-ede7d889d4c3') 203 44.87MiB 318.82KiB 44.1MiB 44.85MiB 45.27MiB 45.36MiB 45.57MiB 45.77MiB 0.0935236
('datadog_agent_remap_datadog_logs_acks', 'comparison', '7055e577-30ce-4619-bad4-8ecf97c36816') 202 44.36MiB 227.33KiB 43.88MiB 44.38MiB 44.62MiB 44.72MiB 44.87MiB 44.99MiB 0.0668407
('datadog_agent_remap_datadog_logs_acks', 'baseline', '0a223875-4a21-4fcb-95d3-3f85dd62dc28') 203 44.09MiB 227.92KiB 43.29MiB 44.08MiB 44.36MiB 44.45MiB 44.66MiB 44.84MiB 0.0461201
('datadog_agent_remap_datadog_logs_acks', 'comparison', 'd31f3dfb-1479-441a-8747-a50016e4378c') 202 43.9MiB 296.3KiB 43.3MiB 43.9MiB 44.17MiB 44.31MiB 45.15MiB 45.19MiB 1.58691
('datadog_agent_remap_datadog_logs_acks', 'comparison', '06a84dd9-ff26-4f20-a846-1237643afb6f') 202 43.56MiB 247.36KiB 42.87MiB 43.57MiB 43.9MiB 43.98MiB 44.06MiB 44.13MiB -0.0709538
('datadog_agent_remap_datadog_logs', 'comparison', 'a397ab99-e18b-4565-91da-2b4d15ab47ea') 200 43.32MiB 230.27KiB 42.78MiB 43.3MiB 43.63MiB 43.74MiB 43.87MiB 43.91MiB 0.414659
('datadog_agent_remap_datadog_logs', 'comparison', '43178ba6-dfa3-4e20-a1df-bbf1e6f769ca') 228 43.14MiB 445.03KiB 42.05MiB 43.16MiB 43.72MiB 43.8MiB 43.87MiB 43.95MiB -0.204103
('datadog_agent_remap_datadog_logs', 'baseline', '9fb7dc92-1387-4230-97af-971fa1ec4fdd') 200 42.94MiB 194.33KiB 42.37MiB 42.96MiB 43.17MiB 43.22MiB 43.39MiB 43.46MiB -0.172403
('datadog_agent_remap_datadog_logs', 'baseline', 'bea6e365-95fe-4a69-87bc-90edb3f755c5') 200 42.6MiB 204.77KiB 42.01MiB 42.6MiB 42.84MiB 42.91MiB 42.99MiB 43.05MiB -0.346047
('datadog_agent_remap_datadog_logs', 'comparison', '42a68144-511a-4923-a62f-e0bb307bad82') 200 42.38MiB 221.17KiB 41.81MiB 42.36MiB 42.68MiB 42.74MiB 42.81MiB 43.0MiB 0.137499
('datadog_agent_remap_datadog_logs', 'baseline', 'af1e8e84-c997-468a-8b1e-4706039b0234') 200 41.15MiB 209.32KiB 40.64MiB 41.18MiB 41.38MiB 41.45MiB 41.52MiB 41.81MiB -0.306246
('datadog_agent_remap_blackhole_acks', 'baseline', 'd1b15dae-dfba-4a7d-a529-3d8f174d1c24') 200 35.78MiB 297.48KiB 35.11MiB 35.75MiB 36.18MiB 36.24MiB 36.52MiB 36.69MiB 0.379547
('datadog_agent_remap_blackhole_acks', 'comparison', '4968d3f7-38fa-409b-a92f-335a3493222b') 205 35.48MiB 410.07KiB 30.84MiB 35.5MiB 35.81MiB 35.89MiB 36.03MiB 36.05MiB -7.64563
('datadog_agent_remap_blackhole', 'comparison', '6ba3057d-f8fb-4698-a1e8-d4fbf2ecae48') 201 35.35MiB 313.59KiB 34.69MiB 35.32MiB 35.76MiB 35.83MiB 36.2MiB 36.39MiB 0.323447
('datadog_agent_remap_blackhole_acks', 'baseline', 'f3fd5b00-cf22-4178-a0ba-92261e16edda') 200 35.33MiB 239.14KiB 34.82MiB 35.32MiB 35.63MiB 35.71MiB 35.83MiB 35.95MiB 0.0573281
('datadog_agent_remap_blackhole_acks', 'baseline', 'f10174d5-4c4a-4e29-a563-b239447d89d3') 200 35.04MiB 237.86KiB 34.36MiB 35.01MiB 35.32MiB 35.46MiB 35.65MiB 35.7MiB 0.320198
('datadog_agent_remap_blackhole', 'comparison', '81518b4b-9889-4e78-bf54-c760013c625f') 206 34.8MiB 463.64KiB 29.19MiB 34.84MiB 35.1MiB 35.17MiB 35.26MiB 35.72MiB -9.34449
('datadog_agent_remap_blackhole', 'baseline', 'd9fd3c4c-8548-4a70-a792-aa73742cc96e') 202 34.71MiB 215.54KiB 34.25MiB 34.7MiB 34.97MiB 35.04MiB 35.18MiB 35.25MiB -0.0563904
('datadog_agent_remap_blackhole', 'comparison', 'c47e2b5d-9d07-48b5-9fbf-49961e530ea5') 201 34.55MiB 209.41KiB 33.92MiB 34.55MiB 34.8MiB 34.88MiB 35.03MiB 35.09MiB 0.050978
('datadog_agent_remap_blackhole', 'baseline', '8ccaf722-ccfc-46e0-8035-c3c268aabb3e') 202 34.32MiB 237.18KiB 33.65MiB 34.34MiB 34.61MiB 34.69MiB 34.76MiB 34.81MiB -0.143354
('datadog_agent_remap_blackhole_acks', 'comparison', '6d489e2b-f021-46fb-aa4a-2ad6e6780cd1') 200 34.05MiB 222.97KiB 33.61MiB 34.02MiB 34.33MiB 34.47MiB 34.59MiB 34.6MiB 0.452384
('datadog_agent_remap_blackhole_acks', 'comparison', 'ebeb1495-f7fb-491e-a4e8-e0dac85ca35a') 200 33.94MiB 264.95KiB 33.32MiB 33.9MiB 34.32MiB 34.44MiB 34.54MiB 34.6MiB 0.449572
('datadog_agent_remap_blackhole', 'baseline', '82e7c21f-f5ce-4897-b13c-58403f4db0d9') 202 33.59MiB 242.87KiB 32.9MiB 33.6MiB 33.88MiB 33.99MiB 34.09MiB 34.57MiB 0.130279
('splunk_hec_to_splunk_hec_logs_noack', 'baseline', '4741a8fd-c345-4825-a648-520ae0f63343') 232 23.95MiB 528.52KiB 22.99MiB 23.87MiB 24.43MiB 24.78MiB 26.01MiB 26.74MiB 1.97512
('splunk_hec_to_splunk_hec_logs_acks', 'comparison', '6f63a9e0-f194-42aa-94c1-489491cc2ad6') 230 23.95MiB 1.66MiB 19.68MiB 24.17MiB 25.92MiB 26.43MiB 27.01MiB 27.43MiB -0.712927
('splunk_hec_to_splunk_hec_logs_noack', 'comparison', 'd5216e53-45e9-4b30-90d1-e439c25b2ea8') 231 23.95MiB 483.59KiB 23.05MiB 23.87MiB 24.46MiB 24.67MiB 25.32MiB 26.98MiB 1.69891
('splunk_hec_to_splunk_hec_logs_acks', 'comparison', '06591200-a66e-436b-bd90-8a46dead1d21') 203 23.91MiB 1.83MiB 19.43MiB 23.94MiB 26.37MiB 26.8MiB 27.37MiB 27.65MiB -0.448933
('splunk_hec_to_splunk_hec_logs_acks', 'baseline', '31c42fd1-5580-4741-af3f-acb09529710b') 200 23.91MiB 1.87MiB 19.47MiB 24.01MiB 26.34MiB 26.73MiB 27.16MiB 27.37MiB -0.565947
('splunk_hec_to_splunk_hec_logs_acks', 'baseline', '4cfc8cd1-d209-4f6c-a4f5-08b71e92e184') 200 23.88MiB 1.69MiB 19.71MiB 23.91MiB 26.35MiB 26.64MiB 27.01MiB 27.55MiB -0.211682
('splunk_hec_to_splunk_hec_logs_noack', 'baseline', 'be70ecc7-b2d2-4fac-9c84-ae37c9c63696') 200 23.84MiB 321.68KiB 22.93MiB 23.83MiB 24.24MiB 24.36MiB 24.51MiB 24.67MiB -0.0238656
('splunk_hec_to_splunk_hec_logs_noack', 'baseline', '6e568606-588d-4ba2-93d0-65d4ddb02c89') 200 23.84MiB 328.12KiB 23.05MiB 23.85MiB 24.24MiB 24.31MiB 24.63MiB 24.81MiB 0.00270078
('splunk_hec_indexer_ack_blackhole', 'comparison', 'c96ca44c-bfe1-491b-ae91-962646d3f7ad') 200 23.84MiB 408.37KiB 22.78MiB 23.87MiB 24.36MiB 24.51MiB 24.69MiB 24.76MiB -0.0360112
('splunk_hec_indexer_ack_blackhole', 'comparison', 'eb64188a-0d18-407e-9579-47f2b25ef89a') 200 23.84MiB 405.46KiB 22.78MiB 23.87MiB 24.33MiB 24.42MiB 24.69MiB 24.9MiB -0.196985
('splunk_hec_to_splunk_hec_logs_noack', 'comparison', '9f7d2536-58ea-4769-9850-c46112d3f191') 204 23.84MiB 346.46KiB 23.03MiB 23.82MiB 24.29MiB 24.41MiB 24.74MiB 24.81MiB 0.456454
('splunk_hec_to_splunk_hec_logs_noack', 'comparison', '61b86f06-ba3b-4255-be19-89d8875c5648') 204 23.84MiB 339.92KiB 22.9MiB 23.87MiB 24.27MiB 24.31MiB 24.66MiB 24.72MiB -0.0685291
('splunk_hec_indexer_ack_blackhole', 'comparison', '78b0c7d6-b4f6-4fd8-b4b1-a1ef594f47cc') 200 23.84MiB 445.45KiB 22.78MiB 23.87MiB 24.36MiB 24.63MiB 24.69MiB 24.75MiB -0.143976
('splunk_hec_indexer_ack_blackhole', 'baseline', '15435649-6cb5-44e1-89d5-e2be45a4aa95') 200 23.84MiB 413.88KiB 22.87MiB 23.84MiB 24.36MiB 24.45MiB 24.73MiB 24.9MiB 0.164775
('splunk_hec_indexer_ack_blackhole', 'baseline', 'bdd887d7-4d10-4bb8-9246-ebafe9a28f79') 200 23.84MiB 423.24KiB 22.82MiB 23.85MiB 24.36MiB 24.52MiB 24.69MiB 24.93MiB 0.0462007
('splunk_hec_indexer_ack_blackhole', 'baseline', '5f03085d-5d8a-41d4-9e4d-4c8004c8474c') 200 23.84MiB 437.28KiB 22.23MiB 23.84MiB 24.36MiB 24.52MiB 24.81MiB 24.9MiB -0.189223
('splunk_hec_to_splunk_hec_logs_acks', 'comparison', '0bc3c4b0-cf06-45aa-84fe-bc866d4abe5e') 203 23.14MiB 1.25MiB 19.8MiB 23.42MiB 24.36MiB 24.58MiB 24.87MiB 25.22MiB -0.895757
('splunk_hec_to_splunk_hec_logs_acks', 'baseline', 'ff4ac854-d128-439c-8d7a-606d22887d33') 200 22.97MiB 1.23MiB 19.81MiB 23.25MiB 24.3MiB 24.61MiB 24.78MiB 25.04MiB -0.743092
('http_to_http_noack', 'baseline', 'a89052c9-6076-4c50-aaf9-a430e0621a10') 204 20.17MiB 690.39KiB 16.41MiB 20.19MiB 21.01MiB 21.27MiB 21.64MiB 21.71MiB -0.764665
('http_to_http_noack', 'baseline', 'c6ea6f82-969d-4358-b90a-c4f120e4d51b') 204 20.06MiB 758.88KiB 17.04MiB 20.08MiB 21.05MiB 21.29MiB 21.71MiB 21.82MiB -0.102526
('http_to_http_noack', 'comparison', '46132a52-0a5d-493d-bf60-9cbdfc30e8e8') 204 19.67MiB 966.77KiB 15.7MiB 19.69MiB 20.78MiB 20.95MiB 21.64MiB 22.0MiB -0.721137
('http_to_http_noack', 'comparison', 'c5a6c3f6-a6d4-4ab5-afeb-2b0cf70d3e2e') 204 19.48MiB 841.94KiB 16.83MiB 19.44MiB 20.48MiB 20.78MiB 21.37MiB 21.77MiB -0.0791702
('http_to_http_noack', 'comparison', 'e76b3319-a0e9-4741-8445-f625723409cb') 204 19.45MiB 812.7KiB 16.99MiB 19.44MiB 20.48MiB 20.71MiB 21.13MiB 21.31MiB -0.255115
('http_to_http_noack', 'baseline', '37058c27-6f06-4ace-8e51-eed0ee1cd94a') 204 19.42MiB 832.59KiB 16.52MiB 19.44MiB 20.4MiB 20.58MiB 21.16MiB 21.97MiB -0.303106
('http_to_http_json', 'baseline', '9a16b354-ed15-448e-b877-db6ddabe98be') 200 16.33MiB 793.46KiB 14.19MiB 16.36MiB 17.39MiB 17.73MiB 17.98MiB 18.11MiB 0.0376247
('http_to_http_json', 'baseline', '80575d9b-9cf2-48b5-9ba7-48b1a8941478') 201 16.14MiB 822.81KiB 13.03MiB 16.15MiB 17.16MiB 17.41MiB 18.0MiB 18.15MiB -0.202243
('http_to_http_json', 'comparison', '70c0571d-ac9e-4f3c-bf8d-7c80eeaaee34') 204 16.14MiB 878.5KiB 13.53MiB 15.99MiB 17.38MiB 17.65MiB 18.05MiB 19.02MiB 0.394715
('http_to_http_json', 'baseline', 'a86f9d11-c63e-42c3-8b8b-051cdbde2f08') 230 15.98MiB 840.11KiB 13.97MiB 15.94MiB 17.0MiB 17.29MiB 17.89MiB 18.0MiB -0.0127523
('http_to_http_json', 'comparison', 'c24660a9-f6f5-4377-a495-74f99ef1d2ac') 204 15.98MiB 915.06KiB 13.49MiB 15.97MiB 17.16MiB 17.53MiB 18.08MiB 18.2MiB 0.0852189
('http_to_http_json', 'comparison', '92e6e456-45a9-42c8-b6f5-414047fdf381') 204 15.97MiB 982.79KiB 13.03MiB 15.98MiB 17.2MiB 17.47MiB 18.11MiB 18.62MiB -0.113912
('socket_to_socket_blackhole', 'baseline', '164171cf-8b93-44c1-92c7-b6a96171edf6') 202 12.55MiB 31.03KiB 12.47MiB 12.54MiB 12.58MiB 12.59MiB 12.62MiB 12.64MiB 0.132106
('socket_to_socket_blackhole', 'comparison', 'e9f637a3-9912-4318-9811-60f4f58e9be0') 202 12.39MiB 34.87KiB 12.32MiB 12.4MiB 12.43MiB 12.45MiB 12.47MiB 12.52MiB 0.128729
('socket_to_socket_blackhole', 'baseline', '217b90c1-d38b-4818-91e8-450d1d624db0') 202 12.35MiB 31.06KiB 12.26MiB 12.35MiB 12.39MiB 12.4MiB 12.42MiB 12.43MiB 0.245253
('syslog_log2metric_splunk_hec_metrics', 'baseline', '83cf2012-9f1c-49e9-87f8-12b80d45b8d1') 200 12.26MiB 54.93KiB 12.03MiB 12.26MiB 12.32MiB 12.33MiB 12.36MiB 12.41MiB -0.643633
('socket_to_socket_blackhole', 'comparison', '92535224-4a2e-42a5-a94f-7c53344ed009') 202 12.19MiB 41.43KiB 12.08MiB 12.19MiB 12.25MiB 12.26MiB 12.27MiB 12.3MiB -0.00891796
('syslog_log2metric_splunk_hec_metrics', 'baseline', '621a63e5-9caa-4d64-9211-df4c3191f75e') 200 12.04MiB 52.91KiB 11.9MiB 12.03MiB 12.11MiB 12.12MiB 12.13MiB 12.24MiB -0.0598052
('socket_to_socket_blackhole', 'comparison', 'e45aee77-966c-44c0-a92d-af8344cf3dd9') 202 12.01MiB 30.41KiB 11.89MiB 12.01MiB 12.04MiB 12.06MiB 12.07MiB 12.08MiB -0.497816
('syslog_splunk_hec_logs', 'comparison', '9510a8ec-1aab-4fce-b235-ee566a375725') 200 11.96MiB 54.11KiB 11.81MiB 11.97MiB 12.03MiB 12.05MiB 12.08MiB 12.11MiB -0.242543
('syslog_humio_logs', 'comparison', '6e536f56-3217-4283-b534-3b085375d196') 204 11.96MiB 40.57KiB 11.84MiB 11.96MiB 12.01MiB 12.02MiB 12.06MiB 12.08MiB 0.143651
('socket_to_socket_blackhole', 'baseline', 'd5c1332f-8720-405f-8ce7-d3bf1bf84a51') 88 11.88MiB 2.49MiB 37.22KiB 12.45MiB 12.5MiB 12.52MiB 12.53MiB 12.54MiB -4.37035
('syslog_splunk_hec_logs', 'comparison', '7a767ec4-3947-4201-a97a-a2c50599fd48') 200 11.86MiB 39.46KiB 11.76MiB 11.86MiB 11.9MiB 11.92MiB 11.94MiB 11.95MiB -0.0187218
('syslog_log2metric_splunk_hec_metrics', 'comparison', 'c9d4d283-7b54-4c95-a018-619a5c3484a7') 200 11.84MiB 64.18KiB 11.59MiB 11.85MiB 11.91MiB 11.92MiB 11.95MiB 11.97MiB -0.848988
('syslog_log2metric_splunk_hec_metrics', 'comparison', '1a723bb6-2f66-42cf-b62d-def33a63ce6a') 233 11.81MiB 49.83KiB 11.71MiB 11.81MiB 11.87MiB 11.89MiB 11.92MiB 11.94MiB 0.0981728
('syslog_humio_logs', 'comparison', 'ca26e792-918f-404b-9045-b10441c8e0b6') 204 11.77MiB 76.62KiB 11.63MiB 11.75MiB 11.83MiB 11.96MiB 12.03MiB 12.08MiB 2.2932
('syslog_log2metric_humio_metrics', 'comparison', 'dde76d08-2922-41cf-92dc-ec0cf2150578') 200 11.75MiB 40.46KiB 11.67MiB 11.75MiB 11.8MiB 11.81MiB 11.83MiB 11.84MiB -0.280374
('syslog_humio_logs', 'baseline', 'a665de04-5ee4-4e62-bdb6-a3379175df94') 202 11.74MiB 36.09KiB 11.64MiB 11.74MiB 11.79MiB 11.8MiB 11.81MiB 11.81MiB 0.13618
('syslog_log2metric_humio_metrics', 'baseline', '44028e96-956d-4df1-8ea3-28d4836ed11d') 202 11.7MiB 58.44KiB 11.59MiB 11.69MiB 11.75MiB 11.78MiB 11.92MiB 11.94MiB 2.05348
('syslog_humio_logs', 'baseline', '944a34bc-95e3-4e96-94e6-0bca1a6e4e8c') 202 11.69MiB 43.42KiB 11.57MiB 11.69MiB 11.74MiB 11.75MiB 11.77MiB 11.79MiB -0.209959
('syslog_log2metric_splunk_hec_metrics', 'comparison', '341727a3-dd63-4235-afcc-3fea0a027dc9') 200 11.68MiB 53.59KiB 11.56MiB 11.68MiB 11.75MiB 11.77MiB 11.8MiB 11.82MiB 0.221576
('syslog_log2metric_humio_metrics', 'comparison', '5f84365e-88b8-42b8-9d48-3c117988a9b4') 200 11.66MiB 178.58KiB 11.25MiB 11.65MiB 11.89MiB 11.92MiB 11.96MiB 11.97MiB 0.0699686
('syslog_humio_logs', 'comparison', '23ed8f65-9d09-40aa-aed5-989bf2fbd6b7') 204 11.58MiB 42.68KiB 11.44MiB 11.58MiB 11.63MiB 11.63MiB 11.67MiB 11.69MiB -0.179593
('syslog_splunk_hec_logs', 'baseline', '4ed06676-00e4-4983-9396-c277655bc5a4') 204 11.55MiB 65.39KiB 11.43MiB 11.55MiB 11.61MiB 11.63MiB 11.8MiB 11.85MiB 1.42716
('syslog_splunk_hec_logs', 'baseline', 'eb4dd246-2115-4bf1-bc17-079e53510c60') 204 11.53MiB 75.11KiB 11.28MiB 11.53MiB 11.63MiB 11.63MiB 11.7MiB 11.73MiB -0.11542
('syslog_log2metric_humio_metrics', 'baseline', '3e565fed-4fce-4184-b74f-acea55511fa2') 202 11.5MiB 43.02KiB 11.38MiB 11.5MiB 11.56MiB 11.57MiB 11.58MiB 11.61MiB -0.13656
('syslog_log2metric_humio_metrics', 'baseline', '971fc111-f3d9-4219-9ffc-abdb197a84c8') 202 11.46MiB 174.45KiB 11.2MiB 11.44MiB 11.72MiB 11.74MiB 11.75MiB 11.8MiB 0.344225
('syslog_splunk_hec_logs', 'comparison', '4daeeb40-0be0-40a4-be4b-7fe2f8604ea2') 200 11.44MiB 44.63KiB 11.31MiB 11.44MiB 11.49MiB 11.51MiB 11.53MiB 11.56MiB 0.0315319
('syslog_log2metric_humio_metrics', 'comparison', 'c0bf436a-8d96-4734-9d69-5e3a42249706') 200 11.29MiB 132.45KiB 11.09MiB 11.24MiB 11.47MiB 11.57MiB 11.61MiB 11.67MiB 0.83192
('syslog_splunk_hec_logs', 'baseline', '5bd7eb87-cc4a-4969-9201-c0d038000570') 204 11.23MiB 77.08KiB 11.07MiB 11.25MiB 11.33MiB 11.34MiB 11.38MiB 11.39MiB -0.146283
('syslog_humio_logs', 'baseline', 'e50d760f-50da-4ba3-a7a8-0361c1741e19') 202 11.16MiB 97.21KiB 11.05MiB 11.14MiB 11.22MiB 11.24MiB 11.64MiB 11.67MiB 3.61497
('splunk_hec_route_s3', 'baseline', 'c310152a-d1ec-4a73-a71b-18a2951a0d9d') 204 10.99MiB 2.3MiB 7.43MiB 11.0MiB 14.28MiB 14.87MiB 15.48MiB 15.84MiB 0.226482
('splunk_hec_route_s3', 'baseline', 'c56b57ac-45cd-4fef-873b-9b235aea7e20') 204 10.96MiB 2.3MiB 7.18MiB 10.67MiB 14.25MiB 14.63MiB 15.61MiB 16.21MiB 0.306587
('syslog_log2metric_splunk_hec_metrics', 'baseline', '09a1c163-71d9-43a8-81d0-058b3a4ea036') 81 10.93MiB 3.22MiB 12.74KiB 11.93MiB 12.01MiB 12.02MiB 12.03MiB 12.03MiB -3.02767
('splunk_hec_route_s3', 'comparison', '5024c7b5-d0f9-4b60-b42c-56cf6cca7370') 204 10.85MiB 2.26MiB 7.27MiB 10.67MiB 13.95MiB 14.52MiB 15.27MiB 15.48MiB 0.252857
('splunk_hec_route_s3', 'baseline', '1f88b6e9-d158-40a2-b292-57841304de9e') 204 10.84MiB 2.26MiB 7.06MiB 10.64MiB 14.02MiB 14.52MiB 15.1MiB 15.33MiB 0.227276
('splunk_hec_route_s3', 'comparison', '6a2ec83e-a22c-4292-bd55-f34c4a2b8f75') 204 10.81MiB 2.22MiB 7.08MiB 10.67MiB 14.09MiB 14.43MiB 15.11MiB 16.51MiB 0.284103
('splunk_hec_route_s3', 'comparison', '039577fc-b86e-4ad0-ab17-0ebd24e241b5') 204 10.81MiB 2.24MiB 6.76MiB 10.78MiB 13.92MiB 14.37MiB 14.87MiB 15.39MiB 0.194432
('http_to_http_acks', 'comparison', '094d29e9-e491-400d-850d-73aabaddd708') 204 8.99MiB 4.29MiB 1.82MiB 9.18MiB 16.13MiB 17.72MiB 19.05MiB 19.23MiB 0.619461
('http_to_http_acks', 'baseline', '2609d2e0-f817-44a9-a690-8a424a77c8b6') 200 8.98MiB 4.43MiB 2.16MiB 9.12MiB 16.73MiB 17.9MiB 19.19MiB 20.0MiB 0.621232
('syslog_regex_logs2metric_ddmetrics', 'comparison', 'd86c8b1b-aee9-4513-8c42-3aa503f28e09') 200 8.76MiB 62.1KiB 8.62MiB 8.76MiB 8.81MiB 8.82MiB 8.88MiB 9.35MiB 4.53433
('syslog_regex_logs2metric_ddmetrics', 'comparison', '6c803b2e-ed66-4300-9b5f-3f84b1849e04') 200 8.68MiB 96.95KiB 8.51MiB 8.66MiB 8.77MiB 8.79MiB 8.81MiB 9.62MiB 5.06988
('syslog_regex_logs2metric_ddmetrics', 'baseline', 'a59411a7-6f8a-4b2e-a3b0-2bf7be9c058f') 200 8.68MiB 98.7KiB 8.47MiB 8.66MiB 8.77MiB 8.78MiB 8.8MiB 9.7MiB 5.98872
('http_to_http_acks', 'baseline', '59ea5ec7-9cb5-4d24-8586-c58ee3be2909') 206 8.65MiB 3.97MiB 1.34MiB 9.1MiB 13.72MiB 17.08MiB 18.95MiB 20.6MiB 0.643817
('syslog_regex_logs2metric_ddmetrics', 'comparison', 'd5f15498-a2dd-428e-89f5-54a3b426ceb0') 200 8.64MiB 108.96KiB 7.65MiB 8.63MiB 8.77MiB 8.78MiB 8.81MiB 8.82MiB -3.87394
('syslog_regex_logs2metric_ddmetrics', 'baseline', '02c3d97a-8638-437e-99fe-90421bcacc25') 200 8.54MiB 146.61KiB 8.32MiB 8.5MiB 8.77MiB 8.78MiB 8.82MiB 9.45MiB 1.80106
('http_to_http_acks', 'comparison', 'ce438ce2-d715-454a-91a4-4ac0899c3f1c') 204 8.36MiB 3.56MiB 1.73MiB 8.99MiB 12.42MiB 15.44MiB 17.66MiB 19.05MiB 0.492799
('http_to_http_acks', 'baseline', '0ec92d1f-5d25-427d-a81e-d758c48c7008') 200 8.33MiB 3.95MiB 2.37MiB 8.59MiB 12.15MiB 17.65MiB 18.96MiB 19.55MiB 0.779366
('http_to_http_acks', 'comparison', '99edbccc-746c-4ded-abbb-ef172d5331cd') 204 8.29MiB 3.68MiB 2.05MiB 8.41MiB 12.45MiB 16.35MiB 17.63MiB 19.35MiB 0.503479
('syslog_regex_logs2metric_ddmetrics', 'baseline', '25e7eecf-807c-4b69-baaf-d0710dbe1391') 82 7.57MiB 2.51MiB 12.38KiB 8.32MiB 8.76MiB 8.79MiB 8.91MiB 9.38MiB -2.60903
('syslog_loki', 'comparison', '742b80a8-8c63-42d3-9f15-4ffbbc2e80ff') 200 7.21MiB 22.55KiB 7.16MiB 7.21MiB 7.24MiB 7.25MiB 7.26MiB 7.26MiB -0.219691
('syslog_loki', 'comparison', '69c2da59-cec9-4aa0-9ee8-fba3a021e155') 200 7.2MiB 25.42KiB 7.13MiB 7.2MiB 7.23MiB 7.24MiB 7.26MiB 7.27MiB 0.149665
('syslog_loki', 'baseline', '50b07728-8f92-4b88-b329-186a6ff20d9f') 202 7.18MiB 23.74KiB 7.11MiB 7.17MiB 7.21MiB 7.21MiB 7.23MiB 7.24MiB -0.0211875
('syslog_loki', 'baseline', '2d8b8d57-d156-4568-83f2-6adadcc0e447') 202 7.09MiB 27.0KiB 7.02MiB 7.09MiB 7.12MiB 7.13MiB 7.15MiB 7.15MiB 0.0649309
('syslog_loki', 'baseline', '4b7d3e6a-7d63-46dd-aac4-a7d899ab36a9') 202 7.08MiB 24.77KiB 7.02MiB 7.08MiB 7.11MiB 7.12MiB 7.13MiB 7.14MiB 0.0568388
('syslog_loki', 'comparison', 'ff7485b7-ba71-4da2-a624-5f672f627537') 200 6.97MiB 82.81KiB 6.76MiB 6.97MiB 7.08MiB 7.1MiB 7.16MiB 7.18MiB -0.0909549
('splunk_transforms_splunk3', 'baseline', '92dbb9fe-daf5-4a9b-927a-58fe03b2c877') 203 6.51MiB 1.69MiB 3.96MiB 5.9MiB 8.84MiB 9.14MiB 9.58MiB 9.67MiB 0.292025
('splunk_transforms_splunk3', 'comparison', 'e7dc6d8c-55ee-46d6-af69-e9550e955499') 202 6.46MiB 1.68MiB 3.75MiB 5.9MiB 8.81MiB 9.06MiB 9.67MiB 9.91MiB 0.329738
('splunk_transforms_splunk3', 'baseline', 'c8e8919f-a2a2-4b9d-b8d0-9260ef677084') 203 6.4MiB 1.65MiB 4.14MiB 5.84MiB 8.72MiB 9.01MiB 9.31MiB 9.31MiB 0.309505
('splunk_transforms_splunk3', 'comparison', '898dde34-6538-47d5-be45-d22fe157d6c0') 202 6.37MiB 1.69MiB 3.84MiB 5.66MiB 8.79MiB 9.19MiB 9.55MiB 9.7MiB 0.355144
('splunk_transforms_splunk3', 'comparison', '31044104-0780-40a0-9716-b610e74b6f01') 202 6.31MiB 1.67MiB 3.81MiB 5.82MiB 8.69MiB 8.91MiB 9.31MiB 9.36MiB 0.298505
('splunk_transforms_splunk3', 'baseline', '02a7d2f9-63eb-4824-a5fd-b87a545a2a1e') 203 6.29MiB 1.66MiB 3.84MiB 5.63MiB 8.55MiB 8.99MiB 9.33MiB 9.67MiB 0.332738
('http_datadog_filter_blackhole', 'baseline', '72c88f8a-7919-47e0-a239-b8f1ecf711c2') 202 4.14MiB 656.62KiB 2.45MiB 4.2MiB 4.98MiB 5.28MiB 5.41MiB 5.65MiB -0.258257
('http_datadog_filter_blackhole', 'baseline', '99bbaa23-eb8f-4111-8670-0dbf811b2377') 202 4.12MiB 686.26KiB 1.98MiB 4.2MiB 4.99MiB 5.27MiB 5.41MiB 5.41MiB -0.444786
('http_datadog_filter_blackhole', 'comparison', '29c55772-23e6-4ab4-b0cb-d73f7178bdff') 202 3.97MiB 719.17KiB 2.13MiB 4.05MiB 4.87MiB 5.16MiB 5.31MiB 5.41MiB -0.292607
('http_datadog_filter_blackhole', 'comparison', 'badcca97-c053-4ab3-8d3c-157c25cb06ea') 202 3.96MiB 686.11KiB 1.23MiB 4.0MiB 4.7MiB 4.99MiB 5.29MiB 5.53MiB -0.468183
('http_datadog_filter_blackhole', 'baseline', 'a17256b7-20b3-4f30-8cb5-1ce345ac1218') 202 3.91MiB 737.75KiB 980.01KiB 4.06MiB 4.76MiB 4.99MiB 5.41MiB 5.47MiB -0.603375
('http_datadog_filter_blackhole', 'comparison', 'ef3632af-b3d6-4f39-9cc8-3858158aa974') 202 3.87MiB 708.35KiB 1.9MiB 3.99MiB 4.71MiB 4.99MiB 5.41MiB 5.53MiB -0.216291
('http_pipelines_no_grok_blackhole', 'baseline', '5dc596a4-d790-404b-8433-90bd460e2e62') 200 3.78MiB 800.54KiB 1.89MiB 3.9MiB 4.53MiB 4.99MiB 5.27MiB 7.43MiB 0.0868977
('http_pipelines_no_grok_blackhole', 'comparison', '25e810ce-9e35-411d-9342-e343d1dca441') 228 3.73MiB 748.59KiB 1.38MiB 3.76MiB 4.5MiB 4.97MiB 5.29MiB 5.47MiB -0.366527
('http_pipelines_no_grok_blackhole', 'baseline', 'affb2a0e-d6e5-4b34-b17e-e69bb45e4fbc') 200 3.73MiB 769.98KiB 1.35MiB 3.79MiB 4.53MiB 4.91MiB 5.27MiB 5.41MiB -0.423575
('http_pipelines_no_grok_blackhole', 'baseline', 'f889413c-314d-4ff3-978a-0002aeb44df3') 200 3.72MiB 766.45KiB 1.41MiB 3.79MiB 4.53MiB 4.99MiB 5.29MiB 5.29MiB -0.503647
('http_pipelines_no_grok_blackhole', 'comparison', '33d00846-f76d-4145-bf37-4f273fbb7538') 200 3.71MiB 758.4KiB 1.75MiB 3.78MiB 4.53MiB 4.87MiB 5.29MiB 5.41MiB -0.342804
('http_pipelines_no_grok_blackhole', 'comparison', 'f11147aa-50ea-4720-970a-7f3b9024dbe4') 200 3.52MiB 819.67KiB 1.36MiB 3.63MiB 4.47MiB 4.8MiB 5.15MiB 5.27MiB -0.324283
('http_pipelines_blackhole_acks', 'comparison', 'a037b62d-dec4-46ff-9ebb-ae1cf6d73247') 202 1.37MiB 711.54KiB 123.02KiB 1.37MiB 2.32MiB 2.62MiB 3.03MiB 3.17MiB 0.453671
('http_pipelines_blackhole_acks', 'baseline', 'e5cb943b-156c-46d3-9a9d-714d169f1a82') 203 1.34MiB 748.66KiB 109.76KiB 1.34MiB 2.4MiB 2.61MiB 3.06MiB 3.24MiB 0.405201
('http_pipelines_blackhole_acks', 'comparison', '885c4afc-3259-47ef-a728-015073ed9184') 202 1.28MiB 708.52KiB 78.86KiB 1.23MiB 2.19MiB 2.5MiB 3.12MiB 3.16MiB 0.5228
('http_pipelines_blackhole_acks', 'comparison', '2c96eb6a-3960-4959-a2c0-409ed262153e') 201 1.28MiB 683.2KiB 185.37KiB 1.26MiB 2.19MiB 2.55MiB 2.91MiB 3.06MiB 0.459433
('http_pipelines_blackhole_acks', 'baseline', 'a82fe33f-547a-47c0-8f13-3eec8c1fa9e0') 202 1.26MiB 674.61KiB 78.86KiB 1.2MiB 2.19MiB 2.5MiB 2.72MiB 3.59MiB 0.56135
('http_pipelines_blackhole_acks', 'baseline', '78ebcefc-54a5-400a-9b8b-0375d829e55e') 202 1.2MiB 665.13KiB 62.87KiB 1.14MiB 2.03MiB 2.35MiB 2.91MiB 3.08MiB 0.470145
('http_pipelines_blackhole', 'comparison', '3f4b5d95-f32c-4122-aa89-03205217ee4c') 177 461.89KiB 352.09KiB 15.99KiB 368.02KiB 1007.54KiB 1.12MiB 1.46MiB 1.55MiB 1.02312
('http_pipelines_blackhole', 'comparison', '2acaf81d-c6c0-4c97-af34-416170556847') 176 460.35KiB 358.87KiB 15.99KiB 368.02KiB 964.5KiB 1.21MiB 1.56MiB 1.58MiB 1.23902
('http_pipelines_blackhole', 'baseline', '15cc19e0-bfc6-4167-9614-23f39f60ff90') 174 454.3KiB 357.53KiB 15.99KiB 368.02KiB 987.84KiB 1.1MiB 1.45MiB 1.55MiB 1.05291
('http_pipelines_blackhole', 'baseline', '88d52155-3533-40dd-a445-6b031099378f') 176 452.22KiB 328.9KiB 15.99KiB 430.37KiB 1023.53KiB 1.07MiB 1.15MiB 1.34MiB 0.701394
('http_pipelines_blackhole', 'baseline', 'dc40275d-d6ca-4e70-9d6c-9b2e77b73e76') 177 443.11KiB 354.53KiB 15.99KiB 354.24KiB 1007.54KiB 1.1MiB 1.41MiB 1.55MiB 0.97443
('http_pipelines_blackhole', 'comparison', '7c41e140-a66a-4e00-b57b-c673c7f93deb') 186 435.6KiB 352.8KiB 15.99KiB 307.36KiB 985.48KiB 1.09MiB 1.45MiB 1.54MiB 1.06683

Signed-off-by: Jesse Szwedko <[email protected]>
@github-actions
Copy link

Soak Test Results

Baseline: 32caaad
Comparison: e301977
Total Vector CPUs: 4

Explanation

A soak test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their throughput performance between baseline and comparision SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±5% change in mean throughput are discarded. An experiment is erratic if its coefficient of variation is greater than 0.3. The abbreviated table will be omitted if no interesting changes are observed.

Changes in throughput with confidence ≥ 90.00% and absolute Δ mean >= ±5%:

experiment Δ mean Δ mean % confidence
syslog_humio_logs 711.75KiB 6.34 100.00%
Fine details of change detection per experiment.
experiment Δ mean Δ mean % confidence baseline mean baseline stdev baseline stderr baseline outlier % baseline CoV comparison mean comparison stdev comparison stderr comparison outlier % comparison CoV erratic declared erratic
syslog_humio_logs 711.75KiB 6.34 100.00% 10.97MiB 1.79MiB 90.89KiB 0 0.162688 11.66MiB 1.13MiB 52.06KiB 0 0.0971914 False False
http_pipelines_blackhole 14.07KiB 3.12 45.70% 450.86KiB 354.05KiB 15.34KiB 0 0.784544 464.93KiB 400.57KiB 17.3KiB 0 0.860762 True True
syslog_log2metric_humio_metrics 245.74KiB 2.1 99.99% 11.43MiB 1.33MiB 59.94KiB 0 0.116302 11.67MiB 182.87KiB 7.47KiB 0 0.0152863 False False
syslog_log2metric_splunk_hec_metrics 159.18KiB 1.3 99.58% 11.94MiB 1.19MiB 55.05KiB 0 0.0995659 12.1MiB 145.04KiB 5.92KiB 0 0.0117003 False False
socket_to_socket_blackhole 120.24KiB 0.98 97.10% 11.98MiB 1.19MiB 54.76KiB 0 0.0990327 12.1MiB 104.02KiB 4.23KiB 0 0.00839096 False False
syslog_loki 37.45KiB 0.51 100.00% 7.14MiB 103.86KiB 4.22KiB 0 0.0141858 7.18MiB 58.74KiB 2.4KiB 0 0.00798152 False False
splunk_hec_to_splunk_hec_logs_acks 118.78KiB 0.49 88.99% 23.63MiB 1.16MiB 48.32KiB 0 0.0488773 23.74MiB 1.39MiB 56.44KiB 0 0.0585001 False False
syslog_regex_logs2metric_ddmetrics 7.1KiB 0.08 19.01% 8.76MiB 102.5KiB 4.18KiB 0 0.0114193 8.77MiB 645.34KiB 29.21KiB 0 0.0718228 False False
fluent_elasticsearch 44.42KiB 0.05 97.62% 79.53MiB 243.88KiB 9.86KiB 0 0.00299242 79.57MiB 419.82KiB 16.97KiB 0 0.00514828 False False
fluent_remap_aws_firehose 182.08B 0 4.60% 79.47MiB 55.09KiB 2.23KiB 0 0.00067645 79.47MiB 52.46KiB 2.13KiB 0 0.000644155 False False
splunk_hec_indexer_ack_blackhole -216.03B -0 0.68% 23.84MiB 432.49KiB 17.58KiB 0 0.0177018 23.84MiB 428.63KiB 17.5KiB 0 0.017544 False False
http_pipelines_blackhole_acks -853.23B -0.06 1.57% 1.34MiB 705.18KiB 31.86KiB 0 0.512708 1.34MiB 685.88KiB 27.86KiB 0 0.499076 True True
splunk_hec_route_s3 -8.65KiB -0.08 5.23% 10.88MiB 2.28MiB 94.42KiB 0 0.209579 10.87MiB 2.22MiB 92.08KiB 0 0.204542 False False
splunk_hec_to_splunk_hec_logs_noack -23.23KiB -0.09 61.62% 23.88MiB 537.03KiB 21.92KiB 0 0.0219424 23.86MiB 375.36KiB 15.17KiB 0 0.0153519 False False
http_pipelines_no_grok_blackhole -18.73KiB -0.48 33.84% 3.78MiB 736.25KiB 30.06KiB 0 0.190239 3.76MiB 744.59KiB 30.45KiB 0 0.193331 False False
http_datadog_filter_blackhole -25.26KiB -0.61 44.97% 4.04MiB 722.35KiB 29.32KiB 0 0.174273 4.02MiB 750.21KiB 30.48KiB 0 0.182105 False True
splunk_transforms_splunk3 -65.84KiB -1 50.35% 6.43MiB 1.69MiB 70.28KiB 0 0.263124 6.37MiB 1.67MiB 66.54KiB 0 0.262783 False False
datadog_agent_remap_datadog_logs_acks -592.54KiB -1.29 100.00% 44.83MiB 2.12MiB 88.39KiB 0 0.0473592 44.25MiB 991.44KiB 39.37KiB 0 0.0218621 False False
syslog_splunk_hec_logs -155.82KiB -1.33 100.00% 11.46MiB 380.58KiB 15.38KiB 0 0.0324121 11.31MiB 216.59KiB 8.84KiB 0 0.018694 False False
http_to_http_json -279.21KiB -1.65 100.00% 16.48MiB 878.74KiB 35.81KiB 0 0.0520368 16.2MiB 900.99KiB 35.7KiB 0 0.0542547 False False
datadog_agent_remap_datadog_logs -838.69KiB -1.89 100.00% 43.35MiB 744.82KiB 30.41KiB 0 0.0167651 42.53MiB 1.05MiB 44.08KiB 0 0.0247718 False False
datadog_agent_remap_blackhole_acks -745.21KiB -2.08 100.00% 34.94MiB 669.93KiB 27.24KiB 0 0.0187115 34.21MiB 794.73KiB 32.44KiB 0 0.0226691 False False
http_to_http_acks -327.68KiB -3.32 77.78% 9.64MiB 4.71MiB 196.71KiB 0 0.487675 9.32MiB 4.41MiB 182.41KiB 0 0.472421 True True
datadog_agent_remap_blackhole -1.2MiB -3.4 100.00% 35.2MiB 477.53KiB 19.4KiB 0 0.0132377 34.0MiB 468.05KiB 19.06KiB 0 0.0134321 False False
http_to_http_noack -679.74KiB -3.43 100.00% 19.34MiB 916.4KiB 36.28KiB 0 0.0462363 18.68MiB 1.57MiB 65.16KiB 0 0.084218 False False
Fine details of each soak run.
(experiment, variant, run_id) total samples mean std min median p90 p95 p99 max skewness
('fluent_elasticsearch', 'comparison', '314ecaca-0fcc-4f2e-86a6-2c70d09e48fd') 204 79.76MiB 682.64KiB 78.68MiB 79.51MiB 80.22MiB 80.69MiB 82.81MiB 83.18MiB 3.11076
('fluent_elasticsearch', 'baseline', '938b5ebb-7aae-434c-a837-1a716f29ac0b') 204 79.63MiB 395.09KiB 79.36MiB 79.49MiB 80.34MiB 80.58MiB 80.9MiB 81.21MiB 2.22507
('fluent_elasticsearch', 'baseline', 'a74dfc55-8185-448e-ad3b-da60f6c1a9f9') 204 79.47MiB 51.77KiB 79.35MiB 79.47MiB 79.55MiB 79.56MiB 79.58MiB 79.59MiB 0.0786596
('fluent_remap_aws_firehose', 'baseline', '514f82cc-ae59-4ed5-90d1-26261c2c3584') 203 79.47MiB 52.02KiB 79.35MiB 79.47MiB 79.54MiB 79.55MiB 79.59MiB 79.63MiB -0.0355864
('fluent_elasticsearch', 'comparison', '2e2d7537-d35a-4262-a71b-c6d6287f647f') 204 79.47MiB 51.63KiB 79.34MiB 79.47MiB 79.54MiB 79.56MiB 79.59MiB 79.59MiB 0.152682
('fluent_elasticsearch', 'baseline', '95cbe291-44b2-4806-8d42-74d5c46b49d4') 204 79.47MiB 54.0KiB 79.35MiB 79.47MiB 79.55MiB 79.57MiB 79.58MiB 79.6MiB 0.0496047
('fluent_remap_aws_firehose', 'comparison', '919a6daf-69ec-48df-81db-7d5c02c67da5') 203 79.47MiB 54.53KiB 79.33MiB 79.47MiB 79.54MiB 79.56MiB 79.59MiB 79.62MiB -0.0545138
('fluent_remap_aws_firehose', 'comparison', '48a4859f-d0d6-4398-acd4-a8745717f459') 203 79.47MiB 49.97KiB 79.37MiB 79.47MiB 79.54MiB 79.56MiB 79.59MiB 79.62MiB 0.338842
('fluent_remap_aws_firehose', 'baseline', 'cb9aec23-e68d-43be-9aea-b12773165c59') 203 79.47MiB 58.52KiB 79.32MiB 79.47MiB 79.55MiB 79.57MiB 79.61MiB 79.63MiB 0.220784
('fluent_remap_aws_firehose', 'comparison', '69a4fe04-7c6f-4ce0-b36a-3b36da542283') 202 79.47MiB 53.05KiB 79.34MiB 79.47MiB 79.54MiB 79.56MiB 79.58MiB 79.6MiB 2.64735e-05
('fluent_remap_aws_firehose', 'baseline', 'eee0f40a-542e-4468-b25a-45caa8512e78') 203 79.47MiB 54.81KiB 79.33MiB 79.47MiB 79.54MiB 79.56MiB 79.59MiB 79.62MiB -0.11416
('fluent_elasticsearch', 'comparison', '9a983c00-1c9a-46d5-b083-452c3ddc7e21') 204 79.47MiB 52.43KiB 79.35MiB 79.47MiB 79.54MiB 79.56MiB 79.58MiB 79.6MiB 0.0411664
('datadog_agent_remap_datadog_logs_acks', 'baseline', 'aa135174-dea5-402b-be5b-d45eb056d4e7') 203 45.54MiB 266.94KiB 44.64MiB 45.55MiB 45.88MiB 45.98MiB 46.09MiB 46.16MiB -0.237107
('datadog_agent_remap_datadog_logs_acks', 'comparison', 'cfa763d1-3122-44d3-92a2-899ab47d51bf') 202 45.02MiB 329.68KiB 43.59MiB 45.07MiB 45.4MiB 45.46MiB 45.67MiB 45.7MiB -0.830832
('datadog_agent_remap_datadog_logs_acks', 'baseline', '515e732e-98e6-4674-8fac-1cbc6b78dacf') 203 44.61MiB 502.92KiB 43.54MiB 44.63MiB 45.24MiB 45.35MiB 45.68MiB 46.07MiB 0.0523153
('datadog_agent_remap_datadog_logs_acks', 'comparison', '959dc7ad-ee0e-4e76-bccc-70c6391b15e1') 230 44.6MiB 357.79KiB 43.81MiB 44.55MiB 45.12MiB 45.25MiB 45.4MiB 45.57MiB 0.434596
('datadog_agent_remap_datadog_logs_acks', 'baseline', 'b29c249d-e02b-4ee3-ab65-b9ffd0490f19') 200 44.34MiB 3.55MiB 8.7MiB 44.63MiB 45.55MiB 45.67MiB 45.94MiB 46.26MiB -8.61516
('datadog_agent_remap_datadog_logs', 'baseline', '45e0cb71-06a8-4807-9511-084d36866b83') 200 44.11MiB 348.33KiB 43.21MiB 44.11MiB 44.54MiB 44.75MiB 44.87MiB 44.99MiB 0.168306
('datadog_agent_remap_datadog_logs', 'comparison', '697fd8e1-3ab2-4650-b3af-3b1d83d72517') 200 43.42MiB 228.82KiB 42.78MiB 43.41MiB 43.7MiB 43.8MiB 43.91MiB 43.95MiB -0.00780092
('datadog_agent_remap_datadog_logs_acks', 'comparison', '2e9bc8c8-9ab5-43a3-8f13-3a04c1c1d122') 202 43.09MiB 800.16KiB 42.07MiB 42.8MiB 44.56MiB 44.79MiB 44.96MiB 45.17MiB 1.363
('datadog_agent_remap_datadog_logs', 'baseline', 'babb21bb-666c-450f-8837-1b371c8839cc') 200 42.99MiB 509.77KiB 42.26MiB 42.85MiB 43.94MiB 44.2MiB 44.6MiB 44.82MiB 1.89211
('datadog_agent_remap_datadog_logs', 'comparison', '1b9e9ca0-7eff-4fa7-8c96-be33542a6115') 200 42.97MiB 549.06KiB 41.66MiB 42.87MiB 43.69MiB 43.95MiB 44.18MiB 44.45MiB 0.361401
('datadog_agent_remap_datadog_logs', 'baseline', '7ebf4798-a1fa-4952-b83d-aaedbe39a8f1') 200 42.94MiB 606.7KiB 41.77MiB 42.92MiB 43.75MiB 43.91MiB 44.09MiB 44.54MiB 0.153179
('datadog_agent_remap_datadog_logs', 'comparison', '477c18d3-f46a-4412-b505-607731dc4939') 200 41.21MiB 526.31KiB 40.29MiB 41.16MiB 41.7MiB 41.81MiB 43.28MiB 43.7MiB 1.5233
('datadog_agent_remap_blackhole_acks', 'baseline', '1eb44b5c-b28a-4f40-9c21-aef69a2e90ae') 200 35.57MiB 258.18KiB 34.91MiB 35.58MiB 35.86MiB 35.96MiB 36.04MiB 36.34MiB -0.0815287
('datadog_agent_remap_blackhole', 'baseline', 'bb87dc57-ae5a-403a-a6ea-694a94d59989') 202 35.52MiB 306.16KiB 34.96MiB 35.47MiB 35.95MiB 36.04MiB 36.22MiB 36.37MiB 0.418413
('datadog_agent_remap_blackhole', 'baseline', 'd80bf1d5-34d7-464d-8c33-10ef8b1c875c') 202 35.36MiB 410.91KiB 34.42MiB 35.34MiB 35.91MiB 35.99MiB 36.18MiB 36.27MiB 0.0617164
('datadog_agent_remap_blackhole_acks', 'baseline', 'bb666a54-3dfd-423f-85b4-9e0f0174d09a') 200 35.06MiB 399.04KiB 34.09MiB 35.07MiB 35.57MiB 35.63MiB 35.95MiB 35.97MiB 0.0133461
('datadog_agent_remap_blackhole_acks', 'comparison', 'bcf7a834-f1db-4b96-a0cb-ff539e6b3af0') 200 34.91MiB 313.85KiB 34.15MiB 34.93MiB 35.28MiB 35.41MiB 35.55MiB 35.65MiB -0.0653626
('datadog_agent_remap_blackhole', 'baseline', '518d7987-27a4-4446-b584-43abc86be44c') 202 34.72MiB 215.11KiB 34.15MiB 34.75MiB 34.98MiB 35.04MiB 35.08MiB 35.2MiB -0.319639
('datadog_agent_remap_blackhole', 'comparison', '885d313b-d4d4-4ec4-b4f6-51bd83d5df55') 201 34.34MiB 436.43KiB 33.55MiB 34.29MiB 34.92MiB 35.02MiB 35.18MiB 35.23MiB 0.110917
('datadog_agent_remap_blackhole_acks', 'comparison', 'f6c7c3f8-41db-479f-b0f4-833fb542fbbd') 200 34.32MiB 449.36KiB 33.34MiB 34.4MiB 34.9MiB 34.99MiB 35.16MiB 35.22MiB -0.1389
('datadog_agent_remap_blackhole_acks', 'baseline', 'd47598b5-87c9-42f5-a6b8-e328de8d07cd') 205 34.19MiB 288.92KiB 33.49MiB 34.2MiB 34.54MiB 34.59MiB 34.87MiB 35.15MiB 0.16943
('datadog_agent_remap_blackhole', 'comparison', '052ff962-7800-4b69-bd43-bd7752b0d2df') 201 33.85MiB 374.92KiB 33.12MiB 33.82MiB 34.39MiB 34.56MiB 34.73MiB 34.85MiB 0.421566
('datadog_agent_remap_blackhole', 'comparison', 'efff6969-00f0-434a-a669-396f1a0714a1') 201 33.81MiB 377.25KiB 32.96MiB 33.79MiB 34.31MiB 34.43MiB 34.62MiB 34.72MiB 0.105251
('datadog_agent_remap_blackhole_acks', 'comparison', 'f807b543-2d48-4afc-a758-de644e8063cb') 200 33.39MiB 596.89KiB 32.21MiB 33.32MiB 34.2MiB 34.37MiB 34.67MiB 34.74MiB 0.258432
('splunk_hec_to_splunk_hec_logs_acks', 'comparison', 'eb5a3c60-34fc-4239-8d9c-4fa805e4d596') 230 23.92MiB 1.7MiB 18.79MiB 24.08MiB 25.89MiB 26.38MiB 26.77MiB 27.44MiB -0.766497
('splunk_hec_to_splunk_hec_logs_noack', 'baseline', 'cf0ac90f-e803-4aa6-a2e3-4064cb014163') 200 23.91MiB 518.76KiB 23.02MiB 23.85MiB 24.31MiB 24.55MiB 26.06MiB 27.89MiB 3.43365
('splunk_hec_to_splunk_hec_logs_noack', 'baseline', 'a2d5f1fe-b7a7-4130-b60e-6142f07cd37f') 200 23.89MiB 707.36KiB 21.81MiB 23.99MiB 24.75MiB 24.79MiB 25.34MiB 25.34MiB -0.601792
('splunk_hec_to_splunk_hec_logs_noack', 'comparison', 'c1e5a874-0c94-4801-bdab-1a35c8fb32e7') 204 23.89MiB 421.81KiB 23.03MiB 23.84MiB 24.31MiB 24.43MiB 25.06MiB 27.07MiB 2.47883
('splunk_hec_to_splunk_hec_logs_noack', 'comparison', '78e9cb17-f883-46fb-adbd-d84d1336e8bf') 204 23.85MiB 357.26KiB 22.96MiB 23.86MiB 24.28MiB 24.36MiB 24.6MiB 25.18MiB 0.137729
('splunk_hec_indexer_ack_blackhole', 'comparison', '87ff953a-cd2a-4be3-b7c7-29ba35943657') 200 23.85MiB 417.53KiB 22.72MiB 23.87MiB 24.36MiB 24.58MiB 24.7MiB 24.81MiB 0.0276118
('splunk_hec_to_splunk_hec_logs_noack', 'baseline', '0c9e5bfa-7344-4daa-a27e-c2e4adb5c5aa') 200 23.84MiB 310.43KiB 23.08MiB 23.84MiB 24.24MiB 24.33MiB 24.45MiB 24.66MiB -0.0638301
('splunk_hec_indexer_ack_blackhole', 'baseline', '47ce24ea-15e9-44a4-aad1-f9285194b09f') 200 23.84MiB 418.59KiB 22.87MiB 23.87MiB 24.36MiB 24.48MiB 24.7MiB 24.84MiB 0.0271633
('splunk_hec_indexer_ack_blackhole', 'baseline', '63ecd33d-2f86-44be-9628-ffd6f91552c2') 205 23.84MiB 427.73KiB 22.75MiB 23.82MiB 24.37MiB 24.48MiB 24.8MiB 24.84MiB 0.0267511
('splunk_hec_to_splunk_hec_logs_noack', 'comparison', '7932b474-5d04-4e3e-be43-8f2c5c759ab0') 204 23.84MiB 342.45KiB 23.08MiB 23.84MiB 24.29MiB 24.36MiB 24.57MiB 24.67MiB -0.00838477
('splunk_hec_indexer_ack_blackhole', 'baseline', 'bc1ef6ce-87ec-4236-ba41-2535311c93fa') 200 23.84MiB 452.7KiB 22.26MiB 23.87MiB 24.39MiB 24.5MiB 24.75MiB 24.84MiB -0.314178
('splunk_hec_indexer_ack_blackhole', 'comparison', '08df1029-b812-43d3-aa4c-1148dd2ef16d') 200 23.84MiB 428.47KiB 22.23MiB 23.87MiB 24.33MiB 24.42MiB 24.81MiB 24.9MiB -0.363539
('splunk_hec_indexer_ack_blackhole', 'comparison', '66f1359e-9b4b-48a6-9a21-904ba8e46a30') 200 23.84MiB 441.6KiB 21.93MiB 23.85MiB 24.38MiB 24.55MiB 24.81MiB 24.93MiB -0.378417
('splunk_hec_to_splunk_hec_logs_acks', 'baseline', '1362ccfe-c685-4880-953e-5ec5f45680e6') 200 23.78MiB 1.14MiB 20.68MiB 24.11MiB 24.93MiB 25.26MiB 25.43MiB 25.79MiB -0.838633
('splunk_hec_to_splunk_hec_logs_acks', 'baseline', '8d8947a9-1fc1-4b41-b444-a04481549a00') 200 23.75MiB 1.12MiB 20.54MiB 24.07MiB 24.93MiB 25.15MiB 25.45MiB 26.19MiB -0.926494
('splunk_hec_to_splunk_hec_logs_acks', 'comparison', 'd5318e80-9451-43b5-a014-1952f129522c') 203 23.64MiB 1.11MiB 20.26MiB 23.91MiB 24.85MiB 24.96MiB 25.4MiB 25.66MiB -0.913431
('splunk_hec_to_splunk_hec_logs_acks', 'comparison', '434d2a90-17dc-4ae2-b510-8e1261283c81') 203 23.63MiB 1.23MiB 20.35MiB 23.93MiB 24.9MiB 25.05MiB 25.43MiB 25.73MiB -0.81985
('splunk_hec_to_splunk_hec_logs_acks', 'baseline', '87381a30-8e82-4a4c-af19-156bd7177bc0') 200 23.34MiB 1.16MiB 20.38MiB 23.54MiB 24.64MiB 24.79MiB 25.2MiB 25.4MiB -0.718653
('http_to_http_noack', 'comparison', '8cf4378a-61dc-491f-9c9f-3647e11dd407') 204 19.62MiB 839.08KiB 17.11MiB 19.65MiB 20.56MiB 21.09MiB 21.43MiB 21.65MiB -0.203896
('http_to_http_noack', 'comparison', '8da224fa-a5cb-4b43-8632-0f664c21bd09') 204 19.59MiB 970.54KiB 16.34MiB 19.56MiB 20.73MiB 21.09MiB 21.79MiB 21.82MiB -0.250382
('http_to_http_noack', 'baseline', '8ad775c5-bf20-4f3b-887a-00ea524a6182') 204 19.57MiB 867.99KiB 16.96MiB 19.52MiB 20.67MiB 21.09MiB 21.55MiB 22.67MiB 0.131959
('http_to_http_noack', 'baseline', '6aaa9f75-bc3b-4044-bca2-4a55e7c60dbb') 229 19.48MiB 805.6KiB 17.05MiB 19.47MiB 20.47MiB 20.78MiB 21.28MiB 21.67MiB 0.0891013
('http_to_http_noack', 'baseline', '46f299d5-8251-4095-8693-af38490ad4b9') 205 18.96MiB 955.72KiB 14.94MiB 19.05MiB 19.97MiB 20.18MiB 20.55MiB 21.01MiB -1.14073
('http_to_http_noack', 'comparison', 'a3e03427-3b56-49c4-ab4b-1a626207cc52') 204 16.82MiB 858.9KiB 14.92MiB 16.78MiB 18.09MiB 18.31MiB 18.54MiB 18.77MiB 0.223228
('http_to_http_json', 'baseline', '44f1ccf3-1ab2-4b55-bbe8-ed6d515a2a8a') 200 16.64MiB 850.53KiB 14.81MiB 16.57MiB 17.65MiB 18.03MiB 18.39MiB 20.68MiB 0.670059
('http_to_http_json', 'baseline', 'b9d116a8-f517-4b18-8b69-47a5dda987b5') 201 16.56MiB 858.48KiB 14.59MiB 16.49MiB 17.7MiB 18.07MiB 18.54MiB 18.99MiB 0.302727
('http_to_http_json', 'comparison', '61523b8b-6bde-4122-a046-a1c6bf36aa42') 229 16.41MiB 836.91KiB 13.89MiB 16.36MiB 17.55MiB 17.79MiB 18.4MiB 19.07MiB 0.234861
('http_to_http_json', 'baseline', '21d69f54-02b1-4f7f-8a07-9665513ce048') 201 16.24MiB 876.94KiB 13.99MiB 16.18MiB 17.3MiB 17.73MiB 18.0MiB 18.26MiB -0.0761893
('http_to_http_json', 'comparison', 'f926eb4c-ec97-402c-84ea-91f9bbecb5c1') 204 16.12MiB 893.22KiB 13.57MiB 16.08MiB 17.28MiB 17.6MiB 18.09MiB 18.17MiB -0.0591743
('http_to_http_json', 'comparison', '950904c1-a637-47c3-a742-74895cbc3dd4') 204 16.06MiB 938.79KiB 13.71MiB 15.96MiB 17.32MiB 17.5MiB 17.96MiB 18.13MiB 0.0153412
('socket_to_socket_blackhole', 'comparison', '2bfd6283-e6a6-499f-b9af-075b6cfd21ec') 202 12.15MiB 43.99KiB 12.02MiB 12.15MiB 12.2MiB 12.22MiB 12.23MiB 12.24MiB -0.165171
('socket_to_socket_blackhole', 'comparison', 'd0ca7660-9252-4991-ac28-054031bb3ea1') 202 12.13MiB 102.88KiB 11.87MiB 12.13MiB 12.26MiB 12.3MiB 12.36MiB 12.37MiB -0.0471393
('socket_to_socket_blackhole', 'baseline', '4435480d-90e9-4a51-bea7-cd1e1601b1c5') 202 12.13MiB 59.55KiB 11.97MiB 12.14MiB 12.19MiB 12.22MiB 12.25MiB 12.26MiB -0.288543
('syslog_log2metric_splunk_hec_metrics', 'comparison', 'feb29645-0b77-48e4-8969-62ce6a82fdf1') 200 12.13MiB 73.54KiB 11.91MiB 12.14MiB 12.22MiB 12.23MiB 12.25MiB 12.31MiB -0.611073
('syslog_log2metric_splunk_hec_metrics', 'baseline', '9e9adca7-bff6-411d-a40e-acdeec087df0') 200 12.11MiB 149.21KiB 11.84MiB 12.17MiB 12.26MiB 12.29MiB 12.32MiB 12.34MiB -0.454144
('syslog_log2metric_splunk_hec_metrics', 'comparison', '4c4c7d74-c0d8-48b2-97e0-ed4d4fc0849e') 200 12.09MiB 122.05KiB 11.86MiB 12.13MiB 12.24MiB 12.25MiB 12.27MiB 12.28MiB -0.259479
('socket_to_socket_blackhole', 'baseline', '158c1809-1ee3-4328-804b-1e20101f2ffb') 202 12.08MiB 88.61KiB 11.87MiB 12.08MiB 12.18MiB 12.24MiB 12.3MiB 12.35MiB 0.487352
('syslog_log2metric_splunk_hec_metrics', 'comparison', 'b0f7027f-3627-43c3-9d9f-81074c197dbd') 200 12.06MiB 200.66KiB 11.7MiB 12.14MiB 12.26MiB 12.29MiB 12.32MiB 12.34MiB -0.283307
('socket_to_socket_blackhole', 'comparison', '76df5033-d31e-481e-9d5f-cfac5343e28a') 202 12.0MiB 82.02KiB 11.82MiB 12.0MiB 12.09MiB 12.13MiB 12.19MiB 12.23MiB 0.168213
('syslog_log2metric_splunk_hec_metrics', 'baseline', 'ff9d3d43-1b5b-4c9b-8ebe-5c4b6a4ce949') 200 11.97MiB 76.8KiB 11.84MiB 11.95MiB 12.08MiB 12.13MiB 12.15MiB 12.18MiB 0.925889
('syslog_humio_logs', 'comparison', '17830f46-8aa9-46d0-971b-c7db10f4c8b7') 204 11.85MiB 88.19KiB 11.68MiB 11.84MiB 11.9MiB 12.08MiB 12.13MiB 12.23MiB 1.89645
('syslog_splunk_hec_logs', 'baseline', 'cb551b0e-20af-4934-93d5-f1338f151dd3') 204 11.77MiB 52.56KiB 11.56MiB 11.78MiB 11.84MiB 11.85MiB 11.86MiB 11.88MiB -0.622971
('syslog_log2metric_humio_metrics', 'comparison', '19075af0-82b8-43a9-b774-4d5fbddfaf94') 200 11.76MiB 48.85KiB 11.63MiB 11.75MiB 11.82MiB 11.84MiB 11.86MiB 11.89MiB 0.0969516
('syslog_humio_logs', 'comparison', 'c8ae861d-9358-442c-b4a0-0acabac4a19c') 204 11.75MiB 106.9KiB 11.57MiB 11.74MiB 11.9MiB 11.91MiB 11.94MiB 11.97MiB 0.190574
('syslog_log2metric_humio_metrics', 'comparison', '4b687d99-7bd2-4ab7-8b05-0e63ad6256db') 200 11.74MiB 142.49KiB 11.54MiB 11.67MiB 11.94MiB 11.96MiB 12.02MiB 12.03MiB 0.413387
('syslog_log2metric_humio_metrics', 'baseline', '7ed1dcb2-6c7b-4cf8-be1b-b2b0ecfef7c1') 202 11.64MiB 223.73KiB 11.25MiB 11.74MiB 11.88MiB 11.9MiB 11.92MiB 11.96MiB -0.302521
('syslog_splunk_hec_logs', 'baseline', 'fe060001-46da-478d-aedf-20264797f531') 204 11.62MiB 74.76KiB 11.41MiB 11.61MiB 11.74MiB 11.75MiB 11.81MiB 11.86MiB 0.563211
('syslog_log2metric_humio_metrics', 'baseline', '7851915e-091b-43bc-808b-38195378b58f') 233 11.54MiB 92.86KiB 11.4MiB 11.52MiB 11.69MiB 11.74MiB 11.78MiB 11.85MiB 1.16976
('syslog_log2metric_humio_metrics', 'comparison', 'd1e46f7b-7e61-4fc8-91ba-56801ce6fe6f') 200 11.53MiB 207.75KiB 11.1MiB 11.53MiB 11.79MiB 11.89MiB 11.94MiB 11.97MiB 0.04838
('syslog_log2metric_splunk_hec_metrics', 'baseline', '9488c3f7-027e-4f40-9b7b-56cace743176') 90 11.5MiB 2.73MiB 25.29KiB 12.19MiB 12.26MiB 12.26MiB 12.29MiB 12.3MiB -3.86154
('syslog_splunk_hec_logs', 'comparison', '74959d0a-f5e7-4e9c-aecc-53c7f15e6d74') 200 11.41MiB 247.58KiB 11.17MiB 11.3MiB 11.86MiB 11.89MiB 11.95MiB 11.98MiB 1.22723
('socket_to_socket_blackhole', 'baseline', '6d403ff5-3c64-4d4c-b919-2edf0921952f') 89 11.41MiB 2.73MiB 49.58KiB 12.11MiB 12.15MiB 12.16MiB 12.18MiB 12.19MiB -3.80697
('syslog_splunk_hec_logs', 'comparison', 'a04ec160-a18b-4168-89c9-7891e341827f') 200 11.25MiB 104.59KiB 11.07MiB 11.23MiB 11.4MiB 11.42MiB 11.48MiB 11.5MiB 0.424256
('syslog_splunk_hec_logs', 'comparison', 'c198ad81-5bb4-4599-bb29-5389e8d59db9') 200 11.25MiB 223.83KiB 10.93MiB 11.14MiB 11.55MiB 11.59MiB 11.64MiB 11.66MiB 0.305442
('syslog_humio_logs', 'baseline', '67318791-7317-4be3-a6a7-cba324ff68dc') 235 11.13MiB 87.6KiB 10.96MiB 11.11MiB 11.26MiB 11.29MiB 11.33MiB 11.36MiB 0.66595
('syslog_humio_logs', 'comparison', '63898e91-ec01-445b-bf2d-ae6a54bb1e17') 90 11.02MiB 2.57MiB 49.49KiB 11.67MiB 11.75MiB 11.77MiB 11.8MiB 11.81MiB -3.87229
('syslog_splunk_hec_logs', 'baseline', '94ebec53-149e-4288-b4cf-f8c85b8588e0') 204 10.98MiB 236.14KiB 10.65MiB 10.85MiB 11.32MiB 11.34MiB 11.39MiB 11.41MiB 0.515644
('splunk_hec_route_s3', 'baseline', '3ed75ec3-7825-4a8b-be33-f710698f5e9e') 204 10.91MiB 2.35MiB 7.21MiB 10.56MiB 14.24MiB 14.96MiB 15.33MiB 15.69MiB 0.327652
('splunk_hec_route_s3', 'comparison', '1104c754-84ec-4500-83f0-bfbccf244dce') 204 10.9MiB 2.28MiB 7.54MiB 10.7MiB 14.27MiB 14.71MiB 15.36MiB 15.49MiB 0.299923
('splunk_hec_route_s3', 'baseline', '9ca17f35-1a75-4d36-bc6c-ad4569bb2de2') 204 10.88MiB 2.28MiB 7.18MiB 10.89MiB 14.23MiB 14.79MiB 15.06MiB 15.57MiB 0.242845
('splunk_hec_route_s3', 'comparison', '8db5c7b2-3eba-43e0-aa0f-da807b9a5276') 204 10.86MiB 2.2MiB 7.34MiB 10.59MiB 14.08MiB 14.42MiB 15.16MiB 15.35MiB 0.258575
('splunk_hec_route_s3', 'baseline', '44e74c4e-45ce-40b9-8a7b-6c38ba8b9136') 204 10.84MiB 2.22MiB 7.4MiB 10.61MiB 14.12MiB 14.39MiB 15.24MiB 15.6MiB 0.250787
('splunk_hec_route_s3', 'comparison', '4f6cab54-a70f-491d-a990-b21819a6a703') 204 10.83MiB 2.2MiB 7.42MiB 10.91MiB 13.92MiB 14.5MiB 15.37MiB 15.88MiB 0.241377
('syslog_humio_logs', 'baseline', '3a4a63c7-3216-4264-8f17-13cd02d780d9') 86 10.78MiB 2.45MiB 25.24KiB 11.34MiB 11.52MiB 11.6MiB 11.65MiB 11.67MiB -4.09558
('syslog_humio_logs', 'baseline', 'd250dd0e-78a1-4592-9ff0-9face232f500') 84 10.71MiB 3.03MiB 12.37KiB 11.59MiB 11.68MiB 11.7MiB 11.74MiB 11.75MiB -3.21699
('syslog_log2metric_humio_metrics', 'baseline', '6e7b44c5-d78d-4fe9-8c30-890b387bce24') 82 10.62MiB 3.21MiB 12.39KiB 11.46MiB 11.92MiB 11.94MiB 11.98MiB 12.0MiB -2.94073
('http_to_http_acks', 'comparison', '06088534-8a8b-4863-9bf3-f4f01de7ba67') 204 9.96MiB 4.73MiB 2.17MiB 9.26MiB 17.67MiB 18.13MiB 19.05MiB 19.48MiB 0.378032
('http_to_http_acks', 'baseline', '0934e99d-137d-4936-8868-b18bd9a68200') 200 9.78MiB 4.8MiB 1.67MiB 9.35MiB 17.32MiB 17.84MiB 19.13MiB 19.93MiB 0.316794
('http_to_http_acks', 'baseline', '360135f0-9b87-4acf-935e-86af53ce728f') 200 9.66MiB 4.83MiB 2.13MiB 9.47MiB 17.66MiB 18.25MiB 19.54MiB 20.02MiB 0.394164
('http_to_http_acks', 'comparison', '0d87914e-cdc7-484c-bb06-6f94b55dce86') 204 9.53MiB 4.44MiB 2.17MiB 9.17MiB 16.44MiB 17.78MiB 19.22MiB 19.42MiB 0.458832
('http_to_http_acks', 'baseline', '8a0769ca-714b-4e74-8e87-795811ac2994') 200 9.48MiB 4.5MiB 1.44MiB 9.29MiB 17.1MiB 18.22MiB 19.11MiB 20.11MiB 0.500415
('syslog_regex_logs2metric_ddmetrics', 'baseline', '0eb990e8-3f8d-4aec-8b36-c184c419677e') 200 8.82MiB 93.88KiB 8.65MiB 8.81MiB 8.9MiB 8.93MiB 8.97MiB 9.7MiB 4.52821
('syslog_regex_logs2metric_ddmetrics', 'comparison', '4575f5ed-b6c1-4540-bee6-40047e8bc65a') 200 8.81MiB 101.2KiB 8.66MiB 8.78MiB 8.96MiB 8.99MiB 9.01MiB 9.08MiB 0.63016
('syslog_regex_logs2metric_ddmetrics', 'comparison', '1f5f149e-1e30-4071-86a6-c432b2920de5') 200 8.78MiB 85.15KiB 8.46MiB 8.78MiB 8.89MiB 8.93MiB 8.99MiB 9.04MiB -0.0478205
('syslog_regex_logs2metric_ddmetrics', 'baseline', 'dc1e1260-12cf-46bc-86bc-65162517926e') 200 8.77MiB 78.21KiB 7.82MiB 8.78MiB 8.82MiB 8.83MiB 8.86MiB 8.88MiB -9.78559
('syslog_regex_logs2metric_ddmetrics', 'baseline', 'a36c8433-e6d2-48aa-9381-6bf65a0c23e5') 200 8.68MiB 83.75KiB 7.92MiB 8.68MiB 8.77MiB 8.79MiB 8.82MiB 8.83MiB -3.93919
('syslog_regex_logs2metric_ddmetrics', 'comparison', 'a38b8d7e-17bd-49a8-ad77-689e98bc4c68') 88 8.62MiB 1.47MiB 62.37KiB 8.92MiB 8.99MiB 9.01MiB 9.15MiB 9.93MiB -5.2655
('http_to_http_acks', 'comparison', '9914733b-e4c1-496c-8bc5-a502ac91013a') 204 8.47MiB 3.9MiB 1006.35KiB 9.02MiB 13.01MiB 17.37MiB 17.98MiB 19.45MiB 0.57083
('syslog_loki', 'baseline', '47705cd1-9885-4d33-9f8b-3d7b8e98530b') 202 7.21MiB 88.47KiB 7.08MiB 7.17MiB 7.31MiB 7.33MiB 7.35MiB 7.36MiB 0.0986487
('syslog_loki', 'comparison', 'a14ab26d-c276-4871-a1a7-315855786bd0') 200 7.2MiB 25.78KiB 7.13MiB 7.2MiB 7.23MiB 7.25MiB 7.26MiB 7.27MiB 0.0908979
('syslog_loki', 'baseline', 'ae822a64-8016-4594-97e6-0c0bf7fae784') 202 7.19MiB 31.08KiB 7.11MiB 7.19MiB 7.22MiB 7.25MiB 7.26MiB 7.26MiB 0.232455
('syslog_loki', 'comparison', 'c170d647-7fed-48c4-8bb6-1ef7648dd42d') 200 7.18MiB 41.53KiB 7.07MiB 7.18MiB 7.22MiB 7.23MiB 7.26MiB 7.27MiB -0.288798
('syslog_loki', 'comparison', 'd2a570f0-4d49-4d67-8a85-1e1678fe01ed') 200 7.16MiB 84.84KiB 7.03MiB 7.12MiB 7.27MiB 7.29MiB 7.31MiB 7.32MiB 0.269509
('syslog_loki', 'baseline', '5e503e7c-c737-4a51-a306-fc6f2bf433b9') 202 7.04MiB 71.6KiB 6.82MiB 7.04MiB 7.12MiB 7.14MiB 7.19MiB 7.21MiB -0.186253
('splunk_transforms_splunk3', 'baseline', '8371d536-5a45-47a8-86c3-e8b579757dd0') 203 6.52MiB 1.7MiB 3.81MiB 5.91MiB 8.83MiB 9.22MiB 9.55MiB 9.79MiB 0.261895
('splunk_transforms_splunk3', 'comparison', '691723b5-d353-42b7-b570-5f96e9494327') 231 6.47MiB 1.71MiB 2.82MiB 5.87MiB 9.01MiB 9.2MiB 9.38MiB 9.67MiB 0.27209
('splunk_transforms_splunk3', 'baseline', '8ec8b8d4-1fd2-4cbc-a009-c44956f007ce') 203 6.43MiB 1.7MiB 3.81MiB 5.9MiB 8.94MiB 9.18MiB 9.59MiB 9.8MiB 0.340351
('splunk_transforms_splunk3', 'baseline', '95e92208-b4bb-4db7-baf5-b9d116c8be2b') 203 6.34MiB 1.68MiB 3.84MiB 5.78MiB 8.72MiB 9.05MiB 9.34MiB 9.46MiB 0.330459
('splunk_transforms_splunk3', 'comparison', '2043b65d-c03a-4b84-a5e7-a261d814ef74') 202 6.32MiB 1.69MiB 3.84MiB 5.69MiB 8.82MiB 9.1MiB 9.33MiB 9.57MiB 0.403848
('splunk_transforms_splunk3', 'comparison', '36b251fa-eb92-430e-910d-0fe0c93992eb') 231 6.31MiB 1.63MiB 2.92MiB 5.72MiB 8.7MiB 8.89MiB 9.32MiB 9.67MiB 0.294599
('http_datadog_filter_blackhole', 'comparison', '073300b8-e028-47ac-ad63-7059b75463af') 202 4.11MiB 712.46KiB 2.14MiB 4.24MiB 5.05MiB 5.29MiB 5.41MiB 5.51MiB -0.39733
('http_datadog_filter_blackhole', 'baseline', 'e64b3e04-c761-4c98-af16-0e303da91a37') 202 4.09MiB 709.31KiB 1.96MiB 4.15MiB 5.02MiB 5.27MiB 5.41MiB 5.65MiB -0.27085
('http_datadog_filter_blackhole', 'baseline', '0fdbb0fd-5404-4430-ac9a-52011a56a7f2') 203 4.07MiB 709.98KiB 2.39MiB 4.14MiB 4.83MiB 5.3MiB 5.53MiB 5.65MiB -0.244966
('http_datadog_filter_blackhole', 'comparison', '4aac724e-bf7c-45e6-a535-04cf40dd3855') 202 3.98MiB 778.42KiB 2.32MiB 4.09MiB 4.83MiB 5.18MiB 5.41MiB 7.66MiB 0.23621
('http_datadog_filter_blackhole', 'baseline', 'b388de2d-d5c0-445e-b371-db7b0cfafe9c') 202 3.97MiB 745.16KiB 1.23MiB 4.07MiB 4.91MiB 5.16MiB 5.29MiB 5.63MiB -0.520863
('http_datadog_filter_blackhole', 'comparison', 'ae5e00ed-f217-46ef-bb62-ad34173aaf1c') 202 3.97MiB 753.92KiB 1.35MiB 4.08MiB 4.86MiB 5.21MiB 5.41MiB 5.63MiB -0.557501
('http_pipelines_no_grok_blackhole', 'baseline', '031a7f6a-6588-4093-b1ed-0ad0ff6a020b') 200 3.81MiB 699.41KiB 1.87MiB 3.83MiB 4.5MiB 5.0MiB 5.41MiB 5.41MiB -0.00171872
('http_pipelines_no_grok_blackhole', 'comparison', 'ad699898-4dbd-4397-adf2-6890870a912e') 205 3.78MiB 716.18KiB 1.53MiB 3.79MiB 4.48MiB 4.96MiB 5.27MiB 5.29MiB -0.499697
('http_pipelines_no_grok_blackhole', 'comparison', 'df7ea7c6-8f3c-47ff-ba5c-263d471181e0') 200 3.77MiB 731.59KiB 1.38MiB 3.8MiB 4.5MiB 4.99MiB 5.29MiB 5.41MiB -0.282561
('http_pipelines_no_grok_blackhole', 'baseline', 'd9ed8706-1905-4aa9-9de2-1bd7c642bcd4') 200 3.77MiB 735.45KiB 1.9MiB 3.89MiB 4.53MiB 4.95MiB 5.29MiB 5.29MiB -0.247747
('http_pipelines_no_grok_blackhole', 'baseline', 'e6bb1062-7623-4ac0-b718-44ed8956e18c') 200 3.75MiB 774.61KiB 1.58MiB 3.8MiB 4.64MiB 4.99MiB 5.27MiB 5.29MiB -0.415432
('http_pipelines_no_grok_blackhole', 'comparison', 'eb98f090-2ea8-43b3-b066-952e116fd6ec') 193 3.72MiB 788.45KiB 1.26MiB 3.82MiB 4.53MiB 4.87MiB 5.29MiB 5.41MiB -0.515128
('http_pipelines_blackhole_acks', 'baseline', '236e4c0f-5fbb-4068-98f0-7b2e3c2c4fbe') 202 1.36MiB 743.0KiB 109.76KiB 1.35MiB 2.33MiB 2.63MiB 3.09MiB 3.68MiB 0.547947
('http_pipelines_blackhole_acks', 'comparison', '39d2fdab-5085-40c6-bbe5-28ab3326adaf') 202 1.36MiB 690.58KiB 201.88KiB 1.36MiB 2.25MiB 2.51MiB 3.08MiB 3.19MiB 0.413405
('http_pipelines_blackhole_acks', 'comparison', '7f65fa34-78fe-4fc0-aa41-f455b595002d') 202 1.36MiB 692.92KiB 185.89KiB 1.34MiB 2.17MiB 2.58MiB 3.14MiB 3.59MiB 0.571644
('http_pipelines_blackhole_acks', 'baseline', '32a5242e-29b8-4b38-9328-0ec020e5951c') 202 1.33MiB 681.8KiB 185.37KiB 1.25MiB 2.21MiB 2.38MiB 3.07MiB 3.57MiB 0.470281
('http_pipelines_blackhole_acks', 'baseline', 'd38e7d33-c00a-43b2-bda8-5b91456b9cf3') 86 1.32MiB 673.67KiB 216.26KiB 1.33MiB 2.08MiB 2.23MiB 2.94MiB 3.11MiB 0.216754
('http_pipelines_blackhole_acks', 'comparison', '8a0d7369-18dc-4d54-883a-62e8268ad989') 202 1.3MiB 675.9KiB 185.37KiB 1.29MiB 2.19MiB 2.55MiB 3.08MiB 3.14MiB 0.483042
('http_pipelines_blackhole', 'comparison', '3669a1bd-3d37-4c80-9de9-b64939d6e2c3') 178 470.28KiB 365.92KiB 15.99KiB 368.02KiB 992.64KiB 1.11MiB 1.46MiB 1.57MiB 0.901514
('http_pipelines_blackhole', 'comparison', 'ad28e0e8-f819-4cef-b2ef-f9a64500a000') 178 462.45KiB 418.66KiB 15.99KiB 300.14KiB 1023.53KiB 1.37MiB 1.57MiB 2.01MiB 1.33287
('http_pipelines_blackhole', 'comparison', '3405cdf2-f3c8-440e-977c-781eef1e9d3b') 180 462.08KiB 416.9KiB 15.99KiB 307.36KiB 1.0MiB 1.16MiB 1.52MiB 2.46MiB 1.50349
('http_pipelines_blackhole', 'baseline', '1410921a-9ed7-422d-86d7-f4bab060d5be') 175 460.25KiB 365.38KiB 15.99KiB 368.02KiB 1.0MiB 1.18MiB 1.43MiB 1.45MiB 1.07301
('http_pipelines_blackhole', 'baseline', '42e62d59-4d82-41a4-99ee-a6536b19624e') 176 447.63KiB 357.79KiB 15.99KiB 307.62KiB 1008.92KiB 1.09MiB 1.43MiB 1.57MiB 1.00184
('http_pipelines_blackhole', 'baseline', '08207f72-aa7e-4129-894a-53b9bacd12fd') 182 444.96KiB 340.89KiB 15.99KiB 354.19KiB 976.65KiB 1.07MiB 1.38MiB 1.49MiB 0.917383

@jszwedko jszwedko merged commit 8caf7fa into master Feb 28, 2022
@jszwedko jszwedko deleted the apply-1.59-lints branch February 28, 2022 17:49
jdrouet pushed a commit that referenced this pull request Mar 1, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
domain: core Anything related to core crates i.e. vector-core, core-common, etc domain: sinks Anything related to the Vector's sinks domain: sources Anything related to the Vector's sources domain: transforms Anything related to Vector's transform components domain: vrl Anything related to the Vector Remap Language
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants