wip multirun #15071

gary-huang · 2025-10-28T15:05:47Z

Description

Testing

Risks

Additional Notes

github-actions · 2025-10-28T15:08:40Z

CODEOWNERS have been resolved as:

ddtrace/llmobs/_constants.py                                            @DataDog/ml-observability
ddtrace/llmobs/_experiment.py                                           @DataDog/ml-observability
ddtrace/llmobs/_llmobs.py                                               @DataDog/ml-observability
ddtrace/llmobs/_writer.py                                               @DataDog/ml-observability
setup.cfg                                                               @DataDog/python-guild

github-actions · 2025-10-28T15:32:07Z

Bootstrap import analysis

Comparison of import times between this PR and base.

Summary

The average import time from this PR is: 240 ± 4 ms.

The average import time from base is: 243 ± 5 ms.

The import time difference between this PR and base is: -3.4 ± 0.2 ms.

Import time breakdown

The following import paths have shrunk:

ddtrace.auto 2.112 ms (0.88%)

ddtrace.bootstrap.sitecustomize 1.433 ms (0.60%)

ddtrace.bootstrap.preload 1.433 ms (0.60%)

ddtrace.internal.remoteconfig.client 0.680 ms (0.28%)

ddtrace 0.679 ms (0.28%)

ddtrace.internal._unpatched 0.030 ms (0.01%)

json 0.030 ms (0.01%)

json.decoder 0.030 ms (0.01%)

re 0.030 ms (0.01%)

enum 0.030 ms (0.01%)

types 0.030 ms (0.01%)

pr-commenter · 2025-10-28T16:05:27Z

Performance SLOs

Comparing candidate gary/mlob-3805 (b85504d) with baseline main (5fa0681)

❌ Test Failures (1 suite)

❌ djangosimple - 27/30

✅ appsec

Time: ✅ 20.492ms (SLO: <22.300ms -8.1%) vs baseline: ~same

Memory: ✅ 66.473MB (SLO: <67.000MB 🟡 -0.8%) vs baseline: +6.9%

✅ exception-replay-enabled

Time: ✅ 1.343ms (SLO: <1.450ms -7.4%) vs baseline: -1.0%

Memory: ✅ 64.521MB (SLO: <67.000MB -3.7%) vs baseline: +4.8%

✅ iast

Time: ✅ 20.501ms (SLO: <22.250ms -7.9%) vs baseline: ~same

Memory: ✅ 66.414MB (SLO: <67.000MB 🟡 -0.9%) vs baseline: +6.8%

✅ profiler

Time: ✅ 15.475ms (SLO: <16.550ms -6.5%) vs baseline: +1.3%

Memory: ✅ 54.087MB (SLO: <54.500MB 🟡 -0.8%) vs baseline: +5.5%

✅ resource-renaming

Time: ✅ 20.543ms (SLO: <21.750ms -5.5%) vs baseline: ~same

Memory: ✅ 66.492MB (SLO: <67.000MB 🟡 -0.8%) vs baseline: +7.0%

✅ span-code-origin

Time: ✅ 25.434ms (SLO: <28.200ms -9.8%) vs baseline: ~same

Memory: ✅ 67.447MB (SLO: <69.500MB -3.0%) vs baseline: +5.0%

✅ tracer

Time: ✅ 20.480ms (SLO: <21.750ms -5.8%) vs baseline: ~same

Memory: ✅ 66.454MB (SLO: <67.000MB 🟡 -0.8%) vs baseline: +6.8%

❌ tracer-and-profiler

Time: ✅ 22.710ms (SLO: <23.500ms -3.4%) vs baseline: +3.1%

Memory: ❌ 67.908MB (SLO: <67.500MB +0.6%) vs baseline: +7.0%

❌ tracer-dont-create-db-spans

Time: ✅ 19.375ms (SLO: <21.500ms -9.9%) vs baseline: +0.5%

Memory: ❌ 66.395MB (SLO: <66.000MB +0.6%) vs baseline: +6.7%

❌ tracer-minimal

Time: ✅ 16.644ms (SLO: <17.500ms -4.9%) vs baseline: +0.5%

Memory: ❌ 66.472MB (SLO: <66.000MB +0.7%) vs baseline: +6.9%

✅ tracer-native

Time: ✅ 20.507ms (SLO: <21.750ms -5.7%) vs baseline: ~same

Memory: ✅ 72.135MB (SLO: <72.500MB 🟡 -0.5%) vs baseline: +6.5%

✅ tracer-no-caches

Time: ✅ 18.467ms (SLO: <19.650ms -6.0%) vs baseline: -0.2%

Memory: ✅ 66.454MB (SLO: <67.000MB 🟡 -0.8%) vs baseline: +6.9%

✅ tracer-no-databases

Time: ✅ 18.805ms (SLO: <20.100ms -6.4%) vs baseline: +0.1%

Memory: ✅ 66.473MB (SLO: <67.000MB 🟡 -0.8%) vs baseline: +6.9%

✅ tracer-no-middleware

Time: ✅ 20.212ms (SLO: <21.500ms -6.0%) vs baseline: +0.3%

Memory: ✅ 66.473MB (SLO: <67.000MB 🟡 -0.8%) vs baseline: +6.8%

✅ tracer-no-templates

Time: ✅ 20.310ms (SLO: <22.000ms -7.7%) vs baseline: ~same

Memory: ✅ 66.504MB (SLO: <67.000MB 🟡 -0.7%) vs baseline: +6.9%

📈 Performance Regressions (1 suite)

📈 iastaspectsospath - 24/24

✅ ospathbasename_aspect

Time: ✅ 4.978µs (SLO: <10.000µs 📉 -50.2%) vs baseline: 📈 +15.9%

Memory: ✅ 38.044MB (SLO: <39.000MB -2.5%) vs baseline: +5.9%

✅ ospathbasename_noaspect

Time: ✅ 1.084µs (SLO: <10.000µs 📉 -89.2%) vs baseline: ~same

Memory: ✅ 38.103MB (SLO: <39.000MB -2.3%) vs baseline: +6.1%

✅ ospathjoin_aspect

Time: ✅ 6.968µs (SLO: <10.000µs 📉 -30.3%) vs baseline: 📈 +12.9%

Memory: ✅ 38.122MB (SLO: <39.000MB -2.3%) vs baseline: +6.1%

✅ ospathjoin_noaspect

Time: ✅ 2.302µs (SLO: <10.000µs 📉 -77.0%) vs baseline: -0.1%

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +6.1%

✅ ospathnormcase_aspect

Time: ✅ 3.577µs (SLO: <10.000µs 📉 -64.2%) vs baseline: +0.6%

Memory: ✅ 38.044MB (SLO: <39.000MB -2.5%) vs baseline: +5.8%

✅ ospathnormcase_noaspect

Time: ✅ 0.567µs (SLO: <10.000µs 📉 -94.3%) vs baseline: -1.2%

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +6.0%

✅ ospathsplit_aspect

Time: ✅ 4.765µs (SLO: <10.000µs 📉 -52.4%) vs baseline: -3.3%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +6.1%

✅ ospathsplit_noaspect

Time: ✅ 1.591µs (SLO: <10.000µs 📉 -84.1%) vs baseline: -0.2%

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +5.8%

✅ ospathsplitdrive_aspect

Time: ✅ 3.671µs (SLO: <10.000µs 📉 -63.3%) vs baseline: -1.2%

Memory: ✅ 38.122MB (SLO: <39.000MB -2.3%) vs baseline: +6.1%

✅ ospathsplitdrive_noaspect

Time: ✅ 0.703µs (SLO: <10.000µs 📉 -93.0%) vs baseline: +0.6%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +6.1%

✅ ospathsplitext_aspect

Time: ✅ 4.580µs (SLO: <10.000µs 📉 -54.2%) vs baseline: -0.2%

Memory: ✅ 38.142MB (SLO: <39.000MB -2.2%) vs baseline: +6.1%

✅ ospathsplitext_noaspect

Time: ✅ 1.400µs (SLO: <10.000µs 📉 -86.0%) vs baseline: +2.0%

Memory: ✅ 38.103MB (SLO: <39.000MB -2.3%) vs baseline: +6.1%

🟡 Near SLO Breach (5 suites)

🟡 errortrackingdjangosimple - 6/6

✅ errortracking-enabled-all

Time: ✅ 18.090ms (SLO: <19.850ms -8.9%) vs baseline: ~same

Memory: ✅ 66.453MB (SLO: <66.500MB 🟡 ~same) vs baseline: +6.9%

✅ errortracking-enabled-user

Time: ✅ 18.073ms (SLO: <19.400ms -6.8%) vs baseline: +0.2%

Memory: ✅ 66.499MB (SLO: <66.500MB 🟡 ~same) vs baseline: +7.0%

✅ tracer-enabled

Time: ✅ 18.066ms (SLO: <19.450ms -7.1%) vs baseline: +0.2%

Memory: ✅ 66.379MB (SLO: <66.500MB 🟡 -0.2%) vs baseline: +6.7%

🟡 errortrackingflasksqli - 6/6

✅ errortracking-enabled-all

Time: ✅ 2.082ms (SLO: <2.300ms -9.5%) vs baseline: +0.8%

Memory: ✅ 52.770MB (SLO: <53.500MB 🟡 -1.4%) vs baseline: +6.3%

✅ errortracking-enabled-user

Time: ✅ 2.100ms (SLO: <2.250ms -6.7%) vs baseline: +1.6%

Memory: ✅ 52.907MB (SLO: <53.500MB 🟡 -1.1%) vs baseline: +6.5%

✅ tracer-enabled

Time: ✅ 2.079ms (SLO: <2.300ms -9.6%) vs baseline: +0.9%

Memory: ✅ 52.920MB (SLO: <53.500MB 🟡 -1.1%) vs baseline: +6.5%

🟡 flasksimple - 18/18

✅ appsec-get

Time: ✅ 4.590ms (SLO: <4.750ms -3.4%) vs baseline: +0.1%

Memory: ✅ 62.718MB (SLO: <65.000MB -3.5%) vs baseline: +6.1%

✅ appsec-post

Time: ✅ 6.629ms (SLO: <6.750ms 🟡 -1.8%) vs baseline: +0.6%

Memory: ✅ 62.738MB (SLO: <65.000MB -3.5%) vs baseline: +6.2%

✅ appsec-telemetry

Time: ✅ 4.584ms (SLO: <4.750ms -3.5%) vs baseline: +0.3%

Memory: ✅ 62.777MB (SLO: <65.000MB -3.4%) vs baseline: +6.2%

✅ debugger

Time: ✅ 1.853ms (SLO: <2.000ms -7.3%) vs baseline: ~same

Memory: ✅ 45.436MB (SLO: <47.000MB -3.3%) vs baseline: +5.0%

✅ iast-get

Time: ✅ 1.855ms (SLO: <2.000ms -7.2%) vs baseline: -0.3%

Memory: ✅ 42.369MB (SLO: <49.000MB 📉 -13.5%) vs baseline: +4.8%

✅ profiler

Time: ✅ 1.917ms (SLO: <2.100ms -8.7%) vs baseline: +0.2%

Memory: ✅ 46.458MB (SLO: <47.000MB 🟡 -1.2%) vs baseline: +4.9%

✅ resource-renaming

Time: ✅ 3.371ms (SLO: <3.650ms -7.7%) vs baseline: -0.3%

Memory: ✅ 53.064MB (SLO: <53.500MB 🟡 -0.8%) vs baseline: +6.6%

✅ tracer

Time: ✅ 3.355ms (SLO: <3.650ms -8.1%) vs baseline: +0.4%

Memory: ✅ 53.045MB (SLO: <53.500MB 🟡 -0.9%) vs baseline: +6.5%

✅ tracer-native

Time: ✅ 3.356ms (SLO: <3.650ms -8.0%) vs baseline: ~same

Memory: ✅ 58.788MB (SLO: <60.000MB -2.0%) vs baseline: +5.9%

🟡 flasksqli - 6/6

✅ appsec-enabled

Time: ✅ 3.966ms (SLO: <4.200ms -5.6%) vs baseline: -0.7%

Memory: ✅ 63.013MB (SLO: <66.000MB -4.5%) vs baseline: +6.2%

✅ iast-enabled

Time: ✅ 2.449ms (SLO: <2.800ms 📉 -12.5%) vs baseline: +1.0%

Memory: ✅ 59.435MB (SLO: <60.000MB 🟡 -0.9%) vs baseline: +6.2%

✅ tracer-enabled

Time: ✅ 2.069ms (SLO: <2.250ms -8.1%) vs baseline: +0.7%

Memory: ✅ 52.907MB (SLO: <54.500MB -2.9%) vs baseline: +6.3%

🟡 telemetryaddmetric - 30/30

✅ 1-count-metric-1-times

Time: ✅ 3.010µs (SLO: <20.000µs 📉 -85.0%) vs baseline: +1.3%

Memory: ✅ 32.204MB (SLO: <34.000MB -5.3%) vs baseline: +5.1%

✅ 1-count-metrics-100-times

Time: ✅ 199.630µs (SLO: <220.000µs -9.3%) vs baseline: -3.5%

Memory: ✅ 32.185MB (SLO: <34.000MB -5.3%) vs baseline: +5.0%

✅ 1-distribution-metric-1-times

Time: ✅ 3.351µs (SLO: <20.000µs 📉 -83.2%) vs baseline: +0.9%

Memory: ✅ 32.165MB (SLO: <34.000MB -5.4%) vs baseline: +4.7%

✅ 1-distribution-metrics-100-times

Time: ✅ 214.273µs (SLO: <220.000µs -2.6%) vs baseline: -1.9%

Memory: ✅ 32.204MB (SLO: <34.000MB -5.3%) vs baseline: +5.0%

✅ 1-gauge-metric-1-times

Time: ✅ 2.245µs (SLO: <20.000µs 📉 -88.8%) vs baseline: +2.8%

Memory: ✅ 32.145MB (SLO: <34.000MB -5.5%) vs baseline: +4.9%

✅ 1-gauge-metrics-100-times

Time: ✅ 138.931µs (SLO: <150.000µs -7.4%) vs baseline: +1.4%

Memory: ✅ 32.145MB (SLO: <34.000MB -5.5%) vs baseline: +4.9%

✅ 1-rate-metric-1-times

Time: ✅ 3.191µs (SLO: <20.000µs 📉 -84.0%) vs baseline: +3.3%

Memory: ✅ 32.106MB (SLO: <34.000MB -5.6%) vs baseline: +4.9%

✅ 1-rate-metrics-100-times

Time: ✅ 214.864µs (SLO: <250.000µs 📉 -14.1%) vs baseline: -2.5%

Memory: ✅ 32.185MB (SLO: <34.000MB -5.3%) vs baseline: +5.1%

✅ 100-count-metrics-100-times

Time: ✅ 20.620ms (SLO: <22.000ms -6.3%) vs baseline: +1.5%

Memory: ✅ 32.126MB (SLO: <34.000MB -5.5%) vs baseline: +4.9%

✅ 100-distribution-metrics-100-times

Time: ✅ 2.271ms (SLO: <2.300ms 🟡 -1.3%) vs baseline: ~same

Memory: ✅ 32.185MB (SLO: <34.000MB -5.3%) vs baseline: +5.1%

✅ 100-gauge-metrics-100-times

Time: ✅ 1.427ms (SLO: <1.550ms -7.9%) vs baseline: +1.9%

Memory: ✅ 32.145MB (SLO: <34.000MB -5.5%) vs baseline: +5.0%

✅ 100-rate-metrics-100-times

Time: ✅ 2.216ms (SLO: <2.550ms 📉 -13.1%) vs baseline: +0.4%

Memory: ✅ 32.165MB (SLO: <34.000MB -5.4%) vs baseline: +4.9%

✅ flush-1-metric

Time: ✅ 4.674µs (SLO: <20.000µs 📉 -76.6%) vs baseline: +5.1%

Memory: ✅ 32.165MB (SLO: <34.000MB -5.4%) vs baseline: +5.2%

✅ flush-100-metrics

Time: ✅ 175.279µs (SLO: <250.000µs 📉 -29.9%) vs baseline: +0.7%

Memory: ✅ 32.165MB (SLO: <34.000MB -5.4%) vs baseline: +5.1%

✅ flush-1000-metrics

Time: ✅ 2.124ms (SLO: <2.500ms 📉 -15.0%) vs baseline: +0.5%

Memory: ✅ 32.971MB (SLO: <34.500MB -4.4%) vs baseline: +5.1%

⚠️ Unstable Tests (1 suite)

⚠️

coreapiscenario - 10/10 (1 unstable)

⚠️ context_with_data_listeners

Time: ⚠️ 13.319µs (SLO: <20.000µs 📉 -33.4%) vs baseline: +0.4%

Memory: ✅ 32.165MB (SLO: <33.500MB -4.0%) vs baseline: +4.9%

✅ context_with_data_no_listeners

Time: ✅ 3.295µs (SLO: <10.000µs 📉 -67.1%) vs baseline: +0.5%

Memory: ✅ 32.165MB (SLO: <33.500MB -4.0%) vs baseline: +5.1%

✅ get_item_exists

Time: ✅ 0.581µs (SLO: <10.000µs 📉 -94.2%) vs baseline: -0.3%

Memory: ✅ 32.106MB (SLO: <33.500MB -4.2%) vs baseline: +4.6%

✅ get_item_missing

Time: ✅ 0.636µs (SLO: <10.000µs 📉 -93.6%) vs baseline: ~same

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +5.0%

✅ set_item

Time: ✅ 24.334µs (SLO: <30.000µs 📉 -18.9%) vs baseline: +0.5%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +5.2%

✅ All Tests Passing (16 suites)

✅ httppropagationextract - 60/60

✅ all_styles_all_headers

Time: ✅ 82.024µs (SLO: <100.000µs 📉 -18.0%) vs baseline: +1.3%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +5.0%

✅ b3_headers

Time: ✅ 14.459µs (SLO: <20.000µs 📉 -27.7%) vs baseline: +1.5%

Memory: ✅ 32.244MB (SLO: <33.500MB -3.8%) vs baseline: +5.0%

✅ b3_single_headers

Time: ✅ 13.780µs (SLO: <20.000µs 📉 -31.1%) vs baseline: +3.4%

Memory: ✅ 32.244MB (SLO: <33.500MB -3.8%) vs baseline: +5.2%

✅ datadog_tracecontext_tracestate_not_propagated_on_trace_id_no_match

Time: ✅ 64.039µs (SLO: <80.000µs 📉 -20.0%) vs baseline: -0.1%

Memory: ✅ 32.244MB (SLO: <33.500MB -3.8%) vs baseline: +5.1%

✅ datadog_tracecontext_tracestate_propagated_on_trace_id_match

Time: ✅ 66.087µs (SLO: <80.000µs 📉 -17.4%) vs baseline: +0.1%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +4.9%

✅ empty_headers

Time: ✅ 1.604µs (SLO: <10.000µs 📉 -84.0%) vs baseline: +0.4%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +5.0%

✅ full_t_id_datadog_headers

Time: ✅ 24.554µs (SLO: <30.000µs 📉 -18.2%) vs baseline: +7.7%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +5.0%

✅ invalid_priority_header

Time: ✅ 6.521µs (SLO: <10.000µs 📉 -34.8%) vs baseline: ~same

Memory: ✅ 32.244MB (SLO: <33.500MB -3.8%) vs baseline: +5.2%

✅ invalid_span_id_header

Time: ✅ 6.524µs (SLO: <10.000µs 📉 -34.8%) vs baseline: -0.2%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.8%

✅ invalid_tags_header

Time: ✅ 6.506µs (SLO: <10.000µs 📉 -34.9%) vs baseline: -0.8%

Memory: ✅ 32.244MB (SLO: <33.500MB -3.8%) vs baseline: +5.2%

✅ invalid_trace_id_header

Time: ✅ 6.510µs (SLO: <10.000µs 📉 -34.9%) vs baseline: -0.6%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +5.0%

✅ large_header_no_matches

Time: ✅ 28.082µs (SLO: <30.000µs -6.4%) vs baseline: +1.9%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%

✅ large_valid_headers_all

Time: ✅ 28.922µs (SLO: <40.000µs 📉 -27.7%) vs baseline: +1.0%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +5.0%

✅ medium_header_no_matches

Time: ✅ 9.812µs (SLO: <20.000µs 📉 -50.9%) vs baseline: -0.5%

Memory: ✅ 32.244MB (SLO: <33.500MB -3.8%) vs baseline: +5.0%

✅ medium_valid_headers_all

Time: ✅ 11.248µs (SLO: <20.000µs 📉 -43.8%) vs baseline: -0.2%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +5.1%

✅ none_propagation_style

Time: ✅ 1.733µs (SLO: <10.000µs 📉 -82.7%) vs baseline: +2.1%

Memory: ✅ 32.244MB (SLO: <33.500MB -3.8%) vs baseline: +5.2%

✅ tracecontext_headers

Time: ✅ 34.745µs (SLO: <40.000µs 📉 -13.1%) vs baseline: +0.5%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%

✅ valid_headers_all

Time: ✅ 6.549µs (SLO: <10.000µs 📉 -34.5%) vs baseline: ~same

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%

✅ valid_headers_basic

Time: ✅ 6.096µs (SLO: <10.000µs 📉 -39.0%) vs baseline: +0.3%

Memory: ✅ 32.244MB (SLO: <33.500MB -3.8%) vs baseline: +5.1%

✅ wsgi_empty_headers

Time: ✅ 1.600µs (SLO: <10.000µs 📉 -84.0%) vs baseline: -0.7%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%

✅ wsgi_invalid_priority_header

Time: ✅ 6.596µs (SLO: <10.000µs 📉 -34.0%) vs baseline: +0.3%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +4.9%

✅ wsgi_invalid_span_id_header

Time: ✅ 1.606µs (SLO: <10.000µs 📉 -83.9%) vs baseline: ~same

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +5.0%

✅ wsgi_invalid_tags_header

Time: ✅ 6.608µs (SLO: <10.000µs 📉 -33.9%) vs baseline: +0.1%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%

✅ wsgi_invalid_trace_id_header

Time: ✅ 6.615µs (SLO: <10.000µs 📉 -33.9%) vs baseline: +0.2%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%

✅ wsgi_large_header_no_matches

Time: ✅ 29.112µs (SLO: <40.000µs 📉 -27.2%) vs baseline: +1.5%

Memory: ✅ 32.244MB (SLO: <33.500MB -3.8%) vs baseline: +5.2%

✅ wsgi_large_valid_headers_all

Time: ✅ 30.339µs (SLO: <40.000µs 📉 -24.2%) vs baseline: +2.0%

Memory: ✅ 32.244MB (SLO: <33.500MB -3.8%) vs baseline: +5.0%

✅ wsgi_medium_header_no_matches

Time: ✅ 10.182µs (SLO: <20.000µs 📉 -49.1%) vs baseline: +0.6%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +5.2%

✅ wsgi_medium_valid_headers_all

Time: ✅ 11.557µs (SLO: <20.000µs 📉 -42.2%) vs baseline: +0.7%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +5.0%

✅ wsgi_valid_headers_all

Time: ✅ 6.570µs (SLO: <10.000µs 📉 -34.3%) vs baseline: +0.3%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +5.2%

✅ wsgi_valid_headers_basic

Time: ✅ 6.163µs (SLO: <10.000µs 📉 -38.4%) vs baseline: +1.2%

Memory: ✅ 32.244MB (SLO: <33.500MB -3.8%) vs baseline: +5.0%

✅ httppropagationinject - 16/16

✅ ids_only

Time: ✅ 21.671µs (SLO: <30.000µs 📉 -27.8%) vs baseline: +0.7%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%

✅ with_all

Time: ✅ 29.456µs (SLO: <40.000µs 📉 -26.4%) vs baseline: +2.5%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +5.0%

✅ with_dd_origin

Time: ✅ 25.386µs (SLO: <30.000µs 📉 -15.4%) vs baseline: +0.6%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +5.0%

✅ with_priority_and_origin

Time: ✅ 24.814µs (SLO: <40.000µs 📉 -38.0%) vs baseline: ~same

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +5.0%

✅ with_sampling_priority

Time: ✅ 21.721µs (SLO: <30.000µs 📉 -27.6%) vs baseline: +0.5%

Memory: ✅ 32.165MB (SLO: <33.500MB -4.0%) vs baseline: +4.8%

✅ with_tags

Time: ✅ 27.238µs (SLO: <40.000µs 📉 -31.9%) vs baseline: +0.9%

Memory: ✅ 32.165MB (SLO: <33.500MB -4.0%) vs baseline: +5.0%

✅ with_tags_invalid

Time: ✅ 28.484µs (SLO: <40.000µs 📉 -28.8%) vs baseline: +0.2%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +5.0%

✅ with_tags_max_size

Time: ✅ 27.712µs (SLO: <40.000µs 📉 -30.7%) vs baseline: +1.1%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%

✅ iast_aspects - 40/40

✅ re_expand_aspect

Time: ✅ 32.068µs (SLO: <40.000µs 📉 -19.8%) vs baseline: +0.3%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +6.0%

✅ re_expand_noaspect

Time: ✅ 28.523µs (SLO: <40.000µs 📉 -28.7%) vs baseline: -0.3%

Memory: ✅ 38.122MB (SLO: <39.000MB -2.3%) vs baseline: +6.2%

✅ re_findall_aspect

Time: ✅ 2.920µs (SLO: <10.000µs 📉 -70.8%) vs baseline: +0.6%

Memory: ✅ 38.122MB (SLO: <39.000MB -2.3%) vs baseline: +6.3%

✅ re_findall_noaspect

Time: ✅ 1.413µs (SLO: <10.000µs 📉 -85.9%) vs baseline: -0.6%

Memory: ✅ 38.103MB (SLO: <39.000MB -2.3%) vs baseline: +6.1%

✅ re_finditer_aspect

Time: ✅ 4.430µs (SLO: <10.000µs 📉 -55.7%) vs baseline: -0.9%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +6.0%

✅ re_finditer_noaspect

Time: ✅ 1.394µs (SLO: <10.000µs 📉 -86.1%) vs baseline: -0.9%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +6.0%

✅ re_fullmatch_aspect

Time: ✅ 2.641µs (SLO: <10.000µs 📉 -73.6%) vs baseline: -0.8%

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +6.0%

✅ re_fullmatch_noaspect

Time: ✅ 1.294µs (SLO: <10.000µs 📉 -87.1%) vs baseline: ~same

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +6.1%

✅ re_group_aspect

Time: ✅ 2.932µs (SLO: <10.000µs 📉 -70.7%) vs baseline: +0.8%

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +5.9%

✅ re_group_noaspect

Time: ✅ 1.609µs (SLO: <10.000µs 📉 -83.9%) vs baseline: -0.4%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +5.8%

✅ re_groups_aspect

Time: ✅ 3.081µs (SLO: <10.000µs 📉 -69.2%) vs baseline: +1.1%

Memory: ✅ 38.142MB (SLO: <39.000MB -2.2%) vs baseline: +6.3%

✅ re_groups_noaspect

Time: ✅ 1.712µs (SLO: <10.000µs 📉 -82.9%) vs baseline: +1.7%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +5.9%

✅ re_match_aspect

Time: ✅ 2.710µs (SLO: <10.000µs 📉 -72.9%) vs baseline: ~same

Memory: ✅ 38.122MB (SLO: <39.000MB -2.3%) vs baseline: +6.1%

✅ re_match_noaspect

Time: ✅ 1.294µs (SLO: <10.000µs 📉 -87.1%) vs baseline: -0.8%

Memory: ✅ 38.122MB (SLO: <39.000MB -2.3%) vs baseline: +6.2%

✅ re_search_aspect

Time: ✅ 2.554µs (SLO: <10.000µs 📉 -74.5%) vs baseline: +1.1%

Memory: ✅ 38.103MB (SLO: <39.000MB -2.3%) vs baseline: +6.0%

✅ re_search_noaspect

Time: ✅ 1.182µs (SLO: <10.000µs 📉 -88.2%) vs baseline: -1.5%

Memory: ✅ 38.103MB (SLO: <39.000MB -2.3%) vs baseline: +6.1%

✅ re_sub_aspect

Time: ✅ 3.383µs (SLO: <10.000µs 📉 -66.2%) vs baseline: -1.3%

Memory: ✅ 38.122MB (SLO: <39.000MB -2.3%) vs baseline: +6.1%

✅ re_sub_noaspect

Time: ✅ 1.541µs (SLO: <10.000µs 📉 -84.6%) vs baseline: +0.9%

Memory: ✅ 38.103MB (SLO: <39.000MB -2.3%) vs baseline: +6.1%

✅ re_subn_aspect

Time: ✅ 3.730µs (SLO: <10.000µs 📉 -62.7%) vs baseline: +1.2%

Memory: ✅ 38.122MB (SLO: <39.000MB -2.3%) vs baseline: +6.1%

✅ re_subn_noaspect

Time: ✅ 1.606µs (SLO: <10.000µs 📉 -83.9%) vs baseline: -0.4%

Memory: ✅ 38.103MB (SLO: <39.000MB -2.3%) vs baseline: +5.9%

✅ iastaspects - 118/118

✅ add_aspect

Time: ✅ 0.401µs (SLO: <10.000µs 📉 -96.0%) vs baseline: -1.9%

Memory: ✅ 38.103MB (SLO: <39.000MB -2.3%) vs baseline: +6.1%

✅ add_inplace_aspect

Time: ✅ 0.408µs (SLO: <10.000µs 📉 -95.9%) vs baseline: -0.7%

Memory: ✅ 38.122MB (SLO: <39.000MB -2.3%) vs baseline: +6.2%

✅ add_inplace_noaspect

Time: ✅ 0.317µs (SLO: <10.000µs 📉 -96.8%) vs baseline: -1.7%

Memory: ✅ 38.103MB (SLO: <39.000MB -2.3%) vs baseline: +6.1%

✅ add_noaspect

Time: ✅ 0.278µs (SLO: <10.000µs 📉 -97.2%) vs baseline: +0.4%

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +6.0%

✅ bytearray_aspect

Time: ✅ 1.362µs (SLO: <10.000µs 📉 -86.4%) vs baseline: +2.7%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +6.0%

✅ bytearray_extend_aspect

Time: ✅ 1.510µs (SLO: <10.000µs 📉 -84.9%) vs baseline: -0.7%

Memory: ✅ 38.024MB (SLO: <39.000MB -2.5%) vs baseline: +5.6%

✅ bytearray_extend_noaspect

Time: ✅ 0.611µs (SLO: <10.000µs 📉 -93.9%) vs baseline: ~same

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +6.1%

✅ bytearray_noaspect

Time: ✅ 0.483µs (SLO: <10.000µs 📉 -95.2%) vs baseline: -1.1%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +6.1%

✅ bytes_aspect

Time: ✅ 1.282µs (SLO: <10.000µs 📉 -87.2%) vs baseline: +0.2%

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +6.1%

✅ bytes_noaspect

Time: ✅ 0.497µs (SLO: <10.000µs 📉 -95.0%) vs baseline: -0.1%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +6.0%

✅ bytesio_aspect

Time: ✅ 1.349µs (SLO: <10.000µs 📉 -86.5%) vs baseline: +1.6%

Memory: ✅ 38.103MB (SLO: <39.000MB -2.3%) vs baseline: +6.2%

✅ bytesio_noaspect

Time: ✅ 0.489µs (SLO: <10.000µs 📉 -95.1%) vs baseline: -2.0%

Memory: ✅ 38.122MB (SLO: <39.000MB -2.3%) vs baseline: +6.2%

✅ capitalize_aspect

Time: ✅ 0.739µs (SLO: <10.000µs 📉 -92.6%) vs baseline: +0.1%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +6.1%

✅ capitalize_noaspect

Time: ✅ 0.434µs (SLO: <10.000µs 📉 -95.7%) vs baseline: ~same

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +6.1%

✅ casefold_aspect

Time: ✅ 0.741µs (SLO: <10.000µs 📉 -92.6%) vs baseline: -1.2%

Memory: ✅ 38.122MB (SLO: <39.000MB -2.3%) vs baseline: +6.2%

✅ casefold_noaspect

Time: ✅ 0.369µs (SLO: <10.000µs 📉 -96.3%) vs baseline: -0.2%

Memory: ✅ 38.142MB (SLO: <39.000MB -2.2%) vs baseline: +5.9%

✅ decode_aspect

Time: ✅ 0.725µs (SLO: <10.000µs 📉 -92.8%) vs baseline: -0.2%

Memory: ✅ 38.024MB (SLO: <39.000MB -2.5%) vs baseline: +5.9%

✅ decode_noaspect

Time: ✅ 0.419µs (SLO: <10.000µs 📉 -95.8%) vs baseline: +0.5%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +6.0%

✅ encode_aspect

Time: ✅ 0.713µs (SLO: <10.000µs 📉 -92.9%) vs baseline: +0.6%

Memory: ✅ 38.103MB (SLO: <39.000MB -2.3%) vs baseline: +6.3%

✅ encode_noaspect

Time: ✅ 0.401µs (SLO: <10.000µs 📉 -96.0%) vs baseline: -1.1%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +6.2%

✅ format_aspect

Time: ✅ 3.401µs (SLO: <10.000µs 📉 -66.0%) vs baseline: +1.1%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +6.1%

✅ format_map_aspect

Time: ✅ 3.691µs (SLO: <10.000µs 📉 -63.1%) vs baseline: +3.1%

Memory: ✅ 38.103MB (SLO: <39.000MB -2.3%) vs baseline: +6.0%

✅ format_map_noaspect

Time: ✅ 0.775µs (SLO: <10.000µs 📉 -92.2%) vs baseline: +0.6%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +6.0%

✅ format_noaspect

Time: ✅ 0.598µs (SLO: <10.000µs 📉 -94.0%) vs baseline: +0.4%

Memory: ✅ 38.044MB (SLO: <39.000MB -2.5%) vs baseline: +5.8%

✅ index_aspect

Time: ✅ 0.355µs (SLO: <10.000µs 📉 -96.5%) vs baseline: -1.1%

Memory: ✅ 38.122MB (SLO: <39.000MB -2.3%) vs baseline: +6.2%

✅ index_noaspect

Time: ✅ 0.278µs (SLO: <10.000µs 📉 -97.2%) vs baseline: +1.0%

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +6.0%

✅ join_aspect

Time: ✅ 1.348µs (SLO: <10.000µs 📉 -86.5%) vs baseline: +2.1%

Memory: ✅ 38.103MB (SLO: <39.000MB -2.3%) vs baseline: +6.0%

✅ join_noaspect

Time: ✅ 0.493µs (SLO: <10.000µs 📉 -95.1%) vs baseline: +0.5%

Memory: ✅ 38.122MB (SLO: <39.000MB -2.3%) vs baseline: +6.1%

✅ ljust_aspect

Time: ✅ 2.571µs (SLO: <20.000µs 📉 -87.1%) vs baseline: -2.1%

Memory: ✅ 38.122MB (SLO: <39.000MB -2.3%) vs baseline: +6.1%

✅ ljust_noaspect

Time: ✅ 0.403µs (SLO: <10.000µs 📉 -96.0%) vs baseline: -0.1%

Memory: ✅ 38.103MB (SLO: <39.000MB -2.3%) vs baseline: +6.0%

✅ lower_aspect

Time: ✅ 2.206µs (SLO: <10.000µs 📉 -77.9%) vs baseline: -2.3%

Memory: ✅ 38.103MB (SLO: <39.000MB -2.3%) vs baseline: +6.0%

✅ lower_noaspect

Time: ✅ 0.368µs (SLO: <10.000µs 📉 -96.3%) vs baseline: +0.7%

Memory: ✅ 38.103MB (SLO: <39.000MB -2.3%) vs baseline: +6.0%

✅ lstrip_aspect

Time: ✅ 2.223µs (SLO: <20.000µs 📉 -88.9%) vs baseline: ~same

Memory: ✅ 38.044MB (SLO: <39.000MB -2.5%) vs baseline: +6.1%

✅ lstrip_noaspect

Time: ✅ 0.386µs (SLO: <10.000µs 📉 -96.1%) vs baseline: +1.8%

Memory: ✅ 38.103MB (SLO: <39.000MB -2.3%) vs baseline: +6.1%

✅ modulo_aspect

Time: ✅ 0.999µs (SLO: <10.000µs 📉 -90.0%) vs baseline: +0.3%

Memory: ✅ 38.122MB (SLO: <39.000MB -2.3%) vs baseline: +6.2%

✅ modulo_aspect_for_bytearray_bytearray

Time: ✅ 1.560µs (SLO: <10.000µs 📉 -84.4%) vs baseline: +2.2%

Memory: ✅ 38.122MB (SLO: <39.000MB -2.3%) vs baseline: +6.2%

✅ modulo_aspect_for_bytes

Time: ✅ 0.972µs (SLO: <10.000µs 📉 -90.3%) vs baseline: -0.8%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +6.0%

✅ modulo_aspect_for_bytes_bytearray

Time: ✅ 1.227µs (SLO: <10.000µs 📉 -87.7%) vs baseline: +2.6%

Memory: ✅ 38.122MB (SLO: <39.000MB -2.3%) vs baseline: +6.2%

✅ modulo_noaspect

Time: ✅ 0.628µs (SLO: <10.000µs 📉 -93.7%) vs baseline: -0.5%

Memory: ✅ 38.103MB (SLO: <39.000MB -2.3%) vs baseline: +6.2%

✅ replace_aspect

Time: ✅ 4.935µs (SLO: <10.000µs 📉 -50.7%) vs baseline: +0.9%

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +5.8%

✅ replace_noaspect

Time: ✅ 0.464µs (SLO: <10.000µs 📉 -95.4%) vs baseline: -0.4%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +5.9%

✅ repr_aspect

Time: ✅ 0.910µs (SLO: <10.000µs 📉 -90.9%) vs baseline: -0.5%

Memory: ✅ 38.122MB (SLO: <39.000MB -2.3%) vs baseline: +6.1%

✅ repr_noaspect

Time: ✅ 0.414µs (SLO: <10.000µs 📉 -95.9%) vs baseline: ~same

Memory: ✅ 38.122MB (SLO: <39.000MB -2.3%) vs baseline: +6.1%

✅ rstrip_aspect

Time: ✅ 1.915µs (SLO: <20.000µs 📉 -90.4%) vs baseline: +0.2%

Memory: ✅ 38.122MB (SLO: <39.000MB -2.3%) vs baseline: +6.1%

✅ rstrip_noaspect

Time: ✅ 0.378µs (SLO: <10.000µs 📉 -96.2%) vs baseline: ~same

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +5.8%

✅ slice_aspect

Time: ✅ 0.496µs (SLO: <10.000µs 📉 -95.0%) vs baseline: +0.3%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +6.0%

✅ slice_noaspect

Time: ✅ 0.444µs (SLO: <10.000µs 📉 -95.6%) vs baseline: -0.8%

Memory: ✅ 38.142MB (SLO: <39.000MB -2.2%) vs baseline: +6.3%

✅ stringio_aspect

Time: ✅ 1.557µs (SLO: <10.000µs 📉 -84.4%) vs baseline: -0.6%

Memory: ✅ 38.103MB (SLO: <39.000MB -2.3%) vs baseline: +6.1%

✅ stringio_noaspect

Time: ✅ 0.723µs (SLO: <10.000µs 📉 -92.8%) vs baseline: +0.8%

Memory: ✅ 38.142MB (SLO: <39.000MB -2.2%) vs baseline: +6.3%

✅ strip_aspect

Time: ✅ 2.194µs (SLO: <20.000µs 📉 -89.0%) vs baseline: -0.7%

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +5.8%

✅ strip_noaspect

Time: ✅ 0.385µs (SLO: <10.000µs 📉 -96.2%) vs baseline: +0.3%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +6.1%

✅ swapcase_aspect

Time: ✅ 2.381µs (SLO: <10.000µs 📉 -76.2%) vs baseline: -1.9%

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +6.0%

✅ swapcase_noaspect

Time: ✅ 0.533µs (SLO: <10.000µs 📉 -94.7%) vs baseline: +0.5%

Memory: ✅ 38.142MB (SLO: <39.000MB -2.2%) vs baseline: +6.2%

✅ title_aspect

Time: ✅ 2.331µs (SLO: <10.000µs 📉 -76.7%) vs baseline: -2.6%

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +6.0%

✅ title_noaspect

Time: ✅ 0.495µs (SLO: <10.000µs 📉 -95.0%) vs baseline: -0.7%

Memory: ✅ 38.103MB (SLO: <39.000MB -2.3%) vs baseline: +6.2%

✅ translate_aspect

Time: ✅ 3.255µs (SLO: <10.000µs 📉 -67.5%) vs baseline: -1.0%

Memory: ✅ 38.142MB (SLO: <39.000MB -2.2%) vs baseline: +6.1%

✅ translate_noaspect

Time: ✅ 1.039µs (SLO: <10.000µs 📉 -89.6%) vs baseline: -0.6%

Memory: ✅ 38.103MB (SLO: <39.000MB -2.3%) vs baseline: +6.0%

✅ upper_aspect

Time: ✅ 2.188µs (SLO: <10.000µs 📉 -78.1%) vs baseline: -4.5%

Memory: ✅ 38.024MB (SLO: <39.000MB -2.5%) vs baseline: +5.8%

✅ upper_noaspect

Time: ✅ 0.372µs (SLO: <10.000µs 📉 -96.3%) vs baseline: +0.5%

Memory: ✅ 38.024MB (SLO: <39.000MB -2.5%) vs baseline: +5.8%

✅ iastaspectssplit - 12/12

✅ rsplit_aspect

Time: ✅ 1.456µs (SLO: <10.000µs 📉 -85.4%) vs baseline: +4.7%

Memory: ✅ 38.142MB (SLO: <39.000MB -2.2%) vs baseline: +6.2%

✅ rsplit_noaspect

Time: ✅ 0.578µs (SLO: <10.000µs 📉 -94.2%) vs baseline: -0.4%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +6.1%

✅ split_aspect

Time: ✅ 1.400µs (SLO: <10.000µs 📉 -86.0%) vs baseline: ~same

Memory: ✅ 38.103MB (SLO: <39.000MB -2.3%) vs baseline: +6.1%

✅ split_noaspect

Time: ✅ 0.566µs (SLO: <10.000µs 📉 -94.3%) vs baseline: -1.8%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +5.8%

✅ splitlines_aspect

Time: ✅ 1.383µs (SLO: <10.000µs 📉 -86.2%) vs baseline: -2.0%

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +6.0%

✅ splitlines_noaspect

Time: ✅ 0.587µs (SLO: <10.000µs 📉 -94.1%) vs baseline: +0.3%

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +6.0%

✅ iastpropagation - 2/2

✅ no-propagation

Time: ✅ 48.467µs (SLO: <60.000µs 📉 -19.2%) vs baseline: -1.1%

Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%

✅ otelsdkspan - 24/24

✅ add-event

Time: ✅ 41.102ms (SLO: <42.000ms -2.1%) vs baseline: +1.4%

Memory: ✅ 34.505MB (SLO: <39.000MB 📉 -11.5%) vs baseline: +4.3%

✅ add-link

Time: ✅ 36.408ms (SLO: <38.550ms -5.6%) vs baseline: +0.2%

Memory: ✅ 34.544MB (SLO: <39.000MB 📉 -11.4%) vs baseline: +4.2%

✅ add-metrics

Time: ✅ 220.130ms (SLO: <232.000ms -5.1%) vs baseline: +0.5%

Memory: ✅ 34.564MB (SLO: <39.000MB 📉 -11.4%) vs baseline: +4.9%

✅ add-tags

Time: ✅ 212.117ms (SLO: <221.600ms -4.3%) vs baseline: +0.8%

Memory: ✅ 34.446MB (SLO: <39.000MB 📉 -11.7%) vs baseline: +4.3%

✅ get-context

Time: ✅ 29.530ms (SLO: <31.300ms -5.7%) vs baseline: +1.0%

Memory: ✅ 34.524MB (SLO: <39.000MB 📉 -11.5%) vs baseline: +4.7%

✅ is-recording

Time: ✅ 29.299ms (SLO: <31.000ms -5.5%) vs baseline: +0.3%

Memory: ✅ 34.485MB (SLO: <39.000MB 📉 -11.6%) vs baseline: +4.8%

✅ record-exception

Time: ✅ 63.956ms (SLO: <65.850ms -2.9%) vs baseline: +1.5%

Memory: ✅ 34.839MB (SLO: <39.000MB 📉 -10.7%) vs baseline: +4.9%

✅ set-status

Time: ✅ 32.424ms (SLO: <34.150ms -5.1%) vs baseline: +1.3%

Memory: ✅ 34.544MB (SLO: <39.000MB 📉 -11.4%) vs baseline: +4.8%

✅ start

Time: ✅ 29.203ms (SLO: <30.150ms -3.1%) vs baseline: +1.5%

Memory: ✅ 34.544MB (SLO: <39.000MB 📉 -11.4%) vs baseline: +5.0%

✅ start-finish

Time: ✅ 33.963ms (SLO: <35.350ms -3.9%) vs baseline: ~same

Memory: ✅ 34.505MB (SLO: <39.000MB 📉 -11.5%) vs baseline: +4.7%

✅ start-finish-telemetry

Time: ✅ 34.369ms (SLO: <35.450ms -3.0%) vs baseline: +1.1%

Memory: ✅ 34.485MB (SLO: <39.000MB 📉 -11.6%) vs baseline: +3.8%

✅ update-name

Time: ✅ 31.600ms (SLO: <33.400ms -5.4%) vs baseline: +1.7%

Memory: ✅ 34.524MB (SLO: <39.000MB 📉 -11.5%) vs baseline: +5.0%

✅ otelspan - 22/22

✅ add-event

Time: ✅ 40.304ms (SLO: <47.150ms 📉 -14.5%) vs baseline: +0.1%

Memory: ✅ 43.671MB (SLO: <47.000MB -7.1%) vs baseline: +4.7%

✅ add-metrics

Time: ✅ 315.288ms (SLO: <344.800ms -8.6%) vs baseline: -0.9%

Memory: ✅ 652.718MB (SLO: <675.000MB -3.3%) vs baseline: +4.8%

✅ add-tags

Time: ✅ 288.906ms (SLO: <314.000ms -8.0%) vs baseline: +0.7%

Memory: ✅ 653.218MB (SLO: <675.000MB -3.2%) vs baseline: +4.9%

✅ get-context

Time: ✅ 80.047ms (SLO: <92.350ms 📉 -13.3%) vs baseline: ~same

Memory: ✅ 39.644MB (SLO: <46.500MB 📉 -14.7%) vs baseline: +5.1%

✅ is-recording

Time: ✅ 37.858ms (SLO: <44.500ms 📉 -14.9%) vs baseline: -0.2%

Memory: ✅ 43.158MB (SLO: <47.500MB -9.1%) vs baseline: +4.8%

✅ record-exception

Time: ✅ 58.112ms (SLO: <67.650ms 📉 -14.1%) vs baseline: ~same

Memory: ✅ 39.844MB (SLO: <47.000MB 📉 -15.2%) vs baseline: +4.8%

✅ set-status

Time: ✅ 44.028ms (SLO: <50.400ms 📉 -12.6%) vs baseline: +0.2%

Memory: ✅ 43.126MB (SLO: <47.000MB -8.2%) vs baseline: +4.8%

✅ start

Time: ✅ 37.244ms (SLO: <43.450ms 📉 -14.3%) vs baseline: +0.5%

Memory: ✅ 43.143MB (SLO: <47.000MB -8.2%) vs baseline: +4.8%

✅ start-finish

Time: ✅ 81.870ms (SLO: <88.000ms -7.0%) vs baseline: +0.4%

Memory: ✅ 34.603MB (SLO: <46.500MB 📉 -25.6%) vs baseline: +5.0%

✅ start-finish-telemetry

Time: ✅ 83.330ms (SLO: <89.000ms -6.4%) vs baseline: +0.3%

Memory: ✅ 34.564MB (SLO: <46.500MB 📉 -25.7%) vs baseline: +5.0%

✅ update-name

Time: ✅ 39.029ms (SLO: <45.150ms 📉 -13.6%) vs baseline: +0.6%

Memory: ✅ 43.493MB (SLO: <47.000MB -7.5%) vs baseline: +4.9%

✅ packagespackageforrootmodulemapping - 4/4

✅ cache_off

Time: ✅ 343.310ms (SLO: <354.300ms -3.1%) vs baseline: -0.2%

Memory: ✅ 38.258MB (SLO: <40.000MB -4.4%) vs baseline: +5.7%

✅ cache_on

Time: ✅ 0.381µs (SLO: <10.000µs 📉 -96.2%) vs baseline: -0.8%

Memory: ✅ 37.018MB (SLO: <39.000MB -5.1%) vs baseline: +3.5%

✅ packagesupdateimporteddependencies - 24/24

✅ import_many

Time: ✅ 155.580µs (SLO: <170.000µs -8.5%) vs baseline: +0.4%

Memory: ✅ 37.058MB (SLO: <38.500MB -3.7%) vs baseline: +5.1%

✅ import_many_cached

Time: ✅ 120.955µs (SLO: <130.000µs -7.0%) vs baseline: -0.7%

Memory: ✅ 36.853MB (SLO: <38.500MB -4.3%) vs baseline: +4.2%

✅ import_many_stdlib

Time: ✅ 1.627ms (SLO: <1.750ms -7.0%) vs baseline: -0.6%

Memory: ✅ 37.179MB (SLO: <38.500MB -3.4%) vs baseline: +4.8%

✅ import_many_stdlib_cached

Time: ✅ 0.984ms (SLO: <1.100ms 📉 -10.5%) vs baseline: -0.6%

Memory: ✅ 37.089MB (SLO: <38.500MB -3.7%) vs baseline: +5.1%

✅ import_many_unknown

Time: ✅ 826.370µs (SLO: <890.000µs -7.1%) vs baseline: -0.6%

Memory: ✅ 37.240MB (SLO: <38.500MB -3.3%) vs baseline: +4.7%

✅ import_many_unknown_cached

Time: ✅ 791.779µs (SLO: <870.000µs -9.0%) vs baseline: -0.8%

Memory: ✅ 36.869MB (SLO: <38.500MB -4.2%) vs baseline: +3.6%

✅ import_one

Time: ✅ 19.831µs (SLO: <30.000µs 📉 -33.9%) vs baseline: +0.4%

Memory: ✅ 36.983MB (SLO: <39.000MB -5.2%) vs baseline: +4.7%

✅ import_one_cache

Time: ✅ 6.255µs (SLO: <10.000µs 📉 -37.5%) vs baseline: -1.5%

Memory: ✅ 37.028MB (SLO: <38.500MB -3.8%) vs baseline: +5.0%

✅ import_one_stdlib

Time: ✅ 18.763µs (SLO: <20.000µs -6.2%) vs baseline: +0.8%

Memory: ✅ 36.985MB (SLO: <38.500MB -3.9%) vs baseline: +4.3%

✅ import_one_stdlib_cache

Time: ✅ 6.258µs (SLO: <10.000µs 📉 -37.4%) vs baseline: -0.7%

Memory: ✅ 37.277MB (SLO: <38.500MB -3.2%) vs baseline: +5.9%

✅ import_one_unknown

Time: ✅ 45.516µs (SLO: <50.000µs -9.0%) vs baseline: +0.3%

Memory: ✅ 37.084MB (SLO: <38.500MB -3.7%) vs baseline: +5.4%

✅ import_one_unknown_cache

Time: ✅ 6.315µs (SLO: <10.000µs 📉 -36.9%) vs baseline: +0.7%

Memory: ✅ 37.277MB (SLO: <38.500MB -3.2%) vs baseline: +6.1%

✅ ratelimiter - 12/12

✅ defaults

Time: ✅ 2.362µs (SLO: <10.000µs 📉 -76.4%) vs baseline: -0.2%

Memory: ✅ 31.752MB (SLO: <34.000MB -6.6%) vs baseline: +5.0%

✅ high_rate_limit

Time: ✅ 2.395µs (SLO: <10.000µs 📉 -76.0%) vs baseline: -0.5%

Memory: ✅ 31.792MB (SLO: <34.000MB -6.5%) vs baseline: +5.1%

✅ long_window

Time: ✅ 2.366µs (SLO: <10.000µs 📉 -76.3%) vs baseline: +0.2%

Memory: ✅ 31.733MB (SLO: <34.000MB -6.7%) vs baseline: +5.0%

✅ low_rate_limit

Time: ✅ 2.360µs (SLO: <10.000µs 📉 -76.4%) vs baseline: -0.5%

Memory: ✅ 31.654MB (SLO: <34.000MB -6.9%) vs baseline: +4.6%

✅ no_rate_limit

Time: ✅ 0.838µs (SLO: <10.000µs 📉 -91.6%) vs baseline: +1.0%

Memory: ✅ 31.674MB (SLO: <34.000MB -6.8%) vs baseline: +4.5%

✅ short_window

Time: ✅ 2.497µs (SLO: <10.000µs 📉 -75.0%) vs baseline: -0.4%

Memory: ✅ 31.733MB (SLO: <34.000MB -6.7%) vs baseline: +4.7%

✅ recursivecomputation - 8/8

✅ deep

Time: ✅ 308.969ms (SLO: <320.950ms -3.7%) vs baseline: ~same

Memory: ✅ 32.893MB (SLO: <34.500MB -4.7%) vs baseline: +5.0%

✅ deep-profiled

Time: ✅ 328.534ms (SLO: <359.150ms -8.5%) vs baseline: ~same

Memory: ✅ 37.336MB (SLO: <39.000MB -4.3%) vs baseline: +5.1%

✅ medium

Time: ✅ 7.036ms (SLO: <7.400ms -4.9%) vs baseline: ~same

Memory: ✅ 32.126MB (SLO: <34.000MB -5.5%) vs baseline: +4.9%

✅ shallow

Time: ✅ 0.951ms (SLO: <1.050ms -9.5%) vs baseline: +0.3%

Memory: ✅ 32.145MB (SLO: <34.000MB -5.5%) vs baseline: +4.9%

✅ samplingrules - 8/8

✅ average_match

Time: ✅ 137.501µs (SLO: <290.000µs 📉 -52.6%) vs baseline: -0.6%

Memory: ✅ 32.165MB (SLO: <34.000MB -5.4%) vs baseline: +4.9%

✅ high_match

Time: ✅ 174.048µs (SLO: <480.000µs 📉 -63.7%) vs baseline: -1.3%

Memory: ✅ 32.165MB (SLO: <34.000MB -5.4%) vs baseline: +4.8%

✅ low_match

Time: ✅ 98.650µs (SLO: <120.000µs 📉 -17.8%) vs baseline: -0.3%

Memory: ✅ 600.985MB (SLO: <700.000MB 📉 -14.1%) vs baseline: +4.9%

✅ very_low_match

Time: ✅ 2.653ms (SLO: <8.500ms 📉 -68.8%) vs baseline: -1.8%

Memory: ✅ 68.373MB (SLO: <75.000MB -8.8%) vs baseline: +4.8%

✅ sethttpmeta - 32/32

✅ all-disabled

Time: ✅ 10.548µs (SLO: <20.000µs 📉 -47.3%) vs baseline: +0.5%

Memory: ✅ 32.598MB (SLO: <34.000MB -4.1%) vs baseline: +5.0%

✅ all-enabled

Time: ✅ 39.927µs (SLO: <50.000µs 📉 -20.1%) vs baseline: -0.2%

Memory: ✅ 32.519MB (SLO: <34.000MB -4.4%) vs baseline: +4.9%

✅ collectipvariant_exists

Time: ✅ 40.737µs (SLO: <50.000µs 📉 -18.5%) vs baseline: +0.5%

Memory: ✅ 32.578MB (SLO: <34.000MB -4.2%) vs baseline: +4.9%

✅ no-collectipvariant

Time: ✅ 40.688µs (SLO: <50.000µs 📉 -18.6%) vs baseline: +2.1%

Memory: ✅ 32.617MB (SLO: <34.000MB -4.1%) vs baseline: +5.3%

✅ no-useragentvariant

Time: ✅ 38.502µs (SLO: <50.000µs 📉 -23.0%) vs baseline: -0.2%

Memory: ✅ 32.578MB (SLO: <34.000MB -4.2%) vs baseline: +5.0%

✅ obfuscation-no-query

Time: ✅ 40.370µs (SLO: <50.000µs 📉 -19.3%) vs baseline: ~same

Memory: ✅ 32.539MB (SLO: <34.000MB -4.3%) vs baseline: +4.9%

✅ obfuscation-regular-case-explicit-query

Time: ✅ 75.803µs (SLO: <90.000µs 📉 -15.8%) vs baseline: +0.2%

Memory: ✅ 32.991MB (SLO: <34.000MB -3.0%) vs baseline: +5.1%

✅ obfuscation-regular-case-implicit-query

Time: ✅ 77.114µs (SLO: <90.000µs 📉 -14.3%) vs baseline: +1.1%

Memory: ✅ 32.971MB (SLO: <34.000MB -3.0%) vs baseline: +4.8%

✅ obfuscation-send-querystring-disabled

Time: ✅ 154.376µs (SLO: <170.000µs -9.2%) vs baseline: +0.2%

Memory: ✅ 32.952MB (SLO: <34.500MB -4.5%) vs baseline: +5.0%

✅ obfuscation-worst-case-explicit-query

Time: ✅ 148.221µs (SLO: <160.000µs -7.4%) vs baseline: -0.2%

Memory: ✅ 32.952MB (SLO: <34.500MB -4.5%) vs baseline: +5.0%

✅ obfuscation-worst-case-implicit-query

Time: ✅ 155.601µs (SLO: <170.000µs -8.5%) vs baseline: +0.6%

Memory: ✅ 32.952MB (SLO: <34.500MB -4.5%) vs baseline: +4.7%

✅ useragentvariant_exists_1

Time: ✅ 39.423µs (SLO: <50.000µs 📉 -21.2%) vs baseline: +0.2%

Memory: ✅ 32.558MB (SLO: <34.000MB -4.2%) vs baseline: +5.0%

✅ useragentvariant_exists_2

Time: ✅ 40.721µs (SLO: <50.000µs 📉 -18.6%) vs baseline: +0.8%

Memory: ✅ 32.539MB (SLO: <34.000MB -4.3%) vs baseline: +4.9%

✅ useragentvariant_exists_3

Time: ✅ 40.067µs (SLO: <50.000µs 📉 -19.9%) vs baseline: +0.3%

Memory: ✅ 32.578MB (SLO: <34.000MB -4.2%) vs baseline: +4.9%

✅ useragentvariant_not_exists_1

Time: ✅ 40.379µs (SLO: <50.000µs 📉 -19.2%) vs baseline: +2.7%

Memory: ✅ 32.598MB (SLO: <34.000MB -4.1%) vs baseline: +4.9%

✅ useragentvariant_not_exists_2

Time: ✅ 39.306µs (SLO: <50.000µs 📉 -21.4%) vs baseline: +0.2%

Memory: ✅ 32.539MB (SLO: <34.000MB -4.3%) vs baseline: +4.8%

✅ span - 26/26

✅ add-event

Time: ✅ 20.082ms (SLO: <22.500ms 📉 -10.7%) vs baseline: +1.0%

Memory: ✅ 48.798MB (SLO: <53.000MB -7.9%) vs baseline: +4.7%

✅ add-metrics

Time: ✅ 90.691ms (SLO: <93.500ms -3.0%) vs baseline: +1.2%

Memory: ✅ 735.840MB (SLO: <961.000MB 📉 -23.4%) vs baseline: +4.9%

✅ add-tags

Time: ✅ 147.420ms (SLO: <155.000ms -4.9%) vs baseline: +0.2%

Memory: ✅ 736.039MB (SLO: <962.500MB 📉 -23.5%) vs baseline: +4.9%

✅ get-context

Time: ✅ 18.407ms (SLO: <20.500ms 📉 -10.2%) vs baseline: +0.4%

Memory: ✅ 47.529MB (SLO: <53.000MB 📉 -10.3%) vs baseline: +4.9%

✅ is-recording

Time: ✅ 18.725ms (SLO: <20.500ms -8.7%) vs baseline: +0.6%

Memory: ✅ 47.495MB (SLO: <53.000MB 📉 -10.4%) vs baseline: +4.9%

✅ record-exception

Time: ✅ 37.332ms (SLO: <40.000ms -6.7%) vs baseline: ~same

Memory: ✅ 42.051MB (SLO: <53.000MB 📉 -20.7%) vs baseline: +5.0%

✅ set-status

Time: ✅ 20.085ms (SLO: <22.000ms -8.7%) vs baseline: -0.4%

Memory: ✅ 47.539MB (SLO: <53.000MB 📉 -10.3%) vs baseline: +4.9%

✅ start

Time: ✅ 18.648ms (SLO: <20.500ms -9.0%) vs baseline: +2.8%

Memory: ✅ 47.544MB (SLO: <53.000MB 📉 -10.3%) vs baseline: +4.8%

✅ start-finish

Time: ✅ 50.685ms (SLO: <52.500ms -3.5%) vs baseline: +0.7%

Memory: ✅ 32.126MB (SLO: <34.000MB -5.5%) vs baseline: +4.9%

✅ start-finish-telemetry

Time: ✅ 52.095ms (SLO: <54.500ms -4.4%) vs baseline: +0.6%

Memory: ✅ 32.185MB (SLO: <34.000MB -5.3%) vs baseline: +5.0%

✅ start-finish-traceid128

Time: ✅ 54.866ms (SLO: <57.000ms -3.7%) vs baseline: +1.3%

Memory: ✅ 32.145MB (SLO: <34.000MB -5.5%) vs baseline: +4.9%

✅ start-traceid128

Time: ✅ 19.080ms (SLO: <22.500ms 📉 -15.2%) vs baseline: +3.0%

Memory: ✅ 47.622MB (SLO: <53.000MB 📉 -10.1%) vs baseline: +5.1%

✅ update-name

Time: ✅ 18.820ms (SLO: <22.000ms 📉 -14.5%) vs baseline: +0.9%

Memory: ✅ 48.240MB (SLO: <53.000MB -9.0%) vs baseline: +5.1%

✅ tracer - 6/6

✅ large

Time: ✅ 29.504ms (SLO: <32.950ms 📉 -10.5%) vs baseline: ~same

Memory: ✅ 32.971MB (SLO: <34.500MB -4.4%) vs baseline: +4.7%

✅ medium

Time: ✅ 2.927ms (SLO: <3.200ms -8.5%) vs baseline: +0.1%

Memory: ✅ 32.165MB (SLO: <34.000MB -5.4%) vs baseline: +5.1%

✅ small

Time: ✅ 332.176µs (SLO: <370.000µs 📉 -10.2%) vs baseline: +0.4%

Memory: ✅ 32.204MB (SLO: <34.000MB -5.3%) vs baseline: +4.9%

ℹ️ Scenarios Missing SLO Configuration (9 scenarios)

The following scenarios exist in candidate data but have no SLO thresholds configured:

coreapiscenario-core_dispatch_listeners
coreapiscenario-core_dispatch_no_listeners
coreapiscenario-core_dispatch_with_results_listeners
coreapiscenario-core_dispatch_with_results_no_listeners
djangosimple-baseline
errortrackingdjangosimple-baseline
errortrackingflasksqli-baseline
flasksimple-baseline
flasksqli-baseline

multi run support for experiments

b85504d

gary-huang force-pushed the gary/mlob-3805 branch from 9dd262b to b85504d Compare October 28, 2025 15:37

wip multirun #15071

Are you sure you want to change the base?

wip multirun #15071

Conversation

gary-huang commented Oct 28, 2025

Description

Testing

Risks

Additional Notes

Uh oh!

github-actions bot commented Oct 28, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Oct 28, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Bootstrap import analysis

Summary

Import time breakdown

Uh oh!

pr-commenter bot commented Oct 28, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Performance SLOs

✅ appsec

✅ exception-replay-enabled

✅ iast

✅ profiler

✅ resource-renaming

✅ span-code-origin

✅ tracer

❌ tracer-and-profiler

❌ tracer-dont-create-db-spans

❌ tracer-minimal

✅ tracer-native

✅ tracer-no-caches

✅ tracer-no-databases

✅ tracer-no-middleware

✅ tracer-no-templates

✅ ospathbasename_aspect

✅ ospathbasename_noaspect

✅ ospathjoin_aspect

✅ ospathjoin_noaspect

✅ ospathnormcase_aspect

✅ ospathnormcase_noaspect

✅ ospathsplit_aspect

✅ ospathsplit_noaspect

✅ ospathsplitdrive_aspect

✅ ospathsplitdrive_noaspect

✅ ospathsplitext_aspect

✅ ospathsplitext_noaspect

✅ errortracking-enabled-all

✅ errortracking-enabled-user

✅ tracer-enabled

✅ errortracking-enabled-all

✅ errortracking-enabled-user

✅ tracer-enabled

✅ appsec-get

✅ appsec-post

✅ appsec-telemetry

✅ debugger

✅ iast-get

✅ profiler

✅ resource-renaming

✅ tracer

✅ tracer-native

✅ appsec-enabled

✅ iast-enabled

✅ tracer-enabled

✅ 1-count-metric-1-times

✅ 1-count-metrics-100-times

✅ 1-distribution-metric-1-times

✅ 1-distribution-metrics-100-times

✅ 1-gauge-metric-1-times

✅ 1-gauge-metrics-100-times

✅ 1-rate-metric-1-times

✅ 1-rate-metrics-100-times

✅ 100-count-metrics-100-times

✅ 100-distribution-metrics-100-times

✅ 100-gauge-metrics-100-times

✅ 100-rate-metrics-100-times

✅ flush-1-metric

github-actions bot commented Oct 28, 2025 •

edited

Loading

github-actions bot commented Oct 28, 2025 •

edited

Loading

pr-commenter bot commented Oct 28, 2025 •

edited

Loading