Default LLM Observability ML Application to Service Name #9415

sabrenner · 2025-08-23T00:22:39Z

What Does This Do

Makes the dd.llmobs.ml.app or DD_LLMOBS_ML_APP configurations optional by removing an IllegalArgumentException when it is either null or empty, instead defaulting to the service name.

Motivation

Easier onboarding for LLM Observability. Often, when there is no clear direction for an ML application configuration, and/or it aligns directly with the service itself, it's more friction to figure out what value ML application should take, especially after seeing a hard exception thrown during configuration when you just want to enable LLM Observability. This change seeks to reduce that friction by just defaulting it to the service name. A user can still set it to something better suited for an ML application description/name, especially if the service hosts multiple ML applications

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: MLOB-3635

pr-commenter · 2025-08-23T00:27:45Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	sabrenner/llmobs-ml-app-optional
git_commit_date	1755892093	1755906816
git_commit_sha	`da2930a`	`b61f1d4`
release_version	1.53.0-SNAPSHOT~da2930a64d	1.53.0-SNAPSHOT~b61f1d49e0

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1755908592	1755908592
ci_job_id	1095348477	1095348477
ci_pipeline_id	74545166	74545166
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-ngrvbeav 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-ngrvbeav 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 47 metrics, 12 unstable metrics.

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.53.0-SNAPSHOT~b61f1d49e0, baseline=1.53.0-SNAPSHOT~da2930a64d

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.049 s) : 0, 1048654
Total [baseline] (8.639 s) : 0, 8638917
Agent [candidate] (1.052 s) : 0, 1051933
Total [candidate] (8.619 s) : 0, 8619451
section iast
Agent [baseline] (1.182 s) : 0, 1181899
Total [baseline] (9.405 s) : 0, 9405093
Agent [candidate] (1.197 s) : 0, 1197434
Total [candidate] (9.362 s) : 0, 9361827

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.049 s	-
Agent	iast	1.182 s	133.245 ms (12.7%)
Total	tracing	8.639 s	-
Total	iast	9.405 s	766.176 ms (8.9%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.052 s	-
Agent	iast	1.197 s	145.501 ms (13.8%)
Total	tracing	8.619 s	-
Total	iast	9.362 s	742.375 ms (8.6%)

gantt
    title insecure-bank - break down per module: candidate=1.53.0-SNAPSHOT~b61f1d49e0, baseline=1.53.0-SNAPSHOT~da2930a64d

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.463 ms) : 0, 1463
crashtracking [candidate] (1.452 ms) : 0, 1452
BytebuddyAgent [baseline] (734.189 ms) : 0, 734189
BytebuddyAgent [candidate] (735.81 ms) : 0, 735810
GlobalTracer [baseline] (242.725 ms) : 0, 242725
GlobalTracer [candidate] (243.717 ms) : 0, 243717
AppSec [baseline] (30.168 ms) : 0, 30168
AppSec [candidate] (30.241 ms) : 0, 30241
Debugger [baseline] (6.076 ms) : 0, 6076
Debugger [candidate] (6.091 ms) : 0, 6091
Remote Config [baseline] (670.285 µs) : 0, 670
Remote Config [candidate] (669.79 µs) : 0, 670
Telemetry [baseline] (12.346 ms) : 0, 12346
Telemetry [candidate] (12.932 ms) : 0, 12932
section iast
crashtracking [baseline] (1.459 ms) : 0, 1459
crashtracking [candidate] (1.477 ms) : 0, 1477
BytebuddyAgent [baseline] (852.948 ms) : 0, 852948
BytebuddyAgent [candidate] (865.261 ms) : 0, 865261
GlobalTracer [baseline] (235.267 ms) : 0, 235267
GlobalTracer [candidate] (235.268 ms) : 0, 235268
IAST [baseline] (28.687 ms) : 0, 28687
IAST [candidate] (30.161 ms) : 0, 30161
AppSec [baseline] (26.112 ms) : 0, 26112
AppSec [candidate] (27.413 ms) : 0, 27413
Debugger [baseline] (7.507 ms) : 0, 7507
Debugger [candidate] (7.49 ms) : 0, 7490
Remote Config [baseline] (618.475 µs) : 0, 618
Remote Config [candidate] (621.121 µs) : 0, 621
Telemetry [baseline] (8.26 ms) : 0, 8260
Telemetry [candidate] (8.518 ms) : 0, 8518

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.53.0-SNAPSHOT~b61f1d49e0, baseline=1.53.0-SNAPSHOT~da2930a64d

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.047 s) : 0, 1046978
Total [baseline] (10.695 s) : 0, 10694510
Agent [candidate] (1.048 s) : 0, 1047541
Total [candidate] (10.656 s) : 0, 10655731
section appsec
Agent [baseline] (1.225 s) : 0, 1224548
Total [baseline] (10.836 s) : 0, 10835830
Agent [candidate] (1.227 s) : 0, 1227039
Total [candidate] (10.838 s) : 0, 10837803
section iast
Agent [baseline] (1.19 s) : 0, 1189505
Total [baseline] (10.961 s) : 0, 10960919
Agent [candidate] (1.182 s) : 0, 1181894
Total [candidate] (11.024 s) : 0, 11024436
section profiling
Agent [baseline] (1.2 s) : 0, 1199705
Total [baseline] (10.914 s) : 0, 10913604
Agent [candidate] (1.21 s) : 0, 1209904
Total [candidate] (11.002 s) : 0, 11001589

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.047 s	-
Agent	appsec	1.225 s	177.57 ms (17.0%)
Agent	iast	1.19 s	142.528 ms (13.6%)
Agent	profiling	1.2 s	152.728 ms (14.6%)
Total	tracing	10.695 s	-
Total	appsec	10.836 s	141.32 ms (1.3%)
Total	iast	10.961 s	266.409 ms (2.5%)
Total	profiling	10.914 s	219.093 ms (2.0%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.048 s	-
Agent	appsec	1.227 s	179.497 ms (17.1%)
Agent	iast	1.182 s	134.353 ms (12.8%)
Agent	profiling	1.21 s	162.363 ms (15.5%)
Total	tracing	10.656 s	-
Total	appsec	10.838 s	182.073 ms (1.7%)
Total	iast	11.024 s	368.705 ms (3.5%)
Total	profiling	11.002 s	345.858 ms (3.2%)

gantt
    title petclinic - break down per module: candidate=1.53.0-SNAPSHOT~b61f1d49e0, baseline=1.53.0-SNAPSHOT~da2930a64d

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.449 ms) : 0, 1449
crashtracking [candidate] (1.456 ms) : 0, 1456
BytebuddyAgent [baseline] (732.604 ms) : 0, 732604
BytebuddyAgent [candidate] (733.419 ms) : 0, 733419
GlobalTracer [baseline] (242.798 ms) : 0, 242798
GlobalTracer [candidate] (243.157 ms) : 0, 243157
AppSec [baseline] (30.145 ms) : 0, 30145
AppSec [candidate] (30.158 ms) : 0, 30158
Debugger [baseline] (6.033 ms) : 0, 6033
Debugger [candidate] (6.06 ms) : 0, 6060
Remote Config [baseline] (669.025 µs) : 0, 669
Remote Config [candidate] (669.627 µs) : 0, 670
Telemetry [baseline] (12.214 ms) : 0, 12214
Telemetry [candidate] (11.464 ms) : 0, 11464
section appsec
crashtracking [baseline] (1.448 ms) : 0, 1448
crashtracking [candidate] (1.475 ms) : 0, 1475
BytebuddyAgent [baseline] (755.892 ms) : 0, 755892
BytebuddyAgent [candidate] (757.854 ms) : 0, 757854
GlobalTracer [baseline] (235.351 ms) : 0, 235351
GlobalTracer [candidate] (236.417 ms) : 0, 236417
AppSec [baseline] (168.163 ms) : 0, 168163
AppSec [candidate] (170.827 ms) : 0, 170827
Debugger [baseline] (6.633 ms) : 0, 6633
Debugger [candidate] (6.468 ms) : 0, 6468
Remote Config [baseline] (642.591 µs) : 0, 643
Remote Config [candidate] (633.322 µs) : 0, 633
Telemetry [baseline] (11.613 ms) : 0, 11613
Telemetry [candidate] (8.504 ms) : 0, 8504
IAST [baseline] (23.614 ms) : 0, 23614
IAST [candidate] (23.638 ms) : 0, 23638
section iast
crashtracking [baseline] (1.462 ms) : 0, 1462
crashtracking [candidate] (1.455 ms) : 0, 1455
BytebuddyAgent [baseline] (859.148 ms) : 0, 859148
BytebuddyAgent [candidate] (853.236 ms) : 0, 853236
GlobalTracer [baseline] (234.715 ms) : 0, 234715
GlobalTracer [candidate] (234.55 ms) : 0, 234550
AppSec [baseline] (26.205 ms) : 0, 26205
AppSec [candidate] (27.726 ms) : 0, 27726
Debugger [baseline] (6.632 ms) : 0, 6632
Debugger [candidate] (5.756 ms) : 0, 5756
Remote Config [baseline] (606.116 µs) : 0, 606
Remote Config [candidate] (584.496 µs) : 0, 584
Telemetry [baseline] (8.348 ms) : 0, 8348
Telemetry [candidate] (8.169 ms) : 0, 8169
IAST [baseline] (31.263 ms) : 0, 31263
IAST [candidate] (29.32 ms) : 0, 29320
section profiling
ProfilingAgent [baseline] (107.881 ms) : 0, 107881
ProfilingAgent [candidate] (109.199 ms) : 0, 109199
crashtracking [baseline] (1.435 ms) : 0, 1435
crashtracking [candidate] (1.461 ms) : 0, 1461
BytebuddyAgent [baseline] (764.157 ms) : 0, 764157
BytebuddyAgent [candidate] (771.556 ms) : 0, 771556
GlobalTracer [baseline] (223.094 ms) : 0, 223094
GlobalTracer [candidate] (223.491 ms) : 0, 223491
AppSec [baseline] (30.113 ms) : 0, 30113
AppSec [candidate] (30.306 ms) : 0, 30306
Debugger [baseline] (6.292 ms) : 0, 6292
Debugger [candidate] (6.378 ms) : 0, 6378
Remote Config [baseline] (750.372 µs) : 0, 750
Remote Config [candidate] (716.448 µs) : 0, 716
Telemetry [baseline] (16.155 ms) : 0, 16155
Telemetry [candidate] (16.473 ms) : 0, 16473
Profiling [baseline] (108.548 ms) : 0, 108548
Profiling [candidate] (109.855 ms) : 0, 109855

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	sabrenner/llmobs-ml-app-optional
git_commit_date	1755892093	1755906816
git_commit_sha	`da2930a`	`b61f1d4`
release_version	1.53.0-SNAPSHOT~da2930a64d	1.53.0-SNAPSHOT~b61f1d49e0

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1755908261	1755908261
ci_job_id	1095348478	1095348478
ci_pipeline_id	74545166	74545166
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-xvlvlqkv 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-xvlvlqkv 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 3 performance improvements and 1 performance regressions! Performance is the same for 8 metrics, 12 unstable metrics.

scenario	Δ mean http_req_duration	Δ mean throughput	candidate mean http_req_duration	candidate mean throughput	baseline mean http_req_duration	baseline mean throughput
scenario:load:petclinic:appsec:high_load	better [-2.127ms; -1.219ms] or [-4.463%; -2.558%]	unstable [-3.529op/s; +10.704op/s] or [-3.593%; +10.899%]	45.984ms	101.800op/s	47.657ms	98.213op/s
scenario:load:petclinic:profiling:high_load	better [-2.232ms; -1.259ms] or [-4.533%; -2.557%]	unstable [-3.616op/s; +10.566op/s] or [-3.802%; +11.109%]	47.487ms	98.588op/s	49.232ms	95.112op/s
scenario:load:petclinic:iast:high_load	better [-2.534ms; -1.688ms] or [-5.443%; -3.624%]	unstable [-2.671op/s; +12.246op/s] or [-2.658%; +12.187%]	44.452ms	105.275op/s	46.563ms	100.487op/s
scenario:load:petclinic:code_origins:high_load	worse [+1.282ms; +2.120ms] or [+2.871%; +4.748%]	unstable [-10.988op/s; +3.263op/s] or [-10.483%; +3.113%]	46.355ms	100.950op/s	44.654ms	104.812op/s

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.53.0-SNAPSHOT~b61f1d49e0, baseline=1.53.0-SNAPSHOT~da2930a64d
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.302 ms) : 4252, 4353
.   : milestone, 4302,
iast (9.32 ms) : 9166, 9474
.   : milestone, 9320,
iast_FULL (14.235 ms) : 13952, 14519
.   : milestone, 14235,
iast_GLOBAL (10.243 ms) : 10053, 10434
.   : milestone, 10243,
profiling (8.724 ms) : 8583, 8866
.   : milestone, 8724,
tracing (7.617 ms) : 7511, 7723
.   : milestone, 7617,
section candidate
no_agent (4.349 ms) : 4300, 4397
.   : milestone, 4349,
iast (9.104 ms) : 8958, 9251
.   : milestone, 9104,
iast_FULL (14.301 ms) : 14016, 14585
.   : milestone, 14301,
iast_GLOBAL (9.878 ms) : 9704, 10052
.   : milestone, 9878,
profiling (8.758 ms) : 8614, 8901
.   : milestone, 8758,
tracing (7.817 ms) : 7701, 7932
.   : milestone, 7817,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.302 ms [4.252 ms, 4.353 ms]	-
iast	9.32 ms [9.166 ms, 9.474 ms]	5.018 ms (116.6%)
iast_FULL	14.235 ms [13.952 ms, 14.519 ms]	9.933 ms (230.9%)
iast_GLOBAL	10.243 ms [10.053 ms, 10.434 ms]	5.941 ms (138.1%)
profiling	8.724 ms [8.583 ms, 8.866 ms]	4.422 ms (102.8%)
tracing	7.617 ms [7.511 ms, 7.723 ms]	3.314 ms (77.0%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.349 ms [4.3 ms, 4.397 ms]	-
iast	9.104 ms [8.958 ms, 9.251 ms]	4.756 ms (109.4%)
iast_FULL	14.301 ms [14.016 ms, 14.585 ms]	9.952 ms (228.9%)
iast_GLOBAL	9.878 ms [9.704 ms, 10.052 ms]	5.53 ms (127.2%)
profiling	8.758 ms [8.614 ms, 8.901 ms]	4.409 ms (101.4%)
tracing	7.817 ms [7.701 ms, 7.932 ms]	3.468 ms (79.8%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.53.0-SNAPSHOT~b61f1d49e0, baseline=1.53.0-SNAPSHOT~da2930a64d
    dateFormat X
    axisFormat %s
section baseline
no_agent (37.627 ms) : 37325, 37930
.   : milestone, 37627,
appsec (47.657 ms) : 47225, 48090
.   : milestone, 47657,
code_origins (44.654 ms) : 44271, 45037
.   : milestone, 44654,
iast (46.563 ms) : 46161, 46964
.   : milestone, 46563,
profiling (49.232 ms) : 48760, 49705
.   : milestone, 49232,
tracing (42.574 ms) : 42217, 42932
.   : milestone, 42574,
section candidate
no_agent (37.266 ms) : 36962, 37569
.   : milestone, 37266,
appsec (45.984 ms) : 45573, 46395
.   : milestone, 45984,
code_origins (46.355 ms) : 45960, 46751
.   : milestone, 46355,
iast (44.452 ms) : 44066, 44837
.   : milestone, 44452,
profiling (47.487 ms) : 47056, 47918
.   : milestone, 47487,
tracing (43.2 ms) : 42820, 43581
.   : milestone, 43200,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	37.627 ms [37.325 ms, 37.93 ms]	-
appsec	47.657 ms [47.225 ms, 48.09 ms]	10.03 ms (26.7%)
code_origins	44.654 ms [44.271 ms, 45.037 ms]	7.027 ms (18.7%)
iast	46.563 ms [46.161 ms, 46.964 ms]	8.936 ms (23.7%)
profiling	49.232 ms [48.76 ms, 49.705 ms]	11.605 ms (30.8%)
tracing	42.574 ms [42.217 ms, 42.932 ms]	4.947 ms (13.1%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	37.266 ms [36.962 ms, 37.569 ms]	-
appsec	45.984 ms [45.573 ms, 46.395 ms]	8.719 ms (23.4%)
code_origins	46.355 ms [45.96 ms, 46.751 ms]	9.09 ms (24.4%)
iast	44.452 ms [44.066 ms, 44.837 ms]	7.186 ms (19.3%)
profiling	47.487 ms [47.056 ms, 47.918 ms]	10.221 ms (27.4%)
tracing	43.2 ms [42.82 ms, 43.581 ms]	5.935 ms (15.9%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	sabrenner/llmobs-ml-app-optional
git_commit_date	1755892093	1755906816
git_commit_sha	`da2930a`	`b61f1d4`
release_version	1.53.0-SNAPSHOT~da2930a64d	1.53.0-SNAPSHOT~b61f1d49e0

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1755908788	1755908788
ci_job_id	1095348479	1095348479
ci_pipeline_id	74545166	74545166
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-xponzzp0 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-xponzzp0 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.53.0-SNAPSHOT~b61f1d49e0, baseline=1.53.0-SNAPSHOT~da2930a64d
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.473 s) : 15473000, 15473000
.   : milestone, 15473000,
appsec (14.795 s) : 14795000, 14795000
.   : milestone, 14795000,
iast (18.322 s) : 18322000, 18322000
.   : milestone, 18322000,
iast_GLOBAL (18.054 s) : 18054000, 18054000
.   : milestone, 18054000,
profiling (15.254 s) : 15254000, 15254000
.   : milestone, 15254000,
tracing (15.035 s) : 15035000, 15035000
.   : milestone, 15035000,
section candidate
no_agent (14.965 s) : 14965000, 14965000
.   : milestone, 14965000,
appsec (14.966 s) : 14966000, 14966000
.   : milestone, 14966000,
iast (18.29 s) : 18290000, 18290000
.   : milestone, 18290000,
iast_GLOBAL (17.521 s) : 17521000, 17521000
.   : milestone, 17521000,
profiling (15.281 s) : 15281000, 15281000
.   : milestone, 15281000,
tracing (14.925 s) : 14925000, 14925000
.   : milestone, 14925000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.473 s [15.473 s, 15.473 s]	-
appsec	14.795 s [14.795 s, 14.795 s]	-678.0 ms (-4.4%)
iast	18.322 s [18.322 s, 18.322 s]	2.849 s (18.4%)
iast_GLOBAL	18.054 s [18.054 s, 18.054 s]	2.581 s (16.7%)
profiling	15.254 s [15.254 s, 15.254 s]	-219.0 ms (-1.4%)
tracing	15.035 s [15.035 s, 15.035 s]	-438.0 ms (-2.8%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.965 s [14.965 s, 14.965 s]	-
appsec	14.966 s [14.966 s, 14.966 s]	1.0 ms (0.0%)
iast	18.29 s [18.29 s, 18.29 s]	3.325 s (22.2%)
iast_GLOBAL	17.521 s [17.521 s, 17.521 s]	2.556 s (17.1%)
profiling	15.281 s [15.281 s, 15.281 s]	316.0 ms (2.1%)
tracing	14.925 s [14.925 s, 14.925 s]	-40.0 ms (-0.3%)

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.53.0-SNAPSHOT~b61f1d49e0, baseline=1.53.0-SNAPSHOT~da2930a64d
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.481 ms) : 1469, 1492
.   : milestone, 1481,
appsec (3.674 ms) : 3455, 3892
.   : milestone, 3674,
iast (2.215 ms) : 2152, 2278
.   : milestone, 2215,
iast_GLOBAL (2.251 ms) : 2187, 2314
.   : milestone, 2251,
profiling (2.049 ms) : 1998, 2100
.   : milestone, 2049,
tracing (2.014 ms) : 1965, 2063
.   : milestone, 2014,
section candidate
no_agent (1.48 ms) : 1468, 1491
.   : milestone, 1480,
appsec (3.655 ms) : 3440, 3871
.   : milestone, 3655,
iast (2.212 ms) : 2149, 2275
.   : milestone, 2212,
iast_GLOBAL (2.247 ms) : 2184, 2311
.   : milestone, 2247,
profiling (2.072 ms) : 2019, 2124
.   : milestone, 2072,
tracing (2.036 ms) : 1987, 2086
.   : milestone, 2036,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.481 ms [1.469 ms, 1.492 ms]	-
appsec	3.674 ms [3.455 ms, 3.892 ms]	2.193 ms (148.1%)
iast	2.215 ms [2.152 ms, 2.278 ms]	734.364 µs (49.6%)
iast_GLOBAL	2.251 ms [2.187 ms, 2.314 ms]	769.863 µs (52.0%)
profiling	2.049 ms [1.998 ms, 2.1 ms]	568.485 µs (38.4%)
tracing	2.014 ms [1.965 ms, 2.063 ms]	533.077 µs (36.0%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.48 ms [1.468 ms, 1.491 ms]	-
appsec	3.655 ms [3.44 ms, 3.871 ms]	2.176 ms (147.0%)
iast	2.212 ms [2.149 ms, 2.275 ms]	732.313 µs (49.5%)
iast_GLOBAL	2.247 ms [2.184 ms, 2.311 ms]	767.688 µs (51.9%)
profiling	2.072 ms [2.019 ms, 2.124 ms]	592.016 µs (40.0%)
tracing	2.036 ms [1.987 ms, 2.086 ms]	556.7 µs (37.6%)

sabrenner added 2 commits August 22, 2025 19:49

config changes

ac08f71

config test changes

b61f1d4

sabrenner added type: enhancement Enhancements and improvements comp: mlobs ML Observability (LLMObs) labels Aug 23, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Default LLM Observability ML Application to Service Name #9415

Default LLM Observability ML Application to Service Name #9415

Uh oh!

sabrenner commented Aug 23, 2025

Uh oh!

pr-commenter bot commented Aug 23, 2025

Uh oh!

Uh oh!

Default LLM Observability ML Application to Service Name #9415

Are you sure you want to change the base?

Default LLM Observability ML Application to Service Name #9415

Uh oh!

Conversation

sabrenner commented Aug 23, 2025

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

pr-commenter bot commented Aug 23, 2025

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Uh oh!