Skip to content

Add telemetry to AI Guard evaluations #9884

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 3 commits into from
Nov 3, 2025
Merged

Add telemetry to AI Guard evaluations #9884

merged 3 commits into from
Nov 3, 2025

Conversation

@manuel-alvarez-alvarez
Copy link
Member

@manuel-alvarez-alvarez manuel-alvarez-alvarez commented Oct 30, 2025

What Does This Do

Adds telemetry to the AI Guard evaluations.

Motivation

We want to track customer usage of the SDK through telemetry metrics.

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@manuel-alvarez-alvarez manuel-alvarez-alvarez requested a review from a team as a code owner October 30, 2025 13:09
@manuel-alvarez-alvarez manuel-alvarez-alvarez added type: enhancement Enhancements and improvements tag: no release notes Changes to exclude from release notes comp: asm waf Application Security Management (WAF) labels Oct 30, 2025
@datadog-datadog-prod-us1
Copy link
Contributor

datadog-datadog-prod-us1 bot commented Oct 30, 2025 •
edited
Loading

🎯 Code Coverage
• Patch Coverage: 92.31%
• Total Coverage: 60.18% (+0.48%)

View detailed report

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: b4114df | Docs | Datadog PR Page | Was this helpful? Give us feedback!

@pr-commenter
Copy link

pr-commenter bot commented Oct 30, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master malvarez/ai-guard-telemetry
git_commit_date 1762162192 1762163669
git_commit_sha 96d5ea2 b4114df
release_version 1.55.0-SNAPSHOT~96d5ea23eb 1.55.0-SNAPSHOT~b4114df0a4
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1762177411 1762177411
ci_job_id 1211898394 1211898394
ci_pipeline_id 81022154 81022154
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-w2w9qm1q 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-w2w9qm1q 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 53 metrics, 12 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.55.0-SNAPSHOT~b4114df0a4, baseline=1.55.0-SNAPSHOT~96d5ea23eb

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.029 s) : 0, 1029315
Total [baseline] (8.698 s) : 0, 8697813
Agent [candidate] (1.03 s) : 0, 1030356
Total [candidate] (8.716 s) : 0, 8715903
section iast
Agent [baseline] (1.162 s) : 0, 1161617
Total [baseline] (9.369 s) : 0, 9368666
Agent [candidate] (1.161 s) : 0, 1160796
Total [candidate] (9.372 s) : 0, 9371825
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.029 s -
Agent iast 1.162 s 132.302 ms (12.9%)
Total tracing 8.698 s -
Total iast 9.369 s 670.854 ms (7.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.03 s -
Agent iast 1.161 s 130.44 ms (12.7%)
Total tracing 8.716 s -
Total iast 9.372 s 655.921 ms (7.5%) 
gantt
    title insecure-bank - break down per module: candidate=1.55.0-SNAPSHOT~b4114df0a4, baseline=1.55.0-SNAPSHOT~96d5ea23eb

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.467 ms) : 0, 1467
crashtracking [candidate] (1.462 ms) : 0, 1462
BytebuddyAgent [baseline] (701.877 ms) : 0, 701877
BytebuddyAgent [candidate] (702.329 ms) : 0, 702329
GlobalTracer [baseline] (244.523 ms) : 0, 244523
GlobalTracer [candidate] (245.064 ms) : 0, 245064
AppSec [baseline] (32.199 ms) : 0, 32199
AppSec [candidate] (32.435 ms) : 0, 32435
Debugger [baseline] (6.363 ms) : 0, 6363
Debugger [candidate] (6.39 ms) : 0, 6390
Remote Config [baseline] (685.886 µs) : 0, 686
Remote Config [candidate] (674.043 µs) : 0, 674
Telemetry [baseline] (14.515 ms) : 0, 14515
Telemetry [candidate] (13.699 ms) : 0, 13699
Flare Poller [baseline] (6.536 ms) : 0, 6536
Flare Poller [candidate] (7.157 ms) : 0, 7157
section iast
crashtracking [baseline] (1.47 ms) : 0, 1470
crashtracking [candidate] (1.474 ms) : 0, 1474
BytebuddyAgent [baseline] (824.234 ms) : 0, 824234
BytebuddyAgent [candidate] (823.99 ms) : 0, 823990
GlobalTracer [baseline] (233.579 ms) : 0, 233579
GlobalTracer [candidate] (233.433 ms) : 0, 233433
AppSec [baseline] (27.985 ms) : 0, 27985
AppSec [candidate] (28.818 ms) : 0, 28818
Debugger [baseline] (6.125 ms) : 0, 6125
Debugger [candidate] (6.101 ms) : 0, 6101
Remote Config [baseline] (607.941 µs) : 0, 608
Remote Config [candidate] (595.399 µs) : 0, 595
Telemetry [baseline] (8.452 ms) : 0, 8452
Telemetry [candidate] (8.446 ms) : 0, 8446
Flare Poller [baseline] (4.119 ms) : 0, 4119
Flare Poller [candidate] (4.085 ms) : 0, 4085
IAST [baseline] (33.735 ms) : 0, 33735
IAST [candidate] (32.696 ms) : 0, 32696
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.55.0-SNAPSHOT~b4114df0a4, baseline=1.55.0-SNAPSHOT~96d5ea23eb

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.036 s) : 0, 1036178
Total [baseline] (10.756 s) : 0, 10755751
Agent [candidate] (1.034 s) : 0, 1033843
Total [candidate] (10.911 s) : 0, 10911436
section appsec
Agent [baseline] (1.201 s) : 0, 1201404
Total [baseline] (11.084 s) : 0, 11083961
Agent [candidate] (1.201 s) : 0, 1201232
Total [candidate] (10.954 s) : 0, 10954460
section iast
Agent [baseline] (1.163 s) : 0, 1162710
Total [baseline] (11.154 s) : 0, 11154018
Agent [candidate] (1.162 s) : 0, 1161794
Total [candidate] (11.148 s) : 0, 11147533
section profiling
Agent [baseline] (1.172 s) : 0, 1171998
Total [baseline] (10.938 s) : 0, 10938397
Agent [candidate] (1.188 s) : 0, 1188026
Total [candidate] (10.943 s) : 0, 10943007
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.036 s -
Agent appsec 1.201 s 165.226 ms (15.9%)
Agent iast 1.163 s 126.532 ms (12.2%)
Agent profiling 1.172 s 135.819 ms (13.1%)
Total tracing 10.756 s -
Total appsec 11.084 s 328.21 ms (3.1%)
Total iast 11.154 s 398.267 ms (3.7%)
Total profiling 10.938 s 182.646 ms (1.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.034 s -
Agent appsec 1.201 s 167.389 ms (16.2%)
Agent iast 1.162 s 127.951 ms (12.4%)
Agent profiling 1.188 s 154.183 ms (14.9%)
Total tracing 10.911 s -
Total appsec 10.954 s 43.024 ms (0.4%)
Total iast 11.148 s 236.097 ms (2.2%)
Total profiling 10.943 s 31.571 ms (0.3%) 
gantt
    title petclinic - break down per module: candidate=1.55.0-SNAPSHOT~b4114df0a4, baseline=1.55.0-SNAPSHOT~96d5ea23eb

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.479 ms) : 0, 1479
crashtracking [candidate] (1.482 ms) : 0, 1482
BytebuddyAgent [baseline] (707.81 ms) : 0, 707810
BytebuddyAgent [candidate] (705.2 ms) : 0, 705200
GlobalTracer [baseline] (244.961 ms) : 0, 244961
GlobalTracer [candidate] (246.035 ms) : 0, 246035
AppSec [baseline] (32.506 ms) : 0, 32506
AppSec [candidate] (32.333 ms) : 0, 32333
Debugger [baseline] (6.438 ms) : 0, 6438
Debugger [candidate] (6.446 ms) : 0, 6446
Remote Config [baseline] (680.803 µs) : 0, 681
Remote Config [candidate] (688.9 µs) : 0, 689
Telemetry [baseline] (13.052 ms) : 0, 13052
Telemetry [candidate] (15.235 ms) : 0, 15235
Flare Poller [baseline] (7.914 ms) : 0, 7914
Flare Poller [candidate] (5.05 ms) : 0, 5050
section appsec
crashtracking [baseline] (1.477 ms) : 0, 1477
crashtracking [candidate] (1.464 ms) : 0, 1464
BytebuddyAgent [baseline] (724.86 ms) : 0, 724860
BytebuddyAgent [candidate] (725.162 ms) : 0, 725162
GlobalTracer [baseline] (235.834 ms) : 0, 235834
GlobalTracer [candidate] (236.079 ms) : 0, 236079
AppSec [baseline] (174.261 ms) : 0, 174261
AppSec [candidate] (173.672 ms) : 0, 173672
Debugger [baseline] (5.953 ms) : 0, 5953
Debugger [candidate] (5.905 ms) : 0, 5905
Remote Config [baseline] (624.296 µs) : 0, 624
Remote Config [candidate] (606.938 µs) : 0, 607
Telemetry [baseline] (8.444 ms) : 0, 8444
Telemetry [candidate] (8.356 ms) : 0, 8356
Flare Poller [baseline] (3.962 ms) : 0, 3962
Flare Poller [candidate] (3.898 ms) : 0, 3898
IAST [baseline] (24.862 ms) : 0, 24862
IAST [candidate] (24.95 ms) : 0, 24950
section iast
crashtracking [baseline] (1.471 ms) : 0, 1471
crashtracking [candidate] (1.474 ms) : 0, 1474
BytebuddyAgent [baseline] (824.566 ms) : 0, 824566
BytebuddyAgent [candidate] (823.931 ms) : 0, 823931
GlobalTracer [baseline] (234.682 ms) : 0, 234682
GlobalTracer [candidate] (234.114 ms) : 0, 234114
AppSec [baseline] (27.204 ms) : 0, 27204
AppSec [candidate] (29.1 ms) : 0, 29100
Debugger [baseline] (6.167 ms) : 0, 6167
Debugger [candidate] (6.108 ms) : 0, 6108
Remote Config [baseline] (600.444 µs) : 0, 600
Remote Config [candidate] (592.906 µs) : 0, 593
Telemetry [baseline] (8.369 ms) : 0, 8369
Telemetry [candidate] (8.371 ms) : 0, 8371
Flare Poller [baseline] (4.163 ms) : 0, 4163
Flare Poller [candidate] (4.202 ms) : 0, 4202
IAST [baseline] (34.26 ms) : 0, 34260
IAST [candidate] (32.511 ms) : 0, 32511
section profiling
crashtracking [baseline] (1.469 ms) : 0, 1469
crashtracking [candidate] (1.47 ms) : 0, 1470
BytebuddyAgent [baseline] (725.391 ms) : 0, 725391
BytebuddyAgent [candidate] (736.967 ms) : 0, 736967
GlobalTracer [baseline] (219.947 ms) : 0, 219947
GlobalTracer [candidate] (222.785 ms) : 0, 222785
AppSec [baseline] (32.257 ms) : 0, 32257
AppSec [candidate] (34.196 ms) : 0, 34196
Debugger [baseline] (10.762 ms) : 0, 10762
Debugger [candidate] (11.454 ms) : 0, 11454
Remote Config [baseline] (2.301 ms) : 0, 2301
Remote Config [candidate] (702.484 µs) : 0, 702
Telemetry [baseline] (10.721 ms) : 0, 10721
Telemetry [candidate] (9.792 ms) : 0, 9792
Flare Poller [baseline] (4.098 ms) : 0, 4098
Flare Poller [candidate] (4.202 ms) : 0, 4202
ProfilingAgent [baseline] (109.621 ms) : 0, 109621
ProfilingAgent [candidate] (110.335 ms) : 0, 110335
Profiling [baseline] (110.233 ms) : 0, 110233
Profiling [candidate] (110.983 ms) : 0, 110983
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master malvarez/ai-guard-telemetry
git_commit_date 1762162192 1762163669
git_commit_sha 96d5ea2 b4114df
release_version 1.55.0-SNAPSHOT~96d5ea23eb 1.55.0-SNAPSHOT~b4114df0a4
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1762177827 1762177827
ci_job_id 1211898211 1211898211
ci_pipeline_id 81022154 81022154
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-5tgnaufl 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-5tgnaufl 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 5 performance improvements and 1 performance regressions! Performance is the same for 6 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:insecure-bank:tracing:high_load better
[-113.776µs; -79.253µs] or [-6.093%; -4.244%]		 unstable
[-154.426op/s; +405.489op/s] or [-6.408%; +16.825%]		 1.771ms 2535.562op/s 1.867ms 2410.031op/s
scenario:load:insecure-bank:profiling:high_load better
[-181.247µs; -144.344µs] or [-8.695%; -6.925%]		 unstable
[-82.786op/s; +437.536op/s] or [-3.817%; +20.173%]		 1.922ms 2346.281op/s 2.084ms 2168.906op/s
scenario:load:insecure-bank:iast_GLOBAL:high_load better
[-219.795µs; -117.802µs] or [-6.080%; -3.258%]		 unstable
[-85.554op/s; +206.492op/s] or [-6.743%; +16.274%]		 3.447ms 1329.281op/s 3.615ms 1268.812op/s
scenario:load:insecure-bank:iast:high_load worse
[+91.000µs; +184.047µs] or [+2.791%; +5.645%]		 unstable
[-208.303op/s; +98.428op/s] or [-14.841%; +7.013%]		 3.398ms 1348.594op/s 3.261ms 1403.531op/s
scenario:load:petclinic:iast:high_load better
[-1.410ms; -1.016ms] or [-7.579%; -5.459%]		 unstable
[-8.093op/s; +42.905op/s] or [-3.226%; +17.102%]		 17.393ms 268.281op/s 18.606ms 250.875op/s
scenario:load:petclinic:appsec:high_load better
[-1.512ms; -1.067ms] or [-7.275%; -5.135%]		 unstable
[-8.540op/s; +38.103op/s] or [-3.801%; +16.956%]		 19.492ms 239.500op/s 20.782ms 224.719op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.55.0-SNAPSHOT~b4114df0a4, baseline=1.55.0-SNAPSHOT~96d5ea23eb
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.202 ms) : 1191, 1214
.   : milestone, 1202,
iast (3.261 ms) : 3218, 3303
.   : milestone, 3261,
iast_FULL (5.886 ms) : 5827, 5946
.   : milestone, 5886,
iast_GLOBAL (3.615 ms) : 3569, 3661
.   : milestone, 3615,
profiling (2.084 ms) : 2066, 2103
.   : milestone, 2084,
tracing (1.867 ms) : 1850, 1885
.   : milestone, 1867,
section candidate
no_agent (1.204 ms) : 1192, 1216
.   : milestone, 1204,
iast (3.398 ms) : 3354, 3442
.   : milestone, 3398,
iast_FULL (5.766 ms) : 5709, 5822
.   : milestone, 5766,
iast_GLOBAL (3.447 ms) : 3398, 3495
.   : milestone, 3447,
profiling (1.922 ms) : 1906, 1937
.   : milestone, 1922,
tracing (1.771 ms) : 1757, 1785
.   : milestone, 1771,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.202 ms [1.191 ms, 1.214 ms] -
iast 3.261 ms [3.218 ms, 3.303 ms] 2.058 ms (171.2%)
iast_FULL 5.886 ms [5.827 ms, 5.946 ms] 4.684 ms (389.5%)
iast_GLOBAL 3.615 ms [3.569 ms, 3.661 ms] 2.413 ms (200.7%)
profiling 2.084 ms [2.066 ms, 2.103 ms] 881.991 µs (73.4%)
tracing 1.867 ms [1.85 ms, 1.885 ms] 665.04 µs (55.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.204 ms [1.192 ms, 1.216 ms] -
iast 3.398 ms [3.354 ms, 3.442 ms] 2.194 ms (182.3%)
iast_FULL 5.766 ms [5.709 ms, 5.822 ms] 4.562 ms (379.0%)
iast_GLOBAL 3.447 ms [3.398 ms, 3.495 ms] 2.243 ms (186.3%)
profiling 1.922 ms [1.906 ms, 1.937 ms] 717.822 µs (59.6%)
tracing 1.771 ms [1.757 ms, 1.785 ms] 567.152 µs (47.1%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.55.0-SNAPSHOT~b4114df0a4, baseline=1.55.0-SNAPSHOT~96d5ea23eb
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.306 ms) : 19106, 19506
.   : milestone, 19306,
appsec (20.782 ms) : 20569, 20994
.   : milestone, 20782,
code_origins (19.685 ms) : 19489, 19882
.   : milestone, 19685,
iast (18.606 ms) : 18414, 18798
.   : milestone, 18606,
profiling (19.525 ms) : 19329, 19721
.   : milestone, 19525,
tracing (18.39 ms) : 18206, 18574
.   : milestone, 18390,
section candidate
no_agent (19.053 ms) : 18855, 19251
.   : milestone, 19053,
appsec (19.492 ms) : 19291, 19693
.   : milestone, 19492,
code_origins (19.739 ms) : 19542, 19937
.   : milestone, 19739,
iast (17.393 ms) : 17219, 17568
.   : milestone, 17393,
profiling (19.598 ms) : 19396, 19800
.   : milestone, 19598,
tracing (18.757 ms) : 18566, 18948
.   : milestone, 18757,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.306 ms [19.106 ms, 19.506 ms] -
appsec 20.782 ms [20.569 ms, 20.994 ms] 1.475 ms (7.6%)
code_origins 19.685 ms [19.489 ms, 19.882 ms] 379.015 µs (2.0%)
iast 18.606 ms [18.414 ms, 18.798 ms] -700.183 µs (-3.6%)
profiling 19.525 ms [19.329 ms, 19.721 ms] 218.931 µs (1.1%)
tracing 18.39 ms [18.206 ms, 18.574 ms] -916.315 µs (-4.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.053 ms [18.855 ms, 19.251 ms] -
appsec 19.492 ms [19.291 ms, 19.693 ms] 439.1 µs (2.3%)
code_origins 19.739 ms [19.542 ms, 19.937 ms] 686.259 µs (3.6%)
iast 17.393 ms [17.219 ms, 17.568 ms] -1.66 ms (-8.7%)
profiling 19.598 ms [19.396 ms, 19.8 ms] 544.817 µs (2.9%)
tracing 18.757 ms [18.566 ms, 18.948 ms] -295.835 µs (-1.6%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master malvarez/ai-guard-telemetry
git_commit_date 1762162192 1762163669
git_commit_sha 96d5ea2 b4114df
release_version 1.55.0-SNAPSHOT~96d5ea23eb 1.55.0-SNAPSHOT~b4114df0a4
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1762177595 1762177595
ci_job_id 1211898108 1211898108
ci_pipeline_id 81022154 81022154
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-9js69ipz 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-9js69ipz 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.55.0-SNAPSHOT~b4114df0a4, baseline=1.55.0-SNAPSHOT~96d5ea23eb
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.488 ms) : 1477, 1500
.   : milestone, 1488,
appsec (3.709 ms) : 3491, 3927
.   : milestone, 3709,
iast (2.231 ms) : 2167, 2294
.   : milestone, 2231,
iast_GLOBAL (2.273 ms) : 2209, 2336
.   : milestone, 2273,
profiling (2.065 ms) : 2014, 2116
.   : milestone, 2065,
tracing (2.042 ms) : 1992, 2091
.   : milestone, 2042,
section candidate
no_agent (1.483 ms) : 1471, 1495
.   : milestone, 1483,
appsec (3.656 ms) : 3444, 3869
.   : milestone, 3656,
iast (2.23 ms) : 2166, 2293
.   : milestone, 2230,
iast_GLOBAL (2.273 ms) : 2209, 2337
.   : milestone, 2273,
profiling (2.078 ms) : 2025, 2131
.   : milestone, 2078,
tracing (2.037 ms) : 1988, 2087
.   : milestone, 2037,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.488 ms [1.477 ms, 1.5 ms] -
appsec 3.709 ms [3.491 ms, 3.927 ms] 2.221 ms (149.2%)
iast 2.231 ms [2.167 ms, 2.294 ms] 742.393 µs (49.9%)
iast_GLOBAL 2.273 ms [2.209 ms, 2.336 ms] 784.498 µs (52.7%)
profiling 2.065 ms [2.014 ms, 2.116 ms] 576.885 µs (38.8%)
tracing 2.042 ms [1.992 ms, 2.091 ms] 553.604 µs (37.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.483 ms [1.471 ms, 1.495 ms] -
appsec 3.656 ms [3.444 ms, 3.869 ms] 2.173 ms (146.5%)
iast 2.23 ms [2.166 ms, 2.293 ms] 746.423 µs (50.3%)
iast_GLOBAL 2.273 ms [2.209 ms, 2.337 ms] 789.868 µs (53.3%)
profiling 2.078 ms [2.025 ms, 2.131 ms] 594.743 µs (40.1%)
tracing 2.037 ms [1.988 ms, 2.087 ms] 554.295 µs (37.4%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.55.0-SNAPSHOT~b4114df0a4, baseline=1.55.0-SNAPSHOT~96d5ea23eb
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.307 s) : 15307000, 15307000
.   : milestone, 15307000,
appsec (14.77 s) : 14770000, 14770000
.   : milestone, 14770000,
iast (18.318 s) : 18318000, 18318000
.   : milestone, 18318000,
iast_GLOBAL (18.118 s) : 18118000, 18118000
.   : milestone, 18118000,
profiling (15.2 s) : 15200000, 15200000
.   : milestone, 15200000,
tracing (15.23 s) : 15230000, 15230000
.   : milestone, 15230000,
section candidate
no_agent (14.914 s) : 14914000, 14914000
.   : milestone, 14914000,
appsec (14.968 s) : 14968000, 14968000
.   : milestone, 14968000,
iast (18.543 s) : 18543000, 18543000
.   : milestone, 18543000,
iast_GLOBAL (17.795 s) : 17795000, 17795000
.   : milestone, 17795000,
profiling (15.869 s) : 15869000, 15869000
.   : milestone, 15869000,
tracing (15.306 s) : 15306000, 15306000
.   : milestone, 15306000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.307 s [15.307 s, 15.307 s] -
appsec 14.77 s [14.77 s, 14.77 s] -537.0 ms (-3.5%)
iast 18.318 s [18.318 s, 18.318 s] 3.011 s (19.7%)
iast_GLOBAL 18.118 s [18.118 s, 18.118 s] 2.811 s (18.4%)
profiling 15.2 s [15.2 s, 15.2 s] -107.0 ms (-0.7%)
tracing 15.23 s [15.23 s, 15.23 s] -77.0 ms (-0.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.914 s [14.914 s, 14.914 s] -
appsec 14.968 s [14.968 s, 14.968 s] 54.0 ms (0.4%)
iast 18.543 s [18.543 s, 18.543 s] 3.629 s (24.3%)
iast_GLOBAL 17.795 s [17.795 s, 17.795 s] 2.881 s (19.3%)
profiling 15.869 s [15.869 s, 15.869 s] 955.0 ms (6.4%)
tracing 15.306 s [15.306 s, 15.306 s] 392.0 ms (2.6%)

jandro996
jandro996 approved these changes Nov 1, 2025
View reviewed changes
Copy link
Member

@jandro996 jandro996 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM just a minor comment

@manuel-alvarez-alvarez manuel-alvarez-alvarez merged commit 370c855 into master Nov 3, 2025
539 checks passed
@manuel-alvarez-alvarez manuel-alvarez-alvarez deleted the malvarez/ai-guard-telemetry branch November 3, 2025 14:10
@github-actions github-actions bot added this to the 1.55.0 milestone Nov 3, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@jandro996 jandro996 jandro996 approved these changes

@smola smola Awaiting requested review from smola smola is a code owner automatically assigned from DataDog/asm-java

Assignees

No one assigned

Labels

comp: asm waf Application Security Management (WAF) tag: no release notes Changes to exclude from release notes type: enhancement Enhancements and improvements

Projects

None yet

Milestone

1.55.0

Development

Successfully merging this pull request may close these issues.

3 participants

@manuel-alvarez-alvarez @jandro996