Skip to content

Conversation

@jpbempel
Copy link
Member

@jpbempel jpbempel commented Oct 28, 2025

What Does This Do

by default Code Origin will be started

Motivation

Additional Notes

Contributor Checklist

Jira ticket: DEBUG-4173

@jpbempel jpbempel requested a review from a team as a code owner October 28, 2025 16:57
@jpbempel jpbempel requested a review from mcculls October 28, 2025 16:57
@jpbempel jpbempel added the comp: debugger Dynamic Instrumentation label Oct 28, 2025
@github-actions
Copy link
Contributor

github-actions bot commented Oct 28, 2025

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

  • Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

@jpbempel jpbempel added the type: enhancement Enhancements and improvements label Oct 28, 2025
@datadog-datadog-prod-us1
Copy link
Contributor

datadog-datadog-prod-us1 bot commented Oct 28, 2025

🎯 Code Coverage
Patch Coverage: 0.00%
Total Coverage: 59.55% (-0.15%)

View detailed report

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 71e7de7 | Docs | Datadog PR Page | Was this helpful? Give us feedback!

@pr-commenter
Copy link

pr-commenter bot commented Oct 28, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/code-origin-default-on
git_commit_date 1762297540 1762328667
git_commit_sha 8db72c0 71e7de7
release_version 1.56.0-SNAPSHOT~8db72c0988 1.56.0-SNAPSHOT~71e7de7cc4
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1762330776 1762330776
ci_job_id 1216405414 1216405414
ci_pipeline_id 81286538 81286538
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-w2aogz80 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-w2aogz80 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 11 performance improvements and 6 performance regressions! Performance is the same for 32 metrics, 16 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:insecure-bank:iast:Agent.start worse
[+38.521ms; +71.668ms] or [+3.244%; +6.035%]
1.243s 1.188s
scenario:startup:insecure-bank:iast:Remote Config better
[-69.468µs; -27.437µs] or [-11.418%; -4.510%]
559.967µs 608.420µs
scenario:startup:insecure-bank:iast:Flare Poller better
[-480.666µs; -266.727µs] or [-11.812%; -6.555%]
3.696ms 4.069ms
scenario:startup:insecure-bank:tracing:Agent.start worse
[+47.886ms; +64.646ms] or [+4.564%; +6.161%]
1.106s 1.049s
scenario:startup:insecure-bank:tracing:Remote Config better
[-90.743µs; -51.512µs] or [-12.666%; -7.190%]
645.310µs 716.437µs
scenario:startup:petclinic:appsec:Agent.start worse
[+42.970ms; +66.299ms] or [+3.501%; +5.402%]
1.282s 1.227s
scenario:startup:petclinic:appsec:Flare Poller better
[-429.037µs; -155.596µs] or [-10.746%; -3.897%]
3.700ms 3.993ms
scenario:startup:petclinic:iast:Agent.start worse
[+58.655ms; +68.212ms] or [+4.981%; +5.792%]
1.241s 1.178s
scenario:startup:petclinic:iast:Remote Config better
[-64.044µs; -19.334µs] or [-10.543%; -3.183%]
565.776µs 607.465µs
scenario:startup:petclinic:iast:Flare Poller better
[-632.893µs; -390.210µs] or [-15.311%; -9.440%]
3.622ms 4.134ms
scenario:startup:petclinic:profiling:Agent.start worse
[+32.424ms; +39.331ms] or [+2.711%; +3.288%]
1.232s 1.196s
scenario:startup:petclinic:profiling:ProfilingAgent better
[-15.370ms; -13.424ms] or [-13.885%; -12.127%]
96.300ms 110.697ms
scenario:startup:petclinic:profiling:Telemetry better
[-8.815ms; -8.299ms] or [-53.454%; -50.324%]
7.934ms 16.491ms
scenario:startup:petclinic:profiling:Flare Poller better
[-382.041µs; -187.822µs] or [-9.283%; -4.564%]
3.831ms 4.116ms
scenario:startup:petclinic:profiling:Profiling better
[-15.444ms; -13.510ms] or [-13.869%; -12.132%]
96.882ms 111.359ms
scenario:startup:petclinic:tracing:Agent.start worse
[+45.068ms; +75.263ms] or [+4.298%; +7.178%]
1.109s 1.049s
scenario:startup:petclinic:tracing:Remote Config better
[-81.408µs; -42.444µs] or [-11.436%; -5.962%]
649.957µs 711.883µs
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.56.0-SNAPSHOT~71e7de7cc4, baseline=1.56.0-SNAPSHOT~8db72c0988

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.049 s) : 0, 1048513
Total [baseline] (10.738 s) : 0, 10738266
Agent [candidate] (1.109 s) : 0, 1108679
Total [candidate] (10.763 s) : 0, 10763098
section appsec
Agent [baseline] (1.227 s) : 0, 1227338
Total [baseline] (10.883 s) : 0, 10883210
Agent [candidate] (1.282 s) : 0, 1281973
Total [candidate] (11.154 s) : 0, 11154425
section iast
Agent [baseline] (1.178 s) : 0, 1177598
Total [baseline] (11.119 s) : 0, 11119481
Agent [candidate] (1.241 s) : 0, 1241032
Total [candidate] (11.26 s) : 0, 11259585
section profiling
Agent [baseline] (1.196 s) : 0, 1196143
Total [baseline] (10.907 s) : 0, 10907006
Agent [candidate] (1.232 s) : 0, 1232020
Total [candidate] (11.016 s) : 0, 11016251
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.049 s -
Agent appsec 1.227 s 178.825 ms (17.1%)
Agent iast 1.178 s 129.085 ms (12.3%)
Agent profiling 1.196 s 147.63 ms (14.1%)
Total tracing 10.738 s -
Total appsec 10.883 s 144.944 ms (1.3%)
Total iast 11.119 s 381.214 ms (3.6%)
Total profiling 10.907 s 168.74 ms (1.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.109 s -
Agent appsec 1.282 s 173.294 ms (15.6%)
Agent iast 1.241 s 132.354 ms (11.9%)
Agent profiling 1.232 s 123.342 ms (11.1%)
Total tracing 10.763 s -
Total appsec 11.154 s 391.328 ms (3.6%)
Total iast 11.26 s 496.487 ms (4.6%)
Total profiling 11.016 s 253.153 ms (2.4%)
gantt
    title petclinic - break down per module: candidate=1.56.0-SNAPSHOT~71e7de7cc4, baseline=1.56.0-SNAPSHOT~8db72c0988

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.464 ms) : 0, 1464
crashtracking [candidate] (1.473 ms) : 0, 1473
BytebuddyAgent [baseline] (705.513 ms) : 0, 705513
BytebuddyAgent [candidate] (710.101 ms) : 0, 710101
GlobalTracer [baseline] (246.243 ms) : 0, 246243
GlobalTracer [candidate] (247.09 ms) : 0, 247090
AppSec [baseline] (32.285 ms) : 0, 32285
AppSec [candidate] (32.504 ms) : 0, 32504
Debugger [baseline] (6.409 ms) : 0, 6409
Debugger [candidate] (69.427 ms) : 0, 69427
Remote Config [baseline] (711.883 µs) : 0, 712
Remote Config [candidate] (649.957 µs) : 0, 650
Telemetry [baseline] (15.226 ms) : 0, 15226
Telemetry [candidate] (8.78 ms) : 0, 8780
Flare Poller [baseline] (5.803 ms) : 0, 5803
Flare Poller [candidate] (3.747 ms) : 0, 3747
section appsec
crashtracking [baseline] (1.457 ms) : 0, 1457
crashtracking [candidate] (1.47 ms) : 0, 1470
BytebuddyAgent [baseline] (731.829 ms) : 0, 731829
BytebuddyAgent [candidate] (733.445 ms) : 0, 733445
GlobalTracer [baseline] (239.385 ms) : 0, 239385
GlobalTracer [candidate] (238.067 ms) : 0, 238067
AppSec [baseline] (175.157 ms) : 0, 175157
AppSec [candidate] (174.946 ms) : 0, 174946
Debugger [baseline] (6.069 ms) : 0, 6069
Debugger [candidate] (60.1 ms) : 0, 60100
Remote Config [baseline] (641.821 µs) : 0, 642
Remote Config [candidate] (1.592 ms) : 0, 1592
Telemetry [baseline] (8.68 ms) : 0, 8680
Telemetry [candidate] (8.787 ms) : 0, 8787
Flare Poller [baseline] (3.993 ms) : 0, 3993
Flare Poller [candidate] (3.7 ms) : 0, 3700
IAST [baseline] (25.186 ms) : 0, 25186
IAST [candidate] (24.794 ms) : 0, 24794
section iast
crashtracking [baseline] (1.458 ms) : 0, 1458
crashtracking [candidate] (1.456 ms) : 0, 1456
BytebuddyAgent [baseline] (826.381 ms) : 0, 826381
BytebuddyAgent [candidate] (828.269 ms) : 0, 828269
GlobalTracer [baseline] (234.717 ms) : 0, 234717
GlobalTracer [candidate] (235.329 ms) : 0, 235329
AppSec [baseline] (31.379 ms) : 0, 31379
AppSec [candidate] (34.493 ms) : 0, 34493
Debugger [baseline] (6.026 ms) : 0, 6026
Debugger [candidate] (66.726 ms) : 0, 66726
Remote Config [baseline] (607.465 µs) : 0, 607
Remote Config [candidate] (565.776 µs) : 0, 566
Telemetry [baseline] (8.449 ms) : 0, 8449
Telemetry [candidate] (8.212 ms) : 0, 8212
Flare Poller [baseline] (4.134 ms) : 0, 4134
Flare Poller [candidate] (3.622 ms) : 0, 3622
IAST [baseline] (29.758 ms) : 0, 29758
IAST [candidate] (27.589 ms) : 0, 27589
section profiling
ProfilingAgent [baseline] (110.697 ms) : 0, 110697
ProfilingAgent [candidate] (96.3 ms) : 0, 96300
crashtracking [baseline] (1.506 ms) : 0, 1506
crashtracking [candidate] (1.456 ms) : 0, 1456
BytebuddyAgent [baseline] (731.414 ms) : 0, 731414
BytebuddyAgent [candidate] (730.385 ms) : 0, 730385
GlobalTracer [baseline] (222.892 ms) : 0, 222892
GlobalTracer [candidate] (222.011 ms) : 0, 222011
AppSec [baseline] (32.25 ms) : 0, 32250
AppSec [candidate] (32.211 ms) : 0, 32211
Debugger [baseline] (6.715 ms) : 0, 6715
Debugger [candidate] (68.028 ms) : 0, 68028
Remote Config [baseline] (709.807 µs) : 0, 710
Remote Config [candidate] (649.68 µs) : 0, 650
Telemetry [baseline] (16.491 ms) : 0, 16491
Telemetry [candidate] (7.934 ms) : 0, 7934
Flare Poller [baseline] (4.116 ms) : 0, 4116
Flare Poller [candidate] (3.831 ms) : 0, 3831
Profiling [baseline] (111.359 ms) : 0, 111359
Profiling [candidate] (96.882 ms) : 0, 96882
Loading
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.56.0-SNAPSHOT~71e7de7cc4, baseline=1.56.0-SNAPSHOT~8db72c0988

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.049 s) : 0, 1049238
Total [baseline] (8.654 s) : 0, 8653753
Agent [candidate] (1.106 s) : 0, 1105504
Total [candidate] (8.808 s) : 0, 8807872
section iast
Agent [baseline] (1.188 s) : 0, 1187516
Total [baseline] (9.315 s) : 0, 9315230
Agent [candidate] (1.243 s) : 0, 1242611
Total [candidate] (9.531 s) : 0, 9531486
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.049 s -
Agent iast 1.188 s 138.278 ms (13.2%)
Total tracing 8.654 s -
Total iast 9.315 s 661.477 ms (7.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.106 s -
Agent iast 1.243 s 137.107 ms (12.4%)
Total tracing 8.808 s -
Total iast 9.531 s 723.613 ms (8.2%)
gantt
    title insecure-bank - break down per module: candidate=1.56.0-SNAPSHOT~71e7de7cc4, baseline=1.56.0-SNAPSHOT~8db72c0988

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.478 ms) : 0, 1478
crashtracking [candidate] (1.483 ms) : 0, 1483
BytebuddyAgent [baseline] (705.546 ms) : 0, 705546
BytebuddyAgent [candidate] (710.143 ms) : 0, 710143
GlobalTracer [baseline] (246.739 ms) : 0, 246739
GlobalTracer [candidate] (245.437 ms) : 0, 245437
AppSec [baseline] (32.677 ms) : 0, 32677
AppSec [candidate] (32.366 ms) : 0, 32366
Debugger [baseline] (6.479 ms) : 0, 6479
Debugger [candidate] (68.186 ms) : 0, 68186
Remote Config [baseline] (716.437 µs) : 0, 716
Remote Config [candidate] (645.31 µs) : 0, 645
Telemetry [baseline] (15.162 ms) : 0, 15162
Telemetry [candidate] (8.65 ms) : 0, 8650
Flare Poller [baseline] (5.677 ms) : 0, 5677
Flare Poller [candidate] (3.758 ms) : 0, 3758
section iast
crashtracking [baseline] (1.494 ms) : 0, 1494
crashtracking [candidate] (1.467 ms) : 0, 1467
BytebuddyAgent [baseline] (835.761 ms) : 0, 835761
BytebuddyAgent [candidate] (829.787 ms) : 0, 829787
GlobalTracer [baseline] (235.606 ms) : 0, 235606
GlobalTracer [candidate] (236.058 ms) : 0, 236058
AppSec [baseline] (26.048 ms) : 0, 26048
AppSec [candidate] (34.021 ms) : 0, 34021
Debugger [baseline] (6.053 ms) : 0, 6053
Debugger [candidate] (65.291 ms) : 0, 65291
Remote Config [baseline] (608.42 µs) : 0, 608
Remote Config [candidate] (559.967 µs) : 0, 560
Telemetry [baseline] (8.343 ms) : 0, 8343
Telemetry [candidate] (8.274 ms) : 0, 8274
Flare Poller [baseline] (4.069 ms) : 0, 4069
Flare Poller [candidate] (3.696 ms) : 0, 3696
IAST [baseline] (34.748 ms) : 0, 34748
IAST [candidate] (28.656 ms) : 0, 28656
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/code-origin-default-on
git_commit_date 1762297540 1762328667
git_commit_sha 8db72c0 71e7de7
release_version 1.56.0-SNAPSHOT~8db72c0988 1.56.0-SNAPSHOT~71e7de7cc4
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1762331143 1762331143
ci_job_id 1216405415 1216405415
ci_pipeline_id 81286538 81286538
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-tvg3r2wm 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-tvg3r2wm 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 3 performance regressions! Performance is the same for 8 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:insecure-bank:profiling:high_load better
[-108.920µs; -73.112µs] or [-5.416%; -3.635%]
unstable
[-143.969op/s; +350.219op/s] or [-6.414%; +15.602%]
1.920ms 2347.781op/s 2.011ms 2244.656op/s
scenario:load:insecure-bank:iast_GLOBAL:high_load worse
[+139.204µs; +255.976µs] or [+3.977%; +7.313%]
unstable
[-194.326op/s; +57.451op/s] or [-14.840%; +4.387%]
3.698ms 1241.062op/s 3.500ms 1309.500op/s
scenario:load:petclinic:iast:high_load worse
[+643.097µs; +1038.045µs] or [+3.601%; +5.812%]
unstable
[-40.228op/s; +16.978op/s] or [-15.400%; +6.500%]
18.700ms 249.594op/s 17.860ms 261.219op/s
scenario:load:petclinic:no_agent:high_load worse
[+1.804ms; +2.204ms] or [+10.497%; +12.825%]
unstable
[-57.886op/s; +1.448op/s] or [-21.326%; +0.534%]
19.190ms 243.219op/s 17.186ms 271.438op/s
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~71e7de7cc4, baseline=1.56.0-SNAPSHOT~8db72c0988
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.186 ms) : 17013, 17359
.   : milestone, 17186,
appsec (18.968 ms) : 18773, 19163
.   : milestone, 18968,
code_origins (17.938 ms) : 17758, 18117
.   : milestone, 17938,
iast (17.86 ms) : 17682, 18037
.   : milestone, 17860,
profiling (18.63 ms) : 18441, 18819
.   : milestone, 18630,
tracing (17.73 ms) : 17554, 17907
.   : milestone, 17730,
section candidate
no_agent (19.19 ms) : 18992, 19388
.   : milestone, 19190,
appsec (18.53 ms) : 18340, 18720
.   : milestone, 18530,
code_origins (17.738 ms) : 17561, 17916
.   : milestone, 17738,
iast (18.7 ms) : 18511, 18889
.   : milestone, 18700,
profiling (18.642 ms) : 18458, 18825
.   : milestone, 18642,
tracing (17.641 ms) : 17469, 17814
.   : milestone, 17641,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.186 ms [17.013 ms, 17.359 ms] -
appsec 18.968 ms [18.773 ms, 19.163 ms] 1.782 ms (10.4%)
code_origins 17.938 ms [17.758 ms, 18.117 ms] 751.585 µs (4.4%)
iast 17.86 ms [17.682 ms, 18.037 ms] 673.473 µs (3.9%)
profiling 18.63 ms [18.441 ms, 18.819 ms] 1.444 ms (8.4%)
tracing 17.73 ms [17.554 ms, 17.907 ms] 544.262 µs (3.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.19 ms [18.992 ms, 19.388 ms] -
appsec 18.53 ms [18.34 ms, 18.72 ms] -659.85 µs (-3.4%)
code_origins 17.738 ms [17.561 ms, 17.916 ms] -1.452 ms (-7.6%)
iast 18.7 ms [18.511 ms, 18.889 ms] -489.983 µs (-2.6%)
profiling 18.642 ms [18.458 ms, 18.825 ms] -548.597 µs (-2.9%)
tracing 17.641 ms [17.469 ms, 17.814 ms] -1.549 ms (-8.1%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~71e7de7cc4, baseline=1.56.0-SNAPSHOT~8db72c0988
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.201 ms) : 1189, 1212
.   : milestone, 1201,
iast (3.215 ms) : 3168, 3262
.   : milestone, 3215,
iast_FULL (5.997 ms) : 5935, 6059
.   : milestone, 5997,
iast_GLOBAL (3.5 ms) : 3447, 3554
.   : milestone, 3500,
profiling (2.011 ms) : 1994, 2028
.   : milestone, 2011,
tracing (1.839 ms) : 1823, 1855
.   : milestone, 1839,
section candidate
no_agent (1.202 ms) : 1190, 1214
.   : milestone, 1202,
iast (3.264 ms) : 3227, 3302
.   : milestone, 3264,
iast_FULL (5.905 ms) : 5846, 5964
.   : milestone, 5905,
iast_GLOBAL (3.698 ms) : 3643, 3753
.   : milestone, 3698,
profiling (1.92 ms) : 1904, 1937
.   : milestone, 1920,
tracing (1.834 ms) : 1818, 1850
.   : milestone, 1834,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.201 ms [1.189 ms, 1.212 ms] -
iast 3.215 ms [3.168 ms, 3.262 ms] 2.014 ms (167.8%)
iast_FULL 5.997 ms [5.935 ms, 6.059 ms] 4.796 ms (399.5%)
iast_GLOBAL 3.5 ms [3.447 ms, 3.554 ms] 2.3 ms (191.6%)
profiling 2.011 ms [1.994 ms, 2.028 ms] 810.488 µs (67.5%)
tracing 1.839 ms [1.823 ms, 1.855 ms] 638.339 µs (53.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.202 ms [1.19 ms, 1.214 ms] -
iast 3.264 ms [3.227 ms, 3.302 ms] 2.062 ms (171.5%)
iast_FULL 5.905 ms [5.846 ms, 5.964 ms] 4.703 ms (391.1%)
iast_GLOBAL 3.698 ms [3.643 ms, 3.753 ms] 2.496 ms (207.6%)
profiling 1.92 ms [1.904 ms, 1.937 ms] 717.731 µs (59.7%)
tracing 1.834 ms [1.818 ms, 1.85 ms] 631.369 µs (52.5%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/code-origin-default-on
git_commit_date 1762297540 1762328667
git_commit_sha 8db72c0 71e7de7
release_version 1.56.0-SNAPSHOT~8db72c0988 1.56.0-SNAPSHOT~71e7de7cc4
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1762330909 1762330909
ci_job_id 1216405416 1216405416
ci_pipeline_id 81286538 81286538
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-qucq49yr 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-qucq49yr 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~71e7de7cc4, baseline=1.56.0-SNAPSHOT~8db72c0988
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.48 ms) : 1468, 1492
.   : milestone, 1480,
appsec (3.638 ms) : 3424, 3851
.   : milestone, 3638,
iast (2.211 ms) : 2148, 2275
.   : milestone, 2211,
iast_GLOBAL (2.245 ms) : 2182, 2309
.   : milestone, 2245,
profiling (2.056 ms) : 2005, 2107
.   : milestone, 2056,
tracing (2.032 ms) : 1983, 2082
.   : milestone, 2032,
section candidate
no_agent (1.474 ms) : 1463, 1486
.   : milestone, 1474,
appsec (3.697 ms) : 3479, 3915
.   : milestone, 3697,
iast (2.201 ms) : 2138, 2265
.   : milestone, 2201,
iast_GLOBAL (2.261 ms) : 2197, 2325
.   : milestone, 2261,
profiling (2.052 ms) : 2001, 2103
.   : milestone, 2052,
tracing (2.027 ms) : 1978, 2077
.   : milestone, 2027,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.48 ms [1.468 ms, 1.492 ms] -
appsec 3.638 ms [3.424 ms, 3.851 ms] 2.158 ms (145.8%)
iast 2.211 ms [2.148 ms, 2.275 ms] 731.363 µs (49.4%)
iast_GLOBAL 2.245 ms [2.182 ms, 2.309 ms] 765.323 µs (51.7%)
profiling 2.056 ms [2.005 ms, 2.107 ms] 575.701 µs (38.9%)
tracing 2.032 ms [1.983 ms, 2.082 ms] 552.278 µs (37.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.474 ms [1.463 ms, 1.486 ms] -
appsec 3.697 ms [3.479 ms, 3.915 ms] 2.223 ms (150.8%)
iast 2.201 ms [2.138 ms, 2.265 ms] 727.246 µs (49.3%)
iast_GLOBAL 2.261 ms [2.197 ms, 2.325 ms] 786.882 µs (53.4%)
profiling 2.052 ms [2.001 ms, 2.103 ms] 577.636 µs (39.2%)
tracing 2.027 ms [1.978 ms, 2.077 ms] 553.048 µs (37.5%)
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~71e7de7cc4, baseline=1.56.0-SNAPSHOT~8db72c0988
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.112 s) : 15112000, 15112000
.   : milestone, 15112000,
appsec (14.747 s) : 14747000, 14747000
.   : milestone, 14747000,
iast (18.781 s) : 18781000, 18781000
.   : milestone, 18781000,
iast_GLOBAL (18.187 s) : 18187000, 18187000
.   : milestone, 18187000,
profiling (14.518 s) : 14518000, 14518000
.   : milestone, 14518000,
tracing (14.774 s) : 14774000, 14774000
.   : milestone, 14774000,
section candidate
no_agent (14.806 s) : 14806000, 14806000
.   : milestone, 14806000,
appsec (14.85 s) : 14850000, 14850000
.   : milestone, 14850000,
iast (18.748 s) : 18748000, 18748000
.   : milestone, 18748000,
iast_GLOBAL (17.692 s) : 17692000, 17692000
.   : milestone, 17692000,
profiling (14.926 s) : 14926000, 14926000
.   : milestone, 14926000,
tracing (14.814 s) : 14814000, 14814000
.   : milestone, 14814000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.112 s [15.112 s, 15.112 s] -
appsec 14.747 s [14.747 s, 14.747 s] -365.0 ms (-2.4%)
iast 18.781 s [18.781 s, 18.781 s] 3.669 s (24.3%)
iast_GLOBAL 18.187 s [18.187 s, 18.187 s] 3.075 s (20.3%)
profiling 14.518 s [14.518 s, 14.518 s] -594.0 ms (-3.9%)
tracing 14.774 s [14.774 s, 14.774 s] -338.0 ms (-2.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.806 s [14.806 s, 14.806 s] -
appsec 14.85 s [14.85 s, 14.85 s] 44.0 ms (0.3%)
iast 18.748 s [18.748 s, 18.748 s] 3.942 s (26.6%)
iast_GLOBAL 17.692 s [17.692 s, 17.692 s] 2.886 s (19.5%)
profiling 14.926 s [14.926 s, 14.926 s] 120.0 ms (0.8%)
tracing 14.814 s [14.814 s, 14.814 s] 8.0 ms (0.1%)

@jpbempel jpbempel force-pushed the jpbempel/code-origin-default-on branch from d56be96 to 3ff89a2 Compare October 29, 2025 08:41
@jpbempel jpbempel requested a review from a team as a code owner October 29, 2025 12:26
@jpbempel jpbempel force-pushed the jpbempel/code-origin-default-on branch from 8dddbde to 778754a Compare October 29, 2025 15:27
@pr-commenter
Copy link

pr-commenter bot commented Oct 29, 2025

Kafka / producer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/code-origin-default-on
git_commit_date 1762297540 1762328667
git_commit_sha 8db72c0 71e7de7
See matching parameters
Baseline Candidate
ci_job_date 1762329989 1762329989
ci_job_id 1216405419 1216405419
ci_pipeline_id 81286538 81286538
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaProduceBenchmark.benchProduce same

@pr-commenter
Copy link

pr-commenter bot commented Oct 29, 2025

Kafka / consumer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/code-origin-default-on
git_commit_date 1762297540 1762328667
git_commit_sha 8db72c0 71e7de7
See matching parameters
Baseline Candidate
ci_job_date 1762330038 1762330038
ci_job_id 1216405420 1216405420
ci_pipeline_id 81286538 81286538
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaConsumerBenchmark.benchConsume unsure
[-15078.898op/s; -162.910op/s] or [-4.795%; -0.052%]
scenario:only-tracing-dsm-enabled-benchmarks/KafkaConsumerBenchmark.benchConsume same

@jpbempel jpbempel force-pushed the jpbempel/code-origin-default-on branch from 778754a to 24b88d7 Compare October 30, 2025 09:53
@jpbempel jpbempel force-pushed the jpbempel/code-origin-default-on branch 5 times, most recently from 629ca87 to ad98e42 Compare November 3, 2025 15:00
by default Code Origin will be started
@jpbempel jpbempel force-pushed the jpbempel/code-origin-default-on branch from ad98e42 to 71e7de7 Compare November 5, 2025 07:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp: debugger Dynamic Instrumentation type: enhancement Enhancements and improvements

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants