Set up crash-tracking JVM flags automatically (for Hotspot) #8738

jbachorik · 2025-04-25T18:36:13Z

What Does This Do

Use the vmstructs based access to JVM flags which is available via ddprof-java library. Using this approach we can even set some flags - the effectiveness depends on whether JVM caches the flag value or not. For the 'OnError' and 'OnOutOfMemoryError' JVM flags the value is not cached and that means we can actually set it up early in the startup.

Motivation

Make the crash-tracking as easy to onboard as possible.

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the public documentation in case of new configuration flag or behavior

Jira ticket: PROF-10707

pr-commenter · 2025-04-25T19:23:13Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	jb/crash_tracking_magic
git_commit_date	1745582823	1745606365
git_commit_sha	`75634fe`	`a1931a3`
release_version	1.49.0-SNAPSHOT~75634fe423	1.49.0-SNAPSHOT~a1931a32e9

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1745609589	1745609589
ci_job_id	913522539	913522539
ci_pipeline_id	63385432	63385432
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-u-qwygag-project-304-concurrent-0-z5n1wc23 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-u-qwygag-project-304-concurrent-0-z5n1wc23 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None
variant	iast	iast

Summary

Found 10 performance improvements and 17 performance regressions! Performance is the same for 35 metrics, 9 unstable metrics.

scenario	Δ mean execution_time	candidate mean execution_time	baseline mean execution_time
scenario:startup:insecure-bank:iast:Agent.start	worse [+213.116ms; +222.246ms] or [+18.774%; +19.579%]	1.353s	1.135s
scenario:startup:insecure-bank:iast:BytebuddyAgent	worse [+61.352ms; +67.512ms] or [+7.783%; +8.564%]	852.720ms	788.288ms
scenario:startup:insecure-bank:iast:GlobalTracer	better [-38.408ms; -33.927ms] or [-16.732%; -14.780%]	193.384ms	229.552ms
scenario:startup:insecure-bank:iast_HARDCODED_SECRET_DISABLED:Agent.start	worse [+219.479ms; +228.173ms] or [+19.345%; +20.112%]	1.358s	1.135s
scenario:startup:insecure-bank:iast_HARDCODED_SECRET_DISABLED:BytebuddyAgent	worse [+60.427ms; +66.528ms] or [+7.667%; +8.441%]	851.604ms	788.126ms
scenario:startup:insecure-bank:iast_HARDCODED_SECRET_DISABLED:GlobalTracer	better [-38.375ms; -33.848ms] or [-16.718%; -14.746%]	193.424ms	229.536ms
scenario:startup:insecure-bank:iast_TELEMETRY_OFF:Agent.start	worse [+219.169ms; +226.495ms] or [+19.329%; +19.975%]	1.357s	1.134s
scenario:startup:insecure-bank:iast_TELEMETRY_OFF:BytebuddyAgent	worse [+62.827ms; +67.496ms] or [+7.979%; +8.572%]	852.592ms	787.430ms
scenario:startup:insecure-bank:iast_TELEMETRY_OFF:GlobalTracer	better [-38.864ms; -37.442ms] or [-16.854%; -16.238%]	192.434ms	230.587ms
scenario:startup:insecure-bank:tracing:Agent.start	worse [+208.205ms; +238.829ms] or [+20.641%; +23.677%]	1.232s	1.009s
scenario:startup:insecure-bank:tracing:BytebuddyAgent	worse [+63.130ms; +84.098ms] or [+9.409%; +12.534%]	744.598ms	670.983ms
scenario:startup:insecure-bank:tracing:GlobalTracer	better [-45.076ms; -39.496ms] or [-18.748%; -16.427%]	198.144ms	240.430ms
scenario:startup:petclinic:appsec:Agent.start	worse [+220.108ms; +239.678ms] or [+19.160%; +20.864%]	1.379s	1.149s
scenario:startup:petclinic:appsec:BytebuddyAgent	worse [+64.898ms; +76.698ms] or [+9.431%; +11.145%]	758.957ms	688.159ms
scenario:startup:petclinic:appsec:GlobalTracer	better [-41.559ms; -38.037ms] or [-17.577%; -16.088%]	196.636ms	236.434ms
scenario:startup:petclinic:appsec:AppSec	better [-6.904ms; -4.784ms] or [-3.920%; -2.716%]	170.296ms	176.139ms
scenario:startup:petclinic:iast:Agent.start	worse [+206.053ms; +239.095ms] or [+17.981%; +20.864%]	1.369s	1.146s
scenario:startup:petclinic:iast:BytebuddyAgent	worse [+43.654ms; +69.688ms] or [+5.478%; +8.746%]	853.509ms	796.838ms
scenario:startup:petclinic:iast:GlobalTracer	better [-40.709ms; -34.053ms] or [-17.584%; -14.709%]	194.128ms	231.509ms
scenario:startup:petclinic:iast:AppSec	better [-8.782ms; -3.990ms] or [-15.525%; -7.054%]	50.182ms	56.569ms
scenario:startup:petclinic:profiling:Agent.start	worse [+120.992ms; +155.816ms] or [+9.667%; +12.450%]	1.390s	1.252s
scenario:startup:petclinic:profiling:BytebuddyAgent	worse [+87.862ms; +108.130ms] or [+13.304%; +16.373%]	758.399ms	660.403ms
scenario:startup:petclinic:profiling:GlobalTracer	better [-151.055ms; -144.981ms] or [-40.376%; -38.753%]	226.100ms	374.118ms
scenario:startup:petclinic:profiling:Remote Config	worse [+13.405µs; +52.522µs] or [+2.096%; +8.213%]	672.423µs	639.460µs
scenario:startup:petclinic:tracing:Agent.start	worse [+223.824ms; +232.212ms] or [+22.193%; +23.024%]	1.237s	1.009s
scenario:startup:petclinic:tracing:BytebuddyAgent	worse [+65.422ms; +70.295ms] or [+9.752%; +10.479%]	738.688ms	670.830ms
scenario:startup:petclinic:tracing:GlobalTracer	better [-44.037ms; -42.299ms] or [-18.364%; -17.640%]	196.629ms	239.797ms

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.49.0-SNAPSHOT~a1931a32e9, baseline=1.49.0-SNAPSHOT~75634fe423

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.009 s) : 0, 1008550
Total [baseline] (10.446 s) : 0, 10445919
Agent [candidate] (1.237 s) : 0, 1236568
Total [candidate] (10.654 s) : 0, 10654313
section appsec
Agent [baseline] (1.149 s) : 0, 1148772
Total [baseline] (10.724 s) : 0, 10723857
Agent [candidate] (1.379 s) : 0, 1378665
Total [candidate] (10.875 s) : 0, 10875143
section iast
Agent [baseline] (1.146 s) : 0, 1145981
Total [baseline] (10.849 s) : 0, 10848881
Agent [candidate] (1.369 s) : 0, 1368555
Total [candidate] (11.08 s) : 0, 11079507
section profiling
Agent [baseline] (1.252 s) : 0, 1251581
Total [baseline] (10.772 s) : 0, 10771698
Agent [candidate] (1.39 s) : 0, 1389985
Total [candidate] (11.086 s) : 0, 11085668

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.009 s	-
Agent	appsec	1.149 s	140.222 ms (13.9%)
Agent	iast	1.146 s	137.431 ms (13.6%)
Agent	profiling	1.252 s	243.031 ms (24.1%)
Total	tracing	10.446 s	-
Total	appsec	10.724 s	277.938 ms (2.7%)
Total	iast	10.849 s	402.962 ms (3.9%)
Total	profiling	10.772 s	325.779 ms (3.1%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.237 s	-
Agent	appsec	1.379 s	142.097 ms (11.5%)
Agent	iast	1.369 s	131.987 ms (10.7%)
Agent	profiling	1.39 s	153.416 ms (12.4%)
Total	tracing	10.654 s	-
Total	appsec	10.875 s	220.83 ms (2.1%)
Total	iast	11.08 s	425.194 ms (4.0%)
Total	profiling	11.086 s	431.355 ms (4.0%)

gantt
    title petclinic - break down per module: candidate=1.49.0-SNAPSHOT~a1931a32e9, baseline=1.49.0-SNAPSHOT~75634fe423

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (670.83 ms) : 0, 670830
BytebuddyAgent [candidate] (738.688 ms) : 0, 738688
GlobalTracer [baseline] (239.797 ms) : 0, 239797
GlobalTracer [candidate] (196.629 ms) : 0, 196629
AppSec [baseline] (54.694 ms) : 0, 54694
AppSec [candidate] (55.086 ms) : 0, 55086
Debugger [baseline] (6.111 ms) : 0, 6111
Debugger [candidate] (6.201 ms) : 0, 6201
Remote Config [baseline] (705.341 µs) : 0, 705
Remote Config [candidate] (677.155 µs) : 0, 677
Telemetry [baseline] (12.964 ms) : 0, 12964
Telemetry [candidate] (15.655 ms) : 0, 15655
section appsec
BytebuddyAgent [baseline] (688.159 ms) : 0, 688159
BytebuddyAgent [candidate] (758.957 ms) : 0, 758957
GlobalTracer [baseline] (236.434 ms) : 0, 236434
GlobalTracer [candidate] (196.636 ms) : 0, 196636
AppSec [baseline] (176.139 ms) : 0, 176139
AppSec [candidate] (170.296 ms) : 0, 170296
Debugger [baseline] (5.85 ms) : 0, 5850
Debugger [candidate] (5.975 ms) : 0, 5975
Remote Config [baseline] (639.127 µs) : 0, 639
Remote Config [candidate] (635.434 µs) : 0, 635
Telemetry [baseline] (7.366 ms) : 0, 7366
Telemetry [candidate] (7.444 ms) : 0, 7444
IAST [baseline] (21.746 ms) : 0, 21746
IAST [candidate] (21.305 ms) : 0, 21305
section iast
BytebuddyAgent [baseline] (796.838 ms) : 0, 796838
BytebuddyAgent [candidate] (853.509 ms) : 0, 853509
GlobalTracer [baseline] (231.509 ms) : 0, 231509
GlobalTracer [candidate] (194.128 ms) : 0, 194128
AppSec [baseline] (56.569 ms) : 0, 56569
AppSec [candidate] (50.182 ms) : 0, 50182
Debugger [baseline] (5.938 ms) : 0, 5938
Debugger [candidate] (5.887 ms) : 0, 5887
Remote Config [baseline] (587.771 µs) : 0, 588
Remote Config [candidate] (583.377 µs) : 0, 583
Telemetry [baseline] (7.942 ms) : 0, 7942
Telemetry [candidate] (7.781 ms) : 0, 7781
IAST [baseline] (23.12 ms) : 0, 23120
IAST [candidate] (26.553 ms) : 0, 26553
section profiling
ProfilingAgent [baseline] (97.857 ms) : 0, 97857
ProfilingAgent [candidate] (98.683 ms) : 0, 98683
BytebuddyAgent [baseline] (660.403 ms) : 0, 660403
BytebuddyAgent [candidate] (758.399 ms) : 0, 758399
GlobalTracer [baseline] (374.118 ms) : 0, 374118
GlobalTracer [candidate] (226.1 ms) : 0, 226100
AppSec [baseline] (54.287 ms) : 0, 54287
AppSec [candidate] (61.61 ms) : 0, 61610
Debugger [baseline] (6.098 ms) : 0, 6098
Debugger [candidate] (6.237 ms) : 0, 6237
Remote Config [baseline] (639.46 µs) : 0, 639
Remote Config [candidate] (672.423 µs) : 0, 672
Telemetry [baseline] (8.173 ms) : 0, 8173
Telemetry [candidate] (8.384 ms) : 0, 8384
Profiling [baseline] (97.881 ms) : 0, 97881
Profiling [candidate] (98.708 ms) : 0, 98708

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.49.0-SNAPSHOT~a1931a32e9, baseline=1.49.0-SNAPSHOT~75634fe423

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.009 s) : 0, 1008712
Total [baseline] (8.644 s) : 0, 8643839
Agent [candidate] (1.232 s) : 0, 1232229
Total [candidate] (8.834 s) : 0, 8834450
section iast
Agent [baseline] (1.135 s) : 0, 1135140
Total [baseline] (9.239 s) : 0, 9238565
Agent [candidate] (1.353 s) : 0, 1352821
Total [candidate] (9.391 s) : 0, 9391034
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.135 s) : 0, 1134526
Total [baseline] (9.165 s) : 0, 9164555
Agent [candidate] (1.358 s) : 0, 1358352
Total [candidate] (9.337 s) : 0, 9337172
section iast_TELEMETRY_OFF
Agent [baseline] (1.134 s) : 0, 1133897
Total [baseline] (9.175 s) : 0, 9175067
Agent [candidate] (1.357 s) : 0, 1356729
Total [candidate] (9.425 s) : 0, 9424948

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.009 s	-
Agent	iast	1.135 s	126.427 ms (12.5%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.135 s	125.814 ms (12.5%)
Agent	iast_TELEMETRY_OFF	1.134 s	125.184 ms (12.4%)
Total	tracing	8.644 s	-
Total	iast	9.239 s	594.727 ms (6.9%)
Total	iast_HARDCODED_SECRET_DISABLED	9.165 s	520.716 ms (6.0%)
Total	iast_TELEMETRY_OFF	9.175 s	531.228 ms (6.1%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.232 s	-
Agent	iast	1.353 s	120.592 ms (9.8%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.358 s	126.123 ms (10.2%)
Agent	iast_TELEMETRY_OFF	1.357 s	124.5 ms (10.1%)
Total	tracing	8.834 s	-
Total	iast	9.391 s	556.584 ms (6.3%)
Total	iast_HARDCODED_SECRET_DISABLED	9.337 s	502.722 ms (5.7%)
Total	iast_TELEMETRY_OFF	9.425 s	590.498 ms (6.7%)

gantt
    title insecure-bank - break down per module: candidate=1.49.0-SNAPSHOT~a1931a32e9, baseline=1.49.0-SNAPSHOT~75634fe423

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (670.983 ms) : 0, 670983
BytebuddyAgent [candidate] (744.598 ms) : 0, 744598
GlobalTracer [baseline] (240.43 ms) : 0, 240430
GlobalTracer [candidate] (198.144 ms) : 0, 198144
AppSec [baseline] (54.79 ms) : 0, 54790
AppSec [candidate] (55.324 ms) : 0, 55324
Debugger [baseline] (6.162 ms) : 0, 6162
Debugger [candidate] (6.208 ms) : 0, 6208
Remote Config [baseline] (720.204 µs) : 0, 720
Remote Config [candidate] (681.548 µs) : 0, 682
Telemetry [baseline] (12.278 ms) : 0, 12278
Telemetry [candidate] (15.467 ms) : 0, 15467
section iast
BytebuddyAgent [baseline] (788.288 ms) : 0, 788288
BytebuddyAgent [candidate] (852.72 ms) : 0, 852720
GlobalTracer [baseline] (229.552 ms) : 0, 229552
GlobalTracer [candidate] (193.384 ms) : 0, 193384
IAST [baseline] (22.742 ms) : 0, 22742
IAST [candidate] (24.245 ms) : 0, 24245
AppSec [baseline] (56.756 ms) : 0, 56756
AppSec [candidate] (53.824 ms) : 0, 53824
Debugger [baseline] (5.964 ms) : 0, 5964
Debugger [candidate] (5.927 ms) : 0, 5927
Remote Config [baseline] (588.64 µs) : 0, 589
Remote Config [candidate] (600.927 µs) : 0, 601
Telemetry [baseline] (7.931 ms) : 0, 7931
Telemetry [candidate] (7.713 ms) : 0, 7713
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (788.126 ms) : 0, 788126
BytebuddyAgent [candidate] (851.604 ms) : 0, 851604
GlobalTracer [baseline] (229.536 ms) : 0, 229536
GlobalTracer [candidate] (193.424 ms) : 0, 193424
IAST [baseline] (22.754 ms) : 0, 22754
IAST [candidate] (25.075 ms) : 0, 25075
AppSec [baseline] (56.373 ms) : 0, 56373
AppSec [candidate] (52.737 ms) : 0, 52737
Debugger [baseline] (5.866 ms) : 0, 5866
Debugger [candidate] (5.946 ms) : 0, 5946
Remote Config [baseline] (602.718 µs) : 0, 603
Remote Config [candidate] (593.56 µs) : 0, 594
Telemetry [baseline] (7.876 ms) : 0, 7876
Telemetry [candidate] (7.808 ms) : 0, 7808
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (787.43 ms) : 0, 787430
BytebuddyAgent [candidate] (852.592 ms) : 0, 852592
GlobalTracer [baseline] (230.587 ms) : 0, 230587
GlobalTracer [candidate] (192.434 ms) : 0, 192434
IAST [baseline] (22.255 ms) : 0, 22255
IAST [candidate] (23.877 ms) : 0, 23877
AppSec [baseline] (56.126 ms) : 0, 56126
AppSec [candidate] (53.577 ms) : 0, 53577
Debugger [baseline] (5.833 ms) : 0, 5833
Debugger [candidate] (5.967 ms) : 0, 5967
Remote Config [baseline] (593.19 µs) : 0, 593
Remote Config [candidate] (623.676 µs) : 0, 624
Telemetry [baseline] (7.677 ms) : 0, 7677
Telemetry [candidate] (7.907 ms) : 0, 7907

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
end_time	2025-04-25T19:03:16	2025-04-25T19:11:03
git_branch	master	jb/crash_tracking_magic
git_commit_date	1745582823	1745606365
git_commit_sha	`75634fe`	`a1931a3`
release_version	1.49.0-SNAPSHOT~75634fe423	1.49.0-SNAPSHOT~a1931a32e9
start_time	2025-04-25T19:03:02	2025-04-25T19:10:48

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1745608662	1745608662
ci_job_id	913522540	913522540
ci_pipeline_id	63385432	63385432
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zdcpjxrd-project-304-concurrent-0-yz5cwhrt 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zdcpjxrd-project-304-concurrent-0-yz5cwhrt 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant	iast	iast

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 18 unstable metrics.

scenario	Δ mean http_req_duration	Δ mean throughput	candidate mean http_req_duration	candidate mean throughput	baseline mean http_req_duration	baseline mean throughput
scenario:load:petclinic:profiling	better [-101.347µs; -49.981µs] or [-6.448%; -3.180%]	unstable [-446.569op/s; +674.489op/s] or [-15.072%; +22.764%]	1.496ms	3076.923op/s	1.572ms	2962.963op/s

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.49.0-SNAPSHOT~a1931a32e9, baseline=1.49.0-SNAPSHOT~75634fe423
    dateFormat X
    axisFormat %s
section baseline
no_agent (388.158 µs) : 368, 408
.   : milestone, 388,
iast (522.447 µs) : 499, 546
.   : milestone, 522,
iast_FULL (742.709 µs) : 720, 766
.   : milestone, 743,
iast_GLOBAL (566.374 µs) : 543, 589
.   : milestone, 566,
iast_HARDCODED_SECRET_DISABLED (532.64 µs) : 509, 556
.   : milestone, 533,
iast_INACTIVE (475.116 µs) : 452, 499
.   : milestone, 475,
iast_TELEMETRY_OFF (511.042 µs) : 489, 533
.   : milestone, 511,
tracing (466.122 µs) : 443, 489
.   : milestone, 466,
section candidate
no_agent (381.053 µs) : 361, 401
.   : milestone, 381,
iast (533.595 µs) : 510, 557
.   : milestone, 534,
iast_FULL (734.042 µs) : 711, 757
.   : milestone, 734,
iast_GLOBAL (573.9 µs) : 550, 597
.   : milestone, 574,
iast_HARDCODED_SECRET_DISABLED (521.962 µs) : 499, 545
.   : milestone, 522,
iast_INACTIVE (478.644 µs) : 456, 501
.   : milestone, 479,
iast_TELEMETRY_OFF (518.729 µs) : 496, 542
.   : milestone, 519,
tracing (467.769 µs) : 447, 489
.   : milestone, 468,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	388.158 µs [368.459 µs, 407.857 µs]	-
iast	522.447 µs [499.283 µs, 545.612 µs]	134.289 µs (34.6%)
iast_FULL	742.709 µs [719.597 µs, 765.82 µs]	354.551 µs (91.3%)
iast_GLOBAL	566.374 µs [543.461 µs, 589.288 µs]	178.216 µs (45.9%)
iast_HARDCODED_SECRET_DISABLED	532.64 µs [509.378 µs, 555.903 µs]	144.482 µs (37.2%)
iast_INACTIVE	475.116 µs [451.665 µs, 498.567 µs]	86.958 µs (22.4%)
iast_TELEMETRY_OFF	511.042 µs [488.627 µs, 533.456 µs]	122.884 µs (31.7%)
tracing	466.122 µs [443.173 µs, 489.072 µs]	77.964 µs (20.1%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	381.053 µs [361.014 µs, 401.091 µs]	-
iast	533.595 µs [510.044 µs, 557.147 µs]	152.543 µs (40.0%)
iast_FULL	734.042 µs [710.975 µs, 757.108 µs]	352.989 µs (92.6%)
iast_GLOBAL	573.9 µs [550.427 µs, 597.372 µs]	192.847 µs (50.6%)
iast_HARDCODED_SECRET_DISABLED	521.962 µs [498.982 µs, 544.941 µs]	140.909 µs (37.0%)
iast_INACTIVE	478.644 µs [456.055 µs, 501.233 µs]	97.591 µs (25.6%)
iast_TELEMETRY_OFF	518.729 µs [495.665 µs, 541.793 µs]	137.676 µs (36.1%)
tracing	467.769 µs [446.579 µs, 488.958 µs]	86.716 µs (22.8%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.49.0-SNAPSHOT~a1931a32e9, baseline=1.49.0-SNAPSHOT~75634fe423
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.358 ms) : 1338, 1377
.   : milestone, 1358,
appsec (1.725 ms) : 1702, 1749
.   : milestone, 1725,
appsec_no_iast (1.743 ms) : 1720, 1766
.   : milestone, 1743,
code_origins (1.688 ms) : 1662, 1714
.   : milestone, 1688,
iast (1.516 ms) : 1491, 1540
.   : milestone, 1516,
profiling (1.572 ms) : 1547, 1597
.   : milestone, 1572,
tracing (1.494 ms) : 1469, 1519
.   : milestone, 1494,
section candidate
no_agent (1.375 ms) : 1356, 1393
.   : milestone, 1375,
appsec (1.748 ms) : 1724, 1772
.   : milestone, 1748,
appsec_no_iast (1.739 ms) : 1716, 1763
.   : milestone, 1739,
code_origins (1.686 ms) : 1659, 1714
.   : milestone, 1686,
iast (1.519 ms) : 1495, 1543
.   : milestone, 1519,
profiling (1.496 ms) : 1473, 1519
.   : milestone, 1496,
tracing (1.488 ms) : 1465, 1512
.   : milestone, 1488,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.358 ms [1.338 ms, 1.377 ms]	-
appsec	1.725 ms [1.702 ms, 1.749 ms]	367.683 µs (27.1%)
appsec_no_iast	1.743 ms [1.72 ms, 1.766 ms]	385.563 µs (28.4%)
code_origins	1.688 ms [1.662 ms, 1.714 ms]	330.265 µs (24.3%)
iast	1.516 ms [1.491 ms, 1.54 ms]	158.206 µs (11.7%)
profiling	1.572 ms [1.547 ms, 1.597 ms]	214.009 µs (15.8%)
tracing	1.494 ms [1.469 ms, 1.519 ms]	136.044 µs (10.0%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.375 ms [1.356 ms, 1.393 ms]	-
appsec	1.748 ms [1.724 ms, 1.772 ms]	373.623 µs (27.2%)
appsec_no_iast	1.739 ms [1.716 ms, 1.763 ms]	364.916 µs (26.5%)
code_origins	1.686 ms [1.659 ms, 1.714 ms]	311.712 µs (22.7%)
iast	1.519 ms [1.495 ms, 1.543 ms]	144.179 µs (10.5%)
profiling	1.496 ms [1.473 ms, 1.519 ms]	121.538 µs (8.8%)
tracing	1.488 ms [1.465 ms, 1.512 ms]	113.683 µs (8.3%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	jb/crash_tracking_magic
git_commit_date	1745582823	1745606365
git_commit_sha	`75634fe`	`a1931a3`
release_version	1.49.0-SNAPSHOT~75634fe423	1.49.0-SNAPSHOT~a1931a32e9

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1745609150	1745609150
ci_job_id	913522541	913522541
ci_pipeline_id	63385432	63385432
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-u-qwygag-project-304-concurrent-1-7whjk72b 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-u-qwygag-project-304-concurrent-1-7whjk72b 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant	appsec	appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.49.0-SNAPSHOT~a1931a32e9, baseline=1.49.0-SNAPSHOT~75634fe423
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.53 s) : 15530000, 15530000
.   : milestone, 15530000,
appsec (14.936 s) : 14936000, 14936000
.   : milestone, 14936000,
iast (18.747 s) : 18747000, 18747000
.   : milestone, 18747000,
iast_GLOBAL (18.278 s) : 18278000, 18278000
.   : milestone, 18278000,
profiling (15.504 s) : 15504000, 15504000
.   : milestone, 15504000,
tracing (15.104 s) : 15104000, 15104000
.   : milestone, 15104000,
section candidate
no_agent (15.063 s) : 15063000, 15063000
.   : milestone, 15063000,
appsec (14.981 s) : 14981000, 14981000
.   : milestone, 14981000,
iast (19.119 s) : 19119000, 19119000
.   : milestone, 19119000,
iast_GLOBAL (18.046 s) : 18046000, 18046000
.   : milestone, 18046000,
profiling (15.027 s) : 15027000, 15027000
.   : milestone, 15027000,
tracing (14.716 s) : 14716000, 14716000
.   : milestone, 14716000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.53 s [15.53 s, 15.53 s]	-
appsec	14.936 s [14.936 s, 14.936 s]	-594.0 ms (-3.8%)
iast	18.747 s [18.747 s, 18.747 s]	3.217 s (20.7%)
iast_GLOBAL	18.278 s [18.278 s, 18.278 s]	2.748 s (17.7%)
profiling	15.504 s [15.504 s, 15.504 s]	-26.0 ms (-0.2%)
tracing	15.104 s [15.104 s, 15.104 s]	-426.0 ms (-2.7%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.063 s [15.063 s, 15.063 s]	-
appsec	14.981 s [14.981 s, 14.981 s]	-82.0 ms (-0.5%)
iast	19.119 s [19.119 s, 19.119 s]	4.056 s (26.9%)
iast_GLOBAL	18.046 s [18.046 s, 18.046 s]	2.983 s (19.8%)
profiling	15.027 s [15.027 s, 15.027 s]	-36.0 ms (-0.2%)
tracing	14.716 s [14.716 s, 14.716 s]	-347.0 ms (-2.3%)

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.49.0-SNAPSHOT~a1931a32e9, baseline=1.49.0-SNAPSHOT~75634fe423
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.471 ms) : 1460, 1483
.   : milestone, 1471,
appsec (2.374 ms) : 2327, 2420
.   : milestone, 2374,
iast (2.15 ms) : 2091, 2208
.   : milestone, 2150,
iast_GLOBAL (2.193 ms) : 2134, 2252
.   : milestone, 2193,
profiling (1.997 ms) : 1950, 2044
.   : milestone, 1997,
tracing (1.975 ms) : 1930, 2020
.   : milestone, 1975,
section candidate
no_agent (1.473 ms) : 1462, 1485
.   : milestone, 1473,
appsec (2.364 ms) : 2318, 2410
.   : milestone, 2364,
iast (2.157 ms) : 2098, 2216
.   : milestone, 2157,
iast_GLOBAL (2.196 ms) : 2137, 2255
.   : milestone, 2196,
profiling (1.992 ms) : 1946, 2039
.   : milestone, 1992,
tracing (1.975 ms) : 1930, 2020
.   : milestone, 1975,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.471 ms [1.46 ms, 1.483 ms]	-
appsec	2.374 ms [2.327 ms, 2.42 ms]	902.461 µs (61.3%)
iast	2.15 ms [2.091 ms, 2.208 ms]	678.626 µs (46.1%)
iast_GLOBAL	2.193 ms [2.134 ms, 2.252 ms]	721.964 µs (49.1%)
profiling	1.997 ms [1.95 ms, 2.044 ms]	525.622 µs (35.7%)
tracing	1.975 ms [1.93 ms, 2.02 ms]	503.678 µs (34.2%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.473 ms [1.462 ms, 1.485 ms]	-
appsec	2.364 ms [2.318 ms, 2.41 ms]	890.848 µs (60.5%)
iast	2.157 ms [2.098 ms, 2.216 ms]	684.077 µs (46.4%)
iast_GLOBAL	2.196 ms [2.137 ms, 2.255 ms]	722.656 µs (49.1%)
profiling	1.992 ms [1.946 ms, 2.039 ms]	519.255 µs (35.2%)
tracing	1.975 ms [1.93 ms, 2.02 ms]	502.063 µs (34.1%)

Set up crash-tracking JVM flags automatically (for Hotspot)

a1931a3

jbachorik force-pushed the jb/crash_tracking_magic branch from 9d19300 to a1931a3 Compare April 25, 2025 18:39

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Set up crash-tracking JVM flags automatically (for Hotspot) #8738

Set up crash-tracking JVM flags automatically (for Hotspot) #8738

jbachorik commented Apr 25, 2025 •

edited by jira bot

Loading

pr-commenter bot commented Apr 25, 2025 •

edited

Loading

Set up crash-tracking JVM flags automatically (for Hotspot) #8738

Are you sure you want to change the base?

Set up crash-tracking JVM flags automatically (for Hotspot) #8738

Conversation

jbachorik commented Apr 25, 2025 • edited by jira bot Loading

What Does This Do

Motivation

Additional Notes

Contributor Checklist

pr-commenter bot commented Apr 25, 2025 • edited Loading

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

jbachorik commented Apr 25, 2025 •

edited by jira bot

Loading

pr-commenter bot commented Apr 25, 2025 •

edited

Loading