Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

WIP - Prototyping context propagation API #8271

Draft
wants to merge 8 commits into
base: master
Choose a base branch
from

Conversation

PerfectSlayer
Copy link
Contributor

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@PerfectSlayer PerfectSlayer added the tag: do not merge Do not merge changes label Jan 23, 2025
Comment on lines 591 to 593
ExtractedSpan(AgentSpanContext spanContext) {
this.spanContext = spanContext;
}
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Quality Violation

Consider adding super() or this() to your constructor (...read more)

In Java, it is suggested to call super() in an extended class. This rule will report a violation if both a call to super() and an overloaded constructor are absent.

View in Datadog  Leave us feedback  Documentation

@PerfectSlayer PerfectSlayer force-pushed the bbujon/context-propagation branch from 017e5a4 to ddb0406 Compare January 23, 2025 09:54
@pr-commenter
Copy link

pr-commenter bot commented Jan 23, 2025

Kafka / producer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/context-propagation
git_commit_date 1737627954 1737715771
git_commit_sha 1efc71f fbf319b
See matching parameters
Baseline Candidate
ci_job_date 1737716824 1737716824
ci_job_id 779231381 779231381
ci_pipeline_id 53901848 53901848
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaProduceBenchmark.benchProduce same

@pr-commenter
Copy link

pr-commenter bot commented Jan 23, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/context-propagation
git_commit_date 1737654035 1737715771
git_commit_sha 56d4919 fbf319b
release_version 1.46.0-SNAPSHOT~56d4919491 1.46.0-SNAPSHOT~fbf319b527
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1737718098 1737718098
ci_job_id 779231377 779231377
ci_pipeline_id 53901848 53901848
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-xugqgpm8-project-304-concurrent-0-wvzg8yax 6.8.0-1018-aws #19~22.04.1-Ubuntu SMP Wed Oct 9 16:48:22 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-xugqgpm8-project-304-concurrent-0-wvzg8yax 6.8.0-1018-aws #19~22.04.1-Ubuntu SMP Wed Oct 9 16:48:22 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 1 performance improvements and 8 performance regressions! Performance is the same for 51 metrics, 3 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:insecure-bank:iast:GlobalTracer worse
[+15.152ms; +21.048ms] or [+6.556%; +9.107%]
249.222ms 231.122ms
scenario:startup:insecure-bank:iast_HARDCODED_SECRET_DISABLED:GlobalTracer worse
[+15.649ms; +21.492ms] or [+6.776%; +9.306%]
249.527ms 230.956ms
scenario:startup:insecure-bank:iast_TELEMETRY_OFF:GlobalTracer worse
[+16.419ms; +24.898ms] or [+7.135%; +10.819%]
250.784ms 230.126ms
scenario:startup:insecure-bank:tracing:GlobalTracer worse
[+17.967ms; +24.432ms] or [+7.526%; +10.233%]
259.949ms 238.749ms
scenario:startup:petclinic:appsec:GlobalTracer worse
[+17.189ms; +21.386ms] or [+7.265%; +9.039%]
255.880ms 236.592ms
scenario:startup:petclinic:appsec:AppSec better
[-6.123ms; -4.783ms] or [-3.465%; -2.707%]
171.237ms 176.690ms
scenario:startup:petclinic:iast:GlobalTracer worse
[+18.356ms; +21.067ms] or [+7.974%; +9.152%]
249.916ms 230.204ms
scenario:startup:petclinic:tracing:GlobalTracer worse
[+18.939ms; +20.607ms] or [+7.943%; +8.643%]
258.210ms 238.437ms
scenario:startup:petclinic:tracing:Remote Config worse
[+29.966µs; +61.868µs] or [+4.253%; +8.781%]
750.524µs 704.607µs
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.46.0-SNAPSHOT~fbf319b527, baseline=1.46.0-SNAPSHOT~56d4919491

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.035 s) : 0, 1034548
Total [baseline] (8.634 s) : 0, 8633691
Agent [candidate] (1.068 s) : 0, 1068333
Total [candidate] (8.657 s) : 0, 8656693
section iast
Agent [baseline] (1.175 s) : 0, 1174620
Total [baseline] (9.215 s) : 0, 9215256
Agent [candidate] (1.186 s) : 0, 1186270
Total [candidate] (9.25 s) : 0, 9250192
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.172 s) : 0, 1171641
Total [baseline] (9.212 s) : 0, 9212361
Agent [candidate] (1.188 s) : 0, 1187968
Total [candidate] (9.205 s) : 0, 9205377
section iast_TELEMETRY_OFF
Agent [baseline] (1.169 s) : 0, 1169465
Total [baseline] (9.262 s) : 0, 9261946
Agent [candidate] (1.191 s) : 0, 1191392
Total [candidate] (9.212 s) : 0, 9212329
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.035 s -
Agent iast 1.175 s 140.072 ms (13.5%)
Agent iast_HARDCODED_SECRET_DISABLED 1.172 s 137.094 ms (13.3%)
Agent iast_TELEMETRY_OFF 1.169 s 134.917 ms (13.0%)
Total tracing 8.634 s -
Total iast 9.215 s 581.565 ms (6.7%)
Total iast_HARDCODED_SECRET_DISABLED 9.212 s 578.67 ms (6.7%)
Total iast_TELEMETRY_OFF 9.262 s 628.255 ms (7.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.068 s -
Agent iast 1.186 s 117.937 ms (11.0%)
Agent iast_HARDCODED_SECRET_DISABLED 1.188 s 119.635 ms (11.2%)
Agent iast_TELEMETRY_OFF 1.191 s 123.059 ms (11.5%)
Total tracing 8.657 s -
Total iast 9.25 s 593.499 ms (6.9%)
Total iast_HARDCODED_SECRET_DISABLED 9.205 s 548.684 ms (6.3%)
Total iast_TELEMETRY_OFF 9.212 s 555.636 ms (6.4%)
gantt
    title insecure-bank - break down per module: candidate=1.46.0-SNAPSHOT~fbf319b527, baseline=1.46.0-SNAPSHOT~56d4919491

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (713.87 ms) : 0, 713870
BytebuddyAgent [candidate] (720.681 ms) : 0, 720681
GlobalTracer [baseline] (238.749 ms) : 0, 238749
GlobalTracer [candidate] (259.949 ms) : 0, 259949
AppSec [baseline] (55.421 ms) : 0, 55421
AppSec [candidate] (55.893 ms) : 0, 55893
Remote Config [baseline] (717.053 µs) : 0, 717
Remote Config [candidate] (742.019 µs) : 0, 742
Telemetry [baseline] (10.749 ms) : 0, 10749
Telemetry [candidate] (15.892 ms) : 0, 15892
section iast
BytebuddyAgent [baseline] (839.318 ms) : 0, 839318
BytebuddyAgent [candidate] (832.558 ms) : 0, 832558
GlobalTracer [baseline] (231.122 ms) : 0, 231122
GlobalTracer [candidate] (249.222 ms) : 0, 249222
AppSec [baseline] (58.209 ms) : 0, 58209
AppSec [candidate] (58.24 ms) : 0, 58240
IAST [baseline] (21.42 ms) : 0, 21420
IAST [candidate] (21.647 ms) : 0, 21647
Remote Config [baseline] (650.748 µs) : 0, 651
Remote Config [candidate] (675.355 µs) : 0, 675
Telemetry [baseline] (8.76 ms) : 0, 8760
Telemetry [candidate] (8.903 ms) : 0, 8903
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (837.181 ms) : 0, 837181
BytebuddyAgent [candidate] (834.178 ms) : 0, 834178
GlobalTracer [baseline] (230.956 ms) : 0, 230956
GlobalTracer [candidate] (249.527 ms) : 0, 249527
AppSec [baseline] (58.143 ms) : 0, 58143
AppSec [candidate] (58.273 ms) : 0, 58273
IAST [baseline] (21.112 ms) : 0, 21112
IAST [candidate] (21.527 ms) : 0, 21527
Remote Config [baseline] (635.096 µs) : 0, 635
Remote Config [candidate] (666.518 µs) : 0, 667
Telemetry [baseline] (8.596 ms) : 0, 8596
Telemetry [candidate] (8.823 ms) : 0, 8823
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (835.855 ms) : 0, 835855
BytebuddyAgent [candidate] (837.162 ms) : 0, 837162
GlobalTracer [baseline] (230.126 ms) : 0, 230126
GlobalTracer [candidate] (250.784 ms) : 0, 250784
AppSec [baseline] (58.038 ms) : 0, 58038
AppSec [candidate] (58.089 ms) : 0, 58089
IAST [baseline] (21.062 ms) : 0, 21062
IAST [candidate] (20.919 ms) : 0, 20919
Remote Config [baseline] (651.159 µs) : 0, 651
Remote Config [candidate] (671.414 µs) : 0, 671
Telemetry [baseline] (8.584 ms) : 0, 8584
Telemetry [candidate] (8.686 ms) : 0, 8686
Loading
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.46.0-SNAPSHOT~fbf319b527, baseline=1.46.0-SNAPSHOT~56d4919491

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.039 s) : 0, 1038670
Total [baseline] (10.437 s) : 0, 10437029
Agent [candidate] (1.06 s) : 0, 1059976
Total [candidate] (10.507 s) : 0, 10506597
section appsec
Agent [baseline] (1.178 s) : 0, 1177600
Total [baseline] (10.751 s) : 0, 10751206
Agent [candidate] (1.192 s) : 0, 1192144
Total [candidate] (10.761 s) : 0, 10760549
section iast
Agent [baseline] (1.17 s) : 0, 1169532
Total [baseline] (10.988 s) : 0, 10987788
Agent [candidate] (1.188 s) : 0, 1188123
Total [candidate] (11.018 s) : 0, 11018018
section profiling
Agent [baseline] (1.255 s) : 0, 1254636
Total [baseline] (10.848 s) : 0, 10848382
Agent [candidate] (1.256 s) : 0, 1255651
Total [candidate] (10.871 s) : 0, 10870819
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.039 s -
Agent appsec 1.178 s 138.93 ms (13.4%)
Agent iast 1.17 s 130.862 ms (12.6%)
Agent profiling 1.255 s 215.966 ms (20.8%)
Total tracing 10.437 s -
Total appsec 10.751 s 314.177 ms (3.0%)
Total iast 10.988 s 550.759 ms (5.3%)
Total profiling 10.848 s 411.353 ms (3.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.06 s -
Agent appsec 1.192 s 132.168 ms (12.5%)
Agent iast 1.188 s 128.147 ms (12.1%)
Agent profiling 1.256 s 195.675 ms (18.5%)
Total tracing 10.507 s -
Total appsec 10.761 s 253.952 ms (2.4%)
Total iast 11.018 s 511.422 ms (4.9%)
Total profiling 10.871 s 364.222 ms (3.5%)
gantt
    title petclinic - break down per module: candidate=1.46.0-SNAPSHOT~fbf319b527, baseline=1.46.0-SNAPSHOT~56d4919491

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (713.406 ms) : 0, 713406
BytebuddyAgent [candidate] (716.319 ms) : 0, 716319
GlobalTracer [baseline] (238.437 ms) : 0, 238437
GlobalTracer [candidate] (258.21 ms) : 0, 258210
AppSec [baseline] (55.497 ms) : 0, 55497
AppSec [candidate] (55.29 ms) : 0, 55290
Remote Config [baseline] (704.607 µs) : 0, 705
Remote Config [candidate] (750.524 µs) : 0, 751
Telemetry [baseline] (15.721 ms) : 0, 15721
Telemetry [candidate] (14.4 ms) : 0, 14400
section appsec
BytebuddyAgent [baseline] (730.947 ms) : 0, 730947
BytebuddyAgent [candidate] (731.523 ms) : 0, 731523
GlobalTracer [baseline] (236.592 ms) : 0, 236592
GlobalTracer [candidate] (255.88 ms) : 0, 255880
AppSec [baseline] (176.69 ms) : 0, 176690
AppSec [candidate] (171.237 ms) : 0, 171237
IAST [baseline] (19.22 ms) : 0, 19220
IAST [candidate] (19.311 ms) : 0, 19311
Remote Config [baseline] (653.974 µs) : 0, 654
Remote Config [candidate] (664.78 µs) : 0, 665
Telemetry [baseline] (8.175 ms) : 0, 8175
Telemetry [candidate] (8.186 ms) : 0, 8186
section iast
BytebuddyAgent [baseline] (835.152 ms) : 0, 835152
BytebuddyAgent [candidate] (833.886 ms) : 0, 833886
GlobalTracer [baseline] (230.204 ms) : 0, 230204
GlobalTracer [candidate] (249.916 ms) : 0, 249916
AppSec [baseline] (58.186 ms) : 0, 58186
AppSec [candidate] (58.317 ms) : 0, 58317
IAST [baseline] (21.539 ms) : 0, 21539
IAST [candidate] (21.59 ms) : 0, 21590
Remote Config [baseline] (646.289 µs) : 0, 646
Remote Config [candidate] (661.807 µs) : 0, 662
Telemetry [baseline] (8.763 ms) : 0, 8763
Telemetry [candidate] (8.711 ms) : 0, 8711
section profiling
BytebuddyAgent [baseline] (703.842 ms) : 0, 703842
BytebuddyAgent [candidate] (704.009 ms) : 0, 704009
GlobalTracer [baseline] (348.59 ms) : 0, 348590
GlobalTracer [candidate] (351.04 ms) : 0, 351040
AppSec [baseline] (55.246 ms) : 0, 55246
AppSec [candidate] (54.135 ms) : 0, 54135
Remote Config [baseline] (714.829 µs) : 0, 715
Remote Config [candidate] (713.192 µs) : 0, 713
Telemetry [baseline] (8.806 ms) : 0, 8806
Telemetry [candidate] (8.828 ms) : 0, 8828
ProfilingAgent [baseline] (95.52 ms) : 0, 95520
ProfilingAgent [candidate] (94.989 ms) : 0, 94989
Profiling [baseline] (95.544 ms) : 0, 95544
Profiling [candidate] (95.013 ms) : 0, 95013
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-01-24T11:00:15 2025-01-24T11:07:22
git_branch master bbujon/context-propagation
git_commit_date 1737654035 1737715771
git_commit_sha 56d4919 fbf319b
release_version 1.46.0-SNAPSHOT~56d4919491 1.46.0-SNAPSHOT~fbf319b527
start_time 2025-01-24T11:00:01 2025-01-24T11:07:08
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1737717202 1737717202
ci_job_id 779231378 779231378
ci_pipeline_id 53901848 53901848
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-xugqgpm8-project-304-concurrent-1-ci1q6hcu 6.8.0-1018-aws #19~22.04.1-Ubuntu SMP Wed Oct 9 16:48:22 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-xugqgpm8-project-304-concurrent-1-ci1q6hcu 6.8.0-1018-aws #19~22.04.1-Ubuntu SMP Wed Oct 9 16:48:22 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 16 unstable metrics.

Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.46.0-SNAPSHOT~fbf319b527, baseline=1.46.0-SNAPSHOT~56d4919491
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.366 ms) : 1346, 1385
.   : milestone, 1366,
appsec (1.76 ms) : 1737, 1782
.   : milestone, 1760,
appsec_no_iast (1.76 ms) : 1736, 1784
.   : milestone, 1760,
iast (1.511 ms) : 1487, 1536
.   : milestone, 1511,
profiling (1.51 ms) : 1487, 1533
.   : milestone, 1510,
tracing (1.505 ms) : 1480, 1529
.   : milestone, 1505,
section candidate
no_agent (1.348 ms) : 1329, 1368
.   : milestone, 1348,
appsec (1.755 ms) : 1731, 1779
.   : milestone, 1755,
appsec_no_iast (1.771 ms) : 1748, 1793
.   : milestone, 1771,
iast (1.509 ms) : 1485, 1534
.   : milestone, 1509,
profiling (1.566 ms) : 1542, 1590
.   : milestone, 1566,
tracing (1.484 ms) : 1458, 1509
.   : milestone, 1484,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.366 ms [1.346 ms, 1.385 ms] -
appsec 1.76 ms [1.737 ms, 1.782 ms] 394.006 µs (28.9%)
appsec_no_iast 1.76 ms [1.736 ms, 1.784 ms] 394.212 µs (28.9%)
iast 1.511 ms [1.487 ms, 1.536 ms] 145.675 µs (10.7%)
profiling 1.51 ms [1.487 ms, 1.533 ms] 144.786 µs (10.6%)
tracing 1.505 ms [1.48 ms, 1.529 ms] 139.19 µs (10.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.348 ms [1.329 ms, 1.368 ms] -
appsec 1.755 ms [1.731 ms, 1.779 ms] 406.834 µs (30.2%)
appsec_no_iast 1.771 ms [1.748 ms, 1.793 ms] 422.118 µs (31.3%)
iast 1.509 ms [1.485 ms, 1.534 ms] 160.996 µs (11.9%)
profiling 1.566 ms [1.542 ms, 1.59 ms] 217.34 µs (16.1%)
tracing 1.484 ms [1.458 ms, 1.509 ms] 135.485 µs (10.0%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.46.0-SNAPSHOT~fbf319b527, baseline=1.46.0-SNAPSHOT~56d4919491
    dateFormat X
    axisFormat %s
section baseline
no_agent (383.835 µs) : 363, 404
.   : milestone, 384,
iast (513.756 µs) : 492, 535
.   : milestone, 514,
iast_FULL (749.187 µs) : 726, 772
.   : milestone, 749,
iast_GLOBAL (565.378 µs) : 541, 590
.   : milestone, 565,
iast_HARDCODED_SECRET_DISABLED (521.596 µs) : 498, 545
.   : milestone, 522,
iast_INACTIVE (472.139 µs) : 450, 494
.   : milestone, 472,
iast_TELEMETRY_OFF (502.09 µs) : 479, 525
.   : milestone, 502,
tracing (461.184 µs) : 440, 482
.   : milestone, 461,
section candidate
no_agent (384.404 µs) : 365, 404
.   : milestone, 384,
iast (512.217 µs) : 491, 534
.   : milestone, 512,
iast_FULL (743.461 µs) : 721, 765
.   : milestone, 743,
iast_GLOBAL (562.668 µs) : 540, 585
.   : milestone, 563,
iast_HARDCODED_SECRET_DISABLED (509.71 µs) : 488, 531
.   : milestone, 510,
iast_INACTIVE (464.523 µs) : 443, 486
.   : milestone, 465,
iast_TELEMETRY_OFF (512.698 µs) : 490, 535
.   : milestone, 513,
tracing (459.91 µs) : 439, 481
.   : milestone, 460,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 383.835 µs [363.362 µs, 404.308 µs] -
iast 513.756 µs [492.146 µs, 535.366 µs] 129.922 µs (33.8%)
iast_FULL 749.187 µs [726.155 µs, 772.219 µs] 365.352 µs (95.2%)
iast_GLOBAL 565.378 µs [541.041 µs, 589.714 µs] 181.543 µs (47.3%)
iast_HARDCODED_SECRET_DISABLED 521.596 µs [498.278 µs, 544.915 µs] 137.762 µs (35.9%)
iast_INACTIVE 472.139 µs [450.018 µs, 494.259 µs] 88.304 µs (23.0%)
iast_TELEMETRY_OFF 502.09 µs [478.743 µs, 525.437 µs] 118.255 µs (30.8%)
tracing 461.184 µs [440.291 µs, 482.078 µs] 77.349 µs (20.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 384.404 µs [364.84 µs, 403.967 µs] -
iast 512.217 µs [490.552 µs, 533.882 µs] 127.813 µs (33.2%)
iast_FULL 743.461 µs [721.437 µs, 765.486 µs] 359.058 µs (93.4%)
iast_GLOBAL 562.668 µs [540.062 µs, 585.273 µs] 178.264 µs (46.4%)
iast_HARDCODED_SECRET_DISABLED 509.71 µs [487.992 µs, 531.429 µs] 125.307 µs (32.6%)
iast_INACTIVE 464.523 µs [442.666 µs, 486.381 µs] 80.12 µs (20.8%)
iast_TELEMETRY_OFF 512.698 µs [490.343 µs, 535.052 µs] 128.294 µs (33.4%)
tracing 459.91 µs [438.528 µs, 481.291 µs] 75.506 µs (19.6%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/context-propagation
git_commit_date 1737654035 1737715771
git_commit_sha 56d4919 fbf319b
release_version 1.46.0-SNAPSHOT~56d4919491 1.46.0-SNAPSHOT~fbf319b527
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1737717743 1737717743
ci_job_id 779231379 779231379
ci_pipeline_id 53901848 53901848
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-dmnxfugi-project-304-concurrent-0-shthnvlg 6.8.0-1018-aws #19~22.04.1-Ubuntu SMP Wed Oct 9 16:48:22 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-dmnxfugi-project-304-concurrent-0-shthnvlg 6.8.0-1018-aws #19~22.04.1-Ubuntu SMP Wed Oct 9 16:48:22 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.46.0-SNAPSHOT~fbf319b527, baseline=1.46.0-SNAPSHOT~56d4919491
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.975 s) : 14975000, 14975000
.   : milestone, 14975000,
appsec (14.934 s) : 14934000, 14934000
.   : milestone, 14934000,
iast (18.419 s) : 18419000, 18419000
.   : milestone, 18419000,
iast_GLOBAL (18.052 s) : 18052000, 18052000
.   : milestone, 18052000,
profiling (15.18 s) : 15180000, 15180000
.   : milestone, 15180000,
tracing (15.271 s) : 15271000, 15271000
.   : milestone, 15271000,
section candidate
no_agent (15.564 s) : 15564000, 15564000
.   : milestone, 15564000,
appsec (15.101 s) : 15101000, 15101000
.   : milestone, 15101000,
iast (18.398 s) : 18398000, 18398000
.   : milestone, 18398000,
iast_GLOBAL (17.929 s) : 17929000, 17929000
.   : milestone, 17929000,
profiling (15.269 s) : 15269000, 15269000
.   : milestone, 15269000,
tracing (14.958 s) : 14958000, 14958000
.   : milestone, 14958000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.975 s [14.975 s, 14.975 s] -
appsec 14.934 s [14.934 s, 14.934 s] -41.0 ms (-0.3%)
iast 18.419 s [18.419 s, 18.419 s] 3.444 s (23.0%)
iast_GLOBAL 18.052 s [18.052 s, 18.052 s] 3.077 s (20.5%)
profiling 15.18 s [15.18 s, 15.18 s] 205.0 ms (1.4%)
tracing 15.271 s [15.271 s, 15.271 s] 296.0 ms (2.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.564 s [15.564 s, 15.564 s] -
appsec 15.101 s [15.101 s, 15.101 s] -463.0 ms (-3.0%)
iast 18.398 s [18.398 s, 18.398 s] 2.834 s (18.2%)
iast_GLOBAL 17.929 s [17.929 s, 17.929 s] 2.365 s (15.2%)
profiling 15.269 s [15.269 s, 15.269 s] -295.0 ms (-1.9%)
tracing 14.958 s [14.958 s, 14.958 s] -606.0 ms (-3.9%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.46.0-SNAPSHOT~fbf319b527, baseline=1.46.0-SNAPSHOT~56d4919491
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.467 ms) : 1455, 1478
.   : milestone, 1467,
appsec (2.362 ms) : 2319, 2405
.   : milestone, 2362,
iast (2.097 ms) : 2043, 2151
.   : milestone, 2097,
iast_GLOBAL (2.141 ms) : 2087, 2196
.   : milestone, 2141,
profiling (1.968 ms) : 1925, 2011
.   : milestone, 1968,
tracing (1.944 ms) : 1902, 1986
.   : milestone, 1944,
section candidate
no_agent (1.471 ms) : 1459, 1482
.   : milestone, 1471,
appsec (2.364 ms) : 2321, 2407
.   : milestone, 2364,
iast (2.097 ms) : 2042, 2151
.   : milestone, 2097,
iast_GLOBAL (2.15 ms) : 2096, 2205
.   : milestone, 2150,
profiling (1.963 ms) : 1919, 2008
.   : milestone, 1963,
tracing (1.94 ms) : 1898, 1981
.   : milestone, 1940,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.467 ms [1.455 ms, 1.478 ms] -
appsec 2.362 ms [2.319 ms, 2.405 ms] 894.738 µs (61.0%)
iast 2.097 ms [2.043 ms, 2.151 ms] 629.839 µs (42.9%)
iast_GLOBAL 2.141 ms [2.087 ms, 2.196 ms] 674.342 µs (46.0%)
profiling 1.968 ms [1.925 ms, 2.011 ms] 501.152 µs (34.2%)
tracing 1.944 ms [1.902 ms, 1.986 ms] 477.352 µs (32.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.471 ms [1.459 ms, 1.482 ms] -
appsec 2.364 ms [2.321 ms, 2.407 ms] 893.285 µs (60.7%)
iast 2.097 ms [2.042 ms, 2.151 ms] 625.896 µs (42.6%)
iast_GLOBAL 2.15 ms [2.096 ms, 2.205 ms] 679.352 µs (46.2%)
profiling 1.963 ms [1.919 ms, 2.008 ms] 492.704 µs (33.5%)
tracing 1.94 ms [1.898 ms, 1.981 ms] 469.107 µs (31.9%)

@pr-commenter
Copy link

pr-commenter bot commented Jan 23, 2025

Kafka / consumer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/context-propagation
git_commit_date 1737627954 1737715771
git_commit_sha 1efc71f fbf319b
See matching parameters
Baseline Candidate
ci_job_date 1737716865 1737716865
ci_job_id 779231382 779231382
ci_pipeline_id 53901848 53901848
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaConsumerBenchmark.benchConsume same

@PerfectSlayer PerfectSlayer force-pushed the bbujon/context-propagation branch from ddb0406 to 12d2605 Compare January 23, 2025 11:05
@PerfectSlayer PerfectSlayer force-pushed the bbujon/context-propagation branch from 12d2605 to 5a40279 Compare January 23, 2025 12:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
tag: do not merge Do not merge changes
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant