Skip to content

Run startup benchmarks on PRs#11357

Draft
sarahchen6 wants to merge 5 commits into
masterfrom
sarahchen6/run-startup-always
Draft

Run startup benchmarks on PRs#11357
sarahchen6 wants to merge 5 commits into
masterfrom
sarahchen6/run-startup-always

Conversation

@sarahchen6
Copy link
Copy Markdown
Contributor

What Does This Do

Run Startup benchmarks, defined in https://github.com/DataDog/apm-sdks-benchmarks/blob/main/.gitlab/ci-java-startup-parallel.yml, on every PR. Dacapo and Load benchmarks still need to be manually triggered to run on PRs.

Motivation

Startup benchmarks are the most easy to regress, so it is important we catch these as early as possible. Additionally, they do not run for very long (i.e. ~12 min), so running them on each PR should not slow down CI time.

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

Note: Once your PR is ready to merge, add it to the merge queue by commenting /merge. /merge -c cancels the queue request. /merge -f --reason "reason" skips all merge queue checks; please use this judiciously, as some checks do not run at the PR-level. For more information, see this doc.

@sarahchen6 sarahchen6 added type: enhancement Enhancements and improvements tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling labels May 12, 2026
@sarahchen6 sarahchen6 force-pushed the sarahchen6/run-startup-always branch 3 times, most recently from e688f0a to f121f13 Compare May 13, 2026 17:08
@DataDog DataDog deleted a comment from dd-octo-sts Bot May 14, 2026
@DataDog DataDog deleted a comment from dd-octo-sts Bot May 15, 2026
@dd-octo-sts
Copy link
Copy Markdown
Contributor

dd-octo-sts Bot commented May 15, 2026

🟢 Java Benchmark SLOs — All performance SLOs passed

Suite Status
Startup 🟢 pass

SLO thresholds are defined here based on automatically generated metrics. A warning is raised when results are within 5% of the threshold.

Commit: bd4b5f07 · CI Pipeline · Benchmarking Platform UI


Load and DaCapo benchmarks can be triggered manually in the GitLab pipeline. Results will appear in the Benchmarking Platform UI after completion.

@sarahchen6 sarahchen6 force-pushed the sarahchen6/run-startup-always branch from 69bcc95 to 95573aa Compare May 15, 2026 14:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes type: enhancement Enhancements and improvements

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant