Skip to content

[DOCS-11497] Guide for new Continuous Testing <> Test Optimization integration #30471

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 9 commits into
base: master
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 6 additions & 1 deletion config/_default/menus/main.en.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -6873,11 +6873,16 @@ menu:
parent: continuous_testing
identifier: continuous_testing_metrics
weight: 5
- name: Guides
url: continuous_testing/guide/
parent: continuous_testing
identifier: continuous_testing_guides
weight: 6
- name: Troubleshooting
url: continuous_testing/troubleshooting/
parent: continuous_testing
identifier: continuous_testing_troubleshooting
weight: 6
weight: 7
- name: Real User Monitoring
url: real_user_monitoring/
pre: rum
Expand Down
1 change: 1 addition & 0 deletions content/en/all_guides.md
Original file line number Diff line number Diff line change
Expand Up @@ -50,6 +50,7 @@ Guides in the Datadog documentation are pages that provide background knowledge,

{{< whatsnext desc="Digital Experience:">}}
{{< nextlink href="/synthetics/guide" >}}<i class="icon-synthetics" style="font-size:25px;color:#7c3eb9;vertical-align:middle"></i>&nbsp;&nbsp;&nbsp;&nbsp;Synthetic Monitoring{{< /nextlink >}}
{{< nextlink href="/continuous_testing/guide" >}}<i class="icon-continuous-testing" style="font-size:25px;color:#7c3eb9;vertical-align:middle"></i>&nbsp;&nbsp;&nbsp;&nbsp;Continuous Testing{{< /nextlink >}}
{{< nextlink href="/real_user_monitoring/guide" >}}<i class="icon-rum" style="font-size:25px;color:#7c3eb9;vertical-align:middle"></i>&nbsp;&nbsp;&nbsp;&nbsp;Real User Monitoring{{< /nextlink >}}
{{< /whatsnext >}}

Expand Down
3 changes: 3 additions & 0 deletions content/en/continuous_testing/_index.md
Original file line number Diff line number Diff line change
Expand Up @@ -12,6 +12,9 @@ further_reading:
- link: '/getting_started/continuous_testing'
tag: 'Documentation'
text: 'Learn about Continuous Testing'
- link: '/continuous_testing/guide'
tag: 'Guide'
text: 'Continuous Testing Guides'
- link: '/synthetics/private_locations/#scale-your-private-location'
tag: 'Documentation'
text: 'Learn about Private Locations'
Expand Down
14 changes: 14 additions & 0 deletions content/en/continuous_testing/guide/_index.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,14 @@
---
title: Continuous Testing Guides
private: true
disable_toc: true
cascade:
algolia:
rank: 20
category: Guide
subcategory: Continuous Testing Guides
---

{{< whatsnext desc="Datadog Integrations:" >}}
{{< nextlink href="/continuous_testing/guide/view-continuous-testing-test-runs-in-test-optimization" >}}View Continuous Testing Test Runs in Test Optimization{{< /nextlink >}}
{{< /whatsnext >}}
Original file line number Diff line number Diff line change
@@ -0,0 +1,68 @@
---
title: View Continuous Testing Test Runs in Test Optimization

further_reading:
- link: 'getting_started/continuous_testing'
tag: 'Documentation'
text: 'Getting Started with Continuous Testing'
- link: '/tests/explorer/'
tag: 'Documentation'
text: 'Using the Test Optimization Explorer'
- link: 'tests/flaky_tests'
tag: 'Documentation'
text: 'Working with Flaky Tests'

---
{{< site-region region="gov" >}}<div class="alert alert-warning"> Mobile Application Testing is not supported on this <a href="/getting_started/site">Datadog site</a> ({{< region-param key="dd_site_name" >}}).</div>
{{< /site-region >}}

## Overview

[Continuous Testing][1] enables you to run [Synthetic Monitoring tests][2] within your CI/CD pipelines, automating software testing throughout your product's lifecycle. [Test Optimization][3] provides a test-first view into your CI health by displaying important metrics and results from your tests.

You can use Test Optimization to view Continuous Testing test runs, giving you a unified overview of metrics and results from all your test frameworks, including Synthetic Monitoring, in one place.

## View Continuous Testing test runs in Test Optimization

1. Navigate to the [Test Runs][4] Explorer in Test Optimization.
2. Filter the **Test Framework** facet to **synthetics**:

{{< img src="continuous_testing/guide/view-continuous-testing-test-runs-in-test-optimization/test_optimization_test_run_explorer_3.png" alt="Test Optimization Test Runs explorer, filtered to synthetics framework facet" style="width:100%" >}}

Use this feature to search, filter, and analyze Continuous Testing test runs, combining both Test Optimization and Continuous Testing metadata in a single view.

For example:

- Use the **Flaky**, **New Flaky**, and **Known Flaky** facets to identify flaky test runs.
- Use the **Synthetics Teams** facet to analyze test run status and performance by team.
- Click **Export** and include the **@test.name** column to export a list of test runs and their names.

Select a Continuous Testing test run in the Test Optimization Explorer to view detailed information about that test run:

{{< img src="continuous_testing/guide/view-continuous-testing-test-runs-in-test-optimization/test_optimization_test_run_detail.png" alt="Test Optimization Test Runs details view" style="width:100%" >}}

Use these tabs on the side panel:

- **Overview**: Troubleshoot a flaky test by viewing the first and last commit it flaked.
- **History**: Visualize past runs by status and branch.
- **Performance**: Track the mean, minimum, maximum, p95, and trends for test run durations over time.

## Viewing test runs

From the Test Optimization Explorer, you can jump to a test run in the Synthetic Monitoring page. Click **View in Synthetics** from the details panel of a test run on the Test Optimization page.

{{< img src="continuous_testing/guide/view-continuous-testing-test-runs-in-test-optimization/view_in_synthetics.png" alt="Test Optimization Test Runs details view, highlighting View in Synthetics button" style="width:100%" >}}

Similarly, from the Synthetic Monitoring page, you jump to a test run in the Test Optimization Explorer. Click **View in Test Optimization** from the details panel of a test run on the Synthetic Monitoring page:

{{< img src="continuous_testing/guide/view-continuous-testing-test-runs-in-test-optimization/continuous_testing_test_run_detail.png" alt="Synthetics Test Runs details view, highlighting View in Test Optimization button" style="width:100%" >}}


## Further Reading

{{< partial name="whats-next/whats-next.html" >}}

[1]: /continuous_testing/
[2]: /synthetics/
[3]: /tests/
[4]: https://app.datadoghq.com/ci/test/runs
1 change: 0 additions & 1 deletion content/en/synthetics/guide/_index.md
Original file line number Diff line number Diff line change
Expand Up @@ -48,7 +48,6 @@ cascade:
{{< nextlink href="logs/guide/ease-troubleshooting-with-cross-product-correlation" >}}Ease troubleshooting with cross-product correlation{{< /nextlink >}}
{{< nextlink href="synthetics/guide/explore-rum-through-synthetics/" >}}Explore a preview of RUM features in Synthetics{{< /nextlink >}}
{{< nextlink href="synthetics/guide/rum-to-synthetics" >}}Generate Synthetic browser tests from RUM Session Replays{{< /nextlink >}}

{{< /whatsnext >}}

{{< whatsnext desc="Metrics:" >}}
Expand Down
3 changes: 3 additions & 0 deletions content/en/tests/explorer/_index.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,6 +8,9 @@ further_reading:
- link: "https://www.datadoghq.com/blog/configure-pipeline-alerts-with-ci-monitors/"
tag: "Blog"
text: "Configure pipeline alerts with Datadog CI monitors"
- link: "/continuous_testing/guide/view-continuous-testing-test-runs-in-test-optimization/"
tag: "Guide"
text: "View Continuous Testing Test Runs in Test Optimization"
---

## Overview
Expand Down
1 change: 1 addition & 0 deletions content/en/tests/guides/_index.md
Original file line number Diff line number Diff line change
Expand Up @@ -12,4 +12,5 @@ cascade:

{{< whatsnext desc="Test Optimization Guides:" >}}
{{< nextlink href="/tests/guides/add_custom_measures" >}}Add Custom Measures to Your Tests{{< /nextlink >}}
{{< nextlink href="/continuous_testing/guide/view-continuous-testing-test-runs-in-test-optimization" >}}View Continuous Testing Test Runs in Test Optimization{{< /nextlink >}}
{{< /whatsnext >}}
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading