DOCS-10584

config/_default/menus/main.en.yaml

@@ -2109,31 +2109,51 @@ menu:
       parent: software_catalog_scorecards
       identifier: using_scorecards
       weight: 703
+    - name: Engineering Reports
+      url: software_catalog/eng_reports
+      parent: software_catalog
+      identifier: software_catalog_eng_reports
+      weight: 8
+    - name: Reliability Overview
+      url: software_catalog/eng_reports/reliability_overview
+      parent: software_catalog_eng_reports
+      identifier: eng_reports_reliability_overview
+      weight: 801
+    - name: Scorecards Performance
+      url: software_catalog/eng_reports/scorecards_performance
+      parent: software_catalog_eng_reports
+      identifier: eng_reports_scorecards_perf
+      weight: 802
+    - name: Overview Pages
+      url: software_catalog/overview_pages
+      parent: software_catalog
+      identifier: software_catalog_overview_pages
+      weight: 9
     - name: Self-Service Actions
       url: software_catalog/self_service_actions
       parent: software_catalog
       identifier: self_service_actions
-      weight: 8
+      weight: 10
     - name: Software Templates
       url: software_catalog/self_service_actions/software_templates
       parent: self_service_actions
       identifier: software_templates
-      weight: 801
+      weight: 1001
     - name: Definition APIs
       url: software_catalog/apis
       parent: software_catalog
       identifier: software_catalog_apis
-      weight: 9
+      weight: 11
     - name: Integrations
       url: software_catalog/integrations
       parent: software_catalog
       identifier: software_catalog_integrations
-      weight: 10
+      weight: 12
     - name: Troubleshooting
       url: software_catalog/troubleshooting
       parent: software_catalog
       identifier: software_catalog_troubleshooting
-      weight: 11
+      weight: 13
     - name: Error Tracking
       url: error_tracking/
       pre: error-tracking
@@ -2297,16 +2317,11 @@ menu:
       parent: slos
       identifier: burn_rate
       weight: 5
-    - name: OOTB Dashboard
-      url: service_management/service_level_objectives/ootb_dashboard/
-      parent: slos
-      identifier: slos_ootb_dashboard
-      weight: 6
     - name: Guides
       url: service_management/service_level_objectives/guide/
       parent: slos
       identifier: slos_guides
-      weight: 7
+      weight: 6
     - name: Incident Management
       url: service_management/incident_management/
       pre: incidents

content/en/software_catalog/eng_reports/_index.md

@@ -0,0 +1,31 @@
+---
+title: Engineering Reports
+further_reading:
+- link: "/service_management/service_level_objectives/"
+  tag: "Documentation"
+  text: "Service Level Objectives"
+- link: "service_management/incident_management/"
+  tag: "Documentation"
+  text: "Incident Management"
+- link: "software_catalog/scorecards/"
+  tag: "Documentation"
+  text: "Datadog Scorecards"
+---
+
+{{< callout url="https://www.datadoghq.com/product-preview/engineering-reports/" d_target="#signupModal" btn_hidden="false" header="Opt in to the Preview for Engineering Reports!" >}}
+{{< /callout >}}
+
+## Overview
+
+Engineering Reports provide you with out-of-the-box, executive-level reports on product reliability, adherence to engineering standards, DORA metrics, and more. You can use these reports to uncover key insights, identify gaps, and drive improvements across your organization. The reports include aggregated views of key engineering metrics that are well suited for directors and executive leadership.
+
+{{< whatsnext desc="Explore the following reports:" >}}
+    {{< nextlink href="/software_catalog/eng_reports/reliability_overview/" >}}Reliability Overview: Summary of your organization's reliability based on SLO performance and Incident trends.{{< /nextlink >}}
+    {{< nextlink href="/software_catalog/eng_reports/scorecards_performance" >}}Scorecards Performance: Organization-wide view of Scorecard performance broken down by teams and rules.{{< /nextlink >}}
+{{< /whatsnext >}}
+
+## Further reading
+
+{{< partial name="whats-next/whats-next.html" >}}
+
+

content/en/software_catalog/eng_reports/reliability_overview.md

@@ -0,0 +1,107 @@
+---
+title: Reliability Overview
+further_reading:
+- link: "/service_management/service_level_objectives/"
+  tag: "Documentation"
+  text: "Service Level Objectives"
+- link: "service_management/incident_management/"
+  tag: "Documentation"
+  text: "Incident Management"
+- link: "dashboards/"
+  tag: "Documentation"
+  text: "Datadog Dashboards"
+---
+
+{{< callout url="https://www.datadoghq.com/product-preview/engineering-reports/" d_target="#signupModal" btn_hidden="false" header="Opt in to the Preview for Engineering Reports!" >}}
+{{< /callout >}}
+
+## Overview
+
+The Reliability Overview report supports aggregated views of SLOs and Incidents to help executive leadership understand your organization's reliability at a glance. 
+
+With this report, you can:
+- Customize your SLO or Incident groupings to be based on service, team, or other tags or properties that have been added to your SLOs or Incidents.
+- Use a summary score, based on the remaining error budget of the underlying SLOs, to understand SLO performance across different groups and identify areas of improvement.
+- Explore daily, weekly, and monthly historical reliability trends over the last 12 months to understand performance over time.
+
+Access the Reliability Overview report by clicking on the "Overview" tab in Internal Developer Portal (IDP) and selecting "Reliability Overview" in the left-hand menu. 
+
+{{< img src="tracing/eng_reports/reliability-overview-landing2.png" alt="Default view of the Reliability Overview report, which shows SLO Performance data" style="width:100%;" >}} 
+
+**Note:** If you have not opted into the Datadog IDP Preview, you can access the Reliability Overview report by clicking on the "Reports" tab at the top of the Software Catalog page.
+
+## Interact with your Reliability Overview report
+
+### Adjust your view
+
+{{< img src="tracing/eng_reports/reliability-overview-filtered2.png" alt="Reliability Overview page with an arrow highlighting the filtering options" style="width:100%;" >}} 
+
+You can update your Reliability Overview report view in the following ways:
+
+- **Switch the aggregation between "Service" or "Team"**: View your organization's SLO and Incident performance by service/team groupings to identify top- and bottom-performing areas. 
+
+   **Note**: Service/team groupings are based on the **service** or **team** tag added to your SLOs, and the **services** or **teams** properties added to your Incidents.
+
+- **View daily, weekly, or monthly historical information**: Update the historical SLO and Incident trends to your desired granularity.
+- **Add filters to scope the data**: Filter by teams, services, and incident severity and state.
+
+### Schedule reports
+
+Set up scheduled reports for your stakeholders that are delivered as PDFs through email or Slack on a recurring basis.
+
+To schedule reports, click on **Schedule Report** in the top right corner (or **Manage Reports** if you've already set up reports). Refer to the [Scheduled Reports documentation][1] for more information.
+
+### Customize your report 
+
+On the upper right corner of the report, click the kebab menu and select **Clone as a Dashboard** to create a dashboard with content from the Reliability Overview report. 
+
+To customize the dashboard, you can:
+- Update the SLO Summary table to group by any tag you have added to your SLOs (for example, you can create a view grouped by "user journey")
+- Add widgets that are not included in the default view
+- Add filters to the existing widgets (for example, you can filter Incidents based on "Detection Method")
+
+## Use the SLO summary score
+
+{{< img src="tracing/eng_reports/slo-summary-score2.png" alt="The SLO Summary widget, including the SLO summary score" style="width:100%;" >}}
+
+The **SLO Summary** widget includes a "score". It is designed as a summary metric for executive leadership to understand the performance of a group of SLOs. The score is calculated based on the average remaining error budget of the underlying SLOs, which is then mapped to a score between 0 - 100:
+
+- The score is "passing" (green/yellow) when most SLOs are **not** breached and have remaining error budget.
+- The score is "failing" (red) when many SLOs are out of error budget or a few SLOs are far out of error budget.
+- SLOs in the "No Data" state are not considered in the score.
+
+### Score calculation details
+
+The score is calculated as follows:
+
+{{< jqmath-vanilla >}}
+
+$$
+\text"Average Remaining Error Budget"
+      = {∑_{i=0}^{n}\\text"[Remaining Error Budget]"_i} / n
+$$
+
+$$
+\text"Score"
+      = {max(\text"[Average Remaining Error Budget]"\,-200) + 200} / 300 * 100
+$$
+
+
+- Average the remaining error budget of the SLOs (the minimum error budget is set to -200%, so any SLO with a lower error budget will be counted as -200% in the average).
+- Map the average error budget (between -200 and 100) to a score between 0 and 100.
+- Set the color and status of the score based on the following thresholds:
+  - **Red:** 0 ≤ Score < 66.667
+  - **Yellow:** 66.667 ≤ Score < 80
+  - **Green:** 80 ≤ Score ≤ 100
+
+**Note**: An average remaining error budget of 0% corresponds to a Score value of 66.667. 
+
+
+## Further reading
+
+{{< partial name="whats-next/whats-next.html" >}}
+
+[1]: /dashboards/sharing/scheduled_reports/
+
+
+

content/en/software_catalog/eng_reports/scorecards_performance.md

@@ -0,0 +1,64 @@
+---
+title: Scorecards Performance
+further_reading:
+- link: "software_catalog/scorecards/"
+  tag: "Documentation"
+  text: "Datadog Scorecards"
+- link: "dashboards/"
+  tag: "Documentation"
+  text: "Datadog Dashboards"
+---
+
+{{< callout url="https://www.datadoghq.com/product-preview/engineering-reports/" d_target="#signupModal" btn_hidden="false" header="Opt in to the Preview for Engineering Reports!" >}}
+{{< /callout >}}
+
+## Overview
+
+The Scorecards Performance report includes an organization-wide view of Scorecard performance by teams and rules, including historical trends. With this report, you can:
+- Identify highest and lowest performing teams by Scorecards and rules. 
+- Filter information based on team, scorecard, rule, application, tier, and lifecycle.
+- Explore historical info for the last 12 months to identify trends over time.
+
+Access the Scorecards Performance report by clicking on the "Overview" tab in Internal Developer Portal (IDP) and selecting "Scorecards Performance" in the left-hand menu. 
+
+{{< img src="tracing/eng_reports/scorecards-landing2.png" alt="Default view of the Scorecards Performance report, with the Performance by Scorecard sub-section visible" style="width:100%;" >}} 
+
+**Note:** If you have not opted into the Datadog IDP Preview, you can access the Scorecards Performance report by clicking on the "Reports" tab at the top of the Software Catalog page.
+
+## Interact with your Scorecard Performance report
+
+### Adjust your view
+
+{{< img src="tracing/eng_reports/scorecards-filtered2.png" alt="Scorecard Performance report with an arrow highlighting the filtering options" style="width:100%;" >}} 
+
+By default, the Scorecards Performance report breaks down data by team, which allows you to identify the highest- and lowest-performing teams across all Scorecards, specific Scorecards, or individual rules.
+
+You can update your Scorecard Performance report view in the following ways:
+
+- **Switch the aggregation between "Service" or "Team"**: View your organization's Scorecard performance by service/team groupings to identify top- and bottom-performing areas. 
+- **Add filters to scope the data**: Filter by teams, services, scorecards, rules, systems, tiers, and lifecycles.
+
+**Note**: The data in the Scorecards Performance report reflects information for active Scorecard rules at any point in time. This means you will see historical information for rules that are now disabled. 
+
+### Schedule reports
+
+Set up scheduled reports for your stakeholders that are delivered as PDFs through email or Slack on a recurring basis.
+
+To schedule reports, click on **Schedule Report** in the top right corner (or **Manage Reports** if you've already set up reports). Refer to the [Scheduled Reports documentation][1] for more information.
+
+### Customize your report
+
+On the upper right corner of the report, click the kebab menu and select **Clone as a Dashboard** to create a dashboard with content from the Scorecards Performance report. The dashboard reflects the "team" aggregated view. 
+
+To customize the dashboard, you can:
+- Update the Scorecard leaderboard view to aggregate by dimensions other than team or service (for example, you can create a leaderboard view by "system" or "tier")
+- Add widgets that are not included in the default view
+- Add filters to the existing widgets
+
+## Further reading
+
+{{< partial name="whats-next/whats-next.html" >}}
+
+[1]: https://docs.datadoghq.com/dashboards/sharing/scheduled_reports/
+
+