|
1 | 1 | ---
|
2 |
| -title: Data Lakes Sync History and Sync Health |
| 2 | +title: Data Lakes Sync History and Health |
3 | 3 | ---
|
4 | 4 | {% include content/plan-grid.md name="data-lakes" %}
|
5 | 5 |
|
6 |
| -Segment generates reports about each sync to your data lake so you can monitor sync performance. The sync health page provides information about trends in volume synced to your data lake over the last 30 days and the sync history provides detailed information about the syncs preformed on the data lake over the last two days. The sync data for both reports updates in real time. |
| 6 | +The Segment Data Lakes sync history and health tabs generate reports about data syncs so you can monitor the health and performance of your data lakes. These tools provide monitoring and debugging capabilities within the Data Lakes UI, so you can identify and proactively address data sync or data pipeline failures in real time. |
7 | 7 |
|
8 | 8 | > info ""
|
9 | 9 | > This feature is currently in Public Beta. Segment’s [First-Access and Beta terms](https://segment.com/legal/first-access-beta-preview/) govern the use of this feature.
|
10 | 10 |
|
11 | 11 | ## Sync history
|
12 |
| -The Sync History table shows detailed information about the most recent syncs to the data lake. The sync history table includes the following fields: |
13 |
| -* **Sync status:** The status of the sync: either 'Success,' where all rows synced correctly, 'Partial Success,' indicating some rows synced correctly, or 'Failed,' were no rows synced correctly |
| 12 | +The sync history table shows detailed information about the 100 most recent syncs to the data lake. The sync history table includes the following fields: |
| 13 | +* **Sync status:** The status of the sync: either 'Success,' where all rows synced correctly, 'Partial Success,' indicating some rows synced correctly, or 'Failed,' where no rows synced correctly |
14 | 14 | * **Start time:** The time the sync began
|
15 | 15 | * **Duration:** How long the sync took to complete
|
16 |
| -* **Synced rows:** The number of rows that were synced with the data lake |
17 |
| -* **Notices:** Any notes about the sync: if no data is synced, the notices column will read "No data found" |
| 16 | +* **Synced rows:** The number of rows that were synced to the data lake |
| 17 | +* **Notices:** Any notes or warnings about the sync |
18 | 18 |
|
19 |
| -<!--- add screenshot here showing the sync history page ---> |
| 19 | +Selecting a row in the sync history table opens a sidebar showing the number of rows that were synced in each collection. |
20 | 20 |
|
21 |
| -Selecting a row in the Sync history table opens a tab with more information about the results of the sync and a detailed breakdown of sync duration. |
| 21 | +To access the sync history page from the Segment app, open the **My Destinations** page and select the data lake. On the data lakes settings page, select the **Sync History** tab. |
22 | 22 |
|
23 |
| -<!--- need to update the procedure for accessing the sync history/sync health pages ---> |
| 23 | +> note "" |
| 24 | +> Users cannot select when syncs occur. Syncs occur approximately every two hours. |
24 | 25 |
|
25 |
| -To access the Sync history page, open the **My Destinations** page and select the data lake. |
| 26 | +## Health |
| 27 | +The health tab provides an overview of the rows that synced to your data lake both today and each day for the last 30 days. |
26 | 28 |
|
27 |
| -## Sync health |
28 |
| -The Sync Health bar chart provides an overview of the volume of rows that synced to your data lake each day for the last 30 days. |
| 29 | +The bar chart, 'Daily Synced Rows,' shows an overview of the rows synced for each of the last 30 days. Hovering over a date shows the number of rows that were synced for that day. Selecting a date from the bar chart opens the Daily Row Volume table, which provides a breakdown of which collections synced, how many rows from each collection were synced, and the percentage of all synced rows that each collection represents. |
29 | 30 |
|
30 |
| -Selecting a bar from the bar chart opens the Daily Row Volume table, which provides a breakdown of which collections synced, how many rows from each collection were synced, and the percentage of all synced rows that each collection of properties represents. |
| 31 | +The Daily Row Volume table contains the following information: |
| 32 | +* **Collections:** The name for each collection of properties synced to the data lake |
| 33 | +* **Rows:** The number of rows synced from each collection |
| 34 | +* **% of Total:** The percentage of the total number of rows synced that each collection represents |
31 | 35 |
|
32 |
| -<!--- add screenshot here/need to update the procedure for accessing the sync history/sync health pages ---> |
| 36 | +Above the Daily Row Volume table is an overview of the total syncs for the day, showing the number of rows synced, the number of collections that synced, and the date. |
33 | 37 |
|
34 |
| -## Data Lakes Reports FAQ |
35 |
| - |
36 |
| -##### What is the maximum sync history you can view? |
37 |
| -The sync history shows the last 30 days worth of data. |
| 38 | +To access the Sync history page from the Segment app, open the **My Destinations** page and select the data lake. On the data lakes settings page, select the **Health** tab. |
38 | 39 |
|
39 |
| -##### How do Sync History and Sync Health compare? |
40 |
| -The Sync History feature shows detailed information about most recent syncs to a data lake (spanning approximately two days,) while the sync health tab shows just the volume synced to the data lake over the last thirty days. |
| 40 | +## Data Lakes Reports FAQ |
| 41 | +##### How long is a data point available? |
| 42 | +The health tab shows an aggregate view of the last 30 days worth of data, while the sync history retains only the last 100 syncs. |
41 | 43 |
|
42 |
| -##### How can I select which collections and properties are synced with the data lake? |
43 |
| -You can select what collections and properties are synced with the data lake by updating the settings on the data lakes destination page. |
| 44 | +##### How do sync history and health compare? |
| 45 | +The sync history feature shows detailed information about the most recent 100 syncs to a data lake, while the health tab shows just the volume of rows synced to the data lake over the last 30 days. |
44 | 46 |
|
45 |
| -To access the settings page, select the Data Lakes destination from the My Destinations page. On the Warehouse Overview page, in the schema table, select the data lake you'd like to update. On the Sync History page, select the Settings tab. In the table, select the connections and properties you'd like to sync to the data lake. |
| 47 | +##### What timezone is the time and date information in? |
| 48 | +All dates and times on the sync history and health pages are in the user's local time. |
46 | 49 |
|
| 50 | +##### When does the data update? |
| 51 | +The sync data for both reports updates in real time. |
0 commit comments