Skip to content

Conversation

jrpeck1989
Copy link
Contributor

@jrpeck1989 jrpeck1989 commented Aug 22, 2025

Summary

A documentation piece/guide on how to use the Failed Events In The Warehouse events table to recover failing events back into your good events table. Covers the following:

  • Finding and identifying the failing events of interest
  • Reconstructing the events to a valid format using SQL
  • Generating a script to programmatically re-insert the newly fixed rows back into the good events table

Things NOT covered in this guide:

  • Only BigQuery for the time being, as it has structured columns which make this slightly easier (Snowflake to follow in an upcoming PR)
  • It does not cover the data modelling considerations (i.e. working with the newly recovered rows in the snowplow_unified package
  • This guide only covers one type of recovery - an entity sent with an incorrect schema version - but the pattern is very similar for any kind of failure

… SQL. Starting with one failure type, and for one data warehouse (BigQuery)
Copy link

netlify bot commented Aug 22, 2025

Deploy Preview for snowplow-docs ready!

Name Link
🔨 Latest commit c1d436d
🔍 Latest deploy log https://app.netlify.com/projects/snowplow-docs/deploys/68a8985e228b0d000836c1fc
😎 Deploy Preview https://deploy-preview-1378--snowplow-docs.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

@jrpeck1989 jrpeck1989 marked this pull request as ready for review August 25, 2025 19:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant