Repository navigation

Add data-availability triggering for TableTriggers - #237

Open

ryannedolan wants to merge 23 commits into

mainfrom

tabletrigger-input-watermarks

Open

Add data-availability triggering for TableTriggers#237
ryannedolan wants to merge 23 commits into
mainfrom
tabletrigger-input-watermarks

Commits on Jul 1, 2026
- Add data-availability triggering for TableTriggers
  
  ryannedolan
  and
  Copilot
  committed
  88ceffc
Commits on Jul 13, 2026
Commits on Jul 14, 2026
- Fix docs churn
  ryannedolan
  committed
  4fb446a
- Hang input-watermark capability off the Database schema; drop the provider SPI
  
  ryannedolan
  and
  Copilot
  committed
  2180a61
- Use kind for local testing instead of Docker Desktop
  ryannedolan
  committed
  5e31575
- Create kind cluster in one place
  ryannedolan
  committed
  f1f41ff
- Rename input "watermark" -> "frontier" (InputWatermarkSource -> InputFrontierSource)
  
  ryannedolan
  and
  Copilot
  committed
  9dacf01
- Document Kafka frontier as best-effort; clarify that repair licenses optimism
  
  ryannedolan
  and
  Copilot
  committed
  a706818
Commits on Jul 15, 2026
- Make backfills plain one-off Jobs; drop backfill tracking from the operator
  
  ryannedolan
  and
  Copilot
  committed
  4a55d90
- Make FIRE a typed Trigger.Fire instead of stringly-typed options
  
  ryannedolan
  and
  Copilot
  committed
  db6bb91
- Kafka: bounded out-of-orderness watermark (min - B, idle partitions excluded)
  
  ryannedolan
  and
  Copilot
  committed
  6ed5275
- Fix misleading in-flight FIRE error: pause/resume does not abort
  
  ryannedolan
  and
  Copilot
  committed
  f3dc222
- CREATE TRIGGER: fail loudly when the JobTemplate renders to empty yaml
  
  ryannedolan
  and
  Copilot
  committed
  bf32aa1
- CREATE TRIGGER: defer fire-window vars through the JobTemplate render
  
  ryannedolan
  and
  Copilot
  committed
  3c5d53a
- Trigger fire: render an empty window start on the first fire; fail clearly on unresolved vars
  
  ryannedolan
  and
  Copilot
  committed
  99a2c3b
- Fix implicit offline trigger: default optional online.table.name in retl-job-template
  
  ryannedolan
  and
  Copilot
  committed
  6d40caa
- Update logical-graph.id: offline trigger now renders a real Job
  
  ryannedolan
  and
  Copilot
  committed
  163f6dd
- FIRE backfill: allow a windowed fire with no watermark (paused/never-run triggers)
  
  ryannedolan
  and
  Copilot
  committed
  f3a5c07
- Update k8s-trigger-fire integration script for watermark-optional backfills
  
  ryannedolan
  and
  Copilot
  committed
  199cbaa
Commits on Jul 18, 2026
- Merge branch 'main' into tabletrigger-input-watermarks
  ryannedolan
  authored
  4cdfc90

Navigation Menu

Repository navigation

Add data-availability triggering for TableTriggers - #237

Add data-availability triggering for TableTriggers#237
ryannedolan wants to merge 23 commits into
mainfrom
tabletrigger-input-watermarks

Commits on Jul 1, 2026

Add data-availability triggering for TableTriggers

Commits on Jul 13, 2026

Merge branch 'main' into tabletrigger-input-watermarks

Fix stale integration test

Merge branch 'tabletrigger-input-watermarks' of personal:linkedin/Hoptimator into tabletrigger-input-watermarks

Fix mismatched integration test

Commits on Jul 14, 2026

Fix docs churn

Hang input-watermark capability off the Database schema; drop the provider SPI

Use kind for local testing instead of Docker Desktop

Create kind cluster in one place

Rename input "watermark" -> "frontier" (InputWatermarkSource -> InputFrontierSource)

Document Kafka frontier as best-effort; clarify that repair licenses optimism

Commits on Jul 15, 2026

Make backfills plain one-off Jobs; drop backfill tracking from the operator

Make FIRE a typed Trigger.Fire instead of stringly-typed options

Kafka: bounded out-of-orderness watermark (min - B, idle partitions excluded)

Fix misleading in-flight FIRE error: pause/resume does not abort

CREATE TRIGGER: fail loudly when the JobTemplate renders to empty yaml

CREATE TRIGGER: defer fire-window vars through the JobTemplate render

Trigger fire: render an empty window start on the first fire; fail clearly on unresolved vars

Fix implicit offline trigger: default optional online.table.name in retl-job-template

Update logical-graph.id: offline trigger now renders a real Job

FIRE backfill: allow a windowed fire with no watermark (paused/never-run triggers)

Update k8s-trigger-fire integration script for watermark-optional backfills

Commits on Jul 18, 2026

Merge branch 'main' into tabletrigger-input-watermarks