List view
SQLFlow aims to provide an ecosystem for making high value stream processing pipelines. SQLFlow needs to unlock the flexibility and pluggability that duckdb provides with analytics, which includes, attaching databases, joining with data from other datastores, control over the execution environment (memory vs disk persistence). The hypothesis is that SQLFlow becomes more valuable the more data and richer context that it can tap into. ETLing and transforming data in flight is good, joining with rich business data and ML data allows for enriching and doing high value things with the streaming data.
No due date•9/9 issues closedDemonstrate how SQLFlow can be leveraged to consume the bluesky firehose: - Add support for websocket source - Show Enriching use case - Show Tumbling Window Aggregation (Counting Use Case) - Show aggregation use case (buffered manage table) https://www.linkedin.com/pulse/learning-sqlflow-using-bluesky-firehose-turbolytics-io4je
No due date•4/4 issues closedDev/POC release of sql-flow. Just enough functionality to run it for real and kick the tires.
No due date•4/4 issues closed