Skip to content

Sennendog/data_tech_stacks

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

50 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

data_tech_stacks

Showcases for different data tech stacks

tf-gcp-lakehouse

Data Lakehouse architecture with storage/compute separation and Apache Iceberg open storage format, fully provisioned using Terraform. Build using GCP-native serverless services (such as Dataproc and BigQuery/BigLake) for an event-driven, scalable ingestion.

dc-api-beam-duckdb

API-callable Data Pipeline ingesting data from another API (open meeo) using Apache Beam, storing the results in a DuckDB database, deployable as container images via docker compose.

About

Showcases for different data tech stacks

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors