Skip to content

Conversation

@fvankrieken
Copy link
Contributor

Just playing around with this, making a PR so I'm reminded to either wrap this up or archive this effort in some other way.

The duckdb being used to load is running into some issue at the moment, just thought it might speed things up for these big parquet files to avoid reading them into memory before loading to db via pandas

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants