Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tweaks to reduce billing costs #54

Open
ItsMeBrianD opened this issue Jul 11, 2024 · 0 comments
Open

Tweaks to reduce billing costs #54

ItsMeBrianD opened this issue Jul 11, 2024 · 0 comments

Comments

@ItsMeBrianD
Copy link
Member

image

The majority of our (admittedly small) backblaze bill is coming from S3 Scan operations, which is caused by building pages

We can probably be smarter about how we are building the pages based on the queries that were actually run. This also makes it easier to remove datasets that are no longer used (e.g. Player Stats is no longer updating), because they will no longer update.

We also want to make sure that we aren't storing versions of the data files in backblaze because we have tar archives for previous versions of the datasets available on the archives page. This will help keep our storage level much flatter than it would be otherwise

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant