r.2025.03.11.0

Summary:

Dependency upgrades, removal of intermediate librdkafka from the ARM image, Azure disk capacity scraping, a fix for incorrect delta values in cost reports, and improved error handling for IntegrityError in the ocppvc table.

What's Changed

• remove intermediate librdkafka from arm image by @maskarb in #5530
• Bump the ci-dependencies group with 3 updates by @dependabot in #5524
• [COST-5833] Fix incorrect delta values in previous month cost reports by @bacciotti in #5525
• Dependency update by @myersCody in #5533
• [COST-5083] Scrape azure disk capacities by @myersCody in #5532
• upgrade watchtower by @maskarb in #5534
• [COST-5772] gracefully handle IntegrityError on ocppvc table by @djnakabaale in #5528

Full Changelog: r.2025.03.04.0...r.2025.03.11.0

r.2025.03.04.0

Summary:

• Additional support for OCP virtual machines costs - platform distribution and storage
• Add node core month metric to cost models.
• Improvements to polling logic.
• Bug fixes.

What's Changed

• Fix EC2 attribute error by @myersCody in #5510
• [COST-5839] - Switch to dynamic batch sizing for polling by @lcouzens in #5513
• [COST-5890] - Adding Node core month to cost model by @lcouzens in #5509
• [COST-5919] Update OCP VMs provider map by @bacciotti in #5512
• update local trino to 471 by @djnakabaale in #5519
• Bump the ci-dependencies group with 3 updates by @dependabot in #5514
• [COST-5923] OCP virtual machine distributed cost SQL by @maskarb in #5517
• [COST-5887] - Return source status by @lcouzens in #5518
• Fix tag not existing error for OCP by @myersCody in #5521
• [COST-5662] Add OpenShift virtual machine storage support by @djnakabaale and @myersCody in #5515
• [COST-3663] db upgrade prep by @maskarb in #5523
• Add default polling hour count by @lcouzens in #5527
• Add default polling count to base yaml by @lcouzens in #5529
• [COST-3663] upgrade to pg16 by @maskarb in #5522

Full Changelog: r.2025.02.24.0...r.2025.03.04.0

r.2025.02.24.0

Summary:

Managed table work, hive migration, and dependency updates.

What's Changed

• [COST-5551] enable Glue Data Catalog in pr_check/daily smokes by @maskarb in #5478
• [COST-5875] Clean up new managed tables when a source is deleted by @myersCody in #5497
• [COST-5898] update to ubuntu-latest for github actions by @maskarb in #5498
• [COST-5551] add config for local Glue Data Catalog utilization by @maskarb in #5471
• [COST-5866] Add row_uuid to parquet files by @myersCody in #5500
• improve sql filtering logic on the masu trino endpoint by @djnakabaale in #5502
• [COST-5906] do not deploy hive to ephemeral by @maskarb in #5505
• update trino and hive config by @maskarb in #5501
• [COST-5432] - Add RI to rhel metering sql by @lcouzens in #5504
• Bump step-security/harden-runner from 2.10.4 to 2.11.0 in the ci-dependencies group by @dependabot in #5506
• [COST-5897] Remove unused columns from managed flow by @myersCody in #5503
• Fix deduplication of csi storage on managed flow by @myersCody in #5507
• Bump dependencies by @myersCody in #5511

Full Changelog: r.2025.02.12.0...r.2025.02.24.0

r.2025.02.12.0

Summary:

• Add new pipeline code for managed table summary flow for (OCP on - AWS, GCP, Azure)
• Work to migrated to AWS Glue from Hive metastore
• Improved Azure failed to create integration error messages

What's Changed

• COST-5137 Azure managed summary by @myersCody in #5475
• COST-5820 Return Azure errors to UI by @djnakabaale in #5474
• fix secret template by @maskarb in #5482
• Bump the ci-dependencies group across 1 directory with 2 updates by @dependabot in #5483
• COST-5137 Initial managed summary tasks rework by @lcouzens in #5469
• Use local settings in ephemeral daily job to disable Ibutsu by @esebesto in #5485
• COST-5860 - hive data migration script and CJI by @maskarb in #5480
• COST-5860 drop assume-role requirement by @maskarb in #5487
• COST-5860 remove AWS_ASSUME_ROLE_ARN from parse args by @maskarb in #5488
• COST-5860 add progress to migration script by @maskarb in #5489
• Revert "Use local settings in ephemeral daily job to disable Ibutsu" by @esebesto in #5491
• COST-5137 - Fix OCP-Azure-Managed sql + report_data masu endpoint by @lcouzens in #5486
• COST-5862 OCP on GCP managed summary by @myersCody in #5479
• COST-5886 update kafka status check by @maskarb in #5494
• Updates to the managed flow by @myersCody in #5496
• Update env example by @myersCody in #5490
• COST-5861 OCP on AWS managed population by @myersCody in #5484

Full Changelog: r.2025.02.03.0...r.2025.02.12.0

r.2025.02.03.0

Summary:

Added defaults for the load-test-customer-data script, updated Codecov action in CI dependencies, ensured one expiration task per provider type, integrated AWS Glue Data Catalog for PR smoke tests, fixed the daily main smoke tests job, disabled Glue in PR checks, reverted trino_schema_prefix, and added a secrets template.

What's Changed

• add defaults for load-test-customer-data script by @maskarb in #5468
• Bump codecov/codecov-action from 5.1.2 to 5.3.1 in the ci-dependencies group by @dependabot in #5467
• [COST-5851] one expiration task per provider_type by @maskarb in #5432
• [COST-5551] utilize AWS Glue Data Catalog for PR smoke tests by @maskarb in #5461
• fix daily main smokes job by @maskarb in #5472
• reversions - disable Glue in PR checks by @maskarb in #5476
• revert trino_schema_prefix by @maskarb in #5477
• add secrets template by @maskarb in #5454

Full Changelog: r.2025.01.27.0...r.2025.02.03.0

r.2025.01.27.0

Summary:

• Prepare to migrate from Hive to AWS Glue.
• Various SQL improvements.
• Dependency updates.

What's Changed

• Divide unattributed storage cost by # of clusters utilizing disk by @myersCody in #5447
• dependency update by @maskarb in #5456
• upgrade minio by @maskarb in #5459
• pin boto to 1.35.90 by @lcouzens in #5457
• Bump the ci-dependencies group with 2 updates by @dependabot in #5455
• [COST-5551] prep for AWS Glue Data Catalogue migration by @maskarb in #5449
• undo POSTGRES_SQL_SERVICE_HOST/PORT in docker-compose by @maskarb in #5462
• Add MINIO_ENDPOINT to env by @myersCody in #5463
• [COST-5796] correctly log exception outside log_json function by @djnakabaale in #5448
• add polling timestamp to masu sources endpoint by @maskarb in #5437
• [COST-5565] - Adding inserts for missed column entries by @lcouzens in #5464
• [COST-5773] Handle multiple resource for OCP on GCP managed flow by @myersCody in #5427
• more prep for glue by @maskarb in #5465
• update dev scripts by @maskarb in #5466

Full Changelog: r.2025.01.20.0...r.2025.01.27.0

r.2025.01.20.0

Summary:

• AWS amortised cost sql enhancement
• OCP on Cloud sql bug fix for multi-worker pipelines
• CICD improvements

What's Changed

• COST-5780 Moving the build pipeline to project-koku/koku-ci repo by @bacciotti in #5445
• Fix amortised cost calculations by @lcouzens in #5446
• use quay api to see if tag is available by @maskarb in #5451
• remove ephemeral secrets from clowdapp by @maskarb in #5452
• Add missing where clause to temp table cte by @lcouzens in #5453

Full Changelog: r.2025.01.15.0...r.2025.01.20.0

r.2025.01.15.0

Summary:

• Fixing OCP on AWS/Azure sql to work correctly with multiple workers
• Handling customer does not exist exception
• General code cleanup

What's Changed

• fix ephemeral bucket names by @maskarb in #5440
• add celery task id chain by @maskarb in #5441
• remove some unused env variables by @maskarb in #5444
• [COST-5796] handle Customer.DoesNotExist exception by @djnakabaale in #5431
• adding year month to disk join where clause by @lcouzens in #5443

Full Changelog: r.2025.01.13.0...r.2025.01.15.0

r.2025.01.13.0

Summary:

• Dependency updates
• Bug fix for OCP on Cloud matching sql

What's Changed

• add dependabot config by @maskarb in #5438
• Bump the ci-dependencies group with 8 updates by @dependabot in #5439
• missing where clause by @maskarb in #5442

Full Changelog: r.2025.01.08.0...r.2025.01.13.0

r.2025.01.08.0

Summary:

• Fix small bug in tag matching logic
• Add new unleash flag to skip trino tag matching
• Other dependency updates

What's Changed

• Disable parallel testing in pr-checks and daily job by @esebesto in #5428
• COST-5565 - Fix bug in old tag matching logic by @lcouzens in #5429
• COST-5784 dependency update by @maskarb in #5433
• chore(deps): update konflux references by @red-hat-konflux in #5430
• COST-5793 remove croniter dependency by @maskarb in #5435
• Add unleash flag to skip trino tag matched get logic by @lcouzens in #5436

Full Changelog: r.2024.12.17.0...r.2025.01.08.0