Skip to content

feat: validate_no_new_added_delete_files #2176

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

gabeiglio
Copy link
Contributor

@gabeiglio gabeiglio commented Jul 6, 2025

Closes #1930

Rationale for this change

Add _validate_no_new_delete_files and dependencies like DeleteFileIndex, PartitionMap that are needed for the validation

Are these changes tested?

Added test for the validation, DeleteFileIndex, and PartitionMap

Are there any user-facing changes?

No

@gabeiglio gabeiglio marked this pull request as ready for review July 8, 2025 20:14
Copy link
Collaborator

@sungwy sungwy left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi @gabeiglio - thank you for working on this PR, and sorry for the delayed review!

I've just started reviewing the proposed changes, and will continue to add some more comments this week.

I think this is a great start! I've added some comments regarding the PartitionMap class by referring to the Java implementation.

@gabeiglio gabeiglio force-pushed the delete-file-index branch from 0c82650 to c0c9236 Compare July 17, 2025 16:58
@gabeiglio
Copy link
Contributor Author

gabeiglio commented Jul 17, 2025

@sungwy thanks for the review! applied the changes.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Support Concurrency Safety Validation: Implement validateNoNewDeleteFiles
2 participants