Skip to content

Comments

fix: ng prepare data metrics conflict#738

Open
cmunley1 wants to merge 1 commit intomainfrom
cmunley1/data-prep
Open

fix: ng prepare data metrics conflict#738
cmunley1 wants to merge 1 commit intomainfrom
cmunley1/data-prep

Conversation

@cmunley1
Copy link
Contributor

issue described in #736

collate_samples writes metrics without the dataset config metadata eg name type jsonl_fpath while validate_samples_and_aggregate_emtrics wrote those with metadata , causing a conflict. this mirrors what the validate step does to merge the metadata before the conflict check

Signed-off-by: cmunley1 <cmunley@nvidia.com>
@copy-pr-bot
Copy link

copy-pr-bot bot commented Feb 20, 2026

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@cwing-nvidia cwing-nvidia linked an issue Feb 20, 2026 that may be closed by this pull request
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

bug: ng_prepare_data metrics conflict

1 participant