Skip to content

feat: Add tracing regression tests #15673

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Apr 10, 2025

Conversation

geoffreyclaude
Copy link
Contributor

Which issue does this PR close?

Rationale for this change

This PR adds smoke tests to verify that the JoinSetTracer is correctly injected into DataFusion. These tests ensure that any changes to the core task spawning mechanism—which might break the tracing functionality—are caught early.

What changes are included in this PR?

  • Added integration tests that run a SQL query (with aggregation and Parquet file reads) to force task spawning.
  • Tests verify that when the tracer is initialized, all tasks can be traced back to the root.
  • An alternative test confirms that without the tracer, the query fails as expected, indicating missing tracing.

Are these changes tested?

Yes. The new tests run automatically in CI and serve as a regression check for the task spawning and tracing mechanism in DataFusion.

Are there any user-facing changes?

No, these changes only affect internal testing and do not introduce any user-facing modifications.

@github-actions github-actions bot added the core Core DataFusion crate label Apr 10, 2025
@geoffreyclaude geoffreyclaude force-pushed the feat/tracing_tests branch 2 times, most recently from 113ead7 to d3a171b Compare April 10, 2025 14:58
Copy link
Contributor

@gabotechs gabotechs left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍 looking fine to me

@geoffreyclaude geoffreyclaude force-pushed the feat/tracing_tests branch 2 times, most recently from c5da1f8 to aa7bb2e Compare April 10, 2025 15:09
Copy link
Contributor

@alamb alamb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

THis is great -- thank you @geoffreyclaude and @gabotechs ❤️

@alamb alamb merged commit 8a0b21b into apache:main Apr 10, 2025
27 checks passed
nirnayroy pushed a commit to nirnayroy/datafusion that referenced this pull request May 2, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
core Core DataFusion crate
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add tracing regression smoke tests
3 participants