Skip to content

Enable sort query fuzzing with limited memory #15517

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
4 tasks
Tracked by #16065
2010YOUY01 opened this issue Apr 1, 2025 · 1 comment
Open
4 tasks
Tracked by #16065

Enable sort query fuzzing with limited memory #15517

2010YOUY01 opened this issue Apr 1, 2025 · 1 comment
Labels
enhancement New feature or request

Comments

@2010YOUY01
Copy link
Contributor

2010YOUY01 commented Apr 1, 2025

Is your feature request related to a problem or challenge?

A new sort query fuzzer for out-of-core sorting has been added in #15501.
However, the memory limit is not enabled because there are known issues that cause external sort queries to fail, resulting in the fuzzer consistently failing. Once these issues are resolved, we can enable the memory limit configuration in the fuzzer.

After this ticket is resolved: #14748
The following update can be made to the sort query fuzzer to increase coverage for memory-limited sorts.

  • Support generating queries with arbitrary number of ORDER BY clauses (Currently it's limited to be smaller than number of projected columns)
  • Enable special type columns like utf8_low to be used in ORDER BY clauses
  • Enable memory limiting functionality in the fuzzer runner
  • Increase the fuzzing throughput: now it spent a lot of time verifying the results (by formatting all the sorted results), we can make it more efficient by splitting the test into smaller tests to run in parallel.

Describe the solution you'd like

No response

Describe alternatives you've considered

No response

Additional context

No response

@2010YOUY01
Copy link
Contributor Author

Here is an additional enhancement: setup MemoryExec with existing sort order, to trigger the code path added in #15563

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant