Skip to content

Compute column statistics min & max for FilterExec and beyond #8155

@NGA-TRAN

Description

@NGA-TRAN

Is your feature request related to a problem or challenge?

In IOx we use columns statistics min and max in an optimizer rule however the statistics of column min and max are lost after going through filter (and may be many other operators).

This ticket is to compute the Column statistics in a conservative way.

Describe the solution you'd like

Column min/max of filter will be the same but turns from Exact to InExact.

When #8078 is implemented, The InExact in this case will become Conservative or the like

While working on FilterExec, I will see if I can do the similarly for other operators

Describe alternatives you've considered

No response

Additional context

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions