You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
[SPARK-50665][SQL] Substitute LocalRelation with ComparableLocalRelation in NormalizePlan
### What changes were proposed in this pull request?
Substitute `LocalRelation` with `ComparableLocalRelation` in `NormalizePlan`.
`ComparableLocalRelation` has `Seq[Seq[Expression]]` instead of `Seq[InternalRow]`. The conversion happens through `Literal`s.
### Why are the changes needed?
`LocalRelation`'s data field is incomparable if it contains maps, because `ArrayBasedMapData` doesn't define `equals`: apache#13847
### Does this PR introduce _any_ user-facing change?
No. This is to compare logical plans in the single-pass Analyzer.
### How was this patch tested?
N/A
### Was this patch authored or co-authored using generative AI tooling?
copilot.nvim.
Closesapache#49287 from vladimirg-db/vladimirg-db/normalize-local-relation.
Authored-by: Vladimir Golubev <[email protected]>
Signed-off-by: Wenchen Fan <[email protected]>
0 commit comments