You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The Arrow version didn't match the new version in DataFusion, and the Java integration test was failing because the output file from the compaction is not readable from Java. It looks like the schema in the output file has the row keys changed to optional. This test was passing before the DataFusion upgrade.
The SketchUDF column (row key 0) is now being marked as optional, instead of required. Disabling the UDF avoids the bug. Why is the "is_nullable" output no longer being used properly?
Background
The following Dependabot upgrade failed for a couple of reasons:
The Arrow version didn't match the new version in DataFusion, and the Java integration test was failing because the output file from the compaction is not readable from Java. It looks like the schema in the output file has the row keys changed to optional. This test was passing before the DataFusion upgrade.
Description
We'd like to upgrade DataFusion to version 45.
Analysis
It's not clear what may have caused the schema change from the changelog for DataFusion:
https://github.com/apache/datafusion/blob/main/dev/changelog/45.0.0.md
The text was updated successfully, but these errors were encountered: