You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Through the introduction of #807 we have introduced large_* types in the parquet files, which cannot be read using an earlier version of PyIceberg: TypeError: Unsupported type: large_string
Although the parquet types are the same, there must be an encoding detail that instructs pyarrow to read these as large_* types on read.
Therefore, instead of defaulting to large_* types, we should default the types to small types on write.