Skip to content

Commit ce5470d

Browse files
committed
Enable reading string view by default from Parquet
1 parent 389f7f7 commit ce5470d

File tree

2 files changed

+3
-3
lines changed

2 files changed

+3
-3
lines changed

datafusion/common/src/config.rs

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -382,7 +382,7 @@ config_namespace! {
382382

383383
/// (reading) If true, parquet reader will read columns of `Utf8/Utf8Large` with `Utf8View`,
384384
/// and `Binary/BinaryLarge` with `BinaryView`.
385-
pub schema_force_view_types: bool, default = false
385+
pub schema_force_view_types: bool, default = true
386386

387387
// The following options affect writing to parquet files
388388
// and map to parquet::file::properties::WriterProperties

datafusion/sqllogictest/test_files/information_schema.slt

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -200,7 +200,7 @@ datafusion.execution.parquet.metadata_size_hint NULL
200200
datafusion.execution.parquet.pruning true
201201
datafusion.execution.parquet.pushdown_filters false
202202
datafusion.execution.parquet.reorder_filters false
203-
datafusion.execution.parquet.schema_force_view_types false
203+
datafusion.execution.parquet.schema_force_view_types true
204204
datafusion.execution.parquet.skip_metadata true
205205
datafusion.execution.parquet.statistics_enabled page
206206
datafusion.execution.parquet.write_batch_size 1024
@@ -290,7 +290,7 @@ datafusion.execution.parquet.metadata_size_hint NULL (reading) If specified, the
290290
datafusion.execution.parquet.pruning true (reading) If true, the parquet reader attempts to skip entire row groups based on the predicate in the query and the metadata (min/max values) stored in the parquet file
291291
datafusion.execution.parquet.pushdown_filters false (reading) If true, filter expressions are be applied during the parquet decoding operation to reduce the number of rows decoded. This optimization is sometimes called "late materialization".
292292
datafusion.execution.parquet.reorder_filters false (reading) If true, filter expressions evaluated during the parquet decoding operation will be reordered heuristically to minimize the cost of evaluation. If false, the filters are applied in the same order as written in the query
293-
datafusion.execution.parquet.schema_force_view_types false (reading) If true, parquet reader will read columns of `Utf8/Utf8Large` with `Utf8View`, and `Binary/BinaryLarge` with `BinaryView`.
293+
datafusion.execution.parquet.schema_force_view_types true (reading) If true, parquet reader will read columns of `Utf8/Utf8Large` with `Utf8View`, and `Binary/BinaryLarge` with `BinaryView`.
294294
datafusion.execution.parquet.skip_metadata true (reading) If true, the parquet reader skip the optional embedded metadata that may be in the file Schema. This setting can help avoid schema conflicts when querying multiple parquet files with schemas containing compatible types but different metadata
295295
datafusion.execution.parquet.statistics_enabled page (writing) Sets if statistics are enabled for any column Valid values are: "none", "chunk", and "page" These values are not case sensitive. If NULL, uses default parquet writer setting
296296
datafusion.execution.parquet.write_batch_size 1024 (writing) Sets write_batch_size in bytes

0 commit comments

Comments
 (0)