Search results

[SPARK-51426][PYTHON][SQL] Fix 'Setting metadata to empty dict does not work'

CONNECT

PYTHON

SQL

Status: Open (in progress).

apache/sparknumber 52378

#52378 In apache/spark;

· petern48 opened on Sep 18, 2025

[SPARK-53626][DOCS] Add invalid mixed-type operations to ANSI migration guide

DOCS

PYTHON

Status: Open (in progress).

apache/sparknumber 52376

#52376 In apache/spark;

· xinrong-meng opened on Sep 17, 2025

[WIP] Transition PySpark default to bytes instead of bytesarray

AVRO

CORE

PYTHON

SQL

Status: Draft (not ready).

apache/sparknumber 52370

#52370 In apache/spark;

· craiuconstantintiberiu opened on Sep 17, 2025

[SPARK-53591][SDP] Simplify Pipeline Spec Pattern Glob Matching

CONNECT

PYTHON

SQL

Status: Open (in progress).

apache/sparknumber 52348

#52348 In apache/spark;

· JiaqiWang18 opened on Sep 15, 2025

[SPARK-53578][CONNECT] Simplify data type handling in LiteralValueProtoConverter

CONNECT

ML

PYTHON

SQL

Status: Open (in progress).

apache/sparknumber 52342

#52342 In apache/spark;

· heyihong opened on Sep 15, 2025

[SPARK-53593][SDP] Add response field for DefineDataset and DefineFlow RPC

CONNECT

PYTHON

SQL

Status: Open (in progress).

apache/sparknumber 52328

#52328 In apache/spark;

· cookiedough77 opened on Sep 12, 2025

[SPARK-53592][PYTHON] Make <code>@udf</code> support vectorized UDF

BUILD

CONNECT

PYTHON

SQL

Status: Open (in progress).

apache/sparknumber 52323

#52323 In apache/spark;

· zhengruifeng opened on Sep 12, 2025

[SPARK-53562][PYTHON] Limit Arrow batch sizes in <code>applyInArrow</code> and <code>applyInPandas</code>

CONNECT

CORE

PYTHON

SQL

Status: Open (in progress).

apache/sparknumber 52303

#52303 In apache/spark;

· zhengruifeng opened on Sep 11, 2025

[SPARK-53429][PYTHON] Support Direct Passthrough Partitioning in the PySpark Dataframe API

CONNECT

PYTHON

SQL

Status: Open (in progress).

apache/sparknumber 52295

#52295 In apache/spark;

· shujingyang-db opened on Sep 10, 2025

[EXPERIMENT][DO NOT MERGE] Automated pyspark sdp build workflow

CORE

INFRA

PYTHON

Status: Open (in progress).

apache/sparknumber 52276

#52276 In apache/spark;

· AnishMahto opened on Sep 9, 2025

Catch InterruptedIOException and ClosedByInterruptException in TransformWithStateInPySparkStateServer to avoid worker crash

PYTHON

SQL

STRUCTURED STREAMING

Status: Draft (not ready).

apache/sparknumber 52275

#52275 In apache/spark;

· jiateoh opened on Sep 8, 2025

Tiny doc wording clarity

DOCS

PYTHON

SQL

Status: Open (in progress).

apache/sparknumber 52273

#52273 In apache/spark;

· hutch3232 opened on Sep 8, 2025