Skip to content

Releases: apache/spark-connect-swift

0.4.0

01 Oct 16:34
@dongjoon-hyun dongjoon-hyun
0.4.0
07a276e
This commit was signed with the committer’s verified signature.
dongjoon-hyun Dongjoon Hyun
GPG key ID: EDA00CE834F0FC5C
Verified
Learn about vigilant mode.

Choose a tag to compare

View all tags
0.4.0 Latest
Latest

Apache Spark™ Connect Client for Swift language is a subproject of Apache Spark and aims to provide Swift implementation of Spark Connect. 0.4.0 is the fourth release of Apache Spark Connect for Swift client. This is still experimental.

Website

https://apache.github.io/spark-connect-swift/

Swift Package Index

https://swiftpackageindex.com/apache/spark-connect-swift

Documentation

https://swiftpackageindex.com/apache/spark-connect-swift/0.4.0/documentation/sparkconnect

Full Changelog

0.3.0...0.4.0

Resolved Issues

  • [SPARK-52390] Upgrade gRPC Swift libraries to grpc-swift-2-based ones
  • [SPARK-52436] Update CIs to use actions/checkout@v4 consistently
  • [SPARK-52465] Update .asf.yaml with new README.md link
  • [SPARK-52472] Regenerate Spark Connect-generated Swift source code with protoc-gen-grpc-swift-2
  • [SPARK-52473] Limit GHA job execution time to up to 20 minutes
  • [SPARK-52522] Reapply swift format
  • [SPARK-52523] Update arrow-swift code for Timestamp
  • [SPARK-52524] Support Timestamp type
  • [SPARK-52627] Improve SQLTests to handle userName
  • [SPARK-52629] Remove ArrowReaderHelper.isNestedType
  • [SPARK-52631] Update Spark Connect-generated Swift source code
  • [SPARK-52658] Add Swift 6.2 build test CI
  • [SPARK-52678] Update ArrowReader.swift with GH-54
  • [SPARK-52742] Support createDataflowGraph
  • [SPARK-52743] Support startRun
  • [SPARK-52744] Add MacOS integration test with Apache Spark 4.1.0-preview1 RC1
  • [SPARK-52748] Support defineDataset
  • [SPARK-52756] Support defineFlow
  • [SPARK-52758] Support defineSqlGraphElements
  • [SPARK-52775] Add time SQL test and answer file
  • [SPARK-52847] Add ConstraintTests
  • [SPARK-52913] Upgrade grpc-swift-2 to 2.1.0
  • [SPARK-53370] Upgrade gRPC Swift Protobuf to 2.1.1
  • [SPARK-53371] Upgrade gRPC Swift NIO Transport to 2.1.0
  • [SPARK-53373] Use nightly-6.2-amazonlinux2 for Swift 6.2 CI
  • [SPARK-53374] Use release build in Apache Spark 4.1.0-preview1 testing
  • [SPARK-53375] Remove downloaded tgz files
  • [SPARK-53376] Run Swift build first before running test
  • [SPARK-53379] Add integration-test-ubuntu GitHub Action job
  • [SPARK-53380] Add SPARK_LOCAL_IP env variable to MacOS-based integration test jobs
  • [SPARK-53404] Make Build step to verify test compilation too
  • [SPARK-53463] Upgrade actions/checkout to v5
  • [SPARK-53465] Use 4.1.0-preview1 instead of RC1
  • [SPARK-53466] Use Spark 4.0.1 instead of 4.0.0
  • [SPARK-53467] Improve merge_spark_pr.py to accept PR numbers as a CLI argument
  • [SPARK-53477] Add integration-test-ubuntu-spark41 GitHub Action job
  • [SPARK-53569] Use Iceberg 1.10 for Spark 3-based Iceberg integration test
  • [SPARK-53570] Update integration-test-token to use Spark 4.1.0-preview1
  • [SPARK-53571] Add integration-test-mac-spark4-iceberg GitHub Action job
  • [SPARK-53683] Use Spark 3.5.7 for Spark 3 integration tests
  • [SPARK-53685] Upgrade gRPC Swift NIO Transport to 2.1.1
  • [SPARK-53697] Use 4.1.0-preview2 for integration-test-(mac-spark41|token) GitHub Action jobs
  • [SPARK-53698] Support Swift 6.2
  • [SPARK-53699] Add MacOS 26 GitHub Action job
  • [SPARK-53724] Update Examples and documentations to use 4.0.1
  • [MINOR] Update gRPC Swift-related library links in README.md
Assets 2
Loading

0.3.0

04 Jun 15:21
@dongjoon-hyun dongjoon-hyun
0.3.0
60fa9c4
This commit was signed with the committer’s verified signature.
dongjoon-hyun Dongjoon Hyun
GPG key ID: EDA00CE834F0FC5C
Verified
Learn about vigilant mode.

Choose a tag to compare

View all tags
0.3.0

Apache Spark™ Connect Client for Swift language is a subproject of Apache Spark and aims to provide Swift implementation of Spark Connect. 0.3.0 is the third release of Apache Spark Connect for Swift client. This is still experimental.

Website

https://apache.github.io/spark-connect-swift/

Swift Package Index

https://swiftpackageindex.com/apache/spark-connect-swift

Documentation

https://swiftpackageindex.com/apache/spark-connect-swift/0.3.0/documentation/sparkconnect

Full Changelog

0.2.0...0.3.0

Resolved Issues

  • [SPARK-52220] Update README.md and integration test with Apache Spark 4.0.0 RC7
  • [SPARK-52247] Upgrade gRPC Swift Protobuf to 1.3.0
  • [SPARK-52248] Use exact versions of dependency
  • [SPARK-52268] Add variant SQL test and answer file
  • [SPARK-52269] Add cast SQL test and answer file
  • [SPARK-52271] Upgrade Spark to 4.0.0 in CIs and docs
  • [SPARK-52274] Update ArrowReader/Writer with GH-44910
  • [SPARK-52277] Upgrade Docker tags to 4.0.0 instead of 4.0.0-preview2
  • [SPARK-52289] Enable jsonToDdl test in Linux environment
  • [SPARK-52293] Use super-linter for markdown files
  • [SPARK-52298] Publish apache/spark-connect-swift:pi docker image
  • [SPARK-52301] Support Decimal type
  • [SPARK-52302] Improve stop to use ReleaseSessionRequest
  • [SPARK-52317] Identify InvalidTypeException in SparkConnectClient
  • [SPARK-52318] Refactor SparkConnectError to simplify case names
  • [SPARK-52319] Add (Catalog|Schema|TableOrView)NotFound to SparkConnectError
  • [SPARK-52320] Add ColumnNotFound/InvalidViewName/TableOrViewAlreadyExists to SparkConnectError
  • [SPARK-52321] Add SessionClosed, SqlConfNotFound, ParseSyntaxError to SparkConnectError
  • [SPARK-52322] Add publish_image GitHub Action job
  • [SPARK-52340] Update ArrowWriter(Helper)? and ProtoUtil with GH-43170
  • [SPARK-52341] Upgrade Spark to 3.5.6 from 3.5.5 in Spark 3 and Iceberg integration tests
  • [SPARK-52343] Download Apache Spark distributions via ASF Mirrors site
  • [SPARK-52359] Upgrade gRPC Swift NIO Transport to 1.2.2
  • [SPARK-52360] Upgrade gRPC Swift to 2.2.2
  • [SPARK-52361] Support executeCommand in SparkSession
  • [SPARK-52369] Fix Session ID to be lowercased always
  • [SPARK-52370] Update Requirement section to point the official Apache Arrow Swift repository
  • [SPARK-52371] Update Example projects to use the latest main branch always
  • [SPARK-52373] Add CRC32 struct
  • [SPARK-52374] Publish apache/spark-connect-swift:web docker image
  • [SPARK-52376] Support addArtifact(s)? in SparkSession
Loading

0.2.0

20 May 13:37
@dongjoon-hyun dongjoon-hyun
0.2.0
a87fc42
This commit was signed with the committer’s verified signature.
dongjoon-hyun Dongjoon Hyun
GPG key ID: EDA00CE834F0FC5C
Verified
Learn about vigilant mode.

Choose a tag to compare

View all tags
0.2.0

Apache Spark™ Connect Client for Swift language is a subproject of Apache Spark and aims to provide Swift implementation of Spark Connect. 0.2.0 is the second release of Apache Spark Connect for Swift client. This is still experimental.

Website

https://apache.github.io/spark-connect-swift/

Swift Package Index

https://swiftpackageindex.com/apache/spark-connect-swift

Documentation

https://swiftpackageindex.com/apache/spark-connect-swift/0.2.0/documentation/sparkconnect

Full Changelog

v0.1.0...0.2.0

Resolved Issues

Loading

v0.1.0

08 May 04:04
@dongjoon-hyun dongjoon-hyun
v0.1.0
e1e8a32
This commit was signed with the committer’s verified signature.
dongjoon-hyun Dongjoon Hyun
GPG key ID: EDA00CE834F0FC5C
Verified
Learn about vigilant mode.

Choose a tag to compare

View all tags
v0.1.0

Apache Spark™ Connect Client for Swift language is a subproject of Apache Spark and aims to provide Swift implementation of Spark Connect. v0.1.0 is the initial release of Apache Spark Connect for Swift client. This is still experimental.

Swift Package Index

https://swiftpackageindex.com/apache/spark-connect-swift

Documentation

https://swiftpackageindex.com/apache/spark-connect-swift/v0.1.0/documentation/sparkconnect

Full Changelog

https://github.com/apache/spark-connect-swift/commits/v0.1.0

Resolved Issues

  • [SPARK-51458] Add GitHub Action job to check ASF license
  • [SPARK-51459] Add merge_spark_pr.py and PULL_REQUEST_TEMPLATE
  • [SPARK-51461] Setup SparkConnect Swift package structure and CI to test build
  • [SPARK-51463] Add Spark Connect-generated Swift source code
  • [SPARK-51465] Use Apache Arrow Swift 19.0.1
  • [SPARK-51472] Add gRPC SparkConnectClient actor
  • [SPARK-51477] Enable autolink to SPARK jira issue
  • [SPARK-51481] Add RuntimeConf actor
  • [SPARK-51483] Add SparkSession and DataFrame actors
  • [SPARK-51485] Add How to use in your apps section to README.md
  • [SPARK-51490] Support iOS, watchOS, and tvOS
  • [SPARK-51493] Refine merge_spark_pr.py to use connect-swift-x.y.z version
  • [SPARK-51495] Add Integration Test GitHub Action job with 4.0.0-preview2
  • [SPARK-51504] Support select/limit/sort/orderBy/isEmpty for DataFrame
  • [SPARK-51508] Support collect(): [[String?]] for DataFrame
  • [SPARK-51510] Add SQL-file based SQLTests suite
  • [SPARK-51521] Add integral/floating/string/date type test and answer files
  • [SPARK-51524] Fix Package Author information to Apache Spark project
  • [SPARK-51529] Support TLS connections
  • [SPARK-51539] Refactor SparkConnectClient to use analyze helper function
  • [SPARK-51560] Support cache/persist/unpersist for DataFrame
  • [SPARK-51561] Upgrade gRPC Swift to 2.1.2 and gRPC Swift NIO Transport to 1.0.2
  • [SPARK-51570] Support filter/where for DataFrame
  • [SPARK-51572] Support binary type in show and collect
  • [SPARK-51620] Support columns for DataFrame
  • [SPARK-51621] Support sparkSession for DataFrame
  • [SPARK-51626] Support DataFrameReader
  • [SPARK-51636] Add StorageLevel struct
  • [SPARK-51642] Support explain for DataFrame
  • [SPARK-51656] Support time for SparkSession
  • [SPARK-51659] Add cache and describe-related sql test and answer files
  • [SPARK-51676] Support printSchema for DataFrame
  • [SPARK-51679] Support dtypes for DataFrame
  • [SPARK-51689] Support DataFrameWriter
  • [SPARK-51693] Support storageLevel for DataFrame
  • [SPARK-51702] Revise sparkSession/read/write/columns/schema/dtypes/storageLevel API
  • [SPARK-51708] Add CaseInsensitiveDictionary
  • [SPARK-51718] Update README.md with Spark 4.0.0 RC3
  • [SPARK-51719] Support table for SparkSession and DataFrameReader
  • [SPARK-51729] Support head/tail for DataFrame
  • [SPARK-51730] Add Catalog actor and support catalog/database APIs
  • [SPARK-51736] Make SparkConnectError and StorageLevel fields public
  • [SPARK-51743] Add describe_(database|table), show_(database|table), explain sql test and answer files
  • [SPARK-51749] Add MacOS integration test with Apache Spark 4.0.0 RC3
  • [SPARK-51750] Upgrade FlatBuffers to v25.2.10
  • [SPARK-51759] Add ErrorUtils and SQLHelper
  • [SPARK-51763] Support struct type in ArrowReader
  • [SPARK-51781] Update README.md and integration test with Apache Spark 4.0.0 RC4
  • [SPARK-51782] Add build-ubuntu-arm test pipeline
  • [SPARK-51784] Support xml in DataFrame(Reader/Writer)
  • [SPARK-51785] Support addTag/removeTag/getTags/clearTags in SparkSession
  • [SPARK-51787] Remove sessionID parameter from getExecutePlanRequest
  • [SPARK-51792] Support saveAsTable and insertInto
  • [SPARK-51793] Support ddlParse and jsonToDdl in SparkConnectClient
  • [SPARK-51799] Support user-specified schema in DataFrameReader
  • [SPARK-51804] Support sample in DataFrame
  • [SPARK-51807] Support drop and withColumnRenamed in DataFrame
  • [SPARK-51808] Use Swift 6.1 in GitHub Action CIs
  • [SPARK-51809] Support offset in DataFrame
  • [SPARK-51815] Add Row struct
  • [SPARK-51825] Add SparkFileUtils
  • [SPARK-51837] Support inputFiles for DataFrame
  • [SPARK-51839] Support except(All)?/intersect(All)?/union(All)?/unionByName in DataFrame
  • [SPARK-51841] Support isLocal and isStreaming for DataFrame
  • [SPARK-51846] Upgrade gRPC Swift Protobuf to 1.2 and gRPC Swift NIO Transport to 1.0.3
  • [SPARK-51850] Fix DataFrame.execute to reset previously received Arrow batch data
  • [SPARK-51851] Refactor to use withGPRC wrappers
  • [SPARK-51852] Support SPARK_CONNECT_AUTHENTICATE_TOKEN
  • [SPARK-51853] Improve DataFrame.show API to support all signatures
  • [SPARK-51854] Remove SwiftyTextTable dependency and unused import statements
  • [SPARK-51855] Support Spark SQL REPL
  • [SPARK-51857] Support token/userId/userAgent parameters in SparkConnectClient
  • [SPARK-51858] Support SPARK_REMOTE
  • [SPARK-51863] Support join and crossJoin in DataFrame
  • [SPARK-51864] Rename parameters and support case-insensitively
  • [SPARK-51870] Support SPARK_GENERATE_GOLDEN_FILES in SQLTests
  • [SPARK-51871] Improve SQLTests to check column names
  • [SPARK-51875] Support repartition(ByExpression)? and coalesce
  • [SPARK-51879] Support groupBy/rollup/cube in DataFrame
  • [SPARK-51911] Support lateralJoin in DataFrame
  • [SPARK-51912] Support semanticHash and sameSemantics in DataFrame
  • [SPARK-51916] Add create_(scala|table)_function and drop_function test scripts
  • [SPARK-51917] Add DataFrameWriterV2 actor
  • [SPARK-51934] Add MacOS integration test with Apache Spark 3.5.5
  • [SPARK-51942] Support selectExpr in DataFrame
  • [SPARK-51943] Upgrade setup-swift to 3.0 dev version
  • [SPARK-51967] Use discardableResult to prevent unnecessary warnings
  • [SPARK-51968] Support (cache|uncache|refresh)Table, refreshByPath, isCached, clearCache in Catalog
  • [SPARK-51969] Support createTable and (table|function)Exists in Catalog
  • [SPARK-51970] Support to create and drop temporary views in DataFrame and Catalog
  • [SPARK-51971] Improve DataFrame.collect to return the original values
  • [SPARK-51976] Add array, map, timestamp, posexplode test queries
  • [SPARK-51977] Improve SparkSQLRepl to support multiple lines
  • [SPARK-51986] Support Parameterized SQL queries in sql API
  • [SPARK-51990] Use Swift docker image on Linux environments
  • [SPARK-51991] Add SparkConnect.md, GettingStarted.md and SparkSession.md
  • [SPARK-51992] Support interrupt(Tag|Operation|All) in SparkSession
  • [SPARK-51993] Support emptyDataFrame and listColumns
  • [SPARK-51994] Fix ArrowType.Info.== to support complex types
  • [SPARK-51995] Support toDF, distinct and dropDuplicates(WithinWatermark)? in DataFrame
  • [SPARK-51996] Support describe and summary in DataFrame
  • [SPARK-51997] Mark nodoc to hide generated and internal classes from docs
Loading