Backend
VL (Velox)
Gluten version: main branch
Description
Spark 4.1 added support for reading and writing NullType columns in Parquet (SPARK-54220). Gluten/Velox does not handle NullType in Parquet format.
Spark 4.1 only.
Parent issue: #11910 ([VL] Spark 4.x: Tracking new feature support)
Impact
| Suite |
Exclude |
spark40 |
spark41 |
| GlutenParquetIOSuite |
SPARK-54220 |
🟢 |
🔴 |
Note: GlutenParquetIOSuite also has struct field excludes tracked under a separate #11550 sub-issue.
References
Backend
VL (Velox)
Gluten version: main branch
Description
Spark 4.1 added support for reading and writing NullType columns in Parquet (SPARK-54220). Gluten/Velox does not handle NullType in Parquet format.
Spark 4.1 only.
Parent issue: #11910 (
[VL] Spark 4.x: Tracking new feature support)Impact
Note: GlutenParquetIOSuite also has struct field excludes tracked under a separate #11550 sub-issue.
References