All pull requests

Pull requests

• bench: add string, Map<Utf8, Int64> and nullable row-to-columnar cases (#7080)

  area:shuffle
  #7201·HarshilMital opened Oct 24, 2026·

  ·

• bench: add nested-column gather cases (#7080)

  area:shuffle
  #7200·HarshilMital opened Oct 24, 2026·

  ·

• bench: add a compressed high-partition writer case (#7080)

  area:shuffle
  #7199·HarshilMital opened Oct 24, 2026·

  ·

• feat: support native Iceberg UUID writes

  area:Icebergarea:writerenhancement
  #7198·sam-1112 opened Oct 24, 2026Contributor·

  ·

• fix: resolve conflicting Parquet field claims consistently

  area:scanbug
  #7196·sam-1112 opened Oct 24, 2026Contributor·

  ·
  1

  5

• fix: cap projection input beneath local and global limits

  bug
  #7195·rich7420 opened Oct 24, 2026Contributor·

  ·

• perf: add grouped accumulators for regression aggregates

  area:aggregationenhancementperformance
  #7194·rich7420 opened Oct 24, 2026Contributor·

  ·
  1

• fix: split a coalesced broadcast before a string or binary vector passes 1 GiB

  bug
  #7193·comphead opened Oct 24, 2026Contributor·

  ·
  1

• feat: run min and max over struct inputs natively

  area:aggregationarea:expressionsenhancementrun-all-spark-profilesrun-spark-3.4-testsrun-spark-4.1-tests
  #7191·parthchandra opened Oct 24, 2026Contributor·

  ·
  1

• perf: reduce duplicate right-side rows before sorting left-semi joins

  enhancementperformancerun-spark-4.1-tests
  #7190·sunchao opened Oct 24, 2026Member·

  ·
  1

  6

• feat: interrupt a native scalar Arrow UDF when its task is killed

  enhancementrun-pyarrow-udf-testsrun-spark-4.1-tests
  #7181·viirya opened Oct 23, 2026Member·

  ·
  1

  14

• perf: overlap the deletion vector and footer reads in Delta scan preparation

  area:Deltaenhancementperformance
  #7180·dwsmith1983 opened Oct 23, 2026Contributor·

  ·
  1

• fix: merge all Bloom filter states and respect sliced offsets

  area:expressionsbug
  #7173·sunchao opened Oct 23, 2026Member·

  ·
  1

  6

• fix: match SPARK-58821 and SPARK-60118 in sequence and string to decimal cast

  area:expressionsbug
  #7171·snmvaughan opened Oct 23, 2026Contributor·

  ·
  1

  10

• docs: Add changelog for 1.2.0

  documentation
  #7168·andygrove opened Oct 23, 2026Member·

  ·

• docs: list contrib/delta-spark/pom.xml in the version bump and add a dependency refresh step

  documentation
  #7166·andygrove opened Oct 23, 2026Member·

  ·
  2

• fix: don't treat planner-inserted casts as Parquet schema conversions

  area:scanbug
  #7159·snmvaughan opened Oct 22, 2026Contributor·

  ·
  1

  12

• feat: read Iceberg tables on HDFS natively through iceberg-rust's hdfs-native backend

  area:Icebergarea:scanenhancement
  #7157·comphead opened Oct 22, 2026Contributor·

  ·
  1

• fix: keep Iceberg residual pushdown within Spark semantics

  area:Icebergarea:scanbug
  #7156·rich7420 opened Oct 22, 2026Contributor·

  ·
  2

• feat: support native AssertNotNull for DataSource V2 writes

  area:expressionsarea:Icebergenhancement
  #7155·LinSimon-901101 opened Oct 22, 2026Contributor·

  ·
  1

  23

• Deduplicate ASCII and char paths in levenshtein_distance_with_threshold

  area:expressions
  #7154·EyobelG opened Oct 22, 2026·

  ·
  1

• docs: add a docs-review skill

  documentation
  #7153·Abhishek-Mohan opened Oct 22, 2026·

  ·
  1

  17

• docs: add a documentation style guide and apply it to the remaining pages

  documentation
  #7151·Abhishek-Mohan opened Oct 22, 2026·

  ·
  5

• fix: coerce INT96 timestamps inside legacy-format lists in the native Parquet scan

  area:scanbugrun-spark-4.1-tests
  #7148·kazuyukitanimura opened Oct 21, 2026Contributor·

  ·
  2

  9

• test: pin localTableScan off in Iceberg write detection helpers

  area:Icebergenhancementtest
  #7141·yunchipang opened Oct 21, 2026Contributor·

  ·
  1