Issues

• Keep native Arrow UDFs on Spark's path when the embedded Python version differs

  enhancementrequires-triage
  apache/datafusion-comet#7178 · Filter by author viirya opened on Oct 23, 2026

• Surface native scalar Arrow UDF errors as Spark's PythonException

  enhancementrequires-triage
  apache/datafusion-comet#7177 · Filter by author viirya opened on Oct 23, 2026
  

• CometTaskMemoryManager.releaseMemory lowers used before Spark accepts the release

  requires-triage
  apache/datafusion-comet#7176 · Filter by author dwsmith1983 opened on Oct 23, 2026

• A short grant stays with Spark when handing it back fails, but the pool records nothing

  requires-triage
  apache/datafusion-comet#7175 · Filter by author dwsmith1983 opened on Oct 23, 2026

• Concurrent unified pool try_grow calls can both ask Spark for the same overcommit

  requires-triage
  apache/datafusion-comet#7174 · Filter by author dwsmith1983 opened on Oct 23, 2026

• Bloom aggregate merge panics on batched states and ignores sliced offsets

  bugrequires-triage
  apache/datafusion-comet#7172 · Filter by author sunchao opened on Oct 23, 2026

• sequence and string to decimal cast don't match Spark 4.0.5, 4.1.4 and 4.2.1 (SPARK-58821, SPARK-60118)

  requires-triage
  apache/datafusion-comet#7170 · Filter by author snmvaughan opened on Oct 23, 2026

• Native Parquet scan: casts the planner inserts into pushed-down filters are rejected as Parquet type promotions (Spark 3.x, row-level filter pushdown)

  requires-triage
  apache/datafusion-comet#7158 · Filter by author snmvaughan opened on Oct 22, 2026

• Run the MinIO-backed S3 suites in CI, starting with ParquetWriteWithMagicCommitterSuite

  enhancementrequires-triage
  apache/datafusion-comet#7150 · Filter by author andygrove opened on Oct 21, 2026

• Native filters and non-collect limits can evaluate ANSI casts on rows Spark skips

  area:expressionsbugrequires-triage
  apache/datafusion-comet#7147 · Filter by author sunchao opened on Oct 21, 2026

• Run SortAggregateExec as a native hash aggregate without its input sort

  area:aggregationenhancementperformancerequires-triage
  apache/datafusion-comet#7146 · Filter by author comphead opened on Oct 21, 2026
  1

• Tune nested take compaction threshold with a query-level benchmark

  requires-triage
  apache/datafusion-comet#7145 · Filter by author rich7420 opened on Oct 21, 2026

• test: move make_date SQL regressions into SQL fixtures

  requires-triage
  apache/datafusion-comet#7144 · Filter by author pingzh opened on Oct 21, 2026

• perf: retain native make_date filters behind redundant NULL checks

  requires-triage
  apache/datafusion-comet#7143 · Filter by author pingzh opened on Oct 21, 2026

• refactor: consolidate make_date and shared evaluation guards

  requires-triage
  apache/datafusion-comet#7142 · Filter by author pingzh opened on Oct 21, 2026

• Native Iceberg scan drops rows from data files that store a narrower type than the column

  requires-triage
  apache/datafusion-comet#7138 · Filter by author rich7420 opened on Oct 20, 2026

• Native Iceberg scan drops NULL rows for NOT (col <=> value)

  requires-triage
  apache/datafusion-comet#7137 · Filter by author rich7420 opened on Oct 20, 2026

• Native Iceberg scan drops -0.0 rows for floating-point predicates

  requires-triage
  apache/datafusion-comet#7136 · Filter by author rich7420 opened on Oct 20, 2026

• Native Iceberg scan reads the wrong struct child for name-mapped files whose nested names differ in case

  requires-triage
  apache/datafusion-comet#7134 · Filter by author dwsmith1983 opened on Oct 20, 2026

• Native Iceberg scan applies equality deletes to the wrong column when column names differ only in case

  requires-triage
  apache/datafusion-comet#7129 · Filter by author dwsmith1983 opened on Oct 20, 2026

• Native object-store errors and debug logs print whole URLs outside the Azure store

  requires-triage
  apache/datafusion-comet#7128 · Filter by author dwsmith1983 opened on Oct 20, 2026
  1

• Text broadcast build sides and string min/max apply the invalid UTF-8 decode where 1.1.0 stayed on Spark

  bugcorrectnessregressionrequires-triage
  apache/datafusion-comet#7118 · Filter by author andygrove opened on Oct 19, 2026 · 1.2.0

• Keep wide-decimal scalar AVG native with a wider running sum

  requires-triage
  apache/datafusion-comet#7116 · Filter by author sunchao opened on Oct 19, 2026

• Support join runtime reader filters through column-only projections

  requires-triage
  apache/datafusion-comet#7113 · Filter by author sunchao opened on Oct 19, 2026

• NativeUtil.exportBatch rejects large_string and large_binary vectors

  requires-triage
  apache/datafusion-comet#7109 · Filter by author andygrove opened on Oct 19, 2026