[VL] Spark 4.1: Support dual-mode ColumnarToRow nodes (SPARK-51474)

[baibaichen]

Backend

VL (Velox)

Gluten version: main branch

Description

Spark 4.1 introduced dual-mode nodes where supportsRowBased=true && supportsColumnar=true (SPARK-51474). Gluten's transition rules (ConventionFunc.conventionReqOf0 and GlutenColumnarRule.preColumnarTransitions) do not account for this case.

Spark 4.1 only.

Parent issue: #11910 ([VL] Spark 4.x: Tracking new feature support)

Impact

Suite	Failures	spark40	spark41
GlutenColumnarRulesSuite	1	🟢	🔴

References

• Apache Spark JIRA: SPARK-51474