Skip to content

[VL] Spark 4.1: Velox decimal arithmetic does not respect allowPrecisionLoss context (SPARK-53968) #11917

@baibaichen

Description

@baibaichen

Backend

VL (Velox)

Bug description

DECIMAL(38,18) + DECIMAL(38,18) produces a result with incorrect scale (off by 1 digit, i.e., 10x error). Spark 4.1 introduced NumericEvalContext (SPARK-53968) which freezes allowPrecisionLoss=true in expression state. Velox does not correctly receive this context, resulting in decimal scale mismatch.

This is not ANSI-related.

Spark 4.1 only.

Parent issue: #11550

Impact

Suite Failures spark40 spark41
GlutenSimpleSQLViewSuite 1 🟢 🔴

Note: GlutenSimpleSQLViewSuite has 2 failures total — the other failure (error condition) is tracked under #11912.

References

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type
    No fields configured for issues without a type.

    Projects

    Status

    No status

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions