Skip to content

[VL] Spark 4.x: CastTransformer does not pass per-expression timezone for timestamp formatting #11918

@baibaichen

Description

@baibaichen

Backend

VL (Velox)

Bug description

CastTransformer does not pass per-expression timezone through Substrait. When casting timestamp to string, Velox does not use the session timezone, producing output that differs from Spark's expected format.

This is a Substrait architecture limitation that requires changes at the C++ layer.

Affects both Spark 4.0 and 4.1.

Parent issue: #11550

Impact

Suite Failures spark40 spark41
GlutenToPrettyStringSuite 1 ("Timestamp as pretty strings") 🔴 🔴

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type
    No fields configured for issues without a type.

    Projects

    Status

    No status

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions