Skip to content

feat: Row readers using storage API acceleration can leverage full precision arrow values#656

Open
danieljbruce wants to merge 18 commits intomainfrom
bigquery-test-create-reader-3
Open

feat: Row readers using storage API acceleration can leverage full precision arrow values#656
danieljbruce wants to merge 18 commits intomainfrom
bigquery-test-create-reader-3

Conversation

@danieljbruce
Copy link
Contributor

@danieljbruce danieljbruce commented Mar 2, 2026

Description

This PR allows users to fetch high precision timestamps for read calls with arrow readers. Previous to this PR there was no way users could

Impact

With the ArrowReaders in this code repository, now users can fetch and consume data from the server that preserves high precision timestamps on the backend.

Testing

A system test is added that proves the timestamp fetched from the server is high precision.

Additional Information

Something to be aware of is that this PR introduces an API change. For various read methods that users can call they can specify a value for the arrowSerializationOptions property of their request which will be passed onto the server. This allows users to opt into receiving high precision timestamps instead of getting them automatically because automatically opting them in could change values they are currently getting from ints to strings which is a breaking change.

Support for Avro readers will be done in a separate PR.

In this PR we make the minimal amount of changes necessary to allow users to fetch high precision timestamps for arrow readers, but there may be additional changes that could make it easier for users to write code to fetch high precision timestamps instead of the current system test we have. That should be deliberated in a separate PR though. For instance, we can expand the GetRowsOptions interface.

@product-auto-label product-auto-label bot added size: m Pull request size is medium. api: bigquerystorage Issues related to the googleapis/nodejs-bigquery-storage API. labels Mar 2, 2026
@danieljbruce danieljbruce marked this pull request as ready for review March 2, 2026 20:41
@danieljbruce danieljbruce requested review from a team as code owners March 2, 2026 20:41
@danieljbruce danieljbruce requested a review from alvarowolfx March 2, 2026 20:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

api: bigquerystorage Issues related to the googleapis/nodejs-bigquery-storage API. size: m Pull request size is medium.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant