Repository navigation
Replies: 1 comment
|
Converting to a discussion - definitely interested in higher performance Arrow ingestion! |
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
we have a relatively long-winded ingestion from a
pyarrow.Table:https://github.com/finos/perspective/blob/768ca4068c79a2c2243aa24fd3a073f09c6dc97d/rust/perspective-python/src/client/python.rs#L166
Even though it would start as a different format, can we save time by going through the pycapsule/c interface: https://arrow.apache.org/docs/format/CDataInterface/PyCapsuleInterface.html#consume-a-pycapsule
xref: #1157
All reactions