Skip to content

Add DataChunkFromArrow#92

Draft
wmTJc9IK0Q wants to merge 1 commit intoduckdb:mainfrom
wmTJc9IK0Q:arrow-table-udf
Draft

Add DataChunkFromArrow#92
wmTJc9IK0Q wants to merge 1 commit intoduckdb:mainfrom
wmTJc9IK0Q:arrow-table-udf

Conversation

@wmTJc9IK0Q
Copy link

Add necessary support for arrow-backed table UDFs by adding a DataChunkFromArrow helper function to the Arrow struct which will move the records of a record batch into an existing data chunk.

Depends on:

Replaces #75

@mlafeldt
Copy link
Member

Hey @wmTJc9IK0Q - what's missing to get this out of draft status?

@wmTJc9IK0Q
Copy link
Author

@mlafeldt See the discussion in duckdb/duckdb#20297

We need a way to populate an existing datachunk with an arrow array, which the new C API does not support and the duckdb team prefers not to change the API in a breaking way. So a new C API needs to be added for this as proposed in the thread.

The feature I was working on that requires this got de-prioritized for a bit so I'm not actively pushing this forward right now.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants