Add GraalPy Apache Arrow guide #15
Conversation
|
Thank you for your pull request and welcome to our community! To contribute, please sign the Oracle Contributor Agreement (OCA).
To sign the OCA, please create an Oracle account and sign the OCA in Oracle's Contributor Agreement Application. When signing the OCA, please provide your GitHub username. After signing the OCA and getting an OCA approval from Oracle, this PR will be automatically updated. If you are an Oracle employee, please make sure that you are a member of the main Oracle GitHub organization, and your membership in this organization is public. |
oracle-contributor-agreement
bot
added
the
OCA Required
- Calculate in threads - Do not include python home in jar - Move data_analysis.py to correct location in vfs
…ow shipping in Jar resources
|
FYI, I extended this demo to use a 0.5GB CSV file and compared with and without the Arrow integration: |
horakivo
force-pushed
the
ih/graalpy-apache-arrow-guide
branch
2 times, most recently
from
a1a392c to
7836676
Compare
horakivo
force-pushed
the
ih/graalpy-apache-arrow-guide
branch
from
7836676 to
dfaa139
Compare
oracle-contributor-agreement
bot
added
OCA Verified
horakivo
force-pushed
the
ih/graalpy-apache-arrow-guide
branch
5 times, most recently
from
4ed22aa to
3c64bfe
Compare
horakivo
force-pushed
the
ih/graalpy-apache-arrow-guide
branch
from
3c64bfe to
9ccf2ec
Compare
horakivo
force-pushed
the
ih/graalpy-apache-arrow-guide
branch
from
bb8b225 to
f750807
Compare
horakivo
force-pushed
the
ih/graalpy-apache-arrow-guide
branch
from
f750807 to
1731eab
Compare
steve-s
left a comment
steve-s
left a comment
There was a problem hiding this comment.
I think we should add a CI job for this. Can be a follow up PR.
3 participants
Recently, many Python libraries have integrated Apache Arrow to leverage its high-performance and memory-efficient format for handling large datasets. Given the widespread adoption of Arrow in data science and big data ecosystems, we are adding Apache Arrow support for Series to GraalPy.
This is the simple demo which uses Java Apache implementation library together with GraalPy achieving zero-copy data transfer for Series.