-
Notifications
You must be signed in to change notification settings - Fork 335
docs: tidying; update version refs; describe various catalogues #1616
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Changes from 11 commits
8f82e5f
3d1ef60
212828c
6b1a7e8
5c5f7ea
2644203
717ccf6
900e957
342c78f
42416a4
53ed027
dd06d7f
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -19,4 +19,19 @@ | |
|
||
# Iceberg Rust | ||
|
||
Iceberg Rust is a rust implementation for accessing iceberg tables. | ||
`iceberg-rust` is a Rust implementation for managing Apache Iceberg tables. | ||
|
||
## What is Apache Iceberg? | ||
|
||
[Apache Iceberg](https://iceberg.apache.org) is a modern, high-performance open table format | ||
for huge analytic datasets that brings SQL-like tables to processing engines including Spark, Trino, PrestoDB, Flink, Hive and Impala. | ||
|
||
Rather than being a new file type, Iceberg provides a metadata layer that sits on top of formats like Parquet | ||
and ORC, ensuring data is organized, accessible, and safe to work with at scale. It introduces features long | ||
expected in databases such as transactional consistency, schema evolution, and time travel into environments | ||
where files are stored directly on systems like Amazon S3 or HDFS. | ||
|
||
Originally developed at Netflix, it was designed as a response to the limitations of early Hive tables, which were | ||
essentially directories of files with only loose conventions for schema and partitioning. While this approach | ||
enabled cheap storage of large datasets, it struggled with schema changes, concurrent writes, and efficient query | ||
planning. | ||
|
Uh oh!
There was an error while loading. Please reload this page.