Skip to content

Proposal: Make Obstore backend the default for s3/gcs/azure/https #3520

@jhamman

Description

@jhamman

The Obstore backend in Zarr for about 6 months. Its working great and is significantly more performant that the fsspec alternatives. See maxrjones/zarr-obstore-performance for performance benchmarks. With this in mind, I'm proposing that we switch to using Obstore as the default in Zarr-Python if is available. Fsspec would become the fallback for s3/gcs/azure/https and would remain the default for all other remote stores.

Image

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions