Add Sentinel-2 L2A optimized pipeline #41
Draft
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
- Introduced a new STAC item JSON file for Sentinel-2 L2A data. - Included comprehensive asset details for surface reflectance at 10m, 20m, and 60m resolutions. - Added metadata for aerosol optical thickness, scene classification, and true color image. - Provided links to the product, zipped product, and consolidated metadata. - Specified properties including timestamps, cloud cover, and processing details.
- Implemented a comprehensive test suite for the `consolidate_reflectance_assets` function. - Added tests to verify the presence and structure of reflectance assets after consolidation. - Ensured old-format assets are removed and new-format assets contain required fields such as `bands`, `cube:variables`, and `cube:dimensions`. - Verified media type, href structure, and roles of the reflectance asset. - Included checks for band names matching cube variables and ensured bands are sorted for consistency.
- Implement `convert_v1.py` for converting EOPF Zarr to GeoZarr format, including CLI support and logging. - Introduce `register_v0.py` and `register_v1.py` for STAC item registration, enhancing asset management and adding projection metadata. - Consolidate reflectance assets in `register_v1.py` to follow Multiscale reflectance group representation best practices. - Add utility functions for rewriting asset URLs, adding visualization links, and managing derived links. - Ensure compliance with ADR-111 by removing XArray-specific fields from assets.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Introduce the new data-pipeline for Sentinel-2 L2A data, including detailed asset information and metadata. Implement unit tests for the consolidation of reflectance assets, ensuring proper structure and validation. Improve test formatting and assertions for clarity and reliability.