dcai/index.qmd at main · ZOO-Project/dcai · GitHub

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
---
title: "GeoCroissant Recipes"
format: html
---

## Authors

**Rajat Shinde** : NASA Office of Data Science and Informatics, University of Alabama in Huntsville, US

**Manil Maskey** : NASA, US

**Ag Stephens** : STFC Centre for Environmental Data Analysis, UK

**Harsh Shinde** : Individual Researcher, India

**Joseph Edgerton** : University of Virginia, US

**Dr. Tejasri Nampally** : IIT Hyderabad, India

**Douglas Fils** : San Diego Supercomputing Center, US

**Edenna Chen** : Massachusetts Institute of Technology, US

**Claus Weiland** : Senckenberg - Leibniz Institution for Biodiversity and Earth System Research, Germany

**Pedram Ghamisi** : Helmholtz-Zentrum Dresden-Rossendorf (HZDR), Germany; Lancaster University, UK

**Gerald Fenoy** : GeoLabs, France

**Yuhan Douglas Rao** : National Oceanic and Atmospheric Administration, US

**Omar Benjelloun** : Google, US

**Elena Simperl** : King's College London & Open Data Institute, UK

## Overview

GeoCroissant extends the MLCommons Croissant metadata standard with geospatial concepts for GeoAI and Earth observation workflows. These notebooks demonstrate practical implementation of GeoCroissant metadata creation, validation, and conversion across geospatial data formats and catalog standards.

## What is GeoCroissant?

GeoCroissant (http://mlcommons.org/croissant/geo/1.0) is a metadata extension that adds geospatial capabilities to the Croissant standard:

- **Spatial & Temporal Coverage**: Geographic extent and time ranges
- **Coordinate Reference Systems**: CRS definitions and transformations
- **Spatial Resolution**: Ground sampling distance and pixel spacing
- **Band Configuration**: Spectral band organization and metadata
- **Time-Series Support**: Temporal cadence and ordering
- **Responsible GeoAI**: Spatial bias and sampling strategy documentation

## Notebook Categories

### Introduction
Core concepts and fundamental implementation patterns for GeoCroissant metadata.

### Catalog to GeoCroissant
Convert geospatial catalog metadata to GeoCroissant format from STAC, NASA UMM-G, CEDA CMIP6, and Google Earth Engine.

### Data Format to GeoCroissant
Generate GeoCroissant metadata from cloud-optimized geospatial data formats including GeoParquet, HDF5, NetCDF, and Zarr.

### GeoCroissant Extensions
Advanced features for time-series Earth observation data and OGC Training Data Markup Language integration.

### GeoCroissant to Standards
Export GeoCroissant metadata to STAC and GeoDCAT formats for interoperability.

## ML Framework Integration

GeoCroissant datasets integrate with PyTorch, TensorFlow, and JAX using the mlcroissant Python library:

```python
import mlcroissant as mlc
dataset = mlc.Dataset("geocroissant.json")
```

## FAIR Principles

GeoCroissant supports machine-actionable FAIR data:

- **Findable**: Versioned URIs and schema.org vocabulary
- **Accessible**: Standardized API endpoints and persistent URLs
- **Interoperable**: Stable vocabulary terms and format conversions
- **Reusable**: Explicit conformance and responsible AI metadata

## Conformance

GeoCroissant datasets declare conformance at the dataset level:

```json
"dct:conformsTo": [
  "http://mlcommons.org/croissant/1.1",
  "http://mlcommons.org/croissant/geo/1.0"
]
```

## Acknowledgements

- MLCommons GeoCroissant Working Group
- MLCommons Croissant Working Group
- Open Geospatial Consortium (OGC) GeoAI Domain Working Group