earth_search Sentinel-2: Missing datatake metadata file

[remi-braun]

Hello,

When downloading Sentinel-2 products from earth_search provider (at least L2A), the datatake metadata file (MTD_MSIL1C.xml or MTD_MSIL2A.xml) is missing, preventing the user to read some very important information such as:

• the true name of the product
• the datatake sensing time
• the processing baseline number
• the quantification values of the bands
• ...

What would be the best way to retrieve them somehow ?
Or am I missing something ?

[sbrunato]

Hello Remi, these files should not be missing.
They are identified using S2_PROD_MTD_REGEX in

eodag/eodag/plugins/download/aws.py

Lines 114 to 117 in d9f16f4

	S2_PROD_MTD_REGEX = re.compile(
	r"^products/(?P<year>[0-9]+)/(?P<month>[0-9]+)/(?P<day>[0-9]+)/(?P<title>[A-Z0-9_]+)/"
	+ r"(?P<file>metadata\.xml)$"
	)

and saved in SAFE product root directory with:

eodag/eodag/plugins/download/aws.py

Lines 790 to 795 in d9f16f4

	elif S2_PROD_MTD_REGEX.match(chunk.key):
	found_dict = S2_PROD_MTD_REGEX.match(chunk.key).groupdict()
	product_path = "%s.SAFE/MTD_MSI%s.xml" % (
	product.properties["title"],
	s2_processing_level,
	)

If you have an example of product where this file is missing, can you please give me its id so I can check it on my side ?

[remi-braun]

I think this comes from the fact that earth_search retrieved Sentinel-2 data from SentinelHub bucket, where those files are already missing (not an eodag issue, this is why I put it in discussion).
You can download almost any S2L2A from earth_search (i.e. S2B_MSIL2A_20191005T104029_N0213_R008_T31UEP_20191005T135415)

[remi-braun]

I got some errors (not affecting the downloading), maybe it has the same root:

[sbrunato]

Missing manifest.safe and metadata for some products was due to a malformed regex in metadata extraction configuration for earth_search.
See Pull Request GH-405

[remi-braun]

Ok I'm relieved then 👍