Skip to content

Commit 0e2febe

Browse files
authored
chore: allow additional requests_kwargs parameter in sitemap loader (#20)
1 parent 2f9ac3d commit 0e2febe

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

libs/extractor-api-lib/src/extractor_api_lib/impl/extractors/sitemap_extractor.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -107,7 +107,7 @@ def _parse_sitemap_loader_parameters(self, extraction_parameters: ExtractionPara
107107
"""
108108
sitemap_loader_parameters = {}
109109
for x in extraction_parameters.kwargs:
110-
if x.key == "header_template":
110+
if x.key == "header_template" or x.key == "requests_kwargs":
111111
try:
112112
sitemap_loader_parameters[x.key] = json.loads(x.value)
113113
except (json.JSONDecodeError, TypeError):

0 commit comments

Comments
 (0)