Skip to content
This repository was archived by the owner on Jul 17, 2025. It is now read-only.

Commit 7b7d6b0

Browse files
authored
chore: allow additional requests_kwargs parameter in sitemap loader (#20)
1 parent acabee8 commit 7b7d6b0

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

extractor-api-lib/src/extractor_api_lib/impl/extractors/sitemap_extractor.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -107,7 +107,7 @@ def _parse_sitemap_loader_parameters(self, extraction_parameters: ExtractionPara
107107
"""
108108
sitemap_loader_parameters = {}
109109
for x in extraction_parameters.kwargs:
110-
if x.key == "header_template":
110+
if x.key == "header_template" or x.key == "requests_kwargs":
111111
try:
112112
sitemap_loader_parameters[x.key] = json.loads(x.value)
113113
except (json.JSONDecodeError, TypeError):

0 commit comments

Comments
 (0)