Skip to content

fix(crawler): skip forbidden crawlers in list and surface non-JSON API errors#267

Open
LorrisSaintGenez wants to merge 1 commit into
mainfrom
fix/crawler-list-forbidden
Open

fix(crawler): skip forbidden crawlers in list and surface non-JSON API errors#267
LorrisSaintGenez wants to merge 1 commit into
mainfrom
fix/crawler-list-forbidden

Conversation

@LorrisSaintGenez

Copy link
Copy Markdown
Contributor

What

algolia crawler list failed with invalid character 'F' looking for beginning of value when any crawler returned a 403: the API answers with plain-text Forbidden, which the client tried to parse as JSON.

  • Crawler API errors are now returned as APIError{StatusCode, Message}, falling back to the raw body when it isn't JSON
  • crawler list skips crawlers the API key can't access instead of aborting

Test

algolia auth crawler
algolia crawler list

@codacy-production

Copy link
Copy Markdown

Up to standards ✅

🟢 Issues 0 issues

Results:
0 new issues

View in Codacy

🟢 Metrics 17 complexity · 4 duplication

Metric Results
Complexity 17
Duplication 4

View in Codacy

TIP This summary will be updated as you push new changes.

@LorrisSaintGenez LorrisSaintGenez marked this pull request as ready for review July 13, 2026 21:38
@LorrisSaintGenez LorrisSaintGenez self-assigned this Jul 13, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant