(web-scraper): Max result records
counts processed pages, not results
#353
Labels
bug
Something isn't working.
Max result records
counts processed pages, not results
#353
As reported in a user issue, returning
undefined
from the Page Function still fires a request to the Dataset API (adding no item) and counts towards theMax result records
(maxResultsPerCrawl
) crawler limit.With the limit set to e.g.
10
andpageFunction
returningundefined
on every other request, the Actor will finish with 5 dataset items only (will stop prematurely, since the "limit has been hit").This seems like a bug to me, so I'd fix it regardless of whether it's breaking.
Reproduction scenario here: https://console.apify.com/view/runs/T3XtWRqfhCSFUeH7X
edit: this is likely the case with other generic Actors as well.
The text was updated successfully, but these errors were encountered: