Consider adding other search providers such as Brave

[jirispilka]

https://console.apify.com/actors/3ox4R101TgZz67sLr/issues/esOAEXvEtsDP9S7fM
Currently, the Actor only uses Google SEPRs, which is unpredictable and relatively slow. We could enable users to select other search providers, e.g. https://brave.com/search/api/

[matyascimbulka]

@jirispilka Is this still relevant? On closer inspection it looks like the Brave search API is only available to users with API key. Paying for the API is really not an option as we can't transfer the cost to final user (no monetization options for standby actors). Other option would be for users to bring their own key. Or we could just scrape the web version with organic results.

I have checked and https://search.brave.com/search?q=apify with datacenter proxies and disabled JS produces search results. Also DuckDuckGo would also work https://html.duckduckgo.com/html/?q=apify, they even provide a URL which doesn't ship any JS to the browser.

I think using DuckDuckGo in HTML only mode could provide some performance benefit over Google SERP. What do you think? Is this worth investing some time into?

[jirispilka]

@matyascimbulka I don’t think we want to do it right now.

We already have Google SERP and SHADER. DuckDuckGo could be an alternative, I don’t think it as a priority now.