Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

No search results #172

Open
LeonMusCoden opened this issue Jan 16, 2025 · 9 comments
Open

No search results #172

LeonMusCoden opened this issue Jan 16, 2025 · 9 comments

Comments

@LeonMusCoden
Copy link

LeonMusCoden commented Jan 16, 2025

Bug: On every couple searches, I'm not getting any search results:

Image

I believe this is related to the Google removing support for javascript-free search. There are some more details in an issue on whoogle.

Btw: Amazing search engine! Love the UI.

Edit: Checked the code and Araa doesn't seem to use the javascript free version of google, which is enabled by gbv=1. My issue might be unrelated.

@TEMtheLEM
Copy link
Contributor

TEMtheLEM commented Jan 16, 2025

Seems like Google is rejecting any search without JS, even with gbv=1.

That's at least trying to use it with NoScript on my browser.

EDIT: Tried using a few alternative google domains (.ca, .de), those have the same roadblock.

TEMtheLEM added a commit to TEMtheLEM/araa-search that referenced this issue Jan 16, 2025
@Malix-Labs
Copy link

Malix-Labs commented Jan 17, 2025

Unfortunately, this sign the death of Google search in Araa.

@Alifoss
Copy link

Alifoss commented Jan 17, 2025

I've just came across this project since running into the same issues with another selfhosted alternative (whoogle).

In whoogle results can still be fetched from google without JS while using some specific user agents. For example Mozilla/3.0 (compatible; MSIE 3.0; Windows NT 5.0) and Lynx/2.9.2 libwww-FM/2.14 SSL-MM/1.4.1 OpenSSL/3.4.0.

I've tested with several other UA's aswell and seems if its from an old enough browser/platform, results can be fetched.

Probably this is still working because google doen't want to disable being a search engine for people who only have access to maybe older platforms. Question is how long ofcourse. Maybe there still is a substational amount of people using these.

On whoogle at least, this messes up the formating internally a little, as from the older ua, google probably servers the results in another format as on how whoogle originally was build.

I'm not sure how this is implemented in this project, but wondered if in araa, using one of the working ua's could bring back results in araa aswell, and if so, if it would affect the formatting in araa aswell.

I would love to try this project, since i like it very much on first glance, with torrent option etc.

@Extravi
Copy link
Owner

Extravi commented Jan 18, 2025

I will have to look into this soon

@beastbond
Copy link

Google always being google...

How about changing from Google's API, as there is no guarantee it will provide a long term service for anybody, they always do annoying shit like this and expect devs to comply, how abt sum else with a more friendly API

@amogusussy
Copy link
Contributor

We could look into getting Google cse results. 4get has a script to scrape them: https://git.lolcat.ca/lolcat/4get/src/branch/master/scraper/google_cse.php

@Alifoss
Copy link

Alifoss commented Jan 20, 2025

Not sure if this could help in any way, but i spinned up a searXNG instance, and still get results from google. Might be beneficial for this project aswell to look how they implemented it. From my limited understanding they use google search mobile site to fetch results. (benbusby/whoogle-search#1211 (comment))

@amogusussy
Copy link
Contributor

This appears to work. I've just made #173 to implement it for araa.

@amogusussy
Copy link
Contributor

@Extravi It now works on the main instance, so this should probably be closed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

7 participants