searxng/searx/engines/google.py, branch master

[mod] network: migrate to curl_cffi

2026-09-04T08:16:09Z

[fix] google: use Nokia UA (#6546)

2026-08-22T03:00:06Z

[chore] Google (HTML) engine: remove obsolete GSA User-Agents (#6366)

2026-07-05T10:07:23Z

The GSA headers that were introduced in PR #5644 unfortunately no longer work (#6359). The Google engines - google.py - google_videos.py do not work anymore either, but we'll leave it in the code for now: - In google.py, central functions like get_google_info(..) are provided, which are also used by other modules. - We will probably need a Google HTML (and video) engine again very soon. Related: - https://github.com/searxng/searxng/issues/6359 - https://github.com/searxng/searxng/pull/6364 Signed-off-by: Markus Heiser

[feat] engines: add google cse engine (#6364)

2026-07-05T09:50:23Z

Adds a new google cse engine as an alternative to the currently broken html google engine. It works by generating a token which is cached for 1 hour and it only uses the public CSE id from blackle.com. We do have two others but I think just hardcoding one will be enough. Will be broken in 2027 due to google deprecating it but I it will be good while it lasts. I found I can get up to 20 results per page. Setting safesearch and language works and I just copied the traits from the google engine. Also set old google engine as inactive as it is completely broken for now.

[fix] set language_support for engines with languages in traits (#6258)

2026-06-15T08:52:00Z

In the past, the engine option ``language_support`` was not consistently maintained; with this patch, a ValueError is now thrown if an engine has languages in its traits but language_support is not set to True. Signed-off-by: Markus Heiser

[fix] google: improve CAPTCHA detection (#5922)

2026-05-15T07:25:13Z

- Detect HTTP 302 responses (Google redirecting to /sorry/index without the HTTP client following the redirect) - Detect short HTML responses (<2000 bytes) containing "/sorry/" links (meta-refresh or JS redirect variants) Instances with rotating IPs can set the `suspended_times.SearxEngineCaptcha` to 0 in the search settings [1], the next request will typically use a different outgoing IP when rotating proxies are configured [1] https://docs.searxng.org/admin/settings/settings_search.html

[fix] google engine - don't set __Secure-ENID in the HTTP header (#5894)

2026-03-24T14:16:47Z

PR #5892 only deepends on the UA and the __Secure-ENID is not needed [1]. [1] https://github.com/searxng/searxng/pull/5892#issuecomment-4114835195 Suggested-by: @yeyuchen198 Signed-off-by: Markus Heiser

[fix] google: switch to using "Google App" for Android useragent (#5892)

2026-03-23T13:55:48Z

I found a bypass using the Android Google App this time. However, unlike the iPhone GSA method, this one does have rate limits. Although it took a couple of hundred consecutive requests to trigger them.

[fix] google engine: Result image thumbnails

2026-03-16T22:35:33Z

[fix] google engines: update XPaths for modern mobile UI (#5836)

2026-03-10T08:05:54Z

Google recently changed the DOM structure for mobile-centric responses, causing the `google_videos` engine to return zero results and the main `google` engine to drop the majority of its results (due to missing snippets or failed URL parsing). These changes restore the functionality and improve the result count for both engines. This patch updates the parsing logic for both the `google` and `google_videos` engines to handle the modern HTML structure returned by Google when using GSA (Google Search App) User-Agents. **Specific changes include:** * **Google Videos (`gov`)**: * Updated title XPath to support `role="heading"`. * Improved URL extraction to correctly decode Google redirectors (`/url?q=...`) using `unquote`. * Added support for the `WRu9Cd` class to capture publication metadata (author/date). * Broadened thumbnail search and added a fallback to YouTube's `hqdefault.jpg`. * **Google Web**: * Relaxed the strict snippet (`content`) requirement. Valid results are no longer discarded if a snippet is missing in the mobile UI. * Hardened URL extraction to handle both direct and redirected URLs safely. * Improved thumbnail extraction by searching the entire result block.