searxng/searx/engines/google_videos.py, branch master

[mod] engines: migrate video engines away from get_embedded_stream_url

2026-09-03T15:28:29Z

[fix] google: use Nokia UA (#6546)

2026-08-22T03:00:06Z

[fix] google engine: Result image thumbnails

2026-03-16T22:35:33Z

[fix] google engines: update XPaths for modern mobile UI (#5836)

2026-03-10T08:05:54Z

Google recently changed the DOM structure for mobile-centric responses, causing the `google_videos` engine to return zero results and the main `google` engine to drop the majority of its results (due to missing snippets or failed URL parsing). These changes restore the functionality and improve the result count for both engines. This patch updates the parsing logic for both the `google` and `google_videos` engines to handle the modern HTML structure returned by Google when using GSA (Google Search App) User-Agents. **Specific changes include:** * **Google Videos (`gov`)**: * Updated title XPath to support `role="heading"`. * Improved URL extraction to correctly decode Google redirectors (`/url?q=...`) using `unquote`. * Added support for the `WRu9Cd` class to capture publication metadata (author/date). * Broadened thumbnail search and added a fallback to YouTube's `hqdefault.jpg`. * **Google Web**: * Relaxed the strict snippet (`content`) requirement. Valid results are no longer discarded if a snippet is missing in the mobile UI. * Hardened URL extraction to handle both direct and redirected URLs safely. * Improved thumbnail extraction by searching the entire result block.

[mod] drop: from future import annotations

2025-09-03T11:37:36Z

Signed-off-by: Markus Heiser

[mod] addition of various type hints / tbc

2025-09-03T11:37:36Z

- pyright configuration [1]_ - stub files: types-lxml [2]_ - addition of various type hints - enable use of new type system features on older Python versions [3]_ - ``.tool-versions`` - set python to lowest version we support (3.10.18) [4]_: Older versions typically lack some typing features found in newer Python versions. Therefore, for local type checking (before commit), it is necessary to use the older Python interpreter. .. [1] https://docs.basedpyright.com/v1.20.0/configuration/config-files/ .. [2] https://pypi.org/project/types-lxml/ .. [3] https://typing-extensions.readthedocs.io/en/latest/# .. [4] https://mise.jdx.dev/configuration.html#tool-versions Signed-off-by: Markus Heiser Format: reST

[fix] google video: refactor broken engine to work again

2025-07-25T19:40:53Z

The current google_videos.py in the master branch is completely non functional, due to it not parsing the returned video search results correctly. The result is searxng saying that no results were found. This commit is a new updated google_videos.py that's designed to fix that and is confirmed to be working. Implementing the suggestions by Bnyro. Re-formatted with `black` for compatibility. After failing automated checks, ran the command: black --line-length 120 --skip-string-normalization --target-version py311 google_videos.py

[doc] add missing docs for the search.max_page setting

2025-03-07T09:07:41Z

Signed-off-by: Markus Heiser

[fix] engines: Google-Web & Google-Video (random arc_id)

2025-03-06T14:43:53Z

Both enghines have been reported ``TooManyRequests``, additionaly Google-Videos thumbnails needed a review. Based on the research from @unixfox [1] this patch generates every hour a new random ``arc_id``. [1] https://github.com/searxng/searxng/issues/4435#issuecomment-2703279522 Closes: - https://github.com/searxng/searxng/issues/4435 - https://github.com/searxng/searxng/issues/4431 Related: - https://github.com/searxng/searxng/discussions/4434 - https://github.com/searxng/searxng/discussions/4429 Signed-off-by: Markus Heiser

[fix] engine google_video: google changed the layout of the HTML response

2024-12-22T10:45:46Z

Closes: https://github.com/searxng/searxng/issues/4127 Signed-off-by: Markus Heiser