searxng/searx/utils.py, branch master

[fix] engines: update brave images/videos parser and news xpath

2026-09-05T17:45:40Z

[feat] results: automatically set embedded stream url for video results

2026-09-03T15:28:29Z

Currently, many engines that provide video results call the same `get_embedded_stream_url` method for setting the `iframe_src`. There is no value in that because this logic is engine-specific and probably many video engines forgot to implement this. With these changes, it's done automatically, so engine implementors don't have to worry about setting an `iframe_src` (unless the engine explicitly has a field for it).

[chore] Google (HTML) engine: remove obsolete GSA User-Agents (#6366)

2026-07-05T10:07:23Z

The GSA headers that were introduced in PR #5644 unfortunately no longer work (#6359). The Google engines - google.py - google_videos.py do not work anymore either, but we'll leave it in the code for now: - In google.py, central functions like get_google_info(..) are provided, which are also used by other modules. - We will probably need a Google HTML (and video) engine again very soon. Related: - https://github.com/searxng/searxng/issues/6359 - https://github.com/searxng/searxng/pull/6364 Signed-off-by: Markus Heiser

[feat] engines: add dogpile (general, news, images, videos)

2026-06-11T14:09:13Z

Add support for the Dogpile search engine, found at: https://seirdy.one/posts/2021/03/10/search-engines-with-own-indexes/ It seems to use the same index as startpage because results are similar and they share the ``qadf`` (Safe-Search) request parameter.

[mod] odysee: move format_duration helper into utils.py

2026-06-11T14:09:13Z

[fix] google: switch to using "Google Go App" (NSTNWV) useragent

2026-04-10T08:09:02Z

[fix] google: switch to using "Google App" for Android useragent (#5892)

2026-03-23T13:55:48Z

I found a bypass using the Android Google App this time. However, unlike the iPhone GSA method, this one does have rate limits. Although it took a couple of hundred consecutive requests to trigger them.

[mod] drop fasttext-predict (#5795)

2026-03-06T14:40:44Z

Removes the `fasttext-predict` dependency and the language detection code. If a user now selects `auto` for the search language, the detected language now falls back directly to the `Accept-Language` header sent by the browser (which was already the fallback when fasttext returned no result). - fasttext's [language detection is unreliable](https://github.com/searxng/searxng/issues/4195) for some languages, especially short search queries, and in particular for queries containing proper names which is a common case. - `fasttext-predict` consumes [significant memory](https://github.com/searxng/searxng/pull/1969#issuecomment-1345366676) without offering users much real value. - the upstream fasttext project was archived by Meta in 2024 - users already have two better alternatives: the `Accept-Language` header and the search-syntax language prefix (e.g. `:fr` or `:de`). Related: https://github.com/searxng/searxng/issues/4195 Closes: https://github.com/searxng/searxng/issues/5790

[mod] fix some minor type hint issues / add some type hints more

2026-02-22T08:30:16Z

Signed-off-by: Markus Heiser

[fix] google: switch to using GSA for iPhone useragent

2026-01-11T15:21:01Z