searxng/searxng_extra/update/update_engine_descriptions.py, branch custom

[mod] update_engine_descriptions.py - revision of the script (#6309)

2026-06-24T10:10:28Z

* [mod] update_engine_descriptions.py - revision of the script (#6309) The script was a bit outdated, type hints were missing, and the strings were converted to double quotation marks The `descriptions.items()` are sorted to avoid assigning the references to seen_descriptions randomly (should reduce unnecessary diffs in the future). Signed-off-by: Markus Heiser * [data] update searx.data - update_engine_descriptions.py (#6309) Signed-off-by: Markus Heiser --------- Signed-off-by: Markus Heiser

[mod] drop fasttext-predict (#5795)

2026-03-06T14:40:44Z

Removes the `fasttext-predict` dependency and the language detection code. If a user now selects `auto` for the search language, the detected language now falls back directly to the `Accept-Language` header sent by the browser (which was already the fallback when fasttext returned no result). - fasttext's [language detection is unreliable](https://github.com/searxng/searxng/issues/4195) for some languages, especially short search queries, and in particular for queries containing proper names which is a common case. - `fasttext-predict` consumes [significant memory](https://github.com/searxng/searxng/pull/1969#issuecomment-1345366676) without offering users much real value. - the upstream fasttext project was archived by Meta in 2024 - users already have two better alternatives: the `Accept-Language` header and the search-syntax language prefix (e.g. `:fr` or `:de`). Related: https://github.com/searxng/searxng/issues/4195 Closes: https://github.com/searxng/searxng/issues/5790

[fix] cleanup: rename `searx` leftovers to `SearXNG` (#5049)

2025-07-26T04:22:46Z

Signed-off-by: Markus Heiser

[mod] pylint all files with one profile / drop PYLINT_SEARXNG_DISABLE_OPTION

2024-03-11T13:55:38Z

In the past, some files were tested with the standard profile, others with a profile in which most of the messages were switched off ... some files were not checked at all. - ``PYLINT_SEARXNG_DISABLE_OPTION`` has been abolished - the distinction ``# lint: pylint`` is no longer necessary - the pylint tasks have been reduced from three to two 1. ./searx/engines -> lint engines with additional builtins 2. ./searx ./searxng_extra ./tests -> lint all other python files Signed-off-by: Markus Heiser

[mod] comprehensive revision of the searxng_extra/update/ scripts

2024-03-10T14:56:50Z

- pylint all scripts - fix some errors reported by pyright - from searx.data import data_dir (Path.open) - fix import from pygments.formatters.html NOTE: none functional changes! Signed-off-by: Markus Heiser

[fix] searxng_extra/update/update_engine_descriptions.py (part 2)

2023-04-15T14:04:05Z

Wikipedia description are fetched without the help the wikipedia engine: * the SQPARL query return the wikipedia URL of the article

[fix] searxng_extra/update/update_engine_descriptions.py (part 1)

2023-04-15T14:03:59Z

Follow up of #2269 The script to update the descriptions of the engines does no longer work since PR #2269 has been merged. searx/engines/wikipedia.py ========================== 1. There was a misusage of zh-classical.wikipedia.org: - `zh-classical` is dedicate to classical Chinese [1] which is not traditional Chinese [2]. - zh.wikipedia.org has LanguageConverter enabled [3] and is going to dynamically show simplified or traditional Chinese according to the HTTP Accept-Language header. 2. The update_engine_descriptions.py needs a list of all wikipedias. The implementation from #2269 included only a reduced list: - https://meta.wikimedia.org/wiki/Wikipedia_article_depth - https://meta.wikimedia.org/wiki/List_of_Wikipedias searxng_extra/update/update_engine_descriptions.py ================================================== Before PR #2269 there was a match_language() function that did an approximation using various methods. With PR #2269 there are only the types in the data model of the languages, which can be recognized by babel. The approximation methods, which are needed (only here) in the determination of the descriptions, must be replaced by other methods. [1] https://en.wikipedia.org/wiki/Classical_Chinese [2] https://en.wikipedia.org/wiki/Traditional_Chinese_characters [3] https://www.mediawiki.org/wiki/Writing_systems#LanguageConverter Closes: https://github.com/searxng/searxng/issues/2330 Signed-off-by: Markus Heiser

[mod] replace utils.match_language by locales.match_locale

2023-03-24T09:37:42Z

This patch replaces the *full of magic* ``utils.match_language`` function by a ``locales.match_locale``. The ``locales.match_locale`` function is based on the ``locales.build_engine_locales`` introduced in 9ae409a0 [1]. In the past SearXNG did only support a search by a language but not in a region. This has been changed a long time ago and regions have been added to SearXNG core but not to the engines. The ``utils.match_language`` was the function to handle the different aspects of language/regions in SearXNG core and the supported *languages* in the engine. The ``utils.match_language`` did it with some magic and works good for most use cases but fails in some edge case. To replace the concurrence of languages and regions in the SearXNG core the ``locales.build_engine_locales`` was introduced in 9ae409a0 [1]. With the last patches all engines has been migrated to a ``fetch_traits`` and a language/region concept that is based on ``locales.build_engine_locales``. To summarize: there is no longer a need for the ``locales.match_language``. [1] https://github.com/searxng/searxng/pull/1652 Signed-off-by: Markus Heiser

Replace langdetect with fasttext

2022-12-16T19:07:39Z

fix searxng_extra/update/update*.py scripts

2022-07-02T10:16:00Z

call searx.locales.locales_initialize before using LOCALE_NAMES Related to https://github.com/searxng/searxng/pull/1306