searxng/searx/data
Markus Heiser d29cf64ce4
[mod] searx.data: lazy load of the data objects (databases) (#4834)
In the previous implementation, all databases were loaded into memory when
importing the searx.data package, regardless of whether they were ever needed.

Regardless of this, it is an antipattern to load entire databases into memory
when importing a package or module; databases should be loaded when needed.

Lazy loading is a first step toward improving memory usage and also improves
performance when setting up the runtime environment.  Building on this,
subsequent PRs will be able to further optimize memory behavior, e.g., by using
a real database application such as the one already available via

    searx.cache.ExpireCache

Related:

- https://github.com/searxng/searxng/discussions/1892
- https://github.com/searxng/searxng/pull/3458
- https://github.com/searxng/searxng/pull/4650

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2025-05-22 16:23:30 +02:00
..
__init__.py [mod] searx.data: lazy load of the data objects (databases) (#4834) 2025-05-22 16:23:30 +02:00
ahmia_blacklist.txt [data] update searx.data - update_ahmia_blacklist.py (#4739) 2025-05-09 07:09:00 +02:00
currencies.json [data] update searx.data - update_currencies.py (#4740) 2025-05-09 07:08:26 +02:00
engine_descriptions.json [data] update searx.data - update_engine_descriptions.py (#4742) 2025-05-09 07:06:52 +02:00
engine_traits.json [data] update searx.data - update_engine_traits.py (#4741) 2025-05-09 07:07:33 +02:00
external_bangs.json [data] update searx.data - update_external_bangs.py 2025-04-29 07:06:10 +02:00
external_urls.json [mod] add external_urls.json and wikidata_units.json 2020-10-28 08:09:25 +01:00
lid.176.ftz [mod] new plugin: Autodetect search language 2022-12-10 13:11:47 +01:00
locales.json [l10n] update translations from Weblate 2025-01-10 08:13:22 +01:00
osm_keys_tags.json [data] update searx.data - make data.all 2025-01-13 08:02:01 +01:00
useragents.json [data] update searx.data - update_firefox_version.py 2025-04-29 07:06:26 +02:00
wikidata_units.json [data] update searx.data - update_wikidata_units.py (#4738) 2025-05-09 07:09:58 +02:00