mirror of
https://github.com/searxng/searxng.git
synced 2025-08-27 13:56:57 +02:00
1ec325adcc
In order to be able to meet the outstanding requirements, the implementation is modularized and supplemented with documentation. This patch does not contain functional change, except it fixes issue #2455 ---- Aktivate limiter in the settings.yml and simulate a bot request by:: curl -H 'Accept-Language: de-DE,en-US;q=0.7,en;q=0.3' \ -H 'Accept: text/html' -H 'User-Agent: xyz' \ -H 'Accept-Encoding: gzip' \ 'http://127.0.0.1:8888/search?q=foo' In the LOG: DEBUG searx.botdetection.link_token : missing ping for this request: ..... Since ``BURST_MAX_SUSPICIOUS = 2`` you can repeat the query above two time before you get a "Too Many Requests" response. Closes: https://github.com/searxng/searxng/issues/2455 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
45 lines
740 B
ReStructuredText
45 lines
740 B
ReStructuredText
.. _botdetection:
|
|
|
|
=============
|
|
Bot Detection
|
|
=============
|
|
|
|
.. contents:: Contents
|
|
:depth: 2
|
|
:local:
|
|
:backlinks: entry
|
|
|
|
.. automodule:: searx.botdetection
|
|
:members:
|
|
|
|
.. automodule:: searx.botdetection.limiter
|
|
:members:
|
|
|
|
|
|
Rate limit
|
|
==========
|
|
|
|
.. automodule:: searx.botdetection.ip_limit
|
|
:members:
|
|
|
|
.. automodule:: searx.botdetection.link_token
|
|
:members:
|
|
|
|
|
|
Probe HTTP headers
|
|
==================
|
|
|
|
.. automodule:: searx.botdetection.http_accept
|
|
:members:
|
|
|
|
.. automodule:: searx.botdetection.http_accept_encoding
|
|
:members:
|
|
|
|
.. automodule:: searx.botdetection.http_accept_language
|
|
:members:
|
|
|
|
.. automodule:: searx.botdetection.http_connection
|
|
:members:
|
|
|
|
.. automodule:: searx.botdetection.http_user_agent
|
|
:members:
|