remove hyperscan resolver (#745)

* remove hyperscan resolver * remove hyperscan resolver * update CHANGELOG
fkie-cad · Jan 28, 2025 · ca1ae75 · ca1ae75
1 parent cc2e6b8
commit ca1ae75
Show file tree

Hide file tree

Showing 21 changed files with 24 additions and 1,458 deletions.
diff --git a/.github/workflows/main.yml b/.github/workflows/main.yml
@@ -37,7 +37,6 @@ jobs:
 
       - name: Install dependencies
         run: |
-          sudo apt-get update && sudo apt-get -y install libhyperscan-dev librdkafka-dev
           pip install --upgrade pip wheel
           pip install .[dev]
 

diff --git a/CHANGELOG.md b/CHANGELOG.md
@@ -2,6 +2,9 @@
 
 ## next release
 ### Breaking
+
+* remove `hyperscan_resolver` processor because it is not significantly faster as the `generic_resolver` with enabled cache
+
 ### Features
 ### Improvements
 ### Bugfix

diff --git a/doc/source/configuration/processor.rst b/doc/source/configuration/processor.rst
@@ -19,7 +19,6 @@ Processors
 .. automodule:: logprep.processor.generic_resolver.processor
 .. automodule:: logprep.processor.geoip_enricher.processor
 .. automodule:: logprep.processor.grokker.processor
-.. automodule:: logprep.processor.hyperscan_resolver.processor
 .. automodule:: logprep.processor.ip_informer.processor
 .. automodule:: logprep.processor.key_checker.processor
 .. automodule:: logprep.processor.labeler.processor

diff --git a/doc/source/development/architecture/diagramms/process-Combined.drawio b/doc/source/development/architecture/diagramms/process-Combined.drawio
diff --git a/doc/source/development/architecture/diagramms/process-Combined.drawio.html b/doc/source/development/architecture/diagramms/process-Combined.drawio.html
diff --git a/logprep/processor/generic_resolver/rule.py b/logprep/processor/generic_resolver/rule.py
@@ -3,7 +3,6 @@
 ^^^^^^^^^^^^^^^^^^
 
 The generic resolver requires the additional field :code:`generic_resolver`.
-It works similarly to the hyperscan resolver, which utilizes hyperscan to process resolve lists.
 Configurable fields are being checked by regex patterns and a configurable value will be added
 if a pattern matches.
 The parameters within :code:`generic_resolver` must be of the form

diff --git a/logprep/processor/hyperscan_resolver/__init__.py b/logprep/processor/hyperscan_resolver/__init__.py
diff --git a/logprep/processor/hyperscan_resolver/processor.py b/logprep/processor/hyperscan_resolver/processor.py