Skip to content

Add CEF processor to Ingest node #122491

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 112 commits into
base: main
Choose a base branch
from
Draft
Changes from all commits
Commits
Show all changes
112 commits
Select commit Hold shift + click to select a range
1eb0658
Marius base code
bhapas Feb 13, 2025
6086a56
[CI] Auto commit changes from spotless
elasticsearchmachine Feb 13, 2025
4559e7a
add cef processor test
bhapas Feb 13, 2025
8723924
Merge branch 'cef_processor' of github.com:bhapas/elasticsearch into …
bhapas Feb 13, 2025
32e3357
Modify the parser and add more tests
bhapas Mar 19, 2025
78c8f90
[CI] Auto commit changes from spotless
elasticsearchmachine Mar 19, 2025
7c4ead4
Fix parser and add more tests
bhapas Mar 20, 2025
566eb76
[CI] Auto commit changes from spotless
elasticsearchmachine Mar 20, 2025
5072cab
Move ecs mapping to root
bhapas Mar 20, 2025
3d605c8
Merge branch 'cef_processor' of github.com:bhapas/elasticsearch into …
bhapas Mar 20, 2025
7773754
[CI] Auto commit changes from spotless
elasticsearchmachine Mar 20, 2025
287b837
move non-ecs fields under cef.extensions
bhapas Mar 20, 2025
eef2ce9
Merge branch 'cef_processor' of github.com:bhapas/elasticsearch into …
bhapas Mar 20, 2025
9dc96e4
[CI] Auto commit changes from spotless
elasticsearchmachine Mar 20, 2025
ed19446
move ecs fields to ingestdocument root
bhapas Mar 21, 2025
a6d1738
Merge branch 'main' into cef_processor
bhapas Mar 21, 2025
31ab55d
[CI] Auto commit changes from spotless
elasticsearchmachine Mar 21, 2025
b0ff719
fix tests
bhapas Mar 24, 2025
f1bbbf6
[CI] Auto commit changes from spotless
elasticsearchmachine Mar 24, 2025
10ef758
Fix commit issues
bhapas Mar 24, 2025
0c3ba47
fix negative test
bhapas Mar 24, 2025
c101a2f
Update date time handling
bhapas Mar 26, 2025
4a1a9ac
fix review comments
bhapas Mar 26, 2025
6b8b735
Merge branch 'main' into cef_processor
bhapas Mar 26, 2025
c53e1d7
fix more comments
bhapas Mar 26, 2025
0008f8a
Make parser independent of ingestDocument
bhapas Mar 27, 2025
757a48d
Pass copy of headerFields to process
bhapas Mar 27, 2025
de33dd4
Merge branch 'main' into cef_processor
bhapas Mar 27, 2025
1f66766
return fast if type is string
bhapas Mar 27, 2025
3f883c9
Prefer List.of over Arrays.asList
joegallo Mar 27, 2025
ac13d2a
Rename this variable
joegallo Mar 27, 2025
a761d14
Move this definition
joegallo Mar 27, 2025
893dadf
Do not copy these maps
joegallo Mar 27, 2025
28d5dc3
Conserve precious characters
joegallo Mar 27, 2025
e7553b9
Whitespace
joegallo Mar 27, 2025
8800f1e
Silence some warnings from IntelliJ
joegallo Mar 27, 2025
94c9914
Allocate the immutable set statically
joegallo Mar 27, 2025
63f06eb
There's no need to copy this list
joegallo Mar 27, 2025
4e4bd11
Conserve precious characters
joegallo Mar 27, 2025
e00aef1
Implement MACAddress and IP types
bhapas Mar 27, 2025
2a2b868
Change to traditional looping
bhapas Mar 28, 2025
48c6e1e
Merge branch 'main' into cef_processor
bhapas Mar 28, 2025
67ba4e0
Handle missed keys for different CEF logs
bhapas Mar 29, 2025
15a0de2
Merge branch 'main' into cef_processor
bhapas Mar 29, 2025
9981768
Merge branch 'main' into cef_processor
bhapas Mar 29, 2025
fb8570c
Merge branch 'main' into cef_processor
bhapas Mar 31, 2025
95bb8a0
Conserve precious characters
joegallo Mar 31, 2025
6543bcb
do not modify collection in getter
bhapas Mar 31, 2025
7ee0213
convert if/else to switch
bhapas Mar 31, 2025
4b97c8c
Don't use a default here
joegallo Mar 31, 2025
c80f3ae
Reorder these conditions
joegallo Mar 31, 2025
0d139cd
Add extensions only if not empty
bhapas Apr 1, 2025
494a31b
Use record for ExtensionMapping
bhapas Apr 1, 2025
78b9cc9
private method
bhapas Apr 1, 2025
79c8257
fix test to match source than each field
bhapas Apr 1, 2025
4a29172
Use Map.of for small Maps
joegallo Apr 1, 2025
ce1c4df
Drop an unnecessary annotation
joegallo Apr 1, 2025
2a71566
Rename this variable
joegallo Apr 1, 2025
528504f
Handle the extensions with processExtensions
joegallo Apr 1, 2025
7578da0
Drop extensions from CEFEvent entirely
joegallo Apr 1, 2025
8722039
Manage the event lifecycle a little more tightly
joegallo Apr 1, 2025
a44847d
Fuss with the visibility
joegallo Apr 1, 2025
3f10cf8
Nest the cef mappings correctly as sub-objects
joegallo Apr 1, 2025
fc26614
Merge branch 'main' into cef_processor
joegallo Apr 1, 2025
e758833
verify tests against the whole document source
bhapas Apr 2, 2025
9b9747f
[CI] Auto commit changes from spotless
elasticsearchmachine Apr 2, 2025
10fc6ec
Do not allow escaped pipe in extensions
bhapas Apr 2, 2025
782406f
Use a statement lambda
joegallo Apr 2, 2025
cde11da
Prefer Map.of when it's a one-liner
joegallo Apr 2, 2025
985d39d
There's no need to have these as variables
joegallo Apr 2, 2025
9c86847
Add a utility for comparing maps
joegallo Apr 2, 2025
fab11f1
Change exception message
bhapas Apr 3, 2025
d755948
Merge branch 'main' into cef_processor
bhapas Apr 3, 2025
803b752
One of these things is not like the others
joegallo Apr 3, 2025
a9db5d1
This can be static
joegallo Apr 3, 2025
4ca1950
Conserve precious characters
joegallo Apr 3, 2025
7ff8e45
Flatten the map structure
joegallo Apr 3, 2025
cb7ae4d
Tighten up this implementation
joegallo Apr 3, 2025
d7bf4c8
Whitespace
joegallo Apr 3, 2025
d0c2b5c
Rename this parameter and some variables
joegallo Apr 3, 2025
e0338a3
Conserve precious characters
joegallo Apr 3, 2025
4bdae8e
Reorder these statements
joegallo Apr 3, 2025
5c3ee2b
The dataType is never null
joegallo Apr 3, 2025
2b5bfd2
Fix test naming
bhapas Apr 4, 2025
b627194
Merge branch 'main' into cef_processor
bhapas Apr 4, 2025
136806d
Use the InetAddresses utility for this
joegallo Apr 4, 2025
367a9e9
make private
bhapas Apr 6, 2025
9aa97a1
Make Pattern compilation static
bhapas Apr 6, 2025
d1841b9
Merge branch 'main' into cef_processor
bhapas Apr 6, 2025
5eeae58
Merge branch 'main' into cef_processor
bhapas Apr 8, 2025
ee969db
Throw exception for incomplete CEF header
bhapas Apr 9, 2025
4470e10
Add doc for Timestamp formats
bhapas Apr 11, 2025
12fdafd
Merge branch 'main' into cef_processor
bhapas Apr 11, 2025
e7242d6
Add appendix details
bhapas Apr 11, 2025
6a5ff53
Merge branch 'main' into cef_processor
bhapas Apr 11, 2025
2fecc52
Simplify the list of supported formats
joegallo Apr 11, 2025
009d1ac
Rewrite the header processing to avoid regexes
joegallo Apr 11, 2025
c4f39a6
Merge branch 'main' into cef_processor
joegallo Apr 11, 2025
c0ab658
Fix datatypes as per spec
bhapas Apr 14, 2025
d3e1e33
Fix reason to lowercase
bhapas Apr 14, 2025
af4d865
Change label to lowercase
bhapas Apr 14, 2025
24ce925
Change deviceFacility to String per spec
bhapas Apr 14, 2025
edf2699
Merge branch 'main' into cef_processor
bhapas Apr 14, 2025
1687e5d
Correct field types according to spec
bhapas Apr 14, 2025
c71e855
Add CEF spec 1.x fields
bhapas Apr 14, 2025
a3bd7ab
Remove unnnecessary code
bhapas Apr 14, 2025
f967ff7
Remove unused constant
bhapas Apr 14, 2025
e830af1
Merge branch 'main' into cef_processor
bhapas Apr 14, 2025
3f7c3d4
Fix handling of spaces
bhapas Apr 14, 2025
df48fc7
Throw exception on unescaped equals sign
bhapas Apr 14, 2025
7684ee1
Merge branch 'main' into cef_processor
bhapas Apr 14, 2025
1a08d4d
Merge branch 'main' into cef_processor
bhapas Apr 14, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading