forked from zeek/broker
-
Notifications
You must be signed in to change notification settings - Fork 2
/
Copy pathCHANGES
2111 lines (1183 loc) · 67.6 KB
/
CHANGES
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
2.5.0-dev.79 | 2023-03-23 21:00:02 +0100
* Fix tick_interval usage in send_later (Arne Welzel, Corelight)
2.5.0-dev.77 | 2023-03-19 15:01:44 +0100
* Add new btest for the status reporting over HTTP (Dominik Charousset, Corelight)
* Support Zeek-style port notation as arguments (Dominik Charousset, Corelight)
Our `btest`-suites pass Zeek-style port notation such as "1024/tcp" as
arguments to Broker. By dealing with them at the endpoint level, we can
avoid the overhead of stripping the protocol suffixes when adding more
`btest` suites that interact with Broker tools.
* Add instrumentation and status collection logic (Dominik Charousset, Corelight)
2.5.0-dev.69 | 2023-03-18 17:05:15 -0700
* Pick up CAF patch for Prometheus (Dominik Charousset, Corelight)
2.5.0-dev.67 | 2023-03-17 09:25:55 +0100
* Use IPv6 mode for accept sockets by default (Dominik Charousset, Corelight)
2.5.0-dev.64 | 2023-03-12 12:51:02 -0700
* Update benchmarker Cirrus secrets to use org-level values (Tim Wojtulewicz, Corelight)
2.5.0-dev.62 | 2023-03-04 11:07:48 +0100
* Fix regression in endpoint::peers (Dominik Charousset, Corelight)
2.5.0-dev.59 | 2023-02-01 15:33:14 -0700
* Bump pybind11 to version 2.10.3 (Tim Wojtulewicz, Corelight)
2.5.0-dev.55 | 2023-01-28 10:08:31 +0100
* sqlite_backend: Add a few more backend_options (Arne Welzel, Corelight)
* synchronous to run 'PRAGMA synchronous=<value>' during initialization.
* journal_mode to run 'PRAGMA journal_mode=<value>' during initialization.
* failure_mode to delete the database and reopen it when
an error occurs during initialization.
* integrity_check to run PRAGMA integrity_check during initialization to
reliably detect corrupted databases.
2.5.0-dev.46 | 2023-01-10 17:28:37 -0800
* CI: switch action/checkout to v3 (Christian Kreibich, Corelight)
* CI: remove Fedora 35, now EOL (Christian Kreibich, Corelight)
2.5.0-dev.44 | 2023-01-10 16:49:10 +0100
* Implement graceful disconnect handshake (Dominik Charousset, Corelight)
2.5.0-dev.36 | 2023-01-05 12:08:33 -0700
* CI: macOS platform updates (Tim Wojtulewicz, Corelight)
- Add Ventura build
- Switch all macOS builds to use M1 images. x86_64 builds are no longer supported
by Cirrus for macOS as of 2023/1/1.
- Drop Big Sur build
2.5.0-dev.34 | 2022-11-29 14:46:24 +0100
* Add formatting helper for consistent pre/post Python 3.11 enum stringification (Christian Kreibich, Corelight)
* CI: add Fedora 37 (Christian Kreibich, Corelight)
2.5.0-dev.31 | 2022-11-22 13:13:43 -0700
* Zeek 5.0.x compatibility (Dominik Charousset, Corelight)
2.5.0-dev.29 | 2022-11-22 13:13:09 -0700
* Fix formatting (Dominik Charousset, Corelight)
* Fix clang-tidy warnings (Dominik Charousset, Corelight)
* Fix handling of peer/client errors (Dominik Charousset, Corelight)
* Set missing flag during unpeering process (Dominik Charousset, Corelight)
* Migrate to CAF 0.19 backport of the flow API (Dominik Charousset, Corelight)
2.5.0-dev.22 | 2022-11-21 09:54:18 -0700
* Windows CI: make Dockerfile a little more like one in Zeek (Tim Wojtulewicz, Corelight)
- Install choco in a much less-verbose way
- Use choco to install VS build tools and git
2.5.0-dev.20 | 2022-11-15 11:49:21 -0700
* Update CAF submodule for SPCP buffer fix (Dominik Charousset, Corelight)
2.5.0-dev.18 | 2022-11-14 12:21:07 -0700
* Minimize messaging in sim_clock::advance_time (Dominik Charousset, Corelight)
2.5.0-dev.16 | 2022-11-14 12:17:17 -0700
* Tweak documentation for --with-log-level (Dominik Charousset, Corelight)
* Configure script: drop --with-caf, add -D option (Dominik Charousset, Corelight)
2.5.0-dev.12 | 2022-11-14 12:16:44 -0700
* Add interface include dirs to broker lib targets (Dominik Charousset, Corelight)
2.5.0-dev.10 | 2022-11-14 12:16:23 -0700
* Drop CAF incubator: caf-net moved to the main repo (Dominik Charousset, Corelight)
2.5.0-dev.8 | 2022-11-14 12:15:19 -0700
* Remove LGTM config file (Dominik Charousset, Corelight)
* Apply LGTM recommendations for some minor findings (Dominik Charousset, Corelight)
2.5.0-dev.4 | 2022-11-09 18:27:33 -0700
* Add the branch whitelist to the Windows/Clang-Tidy Cirrus tasks (Tim Wojtulewicz, Corelight)
2.5.0-dev.2 | 2022-11-09 10:45:06 -0700
* Merge commit 'd9db9ce515f576dc8a4113b1accc489a645bd43c' (Tim Wojtulewicz, Corelight)
* commit 'd9db9ce515f576dc8a4113b1accc489a645bd43c':
Enable modernize-* checks and apply auto-fixes
* Enable modernize-* checks and apply auto-fixes (Dominik Charousset, Corelight)
* Update submodules [nomail] [skip ci] (Tim Wojtulewicz)
2.4.0-dev.86 | 2022-10-20 16:49:49 -0700
* Fix CMake package file when bundling CAF (Dominik Charousset, Corelight)
* Fix messaging between clone and proxy (Dominik Charousset, Corelight)
2.4.0-dev.82 | 2022-10-19 19:37:01 -0700
* Update cmake submodule [nomail] (Tim Wojtulewicz, Corelight)
* Moved include CXX17 directive as per CR instruction (Tomer Lev)
* Bumped cmake submodule commit (Tomer Lev)
* Adding suuport to MSVC under windows platform (Tomer Lev)
2.4.0-dev.77 | 2022-10-02 10:22:23 +0200
* Performance improvements (Dominik Charousset, Corelight)
- Fix performance bottleneck in Broker-internal caching (see #277)
- Improve performance with the `stealing` scheduler policy
(see https://github.com/zeek/zeek/issues/2332)
2.4.0-dev.75 | 2022-09-21 09:56:19 -0700
* Fix a clang-tidy failure from a recent merge (Tim Wojtulewicz, Corelight)
* Fix minor formatting issue (Tim Wojtulewicz, Corelight)
2.4.0-dev.72 | 2022-09-20 08:49:22 -0700
* Get initial number of entries from the backend (Dominik Charousset, Corelight)
* Add additional health and performance metrics (Dominik Charousset, Corelight)
2.4.0-dev.69 | 2022-09-20 08:20:48 -0700
* Enable performance-* checks and fix findings (Dominik Charousset, Corelight)
2.4.0-dev.66 | 2022-09-19 09:21:27 -0700
* Fix error handling with OpenSSL calls (Dominik Charousset, Corelight)
2.4.0-dev.64 | 2022-09-13 08:14:22 -0400
* Avoid unnecessary copies (Dominik Charousset, Corelight)
* Add clang-tidy to CI with an initial set of checks (Dominik Charousset, Corelight)
2.4.0-dev.61 | 2022-09-07 16:43:16 +0200
* Update CAF submodule to fix stalling Broker pipelines (Dominik Charousset, Corelight)
2.4.0-dev.59 | 2022-08-26 09:02:43 -0700
* Add missing error signaling (Dominik Charousset, Corelight)
2.4.0-dev.57 | 2022-08-24 12:57:52 +0100
* Fix formatting (Dominik Charousset, Corelight)
* Allow clients to change the import metric topics (Dominik Charousset, Corelight)
2.4.0-dev.54 | 2022-08-22 16:41:54 +0200
* Remove the retry limit on peerings (Dominik Charousset, Corelight)
2.4.0-dev.52 | 2022-08-22 16:40:48 +0200
* Set SO_REUSEADDR for the Prometheus HTTP server (Dominik Charousset, Corelight)
2.4.0-dev.50 | 2022-08-22 16:39:58 +0200
* Revert accidental change to CMake file from #255 (Dominik Charousset, Corelight)
2.4.0-dev.48 | 2022-08-18 08:03:54 +0200
* Fix AUTO_CAUSES_COPY coverity reportings (Arne Welzel, Corelight)
2.4.0-dev.46 | 2022-08-09 10:54:42 +0200
* Add getters for bucket settings on family handles (Dominik Charousset, Corelight)
2.4.0-dev.42 | 2022-08-08 10:48:37 +0200
* Remove dead code and obsolete files (Dominik Charousset, Corelight)
2.4.0-dev.39 | 2022-08-03 20:44:57 +0200
* Apply clang-format to the code base, add CI check (Dominik Charousset, Corelight)
2.4.0-dev.37 | 2022-08-03 19:01:24 +0200
* Upgrade pybind11 to version 2.10.0 (Dominik Charousset, Corelight)
2.4.0-dev.35 | 2022-08-03 07:52:15 +0200
* Fix warnings on GCC by dropping [[nodiscard]] on convert functions (Dominik Charousset, Corelight)
2.4.0-dev.33 | 2022-08-02 20:06:17 +0200
* telemetry: Introduce a broker::metrics_collector. (Arne Welzel, Corelight)
- Add collect() on the registry and implement proxying between
broker::telemetry and caf::telemetry via metrics_collector
- Add new upcast() and value() overloads for const-pointers to handles
2.4.0-dev.26 | 2022-07-07 14:17:50 -0700
* CI updates (Christian Kreibich, Corelight)
- add FreeBSD 13.1 and fix broken link
- add Opensuse Tumbleweed
- drop Ubuntu 21.10, EOL 2022-07-14
- remove Debian 9, EOL 2022-06-30
* Make more and better use of C++17 features (Dominik Charousset, Corelight)
- Use `if constexpr` over `enable_if` in more places
- Consequently use `foo_v<...>` over `foo<...>::value`
- Drop legacy C++14 and C++17 backports in `type_traits.hh`
- Use better type introspection to allow `convert` to return `void`
- Make more consistent use of the `convert` API
2.4.0-dev.19 | 2022-06-27 15:48:47 -0700
* Fix double-close on pipe handles (Dominik Charousset, Corelight)
2.4.0-dev.17 | 2022-06-27 10:10:35 -0700
* CI distribution updates (Johanna Amann, Corelight)
Update distribution list to the same list we use for Zeek
2.4.0-dev.15 | 2022-06-24 12:53:34 -0700
* Fix recently introduced warnings on GCC (Dominik Charousset, Corelight)
2.4.0-dev.13 | 2022-06-24 12:53:18 -0700
* Point out that --with-caf is for-development-only (Dominik Charousset, Corelight)
* Keep make dist from deleting all paths containing 'build' [skip ci] (Tim Wojtulewicz, Corelight)
2.4.0-dev.10 | 2022-06-21 10:55:43 -0700
* Add new btest for put_unique (Dominik Charousset, Corelight)
* Streamline clone actor logic (Dominik Charousset, Corelight)
* Protect against clones receiving wrong inputs (Dominik Charousset, Corelight)
* Use multiple proxies per node for put_unique test (Dominik Charousset, Corelight)
* Remove unused message type (Dominik Charousset, Corelight)
2.4.0-dev.2 | 2022-06-14 09:19:25 -0700
* Dockerfile updates for consistency with recent Zeek changes (Tim Wojtulewicz, Corelight)
2.3.0 | 2022-06-03 11:39:10 -0700
* Release 2.3.0
2.2.0-323 | 2022-06-02 11:40:39 -0700
* Require newer cmake, and bump cmake installed in CI images (Tim Wojtulewicz, Corelight)
2.2.0-320 | 2022-06-01 21:09:40 +0200
* Fix leak in WebSockets. (Dominik Charousset, Corelight)
* Fix warning on GCC. (Dominik Charousset, Corelight)
* Run btests with ASAN/LeakSanitizer on CI. (Dominik Charousset, Corelight)
2.2.0-316 | 2022-06-01 12:24:56 +0200
* Add version negotiation to the handshake process. (Dominik
Charousset, Corelight)
* Fix double-close on sockets. (Dominik Charousset, Corelight)
* Enable new handshake tests in `btest.cfg`. (Dominik Charousset,
Corelight)
2.2.0-311 | 2022-05-30 11:08:11 +0200
* Implement new fan-out benchmark (Dominik Charousset, Corelight)
2.2.0-309 | 2022-05-30 11:07:09 +0200
* Remove deprecated std::iterator usage (Tim Wojtulewicz, Corelight)
2.2.0-307 | 2022-05-30 11:06:19 +0200
* Set SO_REUSEADDR by default. (Dominik Charousset, Corelight)
2.2.0-305 | 2022-05-30 11:00:52 +0200
* Fix minor Coverity findings. (Dominik Charousset, Corelight)
2.2.0-303 | 2022-05-30 10:31:23 +0200
* Add WebSocket support. (Dominik Charousset, Corelight)
Broker now offers access to the publish/subscribe layer via
WebSocket in order to make its data model accessible to third
parties. WebSocket clients are treated as lightweight peers. Each
Broker endpoint can be configured to act as a WebSocket server by
either setting the environment variable
``BROKER_WEB_SOCKET_PORT``; by setting ``broker.web-socket.port``
on the command line or in the configuration file; or
programmatically by calling ``endpoint::web_socket_listen``. See
``docs/web-socket.rst`` for more information.
2.2.0-277 | 2022-05-23 10:26:53 -0700
* Fix warning when building on macOS (Dominik Charousset, Corelight)
2.2.0-275 | 2022-05-23 10:24:52 -0700
* Drop broken FreeBSD 11 build from pipeline (Dominik Charousset, Corelight)
2.2.0-272 | 2022-05-04 11:14:41 -0700
* Expand tests to verify handling of Python-unsafe types sent by Zeek (Christian Kreibich, Corelight)
* Add broker.zeek.SafeEvent to work around data rendering problems (Christian Kreibich, Corelight)
* Expand HashableDict in favor of types.MappingProxyType (Christian Kreibich, Corelight)
2.2.0-268 | 2022-05-04 10:42:37 -0700
* Remove missed usage of previously-removed bro.py (Tim Wojtulewicz, Corelight)
2.2.0-267 | 2022-05-04 09:44:46 -0700
* Remove long-deprecated bro.py (Tim Wojtulewicz)
2.2.0-265 | 2022-05-04 09:42:30 -0700
* Remove accidentally included .tmp folder for broker-cluster-benchmark (Christian Kreibich, Corelight)
2.2.0-263 | 2022-04-28 19:46:01 +0000
* Implement new ALM transport (Dominik Charousset, Corelight)
This is too long of a change to list all of the commits in this file, but
the full list can be seen in https://github.com/zeek/broker/pull/201.
2.2.0-35 | 2022-03-18 13:39:43 -0700
* Disable LeakSanitizer on Windows (Tim Wojtulewicz, Corelight)
* Disable python bindings in Windows CI builds (Tim Wojtulewicz)
* Fix _MSC_VER macro usage that was breaking macro expansion (Tim Wojtulewicz)
* Output more information when CTest fails (Tim Wojtulewicz)
* Wrap GCC pragmas to avoid warnings on Windows (Tim Wojtulewicz)
* Normalize paths when installing python bindings (Tim Wojtulewicz)
* Set proper environment in test.cmd (Tim Wojtulewicz)
* Fix address::convert_from (Dominik Charousset, Corelight)
* Fix build on MSVC (Dominik Charousset)
* Rework CI scripts for Windows (Tim Wojtulewicz, Corelight)
2.2.0-22 | 2022-02-09 12:56:35 -0800
* CI support refresh (Christian Kreibich, Corelight)
- add FreeBSD 14
- add Ubuntu 21.10
- remove OpenSUSE Leap 15.2 (EOL)
- add CentOS Stream 9
- remove Fedora 33 (EOL)
2.2.0-16 | 2022-02-07 16:21:18 +0100
* Avoid exposing CAF internals. (Dominik Charousset, Corelight)
Remove all CAF dependencies from public headers and build the
bundled CAF version as static, private utility. Consumers of
Broker no longer need to locate CAF headers and we do not install
any CAF content alongside Broker, i.e., Broker becomes fully
standalone.
Where possible, Broker uses recent C++ additions like `std::variant` to
replace CAF types. For types that have no equivalent, Broker deploys
fully opaque handle types. For example, `broker::worker` internally
wraps a `caf::actor` handle.
All components in Broker that require access to CAF were grouped into
the new namespace `broker::internal`. We omit all internal headers from
an installation, since they would be worthless without the matching CAF
headers anyways. This also gives us a clean separation between API
artifacts users may interact with and API parts that are reserved for
internal use.
2.2.0-4 | 2022-01-27 14:49:00 -0700
* Have `make dist` cleanup a few more wayward files before tarring (Tim Wojtulewicz, Corelight)
* Remove CentOS 8 from CI. (Tim Wojtulewicz, Corelight)
EOL was 2021-12-31
2.2.0 | 2021-12-20 19:32:33 -0800
* Merge branch 'topic/christian/fix-python-unhashables' (Christian Kreibich, Corelight)
* topic/christian/fix-python-unhashables:
Add testcases for new Python SafeSubscriber class
Provide a SafeSubscriber class in Python to accommodate non-hashable types
Add immutable values to Python data type testsuite
Python cleanup: remove unneeded semicolons and trailing whitespace
* Add testcases for new Python SafeSubscriber class (Christian Kreibich, Corelight)
* Provide a SafeSubscriber class in Python to accommodate non-hashable types (Christian Kreibich, Corelight)
Broker's data model supports nested complex types, such as a set with table
members. When rendering such structures into Python, this could trigger
TypeError exceptions due to unhashable types.
The SafeSubscriber class and the corresponding Endpoint.make_safe_subscriber()
method ensure that immutable (hashable) Python types get used and that the
returned values are read-only. For sets the frozenset type achieves this, for
mapping types it's types.MappingProxyType. The API now also supports the latter
two types as inputs.
* Add immutable values to Python data type testsuite (Christian Kreibich, Corelight)
* Python cleanup: remove unneeded semicolons and trailing whitespace (Christian Kreibich, Corelight)
2.2.0-dev.17 | 2021-11-05 13:38:17 -0700
* Request at least Sphinx 2.0 to avoid a dependency problem in RTD (Christian Kreibich, Corelight)
* Introduce .readthedocs.yaml to avoid docs directory (Christian Kreibich, Corelight)
2.2.0-dev.14 | 2021-11-05 12:47:15 -0700
* Add macOS Monterey and drop Catalina in CI (Christian Kreibich, Corelight)
* Add Fedora 35 in CI (Christian Kreibich, Corelight)
2.2.0-dev.10 | 2021-08-26 14:30:39 -0700
* CI support refresh (Christian Kreibich, Corelight)
- Add Debian 11 (Bullseye)
- Drop Ubuntu 16.04
2.2.0-dev.8 | 2021-08-03 11:55:22 -0700
* Fix publisher deadlock when passing large batches (Dominik Charousset, Corelight)
2.2.0-dev.6 | 2021-07-28 19:08:17 -0700
* Fix output of build-type CFLAGS during configure (Tim Wojtulewicz, Corelight)
* Update HMAC key for benchmarking service (Tim Wojtulewicz, Corelight)
2.2.0-dev.3 | 2021-07-16 19:02:24 -0700
* Raise CAF dependency to 0.18.5 and update embedded version (Tim Wojtulewicz, Corelight)
2.1.0 | 2021-07-08 09:49:23 -0700
* Release 2.1.0.
2.1.0-dev.90 | 2021-07-08 09:49:16 -0700
* Raise CAF dependency to 0.18.4 and update embedded version (Tim Wojtulewicz, Corelight)
* Bring back process metrics (Dominik Charousset, Corelight)
2.1.0-dev.87 | 2021-07-02 10:02:22 -0700
* Fix is_prefix logic (Dominik Charousset, Corelight)
* Remove global topic variables (Dominik Charousset, Corelight)
Fix a potential memory corruption during static initialization by
avoiding global variables with non-trivial constructors.
2.1.0-dev.83 | 2021-06-28 08:44:56 -0700
* Fix heap-use-after-free during shutdown (Dominik Charousset, Corelight)
2.1.0-dev.81 | 2021-06-21 15:56:14 -0700
* CI support refresh to bring in line with Zeek (Christian Kreibich, Corelight)
* Update port used by benchmark host (Tim Wojtulewicz, Corelight)
2.1.0-dev.78 | 2021-06-07 09:22:35 -0700
* Remove noexcept from functions that may throw
Functions that access a `variant` of a `metric_view` may throw
`broker::bad_variant_access`. (Dominik Charousset, Corelight)
* Fix uninitialized field warnings (Dominik Charousset, Corelight)
2.1.0-dev.75 | 2021-06-01 10:18:00 -0700
* Make telemetry exporter configurable at runtime (Dominik Charousset, Corelight)
* Raise CAF dependency to 0.18.3 (Dominik Charousset, Corelight)
* Update CAF submodule (Dominik Charousset, Corelight)
* Enable Broker to collect cluster metrics (Dominik Charousset, Corelight)
* Add remaining meta data to scrape output (Dominik Charousset, Corelight)
* Add support for histograms to the scraper (Dominik Charousset, Corelight)
* Implement new publishing mode for local metrics (Dominik Charousset, Corelight)
2.1.0-dev.67 | 2021-05-24 15:22:34 -0700
* Change how actor_system_config::config_file_path is set (Jon Siwek, Corelight)
Mainly avoid conflict with an upcoming change
2.1.0-dev.66 | 2021-05-24 15:01:34 -0700
* Update embedded CAF to 0.18.3 (Jon Siwek, Corelight)
And migrate a now-deprecated actor_system_config::parse() usage.
2.1.0-dev.65 | 2021-04-19 16:14:38 -0700
* Fix broker-pipe crash with static CAF builds (Dominik Charousset, Corelight)
2.1.0-dev.63 | 2021-04-19 16:01:51 -0700
* Remove redundant code in "integration" test (Dominik Charousset, Corelight)
2.1.0-dev.61 | 2021-03-27 14:15:37 -0700
* Bump libbroker soversion to 4 (Jon Siwek, Corelight)
* Update bundled CAF to 0.18.2 (Jon Siwek, Corelight)
2.1.0-dev.58 | 2021-03-17 13:45:33 -0700
* Prevent use of LeakSanitizer on FreeBSD (Jon Siwek, Corelight)
2.1.0-dev.56 | 2021-03-08 12:27:52 -0800
* Improve error handling for data store backend creation failures (Jon Siwek, Corelight)
* Change broker::filesystem::detail functions that rely on
std::filesystem to use non-throwing calls
* Add error messages to some broker::filesystem::detail functions:
mkdirs(), remove(), and remove_all()
* Use sqlite3_errmsg() to emit reason for sqlite3_open() failures
* Change sqlite backend initialization failures to be non-fatal
Related to https://github.com/zeek/zeek/issues/1426
2.1.0-dev.54 | 2021-03-02 19:59:06 -0700
* Add lgtm configuration (Tim Wojtulewicz, Corelight)
2.1.0-dev.52 | 2021-02-26 17:57:58 -0800
* Fix to allow hashing of Python binding's broker.Count type (Jon Siwek, Corelight)
2.1.0-dev.50 | 2021-02-22 15:45:38 -0800
* Enable metrics exposition via BROKER_METRICS_PORT (Dominik Charousset, Corelight)
2.1.0-dev.48 | 2021-02-16 13:58:19 -0800
* Increase CPUs used for macOS CI builds (Jon Siwek, Corelight)
2.1.0-dev.47 | 2021-02-16 12:30:36 -0800
* broker-benchmark: Fix heap-buffer overflow when receiving stats (Dominik Charousset, Corelight)
* Fix metrics and TTL of locally published data (Dominik Charousset, Corelight)
* Implement more lightweight origin credit tracking (Dominik Charousset, Corelight)
The item-based tracking of message origins keeps all context for input
messages. However, benchmarking reveled that this nice-to-have property
comes at an expensive price.
The new approach for tracking how many inputs for each origin are
currently in the system leverages the reference count of Broker messages
that we need in any case rather than introducing additional state.
* Disable background deserialization (Dominik Charousset, Corelight)
Zeek configures only a few threads to the CAF thread pool. This may
introduce some heavy delays for the deserialization that takes place in
the background. Disabling this feature altogether makes sure that
messages will not end up in some queues even though it puts more
pressure on the multiplexer's thread.
2.1.0-dev.42 | 2021-02-11 12:10:05 -0800
* Disable syntax highlighting for some overview documentation (Jon Siwek, Corelight)
* Add Python bindings example docs for representing Zeek records (Jon Siwek, Corelight)
* Fix typo in data model documentation (Jon Siwek, Corelight)
2.1.0-dev.39 | 2021-01-25 21:17:05 -0800
* Add missing comments to example Windows Dockerfile (Jon Siwek, Corelight)
* Add Travis CI config for Windows OS (Jon Siwek, Corelight)
2.1.0-dev.36 | 2021-01-25 12:27:58 -0800
* Update embedded CAF to 0.18 (Jon Siwek, Corelight)
* Add CI support for running cluster benchmarks (Tim Wojtulewicz, Corelight)
2.1.0-dev.33 | 2021-01-21 16:15:32 -0800
* Fix deprecation warnings with latest CAF (Dominik Charousset, Corelight)
* Clean up remaining caf::hash::fnv TODO (Dominik Charousset, Corelight)
CAF 0.18 introduced an FNV hashing visitor that we can use instead of
rolling custom hash algorithms and hash combinators.
* Replace unsafe (to|from)_blob functions (Dominik Charousset, Corelight)
The utility functions `to_blob` and `from_blob` in
`broker/detail/blob.hh` silently ignored any error during serialization
and deserialization. Since the functions were only used by the SQLite
backend, the new implementations with proper error propagation (and
cleaned up interface) moved to `sqlite_backend.cc`.
2.1.0-dev.27 | 2021-01-19 21:07:18 -0800
* Update Cirrus CI naming for MacOS images (Christian Kreibich, Corelight)
The docs on https://cirrus-ci.org/guide/macOS/ changed from
"osx_instance" to "macos_instance", so let's reflect that.
2.1.0-dev.25 | 2021-01-12 20:19:56 -0800
* GH-165: Fix possible deadlock by implementing new origin-based credit strategy (Dominik Charousset, Corelight)
2.1.0-dev.16 | 2021-01-11 11:05:53 -0800
* Remove deprecated broker::memory/broker::sqlite enums (Jon Siwek, Corelight)
* Remove unused and broken rocksdb backend (Dominik Charousset, Corelight)
2.1.0-dev.12 | 2021-01-04 15:40:56 -0800
* broker-cluster-benchmark: Fix type mismatch and potential cleanup issue (Dominik Charousset, Corelight)
2.1.0-dev.10 | 2020-12-23 10:13:37 -0800
* Call `ctest` instead of `make test` in CI builds (Dominik Charousset, Corelight)
Setting `CTEST_OUTPUT_ON_FAILURE` and then calling `make test` seems to
lose the flag at some point. Calling `ctest` directly and passing
`--output-on-failure` makes sure that we actually get the test output in
case of an error.
2.1.0-dev.8 | 2020-12-21 10:53:48 -0800
* Add macOS Big Sur to CI (Jon Siwek, Corelight)
2.1.0-dev.6 | 2020-12-17 16:04:25 -0800
* Remove explicit use of config mode for finding CAF (Dominik Charousset, Corelight)
2.1.0-dev.4 | 2020-12-17 10:36:12 -0700
* Fix CAF configuration parameter names (Dominik Charousset, Corelight)
2.1.0-dev.2 | 2020-12-16 15:04:30 -0800
* Make sure status updates are visible before data (Dominik Charousset, Corelight)
2.1.0-dev | 2020-12-14 20:16:02 -0800
* Update NEWS for start of v2.1.0 development (Jon Siwek, Corelight)
1.5.0-dev.63 | 2020-12-14 10:38:14 -0800
* Update CAF submodule to fix handling of --libdir (Jon Siwek, Corelight)
1.5.0-dev.62 | 2020-12-12 18:28:25 -0800
* Change `configure --prefix` to not set CMAKE_INSTALL_LIBDIR (Jon Siwek, Corelight)
In places where that libdir option is used and not explicitly set
before, it will already correctly prepend CMAKE_INSTALL_PREFIX. Having
the configure script use the hardcoded 'lib' also prevented the
automatic use of 'lib64' on platforms that prefer it.
1.5.0-dev.61 | 2020-12-10 14:07:51 -0800
* Add Jenkinsfile for re-enabling Windows builds (Dominik Charousset, Corelight)
* Add Python context manager support (Dominik Charousset, Corelight)
For proper resource management/cleanup, the Python API now requires
using Endpoint, Subscriber, StatusSubscriber, and Store objects within a
`with` statement or alternatively doing an explicit call to the
``reset()`` method of subscriber/store objects before the associated
Endpoint's ``shutdown()`` method.
Co-authored-by: Jon Siwek <[email protected]>
* Disable Windows builds via Travis CI (Dominik Charousset, Corelight)
Remove the YAML file for Travis CI due to issues with getting Visual
Studio 2019 with support for `std::filesystem` working on Travis. This
is supposed to be a temporary measure until either finding a fix for the
setup or re-enabling Windows build through some other means.
* Fix handling of initial subscription set (Dominik Charousset, Corelight)
* Add missing to_string overloads (Dominik Charousset, Corelight)
* Make CMake scaffold more robust against re-runs (Dominik Charousset, Corelight)
* Clean up deprecation warnings for CAF 0.18 (Dominik Charousset, Corelight)
* Fix CAF paths for bundled CAF version (Dominik Charousset, Corelight)
* Migrate to CAF 0.18, update CAF submodule (Dominik Charousset, Corelight)
1.5.0-dev.43 | 2020-12-09 17:27:31 -0800
* Update SQLite to 3.34.0 (Jon Siwek, Corelight)
1.5.0-dev.42 | 2020-12-04 13:05:41 -0800
* Add FreeBSD 11.4 and 12.2 to CI (Jon Siwek, Corelight)
1.5.0-dev.40 | 2020-12-04 11:32:19 -0800
* Suppress interactive tzdata setup on Ubuntu (Dominik Charousset)
* Call update on Debian-based distros before install (Dominik Charousset)
* Update CI build matrix (Dominik Charousset)
* Update and streamline Docker files (Dominik Charousset)
1.5.0-dev.34 | 2020-12-02 11:05:55 -0800
* Update minimum required CMake to 3.5 (Jon Siwek, Corelight)
1.5.0-dev.32 | 2020-12-02 10:57:29 -0800
* Upgrade pybind11 to v2.6.1 and fix compatibility issues (Jon Siwek, Corelight)
1.5.0-dev.30 | 2020-11-26 18:12:38 +0000
* Update macOS CI to use system default Python 3 (Jon Siwek, Corelight)
* Remove Python 2 compatibility logic (Jon Siwek, Corelight)
* Update CMake logic to enforce Python >= 3.5 for Python Bindings (Jon Siwek, Corelight)
* Update Python Bindings docs for new Python >= 3.5 requirements (Jon Siwek, Corelight)
* Update cmake submodules with changes related to Python 2 EOL (Jon Siwek, Corelight)
1.5.0-dev.22 | 2020-10-21 15:37:57 -0700
* Move CI from Fedora 30 (EOL) to Fedora 32 (Jon Siwek, Corelight)
1.5.0-dev.20 | 2020-10-21 15:14:55 -0700
* Update Windows CI config (Jon Siwek, Corelight)
* Disable Cirrus Windows task: an updated Docker image on Cirrus-side
has unknown issues and trying to create one for ourselves also ended
with similar, unsuccessful results
* Provide an example Dockerfile that uses Visual Studio 2019, which may
help as a starting point for manual testing/development purposes
* Enable Travis for testing just Windows
1.5.0-dev.16 | 2020-08-21 11:41:06 -0700
* Respect --config-file= CLI parameters (Dominik Charousset, Corelight)
1.5.0-dev.14 | 2020-07-30 16:08:56 -0700
* Fix build with CAF 0.18 (Dominik Charousset)
1.5.0-dev.12 | 2020-07-27 18:17:13 -0700
* Use 127.0.0.1 instead of ::1 for cluster configs (Dominik Charousset)
* Call abort() on errors during cluster benchmarks (Dominik Charousset)
Orderly shutdowns seem to fail for some categories of errors. Calling
`abort` ensures that the program at least always terminates, even though
this means skipping cleanup of system resources such as open ports.
* Make cluster-benchmark tool modular, add new mode (Dominik Charousset)
Rather than using flags to change the behavior, the configuration of the
tool now asks for a mode. This makes the tool easier to extend and use.
Previously the behavior of mutualy exclusive flags (for example, setting
both `--generate-config` and `--dump-stats`) was not well defined.
Furthermore, this commits adds another mode: `shrink-generator-file`.
This enables users to reduce the size of recordings retrospectively.
* Add factory function for creating generator file headers (Dominik Charousset)
* Add new read_raw method to expose generator file input bytes (Dominik Charousset)
* Make broker-cluster-benchmark config file output independent of argv order (Dominik Charousset)
* Add integration test for broker-cluster-benchmark (Dominik Charousset)
* Support reading the cluster benchmark config from STDIN (Dominik Charousset)
1.5.0-dev | 2020-07-27 10:45:17 -0700
* Update NEWS for v1.5.0-dev placeholder (Jon Siwek, Corelight)
1.4.0 | 2020-07-27 10:28:25 -0700
* Release 1.4.0
1.4.0-dev.171 | 2020-07-24 15:28:49 -0700
* Update embedded CAF 0.17.6 (Jon Siwek, Corelight)
1.4.0-dev.170 | 2020-07-24 13:53:33 -0700
* Use std::move in some broker::store methods (Jon Siwek, Corelight)
1.4.0-dev.169 | 2020-07-24 11:28:34 -0700
* Silence self-assign-overloaded warning on Clang (Dominik Charousset)
1.4.0-dev.165 | 2020-07-16 18:30:03 -0700
* Update CAF to release/0.17 branch (Jon Siwek, Corelight)
1.4.0-dev.164 | 2020-07-14 14:56:23 -0700
* Properly initialize stack buffers in the flare (Dominik Charousset)
1.4.0-dev.162 | 2020-07-13 09:19:40 -0700
* GH-129: improve logging for stale store expiry reminders (Jon Siwek, Corelight)
1.4.0-dev.160 | 2020-07-10 16:51:18 -0700
* broker-cluster-benchmark: Avoid extra peerings on startup (Dominik Charousset)
* broker-cluster-benchmark: Fix loop detection and tree printing (Dominik Charousset)
1.4.0-dev.157 | 2020-07-08 08:33:03 -0700
* Change default console logging verbosity to "error" (Jon Siwek, Corelight)
1.4.0-dev.155 | 2020-07-07 12:40:20 -0700
* Improve error messages emitted from SQLite backend (Jon Siwek, Corelight)
* Fix typos in docs (Jon Siwek, Corelight)
* Add Python SQLite-backed data store examples (Jon Siwek, Corelight)
* Fix syntax highlighting for Python examples (Jon Siwek, Corelight)
* Fix docs to include snippets from correct header path (Jon Siwek, Corelight)
1.4.0-dev.150 | 2020-06-30 10:58:03 -0700
* Include store IDs in the topic (Dominik Charousset)
As discussed in #121, adding the store ID to the topic enables better
control over the amount of data a subscriber receives by selecting only
stores of interest.
1.4.0-dev.148 | 2020-06-23 16:10:07 -0700
* Use the right variable when opening peers.txt for recording data (Tim Wojtulewicz, Corelight)
1.4.0-dev.146 | 2020-06-12 18:01:03 -0700
* Differentiate between data store remove and expire events (Dominik Charousset)
* Remove the multimap for data store clones (Dominik Charousset)
1.4.0-dev.141 | 2020-06-02 10:53:09 -0700
* Change CI script to compile from build/Makefile (Jon Siwek, Corelight)
1.4.0-dev.140 | 2020-06-01 12:16:17 -0700
* Add store ID to insert, update and erase events (Dominik Charousset)
1.4.0-dev.138 | 2020-05-29 17:33:07 -0700
* Add benchmark targets to installed files (Tim Wojtulewicz, Corelight)
1.4.0-dev.136 | 2020-05-28 14:08:26 -0700
* Move recording logic to mixin (Dominik Charousset)
* Move data store management to mixin (Dominik Charousset)
* Move connection and notification logic to mixins (Dominik Charousset)
1.4.0-dev.131 | 2020-05-19 10:48:28 -0700
* Fix definition of broker::infinite (Dominik Charousset)
* Bump required CAF version to >= 0.17.5 (Dominik Charousset)
* Update CAF submodule (Dominik Charousset)
* Port Broker to CAF 0.18 (Dominik Charousset)
With the new forward compatibility macros in CAF 0.17.5, we can support
both CAF releases with a few select #ifdef blocks until switching fully
to CAF 0.18.
* Switch to _v suffix notation for atoms (Dominik Charousset)
* Use CAF's new type ID API (Dominik Charousset)
1.4.0-dev.121 | 2020-05-15 10:37:27 -0700
* Use BROKER_WINDOWS in conditionals for MinGW (Noah Treuhaft)
1.4.0-dev.118 | 2020-05-13 11:12:51 -0700
* Add CMake variable to disable doc examples (Tim Wojtulewicz, Corelight)
1.4.0-dev.116 | 2020-04-30 18:29:35 -0700