RSDK-9345 Deduplicate noisy logs

[benjirewis]

RSDK-9345

Main changes:

• Stops outputting logs from the same sublogger that have already been output 3 times in the past 10 seconds
• Outputs an "aggregation" log for any logs deemed noisy (see above point) at the end of 10 seconds before another log is output
• Parses new disable_log_deduplication JSON flag to potentially disable the logic described in the above two points

Testing changes:

• Small changes to existing logging tests
• Adds tests for log entry hashkeying
• Adds tests for log entry hashkeying

[benjirewis]

Still working on testing a bit, but thought I'd throw this into review before the holiday.

[benjirewis]

Still adding remaining tests and then will re-request review.

[benjirewis]

Still adding remaining tests and then will re-request review.

Added and requested.

[cheukt]

LGTM

[benjirewis]

The level of the aggregation log that's output here is equivalent to the most recent noisy log's level. You'll see in the test I wrote that this means that if I log 3 identical INFO logs followed by a 4th identical ERROR log, the aggregation log will appear as ERROR level. This is sort of strange, but I'm inclined to not care too much about this case since most identical logs will not differ in level. I suppose this raises the question of whether or not level should be considered as part of identicality but I'll stick to the scope for now.

[dgottlieb]

I'm fine with the behavior you described.

[dgottlieb]

I agree this is correct because cfg is default initialized, but this feels like the seedling of a bug. cfg.DisableLogDeduplication = proto.DisableLogDeduplication is less lines and isn't prone to the default initialization value assumption.

[benjirewis]

...I have no idea what I was thinking here haha. Switched to cfg.DisableLogDeduplication = proto.DisableLogDeduplication.