compression on the wire and at rest

[vigith]

Summary

There are 2 major limiting factors for increasing the TPS

• 40 MB/s limitation imposed by JS for a given stream
• inbound and outbound network bandwidth of the node on which the pod is scheduled

The easiest way to improve the TPS is by reducing the data transfer bytes by compressing the data.

Compressing the data before writing to the ISB will reduce the data at rest size, which will improve the performance of JS node restart.

[whynowy]

https://github.com/klauspost/compress

[vigith]

We didn't see a lot of improvements due to size reduction.