Add a feature to compute a checksum for each line. It could then be used as a unique event id in elasticsearch.