core: prioritize the heavy transaction for prefetching

[rjl493456442]

Don't merge it now. Only for testing purpose.

[rjl493456442]

[[ Master ]]

INFO [10-17|00:54:51.108] ########## SLOW BLOCK #########
INFO [10-17|00:54:51.108] Block: 23593931 (0xf80007b08695bb2626b0f854ab7e5b66421d144fa35e888834ccd53776bddec0) txs: 278, mgasps: 192.53
INFO [10-17|00:54:51.108] EVM execution: 106.748ms
INFO [10-17|00:54:51.108] Validation: 1.654ms
INFO [10-17|00:54:51.108] Account read: 8.921ms(1574)
INFO [10-17|00:54:51.108] Storage read: 40.503ms(2343)
INFO [10-17|00:54:51.108] "Account hash: 12.207ms(wait=2.33µs)"
INFO [10-17|00:54:51.108] Storage hash: 42.457ms
INFO [10-17|00:54:51.108] DB commit: 6.733ms
INFO [10-17|00:54:51.108] Block write: 3.715ms
INFO [10-17|00:54:51.108] Total: 218.348ms
INFO [10-17|00:54:51.108] Reader statistics
INFO [10-17|00:54:51.108] account: hit: 1505, miss: 69, rate: 95.62
INFO [10-17|00:54:51.108] storage: hit: 1885, miss: 458, rate: 80.45
INFO [10-17|00:54:51.108] ##############################

[[ PR ]]

INFO [10-17|00:54:51.040] ########## SLOW BLOCK #########
INFO [10-17|00:54:51.040] Block: 23593931 (0xf80007b08695bb2626b0f854ab7e5b66421d144fa35e888834ccd53776bddec0) txs: 278, mgasps: 277.96
INFO [10-17|00:54:51.040] EVM execution: 108.618ms
INFO [10-17|00:54:51.040] Validation: 1.749ms
INFO [10-17|00:54:51.040] Account read: 2.296ms(1574)
INFO [10-17|00:54:51.040] Storage read: 2.811ms(2343)
INFO [10-17|00:54:51.040] "Account hash: 8.108ms(wait=1.18µs)"
INFO [10-17|00:54:51.040] Storage hash: 23.636ms
INFO [10-17|00:54:51.040] DB commit: 5.176ms
INFO [10-17|00:54:51.040] Block write: 2.508ms
INFO [10-17|00:54:51.040] Total: 151.241ms
INFO [10-17|00:54:51.040] Reader statistics
INFO [10-17|00:54:51.040] account: hit: 1554, miss: 20, rate: 98.73
INFO [10-17|00:54:51.040] storage: hit: 2231, miss: 112, rate: 95.22
INFO [10-17|00:54:51.040] ##############################

[rjl493456442]

[[ Master ]]

INFO [10-17|00:55:37.972] ########## SLOW BLOCK #########
INFO [10-17|00:55:37.972] Block: 23593935 (0x1b8e79f3c77589772657866ce10aca2c42a38c402cee5957f9597f56cdf63647) txs: 169, mgasps: 194.13
INFO [10-17|00:55:37.972] EVM execution: 36.996ms
INFO [10-17|00:55:37.972] Validation: 1.044ms
INFO [10-17|00:55:37.972] Account read: 15.383ms(949)
INFO [10-17|00:55:37.972] Storage read: 70.856ms(1459)
INFO [10-17|00:55:37.972] "Account hash: 4.183ms(wait=2µs)"
INFO [10-17|00:55:37.972] Storage hash: 30.216ms
INFO [10-17|00:55:37.972] DB commit: 5.183ms
INFO [10-17|00:55:37.972] Block write: 1.191ms
INFO [10-17|00:55:37.972] Total: 163.650ms
INFO [10-17|00:55:37.972] Reader statistics
INFO [10-17|00:55:37.972] account: hit: 830, miss: 119, rate: 87.46
INFO [10-17|00:55:37.972] storage: hit: 802, miss: 657, rate: 54.97
INFO [10-17|00:55:37.972] ##############################

[[ PR ]]

INFO [10-17|00:55:37.951] ########## SLOW BLOCK #########
INFO [10-17|00:55:37.951] Block: 23593935 (0x1b8e79f3c77589772657866ce10aca2c42a38c402cee5957f9597f56cdf63647) txs: 169, mgasps: 223.71
INFO [10-17|00:55:37.951] EVM execution: 47.776ms
INFO [10-17|00:55:37.951] Validation: 1.058ms
INFO [10-17|00:55:37.951] Account read: 10.399ms(949)
INFO [10-17|00:55:37.951] Storage read: 32.693ms(1459)
INFO [10-17|00:55:37.951] "Account hash: 8.165ms(wait=2.51µs)"
INFO [10-17|00:55:37.951] Storage hash: 35.921ms
INFO [10-17|00:55:37.951] DB commit: 7.875ms
INFO [10-17|00:55:37.951] Block write: 1.603ms
INFO [10-17|00:55:37.951] Total: 142.006ms
INFO [10-17|00:55:37.951] Reader statistics
INFO [10-17|00:55:37.951] account: hit: 847, miss: 102, rate: 89.25
INFO [10-17|00:55:37.951] storage: hit: 959, miss: 500, rate: 65.73
INFO [10-17|00:55:37.951] ##############################

[rjl493456442]

[[ Master ]]

INFO [10-17|00:56:49.739] ########## SLOW BLOCK #########
INFO [10-17|00:56:49.739] Block: 23593941 (0x301baf293bacd17d33de8186b059fd6fb27d9d25bf617ea33dea9c762e595977) txs: 310, mgasps: 131.73
INFO [10-17|00:56:49.739] EVM execution: 56.218ms
INFO [10-17|00:56:49.739] Validation: 3.063ms
INFO [10-17|00:56:49.739] Account read: 20.118ms(998)
INFO [10-17|00:56:49.739] Storage read: 80.769ms(2653)
INFO [10-17|00:56:49.739] "Account hash: 5.634ms(wait=1.94µs)"
INFO [10-17|00:56:49.739] Storage hash: 43.849ms
INFO [10-17|00:56:49.739] DB commit: 8.165ms
INFO [10-17|00:56:49.739] Block write: 1.611ms
INFO [10-17|00:56:49.739] Total: 217.084ms
INFO [10-17|00:56:49.739] Reader statistics
INFO [10-17|00:56:49.739] account: hit: 837, miss: 161, rate: 83.87
INFO [10-17|00:56:49.739] storage: hit: 1833, miss: 820, rate: 69.09
INFO [10-17|00:56:49.739] ##############################

[[ PR ]]

INFO [10-17|00:56:49.770] ########## SLOW BLOCK #########
INFO [10-17|00:56:49.770] Block: 23593941 (0x301baf293bacd17d33de8186b059fd6fb27d9d25bf617ea33dea9c762e595977) txs: 310, mgasps: 199.91
INFO [10-17|00:56:49.770] EVM execution: 64.232ms
INFO [10-17|00:56:49.770] Validation: 1.943ms
INFO [10-17|00:56:49.770] Account read: 10.503ms(998)
INFO [10-17|00:56:49.770] Storage read: 30.768ms(2653)
INFO [10-17|00:56:49.770] "Account hash: 4.847ms(wait=1.63µs)"
INFO [10-17|00:56:49.770] Storage hash: 26.494ms
INFO [10-17|00:56:49.770] DB commit: 5.604ms
INFO [10-17|00:56:49.770] Block write: 1.166ms
INFO [10-17|00:56:49.770] Total: 143.049ms
INFO [10-17|00:56:49.770] Reader statistics
INFO [10-17|00:56:49.770] account: hit: 906, miss: 92, rate: 90.78
INFO [10-17|00:56:49.770] storage: hit: 2185, miss: 468, rate: 82.36
INFO [10-17|00:56:49.770] ##############################

[rjl493456442]

I think the prefetching reordering is beneficial for the blocks with heavy transactions in general.
The storage read part is significantly improved, although these numbers can be affected by various factors.

From the storage cache hit rate, it's also constantly higher than the master

[rjl493456442]

For a normal block without heavy tx

[[ MAster ]]

INFO [10-17|00:57:01.129] ########## SLOW BLOCK #########
INFO [10-17|00:57:01.129] Block: 23593942 (0x569e29a4c890aae3f6bd411fdc52c9d7504eff95bf101277f0493fcf73d5c7e4) txs: 161, mgasps: 203.68
INFO [10-17|00:57:01.129] EVM execution: 60.147ms
INFO [10-17|00:57:01.129] Validation: 1.617ms
INFO [10-17|00:57:01.129] Account read: 1.240ms(537)
INFO [10-17|00:57:01.129] "Storage read: 791.683µs(1317)"
INFO [10-17|00:57:01.129] "Account hash: 3.918ms(wait=1.67µs)"
INFO [10-17|00:57:01.129] Storage hash: 5.488ms
INFO [10-17|00:57:01.129] DB commit: 5.854ms
INFO [10-17|00:57:01.129] Block write: 1.228ms
INFO [10-17|00:57:01.129] Total: 78.725ms
INFO [10-17|00:57:01.129] Reader statistics
INFO [10-17|00:57:01.129] account: hit: 528, miss: 9, rate: 98.32
INFO [10-17|00:57:01.129] storage: hit: 1299, miss: 18, rate: 98.63
INFO [10-17|00:57:01.129] ##############################

[[ PR ]]

INFO [10-17|00:57:01.113] ########## SLOW BLOCK #########
INFO [10-17|00:57:01.113] Block: 23593942 (0x569e29a4c890aae3f6bd411fdc52c9d7504eff95bf101277f0493fcf73d5c7e4) txs: 161, mgasps: 261.69
INFO [10-17|00:57:01.113] EVM execution: 45.149ms
INFO [10-17|00:57:01.113] "Validation: 959.183µs"
INFO [10-17|00:57:01.113] "Account read: 983.464µs(537)"
INFO [10-17|00:57:01.113] "Storage read: 990.556µs(1317)"
INFO [10-17|00:57:01.113] "Account hash: 4.761ms(wait=810ns)"
INFO [10-17|00:57:01.113] Storage hash: 3.845ms
INFO [10-17|00:57:01.113] DB commit: 5.138ms
INFO [10-17|00:57:01.113] Block write: 1.078ms
INFO [10-17|00:57:01.113] Total: 61.273ms
INFO [10-17|00:57:01.113] Reader statistics
INFO [10-17|00:57:01.113] account: hit: 526, miss: 11, rate: 97.95
INFO [10-17|00:57:01.113] storage: hit: 1289, miss: 28, rate: 97.87
INFO [10-17|00:57:01.113] ##############################

There is no big difference in terms of state read, the master even has a slightly higher cache hit rate.

[rjl493456442]

So there are 1-2 heavy txs in one block, it's aligned with the expectation.