L2/CORE: ethrex_l2 loadtest doesn't work as expected

[fborello-lambda]

Steps to reproduce the bug:

In the root's Makefile, the target start-node-with-flamegraph use genesis-l1-dev.json as genesis.

Then in two terminals:

• make start-node-with-flamegraph
• sudo make load-test

NOTE:
Instead of modifying and running the target you can run the following command, which starts the node with the InMemoryEngine:

cargo run --release --bin ethrex \
--features "dev" \
--  \
--evm revm \
--network test_data/genesis-l2-ci.json \
--http.port 1729 \
--dev \
--datadir memory

And then the loadtest.

The output should be:

The transactions reach the RPC, it seems to be a problem related to how the transactions are being filtered from the mempool.

Related to PR #2366

[xqft]

It can also be reproduced by starting the L2 with

cargo run --bin ethrex --release --features "dev,l2" -- --network test_data/genesis-l2-ci.json --dev

and executing load tests

[rodrigo-o]

This is also happening just with L1 and spamoor, I was able to validate it running the new make task of this PR: #3221

running make localnet-client-comparision on that branch shows the same errors mentiones in this issue:

2025-06-23T14:16:04.041290Z ERROR ethrex_blockchain::payload: Failed to execute transaction: 6be7ff7134f611d212fe00dd538437392b0b683e8ed6ea3c9825ff298e569d9a, EVM error: Invalid Transaction: nonce 6436 too high, expected 6435                                                                                                                                                                                                 
2025-06-23T14:16:04.041432Z ERROR ethrex_blockchain::payload: Failed to execute transaction: 4c4fe23af664eedd8e89e174b0b98bdbfdcc3b496222bd3b057bd5c6a38a573b, EVM error: Invalid Transaction: nonce 6433 too high, expected 6431                                                                                                                                                                                                 
2025-06-23T14:16:04.041585Z ERROR ethrex_blockchain::payload: Failed to execute transaction: 5bdeee0cf6d59c4405adef6033b00d02287fb516b21d156f263e2bfb9f2a8cf3, EVM error: Invalid Transaction: nonce 6433 too high, expected 6431                                                                                                                                                                                                 
2025-06-23T14:16:04.041625Z ERROR ethrex_blockchain::payload: Failed to execute transaction: 73b12bebc81a702f74e0b5d76b5e605c070982eeabe2a7662e78eb825d6bf1c9, EVM error: Invalid Transaction: nonce 6436 too high, expected 6435                                                                                                                                                                                                 
2025-06-23T14:16:04.041656Z ERROR ethrex_blockchain::payload: Failed to execute transaction: 40e015942e0481b49104f20c2ddfdd2b4c4de41ef79cb17287a9c5e5ef8188bc, EVM error: Invalid Transaction: nonce 6436 too high, expected 6435                                                                                                                                                                                                 
2025-06-23T14:16:04.041691Z ERROR ethrex_blockchain::payload: Failed to execute transaction: 39931bacb19393bcd1ebededbcadf42ac5b5496bec7b2f5707eebc6ba01a22c5, EVM error: Invalid Transaction: nonce 6436 too high, expected 6435                                                                                                                                                                                                 
2025-06-23T14:16:04.043023Z  INFO ethrex_blockchain::payload: [METRIC] BUILDING PAYLOAD TOOK: 40 ms, base fee 10                                                                                                 
2025-06-23T14:16:04.043028Z  INFO ethrex_blockchain::payload: [METRIC] BLOCK BUILDING THROUGHPUT: 0.0156384 Gigagas/s TIME SPENT: 40 msecs                                                                       
2025-06-23T14:16:04.051096Z  INFO ethrex_rpc::engine::payload: Received new payload with block hash: 0x3f07d891ee6fe27d8adefb1988c826f967cfb68e7e2c2417c30772f280ef0f23                                          
2025-06-23T14:16:04.051344Z  INFO ethrex_rpc::engine::payload: Executing payload with block hash: 0x3f07d891ee6fe27d8adefb1988c826f967cfb68e7e2c2417c30772f280ef0f23                                             
2025-06-23T14:16:04.058095Z  INFO ethrex_blockchain: [METRIC] BLOCK EXECUTION THROUGHPUT (19675): 0.10 Ggas/s TIME SPENT: 6 ms. Gas Used: 2%, #Txs: 16. exec/Ggas: 3197 ms (33%), st/Ggas: 6395 ms (67%)         
2025-06-23T14:16:04.058108Z  INFO ethrex_rpc::engine::payload: Block with hash 0x3f07…0f23 executed and added to storage succesfully