Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Investigate performance of SCP message capturing in database as validator set grows #4139

Closed
bboston7 opened this issue Jan 12, 2024 · 1 comment

Comments

@bboston7
Copy link
Contributor

The current tier 1 validator set is ~23 nodes, but is expected to grow 2-3x. As of right now, PR #4121 updates the set of SCP messages for a given ledger by deleting the database entries corresponding to that ledger and then re-adding all messages to the database. We do this because the alternative of tracking deltas and only updating those rows in the database is slower. As the validator set grows this performance characteristic may change. Once the network has more validators, we should re-evaluate this technique and consider performance gains from tracking deltas and/or moving this work to a separate thread.

@bboston7
Copy link
Contributor Author

bboston7 commented Apr 2, 2024

I took a look at Grafana around when this change landed and didn't see any noticeable performance changes. Most crucially, the average apply time is unaffected, which is what we were primarily concerned about. Given all that, I'm closing this ticket.

@bboston7 bboston7 closed this as completed Apr 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants
@bboston7 and others