Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve glossary lookup performance by caching automaton #9949

Open
nijel opened this issue Sep 14, 2023 · 0 comments
Open

Improve glossary lookup performance by caching automaton #9949

nijel opened this issue Sep 14, 2023 · 0 comments
Labels
enhancement Adding or requesting a new feature. help wanted Extra attention is needed. External knowledge welcome.

Comments

@nijel
Copy link
Member

nijel commented Sep 14, 2023

Describe the problem

On massive glossaries, glossary terms lookup can take hundredths of milliseconds.

Describe the solution you'd like

Use serialized automaton, this is currently discussed at G-Research/ahocorasick_rs#41.

Describe alternatives you've considered

No response

Screenshots

No response

Additional context

It used to be there since #5545, but it turned out not to be that good as the stored object was huge and restoring it from the cache took considerable time. It was reverted in dff3984. Since d8a62a4 the build times are much lower, but still, caching automaton would be probably beneficial.

@nijel nijel added enhancement Adding or requesting a new feature. help wanted Extra attention is needed. External knowledge welcome. labels Sep 14, 2023
@nijel nijel changed the title Improve glossary lookup performance Improve glossary lookup performance by caching automaton Jan 24, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement Adding or requesting a new feature. help wanted Extra attention is needed. External knowledge welcome.
Projects
None yet
Development

No branches or pull requests

1 participant