fix(files_reminders): reduce N+1 query issue for big folders

[salmart-dev]

Summary

Increases the CappedMemoryCache size for ReminderService to 30k.

Context

OCA\FilesReminders\Dav\PropFindPlugin preloads reminders information for an entire collection during PROPFIND. ReminderService has a cacheFolder method which uses a CappedMemoryCache as cache. The problem is that the default size for this cache is 512 meaning that if a directory has more than 512 files inside we start getting cache misses and start querying the DB.

What's worse is that once the condition hits, it always voids the pre-cached data and causes N+1 queries:

1. preloadCollection starts caching reminders for files in a directory
2. once the limit of the CappedMemoryCache is reached, the information that was cached earlier is discarded
3. when the PROPFIND is serialized into XML, the first file queries is no longer in the cache
4. The code queries the DB and caches the value, pushing another previously cached value out
5. This continues making the pre-caching useless 🤯

Checklist

• Code is properly formatted
• Sign-off message is added to all commits
• Tests (unit, integration, api and/or acceptance) are included
• Screenshots before/after for front-end changes
• Documentation (manuals or wiki) has been updated or is not required
• Backports requested where applicable (ex: critical bugfixes)
• Labels added where applicable (ex: bug/enhancement, 3. to review, feature component)
• Milestone added for target branch/version (ex: 32.x for stable32)

[salmart-dev]

/backport to stable33 please

[salmart-dev]

/backport to stable32 please

[salmart-dev]

/backport to stable31 please

[Altahrim]

I am wondering if it makes sense for CappedMemory cache to discard old entries…
It's more unlikely but if a directory have more than 30k entries we'll hit the same issue.

I am also a bit afraid that 30k entries in cache use a lot of memory

[salmart-dev]

I am wondering if it makes sense for CappedMemory cache to discard old entries… It's more unlikely but if a directory have more than 30k entries we'll hit the same issue.

I am also a bit afraid that 30k entries in cache use a lot of memory

That is what the current code is already doing. We insert by key, and while inserting we call reset on the array which goes to the first element inserted (so the oldest) and then unset it.

[Altahrim]

Sorry, it wasn't clear ^^

Maybe CappedMemory cache should just stop discarding entries. When it's full, it serves current entries and stop adding new ones.

[salmart-dev]

Sorry, it wasn't clear ^^

Maybe CappedMemory cache should just stop discarding entries. When it's full, it serves current entries and stop adding new ones.

But that still means then executing N-512 queries to load data for directories with N files, no?

I'm thinking of two things:

1. cache the information that a directory has been preloaded and stop caching keys for files with no reminders. This would cut down the amount of items in the cache by a bit, although it still can be exhausted if a folder has many files with reminders.
2. detect that the capped memory cache is full in the plugin and pause the caching, keep the cursor open and then the code of the plugin could detect when it's time to read another batch of results. This requires the plugin being the one managing the cache though, which is not the current case as the reminder service is the one caching right now.