Scrolling too fast fails and reset position to top

[KaruroChori]

Scrolling too fast fails (with mouse) and scrollHeight is reset to the top.
I was able to find what triggers this issue:

        if (!scrollData->openThisFrame) {
            Clay__ScrollContainerDataInternalArray_RemoveSwapback(&context->scrollContainerDatas, i);
            continue;
        }
        scrollData->openThisFrame = false;

in clay.h. Removing that check the scrolling works as expected, but since I don't quite understand the logic behind it, I cannot provide a valid fix :(.