fix bug when calling _concat_caches in kv.py #177
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
Summary: (fix a bug when calling _concat_caches function)
BUG Description:
Solution:
The solution replaced merged.key_cache.append and merged.value_cache.append with operations on merged.layers[layer].keys and merged.layers[layer].values. This aligns with the DynamicCache structure, where keys and values are stored per layer. Additionally, the code now correctly retrieves keys and values from c.layers[layer].keys and c.layers[layer].values respectively.
Fix: #(not applicable)
Docs Issue/PR: (not applicable)
Reviewer: @(not applicable)
Checklist: