[wip] PatchedArray wiring: Part 2#7145
Draft
a10y wants to merge 19 commits intoaduffy/patched-arrayfrom
Draft
Conversation
Merging this PR will degrade performance by 18.62%
Performance Changes
Comparing Footnotes
|
1d28e78 to
65d8c10
Compare
860cc64 to
042394b
Compare
c76f6bd to
93e2785
Compare
93e2785 to
dd20d70
Compare
042394b to
aa8f05f
Compare
b7c14f1 to
69ce351
Compare
Signed-off-by: Andrew Duffy <andrew@a10y.dev>
Signed-off-by: Andrew Duffy <andrew@a10y.dev>
Signed-off-by: Andrew Duffy <andrew@a10y.dev>
Signed-off-by: Andrew Duffy <andrew@a10y.dev>
Signed-off-by: Andrew Duffy <andrew@a10y.dev>
We call append_to_builder on the inner first, then just do a single pass and overwrite what it just wrote. Signed-off-by: Andrew Duffy <andrew@a10y.dev>
5d0a954 to
df8dbf5
Compare
Signed-off-by: Andrew Duffy <andrew@a10y.dev>
df8dbf5 to
862d814
Compare
this lets us deserialize BPArray with Patches without eagerly transposing Signed-off-by: Andrew Duffy <andrew@a10y.dev>
This lets us return something other than the original array encoding at read time. Currently we'll want this so that BitPacked::build returns a LazyPatched, but this is applicable for pretty much any back-compat preserving encoding rewrites. Signed-off-by: Andrew Duffy <andrew@a10y.dev>
removes both the patches field as well as all code for handling patches. this is safe to do now that we have updated the VTable build function to always read methods. note that we need to leave the metadata as-is. Signed-off-by: Andrew Duffy <andrew@a10y.dev>
Signed-off-by: Andrew Duffy <andrew@a10y.dev>
Signed-off-by: Andrew Duffy <andrew@a10y.dev>
69ce351 to
0d703d8
Compare
0d703d8 to
e658811
Compare
daf258f to
578d83d
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Part of #6535 epic and successor to #7002
This wires PatchedArray through to BitPackedArray, replacing the interior Patches entirely. This change is backward compatible.
API Changes
VTable::buildto returnArrayRefinstead ofV::Array. This allows us to lazily deserialize a previously written value as a new type in a backward-compatible wayLazyPatchedArraywhich is just a dummy node that holds on to an array and somePatches, has no reductions and can just be executed into a transposedPatchedArraypatcheschild fromBitPackedArrayBitPackedArray::encode()and a mess of other functions, instead moving everything into a newBitPackedEncoderfluent APITesting
Reuses our existing and extensive test suite for BP