Support for multibatch load #139
Unanswered
marcinsiewiera
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi,
I have a question / idea regarding functionality of multi-batch load.
Let's assume there is a CDC providing multiple changes of the records in bundles.
All the changed rows of given bkey in 1 CDC bundle receive same loadDate, they are differentiated by cdc_timestamp though.
The proper approach would be to differentiate loaddate by adding e.g. 1 millisecond each time according to the order of cdc_timestamp, so that loadDates are different and can be loaded to RawVault.
Do you think it would make sense to add this feature to the templates or use case is too specific?
Beta Was this translation helpful? Give feedback.
All reactions