You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Currently HDFS persustence factory can only write the lineage data off to a file, but never read it back. To fully make use of this type of persistence we need to be able to read and parse the written lineage JSON to be able to link it with the descendant lineages and visualize in the Spline UI.
The text was updated successfully, but these errors were encountered:
We could export/import the lineage.
Imaginary example:
I have a file A on HDFS, and its lineage in Spline
I want to copy A to a different infrastructure (network, cluster, cloud, you name it), monitored by another independent Spline instance. And I don't want to loose the lineage of A
Using Spline UI or CLI I dump A's full lineage to a file and carry it with A to a new infrastructure
There the lineage dump can be imported manually (again by using UI or CLI), or even automatically on the first Spline tracked read from A.
Currently HDFS persustence factory can only write the lineage data off to a file, but never read it back. To fully make use of this type of persistence we need to be able to read and parse the written lineage JSON to be able to link it with the descendant lineages and visualize in the Spline UI.
The text was updated successfully, but these errors were encountered: