computer-vision-pcb demo fails on torch-lightning: Deletion Vectors not Supported

[championj-db]

When running notebook 05-torch-lightning-training-and-inference the train_model() function call fails with: Exception: Tables with enabled Deletion Vectors are not supported.

When updating the dataset creation to use option("delta.enableDeletionVectors", "false") and re-running the notebook, the same function call fails with RuntimeError: DataLoader worker (pid(s) 20165) exited unexpectedly

[QuentinAmbard]

@dennisschultz-db any idea on this ? @championj-db I suspect you need to delete the full table and re-write it with the option ? Can you give it a try & let us know if it solves the issue?

[championj-db]

@QuentinAmbard I tried writing out the table to a completely new path using option("delta.enableDeletionVectors", "false"), when I did this approach that's when it hit this other Runtime error RuntimeError: DataLoader worker (pid(s) 20165) exited unexpectedly - I wasn't able to find the root of that error however

[dennisschultz-db]

@championj-db , I was unable to get notebook 05 to train on an updated DBR. I left the notebook in the demo as a reference, but it is likely it needs more updates to work with Torch Lightning.