Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Vertipaq Export #103

Open
prathyusha-kamasani opened this issue Aug 28, 2024 · 2 comments
Open

Vertipaq Export #103

prathyusha-kamasani opened this issue Aug 28, 2024 · 2 comments
Labels
enhancement New feature or request

Comments

@prathyusha-kamasani
Copy link

Hi,

Is it possible to update scripts to Export results without attaching the Lakehouse, please? So we can dynamically mount LH and export data into LH tables. Currently, when I mount with script I get below error, it will be good be able to mount dynamically. Many Thanks! Prathy

ValueError: 🔴 In order to save the Vertipaq Analyzer results, a lakehouse must be attached to the notebook. Please attach a lakehouse to this notebook.

@prathyusha-kamasani prathyusha-kamasani added the enhancement New feature or request label Aug 28, 2024
@m-kovalsky
Copy link
Collaborator

I would like to enable saving to any lakehouse in any workspace however currently it is problematic. Saving the results is not the problem. In order to add the proper 'RunId', I must query the delta table to get the max run Id. Running spark queries cross-workspace is not supported. Thus, using the lakehouse attached to the notebook ensures no problems. Once spark queries can be executed cross-workspace, I'd be happy to update the functionality to support saving to any lakehouse in any workspace.

@eisber
Copy link
Contributor

eisber commented Sep 28, 2024

@m-kovalsky you could use delta-rs to read directly in onelake...

https://blog.fabric.microsoft.com/en-us/blog/delta-rs-introduces-native-support-for-onelake/

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants