How to authenticate using an access token from Azure Databricks

[this]

I'm trying to connect to a delta table in Azure Databricks. Here is my Python code.

from deltalake import DeltaTable

path = "abfss://unity-catalog-storage@<STORAGE-ACCOUNT>.dfs.core.windows.net/<REST-OF-THE-PATH-TO-TABLE>"
token = "<DATABRICKS-ACCESS-TOKEN>"

storage_options = {
    "token": token
}
dt = DeltaTable(path, storage_options=storage_options)
print(f"Files: {dt.files()}")

For above, I get the following error.

OSError: The operation lacked valid authentication credentials for path <REST-OF-THE-PATH-TO-TABLE>/_delta_log/_last_checkpoint: Client error with status 401 Unauthorized: <?xml version="1.0" encoding="utf-8"?><Error><Code>InvalidAuthenticationInfo</Code><Message>Server failed to authenticate the request. Please refer to the information in the www-authenticate header.
RequestId:80706dc1-b01e-003e-73b6-7106dd000000
Time:2025-01-28T18:59:55.2197072Z</Message><AuthenticationErrorDetail>The access token was missing or malformed.</AuthenticationErrorDetail></Error>

I got the token from the Settings > Developer > Access tokens page in Azure Databricks UI.

Instead of the token key, I tried with azure_storage_token and bearer_token, ended up with the same error.

So my question is, how to successfully authenticate with a delta lake table in Azure Databricks using an access token? Am I passing an incorrect token? Am I passing the token incorrectly? Or am I missing any other params that needed to be passed through storage_options?

[ion-elgreco]

A databricks access token is used for databricks authentication, not for azure blob authentication, so you would have to use different credentials