All Questions
Tagged with azure-storage-account azure-databricks
12
questions
0
votes
1
answer
209
views
Can't read/list from a Azure storage Account into Databricks notebooks using Secret Scopes
Despite the fact that I have checked and tested my blob url path in my Azure storage account I'm still getting a: cannot resolve hostname. It's like if my secret scopes were not working. Here is what ...
- 121
1
vote
1
answer
110
views
pyspark - select() function ignoring if statement
Thanks to user @DerekO, his following example is correctly getting max lengths of only varchar columns. But when I use the same example with df loaded with a csv file it ignores the if statement and ...
- 23.5k
1
vote
1
answer
600
views
Access Control from Databricks to Azure Storage Accounts and Containers
Our Databricks workspace needs to access different data sets but we need to ensure that access control can be granted on a role or individual level. The data sets are planned to be available as files ...
- 13
1
vote
2
answers
1k
views
Authentication of Azure databricks to Azure Storage account
I need to access my Azure Storage Account from the Azure Databricks notebook.
From authentication side, all key dependant methods (SAS, key based authentication) worked but we can't expose the Access ...
- 430
2
votes
1
answer
412
views
dbutils.fs.mount() works for Python but not for R?
The following code works in a Azure Databricks Python cell:
dbutils.fs.mount(
source = "wasbs://[email protected]",
mount_point = "/mnt/mount1"...
- 99
1
vote
1
answer
2k
views
How to install ODBC Driver 17 for SQL Server on a Azure Databricks cluster with no internet access
My goal is to access Azure Synapse Analytics from Azure Databricks. The first thing that came in mind is to use the spark driver com.databricks.spark.sqldw. But for that, the database user needs to be ...
- 2,406
2
votes
1
answer
2k
views
Is it possible to use an existing storage account to create a Databricks workspace?
We need to create a shared storage account for Synapse and Databricks, however we can only use existing storage accounts in Synapse while Databricks creates separate resource groups on its own and ...
0
votes
1
answer
322
views
unable to connect to azure gen2 storage account in South Central US region from azure databrick in EAST US
We are facing an access issue to connect azure storage account. Firewall is enabled in the storage account to provide access to only specific IPs. Storage account is hosted in Azure South Central US.
...
1
vote
1
answer
131
views
read gen2 secondary account with databricks
I'm trying to read the secondary gen2 account in DataBricks, but I get the following error:
java.io.FileNotFoundException: Operation failed: "The specified resource does not exist.", ...
1
vote
2
answers
2k
views
Create Azure databricks notebook from storage account
We have python script stored in Azure storage account in blob. We want to deploy / create this python script (as notebook) in azure databricks cluster so later we can run Azure data factory pipeline ...
- 418
0
votes
0
answers
510
views
Unable to delete Azure Resource Group
I'm trying to delete Ra esource Group or the resources in that group.
Databricks got deleted half-way is now in a failed state and can't be removed
A storage account can't be deleted because of an ...
- 291
1
vote
2
answers
4k
views
Can't access mounted volume with python on Databricks
I am trying to give access to an Azure Storage Account Gen2 container to a team in their Databricks workspace by mounting it to a the dbfs, using Credential Passthrough. I want to be able to manage ...
- 1,245