We are facing an access issue to connect azure storage account. Firewall is enabled in the storage account to provide access to only specific IPs. Storage account is hosted in Azure South Central US.
We are trying to access data from azure databricks which is hosted in EAST US region.
Now issue is if databricks is also hosted in South central then we can easily whitelist databricks vnet and access storage. But in our case we can't do since vnet is only accessible within the region. We also don't have public IPs for databricks cluster.
We can't all traffic from all the networks.
Can someone suggest how can we access storage account from databricks in this use case.