An Apache Spark-based analytics platform optimized for Azure.
Unable to create Network Connectivity Config resource for Databricks in West Europe
We want to use Lakeflow for ingestion (primarily from a MySQL instance). All our resources are deployed with private endpoints in a vnet. We want to use serverless compute to connect to the MySQL instance. We are currently encountering this error when…
Azure Databricks
Not able to deploy Databricks using Azure Portal
Hi Team, I am trying to deploy Azure databricks using vnet injection method. I am not sure why it fails during validation. Below is the error message I get. I have also attached the screenshot Deployment template validation failed: 'The following…
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
I have a Developer Support Plan, Unable to Submit Support Request
I have Developer Support but when walking through Create a Support Request, there is no option to actually submit.
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
In Azure databricks workspace want to hide or disable.
Dear Team, I am using Azure Databricks workspace for my project testing. sometimes i am not using the workspace more than 10 days or 1 month like that. so, i am paying amount for that and suppose i deleted my workspace i need to create from scratch so,…
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
How to load some private variables from key vault or .env file into DAB databricks.yml file.
Currently I'm trying to setting DAB files for the infrastructure and pipeline deployment in Azure Databricks platform. `targets: dev: mode: development default: true workspace: host: ${secrets/databricks_scope/AzureDevWorkspaceHost} …
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
Failed to add 1 worker to the compute. Will attempt retry: false. Reason: Network Check Control Plane Failure
X_NHC_CONTROL_PLANE_UNREACHABLE: Instance failed network health check before bootstrapping with fatal error: X_NHC_CONTROL_PLANE_UNREACHABLE 2 failed component(s): control_plane internet Retryable: true Based on the failure results: List(entity:…
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
Getting error while creating Databricks Classic Compute Cluster
Cluster fails with the following error: Allocation failed. We do not have sufficient capacity for the requested VM size in this region. All the SKUs in the dropdown are disabled. Is it because of the region I selected. If yes, How can I change my region?
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
unable to create a new compute cluster in Azure databricks.
I want to create a new compute cluster in Azure databricks. But when i click on the compute button it is taking me to the Sql Warehouses page. Can anyone help resolve this?? This account already has all the required permissions and users with required…
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
Azure Databricks workspace in resource group is stuck in Deleting.
Azure Databricks workspace in resource group is stuck in Deleting. Observed error: ApplianceBeingDeleted: The operation cannot be performed on the appliance because it is being deleted. What I already tried: az databricks workspace delete --name …
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
Join: Microsoft Azure Q&A Champions Program
The Microsoft Azure Q&A Champions Program recognizes and empowers a global community of internal and external Azure experts who help customers succeed by providing high-quality, trusted answers on Microsoft Q&A. The program scales expert led…
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
Microsoft.Databricks workspaces The DeploymentBeingDeleted error occurs when attempting to modify or deploy a resource in Azure while it is in the process of being deleted. This issue is encountered with resources such as Microsoft.Databricks workspaces,
My Azure Databricks workspace ADBNikhilProject in resource group Azure_Fundamentals is stuck in a deleting state. Issue I am unable to: Delete the Databricks workspace Delete the resource…
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
How can Network Security perimeter be associated with Databricks Managed workspace storage account?
We have received an email from Microsoft to switch to network security perimeter where we have allow-listed Azure Databricks serverless subnet IDs in any Azure storage firewalls. Basically our databricks managed workspace storage account which starts…
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
No Account Admin – Unable to Manage Metastore
We do not have any active Account Admin in our organization and cannot access the Databricks Account Console. As a result, we are unable to: Grant metastore-level privileges Create catalogs (CREATE CATALOG) Example error: GRANT CREATE CATALOG ON…
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
Databricks node types greyed out despite DDsv5 quota in West US 2
Hi, I’m having an issue with an Azure Databricks workspace in West US 2 where many cluster node types are unavailable, even though the Azure subscription has sufficient vCPU quota. Context: Workspace region: West US 2 Workspace pricing tier: Premium…
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
Databricks to Synapse Copy is taking more time after upgrading Databricks to 17.3 from 12.2
We do Copy Data from Databricks to Synapse using Databricks Notebook When we used to run in Databricks 12.2 when parallel notebooks are run, it was taking near to 1 min to 3 min for most of the notebooks, but after we upgraded to Databricks 17.3, when we…
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
I am encountering 'NoSuchMethodError' error while running a Databricks job that uses SparkContext on a Databricks cluster DBR 16.4 LTS
Hi Team, I am encountering the following error while running a Databricks job that uses SparkContext on a Databricks cluster (DBR 16.4 LTS). Has there been any recent patch or update to DBR 16.4 LTS related to SparkSession. One month ago it was working…
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
Cannot access Accounts Console in Databricks – no Account Admin exists because the user no longer exists.
We have an Azure Databricks workspace that was originally created by a user who has since left the company and was removed. As a result, the Databricks account is now orphaned, and there is no active Account Admin available. Currently, no users in the…
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
Enable and use Unity Catalog in our existing Azure Databricks workspace.
Hi Team, We are trying to enable and use Unity Catalog in our Azure Databricks workspace. Current status: Metastore is created and assigned to the workspace Region matches Metastore admin is assigned Identity federation is enabled SQL Warehouse…
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
row duplication after 10 min exploded fact table after join
I am building a Delta fact table in Databricks SQL where the intended grain is: one row per VisitID per ResourceType per 10 min TimeBucketStart For exple if one visit spans 75 minutes I expect it to produce 5 rows after exploding into 10 min buckets. A…
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
how does Z-Order work with predictive optimization ?
I’m trying to understand the best way to manage Z-Ordering in Databricks when Predictive Optimization (PO) is enabled. According to the documentation, PO runs OPTIMIZE without ZORDER, and for tables that already use Z-Order, PO ignores the Z-ordered…
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.