Dremio Cloud Troubleshooting for Azure
This guide can help you troubleshoot issues that you may encounter in your Azure account with Dremio Cloud.
Cloud Creation Failing
Error
The provided subscription identifier '<subscription_id>' is malformed or invalid.
Problem
The Subscription ID is invalid.
Solution
Check you are using a valid subscription identifier.
Error
The client '<client_id>' with object id '<object_id>' does not have authorization to perform action 'Microsoft.Compute/proximityPlacementGroups/write' over scope '<scope>' or the scope is invalid. If access was recently granted, please refresh your credentials.
Problem
If trying to create/add cloud with an app that doesn't have the Avere Contributor built-in role but has the Virtual Machine Contributor built-in role assigned only.
Solution
If using built-in roles for the app registration for cloud creation (compute), you need to assign both Virtual Machine Contributor and Avere Contributor roles to the same app.
Error
AADSTS900023: Specified tenant identifier '<tenant_id>' is neither a valid DNS name, nor a valid external domain.
Trace ID: <trace_id>
Correlation ID: <correlation_id>
Timestamp: <timestamp>
Problem
The tenant ID is invalid, the validation is unable to find the active subscription for the tenant.
Solution
Check you are using a valid tenant identifier.
Error
Resource group '<resource_group>' could not be found.
Problem
The specified resource group does not exist.
Solution
Check the specified resource group exists.
Error
Network Security Group '<network_security_group>' was not found.
Problem
The specified network security group does not exist.
Solution
Check the specified network security group exists.
Error
Virtual Network '<virtual_network>' was not found.
Problem
The specified virtual network does not exist.
Solution
Check the specified virtual network exists.
Error
Subnet '<subnet>' could not be found.
Problem
The specified subnet does not exist.
Solution
Check the specified subnet exists.
Error
Provided Virtual Network <virtual_network> is in <required_region> Region. Please make sure Virtual Network is in the same Region that is being used to create Cloud, i.e. <provided_region> Region.
Problem
The provided virtual network is not valid for the provided region.
Solution
The provided virtual network must be in the same region as the one used to create the cloud.
Cloud / Project Creation Failing
Error
AADSTS700016: Application with identifier '<client_id>' was not found in the directory 'Dremio'. This can happen if the application has not been installed by the administrator of the tenant or consented to by any user in the tenant. You may have sent your authentication request to the wrong tenant.
Trace ID: <trace_id>
Correlation ID: <correlation_id>
Timestamp: <timestamp>
Problem
The Client ID is invalid.
Solution
Check that you are using a valid application identifier.
Error
AADSTS7000215: Invalid client secret provided. Ensure the secret being sent in the request is the client secret value, not the client secret ID, for a secret added to app '<client_id>'.
Trace ID: <trace_id>
Correlation ID: <correlation_id>
Timestamp: <timestamp>
Problem
The client secret is invalid.
Solution
Check you are using a valid client secret.
Project Creation Failing
Error
This request is not authorized to perform this operation using this permission. RequestId:<request_id> Time:<time_stamp>
Problem
When creating/adding a project with an app that doesn't have the Avere Contributor built-in role assigned.
Solution
If using built-in roles for the app registration for project creation (storage), you need to assign the Avere Contributor role to the same app.
Error
Unable to create project <project_name>. Cannot access the project store. Check the path (<path>) and credentials are valid.
Problem
The provided project store details are incorrect or unsupported.
For example, a project with storage account details belonging to an Azure storage account of type v1.
Solution The project store in Dremio Cloud must belong to an Azure Storage account of type v2.
Error
Something went wrong
Problem
Added a project for a region and the selected cloud is in a different region.
Solution
The project must be in the same region as the cloud for the project store to be accessible.
Error
The specified container <container_name> does not exist.
Problem
The specified container does not exist.
Solution
Check that the container name exists in the provided Azure Storage account.
Project Creation / Source Addition Failing
Error
java.net.UnknownHostException: <account_name>.blob.core.windows.net: Name or service not known.
Problem The provided account name is not valid as part of the Azure Project Store creation or as part of the Azure Storage data source addition.
Solution Provide a valid Azure Storage account name from your account.
Engine Creation Failing
Error
The property 'securityProfile.encryptionAtHost' is not valid because the 'Microsoft.Compute/EncryptionAtHost' feature is not enabled for this subscription.
Problem
The SQL query started while the engine was scaling.
Solution
Enable encryption in your Azure subscription as described in Enabling Azure Disk Encryption.
Engine Scaling Failing
Error
Operation could not be completed as it results in exceeding approved <instance_family> Cores quota.
Problem
Engine creation exceeded the allowed cores quota.
Solution
Ensure the correct quota is allocated to your account for the right region. Read more about it in Azure Prerequisites.
Error
Scaling Failed: Document with _id KeyPair already modified. You cannot save it now. Please refresh the document and try to save again
Problem
Updated an engine parameter, and while propagating the update, a concurrent modification occurs on replicas being scaled up/down on the engine.
Solution Disable the engine and enable it again.