Creating a Project Store
Follow these steps to create an Azure Storage account in the Azure portal when you are connecting your Azure account to Dremio Cloud or adding a project to an organization.
Azure Storage account names must be globally unique. See Azure documentation for details and common errors.
An existing Azure Storage account may used with a new container, but soft delete on blobs must be disabled.
Creating an Azure Storage Account
Log in to the Azure portal.
Search for "Storage accounts" and select the Storage accounts service in the search results.
Click Create in the top left.
On the Basics tab, complete the following:
a. For Subscription, select the appropriate subscription from the dropdown.
b. For Resource Group, select the appropriate resource group from the dropdown.
c. For Storage account name, enter a name for your storage account.
d. For Region, select the region for your storage account.
e. For Performance, select the performance option for your storage account. Determine whether you want to have premium performance for block blobs, file shares, or page blobs in your storage account.
f. For Redundancy, select the redundancy option for your storage account. Dremio recommends Geo-redundant storage (GRS) for production workloads.
g. Click Next : Advanced.
On the Advanced tab, complete the following:
a. (Optional) Under Hierarchical Namespace, check Enable hierarchical namespace.
b. Click Next : Networking.
On the Networking tab, click Next : Data protection.
On the Data protection tab, complete the following:
a. Uncheck the Enable soft delete for blobs checkbox.
b. Click Next : Encryption.
On the Encryption tab, click Next : Tags.
On the Tags tab, complete the following:
a. (Optional) For Name, enter a tag name for your resource group.
b. (Optional) For Value, enter a value to help search and filter your resources or track your Azure costs.
c. Click Next : Review.
On the Review tab, click Create.
Configuring Networking Access
If you are using Dremio Standard Edition, your Azure Storage account must have public network access enabled from all networks. To allow traffic from all networks:
Log in to the Azure portal and go to your Azure Storage account.
On your Azure Storage account page, select Networking from the left sidebar.
For Public network access, select Enabled from all networks.
Click Save.
If you are using Dremio Enterprise Edition, please contact Dremio Support for advanced networking settings.
Creating an Azure Storage Account Container
If following from Creating an Azure Storage Account steps 1 to 4 can be skipped. Click Go to resource upon the completion of the storage account deployment.
Log in to the Azure portal.
Search for "Storage accounts" and select the Storage accounts service in the search results.
Search for the storage account created in Creating an Azure Storage Account, using the Filter for any field... search bar in the top left.
Click on the name of the storage account that is to be used.
On the storage account page, select Containers from the left sidebar.
Click Container at the top.
In the New container panel on the right, enter a name for the container.
Click Create.
Azure CLI
The project store can also be created through the Azure CLI. The following instructions are for using Azure CLI, depending on if you want to create a new Azure Storage account or add a container to an existing Azure Storage account.
Create a Azure Storage Account and Disable Soft Delete for Blobs
#example storage account, resource group and region names given
az storage account create -n dremiocloudstorageaccount -g dremiocloudresourcegroup -l eastus --sku Standard_GRS --enable-hierarchical-namespace true --min-tls-version TLS1_2 --allow-blob-public-access false --https-only true
az storage blob service-properties delete-policy update --account-name dremiocloudstorageaccount --auth-mode login --enable false
Add a Container to an Azure Storage Account
#example storage account name given
az storage container create --name dremio-cloud --account-name dremiocloudstorageaccount --auth-mode login