On this page

    Managing Projects

    A project isolates compute, data and other resources needed by a team for data analysis. An organization may contain multiple projects. A project must be linked to a single cloud account. Your first project was created and linked to your cloud account as part of the sign-up process.

    Each project requires access to an S3 bucket for storing various types data, including:

    • The data for reflections that are created in the project
    • File uploads to home spaces
    • The default path for new tables that are used for data and manifests for datasets
    • All of the tables that store records of events and other historical data

    Viewing All Projects

    To view the list of all of the projects:

    1. In the sidebar on the left side of the Dremio Cloud UI, click the gear button and then select Organization Settings.
    2. Select Projects in the navigation panel on the left.

    Adding a Project

    Before you add a project, ensure that there is an S3 bucket in your AWS account that you can give the project access to. Dremio Cloud uses the bucket as the metadata store for your project. If you need to create an S3 bucket, follow the steps in AWS: Create a Dremio Cloud Project Store.

    To add a new project:

    1. In the top-right corner of the Projects page, click Add Project .
    2. In the Project Name field, specify a name that is unique within the organization.
    3. In the Cloud field, select the cloud in which to create the project store and compute engines for running queries against datasets in the project.

    note:

    After you create the project, you cannot move it to a different cloud.

    1. In the Initial Engine Size field, select the size of the default engine to create for this project.

    2. In the Project Store field, paste the path of the Amazon S3 bucket. Doing so sets the path in the Resource section of the policy JSON. The rest of the policy JSON sets the minimum policy requirement to allow Dremio Cloud read and write access to the project store.

    3. Copy the content of the Policy JSON text box.

    4. To grant Dremio Cloud read and write permissions to the project store, follow either of these two sets of steps:

      • To grant the permissions by means of an IAM user:

        a. In the Project Data Credentials field, select Access Key.

        b. Create an IAM user with an access key.

        c. In the AWS Access Key ID field, paste the Access Key ID from the .csv file you downloaded when you created the user.

        d. In the AWS Secret Access Key field, paste the AWS Secret Access Key from the .csv file you downloaded when you created the user.

      • To grant the permissions by means of a cross-account IAM role:

        a. In the Project Data Credentials field, select IAM Role.

        b. Copy this JSON snippet and paste it into a location that you can access for the rest of this procedure.

            {
              "Effect": "Allow",
              "Principal": {
                "AWS": "arn:aws:iam::<trust account ID>:root"
              },
              "Action": "sts:AssumeRole",
              "Condition": {
                "StringEquals": {
                  "sts:ExternalId": "<external ID>"
                }
              }
            }
        

        c. Copy the trust account ID and the external ID and paste them into the JSON that you copied in the previous step.

        d. Create a cross-account IAM role in the AWS Console.

        e. In the Role ARN field, paste the cross-account role ARN that you copied when you created the role.

        f. In the Instance Profile ARN field, paste the instance profile ARN that you copied when you created the role.

    5. Click Save.

    Setting the Default Project

    When your data consumers connect to Dremio Cloud from BI tools, they need to connect to the projects in which their datasets are located. They can either connect to the default project or they can select a different project to connect to.

    If an organization administrator does not set this value, Dremio Cloud automatically sets the default project to the oldest project in your organization.

    You can change the default project at any time.

    note:

    Data consumers who do not have access to the default project must select a project ID for an alternative project when they connect to Dremio Cloud from their BI tools.

    To specify the default project for your organization:

    1. In the sidebar, click the gear icon and then select Organization Settings.
    2. Select General Info in the sidebar.
    3. In the Default Project field, select the project that you want data consumers to connect to by default through their BI tools.

    Obtaining the ID of a Project

    A BI client application might require the ID of a project as part of the information for creating a connection to Dremio Cloud. You can obtain the ID from the General Information page of a project’s settings.

    To obtain a project ID:

    1. In the Dremio Cloud UI, click the Settings (gear) icon that is towards the bottom of the left sidebar. Select Project Settings from the menu.
    2. Click on General Information in the navigation panel on the left.
    3. Copy the value in the Project ID field.

    Editing a Project

    The name is the only editable attribute of a project.

    To edit the name of a project:

    1. On the Projects page, hover on the row of the project that you want to edit and click the edit (pencil) button. The Edit Project dialog is opened.
    2. In the Edit Project dialog, change the name that is in the Project Name field.

    Enabling Autocomplete

    To help you construct SQL statements more quickly, you can enable autocomplete. Enabling autocomplete can provide suggestions for SQL keywords, catalog objects, and functions while you are constructing SQL statements. This feature can be enabled or disabled for all your users within the project settings, and once the setting is toggled, you must refresh your browser to see the changes.

    To enable autocomplete for a project:

    1. Click the Settings (gear) icon towards the bottom of the side navigation bar. Select Project Settings from the menu.
    2. Select SQL from the navigation panel.
    3. Toggle the autocomplete setting to enable.

    Deleting a Project

    If you delete the default project for your organization, Dremio Cloud automatically selects the oldest project to be the new default. You can override this default. See Setting the Default Project for an Organization.

    note:

    Every organization must contain at least one project. If your organization contains only the project that you want to delete, then you cannot delete the project until another project is created in the organization.

    To delete a project:

    1. On the Projects page, hover on the row of the project that you want to delete and click on the delete (trash can) button.
    2. Confirm that you want to delete the project.