Manage Projects

A project isolates the compute, data, and other resources a team needs for data analysis. An organization may contain multiple projects. Your first project is created during the sign-up process.

Each project in Dremio has its own storage. This is used to store metadata and Reflections and serves as the default storage location for the project's Open Catalog. You can choose between two storage options:

• Dremio-managed storage – No setup or configuration required. Usage is priced per TB, billed monthly.
• Your own storage – Use your own Amazon S3 storage. However, this requires you to manage this infrastructure.

For details on pricing, see How Storage Usage Is Calculated.

Each project in your organization contains a preview engine. Each new project has a preview engine. The preview engine, by default, will scale down after 1 hour without a query. As the name suggests, it provides previews of queries and datasets. Unlike other engines, the preview engine cannot be disabled, ensuring that many core Dremio functions that require an engine can always run.

View All Projects

To view all projects:

1. In the Dremio console, hover over in the side navigation bar and select Organization settings.

2. Select Projects in the organization settings sidebar.

The Projects page displays the status of all projects in your organization. Possible statuses include:

• Creating
• Active
• Inactive
• Deactivating
• Activating
• Archiving
• Archived
• Restoring

Grant Access to a Project

New projects are private by default. In the projects page, users can see only the projects for which they have USAGE or OWNERSHIP privileges. The projects page is empty for users without USAGE or OWNERSHIP privileges on any projects. The projects dropdown list shares this behavior.

Similarly, the Projects API returns an HTTP 403 Forbidden error for requests from users who do not have USAGE or OWNERSHIP privileges on the project. Also, users must have USAGE or OWNERSHIP privileges on a project before they can make API requests or run SQL queries on any objects in the project, even if they have object-level privileges on sources, folders, or other objects in the project.

To allow users to access a project, use the GRANT TO ROLE or GRANT TO USER SQL command or the Grants API to grant them the USAGE privilege on the project. For users who do not own the project, USAGE is the minimum privilege required to perform any operation on the project and the objects the project contains. For example, if you are using GRANT TO USER, you can run GRANT USAGE ON PROJECT TO USER <username>.

Obtain the ID of a Project

A BI client application might require the ID of a project as part of the information for creating a connection to Dremio. You can obtain the ID from the General Information page of a project's settings.

To obtain a project ID:

1. In the Dremio console, hover over in the side navigation bar and select Project settings.

2. Select General Information in the project settings sidebar.

3. Copy the value in the Project ID field.

Set the Default Project

When your data consumers connect to Dremio from BI tools, they must connect to the projects where their datasets reside. They can either connect to the default project or select a different project.

If an organization administrator does not set this value, Dremio automatically sets the default project to the oldest project in your organization.

You can change the default project at any time.

note

Data consumers who do not have access to the default project must select an alternative project ID when connecting to Dremio from their BI tools.

To specify the default project for your organization:

1. Hover over in the side navigation bar and select Organization settings.

2. Select General Information in the organization settings sidebar.

3. In the Default Project field, select the project that you want data consumers to connect to by default through their BI tools.

4. Click Save.

Create a Project

If you're planning on using your own bucket, you will need create a role for Dremio granting access, this must be done prior to creating a project, see Bring Your Own Project Store for instructions. To avoid having to do this simply use Dremio-managed storage.

To add a project:

1. In the Dremio console, hover over in the side navigation bar and select Organization settings.

2. Select Projects option in the organization settings sidebar.

3. In the top-right corner of the Projects page, click Create.

4. For Project name, specify a name that is unique within the organization.

5. For Region, select the AWS Region where you wish the project to reside.

6. Select one of the two Storage options:

   • For Dremio managed storage, Dremio will create and manage object storage for your use.

   • For your own storage, you will need to provide Dremio the bucket URI and Role ARN previously created.

Activate a Project

Dremio automatically deactivates any project that has not been accessed in the last 15 days. Dremio sends a courtesy email to project owners three days prior to deactivation. Inactive projects are displayed in the project selector in the side navigation bar and on the Projects page. An inactive project will be activated automatically when any user tries to access it via the Dremio console, an ODBC or JDBC connection, or an API call.

note

Inactive projects do not consume any compute resources.

You can activate an inactive project on the Projects page, or by clicking the project in the project selector. It takes a few minutes to activate a project.

To activate a project from the Projects page:

1. Hover over in the side navigation bar and select Organization settings.

2. Select Projects in the organization settings sidebar.

3. Click the ellipsis menu to the far right of the inactive project, and then click Activate Project.

The project status will change to Activating while the project is activated. You can access the project after the status changes to Active.

Archive a Project

Users with OWNERSHIP privileges or users assigned to the ADMIN role can archive a project. Archived projects are displayed only on the Projects page.

note

Archived projects do not consume any compute resources.

To archive a project:

1. In the Dremio console, hover over in the side navigation bar and select Organization settings.

2. Select Projects in the organization settings sidebar.

3. Click the ellipsis menu to the far right of an active or inactive project, and then click Archive Project.

The project status will change to Archiving while the project is archived. When archiving is complete, the status changes to Archived.

Restore an Archived Project

An archived project will not be restored automatically if a user tries to access it and can only be restored manually by a user with OWNERSHIP privileges on the project or users assigned to the ADMIN role. It takes a few minutes to restore an archived project.

To restore an archived project:

1. In the Dremio console, hover over in the side navigation bar and select Organization settings.

2. Select Projects in the organization settings sidebar.

3. Click the ellipsis menu to the far right of an archived project and select Restore Project.

The project status will change to Restoring while the project is restored. You can access the project after the status changes to Active.

Delete a Project

Default projects cannot be deleted. If you want to delete the default project, you must first set another project as the default. See Set the Default Project.

To delete a project:

1. In the Dremio console, hover over in the side navigation bar and select Organization Settings.

2. Select Projects in the organization settings sidebar.

3. Click the ellipsis menu to the far right and select Delete Project.

4. Confirm that you want to delete the project.