Skip to main content

Manage Open Catalog

Each project in Dremio includes a built-in Open Catalog powered by Apache Polaris. The Open Catalog provides a unified way to organize, discover, and govern your data assets across the project. You can configure catalog-level settings for reflections, metadata refresh, and access privileges from the project settings. You cannot delete your default Open Catalog as it is a core component of your project.

In addition to the built-in Open Catalog, you can connect to Open Catalogs from other projects. See Open Catalog for details.

Edit Open Catalog​

To edit the default Open Catalog's settings:

  1. In the Dremio console, hover over Admin icon in the side navigation bar and select Project.
  2. Select Catalog in the project settings sidebar.
  3. Edit the catalog settings using the sections below, then click Save.

Reflections and Metadata​

The Reflections and Metadata tab controls reflection refresh frequency, data expiration, and how often Dremio discovers new datasets and refreshes metadata for existing datasets in the catalog. Failed reflections are not refreshed.

To edit the refresh policy:

  1. Under Refresh settings, select one of the following options:
    • Never refresh — Reflections are not refreshed automatically.
    • Refresh every — Set an interval (in minutes, hours, days, or weeks) for automatic refresh. Optionally, enable live refresh to keep reflections continuously up to date.
    • Set refresh schedule — Define a custom schedule for reflection refresh.
  2. Under Expire settings, select one of the following options:
    • Never expire — Reflections remain available indefinitely.
    • Expire after — Set a duration after which reflections expire and are no longer served.
  3. Click Save.

To edit metadata refresh:

  1. Under Metadata Refresh, configure the following:
    • Dataset Discovery — Set the Fetch every interval to control how often Dremio scans for new datasets.
    • Dataset Details — Configure the fetch mode, the Fetch every interval for refreshing dataset metadata, and the Expires after duration for cached metadata.
  2. Click Save.

Privileges​

The Privileges tab on the Catalog settings page allows you to control which users and roles can access and manage the Open Catalog and its contents.

To manage catalog privileges:

  1. Add the user or role to which you want to grant access.
  2. Toggle the desired Open Catalog privileges for each user or role.
  3. Click Save.

For more information about available privilege types, see Privileges.