System Tables
System tables make up Dremio’s system-created catalog to store metadata for the objects in your Dremio organization. Each system table is specific to the associated Dremio object and its attributes, unlike Information Schemas, which are based on the ANSI standards. System tables are read-only (cannot be modified or dropped by users).
Dremio system tables are divided into namespaces:
- Depending on whether the object is an organization or project-level object, the system table lives in the corresponding namespace. For example, clouds are an organization-level object, so the clouds system table is under the sys.organization namespace. For more information about the object model, see Objects in Dremio Cloud.
- System tables can represent either the runtime state of an object, which reflects the current state of the system, or the history of an object. For example, sys.project.jobs represents the jobs that are running in the project at the table is queried whereas sys.project.history.jobs represents the jobs that have historically been run.
Runtime System Tables
The following system tables can be queried to return runtime metadata for the respective entities.
note:
Only users who have been assigned the ADMIN
role or users who have been granted SELECT
privileges on one or more specific runtime system tables can run queries on those tables.
Tables | Description |
---|---|
sys.organization.clouds | The runtime metadata for clouds in an organization. |
sys.organization.privileges | The runtime metadata for privileges at the organization-level. |
sys.organization.projects | The runtime metadata for projects in an organization. |
sys.organization.roles | The runtime metadata for roles in an organization. |
sys.organization.usage | The runtime metadata for usage for projects/engines in the organization. |
sys.organization.users | The runtime metadata for users in an organization. |
sys.project.engines | The runtime metadata for engines in a project. |
sys.project.jobs | The runtime metadata for jobs in a project. |
sys.project.privileges | The runtime metadata for privileges at the project-level. |
sys.project.reflections | The runtime metadata for reflections in a project. |
sys.project.“tables” | The runtime metadata for tables in a project. |
sys.project.views | The runtime metadata for views in a project. |
Historical System Tables
The following system tables can be queried to return historical metadata for the respective entities.
note:
Only users who have been assigned the ADMIN
role can run queries on historical system tables.
Tables | Description |
---|---|
sys.project.history.events | The historical metadata for events in a project. |
sys.project.history.jobs | The historical metadata for jobs in a project. |