System Tables
System tables make up Dremio's system-created catalog to store metadata for the objects in your Dremio organization. Each system table is specific to the associated Dremio object and its attributes, unlike Information Schemas, which are based on the ANSI standards. System tables are read-only (cannot be modified or dropped by users).
Dremio system tables are divided into namespaces:
- Depending on whether the object is an organization or project-level object, the system table lives in the corresponding namespace. For example, clouds are an organization-level object, so the clouds system table is under the
sys.organizationnamespace. For more information about the object model, see Objects in Dremio Cloud. - System tables can represent either the runtime state of an object, which reflects the current state of the system, or the history of an object. For example,
sys.project.jobsrepresents the jobs that are running in the project at the table is queried whereassys.project.history.jobsrepresents the jobs that have historically been run.
Runtime System Tables
The following system tables can be queried to return runtime metadata for the respective entities.
Only users who have been assigned the ADMIN role or users who have been granted SELECT privileges on one or more specific runtime system tables can run queries on those tables.
| Tables | Description |
|---|---|
| sys.organization.billing | The billing account metadata for an organization. |
| sys.organization.clouds | The runtime metadata for clouds in an organization. |
| sys.organization.privileges | The runtime metadata for privileges at the organization-level. |
| sys.organization.projects | The runtime metadata for projects in an organization. |
| sys.organization.roles | The runtime metadata for roles in an organization. |
| sys.organization.usage | The runtime metadata for usage for projects/engines in the organization. |
| sys.organization.users | The runtime metadata for users in an organization. |
| sys.project.engines | The runtime metadata for engines in a project. |
| sys.project.jobs | The runtime metadata for jobs in a project. |
| sys.project.pipes | The runtime metadata for autoingest pipes in a project. |
| sys.project.privileges | The runtime metadata for privileges at the project-level. |
| sys.project.reflection_dependencies | The runtime graph for reflection dependencies in a project. |
| sys.project.reflections | The runtime metadata for reflections in a project. |
| sys.project."tables" | The runtime metadata for tables in a project. |
| sys.project.views | The runtime metadata for views in a project. |
Historical System Tables
The following system tables can be queried to return historical metadata for the respective entities.
Only users who have been assigned the ADMIN role can run queries on historical system tables.
| Tables | Description |
|---|---|
| sys.project.copy_errors_history | Information about COPY INTO operations that were run with ON_ERROR set to continue and that rejected at least one record in a CSV or JSON file. |
| sys.project.copy_file_history | The history of every file in a COPY INTO operation, including files loaded by an autoingest pipe. |
| sys.project.history.events | The historical metadata for events in a project. |
| sys.project.history.jobs | The historical metadata for jobs in a project. |
| sys.project.materializations | Monitoring history for reflection materialization jobs in the Dremio instance. |
| sys.project.pipe_summary | The historical metadata for autoingest pipes. |