Skip to main content
Version: current [25.x]

SYS.REFLECTIONS

The sys.reflections table contains metadata for reflections in the Dremio instance.

Syntax
SELECT * 
FROM sys.reflections

Example Output

reflection_idreflection_nametypecreated_atupdated_atstatusdataset_iddataset_namedataset_typesort_columnspartition_columnsdistribution_columnsdimensionsmeasuresdisplay_columnsexternal_reflectionnum_failureslast_failure_messagelast_failure_stackarrow_cacherefresh_statusacceleration_statusrecord_countcurrent_footprint_bytestotal_footprint_byteslast_refresh_duration_millislast_refresh_from_tablerefresh_methodavailable_untilconsidered_countmatched_countaccelerated_count
76b42fc7-7f81-451a-a24c-646cdd99cd52Raw ReflectionRAW2023-02-22 19:56:042023-02-22 19:56:04FAILED78097c46-bdef-42cd-8265-89cb763368ceRegionsVIRTUAL_DATASET"pickup_datetime, passenger_count, trip_distance_mi, fare_amount, tip_amount, total_amount"3FALSEGIVEN_UPNONE-100-12024-03-18 20:42:07.175FULL1970-01-01 0:00:00000
f154623d-de50-4b32-8049-085228917357Aggregation ReflectionAGGREGATION2023-07-15 0:35:032023-07-15 0:35:03FAILED11add18a-b642-43ed-856e-c2fd3f3c64e0"Samples.""samples.dremio.com"".""zip_lookup.csv"""PHYSICAL_DATASET_SOURCE_FILEBC3FALSEGIVEN_UPNONE-100-11970-01-01 00:00:00.000FULL1970-01-01 0:00:00000
2e2b48f3-fba9-4b87-909d-19b9b8b7bc43Raw ReflectionRAW2023-07-15 0:34:532023-07-15 0:34:53FAILED11add18a-b642-43ed-856e-c2fd3f3c64e0"Samples.""samples.dremio.com"".""zip_lookup.csv"""PHYSICAL_DATASET_SOURCE_FILE"A, B, C, D"3FALSEGIVEN_UPNONE-100-12024-03-12 21:42:55.407FULL1970-01-01 0:00:00000
6e2fc27b-39f5-42e4-a386-ffd2b95cc320Aggregation ReflectionAGGREGATION2023-07-15 0:35:382023-07-15 0:35:38FAILED031256b0-f935-41df-af67-0a8b85c02965"Samples.""samples.dremio.com"".""SF weather 2018-2019.csv"""PHYSICAL_DATASET_SOURCE_FILEJC3FALSEGIVEN_UPNONE-100-12024-03-15 15:47:06.058FULL1970-01-01 0:00:00000
85278d59-5daf-4583-809c-1164766ee425Raw ReflectionRAW2023-07-15 0:35:282023-07-15 0:35:28FAILED031256b0-f935-41df-af67-0a8b85c02965"Samples.""samples.dremio.com"".""SF weather 2018-2019.csv"""PHYSICAL_DATASET_SOURCE_FILE"A, B, C, D, E, F, G, H, I, J, K, L"3FALSEGIVEN_UPNONE-100-11970-01-01 00:00:00.000FULL1970-01-01 0:00:00000

Fields

FieldData TypeDescription
accelerated_countintegerNumber of jobs accelerated by the reflection.
acceleration_statusvarcharStatus of the reflection's availability for accelerating queries.
arrow_cachebooleanThis value will be true if Arrow caching is enabled for the reflection; false otherwise.
available_untiltimestampDate and time that the reflection expires, in UTC format.
considered_countintegerNumber of jobs that considered the reflection during planning.
created_attimestampDate and time that the reflection was created, in UTC format.
current_footprint_bytesbigintData size of the latest reflection job (if one exists), in bytes.
dataset_idvarcharThe UUID to identify the dataset that the reflection is on.
dataset_namevarcharThe path and name of the dataset that the reflection is on.
dataset_typevarcharThe type of dataset that the reflection has been created on. Enum: PHYSICAL_DATASET_HOME_FILE, PHYSICAL_DATASET_SOURCE_FILE, PHYSICAL_DATASET_SOURCE_FOLDER, VIRTUAL_DATASET
dimensionsvarcharThe list of dimension columns or expressions.
display_columnsvarcharThe list of displayed columns.
distribution_columnsvarcharThe list of distributed columns.
external_reflectionvarcharThe field will be populated if the reflection is an external reflection.
last_failure_messagevarcharThe error message of the last failed reflection refresh, which is cleared out once one reflection refresh succeeds.
last_failure_stackvarcharThe stack trace of the last failed reflection refresh, which is cleared out once one reflection refresh succeeds.
last_refresh_duration_millisbigintDuration of the most recent refresh for the reflection, in milliseconds.
last_refresh_from_tabletimestampDate and time of the last refresh of the tables from which the reflection is ultimately derived, in UTC format.
matched_countintegerNumber of jobs that matched the reflection during planning.
measuresvarcharThe list of measures.
num_failuresintegerThe number of recent failures.
partition_columnsvarcharThe list of columns that the dataset is partioned on.
record_countbigintNumber of records returned for the latest reflection.
reflection_idvarcharThe UUID to identify the reflection.
reflection_namevarcharThe user-defined name of the reflection.
refresh_methodvarcharThe method used for the most recent refresh of the reflection. For new reflections, the value is NONE. For more information, see Refreshing Reflections.
refresh_statusvarcharStatus of the reflection refresh.
sort_columnsvarcharThe list of columns that will be sorted on.
statusvarcharThe status of the reflection based on the last time the reflection was used. Enum: CAN_ACCELERATE, CAN_ACCELERATE_WITH_FAILURES, REFRESHING, FAILED, EXIPRED, DISABLED, INVALID, INCOMPLETE, CANNOT_ACCELERATE_SCHEDULED, CANNOT_ACCELERATE_MANUAL
total_footprint_bytesbigintData size of all reflection jobs that have not been pruned (if any exist), in bytes.
typevarcharThe type of reflection. Enum: AGGREGATION, RAW
updated_attimestampDate and time that the reflection was last updated, in UTC format.