Skip to main content

SYS.PROJECT.REFLECTIONS

The sys.project.reflections table shows Reflections defined in the system and their current states for query acceleration. Includes details about full or incremental refresh and usage information.

Syntax
SELECT * 
FROM sys.project.reflections

Example Output

reflection_idreflection_nametypecreated_atupdated_atstatusdataset_iddataset_namedataset_typesort_columnspartition_columnsdistribution_columnsdimensionsmeasuresdisplay_columnsexternal_reflectionnum_failureslast_failure_messagelast_failure_stackrefresh_statusacceleration_statusrecord_countcurrent_footprint_bytestotal_footprint_byteslast_refresh_duration_millislast_refresh_from_tablerefresh_methodavailable_untilconsidered_countmatched_countaccelerated_countreflection_mode
f154623d-de50-4b32-8049-085228917357Aggregation ReflectionAGGREGATION2023-07-15 0:35:032023-07-15 0:35:03FAILED11add18a-b642-43ed-856e-c2fd3f3c64e0"Samples.""samples.dremio.com"".""zip_lookup.csv"""PHYSICAL_DATASET_SOURCE_FILEBC"pickup_datetime, passenger_count, trip_distance_mi, fare_amount, tip_amount, total_amount"3GIVEN_UPNONE-100-12024-03-18 20:42:07.175FULL1970-01-01 0:00:00000Manual
2e2b48f3-fba9-4b87-909d-19b9b8b7bc43Raw ReflectionRAW2023-07-15 0:34:532023-07-15 0:34:53FAILED11add18a-b642-43ed-856e-c2fd3f3c64e0"Samples.""samples.dremio.com"".""zip_lookup.csv"""PHYSICAL_DATASET_SOURCE_FILE"A, B, C, D"3GIVEN_UPNONE-100-12024-03-12 21:42:55.407FULL1970-01-01 0:00:00000Manual
6e2fc27b-39f5-42e4-a386-ffd2b95cc320Aggregation ReflectionAGGREGATION2023-07-15 0:35:382023-07-15 0:35:38FAILED031256b0-f935-41df-af67-0a8b85c02965"Samples.""samples.dremio.com"".""SF weather 2018-2019.csv"""PHYSICAL_DATASET_SOURCE_FILEJC3GIVEN_UPNONE-100-12024-03-15 15:47:06.058FULL1970-01-01 0:00:00000Manual
85278d59-5daf-4583-809c-1164766ee425Raw ReflectionRAW2023-07-15 0:35:282023-07-15 0:35:28FAILED031256b0-f935-41df-af67-0a8b85c02965"Samples.""samples.dremio.com"".""SF weather 2018-2019.csv"""PHYSICAL_DATASET_SOURCE_FILE"A, B, C, D, E, F, G, H, I, J, K, L"3GIVEN_UPNONE-100-11970-01-01 00:00:00.000FULL1970-01-01 0:00:00000Manual

Fields

FieldData TypeDescription
accelerated_countintegerNumber of jobs accelerated by the Reflection.
acceleration_statusvarcharStatus of the Reflection's availability for accelerating queries.
available_untiltimestampDate and time that the Reflection expires, in UTC format.
considered_countintegerNumber of jobs that considered the Reflection during planning.
created_attimestampDate and time that the Reflection was created, in UTC format.
current_footprint_bytesbigintData size of the latest Reflection job (if one exists), in bytes.
dataset_idvarcharThe UUID to identify the dataset that the Reflection is on.
dataset_namevarcharThe path and name of the dataset that the Reflection is on.
dataset_typevarcharThe type of dataset that the Reflection has been created on. Enum: PHYSICAL_DATASET_HOME_FILE, PHYSICAL_DATASET_SOURCE_FILE, PHYSICAL_DATASET_SOURCE_FOLDER, VIRTUAL_DATASET
dimensionsvarcharThe list of dimension columns or expressions.
display_columnsvarcharThe list of displayed columns.
distribution_columnsvarcharThe list of distributed columns.
external_reflectionvarcharThe field will be populated if the Reflection is an external Reflection.
last_failure_messagevarcharThe error message of the last failed Reflection refresh, which is cleared out once one Reflection refresh succeeds.
last_failure_stackvarcharThe stack trace of the last failed Reflection refresh, which is cleared out once one Reflection refresh succeeds.
last_refresh_duration_millisbigintDuration of the most recent refresh for the Reflection, in milliseconds.
matched_countintegerNumber of jobs that matched the Reflection during planning.
measuresvarcharThe list of measures.
num_failuresintegerThe number of recent failures.
partition_columnsvarcharThe list of columns that the dataset is partioned on.
record_countbigintNumber of records returned for the latest Reflection.
reflection_idvarcharThe UUID to identify the Reflection.
reflection_modevarcharHow the Reflection was created. If created by a user, the value is Manual. If created through Autonomous Reflections, the value is Autonomous.
reflection_namevarcharThe user-defined name of the Reflection.
refresh_methodvarcharThe method used for the most recent refresh of the Reflection. For new Reflections, the value is NONE. For more information, see Refreshing Reflections.
refresh_statusvarcharStatus of the Reflection refresh.
sort_columnsvarcharThe list of columns that will be sorted on.
statusvarcharThe status of the Reflection based on the last time the Reflection was used. Enum: CAN_ACCELERATE, CAN_ACCELERATE_WITH_FAILURES, REFRESHING, FAILED, EXIPRED, DISABLED, INVALID, CANNOT_ACCELERATE_SCHEDULED, CANNOT_ACCELERATE_MANUAL
total_footprint_bytesbigintData size of all Reflection jobs that have not been pruned (if any exist), in bytes.
typevarcharThe type of Reflection. Enum: AGGREGATION, RAW
updated_attimestampDate and time that the Reflection was last updated, in UTC format.