SYS.PROJECT.REFLECTIONS
The sys.project.reflections table contains metadata for reflections in a project.
SELECT *
FROM sys.project.reflections
Example Output
| reflection_id | reflection_name | type | created_at | updated_at | status | dataset_id | dataset_name | dataset_type | sort_columns | partition_columns | distribution_columns | dimensions | measures | display_columns | external_reflection | num_failures | last_failure_message | last_failure_stack | arrow_cache | refresh_status | acceleration_status | record_count | current_footprint_bytes | total_footprint_bytes | last_refresh_duration_millis | refresh_method | available_until | considered_count | matched_count | accelerated_count | |---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---| | f154623d-de50-4b32-8049-085228917357 | Aggregation Reflection | AGGREGATION | 2023-07-15 0:35:03 | 2023-07-15 0:35:03 | FAILED | 11add18a-b642-43ed-856e-c2fd3f3c64e0 | "Samples.""samples.dremio.com"".""zip_lookup.csv""" | PHYSICAL_DATASET_SOURCE_FILE | | | | B | C | | | 3 | | | FALSE | GIVEN_UP | NONE | -1 | 0 | 0 | -1 | FULL | 1970-01-01 0:00:00 | 0 | 0 | 0 | | 2e2b48f3-fba9-4b87-909d-19b9b8b7bc43 | Raw Reflection | RAW | 2023-07-15 0:34:53 | 2023-07-15 0:34:53 | FAILED | 11add18a-b642-43ed-856e-c2fd3f3c64e0 | "Samples.""samples.dremio.com"".""zip_lookup.csv""" | PHYSICAL_DATASET_SOURCE_FILE | | | | | | "A, B, C, D" | | 3 | | | FALSE | GIVEN_UP | NONE | -1 | 0 | 0 | -1 | FULL | 1970-01-01 0:00:00 | 0 | 0 | 0 | | 6e2fc27b-39f5-42e4-a386-ffd2b95cc320 | Aggregation Reflection | AGGREGATION | 2023-07-15 0:35:38 | 2023-07-15 0:35:38 | FAILED | 031256b0-f935-41df-af67-0a8b85c02965 | "Samples.""samples.dremio.com"".""SF weather 2018-2019.csv""" | PHYSICAL_DATASET_SOURCE_FILE | | | | J | C | | | 3 | | | FALSE | GIVEN_UP | NONE | -1 | 0 | 0 | -1 | FULL | 1970-01-01 0:00:00 | 0 | 0 | 0 | | 85278d59-5daf-4583-809c-1164766ee425 | Raw Reflection | RAW | 2023-07-15 0:35:28 | 2023-07-15 0:35:28 | FAILED | 031256b0-f935-41df-af67-0a8b85c02965 | "Samples.""samples.dremio.com"".""SF weather 2018-2019.csv""" | PHYSICAL_DATASET_SOURCE_FILE | | | | | | "A, B, C, D, E, F, G, H, I, J, K, L" | | 3 | | | FALSE | GIVEN_UP | NONE | -1 | 0 | 0 | -1 | FULL | 1970-01-01 0:00:00 | 0 | 0 | 0 |
Fields
| Field | Data Type | Description |
|---|---|---|
| accelerated_count | integer | Number of jobs accelerated by the reflection. |
| acceleration_status | varchar | Status of the reflection's availability for accelerating queries. |
| arrow_cache | boolean | This value will be true if Arrow caching is enabled for the reflection; false otherwise. |
| available_until | timestamp | Date and time that the reflection expires, in UTC format. |
| considered_count | integer | Number of jobs that considered the reflection during planning. |
| created_at | timestamp | Date and time that the reflection was created, in UTC format. |
| current_footprint_bytes | bigint | Data size of the latest reflection job (if one exists), in bytes. |
| dataset_id | varchar | The UUID to identify the dataset that the reflection is on. |
| dataset_name | varchar | The path and name of the dataset that the reflection is on. |
| dataset_type | varchar | The type of dataset that the reflection has been created on. Enum: PHYSICAL_DATASET_HOME_FILE, PHYSICAL_DATASET_SOURCE_FILE, PHYSICAL_DATASET_SOURCE_FOLDER, VIRTUAL_DATASET |
| dimensions | varchar | The list of dimension columns or expressions. |
| display_columns | varchar | The list of displayed columns. |
| distribution_columns | varchar | The list of distributed columns. |
| external_reflection | varchar | The field will be populated if the reflection is an external reflection. |
| last_failure_message | varchar | The error message of the last failed reflection refresh, which is cleared out once one reflection refresh succeeds. |
| last_failure_stack | varchar | The stack trace of the last failed reflection refresh, which is cleared out once one reflection refresh succeeds. |
| last_refresh_duration_millis | bigint | Duration of the most recent refresh for the reflection, in milliseconds. |
| matched_count | integer | Number of jobs that matched the reflection during planning. |
| measures | varchar | The list of measures. |
| num_failures | integer | The number of recent failures. |
| partition_columns | varchar | The list of columns that the dataset is partioned on. |
| record_count | bigint | Number of records returned for the latest reflection. |
| reflection_id | varchar | The UUID to identify the reflection. |
| reflection_name | varchar | The user-defined name of the reflection. |
| refresh_method | varchar | The method used for the most recent refresh of the reflection. For new reflections, the value is NONE. For more information, see Refreshing Reflections. |
| refresh_status | varchar | Status of the reflection refresh. |
| sort_columns | varchar | The list of columns that will be sorted on. |
| status | varchar | The status of the reflection based on the last time the reflection was used. Enum: CAN_ACCELERATE, CAN_ACCELERATE_WITH_FAILURES, REFRESHING, FAILED, EXIPRED, DISABLED, INVALID, INCOMPLETE, CANNOT_ACCELERATE_SCHEDULED, CANNOT_ACCELERATE_MANUAL |
| total_footprint_bytes | bigint | Data size of all reflection jobs that have not been pruned (if any exist), in bytes. |
| type | varchar | The type of reflection. Enum: AGGREGATION, RAW |
| updated_at | timestamp | Date and time that the reflection was last updated, in UTC format. |