SYS.PROJECT.HISTORY.EVENTS
The sys.project.history.events
table contains the historical metadata for the events in a project.
SELECT *
FROM sys.project.history.events
note
Dremio refreshes the data in sys.project.history.events
once per hour, so it usually takes about 1 hour for event information to appear. If an event occurs soon after Dremio's hourly refresh and takes a long time to finish, it could take more than 1 hour for the event's data to appear in the sys.project.history.events
table.
Example Output
id | timestamp | action | event_type | status | user_id | details |
---|---|---|---|---|---|---|
nwseswacjqv2jv25 | 2022-02-01 21:22:25.422 | SCALE_UP_STARTED | ENGINE | OK | 678cc92c-01ed-4db3-9a28-d1f871042d9f | {"activeReplicas":0,"autoStopDelaySecs":0,"description":"","drainTimeLimitSecs":0,"engineCapacity":"XX_SMALL_V1","engineId":"99317a9f-ffbc-4acf-a9ce-a649dd7892b0","engineName":"First Engine","maxConcurrency":0,"maxReplicas":10,"minReplicas":0,"queueTimeLimitSecs":0,"requestId":"","runTimeLimitSecs":0,"tags":[]} |
029oip5i7pkpyr4s | 2022-02-01 21:22:25.435 | SCALE_UP_COMPLETED | ENGINE | OK | 678cc92c-01ed-4db3-9a28-d1f871042d9f | {"activeReplicas":1,"autoStopDelaySecs":0,"description":"","drainTimeLimitSecs":0,"engineCapacity":"XX_SMALL_V1","engineId":"99317a9f-ffbc-4acf-a9ce-a649dd7892b0","engineName":"First Engine","maxConcurrency":0,"maxReplicas":10,"minReplicas":0,"queueTimeLimitSecs":0,"requestId":"","runTimeLimitSecs":0,"tags":[]} |
liqdx83ihwzr85qx | 2022-02-01 21:24:37.910 | UPDATE | TABLE | OK | 678cc92c-01ed-4db3-9a28-d1f871042d9f | {"approximateStatisticsAllowed":false,"fields":[{"dataType":"DATETIME","name":"pickup_datetime"},{"dataType":"INTEGER","name":"passenger_count"},{"dataType":"FLOAT","name":"trip_distance_mi"},{"dataType":"FLOAT","name":"fare_amount"},{"dataType":"FLOAT","name":"tip_amount"},{"dataType":"FLOAT","name":"total_amount"}],"icebergmetadataenabled":true,"id":"0678823d-1281-431b-b47d-35b5d4ab3a29","name":"NYC-taxi-trips","path":"Samples."samples.dremio.com"."NYC-taxi-trips"","tag":"245d0c38-7d57-48f8-bacb-af2eaf06caef","type":"PHYSICAL_DATASET_SOURCE_FOLDER"} |
8wvxcsu84433reng | 2022-02-01 21:29:52.092 | SCALE_DOWN_STARTED | ENGINE | OK | 678cc92c-01ed-4db3-9a28-d1f871042d9f | {"activeReplicas":1,"autoStopDelaySecs":0,"description":"","drainTimeLimitSecs":0,"engineCapacity":"XX_SMALL_V1","engineId":"99317a9f-ffbc-4acf-a9ce-a649dd7892b0","engineName":"First Engine","maxConcurrency":0,"maxReplicas":10,"minReplicas":0,"queueTimeLimitSecs":0,"requestId":"","runTimeLimitSecs":0,"tags":[]} |
egpnz1fru74f5l96 | 2022-02-01 21:29:52.100 | SCALE_DOWN_COMPLETED | ENGINE | OK | 678cc92c-01ed-4db3-9a28-d1f871042d9f | {"activeReplicas":0,"autoStopDelaySecs":0,"description":"","drainTimeLimitSecs":0,"engineCapacity":"XX_SMALL_V1","engineId":"99317a9f-ffbc-4acf-a9ce-a649dd7892b0","engineName":"First Engine","maxConcurrency":0,"maxReplicas":10,"minReplicas":0,"queueTimeLimitSecs":0,"requestId":"","runTimeLimitSecs":0,"tags":[]} |
47cd91ye16pvagn3 | 2022-02-03 13:21:01.510 | CREATE | SOURCE | OK | 1 | {"accelerationGracePeriod":0,"accelerationNeverExpire":false,"accelerationNeverRefresh":false,"accelerationRefreshPeriod":0,"allowCrossSourceSelection":false,"configJson":"{"type":"HistoryTablesPluginConfig","distStorePath":"dremioS3:///auditloginternalorg","projectId":"b2d94403-dacc-4443-a78e-76df29251b47","credentialProvider":"com.dremio.service.coordinator.DremioAssumeRoleCredentialsProviderV1","accessKey":null,"secretKey":null,"iamRole":"SECRET","externalId":"SECRET","rootFolder":"internaldatalake"}","description":"","disableMetadataValidityCheck":false,"id":"5009ccd4-e894-4446-91d2-e6ab6d6c22a4","metadataPolicy":{"authTTLMs":3153600000000,"autoPromoteDatasets":false,"datasetDefinitionExpireAfterMs":3153600000000,"datasetDefinitionRefreshAfterMs":3153600000000,"datasetUpdateMode":"UPDATE_MODE_PREFETCH","deleteUnavailableDatasets":true,"namesRefreshMs":3153600000000},"name":"projectstore","tag":"HISTORYTABLES","type":"HISTORYTABLES"} |
Fields
Field | Data Type | Description |
---|---|---|
id | varchar | The UUID to identify the event. |
timestamp | timestamp | The date and time at which the event occurred. |
action | varchar | The type of action that triggered the event. |
event_type | varchar | The object that the event was triggered on. |
status | varchar | The status of the event. |
user_id | varchar | The UUID to identify the user who triggered the event. The following values are placeholders that represent internal system users, which Dremio uses to log events before the user authenticates: 1 , 77a89f85-c936-4f42-ab21-2ee90e9609b8 , and 678cc92c-01ed-4db3-9a28-d1f871042d9f . |
details | json | The updated state of the object that was edited and any additional event details. |