SYS.PROJECT.COPY_ERRORS_HISTORY
The sys.project.copy_errors_history table stores information about COPY INTO operations that were run within the current project with ON_ERROR set to continue or skip_file and that rejected at least one record in a CSV, JSON, or Parquet file.
SELECT * FROM sys.project.copy_errors_history
note
Results display information only about COPY INTO operations that were initiated by the querying user.
Example Output
| executed_at | job_id | table_name | user_name | base_snapshot_id | storage_location | file_path | file_state | records_loaded_count | records_rejected_count |
|---|---|---|---|---|---|---|---|---|---|
| 2023-11-14 10:39:56.535 | 1aacb195-ca94-ec4c-2b01-ecddac81a900 | "my-location"."test".my-folder.ice_tbl_types | user_1 | 8234571992740262000 | "my-location"."test".my-folder.source-data.json."data/" | /test/my-folder/source-data/json/data/test.json | SKIPPED | 0 | 1 |
| 2023-11-18 22:24:53.411 | 1aa6c65f-ff9f-d4c5-4625-c8489898e900 | "my-location"."test".my-folder.ice_tbl_types | user_1 | 8234571992740262000 | "my-location"."test".my-folder.source-data.csv."data/" | /test/my-folder/source-data/csv/data/test_2.csv | PARTIALLY_LOADED | 8 | 1 |
| 2023-11-18 22:24:53.411 | 1aa6c65f-ff9f-d4c5-4625-c8489898e900 | "my-location"."test".my-folder.ice_tbl_types | user_1 | 8234571992740262000 | "my-location"."test".my-folder.source-data.csv."data/" | /test/my-folder/source-data/csv/data/test_4.csv | SKIPPED | 0 | 1 |
| 2023-11-18 22:24:53.411 | 1aa6c65f-ff9f-d4c5-4625-c8489898e900 | "my-location"."test".my-folder.ice_tbl_types | user_1 | 8234571992740262000 | "my-location"."test".my-folder.source-data.csv."data/" | /test/my-folder/source-data/csv/data/test_0.csv | PARTIALLY_LOADED | 8 | 1 |
| 2023-11-18 22:24:53.411 | 1aa6c65f-ff9f-d4c5-4625-c8489898e900 | "my-location"."test".my-folder.ice_tbl_types | user_1 | 8234571992740262000 | "my-location"."test".my-folder.source-data.csv."data/" | /test/my-folder/source-data/csv/data/test_3.csv | PARTIALLY_LOADED | 8 | 1 |
Columns
| Column name | Data Type | Description |
|---|---|---|
| executed_at | timestamptz | The timestamp in milliseconds when the current row was written to the system table. |
| job_id | string | The ID of the COPY INTO job. |
| table_name | string | The name of the target table for the COPY INTO job. |
| user_name | string | The user name of the user who executed the COPY INTO command. |
| base_snapshot_id | long | The id of the last snapshot of the target table before the result of the COPY INTO command was committed. |
| storage_location | string | The storage location that was specified in the COPY INTO command. |
| file_path | string | The path of the input file that contained one or more rejected records (if the file is a CSV file) or one rejected record (if the file is a JSON file). |
| file_state | string | The state of the file. Possible values: PARTIALLY_LOADED -- At least one record from the file has been loaded into the target table and at least one record was rejected.SKIPPED -- No records from the file have been loaded because none of them could be parsed. |
| records_loaded_count | long | The number of records loaded successfully from this file. |
| records_rejected_count | long | The number of records that could not be loaded due to errors within the file. |