SQL Commands for Apache Iceberg Tables
Apache Iceberg is a table format that solves challenges with traditional file-formatted tables in data lakes. It is rapidly becoming an industry standard for managing data in data lakes. Iceberg introduces capabilities that enable multiple applications to work together on the same data in a transactionally consistent manner and defines additional information on the state of datasets as they evolve and change over time.
Iceberg enables Dremio to provide powerful, SQL database-like functionality on data lakes using industry-standard SQL commands. Dremio currently supports Iceberg v2 tables, offering a solid foundation for building and managing data lakehouse tables. Certain features, such as Iceberg native branching and tagging, global equality deletes, and the UUID data type, are not yet supported.
Before you attempt to run SQL commands on Iceberg tables, follow these prerequisite steps:
-
Ensure that you are using AWS Glue, Amazon S3, Hive, or Nessie as a datasource.
-
Ensure that any existing Apache Iceberg tables that you want to use in your datasource are at Apache Iceberg version 2.