Catalogs
Dremio can connect to catalogs to provide a unified metadata layer across platforms. This allows users to query existing datasets in place, without data movement, while preserving a single source of truth for metadata management.
Catalog Comparison
| Catalog | Provider | Read | Write | Vended Credentials | Best For |
|---|---|---|---|---|---|
| Dremio's Open Catalog | Dremio | ✔ | ✔ | ✔ | Open lakehouses |
| AWS Glue Data Catalog | AWS | ✔ | ✔ | ✔ | AWS-native Iceberg environments |
| Google Cloud Lakehouse Catalog | ✔ | ✔ | ✔ | Google-managed Iceberg tables | |
| Iceberg REST Catalog | Various | ✔ | ✔ | Varies | Third-party Iceberg catalogs |
| Snowflake Open Catalog | Snowflake | ✔ | ✔* | ✔ | Snowflake-managed Iceberg tables |
| Unity Catalog | Databricks | ✔ | ✔ | Databricks Delta Lake with UniForm |
*Write supported for external catalogs only
Dremio's Open Catalog
Every Dremio project includes a built-in Open Catalog. You can also connect to Open Catalogs from other projects in your organization for cross-project collaboration.
Key features:
- Query spaces and tables from other projects without duplicating data
- Role-Based Access Control (RBAC) and fine-grained access controls enforced at the catalog level
- Automatic table maintenance handled by the source project
- Configurable Reflection refresh and metadata sync per project
Best for: Collaboration and data sharing within your Dremio organization.
AWS Glue Data Catalog
Connect to AWS Glue's managed metadata catalog for accessing Iceberg tables stored in Amazon S3.
Key features:
- Native integration with AWS ecosystem
- Managed metadata storage and schema management
- Support for both read and write operations
- Integration with AWS Lake Formation for fine-grained access control
Best for: AWS-native environments that use Glue for metadata management and want to query Iceberg tables with Dremio.
Iceberg REST Catalog
Connect to any Iceberg Catalog implementing the REST API specification, including Apache Polaris, AWS Glue Data Catalog, Snowflake Open Catalog, Amazon S3 tables, and Confluent Tableflow.
Key features:
- Universal compatibility with REST-compliant Iceberg catalogs
- Support for multiple authentication mechanisms
- Flexible storage credential management
- Connect to on-premises Dremio clusters for hybrid cloud analytics
Best for: Connecting to Iceberg catalogs from other vendors or on-premises systems.
Google Cloud Lakehouse Catalog
Connect to Google's Cloud Lakehouse Catalog for accessing Iceberg tables stored in Google Cloud.
Key features:
- Native integration with Google Cloud ecosystem
- Support for both read and write operations
- Credential vending for secure storage access
Best for: Google Cloud native environments that use Cloud Lakehouse to store and manage Iceberg tables.
Snowflake Open Catalog
Connect to Snowflake's managed service for Apache Polaris to read and write Iceberg tables across Snowflake and other compatible engines.
Key features:
- Read from internal and external Snowflake Open Catalogs
- Write to internal Snowflake Open Catalogs
- Credential vending for secure storage access
- Support for AWS, Azure, and GCS storage
Best for: Organizations using Snowflake that want to query Iceberg tables with Dremio while leveraging Snowflake's catalog management.
Unity Catalog
Connect to Databricks Unity Catalog to query Delta Lake tables through the UniForm Iceberg compatibility layer.
Key features:
- Read Delta Lake tables via UniForm Iceberg metadata layer
- Integration with Databricks governance and security
- Support for AWS, Azure, and GCS storage
- Credential vending for secure access
Best for: Databricks users who want to query Delta Lake tables with Dremio using the UniForm compatibility layer.