Changelog
This changelog provides a detailed record of the previous 12 months of updates and enhancements we have made to improve your Dremio Cloud experience.
August 19, 2025
Fixed an issue where queries on Iceberg tables in Hive sources could fail with an UnsupportedOperationException during metadata refresh if the tables lacked table properties.
Fixed an issue where datetime parsing functions failed with a "Can't lex input …TZH:TZM" error when using the TZH:TZM format pattern. Affected functions include TO_TIME, TO_DATE, TO_TIMESTAMP, IS_TIME, IS_TIMESTAMP, and UNIT_TIMESTAMP.
August 12, 2025
Datetime formats are now more strictly enforced, and timezone abbreviation behavior has been corrected. As a result, some queries may fail if formats are not aligned. For a complete overview, refer to Dremio's Knowledge Base.
Fixed an issue where certain queries failed with a FragmentMessageToExecutorFailed error.
Fixed an issue where a source doesn't exist error appeared for catalogs that users had access to.
Fixed an issue where Autonomous Reflections were not selecting the most optimal recommendations.
Fixed an issue where writing empty complex types to the results cache could trigger an IndexOutOfBoundsException.
Fixed an issue where queries returning zero rows with null columns were not handled correctly.
Improved Arctic catalog listing performance, reducing listing time by at least 50% in most cases.
Fixed an issue where DELETE operations could fail on certain Iceberg tables.
Fixed a NullPointerException when reading Delta tables that had undergone schema evolution.
Improved query performance by reducing initialization times and storage overhead for Reflections.
Improved read performance for Iceberg v2 tables that simultaneously contain both equality and position deletes.
Improved Amazon S3 connectivity for AWS Glue, Hive, Iceberg Catalogs, distributed storage, and Nessie sources.
Fixed an issue where Reflection recommendations would not be provided for queries involving TIMESTAMP columns.
Fixed an issue where Iceberg Data Manipulation Language (DML) queries were writing null results on some rows.
Added VACUUM TABLE support for the REMOVE ORPHAN FILES command to clean up files in Iceberg tables that are not tracked via table metadata.
Fixed an issue where columns for starred datasets would not appear in the SQL Runner's left panel if the dataset name or path contained a . character.
Fixed an issue where clicking focus on a dataset in the Lineage graph would result in a blank page.
Fixed an issue where scripts created through Dremio's API could have their contents overwritten when opened in the SQL Runner.
Fixed an issue where the Details section of tables would incorrectly show zero columns.
Fixed an issue where the query duration timer would continue running after a query completed.
July 8, 2025
Fixed an issue where the Dremio console could become unresponsive when selecting an option from the Reflection execution strategy in Advanced settings.
Fixed an issue where MongoDB queries using the $nor expression failed due to incorrect pushdown in aggregation expressions.
Fixed an issue where the Reflection refresh retry policy could fail during a Dremio upgrade.
Fixed an issue where closing a temporary tab before it could autosave would incorrectly trigger a "This script has been deleted" dialog.
June 16, 2025
Fixed an issue that caused certain queries to fail when the HASH_JOIN operator spilled to disk and triggered the exception IndexOutOfBoundsException.
June 5, 2025
Fixed an issue where metadata was not accessible for Arctic sources.
June 4, 2025
Updates to Autonomous Reflections are now shown in the history.autonomous_reflection system table.
Updated the following library to address potential security issues:
- Hadoop to Protobuf 3.15.0+ [CVE-2022-3171, CVE-2022-3509, CVE-2022-3510, CVE-2021-22570].
DX-102976
The Reflection refresh retry policy is now enforced within a 72-hour window.
Queries now scan only the required fields from complex structure type columns to prevent errors in query execution.
Fixed an issue where large case expressions were causing the planner to hang.
Fixed a memory leak on the coordinator when queries using Arrow Flight are canceled.
Fixed an issue where queries against tables with equality deletes could fail if the fields used in the deletes had capital letters.
Fixed an issue where Delta tables with unsupported minReaderVersion values were allowed to be promoted, leading to query failures.
Fixed an issue with CREATE TABLE AS SELECT statements on Parquet datasets that could result in an error.
Fixed an issue where partition recommendations were not generated for Reflections defined on views.
The following Iceberg table properties are now supported when configuring Parquet bloom filters:
write.parquet.bloom-filter-enabled.column.<col>enables bloom filters for specific columns.write.parquet.bloom-filter-max-bytessets the maximum size of the bloom filter bitset (default: 1MB).write.parquet.bloom-filter-fpp.column.<col>configures the false positive probability per column (default: 0.01).DX-100948
Fixed an issue where semantic search results did not include parent folders or source paths for entities the user had permission to read.
Queries with too many expressions in WHERE clauses or CASE statements now return a clear error message instead of failing unexpectedly.
Removed the measure_columns column from the sys.reflections table.
Running a SELECT COUNT(*) query on Iceberg tables now leverages metadata to return row counts without scanning the entire table.
Fixed an issue related to CREATE TABLE AS SELECT statements for Parquet datasets with the error message "Multiple entries with same key: $file=$file: Utf8 and $file=$file: Utf8".
Added an INCLUDE option to VACUUM CATALOG to allow targeting specific tables for vacuuming.
You can now manually refresh failed Reflections by clicking the "Refresh now" icon on the Reflections page.
The Enable asynchronous access when possible and Enable asynchronous access for Parquet datasets checkboxes have been removed from the advanced options in the source configuration dialog to simplify setup and ensure optimal performance.
May 7, 2025
Quickly discover your data using the AI-enabled semantic search. Object names, wikis, labels, column names, and other metadata are used to serve the most relevant datasets and entities.
Autonomous Reflections automatically creates and manages Reflections, accelerating query performance and optimizing data accessibility. This enables you to derive faster insights, scale effortlessly, and make data-driven decisions.
Dremio now supports a generic Iceberg REST Catalog as a source. This allows you to connect to Iceberg catalogs over the Iceberg REST API. This source is located within the Lakehouse Catalogs.
Support for vended credentials has been added to Snowflake Open Catalog, Unity Catalog, and Iceberg REST Catalog.
Dremio now supports writes against Iceberg REST sources like Snowflake Open Catalog and the generic Iceberg REST Catalog. Unity Catalog remains read only.
Results cache is now supported to accelerate repeated queries.
Incremental Reflection refresh is now supported for tables in Unity Catalog.
Fixed an issue where sources with connection issues could not be modified or deleted.
Fixed an issue where queries returning more than 1 million rows could run slower with results cache.
Fixed an issue where an OversizedAllocationException could occur for collections of variable-length values due to unnecessary data buffer reallocations.
You can now specify columns for both sorting and partitioning in Reflections when the partitioning scheme uses a transformation.
Improved Reflection refresh behavior by fixing inaccurate duration reporting and adjusting retry timing for long-running jobs and limited retry configurations.
Fixed an issue with row count estimates in Delta Lake tables that could lead to suboptimal query plans.
April 8, 2025
Updated the following library to address potential security issues:
- org.apache.parquet:parquet-avro to version 1.15.1 [CVE-2025-30065].
DX-102559
March 31, 2025
Fixed an issue where queries using Reflections failed or referenced stale materializations.
Fixed an issue where the LEAD() function returned incorrect values for the last row in a partition, where NULL was expected.
Queries accelerated by the results cache now display a lightning bolt icon and indicate a cache hit on the Job Overview page.
March 17, 2025
Dremio now supports Azure Storage container writes with the Azure Blob File System (ABFSS) driver. Iceberg metadata on Azure now defaults to the abfss:// format instead of wasbs://.
You can now use clustering as a straightforward and effective alternative to partitioning. Clustering simplifies processes and helps ensure fast queries on Apache Iceberg tables.
Dremio now supports SAP HANA as a source for AWS projects.
Azure Data Lake Storage Gen1 is no longer supported following its official retirement by Microsoft in February 2024.
You can now update Sample Source and SampleDB source settings with the necessary permissions.
Added an explicit exception for the unsupported IGNORE NULLS option in window functions.
Queries now scan only the required fields from complex structure type columns to prevent errors in query execution.
Fixed an issue where raw or aggregate Reflection recommendations were duplicated when a Reflection had no available materializations.
Fixed an issue where Reflections could have an empty Reflection score.
When writing Parquet files to Iceberg tables:
store.parquet.block-sizeanddremio.iceberg.optimize.target_file_size_mbare now ignored.- The
write.parquet.row-group-size-bytesproperty now controls row group and file size, with a default value of 128 MB instead of 256 MB. write.metadata.metrics.max-inferred-column-defaultsandwrite.metadata.metrics.defaultnow control file-level metrics in Iceberg metadata. Thewrite.metadata.metrics.max-inferred-column-defaultsproperty is now 100 instead of unlimited.- The
write.metadata.metrics.defaultmode is nowtruncate(16)instead offull. - The default value for
write.parquet.page-row-limitis now 20,000 instead of unlimited.DX-99417DX-99441DX-99743
Long project owner names are now displayed correctly.
Query completion is no longer blocked by profile updates. The profile now shows a status during updates.
February 21, 2025
Dremio supports Snowflake Open Catalog as a source.
Dremio supports Unity Catalog as a source.
February 19, 2025
Dremio supports SAP HANA as a source for Azure projects.
Fixed an issue where queries could be stuck in a pending state when executor node events are not correctly propagated to the coordinators, causing coordinators not to take appropriate corrective action.
Enhanced default raw Reflection matching to include query tree hashes so that more SQL queries can match without direct view references.
Updated the list of Dremio-supported properties and default values in the Supported Properties of Apache Iceberg Tables.
The Iceberg table property compatibility.snapshot-id-inheritance.enabled is no longer written by default when creating Iceberg tables, although it can be used for Iceberg tables (V1) for backward compatibility reasons.
Updated the following library to address potential security issues:
- AsyncHttpClient to 3.0.1 [CVE-2024-53990] DX-98578
Updated the source categories in Dremio Cloud as follows: Lakehouse Catalogs, Object Storage, and Databases.
Fixed some cases where a Reflection did not have score on the Reflections page.
Fixed an issue that could cause a query with a LIMIT clause to not be accelerated due to miscalculated row adjustments.
Fixed an issue with zero milliseconds that could occur when using the CURRENT_TIME function.
February 4, 2025
Added isPrimaryCatalog in the Catalog API, so you can update the Arctic primary source.
January 28, 2025
Fixed an issue where the snapshot ID for a table could stop refreshing and cause a Reflection to continuously refresh.
Addressed regional endpoint issues with Amazon S3 and AWS STS for users that have projects deployed in VPCs with private subnets that lack public internet connectivity.
January 23, 2025
Dremio supports Azure Synapse Analytics as a source.
Dremio supports Google BigQuery as a source.
You can now select AWS Graviton instances when creating new engines or editing existing engines.
Fixed an issue that could prevent the retry policy for Reflection refreshes from working in all cases.
Sonar cards on the Sonar Projects page now show the full name of the user who created the project instead of their email address, and when a user has been deleted from the system, you will see 
Unavailable. Users assigned to the PUBLIC role who do not have access to fetch user details no longer see a gray empty circle in place of user details.
Fixed an issue where a Reflection could have an empty Reflection score on the Reflections page.
Fixed an issue where clicking on a script in the search results on the Datasets page does not open that script in the SQL Runner.
The script lookup in the All/Mine tabs on the Scripts panel in the SQL Runner was previously case-sensitive. Now, the script lookup is case insensitive.
Because the Arrow caching feature for Reflections has been deprecated, any remaining references to Arrow cache for Reflections have been removed, such as in the sys.project.reflections system table and APIs.
You can now exclude specific tables directly in the catalog source when running the VACUUM CATALOG SQL command.
Removed unsupported pushdown operations with VARCHAR data types from PostgreSQL advanced relational pushdown (ARP) connectors.
Fixed an issue in some cases that could prevent runtime filtering if the CONVERT_FROM SQL function was used in the query.
January 15, 2025
Fixed an issue that could prevent the OpenID Connect (OIDC) option from appearing in the dropdown menu as an authentication provider for Dremio Enterprise Edition under Authentication on the Organization Settings page.
January 8, 2025
Fixed an issue that could cause Dremio Enterprise Edition to not propagate properly during the Reflection refresh process and cause SQL commands containing REFRESH REFLECTIONS to fail.
December 20, 2024
Fixed an issue with the SQL Runner that could prevent users from being able to expand an Arctic catalog in the Data panel to click 
to add a dataset or drag and drop the data into the SQL editor.
December 17, 2024
Parameterized prepared statements are now supported for Arrow Flight SQL JDBC to prevent SQL injection and enable customers to leverage client tools that support this feature. This feature supports SELECT statements.
Fixed a filter pushdown issue that could cause a query to run slowly or return incorrect results.
Fixed an SSL negotiation issue when connecting to Dremio servers through secure connections.
Updated password change behavior in the Dremio console to more effectively handle UI session termination after password rotation.
Fixed an issue that could cause reading tables from the AWS Glue Data Catalog to be slow.
Fixed an issue where a duplicated table schema could be written to its metadata file.
Fixed an issue where REFLECTION REFRESH jobs could fail for Reflections involving joins in the query plan if field-based incremental refresh was configured on the underlying datasets. These Reflection refreshes will now succeed using full refreshes.
Fixed a issue that could occur when you request Reflection recommendations for a specific job and the query you want to accelerate contains a subquery.
Fixed an issue that could cause the SQL Runner to display the view definition of the last executed preview instead of the saved view definition.
Navigating to a dataset with dots in the name on the History tab of the Datasets page will now work as expected.
The SHOW TBLPROPERTIES SQL command will now return the format version for Iceberg tables.
Fixed an issue for SELECT queries when using LIMIT and OFFSET for a value greater than the maximum value for a signed integer. Now LIMIT and OFFSET cannot exceed the maximum integer value.
Deprecated COMPACTION and LOAD MATERIALIZATION for Reflection jobs because they optimize non-Iceberg materialization and Dremio now supports only Iceberg materialization. The sys.project.materializations table now only shows REFRESH REFLECTION jobs. COMPACT and LOAD are no longer considered reserved keywords for SQL queries.
Fixed an issue that would cause a query on the sys.project.history tables using 'SYS' uppercase to fail.
Fixed an issue for SELECT queries when using LIMIT and OFFSET for a value greater than the maximum value for a signed integer. Now LIMIT and OFFSET cannot exceed the maximum integer value.
December 3, 2024
Fixed an issue that could cause a query failure due to an exceeded timeout after an elapsed query runtime limit.
Fixed an issue that could cause users without the VIEW JOB HISTORY privilege or ADMIN role to view jobs executed by other users on the Jobs page.
Fixed an issue that could prevent users from enabling or disabling system-wide acceleration on the Reflections page.
Fixed an issue where CLUSTER and CLUSTERING were accidentally added as reserved keywords. They are no longer treated as reserved.
November 19, 2024
The Arrow Flight SQL JDBC driver now supports the project ID parameter for connecting to non-default projects in Dremio Cloud.
When configuring cloud resources in Dremio Cloud, you can specify separate resource groups for compute resources (such as virtual machine scale sets) and network resources (such as virtual networks). While using a single resource group was previously supported, this enhancement offers improved flexibility for cloud infrastructure organization and strengthens security posture.
Dark Mode is now available in Dremio! You can now choose between light mode, dark mode, or system settings. Try it out by going to Account Settings > Appearance.
In preparation for the upcoming End of Life (EOL) of Amazon Linux 2, Dremio has transitioned the base operating system for its executors from Amazon Linux 2 to Ubuntu LTS. This shift ensures continued support, security updates, and improved compatibility with modern infrastructure and libraries.
Updated the following libraries to address potential security issues:
- Ranger client in Dremio from version 1.1 to 1.2 DX-93529
- Avro from 1.11.3 to 1.11.4 [CVE-2024-47561] DX-96442
Fixed a NullPointerException that could occur during a metadata refresh due to closing a filesystem object already evicted from the cache.
Improved the sync time for Reflection recommendations.
Fixed an issue that could prevent async Azure reads due to a time zone issue in locations east of Greenwich Mean Time (GMT).
Fixed an issue that could prevent users from being able to run or preview a query in the SQL Runner after viewing the History tab for the query on the Datasets page.
Navigating to the wiki of a dataset from the SQL Runner will no longer cause (edited) to appear next to the dataset name.
Fixed an issue that could prevent changes to the project storage settings from updating on the Project Settings page until the page was refreshed.
Fixed a "Could not update dag for engine schedule" issue that could occur when trying to save edits to the engine schedule on the Engines page.
October 30, 2024
Running a SELECT COUNT(*) query now uses Iceberg metadata instead of scanning the entire Iceberg table to return the total number of rows in a table.
For AWS accounts, fixed an issue where the Save button is disabled while editing the configuration in the catalog settings.
Fixed an issue that could prevent users from editing project settings for projects created using an AWS cloud.
Fixed a issue where decorrelating a subquery with an EXISTS statement and an empty GROUP BY clause could result in incorrect data.
October 16, 2024
You can now access the Arctic UDFs via API which supports CRUD actions.
Fixed an issue where file handles (and HTTP connections) were left opened after reading JSON commit logs for Delta tables within a AWS Glue Data Catalog.
Fixed an issue that could prevent a user from scrolling through the wiki content in the Details tab on the Datasets page.
Fixed an issue with "Go to Table" functionality on the Datasets page that could cause the table definition to be blank on the Data tab when multiple partitions from the same column are added to an Arctic table.
Dremio will now notify you when a view's metadata is out-of-date due to schema changes in the underlying views or tables. The notification will appear on the Data panel in the SQL Runner and in the Details and Lineage tabs on the Datasets page.
Fixed an issue that could cause query results to appear in a new tab when cached results are loading in the SQL Runner.
Creating a new tab while a script is executing will now cause a confirmation dialog to appear in the SQL Runner.
Fixed an issue that prevented non-admin users from saving a view using the Save as View button in the SQL Runner.
The Start Time filter on the Jobs page no longer updates to Custom after a user selects a start time filter, leaves for a short time, and then comes back to the page.
The Visual Profile tab on the Jobs page will now show the correct error message when a visual profile cannot be generated.
When hovering over the tooltip for a Reflection score on the Reflections page, the daily query accelerated value will be rounded to the nearest integer.
Fixed a NullPointerException (NPE) that could cause VACUUM jobs for Reflections to fail.
HASH_JOIN will now randomize the distribution if there are nulls being generated by a join condition in order to avoid sending the data to the same thread and eventually reduce the skew.
The following words were incorrectly made reserved keywords: CLUSTER, CLUSTERING.
September 23, 2024
Fixed an issue that could occur when attempting to access datasets in the Data panel in the SQL Runner, resulting in a "Something went wrong" error message.
Fixed an issue that could cause views to not save properly for non-admin users when clicking the Save as View button in the SQL Runner.
September 20, 2024
In Enterprise edition, members of the admin role can now configure an OpenID Connect (OIDC) identity provider for authentication under Organization Settings on the Authentication page or using the Identity Providers API. This new authentication method allows organizations to configure SSO with OIDC-compliant identity providers.
You can now connect to Vertica as a source in Dremio.
Azure regions East US 2 and West US 2 have been added for Dremio Cloud.
Create user-defined functions (UDFs) to extend the native capabilities of Dremio’s SQL dialect and reuse business logic across queries. Because UDFs are native, first-class entities in the Arctic catalog, you can seamlessly experiment on and change UDFs using Arctic's branching capabilities.
New SQL commands have been added for UDFs: CREATE FUNCTION, DROP FUNCTION, DESCRIBE FUNCTION, and SHOW FUNCTIONS. UDFs can also be used in SELECT statements.
Fixed an issue where queries could be stuck in planning and accumulate until a coordinator restart is required.
Resolved an issue with queries against AWS Glue that were failing due to errors when loading an endpoints.json partitions file.
Fixed an issue where a Reflection is given a score of 0 if an error occurs while calculating the score. Now the score will be empty instead of 0.
When no new data is read during REFRESH Reflection jobs, the snapshot IDs of the datasets and Reflections that they depend on are shown in the Refresh Decision section of the query profile.
Improved logout functionality.
The Edit Rule dialog now auto-populates with information from the existing rule.
You can now open the Details Panel from the options menu on the Datasets page.
The result summary table now sorts cached query results in the summary table on the SQL Runner page in the order that the queries are executed.
You can now see the selected value for a Reflection's partition transformation in the Reflections editor.
Fixed a compilation issue that could occur when a window function is used with an ARRAY type column.
Fixed an issue that could occur when complex types are returned when splitting a function such as ARRAY_COMPACT.
Fixed an issue that could prevent a Reflection score from being provided when running USE to set the query context.
Fixed an issue where a failed Reflection could show an incorrect record count and size in the sys.reflections system table.
Fixed an issue that could cause ANALYZE TABLE to fail when table column names contained reserved keywords.
September 10, 2024
Fixed an intermittent issue that could cause project creation to fail with a ProjectConfigServiceException. Project creation is no longer prevented due to an interruption when an asynchronous source is being created or updated, causing the source to not update properly.
September 3, 2024
Fixed an issue that could result in a leak from an unclosed connection in Microsoft SQL Server, Oracle, or Dremio cluster data sources.
Fixed an issue that could cause VACUUM CATALOG to fail with a ContainerNotFoundException. Also fixed a bug that could cause VACUUM CATALOG to fail with an IllegalArgumentException if a view is created in an Arctic catalog.
August 22, 2024
Dremio now supports writes using merge-on-read in the Apache Iceberg table properties, which creates positional delete files and optimizes DML operations.
A Reflection score shows the value that a Reflection provides to your workloads based on the jobs that have been executed in the last 7 days.
For Reflections on Iceberg tables, a new type of refresh policy is available. You can now automatically refresh Reflections for underlying tables that are in Iceberg format when new snapshots are created after an update.
When Reflection refresh jobs fail, Dremio now retries the refresh according to a uniform policy.
You can authenticate to a Snowflake source using key pair authentication.
User impersonation is now supported for Microsoft SQL Server sources.
OPTIMIZE TABLE now supports Iceberg tables with equality deletes.
Mapping table columns to the corresponding Parquet columns has been improved for Iceberg tables that are created from Parquet files and have columns without IDs.
Fixed an issue with long calls to AWS Glue sources that could result in a deadlock, preventing the Glue database from appearing as a source in the Dremio console and privileges granted to roles and users from applying properly to that source.
Fixed an issue that could prevent Reflections with a row-access or column-masking policy from accelerating queries after an upgrade.
Automatically generated Reflection recommendations now appear only if they meet a minimum threshold of value to your workloads.
In the Reflections editor, the Refresh Now button no longer appears for failed Reflections.
Clicking on a dataset on the Datasets page or clicking the Open Results link on the Job Overview page creates a new tab that is not automatically saved as a script.
Fixed an issue that could prevent Reflections from being created for queries that contain an OVER clause with a specified RANGE.
Reduced memory usage when SELECT statements are run from the information schema by adjusting the page size parameter for pagination.
Fixed an issue that could cause the CURRENT_TIME function to return incorrect data when a user's timezone is defined.
Improved the query performance for VACUUM TABLE when using EXPIRE SNAPSHOTS.
Fixed an issue that could prevent partition columns from being applied in INSERT and CREATE TABLE AS statements.