Changelog
This changelog provides a detailed record of the previous 12 months of updates and enhancements we have made to improve your Dremio Cloud experience.
September 18, 2025
The Arrow Flight SQL JDBC driver now supports parameterized DML (INSERT, UPDATE, DELETE, MERGE), improving client tool integration and enhancing protection against SQL injection.
Fixed an issue that prevented adding RDBMS sources (MySQL, PostgreSQL, SQL Server, and Redshift) due to a library compatibility issue.
Fixed an UnsupportedOperationException encountered during metadata refresh of Iceberg tables in a Hive source if they did not contain table properties.
Fixed a NullPointerException that could occur when querying a table in an AWS Glue Data Catalog with an empty serdeInfo field.
Improved reliability of Amazon S3 connectivity with configurable timeout settings in milliseconds. The fs.s3a.connection.request.timeout property can be configured in the Amazon S3 connection properties or in the core-site.xml file for distributed storage.
Fixed a query performance regression related to Autonomous Reflection data collection.
Improved Autonomous Reflections with enhanced pattern detection that automatically creates more efficient Reflections to accelerate your queries.
Fixed an issue where Reflection recommendations were not generated due to inaccurate row count estimates.
Improved Reflection recommendations to generate multiple hash-matching Raw Reflections for different queries, resulting in better query acceleration.
Fixed issues with job usage info collection that caused exceptions during Reflection recommendation analysis and prevented double-counting of Arrow Flight queries.
Fixed an issue where Raw Reflections were automatically created without user changes in Advanced mode.
Added new system table function sys.reflection_refresh_settings to help administrators monitor and troubleshoot Reflection refresh configurations.
Improved Iceberg compliance for INSERT statements by writing null values for unspecified columns in Parquet files. This may impact performance proportional to the number of omitted fields.
Fixed query failures in right and outer joins with nullable fields.
The TO_NUMBER function now requires a constant, non-empty format string to improve query reliability and prevent runtime errors.
Fixed an issue where the CREATE USER SQL command would fail with an "Application error processing RPC" error.
Fixed an issue where replacing an existing view would fail if the view used the CONVERT_FROM function.
Fixed an issue where the popup that appears when an engine is starting in the SQL Runner would flicker during job execution.
Fixed an issue where opening a Reflection from semantic search would not work as expected.
August 19, 2025
Fixed an issue where queries on Iceberg tables in Hive sources could fail with an UnsupportedOperationException during metadata refresh if the tables lacked table properties.
Fixed an issue where datetime parsing functions failed with a "Can't lex input …TZH:TZM" error when using the TZH:TZM format pattern. Affected functions include TO_TIME, TO_DATE, TO_TIMESTAMP, IS_TIME, IS_TIMESTAMP, and UNIT_TIMESTAMP.
August 12, 2025
Datetime formats are now more strictly enforced, and timezone abbreviation behavior has been corrected. As a result, some queries may fail if formats are not aligned. For a complete overview, refer to Dremio's Knowledge Base.
Fixed an issue where certain queries failed with a FragmentMessageToExecutorFailed error.
Fixed an issue where a source doesn't exist error appeared for catalogs that users had access to.
Fixed an issue where Autonomous Reflections were not selecting the most optimal recommendations.
Fixed an issue where writing empty complex types to the results cache could trigger an IndexOutOfBoundsException.
Fixed an issue where queries returning zero rows with null columns were not handled correctly.
Improved Arctic catalog listing performance, reducing listing time by at least 50% in most cases.
Fixed an issue where DELETE operations could fail on certain Iceberg tables.
Fixed a NullPointerException when reading Delta tables that had undergone schema evolution.
Improved query performance by reducing initialization times and storage overhead for Reflections.
Improved read performance for Iceberg v2 tables that simultaneously contain both equality and position deletes.
Improved Amazon S3 connectivity for AWS Glue, Hive, Iceberg Catalogs, distributed storage, and Nessie sources.
Fixed an issue where Reflection recommendations would not be provided for queries involving TIMESTAMP columns.
Fixed an issue where Iceberg Data Manipulation Language (DML) queries were writing null results on some rows.
Added VACUUM TABLE support for the REMOVE ORPHAN FILES command to clean up files in Iceberg tables that are not tracked via table metadata.
Fixed an issue where columns for starred datasets would not appear in the SQL Runner's left panel if the dataset name or path contained a . character.
Fixed an issue where clicking focus on a dataset in the Lineage graph would result in a blank page.
Fixed an issue where scripts created through Dremio's API could have their contents overwritten when opened in the SQL Runner.
Fixed an issue where the Details section of tables would incorrectly show zero columns.
Fixed an issue where the query duration timer would continue running after a query completed.
July 8, 2025
Fixed an issue where the Dremio console could become unresponsive when selecting an option from the Reflection execution strategy in Advanced settings.
Fixed an issue where MongoDB queries using the $nor expression failed due to incorrect pushdown in aggregation expressions.
Fixed an issue where the Reflection refresh retry policy could fail during a Dremio upgrade.
Fixed an issue where closing a temporary tab before it could autosave would incorrectly trigger a "This script has been deleted" dialog.
June 16, 2025
Fixed an issue that caused certain queries to fail when the HASH_JOIN operator spilled to disk and triggered the exception IndexOutOfBoundsException.
June 5, 2025
Fixed an issue where metadata was not accessible for Arctic sources.
June 4, 2025
Updates to Autonomous Reflections are now shown in the history.autonomous_reflection system table.
Updated the following library to address potential security issues:
- Hadoop to Protobuf 3.15.0+ [CVE-2022-3171, CVE-2022-3509, CVE-2022-3510, CVE-2021-22570].
DX-102976
The Reflection refresh retry policy is now enforced within a 72-hour window.
Queries now scan only the required fields from complex structure type columns to prevent errors in query execution.
Fixed an issue where large case expressions were causing the planner to hang.
Fixed a memory leak on the coordinator when queries using Arrow Flight are canceled.
Fixed an issue where queries against tables with equality deletes could fail if the fields used in the deletes had capital letters.
Fixed an issue where Delta tables with unsupported minReaderVersion values were allowed to be promoted, leading to query failures.
Fixed an issue with CREATE TABLE AS SELECT statements on Parquet datasets that could result in an error.
Fixed an issue where partition recommendations were not generated for Reflections defined on views.
The following Iceberg table properties are now supported when configuring Parquet bloom filters:
write.parquet.bloom-filter-enabled.column.<col>enables bloom filters for specific columns.write.parquet.bloom-filter-max-bytessets the maximum size of the bloom filter bitset (default: 1MB).write.parquet.bloom-filter-fpp.column.<col>configures the false positive probability per column (default: 0.01).DX-100948
Fixed an issue where semantic search results did not include parent folders or source paths for entities the user had permission to read.
Queries with too many expressions in WHERE clauses or CASE statements now return a clear error message instead of failing unexpectedly.
Removed the measure_columns column from the sys.reflections table.
Running a SELECT COUNT(*) query on Iceberg tables now leverages metadata to return row counts without scanning the entire table.
Fixed an issue related to CREATE TABLE AS SELECT statements for Parquet datasets with the error message "Multiple entries with same key: $file=$file: Utf8 and $file=$file: Utf8".
Added an INCLUDE option to VACUUM CATALOG to allow targeting specific tables for vacuuming.
You can now manually refresh failed Reflections by clicking the "Refresh now" icon on the Reflections page.
The Enable asynchronous access when possible and Enable asynchronous access for Parquet datasets checkboxes have been removed from the advanced options in the source configuration dialog to simplify setup and ensure optimal performance.
May 7, 2025
Quickly discover your data using the AI-enabled semantic search. Object names, wikis, labels, column names, and other metadata are used to serve the most relevant datasets and entities.
Autonomous Reflections automatically creates and manages Reflections, accelerating query performance and optimizing data accessibility. This enables you to derive faster insights, scale effortlessly, and make data-driven decisions.
Dremio now supports a generic Iceberg REST Catalog as a source. This allows you to connect to Iceberg catalogs over the Iceberg REST API. This source is located within the Lakehouse Catalogs.
Support for vended credentials has been added to Snowflake Open Catalog, Unity Catalog, and Iceberg REST Catalog.
Dremio now supports writes against Iceberg REST sources like Snowflake Open Catalog and the generic Iceberg REST Catalog. Unity Catalog remains read only.
Results cache is now supported to accelerate repeated queries.
Incremental Reflection refresh is now supported for tables in Unity Catalog.
Fixed an issue where sources with connection issues could not be modified or deleted.
Fixed an issue where queries returning more than 1 million rows could run slower with results cache.
Fixed an issue where an OversizedAllocationException could occur for collections of variable-length values due to unnecessary data buffer reallocations.
You can now specify columns for both sorting and partitioning in Reflections when the partitioning scheme uses a transformation.
Improved Reflection refresh behavior by fixing inaccurate duration reporting and adjusting retry timing for long-running jobs and limited retry configurations.
Fixed an issue with row count estimates in Delta Lake tables that could lead to suboptimal query plans.
April 8, 2025
Updated the following library to address potential security issues:
- org.apache.parquet:parquet-avro to version 1.15.1 [CVE-2025-30065].
DX-102559
March 31, 2025
Fixed an issue where queries using Reflections failed or referenced stale materializations.
Fixed an issue where the LEAD() function returned incorrect values for the last row in a partition, where NULL was expected.
Queries accelerated by the results cache now display a lightning bolt icon and indicate a cache hit on the Job Overview page.
March 17, 2025
Dremio now supports Azure Storage container writes with the Azure Blob File System (ABFSS) driver. Iceberg metadata on Azure now defaults to the abfss:// format instead of wasbs://.
You can now use clustering as a straightforward and effective alternative to partitioning. Clustering simplifies processes and helps ensure fast queries on Apache Iceberg tables.
Dremio now supports SAP HANA as a source for AWS projects.
Azure Data Lake Storage Gen1 is no longer supported following its official retirement by Microsoft in February 2024.
You can now update Sample Source and SampleDB source settings with the necessary permissions.
Added an explicit exception for the unsupported IGNORE NULLS option in window functions.
Queries now scan only the required fields from complex structure type columns to prevent errors in query execution.
Fixed an issue where raw or aggregate Reflection recommendations were duplicated when a Reflection had no available materializations.
Fixed an issue where Reflections could have an empty Reflection score.
When writing Parquet files to Iceberg tables:
store.parquet.block-sizeanddremio.iceberg.optimize.target_file_size_mbare now ignored.- The
write.parquet.row-group-size-bytesproperty now controls row group and file size, with a default value of 128 MB instead of 256 MB. write.metadata.metrics.max-inferred-column-defaultsandwrite.metadata.metrics.defaultnow control file-level metrics in Iceberg metadata. Thewrite.metadata.metrics.max-inferred-column-defaultsproperty is now 100 instead of unlimited.- The
write.metadata.metrics.defaultmode is nowtruncate(16)instead offull. - The default value for
write.parquet.page-row-limitis now 20,000 instead of unlimited.DX-99417DX-99441DX-99743
Long project owner names are now displayed correctly.
Query completion is no longer blocked by profile updates. The profile now shows a status during updates.
February 21, 2025
Dremio supports Snowflake Open Catalog as a source.
Dremio supports Unity Catalog as a source.
February 19, 2025
Dremio supports SAP HANA as a source for Azure projects.
Fixed an issue where queries could be stuck in a pending state when executor node events are not correctly propagated to the coordinators, causing coordinators not to take appropriate corrective action.
Enhanced default raw Reflection matching to include query tree hashes so that more SQL queries can match without direct view references.
Updated the list of Dremio-supported properties and default values in the Supported Properties of Apache Iceberg Tables.
The Iceberg table property compatibility.snapshot-id-inheritance.enabled is no longer written by default when creating Iceberg tables, although it can be used for Iceberg tables (V1) for backward compatibility reasons.
Updated the following library to address potential security issues:
- AsyncHttpClient to 3.0.1 [CVE-2024-53990] DX-98578
Updated the source categories in Dremio Cloud as follows: Lakehouse Catalogs, Object Storage, and Databases.
Fixed some cases where a Reflection did not have score on the Reflections page.
Fixed an issue that could cause a query with a LIMIT clause to not be accelerated due to miscalculated row adjustments.
Fixed an issue with zero milliseconds that could occur when using the CURRENT_TIME function.
February 4, 2025
Added isPrimaryCatalog in the Catalog API, so you can update the Arctic primary source.
January 28, 2025
Fixed an issue where the snapshot ID for a table could stop refreshing and cause a Reflection to continuously refresh.
Addressed regional endpoint issues with Amazon S3 and AWS STS for users that have projects deployed in VPCs with private subnets that lack public internet connectivity.
January 23, 2025
Dremio supports Azure Synapse Analytics as a source.
Dremio supports Google BigQuery as a source.
You can now select AWS Graviton instances when creating new engines or editing existing engines.
Fixed an issue that could prevent the retry policy for Reflection refreshes from working in all cases.
Sonar cards on the Sonar Projects page now show the full name of the user who created the project instead of their email address, and when a user has been deleted from the system, you will see 
Unavailable. Users assigned to the PUBLIC role who do not have access to fetch user details no longer see a gray empty circle in place of user details.
Fixed an issue where a Reflection could have an empty Reflection score on the Reflections page.
Fixed an issue where clicking on a script in the search results on the Datasets page does not open that script in the SQL Runner.
The script lookup in the All/Mine tabs on the Scripts panel in the SQL Runner was previously case-sensitive. Now, the script lookup is case insensitive.
Because the Arrow caching feature for Reflections has been deprecated, any remaining references to Arrow cache for Reflections have been removed, such as in the sys.project.reflections system table and APIs.
You can now exclude specific tables directly in the catalog source when running the VACUUM CATALOG SQL command.
Removed unsupported pushdown operations with VARCHAR data types from PostgreSQL advanced relational pushdown (ARP) connectors.
Fixed an issue in some cases that could prevent runtime filtering if the CONVERT_FROM SQL function was used in the query.
January 15, 2025
Fixed an issue that could prevent the OpenID Connect (OIDC) option from appearing in the dropdown menu as an authentication provider for Dremio Enterprise Edition under Authentication on the Organization Settings page.
January 8, 2025
Fixed an issue that could cause Dremio Enterprise Edition to not propagate properly during the Reflection refresh process and cause SQL commands containing REFRESH REFLECTIONS to fail.
December 20, 2024
Fixed an issue with the SQL Runner that could prevent users from being able to expand an Arctic catalog in the Data panel to click 
to add a dataset or drag and drop the data into the SQL editor.
December 17, 2024
Parameterized prepared statements are now supported for Arrow Flight SQL JDBC to prevent SQL injection and enable customers to leverage client tools that support this feature. This feature supports SELECT statements.
Fixed a filter pushdown issue that could cause a query to run slowly or return incorrect results.
Fixed an SSL negotiation issue when connecting to Dremio servers through secure connections.
Updated password change behavior in the Dremio console to more effectively handle UI session termination after password rotation.
Fixed an issue that could cause reading tables from the AWS Glue Data Catalog to be slow.
Fixed an issue where a duplicated table schema could be written to its metadata file.
Fixed an issue where REFLECTION REFRESH jobs could fail for Reflections involving joins in the query plan if field-based incremental refresh was configured on the underlying datasets. These Reflection refreshes will now succeed using full refreshes.
Fixed a issue that could occur when you request Reflection recommendations for a specific job and the query you want to accelerate contains a subquery.
Fixed an issue that could cause the SQL Runner to display the view definition of the last executed preview instead of the saved view definition.
Navigating to a dataset with dots in the name on the History tab of the Datasets page will now work as expected.
The SHOW TBLPROPERTIES SQL command will now return the format version for Iceberg tables.
Fixed an issue for SELECT queries when using LIMIT and OFFSET for a value greater than the maximum value for a signed integer. Now LIMIT and OFFSET cannot exceed the maximum integer value.
Deprecated COMPACTION and LOAD MATERIALIZATION for Reflection jobs because they optimize non-Iceberg materialization and Dremio now supports only Iceberg materialization. The sys.project.materializations table now only shows REFRESH REFLECTION jobs. COMPACT and LOAD are no longer considered reserved keywords for SQL queries.
Fixed an issue that would cause a query on the sys.project.history tables using 'SYS' uppercase to fail.
Fixed an issue for SELECT queries when using LIMIT and OFFSET for a value greater than the maximum value for a signed integer. Now LIMIT and OFFSET cannot exceed the maximum integer value.
December 3, 2024
Fixed an issue that could cause a query failure due to an exceeded timeout after an elapsed query runtime limit.
Fixed an issue that could cause users without the VIEW JOB HISTORY privilege or ADMIN role to view jobs executed by other users on the Jobs page.
Fixed an issue that could prevent users from enabling or disabling system-wide acceleration on the Reflections page.
Fixed an issue where CLUSTER and CLUSTERING were accidentally added as reserved keywords. They are no longer treated as reserved.
November 19, 2024
The Arrow Flight SQL JDBC driver now supports the project ID parameter for connecting to non-default projects in Dremio Cloud.
When configuring cloud resources in Dremio Cloud, you can specify separate resource groups for compute resources (such as virtual machine scale sets) and network resources (such as virtual networks). While using a single resource group was previously supported, this enhancement offers improved flexibility for cloud infrastructure organization and strengthens security posture.
Dark Mode is now available in Dremio! You can now choose between light mode, dark mode, or system settings. Try it out by going to Account Settings > Appearance.
In preparation for the upcoming End of Life (EOL) of Amazon Linux 2, Dremio has transitioned the base operating system for its executors from Amazon Linux 2 to Ubuntu LTS. This shift ensures continued support, security updates, and improved compatibility with modern infrastructure and libraries.
Updated the following libraries to address potential security issues:
- Ranger client in Dremio from version 1.1 to 1.2 DX-93529
- Avro from 1.11.3 to 1.11.4 [CVE-2024-47561] DX-96442
Fixed a NullPointerException that could occur during a metadata refresh due to closing a filesystem object already evicted from the cache.
Improved the sync time for Reflection recommendations.
Fixed an issue that could prevent async Azure reads due to a time zone issue in locations east of Greenwich Mean Time (GMT).
Fixed an issue that could prevent users from being able to run or preview a query in the SQL Runner after viewing the History tab for the query on the Datasets page.
Navigating to the wiki of a dataset from the SQL Runner will no longer cause (edited) to appear next to the dataset name.
Fixed an issue that could prevent changes to the project storage settings from updating on the Project Settings page until the page was refreshed.
Fixed a "Could not update dag for engine schedule" issue that could occur when trying to save edits to the engine schedule on the Engines page.
October 30, 2024
Running a SELECT COUNT(*) query now uses Iceberg metadata instead of scanning the entire Iceberg table to return the total number of rows in a table.
For AWS accounts, fixed an issue where the Save button is disabled while editing the configuration in the catalog settings.
Fixed an issue that could prevent users from editing project settings for projects created using an AWS cloud.
Fixed a issue where decorrelating a subquery with an EXISTS statement and an empty GROUP BY clause could result in incorrect data.
October 16, 2024
You can now access the Arctic UDFs via API which supports CRUD actions.
Fixed an issue where file handles (and HTTP connections) were left opened after reading JSON commit logs for Delta tables within a AWS Glue Data Catalog.
Fixed an issue that could prevent a user from scrolling through the wiki content in the Details tab on the Datasets page.
Fixed an issue with "Go to Table" functionality on the Datasets page that could cause the table definition to be blank on the Data tab when multiple partitions from the same column are added to an Arctic table.
Dremio will now notify you when a view's metadata is out-of-date due to schema changes in the underlying views or tables. The notification will appear on the Data panel in the SQL Runner and in the Details and Lineage tabs on the Datasets page.
Fixed an issue that could cause query results to appear in a new tab when cached results are loading in the SQL Runner.
Creating a new tab while a script is executing will now cause a confirmation dialog to appear in the SQL Runner.
Fixed an issue that prevented non-admin users from saving a view using the Save as View button in the SQL Runner.
The Start Time filter on the Jobs page no longer updates to Custom after a user selects a start time filter, leaves for a short time, and then comes back to the page.
The Visual Profile tab on the Jobs page will now show the correct error message when a visual profile cannot be generated.
When hovering over the tooltip for a Reflection score on the Reflections page, the daily query accelerated value will be rounded to the nearest integer.
Fixed a NullPointerException (NPE) that could cause VACUUM jobs for Reflections to fail.
HASH_JOIN will now randomize the distribution if there are nulls being generated by a join condition in order to avoid sending the data to the same thread and eventually reduce the skew.
The following words were incorrectly made reserved keywords: CLUSTER, CLUSTERING.
September 23, 2024
Fixed an issue that could occur when attempting to access datasets in the Data panel in the SQL Runner, resulting in a "Something went wrong" error message.
Fixed an issue that could cause views to not save properly for non-admin users when clicking the Save as View button in the SQL Runner.
September 20, 2024
In Enterprise edition, members of the admin role can now configure an OpenID Connect (OIDC) identity provider for authentication under Organization Settings on the Authentication page or using the Identity Providers API. This new authentication method allows organizations to configure SSO with OIDC-compliant identity providers.
You can now connect to Vertica as a source in Dremio.
Azure regions East US 2 and West US 2 have been added for Dremio Cloud.
Create user-defined functions (UDFs) to extend the native capabilities of Dremio’s SQL dialect and reuse business logic across queries. Because UDFs are native, first-class entities in the Arctic catalog, you can seamlessly experiment on and change UDFs using Arctic's branching capabilities.