Distributed Storage

The distributed storage cache location contains accelerator, tables, job results, downloads, and upload data.

The location is specified with the paths.dist property in the dremio.conf file. In addition, this property must be the same across all nodes in the cluster. This means that if local storage or NAS is used, the configured path must exist on, or be accessible from, all nodes. If the value of this property is changed, then it must be updated in the dremio.conf file on all nodes in the Dremio cluster. By default Dremio uses the disk space on local Dremio nodes.

The following table shows which stores are supported:

Store Supported?
NAS Yes
HDFS Yes
MapR-FS Yes
Amazon S3 Yes
Amazon Elastic File System (EFS) No
Azure File System (AFS) No
Azure Data Lake Store (ADLS Gen1) Yes
Azure Storage (ADLS Gen2) Yes

For More Information


results matching ""

    No results matching ""