Configuring S3-Compatible Storage
You can use S3-compatible storage, such as MinIO, as a Dremio data source as long as the storage is completely S3-compatible. We recommend confirming S3 compatibility with the storage provider before you start the configuration steps.
To configure S3-compatible storage as a data source in the Dremio console:
Sign in to your Dremio Cloud account.
Under Datasets > Data Lakes, select the S3 source.
In the S3 source section, upper-right corner, click the Settings (gear) icon.
In the Edit Source dialog box, select Advanced Options.
Under the Advanced Options section, tick the checkbox for Enable compatibility mode.
Under the Connection Properties section, click Add property.
In the Name field, enter
fs.s3a.path.style.access
.In the Value field, enter
true
.noteThis setting ensures that the request path is created correctly when using IP addresses or hostnames as the endpoint.
Click Add property again and add the
fs.s3a.endpoint
property and its corresponding server endpoint value (IP address).noteThe endpoint value cannot contain the
http(s)://
prefix. For example, if the endpoint ishttp://123.1.2.3:9000
, the value is123.1.2.3:9000
..
Return to Connecting to Amazon S3.