Skip to main content

Configuring S3-Compatible Storage

You can use S3-compatible storage, such as MinIO, as a Dremio data source as long as the storage is completely S3-compatible. We recommend confirming S3 compatibility with the storage provider before you start the configuration steps.

To configure S3-compatible storage as a data source in the Dremio console:

  1. Sign in to your Dremio Cloud account.
  2. Under Datasets > Data Lakes, select the S3 source.
  3. In the S3 source section, upper-right corner, click the Settings (gear) icon.
  4. In the Edit Source dialog box, select Advanced Options.
  5. Under the Advanced Options section, tick the checkbox for Enable compatibility mode.
  6. Under the Connection Properties section, click Add property.
  7. In the Name field, enter fs.s3a.path.style.access.
  8. In the Value field, enter true.
note

This setting ensures that the request path is created correctly when using IP addresses or hostnames as the endpoint.

  1. Click Add property again and add the fs.s3a.endpoint property and its corresponding server endpoint value (IP address).
note

The endpoint value cannot contain the http(s):// prefix nor can it start with the string s3. For example, if the endpoint is http://123.1.2.3:9000, the value is 123.1.2.3:9000.

Return to Connecting to Amazon S3.