Dremio Community

S3 on Amazon EMR Configuration

When working with S3-backed Hive tables on Amazon EMR, you need to configure Hive with an additional property for that Hive source.

Property Name Value
fs.s3.impl org.apache.hadoop.fs.s3a.S3AFileSystem

To configure for S3-backed Hive tables on Amazon EMR:

  1. Select Advanced Options.
  2. Set the fs.s3.impl Hive connection property to org.apache.hadoop.fs.s3a.S3AFileSystem.
  3. Restart your coordinator nodes.