Connecting to Your Data
Dremio supports a variety of data sources, including metastores, local and cloud-based object storage, and databases.
note:
Case-sensitive source data file/table names are not supported. In Dremio, data filenames in your data source are “seen” in a case-insensitive manner. So, if you have three file names with difference cases (for example, JOE
Joe
, and joe
), Dremio “sees” the files as having the same name. Thus, searching on Joe
, JOE
, or joe
, can result in unanticipated data results.In addition, columns in a table that have the same name with different cases are not supported. For example, if two columns named Trip_Pickup_DateTime
and trip_pickup_datetime
exist in the same table, one of the columns may disappear when the header is extracted.
Metastores
Object Storage
Databases
-
Dremio Cluster – you can connect to one or more other Dremio Software clusters and run queries on the data sources that they are connected to. You can even run queries that federate data across connected clusters.
-
IBM Db2 
Dremio enables users to run external queries, queries that use the native syntax of the relational database, to process SQL statements that are not yet supported by Dremio or are too complex to convert. Dremio administrators enable the feature for each data source and specify which Dremio users can edit that source. See Querying External Data Sources for more information.
Dremio improves query performance for relational database datasets with Runtime Filtering, which applies dimension table filters to joined fact tables at runtime.
Note:
Decimal Support
Decimal-to-decimal mappings are supported for relational database sources.
CollationRelational database sources must have a collation equivalent to
LATIN1_GENERAL_BIN2
to ensure consistent results when operations are pushed down. For non-equivalent collations, create a view that coerces the collation to one that is equivalent toLATIN1_GENERAL_BIN2
and access that view.