Dremio Software
Dremio Cloud
Dremio Software
Getting Started with Dremio on AWS
Getting Started with Dremio on Azure
Getting Started with Dremio on GCP
Getting Started with Dremio on Your Infrastructure
Cluster Deployments
Deployment Architecture
Dremio Services
Metadata Storage
Distributed Storage
Coordinator Nodes System-level Caching
ZooKeeper
High Availability
Wire Encryption
Limits
Customizing Configuration
Configuring via dremio.conf
Configuring Dremio Services
Configuring Metadata Storage
Configuring Distributed Storage
Configuring ZooKeeper
Configuring High Availability
Configuring Cloud Cache
Configuring Wire Encryption
Configuring Authorization for Power BI
Configuring Single Sign-On
Configuring via dremio-env
Configuring Memory
Configuring Logs and PID Location
Configuring Dremio for Queries with non-ISO-8859-1 Literals
Setting Up LDAP
Deployment Models
Amazon Deployments
AWS Edition
Deploying Dremio on AWS
Deploying Dremio on AWS
Upgrade to Dremio Enterprise
Configuring AWS Edition
Configuring IAM Roles
Configuring Security Groups
Configuring LDAP
Configuring SSO in AWS Edition
Configuring Executor Nodes
Administering Projects
Create and Open a Project
Open an Existing Project
Close an Open Project
Delete a Project
Managing Engines
Creating Custom Dremio Projects
Amazon EKS
Deploying Dremio on EKS
Customizing EKS Deployment
Administering Dremio on EKS
Azure Deployments
Azure ARM
Deploying Dremio on Azure
Administering Dremio on Azure
Enabling TLS for Dremio UI on Azure
Azure AKS
Deploying Dremio on AKS
Customizing AKS Deployment
Administering Dremio on AKS
Hadoop Using YARN
HPE Ezmeral
MapR using YARN
Standalone Cluster
System Requirements
Installing and Upgrading
RPM Install and Upgrade
Tarball Install and Upgrade
Configuring Standalone Clusters
Deprecated Deployment Models
AWS Cloudformation
Admin Tasks
Logs
Start, Stop, and Status
Admin CLI
Backup
Clean Metadata
Encrypt Credentials
Export Profiles
Perform Nessie Maintenance
Remove Duplicate Roles
Repair ACLs
Restore
Reset Password
Upgrade KV Store
Cleaning Up Job Results
Cleaning Up Spill Directories
Monitoring Nodes
Monitoring System Telemetry
Monitoring Cluster Usage
Caching Metadata
Managing Job Workloads
Job History & Details
Queue Control
Queue Routing
Workload Management
Gandiva-based Execution
Hash Aggregate Spilling
Support Settings
Connecting to Your Data
Metastores
AWS Glue
Hive
Ranger-Based Authorization
Connecting to a Ranger Host using SSL
S3 on Amazon EMR Configuration
Object Storage
Amazon S3
Azure Data Lake Storage Gen1
Azure Storage
Google Cloud Storage
HDFS
MapR-FS
NAS
Databases
Amazon Redshift
Dremio Cluster
Elasticsearch
IBM Db2
Microsoft Azure Data Explorer
Microsoft Azure Synapse Analytics
Microsoft SQL Server
MongoDB
MySQL
Oracle
Postgres
Snowflake
Teradata
Querying External Data Sources
Formatting Data to a Table
Uploading Files
Data Formats
Apache Iceberg
Copying Data Into Tables
Optimizing Tables
Rolling Back Tables
Delta Lake
Parquet Best Practices
Managing Your Data
Datasets
Concepts
Views
Data Curation
Querying Your Data
Creating and Querying Wide Tables
Querying Files and Directories
Runtime Filtering
Viewing Jobs
Overview
SQL
Query Profile
Raw Profile
Uploading Profile Data
Analyzing Profiles
Example: Number of Rows
Example: Amount of Consumed Memory
Example: Operator Type Mapping
Accelerating Queries with Reflections
Types and Benefits
Best Practices
Creating and Editing Reflections
Testing Reflections
Viewing Whether Queries Used Reflections
Refreshing Reflections
Viewing Information about Reflections
Disabling Reflections
Deleting Reflections
Setting Expiration Policy
Managing Security
Authentication
Access Management
Access Management Structure
Apache Ranger: Row-Level Filtering & Column-Masking
Dremio-Native: Row-Access & Column-Masking Policies
Privileges
Roles
Users
Migration
SCIM Integration with Okta
Best Practices
Integrating with AWS Lake Formation
Personal Access Tokens
Users, Groups, and Roles
Sharing and Permissions
Inbound Impersonation
Connecting from Client Applications
Drivers
ODBC
JDBC
Arrow Flight SQL JDBC
Clients
Alteryx Designer
DBeaver
dbt
DbVisualizer
IBM Cognos Analytics
Looker
Microsoft Excel
Microsoft Excel PowerPivot
Microsoft Power BI
Connecting to Dremio from Power BI Desktop
Publishing Reports
Enabling Single Sign-On
Administering Connectivity
Troubleshooting Connectivity
Microstrategy Desktop
Qlik Sense Desktop
Python
SAP Business Objects
Superset and Preset
Tableau
ThoughtSpot
Developing Client Applications with Arrow Flight
Arrow Flight
Arrow Flight SQL
API Reference
Accounts API
View a User
View a Group
Catalog API
Home
Space
Source
Source Types
Source Type Configuration
Source Metadata Policy
Folder
Dataset
File
Access Control
Wikis and Tags
List Catalogs
View a Catalog
View the Graph Information of a Catalog
View a Catalog using its Path
View a Catalog Wikis and Tags
Create a Catalog
Promote a File/Folder to a Physical Dataset
Refresh a Catalog
Create and Update Tags and Wiki for a Catalog
Edit a Catalog
Delete a Catalog
Job
Job Results
Node Collections API
Blacklist Nodes
View Blacklisted Nodes
LDAP User Cache
Privileges/Grant API (16.0+)
GET /grant
GET {grantType}
PUT /grants
Reflection
Reflection Summary (24.0+)
Reflection Summary (23.x and earlier)
Role API (18.0+)
Add/Remove Members
Create Role
Delete Role
Get Role Info
Get Member List
Get Privileges List
Update Role
Source API
Source
Source Types
List Sources
Create a Source
Edit a Source
Delete a Source
SQL
Token
User API
View a User
List Tokens of a User
Create a Token for a User
Delete Tokens of a User
Delete a Specific Token of a User
Create User
Delete User
Get User Privileges
Get User
Update User
Workload Management API
View Queue Information
Create a Queue
Update Attributes of a Queue
Delete a Specific Queue
List Rules
Create and Manage Rules
SQL Reference
Data Types
Mappings for External Sources
Amazon Redshift
Elasticsearch
Hive
IBM Db2
Microsoft SQL Server
MongoDB
MySQL
Oracle
PostgreSQL
Teradata
Time Zone Support
Coercions Support
SQL Functions
All Functions
ABS
ACOS
APPROX_COUNT_DISTINCT
ARRAY_CONTAINS
ASCII
ASIN
ATAN
AVG
BASE64
BINARY_STRING
BIT_AND
BIT_LENGTH
BIT_OR
BOOL_AND
BOOL_OR
BTRIM
CASE
CAST
CBRT
CEILING
CHARACTER_LENGTH
CHAR_LENGTH
CHR
COALESCE
COL_LIKE
CONCAT
CONCAT_WS
CONTAINS
CONVERT_FROM
CONVERT_REPLACEUTF8
CONVERT_TIMEZONE
CONVERT_TO
CORR
COS
COSH
COT
COUNT
COVAR_POP
COVAR_SAMP
CUME_DIST
CURRENT_DATE
CURRENT_DATE_UTC
CURRENT_SCHEMA
CURRENT_TIME
CURRENT_TIMESTAMP
DATE_ADD
DATE_DIFF
DATE_PART
DATE_SUB
DATE_TRUNC
DEGREES
DENSE_RANK
E
ENDS_WITH
EXP
EXTRACT
FIRST_VALUE
FLATTEN
FLOOR
FROM_HEX
GEO_BEYOND
GEO_DISTANCE
GEO_NEARBY
GREATEST
HASH
HEX
HLL
ILIKE
IMAXDIR
IMINDIR
INITCAP
INSTR
IS [NOT] DISTINCT FROM
ISFALSE
IS [NOT] NULL
ISNUMERIC
ISTRUE
IS_BIGINT
IS_DATE
IS_INT
IS_MEMBER
IS_UTF8
IS_VARCHAR
LAG
LAST_QUERY_ID
LCASE
LEAD
LEAST
LEFT
LENGTH
LEVENSHTEIN
LIKE
LISTAGG
LOCALTIME
LOCALTIMESTAMP
LOCATE
LOG
LOG10
LOWER
LPAD
LSHIFT
LTRIM
MAP_KEYS
MAP_VALUES
MASK
MASK_FIRST_N
MASK_HASH
MASK_LAST_N
MASK_SHOW_FIRST_N
MASK_SHOW_LAST_N
MAX
MAXDIR
MEDIAN
MIN
MINDIR
MOD
NDV
NOW
NTILE
NULLIF
OCTET_LENGTH
PERCENTILE_CONT
PERCENTILE_DISC
PERCENT_RANK
PI
POSITION
POWER
QUERY_USER
QUOTE
RADIANS
RANDOM
RANK
REGEXP_EXTRACT
REGEXP_LIKE
REGEXP_MATCHES
REGEXP_REPLACE
REGEXP_SPLIT
REPEAT
REPEATSTR
REPLACE
REVERSE
RIGHT
ROUND
ROW_NUMBER
RPAD
RSHIFT
RTRIM
SESSION_USER
SIGN
SIMILAR_TO
SIN
SINH
SIZE
SOUNDEX
SPLIT_PART
SQRT
STARTS_WITH
STDDEV
STDDEV_POP
STDDEV_SAMP
STRPOS
SUBSTRING
SUBSTRING_INDEX
SUM
TAN
TANH
TIMESTAMPADD
TIMESTAMPDIFF
TOASCII
TO_CHAR
TO_DATE
TO_HEX
TO_NUMBER
TO_TIME
TO_TIMESTAMP
TRANSACTION_TIMESTAMP
TRANSLATE
TRIM
TRUNCATE
TYPEOF
UCASE
UNBASE64
UNHEX
UNIX_TIMESTAMP
UPPER
USER
VAR_POP
VAR_SAMP
XOR
Aggregate
APPROX_COUNT_DISTINCT
AVG
BIT_AND
BIT_OR
CORR
COUNT
COVAR_POP
COVAR_SAMP
HLL
LISTAGG
MAX
MIN
NDV
STDDEV
STDDEV_POP
STDDEV_SAMP
SUM
VAR_POP
VAR_SAMP
Binary
BASE64
BIT_LENGTH
FROM_HEX
HEX
TO_HEX
UNBASE64
UNHEX
Bitwise
BIT_AND
BIT_OR
LSHIFT
RSHIFT
XOR
Boolean
IS [NOT] DISTINCT FROM
ISFALSE
IS [NOT] NULL
ISNUMERIC
ISTRUE
IS_MEMBER
Conditional
BOOL_AND
BOOL_OR
CASE
COALESCE
GREATEST
LEAST
NULLIF
Conversion
BINARY_STRING
CAST
CONVERT_FROM
CONVERT_REPLACEUTF8
CONVERT_TIMEZONE
CONVERT_TO
FLATTEN
FROM_HEX
HASH
HEX
TOASCII
TO_CHAR
TO_DATE
TO_HEX
TO_NUMBER
TO_TIME
TO_TIMESTAMP
UNHEX
Data Generation
RANDOM
Datatype
IS_BIGINT
IS_DATE
IS_INT
IS_VARCHAR
SIZE
TYPEOF
Date/Time
CONVERT_TIMEZONE
CURRENT_DATE
CURRENT_DATE_UTC
CURRENT_TIME
CURRENT_TIMESTAMP
DATE_ADD
DATE_DIFF
DATE_PART
DATE_SUB
DATE_TRUNC
EXTRACT
TIMESTAMPADD
TIMESTAMPDIFF
TO_DATE
TO_TIME
TO_TIMESTAMP
UNIX_TIMESTAMP
Directory
IMAXDIR
IMINDIR
MAXDIR
MINDIR
Geospatial
GEO_BEYOND
GEO_DISTANCE
GEO_NEARBY
Math
ABS
ACOS
ASIN
ATAN
CBRT
CEILING
COS
COSH
COT
DEGREES
E
EXP
FLOOR
LOG
LOG10
MOD
PI
POWER
RADIANS
ROUND
SIGN
SIN
SINH
SQRT
STDDEV
STDDEV_POP
STDDEV_SAMP
TAN
TANH
TRUNCATE
Percentile
MEDIAN
PERCENTILE_CONT
PERCENTILE_DISC
Semistructured Data
ARRAY_CONTAINS
MAP_KEYS
MAP_VALUES
String
ASCII
BASE64
BTRIM
CHARACTER_LENGTH
CHAR_LENGTH
CHR
COL_LIKE
CONCAT
CONCAT_WS
CONTAINS
ENDS_WITH
FROM_HEX
HEX
ILIKE
INITCAP
INSTR
IS_UTF8
LCASE
LEFT
LENGTH
LEVENSHTEIN
LIKE
LOCATE
LOWER
LPAD
LTRIM
MASK
MASK_FIRST_N
MASK_HASH
MASK_LAST_N
MASK_SHOW_FIRST_N
MASK_SHOW_LAST_N
OCTET_LENGTH
POSITION
QUOTE
REGEXP_EXTRACT
REGEXP_LIKE
REGEXP_MATCHES
REGEXP_REPLACE
REGEXP_SPLIT
REPEAT
REPEATSTR
REPLACE
REVERSE
RIGHT
RPAD
RTRIM
SIMILAR_TO
SOUNDEX
SPLIT_PART
STARTS_WITH
STRPOS
SUBSTRING
SUBSTRING_INDEX
TOASCII
TO_HEX
TRANSLATE
TRIM
UCASE
UNBASE64
UNHEX
UPPER
System
CURRENT_DATE
CURRENT_DATE_UTC
CURRENT_SCHEMA
CURRENT_TIME
CURRENT_TIMESTAMP
LAST_QUERY_ID
LOCALTIME
LOCALTIMESTAMP
NOW
QUERY_USER
SESSION_USER
TRANSACTION_TIMESTAMP
UNIX_TIMESTAMP
USER
Window
COUNT
COVAR_POP
COVAR_SAMP
CUME_DIST
DENSE_RANK
FIRST_VALUE
HLL
LAG
LEAD
MAX
MIN
NDV
NTILE
PERCENT_RANK
RANK
ROW_NUMBER
SUM
VAR_POP
VAR_SAMP
All Functions
ABS
ACOS
APPROX_COUNT_DISTINCT
ARRAY_CONTAINS
ASCII
ASIN
ATAN
AVG
BASE64
BINARY_STRING
BIT_AND
BIT_LENGTH
BIT_OR
BOOL_AND
BOOL_OR
BTRIM
CASE
CAST
CBRT
CEILING
CHARACTER_LENGTH
CHAR_LENGTH
CHR
COALESCE
COL_LIKE
CONCAT
CONCAT_WS
CONTAINS
CONVERT_FROM
CONVERT_REPLACEUTF8
CONVERT_TIMEZONE
CONVERT_TO
CORR
COS
COSH
COT
COUNT
COVAR_POP
COVAR_SAMP
CUME_DIST
CURRENT_DATE
CURRENT_DATE_UTC
CURRENT_SCHEMA
CURRENT_TIME
CURRENT_TIMESTAMP
DATE_ADD
DATE_DIFF
DATE_PART
DATE_SUB
DATE_TRUNC
DEGREES
DENSE_RANK
E
ENDS_WITH
EXP
EXTRACT
FIRST_VALUE
FLATTEN
FLOOR
FROM_HEX
GEO_BEYOND
GEO_DISTANCE
GEO_NEARBY
GREATEST
HASH
HEX
HLL
ILIKE
IMAXDIR
IMINDIR
INITCAP
INSTR
IS [NOT] DISTINCT FROM
ISFALSE
IS [NOT] NULL
ISNUMERIC
ISTRUE
IS_BIGINT
IS_DATE
IS_INT
IS_MEMBER
IS_UTF8
IS_VARCHAR
LAG
LAST_QUERY_ID
LCASE
LEAD
LEAST
LEFT
LENGTH
LEVENSHTEIN
LIKE
LISTAGG
LOCALTIME
LOCALTIMESTAMP
LOCATE
LOG
LOG10
LOWER
LPAD
LSHIFT
LTRIM
MAP_KEYS
MAP_VALUES
MASK
MASK_FIRST_N
MASK_HASH
MASK_LAST_N
MASK_SHOW_FIRST_N
MASK_SHOW_LAST_N
MAX
MAXDIR
MEDIAN
MIN
MINDIR
MOD
NDV
NOW
NTILE
NULLIF
OCTET_LENGTH
PERCENTILE_CONT
PERCENTILE_DISC
PERCENT_RANK
PI
POSITION
POWER
QUERY_USER
QUOTE
RADIANS
RANDOM
RANK
REGEXP_EXTRACT
REGEXP_LIKE
REGEXP_MATCHES
REGEXP_REPLACE
REGEXP_SPLIT
REPEAT
REPEATSTR
REPLACE
REVERSE
RIGHT
ROUND
ROW_NUMBER
RPAD
RSHIFT
RTRIM
SESSION_USER
SIGN
SIMILAR_TO
SIN
SINH
SIZE
SOUNDEX
SPLIT_PART
SQRT
STARTS_WITH
STDDEV
STDDEV_POP
STDDEV_SAMP
STRPOS
SUBSTRING
SUBSTRING_INDEX
SUM
TAN
TANH
TIMESTAMPADD
TIMESTAMPDIFF
TOASCII
TO_CHAR
TO_DATE
TO_HEX
TO_NUMBER
TO_TIME
TO_TIMESTAMP
TRANSACTION_TIMESTAMP
TRANSLATE
TRIM
TRUNCATE
TYPEOF
UCASE
UNBASE64
UNHEX
UNIX_TIMESTAMP
UPPER
USER
VAR_POP
VAR_SAMP
XOR
Aggregate
APPROX_COUNT_DISTINCT
AVG
BIT_AND
BIT_OR
CORR
COUNT
COVAR_POP
COVAR_SAMP
HLL
LISTAGG
MAX
MIN
NDV
STDDEV
STDDEV_POP
STDDEV_SAMP
SUM
VAR_POP
VAR_SAMP
Binary
BASE64
BIT_LENGTH
FROM_HEX
HEX
TO_HEX
UNBASE64
UNHEX
Bitwise
BIT_AND
BIT_OR
LSHIFT
RSHIFT
XOR
Boolean
IS [NOT] DISTINCT FROM
ISFALSE
IS [NOT] NULL
ISNUMERIC
ISTRUE
IS_MEMBER
Conditional
BOOL_AND
BOOL_OR
CASE
COALESCE
GREATEST
LEAST
NULLIF
Conversion
BINARY_STRING
CAST
CONVERT_FROM
CONVERT_REPLACEUTF8
CONVERT_TIMEZONE
CONVERT_TO
FLATTEN
FROM_HEX
HASH
HEX
TOASCII
TO_CHAR
TO_DATE
TO_HEX
TO_NUMBER
TO_TIME
TO_TIMESTAMP
UNHEX
Data Generation
RANDOM
Datatype
IS_BIGINT
IS_DATE
IS_INT
IS_VARCHAR
SIZE
TYPEOF
Date/Time
CONVERT_TIMEZONE
CURRENT_DATE
CURRENT_DATE_UTC
CURRENT_TIME
CURRENT_TIMESTAMP
DATE_ADD
DATE_DIFF
DATE_PART
DATE_SUB
DATE_TRUNC
EXTRACT
TIMESTAMPADD
TIMESTAMPDIFF
TO_DATE
TO_TIME
TO_TIMESTAMP
UNIX_TIMESTAMP
Directory
IMAXDIR
IMINDIR
MAXDIR
MINDIR
Geospatial
GEO_BEYOND
GEO_DISTANCE
GEO_NEARBY
Math
ABS
ACOS
ASIN
ATAN
CBRT
CEILING
COS
COSH
COT
DEGREES
E
EXP
FLOOR
LOG
LOG10
MOD
PI
POWER
RADIANS
ROUND
SIGN
SIN
SINH
SQRT
STDDEV
STDDEV_POP
STDDEV_SAMP
TAN
TANH
TRUNCATE
Percentile
MEDIAN
PERCENTILE_CONT
PERCENTILE_DISC
Semistructured Data
ARRAY_CONTAINS
MAP_KEYS
MAP_VALUES
String
ASCII
BASE64
BTRIM
CHARACTER_LENGTH
CHAR_LENGTH
CHR
COL_LIKE
CONCAT
CONCAT_WS
CONTAINS
ENDS_WITH
FROM_HEX
HEX
ILIKE
INITCAP
INSTR
IS_UTF8
LCASE
LEFT
LENGTH
LEVENSHTEIN
LIKE
LOCATE
LOWER
LPAD
LTRIM
MASK
MASK_FIRST_N
MASK_HASH
MASK_LAST_N
MASK_SHOW_FIRST_N
MASK_SHOW_LAST_N
OCTET_LENGTH
POSITION
QUOTE
REGEXP_EXTRACT
REGEXP_LIKE
REGEXP_MATCHES
REGEXP_REPLACE
REGEXP_SPLIT
REPEAT
REPEATSTR
REPLACE
REVERSE
RIGHT
RPAD
RTRIM
SIMILAR_TO
SOUNDEX
SPLIT_PART
STARTS_WITH
STRPOS
SUBSTRING
SUBSTRING_INDEX
TOASCII
TO_HEX
TRANSLATE
TRIM
UCASE
UNBASE64
UNHEX
UPPER
System
CURRENT_DATE
CURRENT_DATE_UTC
CURRENT_SCHEMA
CURRENT_TIME
CURRENT_TIMESTAMP
LAST_QUERY_ID
LOCALTIME
LOCALTIMESTAMP
NOW
QUERY_USER
SESSION_USER
TRANSACTION_TIMESTAMP
UNIX_TIMESTAMP
USER
Window
COUNT
COVAR_POP
COVAR_SAMP
CUME_DIST
DENSE_RANK
FIRST_VALUE
HLL
LAG
LEAD
MAX
MIN
NDV
NTILE
PERCENT_RANK
RANK
ROW_NUMBER
SUM
VAR_POP
VAR_SAMP
SQL Commands
Apache Iceberg Tables
ALTER
CREATE
COPY INTO <table>
DELETE
DROP
INSERT
MERGE
OPTIMIZE
ROLLBACK
SELECT
TRUNCATE
UPDATE
Analyze Table
Datasets
Privileges
Queue Routing
Reflections
Roles
Row-Access & Column-Masking
SELECT
Sources
Tables
USE
User-Defined Functions
Users
WITH
Reserved Words
System Tables
Jobs
Membership
Privileges
Reflection Dependencies
Reflections
Roles
Tables
Timezone Names
User Defined Functions
Users
Version
Views
Information Schema
Catalogs
Columns
Schemata
Tables
Views
Knowledge Base
Apache Log4j Vulnerability
G1 Garbage Collection Setup
Kerberos Setup and Troubleshooting
Kubernetes Troubleshooting
Log Monitoring for AKS
Release Notes
24.0.0 Release Notes
23.0.0+ Release Notes
22.0.0+ Release Notes
21.0.0+ Release Notes
20.0.0+ Release Notes
19.0.0+ Release Notes
18.0.0+ Release Notes
17.0.0+ Release Notes
16.0.0+ Release Notes
15.0.0+ Release Notes
14.0.0 Release Notes
13.0.0 Release Notes
12.0.0 Release Notes
11.0.0 Release Notes
Dependencies & Licenses
Dremio JDBC Driver Release Notes
17.0.0 (Dremio June 2021) Release Notes
15.0.0 (Dremio February 2021) Release Notes
14.0.0 (Dremio February 2021) Release Notes
11.0.0 (Dremio November 2020) Release Notes
ODBC Driver for Arrow Flight SQL Release Notes
ODBC Driver for Arrow Flight SQL 0.9.1
ODBC Driver for Arrow Flight SQL 0.9.0
JDBC Driver for Arrow Flight SQL Release Notes
JDBC Driver for Arrow Flight SQL 10.0.0
ODBC Driver for Arrow Flight SQL 0.9.0
Glossary
On this page
Welcome to Dremio Cloud Documentation - Dremio
>
>
>
Configuring AWS Edition
Configuring AWS Edition
Configure IAM Roles
Configure Security Group
Configuring LDAP
Customizing Executors
Was this page helpful?
Yes
No
Glad to hear it! Thank you for your feedback.
Sorry to hear that. Thank you for your feedback.