System Requirements

Server or Instance

Dremio is designed to run on clusters of 1-1000 servers (on premise) or instances (cloud). You can get started by running Dremio on a standard laptop, but when you're ready to evaluate the performance or scalability of the system, or deploy it in production, it's important to utilize adequate hardware.

Linux Distributions

Dremio supports the following distributions and versions of Linux:

• RHEL and CentOS 6.7+ and 7.3+
• SLES 12 SP2+
• Ubuntu 14.04+
• Debian 7+

Network

For maximum performance, it is recommended to use a 10 GbE network between coordinators and executors, executors and executors, and executors and data sources

The following ports must be open:

Server System

Dremio can be deployed on Linux, Mac and Windows. For production deployments, Linux is the recommended operating system.

An RPM package is available for RHEL 6+ and CentOS 6+. A tarball is available for other operating systems.

To install Dremio, the following access privileges are required:

• ssh and scp access
• root or sudo privileges

Java Development Kit

Dremio requires Java SE 8 (also known as JDK 1.8). Dremio utilizes the Java compiler (javac) for runtime code generation. You can check to see if your operating system has Java installed (and which version) with this command:

$ java -version

You can download the latest version of Java SE from the Oracle website.

Best Practices

• For Unix/Linux operating systems, increase your open file limit for users (this impacts the Dremio processes) to 65536.

• If you have a machine with a large amount of RAM (for example, 64GB), increase the Dremio RAM configuration setting from the default (16GB). To increase Dremio RAM:

  1. Modify the DREMIO_MAX_DIRECT_MEMORY_SIZE_MB property in the dremio-env file.

  2. Restart the executor node(s).

     [info] To verify the memory assigned to the nodes (heap and direct), run the following query:
     SELECT * FROM sys.memory