Skip to main content
Version: current [26.x Preview]

Amazon EKS

Learn the deployment architecture, requirements, recommendations, and necessary steps for installing Dremio in a Kubernetes cluster on Amazon Elastic Kubernetes Service (EKS).

Requirements​

  • AWS EKS version 1.12.7 or later (see Setting up an EKS Cluster for instructions)

  • Worker node instance type (minimum): r5d.4xlarge (16 core, 128 GiB memory, 2 x 300 NVMe)

Setting Up an EKS Cluster​

To set up a Kubernetes cluster on EKS, follow what's in the Amazon EKS User Guide:

  1. Create an EKS cluster following the instructions in Step 1: Create your Amazon EKS cluster.

    • Make sure to create a node group with an instance type that has 16CPU and 128GB of memory (r5d.4xlarge is recommended).

    • The number of allocated nodes in the EKS cluster must be equivalent to the number of Dremio executors plus one (1) for the Dremio master-coordinator.

  2. Connect to the cluster following the instructions in Connect kubectl to an EKS cluster by creating a kubeconfig file.

  3. Install Helm following the instructions in Deploy applications with Helm on Amazon EKS.

Deploying Dremio on the EKS Cluster​

To deploy Dremio on the EKS Cluster, follow the steps in Deploy Dremio on Kubernetes.

High Availability​

High availability is dependent on the Kubernetes infrastructure. For more information, see High Availability in Cluster Deployments.

Load Balancing​

Load balancing distributes the workload from Dremio's web client (UI and REST) and ODBC/JDBC clients. All web and ODBC/JDBC clients connect to a single endpoint (load balancer) rather than directly to an individual pod. These connections are then distributed across available coordinator (master-coordinator and secondary-coordinator) pods.

For More Information​