AWS Edition
This topic provides information on deploying Dremio on AWS.
AWS Edition Overview
Dremio AWS Edition (AWSE) is a separate Dremio edition that is provisioned via the AWS Marketplace. It comes in both Community (free) and Enterprise editions.
Dremio AWS Edition is made up of the following components, all of which exist within your existing AWS account:
-
Projects - Projects are persistent objects that contain all customer-specific definitions and metadata, to include user definitions, VDS and PDS definitions, reflection definitions, logs, and admin settings. An account can have one or more Projects, all of which can be considered as separate “instances” of Dremio. No data or resources are shared between Projects. Projects can be opened or closed depending on need, and by default are automatically backed up once a day. AWS services used: EBS, EFS, S3.
-
Coordinator - The coordinator node contains the core Dremio application and is the “brains” of the cluster. It issues commands to one or more engines. It is responsible for serving Dremio’s UI, query planning, handling client connections, and managing metadata. The coordinator node is ephemeral, and can be shut down if it is not in use (to save money, for example), and can be restarted as needed. A coordinator node needs to be running in order to open and use a Project. AWS services used: EC2
-
Engines - Engines are the workers of the cluster and they execute and process query jobs issued from the coordinator node. Engines are “elastic” in the sense that they are made up of one or more nodes (EC2 instances) and can be automatically started and stopped. Engines can be managed to process specific workloads. AWS services used: EC2
-
Data Sources - Data sources are where physical data resides. Data sources can either be Data Lakes (like S3), or External Sources like NoSQL databases, relational databases, and local filesystems. In Dremio, the physical data remains in the Data Sources.
Supported Regions
Dremio supports AWSE in the following AWS regions:
- Africa (Cape Town)
- Asia Pacific (Hong Kong)
- Asia Pacific (Tokyo)
- Asia Pacific (Seoul)
- Asia Pacific (Osaka)
- Asia Pacific (Mumbai)
- Asia Pacific (Singapore)
- Asia Pacific (Sydney)
- Canada (Central)
- Europe (Frankfurt)
- Europe (Zurich)
- Europe (Stockholm)
- Europe (Milan)
- Europe (Ireland)
- Europe (London)
- Europe (Paris)
- Middle East (UAE)
- Middle East (Bahrain)
- South America (Sao Paulo)
- US East (N. Virginia)
- US East (Ohio)
- US West (N. California)
- US West (Oregon)
Deploying Dremio AWSE
AWSE provides the ability to quickly and easily deploy Dremio through the AWS Marketplace. Use the Getting Started with Dremio on AWS guide to deploy a Dremio instance through the AWS Marketplace.
AWS Edition does not support the following data sources: