RPM Install and Upgrade
This topic describes how to install and upgrade Dremio using an RPM package.
Prerequisites
Download and install the required Java version.
Installing Dremio
Perform these steps on each node of your Dremio cluster:
-
Download and install Dremio via RPM.
Download and install Dremiosudo yum install dremio-<VERSION>.rpm
-
(Optional) Enable
Enable dremio start at boot (optional)dremio
to start at boot.sudo chkconfig --level 3456 dremio on
-
Configure Dremio. See Dremio Configuration for more information.
Default Configuration
The following configurations are created by default when you install Dremio using the RPM package.
Software/File | Location |
---|---|
Software location | /opt/dremio |
dremio.conf configuration file | /etc/dremio/dremio.conf |
dremio-env environment configuration file | /etc/dremio/dremio-env |
Local path (for data location) | /var/lib/dremio |
Log directory | /var/log/dremio |
PID files directory | /var/run/dremio |
Changing the Dremio User and Group
The generic installation steps assume a user called dremio
.
To run the Dremio daemon service under a different username (for example, testuser
),
apply the following changes before configuring.
-
Update the
DREMIO_USER
in the /etc/sysconfig/dremio file totestuser
. -
Apply the following permissions:
Permissions to applysudo chown -R testuser:testuser /var/log/dremio
sudo chown -R testuser:testuser /var/lib/dremio
sudo chown -R testuser:testuser /var/run/dremio
Upgrading Dremio
This topic provides upgrade instructions for RPM-based installations. These instructions assume you are using the default RPM installation paths for configuration, data and logging.
Before you begin, do the following:
- While Dremio is still running, create a backup of your Dremio cluster.
- If HDFS/MapR-FS is configured, perform a snapshot of your distributed store directories.
To upgrade your Dremio installation:
-
Ensure that your existing Dremio cluster is backed up. See Create a backup for more information.
-
Shut down all Dremio provisioned nodes. For example:
service dremio stop
- See the Shutting Down with YARN Deployments section.
- See the Shutting Down with non-YARN Deployments section.
- See the Shutdown Commands section.
-
On each Dremio node in your cluster, copy your old Dremio installation to another location on the node. For example:
Copy and move Dremio installationcp -rL /var/lib/dremio /var/lib/dremio_bak
cp -rL /opt/dremio /opt/dremio_bak -
Download and install the new Dremio version. For example:
Download and install Dremiosudo yum install dremio-<version>.rpm
- For YARN deployments, install on each coordinator node in your Dremio cluster.
- For non-YARN deployments, install on all nodes in your Dremio cluster.
-
Copy the
Copy and move the /conf directory and files/conf
directory and associated configuration files from your backup-copy location (from Step# 3) to the new installation location. As a result, the default files from the fresh install are overwritten. For example:cp /opt/dremio_bak/conf/* /opt/dremio/conf
- For YARN deployments, perform this step on each coordinator node in your Dremio cluster.
- For non-YARN deployments, perform this step on all nodes in your Dremio cluster.
-
On the coordinator node, copy the metastore files from your backup-copy location (from Step #3) to the new installation location. For example:
cp -r /var/lib/dremio_bak/* /var/lib/dremio
- On the coordinator node, execute the upgrade script as the user running the Dremio Daemon service. For example, as "dremio":
dremio-<version>/bin/dremio-admin upgrade
-
Start up all Dremio provisioned nodes in the Dremio cluster. For example:
service dremio start
.- See the Starting Up with YARN Deployments section.
- See the Starting Up with non-YARN Deployments section.
- See the Startup Commands section.
-
Backup your new Dremio cluster. See Create a backup for more information.