Dremio metadata and user uploaded files can be backed up and restored. Doing a restore will not restore the contents of the distributed cache such as acceleration cache, downloaded files and query results.
Please refer to Creating a Backup for getting started with backups.
Restore utility is available on Mac and Linux.
To obtain a list of restore options on the command line:
./dremio-admin restore -h
* -d, --backupdir backup directory path. for example, /mnt/dremio/backups or hdfs://$namenode:8020/dremio/backups -h, --help show usage -r, --restore restore dremio metadata Default: false -v, --verify verify backup contents Default: false
Restoring from a Backup
Make sure all cluster nodes are down. Then on the master node complete the following steps:
Make a copy of dremio.conf you are using (i.e. under
/etc/dremio/depending on your setup) to under
<DREMIO_HOME>/conf/. (Skip this step if using this location already.)
Create a copy of
/data/dremio/depending on your setup).
Delete contents of
<DREMIO_LOCAL_DATA_PATH>and then create an empty directory called
dbreadable and writable by the user running restore tool and Dremio daemon under
Run the following command located under
<DREMIO_HOME>/bin/to verify backup:
$ ./dremio-admin restore -d <BACKUP_FOLDER_PATH> -v
-voption verifies backup contents
If above step is successful, run the following command located under
$ ./dremio-admin restore -d <BACKUP_FOLDER_PATH> -r
-roption initiates a restore
Look for the confirmation message. Here is a sample:
... Restored from backup at /tmp/dremio_backup_2017-02-23_18.25, dremio tables 14, uploaded files 1
A backup can only be restored using the same version of Dremio that the backup was created on.