Dremio Community

Uploading Files

This topic describes how to upload files.

Working with local files

You can upload local files into your Dremio cluster and use this data as a source with the same features as your other data sources. For example, you can upload an Excel spreadsheet, JSON, Parquet, or CSV file from your desktop. Once your file is uploaded, you can transform the data, join it with our data sources, and query it with SQL or any BI tool.

How to Upload Files

  1. Navigate to your Home location by clicking on the home icon & your username.
  2. Click on the cloud button in the upper right side.

    Note that the folder button allows you to add folders to your personal space to help you organize your files. The purple file button allows you to upload a new file.
  3. From the dialog box, drag a file here or navigate your local filesystem to find a file. Click Next once the file has been selected.

    Dremio supports delimited files, Excel, JSON, Parquet, and other file formats. If your file is large it may take a few moments to upload, depending on your connection speed.
  4. (Optional) During the upload process, configure the file settings such as how the file is delimited. Click Save.
    Depending on the file format, different options are available in this step. For delimited files, select the Extract Header option if the name of each column is in the first row of your file.

Viewing Uploaded Files

Once uploaded, the file is displayed in your Personal Space. This file is now a data source in Dremio that you can use like any other data source, including the ability to query through SQL or with your favorite BI tool.

To view the file contents, click on the file.

Note
This is a copy of your local file. Updates to your local file are not reflected in Dremio.

Bulk Uploads

You cannot perform bulk uploads into Dremio. Instead, groups of files with the same structure in a common directory can be queried together like they are a single table. To learn more, see the chapter on Directories.

If you are running Dremio locally, you can create a NAS data source and connect to your local files. To learn more, see the chapter on NAS.

Sharing with Other Users

By default, data in your personal space is private to the user. However, you can share with other users of Dremio by saving it as a virtual dataset in a public space.