Dremio Sonar preview
To use Dremio Sonar with Arctic, you need to connect an Arctic catalog source in the Sonar project.
Before you can connect to an Arctic catalog source, ensure you have the following resources available:
- An Arctic catalog. If you do not have an Arctic catalog, you can do one of the following:
- Create one within the Sonar service when Adding an Arctic Catalog to a Sonar Project from Sonar.
- Create one within the Arctic service by Adding an Arctic Catalog.
- A Sonar project, which will connect to the Arctic catalog. If you want to create a new Sonar project, see Adding a Project.
Connecting an Arctic Source to Sonar
To use Dremio Sonar with Arctic, you need to connect an Arctic catalog as a source to a Sonar project. You can add an Arctic catalog from either the Sonar or Arctic services.
Adding an Arctic Catalog to a Sonar Project from Sonar
To add a catalog from within the Sonar service:
Select a Sonar project in which you want to connect to an Arctic catalog source.
From the Datasets pane, click the Add Source (plus) icon.
From the Add Data Source dialog box, select Arctic (Preview).
On the New Arctic (Preview) Source dialog box > General tab:
a. Select the Arctic catalog from the drop-down list of existing catalogs.
b. Under the Authentication section, you can choose Project Data Credentials or enter your own Data Source Credentials.
c. Under Default Storage Location, enter the root path to your S3 bucket.
When creating new tables in Arctic, this is the default location where tables will be created when you do not specify a
LOCATIONattribute in a
CREATE TABLEstatement. Example root path:
d. Click Save.
Adding an Arctic Catalog to a Sonar Project from Arctic
To add a catalog from within the Arctic service:
From the Arctic Catalogs home page, select an Arctic catalog.
From the selected catalog page, click the Settings (gear) icon.
Under General Information > Connect from SQL Engines > Add as a Source to a Sonar Project, click Add to Sonar.
From the Add to a Sonar Project dialog box, click the drop-down list and select a project.
After you have connected Sonar to Arctic, you can try out the Getting Started with Dremio Sonar and Arctic tutorial to learn the basics of Arctic.
Limitations When Using Sonar With Arctic
Limitations that exist when using Sonar with Arctic relate to Arctic views:
- Dremio Sonar reflections are not supported.
- The Sonar graph dataset component is not supported.
- Wikis and searchable tags are not supported.
- Views are not yet interoperable with other engines.
- When a view is created, the original version context is not saved/persisted in the view definition (that is, the view definition does not contain a field for the version information). As a result, the context where the view is executed may yield different results compared to when it was created.
- Folders that are created either directly or implicitly as part of a table path cannot be deleted.