Skip to main content

Discover Data

Dremio provides multiple ways to discover and explore your data. Whether you prefer browsing catalogs, using semantic search, or leveraging the AI Agent, you can find the data you need quickly and efficiently.

Data discovery capabilities in Dremio include the following:

  • Dremio's AI Agent for natural language data discovery and exploration
  • AI-enabled semantic search for objects and entities
  • Catalog exploration in the Dremio console
  • Metadata cards for dataset details

Discover using Dremio's AI Agent​

Dremio's AI Agent makes it easy to find relevant data using natural language and your business terms. To learn more about using the AI Agent, see Explore Using AI Agent.

Search for Dremio Objects and Entities​

You can quickly and easily find objects and entities with the AI-enabled search experience. Semantic search returns results of sources, folders, tables in Dremio's Open Catalog and external sources registered in Dremio, views in external sources registered in Dremio catalogs, user-defined functions (UDFs), Reflections, scripts, and jobs.

Semantic search takes object names and metadata such as wikis and labels into account to return results that are relevant to your search criteria.

To search for objects and entities:

  1. Click the search bar on the top right of the page and type in your search criteria. You can activate the search bar by using the shortcut keys Command + K (Mac) or Ctrl + K (Windows/Linux).
  2. Press the return or enter key to execute the search. Under Recents, you will see your recent searches.
  3. Select a search result to view details. For a table or view, you can click the icon to query the table or view in the SQL Runner.

Limitations and Considerations​

  • Semantic search has been optimized for English terms.
  • After creating new objects, they can take a few hours to appear in search results.
  • After deleting objects or entities, they can take a few hours to disappear from search results.
  • Data discovery capabilities are optimized for data that is governed by Dremio. Files and folders in object storage that have not been formatted as a table in Dremio may not be easily discoverable.

The Datasets page allows you to navigate through and explore objects that you have access to in Dremio. To learn more about the Datasets page, see Quick Tour of the Dremio Console. Once you have located the table or view that you are interested in, click it to open the Details panel and view comprehensive information about the dataset.

View Metadata of a Dataset​

Wherever a dataset is referenced in Dremio, you can view a metadata card with details about the dataset.

To view the metadata, hover over a dataset to see a metadata card appear with details about the dataset. Key information displayed on dataset cards includes:

  • Dataset type and name: Icon and title showing the dataset format and name
  • Quick actions: Query, edit, or view the dataset
  • Path and labels: Location and any applied labels
  • Usage metrics: Jobs run and views created from the dataset
  • Ownership and dates: Creator, creation date, and last modified
  • Wikis and Labels – Learn more about using wikis and labels to enrich your data.
  • Data Privacy – Learn more about Dremio's data privacy practices.