Configure Model Providers

You configure model providers for your organization for AI features when deploying Dremio. After you configure at least one model provider, you must set a default model provider and optionally set an allowlist of available models. Dremio uses this default provider for all Dremio's AI Agent interactions, whereas the allowlist models can be used by anyone writing AI functions. By default CALL MODEL is granted to all users for all new model providers so if the default changes users can continue to use the AI Agent without interruption.

Dremio-Provided LLM

Dremio provides all organizations with an out-of-the-box model provider so that all users can begin engaging with the AI Agent and AI functions without any other configuration required. For US deployments, the LLM calls are routed to a US endpoint; for EU deployments, the LLM calls are routed to an EU endpoint. Once you have added your own model provider and set it as the new default, the Dremio-Provided LLM will no longer be used. If you delete all other model providers, then the Dremio-Provided LLM will revert to the organization's default model provider. This model provider cannot be deleted.

Supported Model Providers

Dremio supports configuration of the following model providers. Dremio recommends using a medium or high tier enterprise-grade reasoning model for the best performance and experience.

Service	Connection Method(s)
OpenAI	Organization ID + API Key + Region (US, EU, or Global). Region selection adheres to OpenAI Regional Data Controls.
Anthropic	API Key
Google Gemini	API Key
Amazon Bedrock	Choose one of the following: Region + Access Key ID + Secret Access Key Region + IAM Role ARN
Azure OpenAI	Resource Name + Directory ID + Application ID + Client Secret Value

note

Dremio does not validate the model associated with an AWS Bedrock model ID or Azure OpenAI deployment name upon model provider creation. Using an unsupported model can lead to runtime errors or a higher rate of inaccurate responses.

Default Model Provider

To delete the model provider, you must assign a new default unless you are deleting the last available model provider that you have configured. To update the default model provider to a new one, you must have MODIFY privilege on both the current default and the new proposed default model provider.

Add Model Provider

For steps on adding an AWS Bedrock model provider, see Configure AWS Bedrock as a Model Provider.

For all other model providers, follow these steps to add a model provider in the Dremio console:

1. Click in the side navigation bar and select Organization.
2. Select AI Configurations from the organization settings sidebar.
3. Click Add model provider.