LLM Providers

The LLM Providers module defines the set of models and providers that AI Gateway can invoke when a route is triggered. Each provider is a reusable configuration that groups one or more provider + model + API Key combinations with different priorities. This helps you define failover strategies or balance requests across models.

NOTE

Before creating an LLM Provider, register the API Keys for the providers you want to use. The form only lets you save when at least one key exists for each selected combination.

Quick links

Learn how to:

• Filter and list LLM Providers
• Create an LLM Provider
• Edit an LLM Provider
• Delete an LLM Provider
• Review the form fields
• Understand conditional fields by provider

Listing

The LLM Providers page lists registered configurations with pagination. You can filter by:

• Provider (optional): associated LLM provider. Values: All providers, OpenAI, Gemini, Anthropic, Azure OpenAI, Bedrock.
• Model (optional): text search by model name.

Use Search to apply the filter and Clear to reset it.

Columns shown in the table:

• LLM Provider ID: internal configuration identifier.
• Providers and Models: summary of registered Provider / Model / Priority combinations, separated by |.
• Created At: creation date and time.
• Updated At: date and time of the last update, when applicable.
• Actions: Edit and Delete icons for each row.

Create LLM Provider

Edit LLM Provider

In the Actions column of the row you want, click the Edit icon. The Update LLM Provider form opens with all configurations prefilled. Change the required fields, add or remove provider rows, and click Save.

Delete LLM Provider

In the Actions column of the row you want, click the Delete icon. Confirm the operation in the "Are you sure you want to delete this LLM provider?" dialog.

IMPORTANT

Deletion is permanent and cannot be undone. Routes that reference the deleted LLM Provider start failing. Update or remove dependent routes before deleting it.

Form fields

The form is made up of a list of provider configurations. At least one is required. Each Provider block repeats the fields in the table below.

Action buttons outside the table:

• Add provider: adds a new Provider block to the list.
• Delete icon for each block: removes the corresponding block (disabled when there is only one configuration).
• Save: saves the creation or edit. Cancel: discards changes.

Conditional fields by provider

The visibility and required state of some fields depend on the Provider selected in each block:

• Azure OpenAI: shows the required Endpoint field.
• Bedrock: shows the Region field (required) and the Guardrail identifier + Guardrail version pair (optional as a pair; when you fill in one, the other becomes required).
• OpenAI, Gemini, and Anthropic: do not require extra fields beyond Priority, Provider, Model, and API Key.

TIP

The Guardrail pairing rule prevents ambiguous configurations. To disable the guardrail, clear both fields. They become optional again, and the set is not sent when you save.