Skip to content

Configure LLM Service Providers

LLM service providers are configured in your Team settings under "LLM and Embedding Model Service Providers". Before configuring a provider, make sure you have an active account with the provider and its API key ready.

Prerequisites

API Key Required: You cannot create a provider without a valid API key. The API key lets Open Chat Studio connect securely to your account with the provider. You must:

  1. Have an active account with the provider (OpenAI, Anthropic, Google, etc.)
  2. Generate an API key from your provider account
  3. Have access to the specific models you want to use

Adding a New Provider

  1. Go to your team settings
  2. Navigate to "LLM and Embedding Model Service Providers"
  3. Click "Add Provider"
  4. Select your provider from the dropdown (see supported providers for the full list)
  5. Enter your API key
  6. Save the configuration

Note

After saving, the provider page lists the LLM models it supports. Each model shows its max token limit and pricing.

Testing Your Configuration

After adding a provider and models, it's recommended to: 1. Create a test chatbot 2. Configure it to use your new provider/model 3. Send a test message to verify everything works correctly

Adding Custom LLM Models

If you need a model that isn't pre-configured in OCS, see Add a Custom LLM Model for how to add one.