Configure AI model providers (OpenAI, Azure OpenAI, Ollama) and cloud storage.
To use AI models, first configure connections to LLM providers. Connect multiple providers simultaneously so users can pick from various models.Configure in Admin > Settings > Connections.
Connect with OpenAI or OpenAI-compatible APIs (Azure OpenAI, AI Foundry, etc.). Configure multiple connections to balance load.
1
Add connection
Click the + button in the OpenAI API section.
2
Enter connection info
In the connection modal, enter API Base URL and API Key.
3
Verify connection
After saving, verify the model list auto-refreshes.
OpenAI
Azure OpenAI
AI Foundry
Vertex AI
Setting
Description
API Base URL
https://api.openai.com/v1
API Key
Key from OpenAI (sk-...)
Prefix ID
Model ID prefix (optional — prevents collision in multi-connection)
Model IDs
Manual specification (auto-fetched if blank)
Setting
Description
API Base URL
https://{resource}.openai.azure.com/
API Key
Key from Azure Portal
API Version
API version (required, e.g., 2024-02-15-preview)
Prefix ID
Model ID prefix (optional)
Model IDs
Manual specification of deployed model names
Setting
Description
API Base URL
https://{project}.{region}.models.ai.azure.com/
API Key
Key from AI Foundry
API Version
API version (default: 2024-05-01-preview)
Prefix ID
Model ID prefix (optional)
Model IDs
Manual (auto-fetched on Verify Connection if blank)
Azure OpenAI vs AI Foundry
Azure OpenAI
AI Foundry
Endpoint format
{url}/openai/deployments/{model}/...
{url}/openai/v1/...
Model identifier
Deployment name
Model ID
Auth
API Key or Bearer Token
Bearer Token only
Use
OpenAI-only models on Azure
Diverse models on Azure AI (OpenAI + OSS)
Azure OpenAI manages models per deployment; AI Foundry accesses them directly from the model catalog. If you already use Azure OpenAI, AI Foundry isn’t separately required — add it when you need OSS or AI Foundry-only models.
Setting
Description
Project ID
Google Cloud project ID (required)
Location
Region (default: us-central1)
Auth
Global GCP Key or Custom Service Account JSON
Available models are auto-displayed on Verify Connection.
Test API access via the verify button in the settings modal
Prefix ID
Distinguish models with {prefix}.{model} form when names collide across connections
Activate/Deactivate
Per-connection toggle to pause without deleting
Model IDs
When manually specified, only those models are exposed. Auto-fetched if blank
Adding multiple connections to the same provider auto-merges model lists. For example, adding 2 Azure OpenAI connections (US/Korea regions) shows models from both regions. Use Prefix ID to distinguish.
Configure global cloud service accounts. Service Account Keys set here serve as fallback when individual features (TTS, STT, images) lack separate keys.
Provider
Settings
Google Cloud
Service Account Key (JSON)
Leaving Service Account Key empty uses Application Default Credentials (ADC).