Add Endpoints
Endpoints connect the Control Layer to AI providers. Add an endpoint to make models available to your users.
Add an endpoint
- Click Endpoints in the sidebar
- Click Add Endpoint
- Select a provider from the dropdown (OpenAI, Anthropic, Google) or enter a custom base URL
- Enter your API key
- Click Discover Models
- Select which models to enable
- Click Save
The Control Layer queries the provider's /v1/models endpoint and imports available models.
Model aliases
During setup, you can assign aliases to models. This lets you use a custom name (like our-gpt4) instead of the provider's name. Users can call models by either name.
Supported providers
Any OpenAI-compatible API works:
- OpenAI —
https://api.openai.com - Anthropic —
https://api.anthropic.com - Google —
https://generativelanguage.googleapis.com - Together, Groq, Fireworks — enter their API URL
- Self-hosted — vLLM, Ollama, or any OpenAI-compatible server
Custom authentication
Some providers use non-standard authentication. When adding an endpoint, you can configure:
- Auth header name: Default is
Authorization - Auth header prefix: Default is
Bearer
For example, some internal services might use X-API-Key with no prefix.
Edit an endpoint
- Click the endpoint in the list
- Update the name, description, or URL
- Click Save
To change the API key, delete the endpoint and create a new one.
Re-sync models
When a provider adds new models, re-sync to discover them:
- Click the endpoint in the list
- Click Synchronize
- The Control Layer fetches the current model list
New models appear but aren't automatically enabled. Go to Models to enable them and assign group access.
Delete an endpoint
- Select the endpoint (checkbox)
- Click Delete
Or click the delete icon on a single endpoint.
Deleting an endpoint removes all its models from the Control Layer. Users will get "model not found" errors for any deleted models.
API key security
Provider API keys are stored encrypted in the Control Layer database. If credentials are exposed elsewhere, rotate them immediately with your provider, then delete and recreate the endpoint.
Troubleshooting
"Connection failed" during discovery: Check that the URL is correct and reachable. Test the API key directly with the provider using curl.
No models returned: The endpoint might not have a /v1/models endpoint, or your API key might lack permission to list models. Try adding models manually if you know their names.
"Alias already exists" error: Another endpoint already uses that alias. Choose a different alias, or remove it from the other endpoint first.
Models not appearing after sync: New models are discovered but disabled by default. Go to Models and enable them.
Authentication errors after setup: The API key may have been rotated or revoked. Delete the endpoint and recreate it with a fresh key.