CalypsoAI allows organizations to add public or custom LLM providers to their list of available providers. Models can be added, configured, and connected by Super Admins or Group Admins.
This article covers adding a pre-configured LLM provider. To learn how to add a custom model, click here.
Add a Model from an Existing LLM Provider
Click Model Configurations in the navigation panel.
The Model Configurations screen opens. Click the Global, Groups, or Chatbots link to display the pre-configured LLM providers. Each tile displays one provider and lists its available models. Click Add on a tile to add a model supported by that provider.
The provider window opens. Enter the required information, then click Test and Connect.
Add an LLM Provider
From the Global or Groups screen, click Add other providers to include a new provider to the list of available providers. The Other models screen opens.
Connect to Model Provider
Open the Select config drop-down list and select the provider.
Enter a name for the model in the Model Display Name text box. The Inputs and Configuration windows will display the model parameters and outputs, respectively, for that model.
Secrets
If the provider requires a secret, such as an API key, to be provided via an authentication header, we can supply this securely through the Secret section in the Configuration window and paste it into the Key field. The value of the key will be displayed in the Value field.
Input
Enter changes to the model parameters via the Input window.
Configuration
Enter changes to the model configuration via the Configuration window.
Model Configuration Error Messaging
If an error occurs when configuring a model, the full error message appears beneath the configuration form. This provides more context about what went wrong and allows users to keep the error in view until it has been fixed.
Finalize Changes
When the preferred changes have been made, click Test and Connect. An error message appears if the test and/or connection was not successful.
Manage A Model
Click Manage.
Click Connect Model.
Enter the required information, then click Test and Connect.
