Configure LLM providers and BYOK controls for Clearly AI.
Clearly AI supports Bring Your Own Key (BYOK) for LLM providers. Organizations can bring their own provider credentials from OpenAI, OpenRouter, Anthropic, Google Generative AI, Google Vertex AI, Azure OpenAI, and AWS Bedrock, giving you control over which models power reviews, chats, cost allocation, and data residency.
Organization admins and owners can access model provider settings.
You can save multiple provider configurations. Enable a provider before assigning it to chats or review features.
Models with a context window of 1M tokens or more tend to perform significantly better with Clearly AI's review workflows. When choosing a model, aim for one with this capability.
Model data handling and contractual terms depend on your organization's deployment, selected provider, and credential configuration. Confirm the retention and BAA terms that apply to your organization before sending regulated data. If you configure BYOK, Clearly AI sends model requests through the provider configuration saved for your organization.
Saved keys are encrypted at rest and are not displayed after saving.
Use Feature Assignments in Settings > Organization > Models to choose which provider and model Clearly AI uses for specific chat and review workflows.
Assignments can use Clearly AI's managed provider defaults or an enabled BYOK provider. Administrators can assign models independently to review generation, supporting analysis tasks, and chat workflows.
When a selected model supports reasoning controls, you can set the reasoning effort for that feature.
In Settings > Organization > Models, find the OpenAI card.
Paste your API key.
Click Test to verify the connection, then Save.
Data residency: OpenAI data residency is configured in your OpenAI project or account. If OpenAI gives you a regional API endpoint, set base_url in the Advanced Options JSON:
{ "base_url": "https://eu.api.openai.com/v1"}
Your tenant's default OpenAI endpoint is configured during onboarding. US data residency tenants use https://us.api.openai.com/v1. Only HTTPS URLs are accepted.
Main options:
Option
Type
Description
temperature
float
Randomness (0 = deterministic, 1 = creative). Some reasoning models do not support custom temperature values.
max_tokens
int
Maximum tokens in the response. Some reasoning models use different token-limit parameters.
What you need: A Google Cloud project with Vertex AI access, a target location, and either a Vertex API key for Express Mode or application credentials.
In Settings > Organization > Models, find the Google Vertex AI card.
Enter the Project ID, Location, and Model.
Choose Vertex API key (Express Mode) or Application credentials.
Paste the API key or credentials.
Click Test, then Save.
Main options:
Option
Type
Description
project_id
string
Google Cloud project ID.
location
string
Vertex AI location, for example global or a regional location.
This covers foundation models, cross-region inference profiles, and marketplace model subscriptions. Review and harden as needed: scope Resource ARNs to specific regions or model IDs you actually use, and remove the MarketplaceAccess statement if your models are already subscribed.
Go to Security credentials for the user, click Create access key, and select Third-party service.
Copy the Access Key ID and Secret Access Key. The secret is shown only once.
In the Bedrock console, navigate to Model access and request access to the models you plan to use. Access is per-region.
Requests use the AWS Region you select. If you enter a cross-region or global inference profile, AWS may route inference according to that profile. Use region-specific model IDs or inference profiles when residency boundaries matter. For VPC-private access, set endpoint_url in the Advanced Options to your VPC endpoint.
Each provider card includes an Advanced Options (JSON) field. These parameters are passed to the model provider client at inference time. Leave as {} for defaults. See the provider-specific tables above for common options.
Enable providers before assignment. Feature assignments that use BYOK require the provider configuration to be enabled.
Test before saving. Any change to credentials, model, or advanced options requires a successful connection test before you can save.
Keys are encrypted at rest. Saved keys are never displayed in the UI.
Removing a configuration removes that saved provider setup. Update any feature assignments that used the provider, or use Clearly AI's managed defaults.