AnythingLLM

Use Cortecs models with AnythingLLM

AnythingLLM is an open-source app for chatting with AI models and documents. Connect it to Cortecs using its Generic OpenAI provider.

Before you begin, create a Cortecs API key by following the Member quickstart and choose a chat model from the model catalog.

1. Install AnythingLLM

Download and install AnythingLLM Desktop for macOS, Windows, or Linux.

2. Connect to Cortecs

1. Open Settings → AI Providers → LLM.

2. Select Generic OpenAI as the LLM provider.

3. Enter the following values:

Field	Value
Base URL	https://api.cortecs.ai/v1
API Key	Your Cortecs API key
Selected Model	The exact model ID from the model catalog
Model context window	The selected model's context size in tokens
Max Tokens	1024 to start; increase within the model's output limit if needed

Select your model from the list, or enter its ID if no models are listed. Use the base URL above; AnythingLLM adds /chat/completions automatically.

Click Save changes.

3. Start a chat

Create or open a workspace and send a prompt. If an existing workspace uses another provider, open its Chat Settings and set Workspace LLM Provider to System default, then save.

Document search uses a separate embedding model. You can keep AnythingLLM's default local embedder while using Cortecs for chat.

For more configuration options, see the AnythingLLM Generic OpenAI documentation.