Quickstart

Get started using Europe's LLM Router

1. Register & Fund

Register at cortecs.ai and follow these steps to set up your account:

• Fill in your billing address on the settings page and press Save.

• Enter your credit card details.

• Top up your account balance.

• Generate an API key.

If your balance reaches zero, your requests will fail. To avoid this, use Auto top-up to set an amount that is automatically transferred when your balance falls below a specified threshold.

2. Choose a Model

Browse the Model Catalog and select the model that fits your use case. Once you’re confident with the model's performance, you can proceed to obtain your access token and start sending requests via the API.

3. Send Your First Request

Sky Inference supports OpenAI-compatible calls. Here's are some usage examples:

Python

from openai import OpenAI

client = OpenAI(
  base_url="https://api.cortecs.ai/v1/",
  api_key="<API_KEY>",
)

completion = client.chat.completions.create(
  model="<MODEL_NAME>",
  messages=[
    {
      "role": "user",
      "content": "Tell me a joke."
    }
  ],
  extra_body={
    "preference": "balanced"
  }
)

print(completion.choices[0].message.content)

Node.js

Curl

When using the OpenAI compatible wrapper, router specific parameters need to be passed inside the extra_body parameter (eg. preference and allowed_providers). Find out more about supported parameters here.

Tip: Set "preference" to "speed", "cost" or "balanced" to control routing behavior.

➡️ For more details on how routing and preferences work, check the next chapter.