Abacus in VSCode

Code completion and chat

Instead of Abacus's botched VSCode fork, we can embed its language models directly in VSCode.

:::warning API access is billed separately by Abacus and is NOT included in the monthly fee! :::

  1. Generate and note an API key in the Abacus web UI.
  2. Install the plugin OAI Compatible Provider for Copilot.
  3. Open the VS Code settings and maintain the values for oaicopilot.baseUrl and oaicopilot.models there. Example:
    "oaicopilot.baseUrl": "https://routellm.abacus.ai/v1",
    "oaicopilot.models": [
    {
      "id": "meta-llama/Meta-Llama-3.1-8B-Instruct",
      "owned_by": "abacus"
    }
  1. Open the GitHub Copilot chat interface.
  2. Click on the model picker and select "Manage Models...".
  3. Select the "OAI Compatible" provider.
  4. Enter the API key.
  5. Select the models.
  6. Restart VSCode.