Code completion and chat
Instead of Abacus's botched VSCode fork, we can embed its language models directly in VSCode.
:::warning API access is billed separately by Abacus and is NOT included in the monthly fee! :::
- Generate and note an API key in the Abacus web UI.
- Install the plugin OAI Compatible Provider for Copilot.
- Open the VS Code settings and maintain the values for
oaicopilot.baseUrlandoaicopilot.modelsthere. Example:
"oaicopilot.baseUrl": "https://routellm.abacus.ai/v1",
"oaicopilot.models": [
{
"id": "meta-llama/Meta-Llama-3.1-8B-Instruct",
"owned_by": "abacus"
}
- Open the GitHub Copilot chat interface.
- Click on the model picker and select "Manage Models...".
- Select the "OAI Compatible" provider.
- Enter the API key.
- Select the models.
- Restart VSCode.