Skip to main content
  • Chat: Power conversational interactions about code and provide detailed guidance
  • Edit: Handle complex code transformations and refactoring tasks
  • Apply: Execute targeted code modifications with high accuracy
  • Autocomplete: Provide real-time suggestions as developers type
  • Embedding: Transform code into vector representations for semantic search
  • Reranker: Improve search relevance by ordering results based on semantic meaning
Models Overview

​
Best Models by Role

Model roleBest open modelsBest closed modelsNotes
Agent PlanClosed models are slightly better than open models
Chat EditClosed and open models have pretty similar performance
AutocompleteClosed models are slightly better than open models
Apply
N/A
Open models are not good enough for this model role
Embed
Qwen3 Embedding
Codestral Embed
Closed models are slightly better than open models
Rerank
zerank-1
zerank-1-small
Qwen3 Reranker
Relace Code Rerank
Open models are beginning to emerge for this model role
Next EditClosed models are better than open models

​
Learn More About Models

Continue supports many model providers, including Anthropic, OpenAI, Gemini, Ollama, Amazon Bedrock, Azure, xAI, and more. Models can have various roles like chat, edit, apply, autocomplete, embed, and rerank. Read more about model roles, model capabilities and view models in the YAML Reference.

​
Example Model Setup Instructions

​
Frontier Models

Claude 4 Sonnet from Anthropic
  1. Get your API key from Anthropic
  2. Add Claude 4 Sonnet to a config on Continue Hub
  3. Add ANTHROPIC_API_KEY as a User Secret on Continue Hub here
  4. Click Reload config in the config selector in the Continue IDE extension
Qwen Coder 3 480B from Qwen
  1. Get your API key from OpenRouter
  2. Add Qwen Coder 3 480B a config on Continue Hub
  3. Add OPENROUTER_API_KEY as a User Secret on Continue Hub here
  4. Click Reload config in the config selector in the Continue IDE extension
GPT-5 from OpenAI
  1. Get your API key from OpenAI
  2. Add GPT-5 a config on Continue Hub
  3. Add OPENAI_API_KEY as a User Secret on Continue Hub here
  4. Click Reload config in the config selector in the Continue IDE extension
Kimi K2 from Moonshot AI
  1. Get your API key from OpenRouter
  2. Add Kimi K2 a config on Continue Hub
  3. Add OPENROUTER_API_KEY as a User Secret on Continue Hub here
  4. Click Reload config in the config selector in the Continue IDE extension
Gemini 2.5 Pro from Google
  1. Get your API key from Google AI Studio
  2. Add Gemini 2.5 Pro a config on Continue Hub
  3. Add GEMINI_API_KEY as a User Secret on Continue Hub here
  4. Click Reload config in the config selector in the Continue IDE extension
Grok Code Fast 1 from xAI
  1. Get your API key from xAI
  2. Add Grok Code Fast 1 a config on Continue Hub
  3. Add XAI_API_KEY as a User Secret on Continue Hub here
  4. Click Reload config in the config selector in the Continue IDE extension
Devstral Medium from Mistral AI
  1. Get your API key from Mistral AI
  2. Add Devstral Medium a config on Continue Hub
  3. Add MISTRAL_API_KEY as a User Secret on Continue Hub here
  4. Click Reload config in the config selector in the Continue IDE extension
gpt-oss-120b from OpenAI
  1. Get your API key from OpenRouter
  2. Add gpt-oss-120b a config on Continue Hub
  3. Add OPENROUTER_API_KEY as a User Secret on Continue Hub here
  4. Click Reload config in the config selector in the Continue IDE extension

​
Local Models

These models can be run on your computer if you have enough VRAM. Their limited tool calling and reasoning capabilities will make it challenging to use agent mode. Qwen3 Coder 30B
  1. Add Qwen3 Coder 30B a config on Continue Hub
  2. Run the model with Ollama
  3. Click Reload config in the config selector in the Continue IDE extension
gpt-oss-20b
  1. Add gpt-oss-20b a config on Continue Hub
  2. Run the model with Ollama
  3. Click Reload config in the config selector in the Continue IDE extension
Devstral Small 27B
  1. Add Devstral Small a config on Continue Hub
  2. Run the model with Ollama
  3. Click Reload config in the config selector in the Continue IDE extension
Qwen2.5-Coder 7B from Qwen
  1. Add Qwen2.5-Coder 7B a config on Continue Hub
  2. Run the model with Ollama
  3. Click Reload config in the config selector in the Continue IDE extension
Gemma 3 4B from Google
  1. Add Gemma 3 4B a config on Continue Hub
  2. Run the model with Ollama
  3. Click Reload config in the config selector in the Continue IDE extension
Qwen2.5-Coder 1.5B from Qwen
  1. Add Qwen2.5-Coder 1.5B a config on Continue Hub
  2. Run the model with Ollama
  3. Click Reload config in the config selector in the Continue IDE extension
⌘I