Model Comparison

A practical guide to picking the right model for the job across every provider VibeCody supports. Last updated: 2026-05-08.

Caveat: model leaderboards shift weekly. Treat the strength/weakness blurbs as a shape of each model’s bias (what it was trained for), not a final benchmark verdict. When in doubt, run the same prompt through two candidates side-by-side in VibeCoder’s MultiModel panel.

Where models run

Three different execution shapes hide behind the model picker. Pick the row that matches your privacy / cost / capability needs:

vibecli-mistralrs — runs on your machine. Weights cached at ~/.cache/huggingface/hub, forward passes execute on your CPU / Metal / CUDA. Nothing leaves the host. Limited to ~7B-class models on a laptop. Default for the privacy path.

ollama — runs locally OR on Ollama Cloud. Without an ollama API key, only models you’ve ollama pull-ed run (locally). With an API key, large cloud-hosted models (devstral-2:123b-cloud, nemotron-3-super, etc.) route to Ollama Cloud transparently. Open-weights only, scales up to 100B+ MoE.

Cloud APIs (claude, openai, gemini, grok, mistral, deepseek, cerebras, perplexity, together, fireworks, openrouter, azure_openai, bedrock, copilot, zhipu, vercel_ai, minimax, sambanova) — runs on the provider’s hardware. Closed-weights flagships live here. Inputs and outputs traverse the network; check each provider’s data-handling terms.

The daemon serves all three from the same HTTP surface (:7878), so a remote VibeCoder / VibeMobile / VibeWatch client can use any of them. The choice of provider determines where the model itself executes, not how the client connects.

Notation

• Ctx — maximum context window (input tokens).
• Tools — native function/tool calling support: ✅ first-class, ⚠️ supported but quirky, ❌ none.
• Vision — accepts image input.
• Reasoning — model does explicit chain-of-thought / “thinking” tokens before answering.
• Open — open-weights (you can self-host).

Pick by task

The “right” pick depends on what you’re doing. Use this matrix as a starting point, then verify with the MultiModel panel in VibeCoder.

Coding agent (multi-step file edits, run-and-fix loops)

One-shot reasoning, math, hard algorithms

Long context (≥200k tokens)

Vision (image input)

Cheap & fast tool-calling agents

Privacy / fully offline

Web search / news-aware

Providers and models

Below: every provider VibeCody ships, the models we expose in the picker, and what each one is actually good at. Flagships get deeper dives; secondary models get one-liners.

Anthropic Claude (claude)

Three-tier family — Opus (deepest reasoning), Sonnet (balanced workhorse), Haiku (fast/cheap). All three support tool calling, vision, and adaptive thinking. Default in VibeCody is claude-opus-5.

claude-3-5-sonnet-20241022 was dropped on 2026-08-05 — Anthropic retired it on 2025-10-28 and it now 404s. Retired alongside it: Claude 3 Opus (2026-01-05), Claude 3.5 Haiku and Claude 3.7 Sonnet (both 2026-02-19).

claude-opus-5 — Strongest at sustained agentic loops with many tools and many turns. It rarely loses the plot on long sessions and is willing to push back on bad instructions. Most expensive of the three. Use when latency doesn’t matter and the work is hard.

claude-sonnet-5 — The model most VibeCody users will actually run. Roughly Opus-level coding quality on common tasks, ~3-4× cheaper, ~2× faster. Default for the VibeCoder Code panel.

claude-haiku-4-5 — Surprisingly capable for its tier; handles routine tool-calling, summarization, intent classification. Don’t use it for novel architecture or deep debugging — it gets confidently wrong.

claude-code (local Claude Code CLI passthrough)

Same Anthropic models (Opus 5, Sonnet 5, Haiku 4.5), but billed against the user’s Claude.ai Free/Pro/Max/Team/Enterprise plan instead of API credits. Same capabilities; payment shape differs.

OpenAI (openai)

As of August 2026: the GPT-5.6 line (-sol, -terra, -luna, each with a -pro variant) is the current flagship family with built-in adaptive reasoning; GPT-5.5 / 5.4 remain as cheaper previous flagships; the codex variants (gpt-5.3-codex) are coding-tuned for agent loops; the GPT-4 line (gpt-4o, gpt-4.1) remains for compatibility and long-context cases. VibeCody’s default is gpt-5.6-sol. The o-line (o3, o3-mini, o4-mini) and gpt-4-turbo were dropped from the picker on 2026-08-05.

gpt-5.6-sol — OpenAI’s current general-purpose flagship. 1M-token context with strong long-range retrieval, built-in adaptive reasoning (the model decides per-prompt how much “thinking” to spend), native vision, rock-solid tool calling. Default in VibeCody for the OpenAI provider.

gpt-5.3-codex — Coding-specialised GPT-5 variant; tuned for multi-step file edits, run-and-fix loops, and tool-heavy agent flows. Pick this over gpt-5.6-sol when the workload is overwhelmingly code-editing.

gpt-4.1 — Still useful when you need a non-reasoning baseline at low cost or want to A/B against GPT-5 outputs. 1M-token context retrieves well. For new work, default to a GPT-5 entry instead.

Google Gemini (gemini)

Long context is the headline (1M+ across the line). The Gemini 3 generation (released Q1 2026) is competitive with GPT-5-class models on most general tasks and remains best-in-class for long-context retrieval. The 2.5 line stays in the picker for cost-sensitive workloads. VibeCody’s default is gemini-3.6-flash. The 2.0 line was dropped from the picker on 2026-08-05.

gemini-3.5-pro is not in the picker, because it has never shipped. Google announced it at I/O on 2026-05-19 and it has slipped three times; as of August 2026 it remains a limited Vertex AI preview for selected enterprise customers, absent from the consumer Gemini app and AI Studio. This page previously listed it as the current flagship and as VibeCody’s default — both were wrong, written from a projected release date. Corrected 2026-08-10.

gemini-3.6-flash — the current default for the Gemini provider (shipped 2026-07-21). Google’s workhorse tier: roughly 17% fewer output tokens than the model it replaced, with tools, vision, and reasoning across a 1M+ window. Tool calling caught up to Claude/GPT-5 with the 3.x line; argument-shape hallucinations on complex tools have largely cleared. For the deepest long-context work, gemini-3.1-pro remains the strongest shipped Pro-tier option in the picker.

gemini-2.5-pro — Still a strong long-context option at lower cost than 3.1 Pro. Use when you need depth on a long input but don’t need the latest reasoning quality.

gemini-2.5-flash — Sub-second time-to-first-token, supports tools and vision, costs roughly 10× less than Pro. Good for chat-style use and high-volume tool-calling agents.

xAI Grok (grok)

Strong on real-time / news-aware tasks (it has live X data feed integration on the back end). Decent coding ability; tool calling is solid across the 4.x line.

The grok-3 and grok-2 entries were dropped on 2026-08-05 — superseded by the 4.x line.

grok-4.5 — Useful when the task involves recent events, market data, or code where the relevant docs were published in the last few months — it tends to be more current than rivals. Coding capability roughly between gpt-4o and gpt-4.1. Tool calling works but the JSON schema adherence is fussier than Claude’s.

Mistral (mistral)

European cloud provider, strong on multilingual and coding (Codestral). Tool calling is native and well-specced.

codestral-latest — Mistral’s coding specialist. Excellent at completion and edit tasks; smaller than Devstral but covers most languages well. Use this for inline-style completions; use devstral-2 (via Ollama) for full agentic loops.

DeepSeek (deepseek)

Chinese provider; very strong reasoning (R1) and aggressively cheap pricing. Note: data residency / outbound traffic considerations apply if your project requires non-Chinese hosting.

deepseek-coder was dropped on 2026-08-05 (folded into the chat line), as was the bare deepseek-v4 id — the shipped pair is -pro / -flash.

deepseek-reasoner — Strong at math and algorithmic reasoning; meaningfully cheaper than o3 for similar quality on bench tasks. Tool calling support is recent and a bit rough; verify your function schemas round-trip cleanly before relying on it for agent loops.

Cerebras (cerebras)

Inference-only platform — does not train models, but runs open weights at extreme speed (often 10-20× faster than typical cloud endpoints) on their wafer-scale hardware. The Llama-class entries were dropped on 2026-08-05; Cerebras no longer serves them.

gpt-oss-120b on Cerebras — Use when you want frontier open-weights quality with 1000+ tokens/sec generation. Great for streaming-heavy chat UIs and agent loops where round-trip count dominates.

Perplexity (perplexity)

Web-search-augmented chat. Models include browsing as a native step in their generation pipeline; you don’t add a separate tool. Citations come back inline.

Use Perplexity for “what’s the latest on X” prompts where you need fresh sources. Don’t use it for code generation or long agent loops — it isn’t shaped for that.

Together.ai (together)

Inference-only marketplace for open-weights models. We expose a handful of current frontier open weights; Together hosts dozens more — extend STATIC_MODELS if you need them. The Llama-3.3 / Mixtral defaults were dropped on 2026-08-05.

Fireworks (fireworks)

Same shape as Together — inference-only, open-weights focus.

⚠️ Not verified in the 2026-08-05 sweep. Both ids predate the Mixtral-era lineup and are likely stale, but Fireworks’ catalog was not checked against a live source, so they were left as-is rather than replaced with guesses. Same caveat applies to sambanova, azure_openai, and copilot.

OpenRouter (openrouter)

Aggregator front-end — one API key, hundreds of models routed to the cheapest/fastest available backend. Useful for quick experimentation across models, less ideal as a production primary because pricing and latency vary by route.

The previous entries (anthropic/claude-3.5-sonnet, openai/gpt-4o, google/gemini-2.0-flash-001, deepseek/deepseek-v4) were replaced on 2026-08-05 — the first is retired and the last was never a valid slug. This list is still deliberately small; the full catalog is at https://openrouter.ai/api/v1/models.

Azure OpenAI (azure_openai)

Enterprise Azure-region-pinned OpenAI deployments. Same models as openai but billed via Azure with regional / compliance guarantees.

Amazon Bedrock (bedrock)

AWS-region-pinned Anthropic Claude (and others). Same models, AWS billing, IAM-gated. Bedrock is partner-operated, so availability per region can trail the first-party API and the feature surface is a subset — check the model is listed in your region before pinning it.

Bedrock ids take an anthropic. prefix on the otherwise-identical first-party id. The previous entries were replaced on 2026-08-05: claude-3-5-sonnet retired 2025-10-28 and claude-3-haiku retires 2026-04-19. If a model isn’t yet listed in your region, pin an older entry from the table above.

GitHub Copilot (copilot)

Copilot’s chat back-end uses gpt-4o-class models. We expose it as a provider for users on Copilot Business/Enterprise who want to channel chat through that quota.

Ollama (ollama)

The most-used provider in VibeCody. ollama covers both local-pulled models (run on your machine) and cloud-hosted models (run on ollama.com when an API key is configured). The full library list lives in vibecoder/src/constants/ollamaModels.ts.

VibeCody’s default Ollama model is devstral-2 — Mistral’s 123B coding-agent flagship, non-Chinese origin, native tool calling.

Cloud-hosted flagships (non-Chinese)

Cloud-hosted flagships (Chinese-origin)

These are technically excellent but may conflict with data-residency rules. Listed for completeness.

Retired from Ollama Cloud (verified by a live POST /api/show on 2026-08-05, which answers 410 Gone with the retirement date): glm-4.6, kimi-k2:1t and minimax-m2 (all 2026-06-16), and deepseek-v3.1:671b (2026-07-15). Selecting one returns a 410 the user can do nothing about, so re-verify tags the same way when refreshing constants/ollamaModels.ts — the listing page shows base names without their :cloud / :<size>-cloud suffix.

Notable local-pull models

devstral-2 vs nemotron-3-super (most-asked)

• devstral-2 wins for coding agents — file edits, run-and-fix, multi-turn tool use. Trained specifically for that loop. SWE-Bench Verified ~58–62% per Mistral’s release numbers.
• nemotron-3-super wins for one-shot reasoning — math, algorithms, “think first then answer” problems. Heavy RLHF on reasoning benches.
• For VibeCody’s daemon (mostly multi-step coding/agent workloads), devstral-2 is the default. Switch to nemotron-3-super in useModelRegistry.ts:PROVIDER_DEFAULT_MODEL.ollama if your usage is reasoning-heavy.

VibeCLI mistralrs (vibecli-mistralrs)

Embedded-in-daemon inference. Talks to the local VibeCLI daemon (:7878 by default) and pins the in-process mistralrs backend via X-VibeCLI-Backend. Models here are HuggingFace repo IDs that lazy-load on first use.

VibeCody’s default mistralrs model is meta-llama/Llama-3.1-8B-Instruct — Meta’s most recent ~8B open-weights model with a 128k context window and tool-calling support.

About gating — Meta’s Llama models are gated repos on HuggingFace: first-time download requires you to (a) accept Meta’s community license at the model page on huggingface.co and (b) export an HF_TOKEN environment variable with read scope. Qwen (Apache-2.0) and Phi (MIT) repos are fully open and need no token. If HF_TOKEN isn’t set, the daemon’s first lazy-load of a Llama model fails with a 401/403 — switch to a Qwen or Phi model in the picker, or set up the token (see Hugging Face access token docs).

This is the default provider for VibeCody’s privacy-preserving / no-API-key path. Inference is ~5× slower than Cerebras but every byte stays on your machine.

Zhipu (zhipu)

Chinese provider; GLM family.

Vercel AI Gateway (vercel_ai)

Gateway with no preset list — you point it at any backend Vercel AI supports. Empty model list in the registry; user supplies the model string.

MiniMax (minimax)

Chinese provider.

SambaNova (sambanova)

Inference-only, similar shape to Cerebras (fast Llama runs).

Open vs closed weights

If your project needs to run inference offline or prove no data left the machine, only the open-weights column is viable — through Ollama (cloud or local) or the in-daemon mistralrs backend.

Model lifecycle policy

Models in this picker are not equally durable. Open-weights models on HuggingFace, closed flagships behind a paid API, and inference-only marketplaces all age differently. Plan for it.

Two clocks: supply vs quality

Every model has two deprecation timelines:

• Supply clock — will the model still be available? For open weights from Meta, Microsoft, Mistral, Alibaba, Google, etc., the answer is essentially “forever.” First-party releases from major labs are not yanked from HuggingFace. Closed APIs (gpt-3.5-turbo, older Claude versions) do get sunset on published timelines — typically 6-18 months notice.
• Quality clock — will the model still be the right pick? This runs much faster. Small-model tier sees a new generation every 6-12 months: Llama-3.2 → 3.3 → 4, Phi-3.5 → 4 → 4-mini, Qwen-2.5 → 3 → 3.5. The previous version still works; it’s just no longer competitive.

In practice: expect every model in this doc to be obsolete within 18 months, but expect open-weights models to keep working for as long as you have local copies.

Cached-weights floor

When mistralrs first uses a model, weights download once into ~/.cache/huggingface/hub. From that point forward, the model keeps working even if HuggingFace removed the upstream tomorrow. Same applies to Ollama’s local pulls (~/.ollama/models/). Cloud APIs have no equivalent floor — when Anthropic retired claude-3-5-sonnet-20241022 on 2025-10-28, every client lost access on the same day. Ollama Cloud does the same: four of the models this doc previously listed went 410 Gone between 2026-06-16 and 2026-07-15.

Practical implication: if reproducibility matters (audit trail, regulated environment), cache open-weights models on disk and avoid relying on closed APIs for the part of the pipeline that must reproduce identically.

Risk table

Hardening options for VibeCody

If you ship VibeCody to users who need reproducibility (enterprise, regulated, research), there are three knobs you can turn beyond the defaults:

1. Pin commit SHAs in the registry. mistralrs accepts HuggingFace revision specs — change "meta-llama/Llama-3.1-8B-Instruct" to "meta-llama/Llama-3.1-8B-Instruct@<commit-sha>" in STATIC_MODELS. This immunizes against silent re-uploads under the same tag. Cost: you have to manually bump the SHA when you want a newer revision.
2. Add a MODEL_REPLACEMENT_MAP. When a model 404s on pull, the daemon can log “this model has been retired; suggested replacement: X” and either fail fast or auto-substitute. Not implemented today; ~30 lines if you want it.
3. Ship a snapshot mirror. For closed environments without HuggingFace access, mirror the open-weights models you depend on into an internal artifact store (S3, Artifactory) and point HF_ENDPOINT at it. The daemon will pull from there.

None of these are urgent. They become useful when you start depending on a specific model staying frozen.

What we update and when

The lists in this doc and in vibecoder/src/hooks/useModelRegistry.ts are refreshed on a roughly quarterly cadence — when a new flagship lands at one of the major providers, or when an existing model gets formally sunset. The “Last updated” date at the top of this page is authoritative; if it’s more than 6 months old when you read this, treat the picks as historical and verify against the providers’ current docs.

How to set a different default

Per-provider default lives in vibecoder/src/hooks/useModelRegistry.ts:

export const PROVIDER_DEFAULT_MODEL: Record<string, string> = {
  claude:       "claude-opus-4-7",
  openai:       "gpt-5.5",
  gemini:       "gemini-3.1-pro",
  // ...
  ollama:       "devstral-2",     // ← change here
  // ...
};

To add a new model to a provider’s picker, append to the array in STATIC_MODELS in the same file. (For Ollama, the array is sourced from vibecoder/src/constants/ollamaModels.ts.)

Per CLAUDE.md, the model list is the only file you need to touch for a frontend-only change.

See also

• Providers overview — per-provider setup and API key configuration.
• Configuration — daemon and UI settings.
• Failover — chain providers so one going down doesn’t kill your session.