by Cohere

North Micro Vision Instruct review, pricing and limits

Cohere Labs' compact 2.4B vision-language model for document, chart, and OCR-heavy workloads that need to run locally under the open Apache 2.0 North family.

Best for
Document and OCR extraction pipelines
Not for
General-purpose chat assistant replacement
  • Available
  • Open source

Should you use North Micro Vision Instruct?

Released 12 August 2026, this model has a 128K-token language backbone, but Cohere validates image-plus-text prompts only to 8K tokens. It targets local document, chart and OCR extraction and trails the strongest same-size peer on general visual question answering. Weights are free, and no Cohere-hosted API exists for this checkpoint.

Best for

  • Document and OCR extraction pipelines DocVQA (VAL) 92.1% and ChartQA 80.8% sit near the top of its size class, with native-resolution input preserving fine text.
  • Visual grounding and bounding-box tasks RefCOCO average of 73.2% is more than double four of the seven same-size peers Cohere benchmarked.
  • Local, fine-tuned multimodal apps Apache 2.0 weights plus Axolotl and NVIDIA NeMo AutoModel recipes make task-specific fine-tuning straightforward.

Not for

  • General-purpose chat assistant replacement Cohere explicitly scopes it as a compact foundation, not a chat-assistant replacement; MMBench and MMLU trail larger same-size peers.
  • STEM or math visual reasoning MMMU_DEV_VAL of 32.9% is the lowest of the 8 models in Cohere's own comparison table.
  • Agentic or tool-calling workflows Tool calling and agentic workflows are not supported by this checkpoint.

North Micro Vision Instruct pricing

Input, per 1M tokens
$0.00/1M
Output, per 1M tokens
$0.00/1M
Pricing model
free (self-hosted, open weights)
Free tier
Fully free and open-weight under Apache 2.0; no rate limits imposed by Cohere. Self-hosting compute is the only cost.

What a real job costs

JobInputOutputTotal
Summarise a 20-page PDF$0$0$0
Support reply$0$0$0
One coding agent run$0$0$0

Budgets: 20-page PDF = 30k in / 1k out · Support reply = 2k in / 300 out · Coding agent run = 200k in / 20k out. Computed from the vendor's per-token prices at render time; cached-input discounts are not applied.

No metered Cohere API exists for this checkpoint as of 2026-10-07. The weights are free under an open license; the cost is self-hosting compute, which stays low for a model this small (about 4.8GB for the bf16 weights alone, before image activations) and falls with community quantized builds. Run it through Ollama, llama.cpp or Jan; for hosted OCR billed per page, see Mistral OCR 4.

Self-hosting requirements

Min vram gb
5
Self-hosted
Yes
Recommended GPU
Any modern consumer GPU with ~5GB+ VRAM for bf16; quantized GGUF/MLX builds run on 2-3GB, including Apple Silicon

What North Micro Vision Instruct can do

North Micro Vision Instruct is Cohere Labs' compact open-weight vision-language model. It reads pages at up to 1654 by 2339 pixels without downscaling, and Cohere's own table has it at 73.2% on RefCOCO grounding against 8.4% for Gemma-4-E2B. The weights are free to download.

What goes in and what comes out

Reads

  • text
  • image

Writes

  • text

Capabilities

  • VisionSupported
  • Audio inputNot supported
  • Audio outputNot supported
  • Code executionNot supported
  • Function callingNot supported
  • Structured outputNot supported
  • Tool useNot supported
  • Video inputNot supported
  • Web browsingNot supported
Reasoning modes
standard
Long context recall
validated only to 8K multimodal tokens despite a 128K text backbone

Key features

  • Native-Resolution Vision Encoder

    Processes pages and images at their original size and aspect ratio, so small text and chart detail stay legible.

  • Strong Document Understanding

    Lands within half a point of the best of eight models on DocVQA (VAL) in Cohere's own comparison.

  • Visual Grounding

    Returns bounding boxes on a normalised 0-1000 scale and beats four of the seven peers on RefCOCO by more than two times.

  • Multilingual, Multi-Image Input

    Takes interleaved text and several images at once across about a dozen languages, from English and Spanish to Japanese, Korean and Arabic.

  • Open and Locally Runnable

    Ships as open weights with 14 community quantizations listed on its Hugging Face page for offline deployment.

Known limitations

  • Lowest STEM/general-knowledge visual reasoning (MMMU) of every model in Cohere's own comparison table.
  • General text knowledge (MMLU) trails larger same-size peers by a wide margin, since it wasn't trained as a broad reasoning model.
  • No tool calling or agentic workflow support; not designed as a chat-assistant replacement.

Who it is for

  • Developers building local or on-device document, invoice, and OCR pipelines who need Apache 2.0 weights
  • Teams fine-tuning a compact VLM for a narrow domain like charts, forms, or receipts rather than general chat
  • Edge and laptop deployments where a 2.4B footprint matters more than best-in-class general VQA
  • Researchers prototyping vision-grounding or multi-image applications who want strong RefCOCO performance out of the box

Supported languages

  • English
  • German
  • French
  • Spanish
  • Italian
  • Portuguese
  • Hindi
  • Japanese
  • Korean
  • Chinese
  • Arabic

North Micro Vision Instruct benchmarks

Standout result

92.1%

DocVQA (VAL) score, near the top of Cohere's own 8-model comparison for document visual question answering

Source: Cohere Labs Hugging Face model card, August 12, 2026

Where it sits

Cheaper than 98% of the 103 GA models with a published price, and one of 89 whose vendor states it does not train on customer data.

MeasureThis modelRankMedian
Blended price (3:1)$ per 1M tokens$0/M#1 / 103peer median $1.71/M

Ranks are against GA models on Hokai that publish the same figure; ties share a rank.

Benchmark scores

Show all 22 benchmark scores
  • DocVQA Val vendor-reported · 07 Oct 202692.1
  • ChartQA Test vendor-reported · 07 Oct 202680.8
  • OCRBench vendor-reported · 07 Oct 202679.2
  • AI2D Test vendor-reported · 07 Oct 202677.5
  • IFEval vendor-reported · 07 Oct 202674.9
  • RefCOCO Avg vendor-reported · 07 Oct 202673.2
  • MMMB vendor-reported · 07 Oct 202672.8
  • Countbench vendor-reported · 07 Oct 202672.5
  • MMBench Dev EN v11 vendor-reported · 07 Oct 202668.7
  • InfoVQA Val vendor-reported · 07 Oct 202665.2
  • MTL MMBench Dev vendor-reported · 07 Oct 202663.6
  • RealWorldQA vendor-reported · 07 Oct 202662.2
  • Hallusionbench vendor-reported · 07 Oct 202661.5
  • CharXiv Dq vendor-reported · 07 Oct 202660
  • GQA Testdev Balanced vendor-reported · 07 Oct 202657.4
  • Blink vendor-reported · 07 Oct 202652.7
  • MMStar vendor-reported · 07 Oct 202651.8
  • MMLU vendor-reported · 07 Oct 202650.4%General-knowledge exam across 57 subjects, % correct.
  • Multi If vendor-reported · 07 Oct 202637.3
  • OCRBench v2 EN vendor-reported · 07 Oct 202636.7
  • MMMU Dev Val vendor-reported · 07 Oct 202632.9
  • MMLU-Pro vendor-reported · 07 Oct 202630.7%A harder version of the 57-subject knowledge exam, % correct.

A benchmark is an exam, not the job. Scores transfer unevenly between tasks, so weigh the one closest to your workload and read every figure with its source.

Strengths and limits

Strengths

  • Lands close to the class leader on document understanding, within half a point on DocVQA in Cohere's own comparison.
  • Visual grounding beats four of the seven benchmarked peers by more than two times, a task many small VLMs struggle with.
  • Permissive licensing with no commercial-use restriction, and community builds for llama.cpp, Ollama, LM Studio, Jan and MLX.
  • Reads full-resolution scans and photos without downscaling, preserving fine text and chart detail.
Show 2 more
  • Top-tier document understanding for its size: 92.1% on DocVQA, per Cohere's own published comparison.
  • Native-resolution input reads a full printed page without downscaling or losing aspect ratio.

Limits

  • MMLU of 50.4% trails Gemma-4-E2B (69.2%) and Ministral-3-3B (66.0%), since this checkpoint was not trained as a broad reasoning model.
  • OCRBench v2 (English) lands at 36.7%, under five of the seven peers, so dense-text OCR needs testing on your own documents.
  • Multimodal inputs are validated only to 8K tokens of the 128K backbone, so long documents or image sequences fall outside tested behaviour.

North Micro Vision Instruct alternatives

The nearest AI models on Hokai for the same job.

ModelLabContextIn / out per 1MReads and writes
North Micro Vision Instruct This pageCohere128KFreetext, image → text
Claude Fable 5Superseded by Fable 5.1 and Fable 5.2 but still sold on the Claude API: Anthropic's first generally available Mythos-class model, released June 2026, with a 1M-token context.Anthropic1M$10 / $50text, image, pdf → text
Claude Fable 5.1Superseded by Claude Fable 5.2 in November 2026 but still sold on the Claude API: Anthropic's second Mythos-class model, released Sept 1, 2026, for long-horizon coding and research.Anthropic1M$10 / $50text, image, pdf → text
Gemini Decision 1Google DeepMind's decision model scores many questions over one multimodal input of up to 262,144 tokens and bills zero output tokens.Google262K$0.10 / $0text, image, audio, video, pdf → text

North Micro Vision Instruct specs

Context window
128K tokens
Architecture
Vision-language model: 400M native-resolution vision encoder (continued from SigLIP 2 SO400M) + 2B-parameter North Micro LLM (Command A+-derived, 3 sliding-window attention layers + 1 global attention layer)
Mixture of experts
No
Parameters
2.4B total (2B language model + 400M vision encoder)
VRAM requirements
Roughly 4.8GB for the bf16 checkpoint based on its 2.4B parameter count; community GGUF/MLX quantizations bring this down to an estimated 1.5-2.5GB depending on quant level.

Training data

4-stage pretraining scaling resolution from 384x384 to 1654x2339 across 10M, 13M, then 10M examples (dense captions and OCR-heavy mix), a 50M-example instruction-tuning stage weighted toward OCR (17.8%), charts/tables (17.8%), grounding (13.3%), and VQA (11.2%), then a 500K-example Stage 4 simplified Mixed Preference Optimization pass for safety and formatting.

Weight formats

  • bfloat16 safetensors
  • GGUF (community)
  • MLX (community)

API endpoints

NameEndpointAuth
Hugging Face Hub (weights)https://huggingface.co/CohereLabs/North-Micro-Vision-InstructHugging Face account (public download)

SDKs

  • Python

Prompting patterns

Show 2 prompting patterns
  • Skip the system prompt

    Put instructions directly in the user turn instead of a system role.

    The model wasn't trained with system prompts; the chat template accepts one but Cohere explicitly discourages relying on it.

  • Keep combined image+text under roughly 8K tokens

    Chunk multi-page documents into batches that fit within the validated 8K multimodal window.

    Longer multimodal contexts rely on unbenchmarked extrapolation from the 128K text backbone.

Known quirks

Show 5 known quirks
  • Not built for math or code generation

    Cohere documents limited math and code-generation capabilities for this checkpoint; it wasn't trained to be a general reasoning or coding model.

    Workaround: Route math- and code-heavy sub-tasks to a dedicated text LLM. Use North Micro Vision Instruct only for the visual extraction or OCR step of a pipeline.

  • No tool calling or agentic workflows

    The checkpoint does not support function calling or multi-step agentic tool use, unlike Cohere's Command models.

    Workaround: Run tool-calling and orchestration in a separate LLM layer. Treat this model purely as a vision or perception sub-module that hands text back to the orchestrator.

  • System prompts are actively discouraged

    The model wasn't trained with system prompts, even though its chat template technically accepts a system role.

    Workaround: Put all instructions directly in the user turn instead of a system message.

  • Multimodal context validated only to 8K

    The language backbone nominally supports 128K tokens, but Cohere has only validated multimodal image-plus-text prompts up to 8K tokens; longer contexts rely on unbenchmarked extrapolation.

    Workaround: Chunk multi-page documents or long multi-image sequences into batches that keep combined image-plus-text tokens under roughly 8K.

  • Native-resolution input scales memory with image size

    Because images are processed at native resolution rather than a fixed downsized size, memory use and latency grow as input image dimensions grow.

    Workaround: Downscale or tile very large scans beyond roughly A4 at 200dpi before inference to keep VRAM and latency predictable.

North Micro Vision Instruct facts

Trains on your data
No
Licence
Apache License 2.0 · Open source
Safety posture
Balanced
Released
12 Aug 2026
Current version
North-Micro-Vision-Instruct
Family
North
Variant
Vision
Deployment
Self-hosted · Hugging Face Transformers · llama.cpp · Ollama · LM Studio · Jan · MLX
Data retention
Self-hosted, open-weight model: no data is sent to Cohere at inference time unless a third-party hosted-inference provider is chosen. No vendor-side retention by default.

Safety controls

Rlhf
No
System prompt
Yes
Constitutional AI
No
Content filter API
No
Moderation endpoint
No
Mixed preference optimization
Yes

Data governance

Trains on inputs
No
Data residency options
self-hosted (any region)

Version history

  • North-Micro-Vision-Instruct (initial release) · 12 Aug 2026

    First release of North Micro Vision Instruct: 2.4B-parameter native-resolution VLM, Apache 2.0. DocVQA (VAL) 92.1%, RefCOCO average 73.2%.

What changed

  • New feature Cohere Labs publishes technical deep-dive and benchmark comparison source
  • Release North Micro Vision Instruct launches as Cohere's first vision entry in the North family source

Questions about North Micro Vision Instruct

Is North Micro Vision Instruct free, and what does it cost to run?

The weights are free under their open license and Cohere charges no per-token fee, because it runs no hosted API for this checkpoint. You pay for compute. The bf16 weights alone take about 4.8GB (two bytes per parameter), before image activations, and its Hugging Face page lists 14 community quantizations that cut that further.

Where does Qwen3.5-2B beat North Micro Vision Instruct?

In Cohere's table, Qwen3.5-2B leads on MMBench (76.0% against 68.7%), multilingual MMMB (74.5% against 72.8%) and MMStar (61.4% against 51.8%). North Micro Vision Instruct is ahead on MMLU-Pro (30.7% against 29.8%), IFEval (74.9% against 67.9%) and GQA (57.4% against 53.9%).

Which license does North Micro Vision Instruct use?

Apache 2.0, as stated on its Hugging Face model card. That license permits commercial use, modification and redistribution subject to its notice and patent terms, so the weights can be fine-tuned and quantized. Read the license text itself before shipping a product.

Does North Micro Vision Instruct send my data to Cohere?

Not when you run it yourself. It is a self-hosted open-weight checkpoint, so inputs stay on your hardware unless you choose a third-party hosted-inference provider. Cohere has published no data-retention policy for this checkpoint, as there is no vendor-side inference to retain.

Is North Micro Vision Instruct a good fit for invoice and document OCR?

It suits local invoice, receipt and form extraction and fine-tuning toward one visual task, with ChartQA at 80.8% in Cohere's table. Its OCRBench v2 result trails most peers there, so test it on your own documents first. Avoid it for chat, tool use or math-heavy visual reasoning.

About North Micro Vision Instruct

North Micro Vision Instruct is a 2.4-billion-parameter vision-language model released by Cohere Labs, the open-science arm of Cohere, on 12 August 2026. It pairs a 400-million-parameter native-resolution vision encoder, continued from Google's SigLIP 2 SO400M, with a 2-billion-parameter North Micro language model built on the architecture of Cohere Command A+. It is the second entry in the North family of workstation-scale open models and the first to add vision. Cohere positions it as a compact foundation for prototyping and fine-tuning, not a replacement for a chat assistant.

Read the full background

In Cohere's own comparison against seven similarly sized vision-language models (Ministral-3-3B, LFM2.5-VL-1.6B, Phi-3.5-vision-instruct, Gemma-4-E2B, Qwen3-VL-2B, Qwen3.5-2B and SmolVLM2.2B), it scores 92.1% on DocVQA (VAL), half a point behind Qwen3.5-2B's 92.6%, and 73.2% on the RefCOCO grounding average. That grounding figure is more than double four of the seven peers: Ministral-3-3B at 31.7%, Gemma-4-E2B at 8.4%, Qwen3-VL-2B at 30.4% and SmolVLM2.2B at 1.8%. For readers shopping the same size class, the Ministral 3 3B and LFM2.5-VL-3B records show how neighbouring open models are specified. It is weakest on STEM and general knowledge: 32.9% on MMMU (DEV_VAL) is the lowest of all eight models in the table, and 50.4% on MMLU sits well behind Gemma-4-E2B's 69.2% and Ministral-3-3B's 66.0%.

The language backbone nominally supports a 128,000-token context window, but Cohere validates image-plus-text prompts only up to 8,000 tokens; longer multimodal contexts rely on extrapolation that has not been benchmarked. The vision encoder processes images at native resolution up to 1654 by 2339 pixels, the size of an A4 page scanned at 200 dpi, and keeps the aspect ratio. Input is interleaved text and multiple images, output is text only, and documented skills include visual question answering, captioning, grounding with boxes on a normalised 0-1000 scale, OCR, and chart and document reading across roughly a dozen languages. Tool calling and agentic workflows are not supported.

The weights are Apache 2.0 and published on Hugging Face. There is no metered Cohere API and no published hosted price for this checkpoint, so the only cost is compute. The model card documents Transformers (the card pins version 5.16.0), and community builds cover llama.cpp, Ollama, LM Studio, Jan and MLX for Apple Silicon. Cohere's launch post still lists public vLLM support as coming soon, so treat vLLM as unconfirmed. Fine-tuning recipes exist for NVIDIA NeMo AutoModel, plus community support in Axolotl. For a wider walk through local setups, see the guide to running AI locally and the Ollama vs LM Studio comparison.

Training ran in four stages: three resolution-scaling pretraining phases of 10 million, 13 million and 10 million examples, growing from 384 by 384 pixels to the full native cap, then a 50-million-example instruction-tuning stage weighted toward OCR (17.8%), charts and tables (17.8%), grounding (13.3%) and visual question answering (11.2%), and a final 500,000-example preference stage aimed at safety and formatting. Cohere has not published a HarmBench or jailbreak-resistance score, a training-data cutoff or a dedicated system card for this checkpoint, and it advises against system prompts because the model was not trained with one.

Who should look elsewhere: anyone who needs a general chat assistant, tool use, or strong STEM and math reasoning. Qwen3.5-2B beats it on MMBench (76.0% against 68.7%), MMStar, OCRBench and RefCOCO (78.5% against 73.2%), and it also leads on OCRBench v2, where this model's 36.7% trails five of the seven peers. Teams that outgrow this size can compare larger open models such as Gemma 4 12B. A hosted OCR service such as Mistral OCR 4 suits teams that do not want to run any model themselves. The model's own case is narrower: local invoice, receipt and form extraction, and a small base to fine-tune for one visual domain. To compare it with other open models, browse the model directory or ask Smart Match with your document type and hardware.

Sources and guides

More AI Models on Hokai

  • Shieldstral 1.0Mistral's open-weight multimodal safety classifier, released 4 August 2026, that screens text and images against policies you write.
  • Claude Mythos 5.2Anthropic's November 2026 Mythos model: Fable 5.2's weights with relaxed cyber and biology safeguards for verified teams, with a 1M-token context.
  • ERNIE-5.5-Flash-PreviewBaidu's text-only preview mixture-of-experts model, served through Qianfan on OpenRouter with a 1M-token context window and tool calling.
  • Gemini 4 CarbonGoogle DeepMind's Gemini 4 Carbon, open to paying Gemini API developers since 10 November: a reasoning model for agentic coding, research and cyber defense.
  • JevTypeSafe's first System One Model, launched in 2026: skips text generation for typed, calibrated decisions software can act on directly.
  • Nex-N2.6Nex AGI's hosted agentic model for computer use and coding, with image input, tool calling and about 321B parameters, served first-party on OpenRouter.