by Cohere
Cohere Labs' compact 2.4B vision-language model for document, chart, and OCR-heavy workloads that need to run locally under the open Apache 2.0 North family.
Released 12 August 2026, this model has a 128K-token language backbone, but Cohere validates image-plus-text prompts only to 8K tokens. It targets local document, chart and OCR extraction and trails the strongest same-size peer on general visual question answering. Weights are free, and no Cohere-hosted API exists for this checkpoint.
| Job | Input | Output | Total |
|---|---|---|---|
| Summarise a 20-page PDF | $0 | $0 | $0 |
| Support reply | $0 | $0 | $0 |
| One coding agent run | $0 | $0 | $0 |
Budgets: 20-page PDF = 30k in / 1k out · Support reply = 2k in / 300 out · Coding agent run = 200k in / 20k out. Computed from the vendor's per-token prices at render time; cached-input discounts are not applied.
No metered Cohere API exists for this checkpoint as of 2026-10-07. The weights are free under an open license; the cost is self-hosting compute, which stays low for a model this small (about 4.8GB for the bf16 weights alone, before image activations) and falls with community quantized builds. Run it through Ollama, llama.cpp or Jan; for hosted OCR billed per page, see Mistral OCR 4.
North Micro Vision Instruct is Cohere Labs' compact open-weight vision-language model. It reads pages at up to 1654 by 2339 pixels without downscaling, and Cohere's own table has it at 73.2% on RefCOCO grounding against 8.4% for Gemma-4-E2B. The weights are free to download.
Reads
Writes
Native-Resolution Vision Encoder
Processes pages and images at their original size and aspect ratio, so small text and chart detail stay legible.
Strong Document Understanding
Lands within half a point of the best of eight models on DocVQA (VAL) in Cohere's own comparison.
Visual Grounding
Returns bounding boxes on a normalised 0-1000 scale and beats four of the seven peers on RefCOCO by more than two times.
Multilingual, Multi-Image Input
Takes interleaved text and several images at once across about a dozen languages, from English and Spanish to Japanese, Korean and Arabic.
Open and Locally Runnable
Ships as open weights with 14 community quantizations listed on its Hugging Face page for offline deployment.
DocVQA (VAL) score, near the top of Cohere's own 8-model comparison for document visual question answering
Source: Cohere Labs Hugging Face model card, August 12, 2026Cheaper than 98% of the 103 GA models with a published price, and one of 89 whose vendor states it does not train on customer data.
| Measure | This model | Rank | Median |
|---|---|---|---|
| Blended price (3:1)$ per 1M tokens | $0/M | #1 / 103 | peer median $1.71/M |
Ranks are against GA models on Hokai that publish the same figure; ties share a rank.
A benchmark is an exam, not the job. Scores transfer unevenly between tasks, so weigh the one closest to your workload and read every figure with its source.
The nearest AI models on Hokai for the same job.
| Model | Lab | Context | In / out per 1M | Reads and writes |
|---|---|---|---|---|
| North Micro Vision Instruct This page | Cohere | 128K | Free | text, image → text |
| Anthropic | 1M | $10 / $50 | text, image, pdf → text | |
| Anthropic | 1M | $10 / $50 | text, image, pdf → text | |
| 262K | $0.10 / $0 | text, image, audio, video, pdf → text |
Training data
4-stage pretraining scaling resolution from 384x384 to 1654x2339 across 10M, 13M, then 10M examples (dense captions and OCR-heavy mix), a 50M-example instruction-tuning stage weighted toward OCR (17.8%), charts/tables (17.8%), grounding (13.3%), and VQA (11.2%), then a 500K-example Stage 4 simplified Mixed Preference Optimization pass for safety and formatting.
| Name | Endpoint | Auth |
|---|---|---|
| Hugging Face Hub (weights) | https://huggingface.co/CohereLabs/North-Micro-Vision-Instruct | Hugging Face account (public download) |
Skip the system prompt
Put instructions directly in the user turn instead of a system role.
The model wasn't trained with system prompts; the chat template accepts one but Cohere explicitly discourages relying on it.
Keep combined image+text under roughly 8K tokens
Chunk multi-page documents into batches that fit within the validated 8K multimodal window.
Longer multimodal contexts rely on unbenchmarked extrapolation from the 128K text backbone.
Not built for math or code generation
Cohere documents limited math and code-generation capabilities for this checkpoint; it wasn't trained to be a general reasoning or coding model.
Workaround: Route math- and code-heavy sub-tasks to a dedicated text LLM. Use North Micro Vision Instruct only for the visual extraction or OCR step of a pipeline.
No tool calling or agentic workflows
The checkpoint does not support function calling or multi-step agentic tool use, unlike Cohere's Command models.
Workaround: Run tool-calling and orchestration in a separate LLM layer. Treat this model purely as a vision or perception sub-module that hands text back to the orchestrator.
System prompts are actively discouraged
The model wasn't trained with system prompts, even though its chat template technically accepts a system role.
Workaround: Put all instructions directly in the user turn instead of a system message.
Multimodal context validated only to 8K
The language backbone nominally supports 128K tokens, but Cohere has only validated multimodal image-plus-text prompts up to 8K tokens; longer contexts rely on unbenchmarked extrapolation.
Workaround: Chunk multi-page documents or long multi-image sequences into batches that keep combined image-plus-text tokens under roughly 8K.
Native-resolution input scales memory with image size
Because images are processed at native resolution rather than a fixed downsized size, memory use and latency grow as input image dimensions grow.
Workaround: Downscale or tile very large scans beyond roughly A4 at 200dpi before inference to keep VRAM and latency predictable.
North-Micro-Vision-Instruct (initial release) · 12 Aug 2026
First release of North Micro Vision Instruct: 2.4B-parameter native-resolution VLM, Apache 2.0. DocVQA (VAL) 92.1%, RefCOCO average 73.2%.
The weights are free under their open license and Cohere charges no per-token fee, because it runs no hosted API for this checkpoint. You pay for compute. The bf16 weights alone take about 4.8GB (two bytes per parameter), before image activations, and its Hugging Face page lists 14 community quantizations that cut that further.
In Cohere's table, Qwen3.5-2B leads on MMBench (76.0% against 68.7%), multilingual MMMB (74.5% against 72.8%) and MMStar (61.4% against 51.8%). North Micro Vision Instruct is ahead on MMLU-Pro (30.7% against 29.8%), IFEval (74.9% against 67.9%) and GQA (57.4% against 53.9%).
Apache 2.0, as stated on its Hugging Face model card. That license permits commercial use, modification and redistribution subject to its notice and patent terms, so the weights can be fine-tuned and quantized. Read the license text itself before shipping a product.
Not when you run it yourself. It is a self-hosted open-weight checkpoint, so inputs stay on your hardware unless you choose a third-party hosted-inference provider. Cohere has published no data-retention policy for this checkpoint, as there is no vendor-side inference to retain.
It suits local invoice, receipt and form extraction and fine-tuning toward one visual task, with ChartQA at 80.8% in Cohere's table. Its OCRBench v2 result trails most peers there, so test it on your own documents first. Avoid it for chat, tool use or math-heavy visual reasoning.
North Micro Vision Instruct is a 2.4-billion-parameter vision-language model released by Cohere Labs, the open-science arm of Cohere, on 12 August 2026. It pairs a 400-million-parameter native-resolution vision encoder, continued from Google's SigLIP 2 SO400M, with a 2-billion-parameter North Micro language model built on the architecture of Cohere Command A+. It is the second entry in the North family of workstation-scale open models and the first to add vision. Cohere positions it as a compact foundation for prototyping and fine-tuning, not a replacement for a chat assistant.
In Cohere's own comparison against seven similarly sized vision-language models (Ministral-3-3B, LFM2.5-VL-1.6B, Phi-3.5-vision-instruct, Gemma-4-E2B, Qwen3-VL-2B, Qwen3.5-2B and SmolVLM2.2B), it scores 92.1% on DocVQA (VAL), half a point behind Qwen3.5-2B's 92.6%, and 73.2% on the RefCOCO grounding average. That grounding figure is more than double four of the seven peers: Ministral-3-3B at 31.7%, Gemma-4-E2B at 8.4%, Qwen3-VL-2B at 30.4% and SmolVLM2.2B at 1.8%. For readers shopping the same size class, the Ministral 3 3B and LFM2.5-VL-3B records show how neighbouring open models are specified. It is weakest on STEM and general knowledge: 32.9% on MMMU (DEV_VAL) is the lowest of all eight models in the table, and 50.4% on MMLU sits well behind Gemma-4-E2B's 69.2% and Ministral-3-3B's 66.0%.
The language backbone nominally supports a 128,000-token context window, but Cohere validates image-plus-text prompts only up to 8,000 tokens; longer multimodal contexts rely on extrapolation that has not been benchmarked. The vision encoder processes images at native resolution up to 1654 by 2339 pixels, the size of an A4 page scanned at 200 dpi, and keeps the aspect ratio. Input is interleaved text and multiple images, output is text only, and documented skills include visual question answering, captioning, grounding with boxes on a normalised 0-1000 scale, OCR, and chart and document reading across roughly a dozen languages. Tool calling and agentic workflows are not supported.
The weights are Apache 2.0 and published on Hugging Face. There is no metered Cohere API and no published hosted price for this checkpoint, so the only cost is compute. The model card documents Transformers (the card pins version 5.16.0), and community builds cover llama.cpp, Ollama, LM Studio, Jan and MLX for Apple Silicon. Cohere's launch post still lists public vLLM support as coming soon, so treat vLLM as unconfirmed. Fine-tuning recipes exist for NVIDIA NeMo AutoModel, plus community support in Axolotl. For a wider walk through local setups, see the guide to running AI locally and the Ollama vs LM Studio comparison.
Training ran in four stages: three resolution-scaling pretraining phases of 10 million, 13 million and 10 million examples, growing from 384 by 384 pixels to the full native cap, then a 50-million-example instruction-tuning stage weighted toward OCR (17.8%), charts and tables (17.8%), grounding (13.3%) and visual question answering (11.2%), and a final 500,000-example preference stage aimed at safety and formatting. Cohere has not published a HarmBench or jailbreak-resistance score, a training-data cutoff or a dedicated system card for this checkpoint, and it advises against system prompts because the model was not trained with one.
Who should look elsewhere: anyone who needs a general chat assistant, tool use, or strong STEM and math reasoning. Qwen3.5-2B beats it on MMBench (76.0% against 68.7%), MMStar, OCRBench and RefCOCO (78.5% against 73.2%), and it also leads on OCRBench v2, where this model's 36.7% trails five of the seven peers. Teams that outgrow this size can compare larger open models such as Gemma 4 12B. A hosted OCR service such as Mistral OCR 4 suits teams that do not want to run any model themselves. The model's own case is narrower: local invoice, receipt and form extraction, and a small base to fine-tune for one visual domain. To compare it with other open models, browse the model directory or ask Smart Match with your document type and hardware.
Specifications on this page (context window, token prices, benchmark scores, licence) are read from Cohere's own model card and documentation. The verdict is Hokai's reading of them, not the provider's claim.