by Mintplex Labs

AnythingLLM review, pricing and verdict

Free MIT-licensed desktop app that chats with your documents and runs agents on local models, no account needed. About 66,700 GitHub stars.

Best for
Independent researcher
Not for
Compliance officer needing published attestations

Should you use AnythingLLM?

Pick it if you want private document chat on one computer, or a self-hosted team workspace, without writing code. It sits between a plain model runner and a full enterprise platform, and the Docker image is free to host. Answer quality still depends on your hardware and the model you choose, so test with your own files first.

Workspace-based document chat with agents and a meeting assistant in one free local app.

The MIT code and a large community give it reach, but local runners and chat front ends are easy to swap, so lock-in is low.

Also for

  • IT lead at a small team
  • Researchers who need a private assistant over a folder of PDFs
Show 3 more
  • Small teams that want a shared self-hosted AI workspace
  • Developers who need an embeddable RAG backend with an API
  • Privacy-minded freelancers working with client documents

Also not for

  • Non-technical user wanting a hosted frontier model with no setup

Main trade-off

Output quality is capped by local hardware and the small models it can run there.

AnythingLLM pricing

PlanMonthly priceWhat it includes
Desktop and self-hostedFreeDesktop app for Windows, macOS and Linux or a Docker self-host under the MIT licence, document chat, agents, local models, no account
Cloud Basic$50/moPrivate hosted instance, custom subdomain, RAG and agents out of the box, bring your own LLM API key
Cloud Pro$99/moPrivate hosted instance with priority resources for larger teams and a 72-hour support SLA
EnterpriseCustomSales-led plan with on-premises deployment, custom SLA, custom integrations, SSO and RBAC; no public price

Free on desktop and Docker. Hosted Cloud Basic $50/mo, Cloud Pro $99/mo, Enterprise by quote. Cloud plans need an API key from your model provider. Checked on the vendor cloud page 2026-10-06.

Before you commit

  • Cloud plans need a separate LLM API key billed by the model provider
  • A capable GPU or large RAM is needed for good local model speed

What AnythingLLM does

AnythingLLM is an open-source desktop and server app from Mintplex Labs that chats with your own documents using local or hosted models. Its MIT-licensed GitHub repository holds about 66,700 stars, and desktop version 1.17.0 runs on Windows, macOS and Linux with no account, adding agents, scheduled jobs and an on-device meeting assistant.

  • Workspace document chat

    Embeds PDFs, text files and web pages locally and answers each chat from that workspace with source citations.

  • Bring any model

    Runs a downloaded on-device model, connects to Ollama or LM Studio, or calls a hosted API, and auto-recommends a model for your hardware.

  • Agents and custom skills

    Agents scrape pages, search the web, read and write local files and run scheduled background jobs, extended through a custom tool builder.

  • On-device meeting assistant

    Transcribes and summarises calls on your computer with action items, and no bot joins the meeting.

Show all 6 features
  • Multi-user cloud and Docker

    The cloud and self-hosted server editions give each user isolated access with admin controls and white-labelling.

  • Developer API

    Exposes a developer API so other apps can use a workspace as a retrieval backend.

Works with

  • Ollama
  • LM Studio
  • OpenAI-compatible APIs
  • Docker

Missing integrations

  • Published SSO on the free tiers

Most users expect these and they are not currently supported.

Capabilities

  • Local LLM
  • RAG
  • Document chat
  • Open source
  • Self-hosted
  • AI agents
  • Privacy

Strengths and limits

Strengths

  • The desktop app is free under the MIT licence and needs no account, so a first document chat takes one download and no sign-up.
  • Works with an on-device model, Ollama, LM Studio or a hosted API, so you are not tied to one model vendor.
  • Ships agents, scheduled jobs and a meeting assistant in the same app, where most local runners stop at plain chat.
  • Hosted multi-user plans are a flat monthly price per instance rather than a per-seat charge.

Limits

  • Local answer quality depends on your hardware and the model you pick, and small on-device models handle long documents worse than hosted frontier models.
  • Cloud plans require your own LLM API key, so a hosted setup has a second bill on top of the subscription.
  • No security attestation such as SOC 2 or ISO 27001 is published on the pages checked, which matters for regulated teams.
  • The Enterprise tier has no public price and is sales-led, so budgeting a large rollout means a quote first.

AnythingLLM alternatives

ToolPrice fromFree planRuns onRating
AnythingLLM This page$50/moYesWeb · Android · Mac · Windows--
OllamaPick AnythingLLM for document chat and agents in a ready interface; pick Ollama when you want the model engine and a command line, and pair them if you like.$20/moYesWeb · Mac · Windows4.0
LM StudioChoose AnythingLLM for workspaces, agents and a team server; choose LM Studio for a polished model browser and a single-user desktop.$20/moYesMac · Windows--
Open WebUIPick AnythingLLM for a desktop install with document workspaces; pick Open WebUI for a browser-first team deployment with plugins and roles.--YesWeb--

Also compared

  • JanChoose AnythingLLM when you need retrieval over many files and agents; choose Jan for a simple offline chat app.
  • GPT4AllPick AnythingLLM for agents, scheduled jobs and a server edition; pick GPT4All for a minimal installer with LocalDocs.

AnythingLLM facts

Training-data policy
Desktop app keeps models, documents and chat history on the device by default; the vendor states nothing phones home.
Works offline
Yes
Minimum skill level
Basic
Price band
Free

Data and privacy

MIT

Questions about AnythingLLM

What does AnythingLLM cost to run?

Running it on your own machine costs nothing, through the desktop installer or the Docker image. Vendor hosting is $50 monthly for Cloud Basic or $99 monthly for Cloud Pro, each needing an LLM API key that you pay for separately. Enterprise pricing comes from a sales quote.

Can you use AnythingLLM without paying or signing up?

Yes. The desktop app asks for no account, email or card, and the vendor states that models, documents and chat history stay on your machine by default. The limit is your hardware: a laptop without a GPU runs only small models at modest speed.

What are the closest alternatives to AnythingLLM?

Jan suits a simple offline chat app, GPT4All offers LocalDocs in a minimal installer, and Open WebUI fits a browser-based team deployment. LM Studio is the pick if you mostly want a model browser and local server rather than document workspaces.

Is AnythingLLM better than Ollama for chatting with PDFs?

They do different jobs. Ollama runs the model and exposes it through a command line and API, while AnythingLLM adds the workspace, embedding and citation layer on top, and can use an Ollama model as its engine. Most people who want PDF chat without code start with AnythingLLM.

How do you get AnythingLLM running on a laptop?

Download the installer for Windows, macOS or Linux from the vendor site, open it and let the app suggest a model for your hardware. Create a workspace, drag in a few documents and ask a question. Developers can instead start the Docker image from the quickstart guide.

About AnythingLLM

AnythingLLM is an open-source AI app from Mintplex Labs that runs on your own computer and chats with your documents, searches the web and carries out agent tasks without an account or API key. The code is MIT licensed and the GitHub repository holds about 66,700 stars as of 6 October 2026. The desktop build is at version 1.17.0 and is free.

Read the full background

The core idea is a workspace. You drop PDFs, text files, web pages or whole folders into a workspace, the app splits and embeds them locally, and every chat in that workspace answers from those files with citations back to the source passage. You pick the model behind it: a small model that the app downloads and runs on your device, a model served by Ollama or LM Studio, or a hosted API if you prefer. If you cannot decide, the app recommends a model that fits your hardware.

On top of document chat sits an agent layer. Agents can scrape a page, search the web, read and write files on your machine, run scheduled background jobs and call custom skills you build with the tool builder or the developer API. Newer additions include a meeting assistant that transcribes and summarises calls on the device without a bot joining the meeting, and a dictation feature that refines speech as you talk.

Who it suits: people who want a private research assistant on one laptop, teams that want a shared multi-user workspace on their own server, and developers who want an embeddable RAG backend. It overlaps with Jan and GPT4All on the single-user desktop and with Open WebUI on the self-hosted team side. For a wider look at running models on your own hardware, see the guide on local coding models.

Pricing splits by where it runs. The desktop app and the Docker self-host are free. The hosted cloud version starts at $50 a month for a private instance with a custom subdomain, and a $99 a month Pro plan adds priority resources and a 72-hour support response. Enterprise is quoted by sales and adds on-premises deployment, SSO and role-based access. Desktop builds exist for Windows (x64 and ARM), macOS (Apple Silicon and Intel) and Linux, and a local-first Android app is available.

Sources and guides

More AI Tools on Hokai

  • Overview AISmart cameras with on-device AI and browser-based software for spotting defects on factory lines, with public base prices for three models.
  • CactusOpen-source engine that runs LLM, speech and vision models on phones and wearables, with 6 language bindings and cloud handoff.
  • llama.cppFree MIT-licensed C/C++ engine that runs LLMs locally. 130,000+ GitHub stars, GGUF models, OpenAI-compatible server. A developer tool.
  • MstyDesktop AI workspace that runs local and online models side by side. Free Studio plan and paid Aurum tier. For Windows, macOS and Linux.
  • CometAPICometAPI is a unified API gateway: one key and one OpenAI-compatible endpoint for 500+ text, image, video and audio models, billed about 20% below official provider rates.
  • CoralOpen-source, self-hosted gateway where agents write TypeScript programs to call tools under Allow, Ask or Block rules; about 5,000 GitHub stars.