Show me open source edge AI platforms

7 open source edge AI platforms. All have a free plan. Paid plans start at $20 a month. Newest check: 12 Nov 2026.

268 of 721 tools were checked against the vendor's own page in the last 30 days.

ToolPrice fromFree planRuns onChecked
OllamaMIT-licensed runtime that runs open-weight LLMs on macOS, Windows and Linux with a local API, plus an optional paid cloud for larger models.$20/moYesWeb · Mac · Windows12 Nov
AnythingLLMFree MIT-licensed desktop app that chats with your documents and runs agents on local models, no account needed. About 66,700 GitHub stars.$50/moYesWeb · Android · Mac · Windows6 Oct
CactusOpen-source engine that runs LLM, speech and vision models on phones and wearables, with 6 language bindings and cloud handoff.FreeYesiOS · Android · Mac14 Oct
GPT4AllFree MIT-licensed desktop app that runs open-weight LLMs offline, with LocalDocs chat over your own folders. About 77K GitHub stars.FreeYesMac · Windows6 Oct
JanOpen-source desktop app that runs open LLMs offline on Windows, macOS and Linux, with optional cloud models through your own API keys.FreeYesMac · Windows6 Oct
llama.cppFree MIT-licensed C/C++ engine that runs LLMs locally. 130,000+ GitHub stars, GGUF models, OpenAI-compatible server. A developer tool.FreeYesMac · Windows7 Oct
Open WebUISelf-hosted browser chat for Ollama and OpenAI-compatible models, adding retrieval, plugins and user roles. Free software, about 154K GitHub stars.--YesWeb6 Oct

Runs on

A person checks every record against the vendor's own page. Rankings cannot be bought. How Hokai checks records. Not sure what you need? Describe the job to Smart Match and get three picks with reasons.