7 open source AI infrastructure tools for Windows. All have a free plan. Half of the paid plans start at $20 a month or less. Newest check: 12 Nov 2026.
268 of 721 tools were checked against the vendor's own page in the last 30 days.
| Tool | Price from | Free plan | Runs on | Checked |
|---|---|---|---|---|
| OllamaMIT-licensed runtime that runs open-weight LLMs on macOS, Windows and Linux with a local API, plus an optional paid cloud for larger models. | $20/mo | Yes | Web · Mac · Windows | 12 Nov |
| AnythingLLMFree MIT-licensed desktop app that chats with your documents and runs agents on local models, no account needed. About 66,700 GitHub stars. | $50/mo | Yes | Web · Android · Mac · Windows | 6 Oct |
| GPT4AllFree MIT-licensed desktop app that runs open-weight LLMs offline, with LocalDocs chat over your own folders. About 77K GitHub stars. | Free | Yes | Mac · Windows | 6 Oct |
| JanOpen-source desktop app that runs open LLMs offline on Windows, macOS and Linux, with optional cloud models through your own API keys. | Free | Yes | Mac · Windows | 6 Oct |
| LiteLLMOpen-source AI gateway and Python SDK that puts 100+ LLM providers behind one OpenAI-compatible API, with budgets and fallbacks. Free to self-host. | -- | Yes | Web · Mac · Windows | 23 Oct |
| llama.cppFree MIT-licensed C/C++ engine that runs LLMs locally. 130,000+ GitHub stars, GGUF models, OpenAI-compatible server. A developer tool. | Free | Yes | Mac · Windows | 7 Oct |
| RiffusionFree AI music generator that creates instrumental tracks from text prompts in 30–45 seconds, no login required. | $8/mo | Yes | Web · Mac · Windows | 19 Aug |
A person checks every record against the vendor's own page. Rankings cannot be bought. How Hokai checks records. Not sure what you need? Describe the job to Smart Match and get three picks with reasons.