Show me open source AI infrastructure tools

21 open source AI infrastructure tools. 19 have a free plan. Half of the paid plans start at $15 a month or less. Newest check: 12 Nov 2026.

268 of 721 tools were checked against the vendor's own page in the last 30 days.

ToolPrice fromFree planRuns onRatingChecked
OSSInsightOSSInsight is a free AI-powered GitHub analytics platform by PingCAP analyzing 10+ billion open source events to surface trends, rankings, and developer insights across the ecosystem.FreeYesWeb4.120 Sep
GroqFast open-model inference, now built on NVIDIA-licensed LPU hardwareFreeYesWeb4.06 Sep
Hugging FaceThe AI community building the future. Platform for discovering, sharing and collaborating on machine learning models, datasets and applications.$9/moYesWeb4.019 Aug
OllamaMIT-licensed runtime that runs open-weight LLMs on macOS, Windows and Linux with a local API, plus an optional paid cloud for larger models.$20/moYesWeb · Mac · Windows4.012 Nov
Cast.aiCast.ai cuts Kubernetes cloud costs 50-70% using automated rightsizing and Spot instance management. Trusted by 2,100+ companies, reached $1B unicorn in 2026.--YesWeb3.819 Aug
ExecutorMIT licensed MCP gateway with 4.3k GitHub stars that connects Claude Code, Codex and Cursor to your accounts and hosts the tools agents write.$15/moYesWeb3.229 Oct
AnythingLLMFree MIT-licensed desktop app that chats with your documents and runs agents on local models, no account needed. About 66,700 GitHub stars.$50/moYesWeb · Android · Mac · Windows--6 Oct
CactusOpen-source engine that runs LLM, speech and vision models on phones and wearables, with 6 language bindings and cloud handoff.FreeYesiOS · Android · Mac--14 Oct
fast.aifast.ai is a free nonprofit deep learning course reaching 500,000+ students with practical top-down teaching and open-source fastai library.FreeYesWeb--19 Aug
GPT4AllFree MIT-licensed desktop app that runs open-weight LLMs offline, with LocalDocs chat over your own folders. About 77K GitHub stars.FreeYesMac · Windows--6 Oct
JanOpen-source desktop app that runs open LLMs offline on Windows, macOS and Linux, with optional cloud models through your own API keys.FreeYesMac · Windows--6 Oct
LiteLLMOpen-source AI gateway and Python SDK that puts 100+ LLM providers behind one OpenAI-compatible API, with budgets and fallbacks. Free to self-host.--YesWeb · Mac · Windows--23 Oct
llama.cppFree MIT-licensed C/C++ engine that runs LLMs locally. 130,000+ GitHub stars, GGUF models, OpenAI-compatible server. A developer tool.FreeYesMac · Windows--7 Oct
MaleCNS ConnectomeFree connectome of 166,000+ neurons across an entire male Drosophila nervous system, from HHMI Janelia and Google Research.FreeYesWeb--14 Oct
MiroFishOpen-source app that simulates thousands of LLM personas reacting on mock social networks to rehearse public response. Self-hosted, AGPL-3.0 licensed.FreeYesWeb--27 Oct
Open WebUISelf-hosted browser chat for Ollama and OpenAI-compatible models, adding retrieval, plugins and user roles. Free software, about 154K GitHub stars.--YesWeb--6 Oct
OvermindOpen-source platform that turns AI agent traces into scored datasets and LoRA or full fine-tunes of open models from 230M parameters up, with weights you keep.$120/moYesWeb--27 Oct
ReplicateRun open-source AI models via API without managing any GPU infrastructure.FreeYesWeb--21 Aug
RiffusionFree AI music generator that creates instrumental tracks from text prompts in 30–45 seconds, no login required.$8/moYesWeb · Mac · Windows--19 Aug
Together AIThe AI Native Cloud: a full-stack platform for training, fine-tuning, and deploying open-source AI models--TrialWeb--5 Oct
OpenPipeFine-tuning platform whose hosted service ended in July 2026 after CoreWeave moved it to W&B; the ART library stays open source.----Web--13 Oct

Runs on

A person checks every record against the vendor's own page. Rankings cannot be bought. How Hokai checks records. Not sure what you need? Describe the job to Smart Match and get three picks with reasons.