Local inferenceMIT
Ollama
Beginner to intermediate · Local CLI and API server
Run open LLMs locally with a simple CLI, model library, and local API.
Open Source AI Tools
Compare practical tools for local inference, model serving, retrieval, application frameworks, and developer workflows.
Local inferenceProprietary free tier
LM Studio
Beginner · Desktop app with local server mode
Desktop app for discovering, downloading, chatting with, and serving local LLMs.
Chat interfaceBSD-3-Clause
Open WebUI
Intermediate · Self-hosted web app
Self-hosted chat interface for Ollama and other model backends.
Private knowledge baseMIT
AnythingLLM
Beginner to intermediate · Desktop app or self-hosted workspace
Private AI workspace for documents, agents, and local or hosted model providers.
Image workflowsGPL-3.0
ComfyUI
Intermediate to advanced · Local node-based workflow app
Node-based interface for building advanced local image generation workflows.
AutomationFair-code / sustainable use
n8n
Intermediate · Cloud or self-hosted automation platform
Workflow automation platform for connecting AI tools, APIs, databases, and business systems.
AI app builderApache 2.0
Flowise
Beginner to intermediate · Self-hosted or cloud low-code builder
Low-code builder for LLM apps, agents, retrieval flows, and AI workflow prototypes.