INFRASTRUCTURE NOTE: Running unquantized weights requires a high-VRAM server or multi-GPU rig. For local workstation setups, select an architecture profile to isolate low-overhead distillation filters or Q4_K_M GGUF quantization paths.

Models · Source-aware through June 2026

Open-weight and open-source AI models

Search and filter model families and featured models by task, hardware, workflow, source status, license posture, and practical deployment fit. OpenSourcesAI separates open-source software projects from open-weight model releases so builders can check the exact model card before production or commercial use.

11Featured models
4Model families

Openness labeled clearly

Open-weight and open-source status is separated so you can verify the exact license before production use.

Hardware fit first

Every model surfaces VRAM and runtime needs alongside the description.

Decision-focused filters

Narrow by task, capability, or openness before comparing model cards.

Click a family hub to browse variants, local notes, comparison tables, source links, and related tools.

Start here

Choose models by fit, not hype

The fastest path is hardware fit first, then task fit, then a small test before committing to a stack.

Showing 11 featured models and 4 family hubs.

Browse by model type

Filter by openness and capability

License note: model openness varies by checkpoint. Treat directory labels as a starting point and verify the official model card, license file, provider terms, redistribution rights, hosted-use limits, and derivative-use rules before commercial deployment.

Featured 2026

Featured model profiles

Reasoning

DeepSeek-V4-Pro

Open weightsMIT

Frontier open-weight DeepSeek model positioned for reasoning-heavy coding, agent, and long-context work.

Best for: Teams comparing frontier-style open-weight reasoning and coding models against hosted closed models.

ParametersMoE / variesContextUp to 1M in DeepSeek docs; verify exact releaseHardwareServer-classRuntimevLLM, SGLang, Transformers, hosted providers

DeepSeek · DeepSeek

Verified/updated 2026

Review model →

Chat

Qwen3 235B A22B

Open weightsApache 2.0

Flagship open-weight Qwen3 MoE model often chosen for serious reasoning, coding, multilingual work, and agent experiments.

Best for: Builders testing frontier-style open-weight reasoning and coding in hosted or multi-GPU environments.

Parameters235BContext40,960 tokensHardwareServer-classRuntimevLLM, SGLang, Transformers, hosted providers

Alibaba Qwen · Qwen

Verified/updated 2026

Review model →

Agents

Kimi K2.6

Open weights where releasedModified MIT License

Current Kimi family model for agentic coding, tool-use behavior, and long-context workflow evaluation.

Best for: Builders testing agentic coding, tool calling, long-context planning, and workflow automation.

ParametersMoE / variesContext262,144 tokens, confirmed from the model's published configHardwareServer-classRuntimevLLM, SGLang, hosted providers

Moonshot AI · Kimi

Verified/updated 2026

Review model →

Code

GLM-5.2

Open weightsMIT

GLM-5.2 is a 753B MoE model requiring multi-GPU or distributed inference for full deployment.

Best for: GLM-5.2 is Z.ai's large mixture-of-experts model, aimed at coding, agentic tool-use, and very long context work rather than single-GPU home setups.

Parameters753BContextCheck model cardHardwareGLM-5.2 is a 753B MoE model requiring multi-GPU or distributed inference for full deployment. Ollama publishes a cloud-hosted entry only (`glm-5.2:cloud`, re-checked 2026-08-24) and exposes no downloadable local artifact, so this catalog records no local tag. Below data-center scale, the unsloth/GLM-5.2-GGUF 1-bit UD-IQ1 variants (~217–228 GB) via llama.cpp or Unsloth Studio with KTransformers are the only local execution path, at reduced fidelity. Not consumer-local hardware friendly.RuntimeOllama / LM Studio / vLLM varies

Z.ai (Zhipu AI) · GLM

Check exact model card

Review model →

Chat

Gemma 4

Open weightsApache 2.0

Google Gemma family entry for open-weight testing across efficient local, app, and multimodal workflows.

Best for: Developers evaluating Google-backed open-weight models for efficient local apps, hosted prototypes, and multimodal workflows where supported.

ParametersCheck model cardContextCheck current Gemma model cardHardwareVaries by sizeRuntimeOllama, LM Studio, llama.cpp, Transformers, vLLM

Google · Gemma

Verified/updated 2026

Review model →

Multimodal

Llama 4 Scout

Open weightsLlama 4 Community License

Open-weight Llama 4 model positioned for multimodal and long-context workflows.

Best for: Teams evaluating Llama-family models for multimodal assistant, long-context, and application workflows.

ParametersCheck model cardContext10,485,760 tokensHardware~63 GB at Q4_K_M (109B total parameters, MoE), multi-GPU classRuntimevLLM, Transformers, hosted providers where supported

Meta · Llama

Verified/updated 2026

Review model →

Multimodal

Llama 4 Maverick

Open weightsLlama 4 Community License

Open-weight Llama 4 model positioned for multimodal, reasoning, and general assistant workflows.

Best for: Builders comparing current Llama-family models for assistant, multimodal, and reasoning-oriented workflows.

ParametersCheck model cardContext1,048,576 tokens (~1M), confirmed from the model's published configHardware~243 GB at Q4_K_M (401.6B total parameters, 128-expert MoE), multi-GPU or server classRuntimevLLM, Transformers, hosted providers where supported

Meta · Llama

Verified/updated 2026

Review model →

Chat

gpt-oss-20b

Open weightsApache 2.0

Smaller gpt-oss model for local and more accessible open-weight deployments.

Best for: Builders evaluating more accessible open-weight deployments for local apps, prototypes, and controlled workflows.

Parameters20bContext128,000 tokensHardware~12.5 GB at Q4_K_M (20B parameters)RuntimeOllama or LM Studio where supported, vLLM, Transformers

OpenAI · gpt-oss

Verified/updated 2026

Review model →

Audio

Whisper Large V3

Open source weights and codeApache 2.0

Open speech recognition model commonly used for transcription and multilingual audio workflows.

Best for: Builders adding local transcription, podcast processing, meeting notes, or audio translation.

ParametersCheck model cardContext30-second audio windows · 448-token cap per windowHardware~3.1 GB in fp16 (1.5B parameters)RuntimeTransformers, faster-whisper, whisper.cpp

OpenAI · Whisper

Verified/updated 2026

Review model →

Embedding

bge-m3

Open weightsMIT

Multilingual BGE embedding model that supports dense retrieval, lexical retrieval, and multi-vector retrieval in one checkpoint.

Best for: RAG teams that want one embedding model for multilingual search, long documents, and retrieval experiments beyond plain dense vectors.

ParametersCheck model cardContext8,192 tokensHardware~2.27 GB in fp32 (568M parameters)RuntimeOllama or LM Studio where supported, llama.cpp, Transformers, vLLM

BAAI · BGE

Verified/updated 2026

Review model →

Embedding

e5-mistral-7b-instruct

Open weightsMIT

Instruction-tuned E5 embedding model built on a Mistral 7B backbone for text embedding and retrieval tasks.

Best for: Teams comparing larger instruction-tuned embedding models for retrieval quality when smaller E5 checkpoints are not enough.

Parameters7bContext32,768 tokensHardware~14.2 GB in fp16 (7.1B parameters), an LLM-scale embedding modelRuntimeOllama or LM Studio where supported, llama.cpp, Transformers, vLLM

Microsoft / intfloat · E5

Verified/updated 2026

Review model →

Browse by family

Model family hubs

Next step

Turn a model choice into a working stack.

After you shortlist a model, test prompts in the Playground and use stack recipes to connect it to a chat UI, RAG workflow, coding assistant, or serving layer.

Local model VRAM reference

Consumer-runnable models by parameter tier

All models run locally via Ollama or llama.cpp. VRAM values are empirical GGUF measurements, not formula estimates. Enter your GPU VRAM below to highlight which quantization fits your hardware.

≤5B

Compact

Fits in 4 GB VRAM at Q4. Fast responses on entry GPU or CPU.
ModelParamsContextQ4_K_MQ8_0FP16License
DeepSeek R1 Distill Qwen 1.5B
Reasoningmath
1.78B
128K
Q4: 1.2 GB
Q8: 2 GB
FP16: 3.6 GB
MIT
Hy-MT2 1.8B
multilingualedge
1.8B
256K
Q4: 1.3 GB
Q8: n/a
FP16: n/a
Apache 2.0
VibeThinker-3B
ReasoningmathCoding
3B
64K
Q4: 2.4 GB
Q8: 3.8 GB
FP16: n/a
MIT
Phi-3 Mini 128K
ChatCodingedgeSummarisation
3.8B
128K
Q4: 4 GB
Q8: 6 GB
FP16: 8 GB
MIT
Phi-4 Mini
ChatReasoningmath
3.84B
128K
Q4: 2.6 GB
Q8: 4.2 GB
FP16: 7.5 GB
MIT
Qwen3 4B
ChatCodingSummarisation
4B
32K
Q4: 2.6 GB
Q8: 4.5 GB
FP16: 8 GB
Apache 2.0
Gemma 3 4B
ChatSummarisationRAG
4B
128K
Q4: 2.5 GB
Q8: 4.3 GB
FP16: 8 GB
Gemma Terms of Use
6–20B

Standard

Sweet spot for 8–16 GB VRAM. Best quality-to-cost ratio.
ModelParamsContextQ4_K_MQ8_0FP16License
6.7B
16K
Q4: 4.4 GB
Q8: 7.4 GB
FP16: 13.5 GB
DeepSeek License
Qwen2.5 7B
ChatCodingReasoningmultilingual
7B
128K
Q4: 6 GB
Q8: 9 GB
FP16: 16 GB
Apache 2.0
Qwen2.5-Coder 7B
CodingReasoningChatAgents
7B
128K
Q4: 6 GB
Q8: 9 GB
FP16: 16 GB
Apache 2.0
Mathstral 7B
mathReasoning
7.25B
32K
Q4: 4.7 GB
Q8: 8 GB
FP16: 14 GB
Apache 2.0
Phi-3 Small
ChatReasoning
7.4B
8K
Q4: 4.8 GB
Q8: 8.1 GB
FP16: 14.5 GB
MIT
Llama 3 8B
ChatCodingRAGSummarisation
8B
8K
Q4: 5.6 GB
Q8: 9.5 GB
FP16: 16 GB
Llama 3 Community License
Llama 3.1 8B Instruct
ChatCodingRAGAgentsSummarisation
8B
128K
Q4: 5.6 GB
Q8: 9.5 GB
FP16: 16 GB
Llama 3.1 Community License
Qwen3 8B
CodingChatRAGAgentsReasoning
8B
32K
Q4: 5.3 GB
Q8: 8.9 GB
FP16: 16 GB
Apache 2.0
DeepSeek-R1 8B (0528 Qwen3)
ReasoningCodingChat
8B
32K
Q4: 5 GB
Q8: 8.8 GB
FP16: 16 GB
MIT
Ministral 8B
ChatSummarisation
8.02B
128K
Q4: 5.2 GB
Q8: 8.8 GB
FP16: 16 GB
Mistral Research License (non-commercial)
DeepSeek R1 Distill Llama 8B
Reasoningmath
8.03B
128K
Q4: 5.2 GB
Q8: 8.8 GB
FP16: 16 GB
MIT
8.54B
8K
Q4: 5.6 GB
Q8: 9.4 GB
FP16: 17 GB
Gemma Terms of Use
Granite 4.2 8B
ReasoningCodingtool-useAgentsmathmultilingual
8.8B
128K
Q4: 5.6 GB
Q8: n/a
FP16: n/a
Apache 2.0
Qwythos-9B (Claude-Mythos-5 1M)
ReasoningCodingtool-uselong-contextChat
9B
1024K
Q4: 6.5 GB
Q8: 11 GB
FP16: n/a
Apache-2.0
Gemma 2 9B Instruct
ChatSummarisationRAG
9.24B
8K
Q4: 6 GB
Q8: 10 GB
FP16: 18 GB
Gemma Terms of Use
Qwen3.8 9B Distill
ReasoningmathCodingtool-uselong-context
9.7B
256K
Q4: 5.4 GB
Q8: n/a
FP16: n/a
Apache 2.0
Qwen3.5 9B
ChatReasoninglong-contextmultilingual
9.7B
256K
Q4: 6.6 GB
Q8: 11 GB
FP16: 19 GB
Apache 2.0
Ornith 1.5 9B
CodingAgentsChatlong-context
9.7B
256K
Q4: 5.6 GB
Q8: n/a
FP16: n/a
MIT
Gemma 3 12B
ChatRAGSummarisationCoding
12B
128K
Q4: 7.6 GB
Q8: 13 GB
FP16: 24 GB
Gemma Terms of Use
Gemma 4 12B
ChatReasoning
12B
256K
Q4: 7.6 GB
Q8: 12.8 GB
FP16: 24 GB
Apache 2.0
Gemma 4 12B (QAT)
ChatCodingSummarisationReasoning
12B
256K
Q4: 9.5 GB
Q8: n/a
FP16: n/a
Apache 2.0
Phi-3 Medium 128K Instruct
ChatCodingSummarisationRAG
14B
128K
Q4: 8.6 GB
Q8: 15 GB
FP16: 28 GB
MIT
Phi-4
CodingReasoningChatSummarisation
14B
16K
Q4: 9.1 GB
Q8: 15 GB
FP16: 28 GB
MIT
Qwen3 14B
CodingChatRAGAgentsReasoning
14B
32K
Q4: 9.3 GB
Q8: 15.5 GB
FP16: 28 GB
Apache 2.0
DeepSeek-R1 Distill 14B
ReasoningCodingAgents
14B
32K
Q4: 9 GB
Q8: 15.5 GB
FP16: 28 GB
MIT
Qwen2.5 14B
ChatCodingReasoningmultilingualRAG
14B
128K
Q4: 9 GB
Q8: 16 GB
FP16: 28 GB
Apache 2.0
Qwen2.5-Coder 14B
CodingReasoningAgents
14B
128K
Q4: 9 GB
Q8: 15.7 GB
FP16: 29.6 GB
Apache 2.0
15.7B
128K
Q4: 10 GB
Q8: 17 GB
FP16: 31 GB
DeepSeek License
GPT-OSS 20B
ReasoningCodingAgents
20B
125K
Q4: 12.5 GB
Q8: n/a
FP16: n/a
Apache 2.0
21B+

Large

Needs 20+ GB VRAM at Q4. Workstation or multi-GPU hardware.
ModelParamsContextQ4_K_MQ8_0FP16License
22.2B
32K
Q4: 14 GB
Q8: 24 GB
FP16: 43 GB
Mistral Non-Production License
Devstral
CodingAgents
23.6B
128K
Q4: 14.3 GB
Q8: 25 GB
FP16: 47 GB
Apache 2.0
Mistral Small 3.1
ChatCodingRAGReasoningAgentsSummarisation
24B
128K
Q4: 14.4 GB
Q8: 25.5 GB
FP16: 48 GB
Apache 2.0
Gemma 4 26B (A4B)
ChatReasoninglong-contextmultilingual
26B
256K
Q4: 18 GB
Q8: n/a
FP16: n/a
Apache 2.0
Ternary Bonsai 2 27B
ReasoningCodingtool-usemathlong-context
26.9B
256K
Q4: 5.9 GB
Q8: n/a
FP16: n/a
Apache 2.0
Gemma 3 27B
ChatCodingRAGSummarisationReasoning
27B
128K
Q4: 17 GB
Q8: 29 GB
FP16: 56 GB
Gemma Terms of Use
Gemma 2 27B Instruct
ChatReasoningSummarisation
27.2B
8K
Q4: 17 GB
Q8: 29 GB
FP16: 53 GB
Gemma Terms of Use
Qwen3.6 27B
ChatReasoninglong-contextmultilingual
27.8B
256K
Q4: 17 GB
Q8: n/a
FP16: n/a
Apache 2.0
Qwen3.8 27B
ChatReasoninglong-contextmultilingual
27.8B
256K
Q4: 18 GB
Q8: 30 GB
FP16: 56 GB
Apache 2.0
Muse Glimmer 30B
Agentstool-useCodingReasoninglong-contextChat
29.8B
128K
Q4: 18 GB
Q8: 31 GB
FP16: 57 GB
Apache 2.0
North Mini Code 1.0
CodingAgentstool-useReasoninglong-context
30.5B
488K
Q4: 18 GB
Q8: n/a
FP16: n/a
Apache 2.0
Qwen3 30B (A3B)
ChatReasoninglong-contextAgents
30.5B
256K
Q4: 19 GB
Q8: n/a
FP16: n/a
Apache 2.0
Qwen3-Coder 30B (A3B)
CodingAgentstool-uselong-context
30.5B
256K
Q4: 19 GB
Q8: n/a
FP16: n/a
Apache 2.0
Gemma 4 31B
ChatReasoninglong-contextmultilingual
31B
256K
Q4: 20 GB
Q8: n/a
FP16: n/a
Apache 2.0
Qwen3 32B
CodingReasoningAgentsChatRAG
32B
32K
Q4: 20 GB
Q8: 34 GB
FP16: 64 GB
Apache 2.0
DeepSeek-R1 Distill Qwen 32B
ReasoningCodingAgentsChat
32B
32K
Q4: 20 GB
Q8: 34 GB
FP16: 64 GB
MIT
Qwen2.5 32B
ChatCodingReasoningmultilingualAgents
32B
128K
Q4: 20 GB
Q8: 34 GB
FP16: 66 GB
Apache 2.0
Qwen2.5-Coder 32B
CodingReasoningAgentsChat
32B
128K
Q4: 20 GB
Q8: 34 GB
FP16: 65 GB
Apache 2.0
33B
16K
Q4: 20.5 GB
Q8: 35 GB
FP16: 64 GB
DeepSeek License
Laguna XS 2.1
CodingAgentstool-useReasoninglong-context
33.4B
256K
Q4: 20 GB
Q8: n/a
FP16: n/a
OpenMDW-1.1
Qwen3.6 35B (A3B)
ChatReasoninglong-contextmultilingual
36B
256K
Q4: 24 GB
Q8: n/a
FP16: n/a
Apache 2.0
Ornith 1.5 35B (A3B)
CodingAgentsChatlong-context
36B
256K
Q4: 22 GB
Q8: n/a
FP16: n/a
MIT
Flint
CodingAgentstool-useReasoninglong-context
39.8B
256K
Q4: 22.9 GB
Q8: n/a
FP16: n/a
Apache 2.0
Phi-3.5 MoE
ChatReasoning
41.9B
128K
Q4: 25.5 GB
Q8: 44.5 GB
FP16: 80 GB
MIT
Mixtral 8x7B Instruct
ChatCodingReasoning
46.7B
32K
Q4: 28.5 GB
Q8: 50 GB
FP16: 91 GB
Apache 2.0
Llama 3 70B
ChatCodingRAGAgentsSummarisationReasoning
70B
8K
Q4: 41.5 GB
Q8: 74 GB
FP16: 140 GB
Llama 3 Community License
Llama 3.3 70B
ChatCodingRAGAgentsReasoningSummarisation
70B
128K
Q4: 41 GB
Q8: 72 GB
FP16: 142 GB
Llama 3.3 Community License
DeepSeek R1 Distill Llama 70B
Reasoningmath
70.6B
128K
Q4: 43 GB
Q8: 75 GB
FP16: n/a
MIT
Llama 3.1 70B Instruct
ChatReasoningSummarisation
70.6B
128K
Q4: 43 GB
Q8: 75 GB
FP16: n/a
Llama 3.1 Community License
Qwen2.5 72B
ChatCodingReasoningmultilingualAgents
72B
128K
Q4: 45 GB
Q8: 80 GB
FP16: 144 GB
Qwen License
Qwen2.5 Math 72B
mathReasoning
72.7B
4K
Q4: 44 GB
Q8: 77 GB
FP16: n/a
Qwen License
Llama 4 Scout
ChatCodingRAGAgentsReasoning
109B
10240K
Q4: 63 GB
Q8: n/a
FP16: n/a
Llama 4 Community License
Mistral Large 2
ChatReasoningCoding
123B
128K
Q4: 75 GB
Q8: 131 GB
FP16: n/a
Mistral Research License (non-commercial)
Mistral 8x22B Instruct
ChatReasoningCoding
141B
64K
Q4: 86 GB
Q8: 150 GB
FP16: n/a
Apache 2.0
Qwen3-235B-A22B
CodingReasoningRAGlong-context
235B
125K
Q4: 140 GB
Q8: 236 GB
FP16: n/a
Apache 2.0
Qwen3 235B A22B Thinking
ReasoningAgentslong-context
235B
256K
Q4: 143 GB
Q8: 250 GB
FP16: n/a
Apache 2.0
GLM-4.5
ChatCodingReasoning
355B
125K
Q4: 216 GB
Q8: 381 GB
FP16: n/a
MIT
405B
128K
Q4: 245 GB
Q8: 430 GB
FP16: n/a
Llama 3.1 Community License
DeepSeek V3
ChatReasoningCoding
671B
128K
Q4: 407 GB
Q8: 712 GB
FP16: n/a
DeepSeek License Agreement (model weights); MIT (code)
GLM-5.2
CodingAgentsReasoninglong-contexttool-use
753B
1024K
Q4: 466 GB
Q8: 801 GB
FP16: n/a
MIT
DeepSeek-V4-Pro
CodingReasoningAgentslong-context
1600B
977K
Q4: 900 GB
Q8: 1600 GB
FP16: n/a
MIT

Want a ranked shortlist for your specific hardware? The compatibility checker scores every model against your VRAM and RAM using the same engine that powers this table.

OpenSourcesAI tracks open-weight, open-source, local-capable, and hosted AI models. Use the filters to separate model families by openness, deployment fit, and primary workflow.