Qwen3.6 27B
27.8B parameter open-weight model. The dense flagship of the Qwen3.6 generation - 27.8B parameters, 256K context, image input, Apache 2.0. The Ollama Q4_K_M is ~17 GB: treat a 24 GB card as the practical floor, because dense models pay the full split-mode cost - measured 3.1 tok/s on an RTX 3080 (10 GB) at 46% VRAM residency (2026-08-01). On hardware that fits it fully, this is the current Qwen quality pick.
Alibaba · Qwen 3.6
Editorial review
VRAM figures are empirical estimates. Actual usage varies by runtime, context length, and system configuration. Verify on your specific hardware before production use.
Will Qwen3.6 27B run on your machine?
Qwen3.6 27B is 27.8B parameters and needs 18.5 GB of VRAM at Q4_K_M — 17 GB of weights plus 1.5 GB of runtime overhead for the inference server itself.
VRAM by quantization
| Quantization | Weights | Needs (with overhead) | Quality |
|---|---|---|---|
| Q4_K_M | 17 GB | 18.5 GB | good |
Fit on common hardware at Q4_K_M
| Hardware | Memory the model can use | System RAM | Verdict |
|---|---|---|---|
| CPU Only | None (CPU only) | 16 GB | Too large |
| RTX 4060 Laptop | 8 GB | 16 GB | Too large |
| RTX 3060 (12GB) | 12 GB | 32 GB | CPU offload |
| RTX 4060 Ti (16GB) | 16 GB | 32 GB | CPU offload |
| RTX 3090 | 24 GB | 64 GB | Comfortable |
| Apple Silicon (Unified Memory) 36 GB | 27 GB of 36 GB | 36 GB | Comfortable |
| RTX 5090 | 32 GB | 64 GB | Comfortable |
Comfortable means VRAM clears the requirement by 2 GB or more. Tight means it covers the requirement with no margin. CPU offload means the model does not fit in VRAM but system RAM is at least 1.6× the weights, so it will run at reduced speed — expect roughly 1–5 tokens per second. Figures are weights plus a fixed runtime overhead and exclude KV-cache growth, which scales with context length.
Apple Silicon shares one pool of memory between the system and the GPU, so a model cannot use all of it. These rows apply the same 75% usable fraction the Compatibility Checker uses, which is why a 36 GB Mac is graded on less than 36 GB.
Ready to run this model locally?
Find a compatible interface in our Local AI Tools directory →