largeApache 2.027.8B paramsOpen weights

Qwen3.8 27B

27.8B parameter open-weight model. The dense flagship of the Qwen3.8 generation — 27.8B parameters, 256K context, image input, Apache 2.0. Architecturally a hybrid rather than a plain GQA stack: config.json declares a full-attention layer every fourth block with linear-attention and gated-delta components between them, so ordinary KV-cache arithmetic does not transfer and no architectureNotes are published for this record. The Ollama library Q4_K_M is 18 GB, Q8_0 is 30 GB and BF16 is 56 GB; with the 1.5 GB runtime overhead this site grades against, Q4 asks 19.5 GB, so 20 GB is a tight fit and 24 GB clears it comfortably. Shares a parameter count and architecture string with Qwen3.6 27B and is a different checkpoint — do not read one record's measurements onto the other. No throughput measured on our rigs yet. An official FP8 checkpoint (Qwen/Qwen3.8-27B-FP8) exists for vLLM and SGLang serving, which is a server path, not a llama.cpp one. Figures verified against the Hugging Face model card, its config.json, and the Ollama library on 2026-08-19.

Alibaba · Qwen 3.8

Editorial review

Reviewed byOpenSourcesAI EditorialLast updatedJune 2026SourcesHuggingFace model card (Qwen/Qwen3.8-27B), official docs, OpenSourcesAI editorial review.

VRAM figures are empirical estimates. Actual usage varies by runtime, context length, and system configuration. Verify on your specific hardware before production use.

Will Qwen3.8 27B run on your machine?

Qwen3.8 27B is 27.8B parameters and needs 19.5 GB of VRAM at Q4_K_M18 GB of weights plus 1.5 GB of runtime overhead for the inference server itself.

VRAM by quantization

QuantizationWeightsNeeds (with overhead)Quality
Q4_K_M18 GB19.5 GBgood
Q8_030 GB31.5 GBhigh
FP1656 GB57.5 GBreference

Fit on common hardware at Q4_K_M

HardwareMemory the model can useSystem RAMVerdict
CPU OnlyNone (CPU only)16 GBToo large
RTX 4060 Laptop8 GB16 GBToo large
RTX 3060 (12GB)12 GB32 GBCPU offload
RTX 4060 Ti (16GB)16 GB32 GBCPU offload
RTX 309024 GB64 GBComfortable
Apple Silicon (Unified Memory) 36 GB27 GB of 36 GB36 GBComfortable
RTX 509032 GB64 GBComfortable

Comfortable means VRAM clears the requirement by 2 GB or more. Tight means it covers the requirement with no margin. CPU offload means the model does not fit in VRAM but system RAM is at least 1.6× the weights, so it will run at reduced speed — expect roughly 1–5 tokens per second. Figures are weights plus a fixed runtime overhead and exclude KV-cache growth, which scales with context length.

Apple Silicon shares one pool of memory between the system and the GPU, so a model cannot use all of it. These rows apply the same 75% usable fraction the Compatibility Checker uses, which is why a 36 GB Mac is graded on less than 36 GB.

Need more hardware for Qwen3.8 27B? Open the PC Builder for the 30B / 32B tier →