Ternary Bonsai 2 27B
26.9B parameter open-weight model. A ternary re-training of Qwen3.8-27B by PrismML: every language weight is -1, 0 or +1 with FP16 scales per group of 128 (embeddings, attention, MLP and the output head), on the base model's hybrid-attention architecture (about 75% linear attention), with a 262,144-token context and an optional vision projector (model card read 2026-10-23). 26.9B parameters in the GGUF metadata; the card's 27.36B adds the 0.46B vision tower. Apache 2.0. The vendor publishes only packed GGUF and MLX releases, so the GGUF repository is the release itself, not a re-upload. Two packings: PTQ1_0 (1.75 bits per weight, 5.95 GB) and PQ2_0 (2.13 bits per weight, 7.21 GB). Neither is a Q4_K_M: the figure here is the PTQ1_0 file. Both need PrismML's llama.cpp fork (github.com/PrismML-Eng/llama.cpp); stock Ollama, LM Studio and upstream llama.cpp do not read them, so no Ollama library tag exists (registry checked 2026-10-23) and the Checker does not list it. Measured on this project's own hardware with the fork at its pinned release tag prism-b10777-e3de715, an RTX 3080 (10 GB) with nothing else on the card: entirely in VRAM, PTQ1_0 generated 78.4 tok/s and used 6.75 GB at a 4,096 context and 8.57 GB at 32,768; PQ2_0 generated 66.8 tok/s and used 7.90 GB and 9.72 GB; prompt processing ran at about 1,290 tok/s for both, and both answered a short reasoning prompt and a coding task correctly (2026-10-23, docs/lab/radar-2026-10-23-model-validation.md). Plan around 7 GB of free VRAM for PTQ1_0 at a short context.
PrismML · Bonsai 2
Model overview
Ternary Bonsai 2 27B is PrismML's ternary version of Qwen3.8 27B: a 27B reasoning model whose weights are stored as -1, 0 or +1, which shrinks it to about 6 GB. That lets a 27B-class model run entirely on an 8 to 10 GB graphics card, where an ordinary 27B at Q4_K_M needs about 18 GB and crawls on a smaller card. This project measured 78 tokens a second on a 10 GB card. The catch is the runtime: it needs PrismML's own llama.cpp fork, so it does not run in Ollama or LM Studio yet.
Editorial review
VRAM figures are empirical estimates. Actual usage varies by runtime, context length, and system configuration. Verify on your specific hardware before production use.
Will Ternary Bonsai 2 27B run on your machine?
Ternary Bonsai 2 27B is 26.9B parameters and needs 7.4 GB of VRAM at PTQ1_0 (ternary): 5.9 GB of weights plus 1.5 GB of runtime overhead for the inference server itself.
VRAM by quantization
| Quantization | Weights | Needs (with overhead) | Quality |
|---|---|---|---|
| PTQ1_0 (ternary) | 5.9 GB | 7.4 GB | good |
Fit on common hardware at PTQ1_0 (ternary)
| Hardware | Memory the model can use | System RAM | Verdict |
|---|---|---|---|
| CPU Only | None (CPU only) | 16 GB | CPU offload |
| RTX 4060 Laptop | 8 GB | 16 GB | Tight |
| RTX 3060 (12GB) | 12 GB | 32 GB | Comfortable |
| RTX 4060 Ti (16GB) | 16 GB | 32 GB | Comfortable |
| RTX 3090 | 24 GB | 64 GB | Comfortable |
Comfortable means VRAM clears the requirement by 2 GB or more. Tight means it covers the requirement with no margin. CPU offload means the model does not fit in VRAM but system RAM is at least 1.6× the weights, so it will run at reduced speed: expect roughly 1–5 tokens per second. Figures are weights plus a fixed runtime overhead and exclude KV-cache growth, which scales with context length.
Want a broader hardware plan around Ternary Bonsai 2 27B? Open the PC Builder for the whole 30B / 32B class → The Builder plans across that class; it does not replace the exact-model fit verdict above.
This catalog has no verified local Ollama tag for this checkpoint, so fit grades do not include a local run command.
Ready to run this model locally?
Find a compatible interface in our Local AI Tools directory →