compactApache 2.01.8B paramsOpen weights

Hy-MT2 1.8B

1.8B parameter open-weight model. Dense 1.8B translation model from Tencent's Hy-MT2 line (HunYuanDenseV1ForCausalLM, 32 layers, grouped-query attention with 4 KV heads, 262,144-token context, config.json read 2026-10-16), trained to translate between 33 languages plus five Chinese dialect and minority-language pairs rather than to chat. Apache 2.0. Parameter count: Ollama and the vendor's GGUF report 1.8B; the Hugging Face API counts 2.04B for the safetensors checkpoint, and the difference is exactly the 120,818 x 2,048 tied embedding matrix counted once. No Ollama library tag exists (registry checked 2026-10-16); Tencent publishes Q4_K_M, Q6_K and Q8_0 GGUFs at tencent/Hy-MT2-1.8B-GGUF (checked 2026-10-16) for llama.cpp and LM Studio. Measured on this project's own hardware from an in-house Q4_K_M conversion: 1.3 GB resident at 100% GPU on an RTX 3080, 259 to 282 tok/s across four runs (2026-09-05, docs/lab/radar-2026-09-05-model-validation.md) and 223 to 233 tok/s on 2026-10-16 while another service held 3.9 GB of the card (docs/lab/radar-2026-10-09-model-validation.md). Translation was spot-checked, not evaluated: single sentences into French, Japanese, Spanish and German came back accurate and idiomatic.

Tencent · Hy MT2

Model overview

Hy-MT2 1.8B is Tencent's smallest dedicated translation model: a 1.8B dense transformer trained to translate between 33 languages, plus five Chinese dialect and minority-language pairs, rather than to chat. It is one of the lightest useful models in this catalog, running inside about 1.3 GB of VRAM at Q4_K_M at well over 200 tokens a second on a mid-range card, so it fits almost any GPU and leaves room for a larger general model beside it. Use it for translation only, and check terminology in specialist domains before trusting the output.

Editorial review

Reviewed byCJ ZwartLast updatedJune 2026SourcesHuggingFace model card (tencent/Hy-MT2-1.8B), official docs, OpenSourcesAI editorial review.

VRAM figures are empirical estimates. Actual usage varies by runtime, context length, and system configuration. Verify on your specific hardware before production use.

Will Hy-MT2 1.8B run on your machine?

Hy-MT2 1.8B is 1.8B parameters and needs 2.8 GB of VRAM at Q4_K_M: 1.3 GB of weights plus 1.5 GB of runtime overhead for the inference server itself.

VRAM by quantization

QuantizationWeightsNeeds (with overhead)Quality
Q4_K_M1.3 GB2.8 GBgood

Fit on common hardware at Q4_K_M

HardwareMemory the model can useSystem RAMVerdict
CPU OnlyNone (CPU only)16 GBCPU offload
RTX 4060 Laptop8 GB16 GBComfortable
RTX 3060 (12GB)12 GB32 GBComfortable
RTX 4060 Ti (16GB)16 GB32 GBComfortable

Comfortable means VRAM clears the requirement by 2 GB or more. Tight means it covers the requirement with no margin. CPU offload means the model does not fit in VRAM but system RAM is at least 1.6× the weights, so it will run at reduced speed: expect roughly 1–5 tokens per second. Figures are weights plus a fixed runtime overhead and exclude KV-cache growth, which scales with context length.

Want a broader hardware plan around Hy-MT2 1.8B? Open the PC Builder for the whole 1B–3B lightweight class → The Builder plans across that class; it does not replace the exact-model fit verdict above.

This catalog has no verified local Ollama tag for this checkpoint, so fit grades do not include a local run command.