How much VRAM to run Qwen3.6 27B?

About 20 GB atQ4_K_M with an 8K context — fits a RX 7900 XTX. Full breakdown below, or check your exact hardware.

Qwen3.6 27B VRAM by quantisation

QuantisationWeightsTotal (8K ctx)Fits on
Q4_K_M16.5 GB19.7 GBRX 7900 XTX, RTX 4090
Q5_K_M19.2 GB22.7 GBRX 7900 XTX, RTX 4090
Q6_K22.1 GB25.9 GBRTX 5090, Radeon AI PRO R9700
Q8_028.8 GB33.2 GBApple Silicon 48GB unified, RTX 6000 Ada
FP16 / BF1654.0 GB61.0 GBA100 80GB, RTX PRO 6000 Blackwell

Check your hardware

About Qwen3.6 27B

Qwen3.6 27B is Alibaba's 27B-parameter model released in April 2026, with a 256K-token context window. It uses a hybrid-attention design — only a fraction of its layers cache the full context, so long conversations cost far less VRAM than a classic dense model: its KV cache is about 0.5 GB at an 8K context, 8.6 GB at 128K, and 17.2 GB at the full 256K window (FP16 cache).

For most people Q4_K_M is the sweet spot — the most popular quality/size trade-off — while Q8 is near-lossless if you have the memory. Totals above include the KV cache and a realistic framework overhead, so they are what you should expect to see in practice rather than just the download size. Weight sizes are calibrated against real GGUF files — see themethodology.

Frequently asked questions

How much VRAM does Qwen3.6 27B need?

At Q4_K_M with an 8K context, Qwen3.6 27B needs about 20 GB (weights 16 GB + KV cache + overhead). The smallest common hardware that fits is a RX 7900 XTX.

Can an RTX 4090 (24GB) run Qwen3.6 27B?

Yes. An RTX 4090's 24 GB runs Qwen3.6 27B at Q5_K_M (about 23 GB at 8K context).

Can a Mac run Qwen3.6 27B?

Yes — Apple Silicon with 32 GB of unified memory or more (macOS lets the GPU use ~75% of it, ~24 GB) runs Qwen3.6 27B at Q4_K_M.

Related

VRAM calculator for any model ·Token counter

Last updated 2026-08-03. Architecture figures from the model's published config.json; see themethodology.