How much VRAM to run DeepSeek V4 Flash?

About 192 GB atQ4_K_M with an 8K context — fits a Apple Silicon 512GB unified. Full breakdown below, or check your exact hardware.

DeepSeek V4 Flash VRAM by quantisation

QuantisationWeightsTotal (8K ctx)Fits on
Q4_K_M173.2 GB192.0 GBApple Silicon 512GB unified
Q5_K_M202.2 GB223.9 GBApple Silicon 512GB unified
Q6_K232.9 GB257.6 GBApple Silicon 512GB unified
Q8_0302.5 GB334.2 GBApple Silicon 512GB unified
FP16 / BF16568.0 GB626.2 GBmulti-GPU / datacenter only

Check your hardware

About DeepSeek V4 Flash

DeepSeek V4 Flash is DeepSeek's 284B-parameter model released in April 2026, with a 1024K-token context window. It is a mixture-of-experts model: all 284B parameters must sit in memory, but only ~13B are active per token, which is what makes it fast for its size. It uses a latent-attention (MLA) design that compresses its KV cache, keeping even very long contexts cheap in memory: its KV cache is about 0.4 GB at an 8K context, 6.5 GB at 128K, and 51.9 GB at the full 1024K window (FP16 cache).

For most people Q4_K_M is the sweet spot — the most popular quality/size trade-off — while Q8 is near-lossless if you have the memory. Totals above include the KV cache and a realistic framework overhead, so they are what you should expect to see in practice rather than just the download size. Weight sizes are calibrated against real GGUF files — see themethodology.

Frequently asked questions

How much VRAM does DeepSeek V4 Flash need?

At Q4_K_M with an 8K context, DeepSeek V4 Flash needs about 192 GB (weights 173 GB + KV cache + overhead). The smallest common hardware that fits is a Apple Silicon 512GB unified.

Can an RTX 4090 (24GB) run DeepSeek V4 Flash?

Not fully in VRAM. DeepSeek V4 Flash needs about 192 GB even at Q4_K_M, so a 24 GB card would have to offload layers to system RAM at a large speed penalty.

Can a Mac run DeepSeek V4 Flash?

Yes — Apple Silicon with 512 GB of unified memory or more (macOS lets the GPU use ~75% of it, ~384 GB) runs DeepSeek V4 Flash at Q4_K_M.

Related

VRAM calculator for any model ·Token counter · DeepSeek V4 Flash API pricing

Last updated 2026-08-03. Architecture figures from the model's published config.json; see themethodology.