Modified 2 August 2026

AI glossary

Q4

A 4-bit quantization — the most compressed variant. Gives the smallest file size and fits most GPUs. Quality loss is marginal for most tasks.

Related terms

• Quantization
• Q8
• VRAM