Gaussian distributed weights for LLMs

1 · John Cook · April 18, 2026, 3:01 p.m.
AI Number systems Machine Learning Quantization Data Types LLMs
Summary
This blog post discusses different 4-bit floating point formats for machine learning model weights, specifically NF4 and FP4, and their relevance to downloading quantized weights from Hugging Face.
Read full post on www.johndcook.com →
AUTHOR