The home for great developer writing.

We surface the best developer writing from thousands of independent blogs, updated daily.

TIL: What’s actually different about GGUF and ONNX?

· Anup · Sept. 8, 2026, 10:24 a.m.

Machine Learning ONNX GGUF Runtime Expectations

Summary

The blog post discusses the differences between GGUF and ONNX in terms of their contents, runtime expectations, and the complexities involved in choosing between the two formats.

Read full post on www.anup.io →

MORE POSTS LIKE THIS

How to Convert GGUF to MLX (and When You Should Not)

Muhammad · Sep 24, 2026

AI llm

Quantizing Ideogram 4.0 onto a 3090: an INT8 build that matches FP8 and a 4-bit GGUF that beats NF4

transformerlab · Jun 9, 2026

ml-research Quantization

Building a Production Multilingual PII Detection System in Rust with GLiNER2

Users Rust Lang · May 5, 2026

Machine Learning Software Architecture

Not One, Not Two, Not Even Three, but Four Ways to Run an ONNX AI Model on GPU with CUDA

Dragan Djuric · Nov 9, 2025

Clojure AI

Using ONNX to integrate local AI models into .NET

Christopher Lopes · Jun 3, 2024

Machine Learning C++

Language Models for Text Classification: From Bag-of-Words to Jev

Sebastian Raschka · Sep 29, 2026

Machine Learning Natural Language Processing

Discover more posts →

AUTHOR

Advertise

Sponsor diff.blog

Put your product in front of developers who read and write about their craft. One exclusive sponsor at a time.

Become a sponsor →