DIFF.BLOG
New Following Discover Jobs
More
Top Writers Suggest a blog Upvotes plugin
Report bug Contact About Privacy
Sign up
Topics
Follow your own topics →
Menu
New Following Discover Jobs Top Writers
More
Suggest a blog Upvotes plugin Report bug Contact About
Sign up
Privacy Policy
The home for great developer writing.
We surface the best developer writing from thousands of independent blogs, updated daily.
Join Diff.blog
TOPICS

Accelerating LLMs on Debian 13: Setting up CUDA for llama.cpp

· özkan pakdil · March 20, 2026, 2:04 a.m.
CUDA GPGPU large language models Performance Optimization
Summary
This blog post provides a detailed guide on setting up NVIDIA CUDA on Debian 13 to enhance the performance of Large Language Models (LLMs) using llama.cpp, sharing personal experiences and insights from the author's journey.
Read full post on ozkanpakdil.github.io →
MORE POSTS LIKE THIS
Accelerating LLMs on Debian 13: Setting up Vulkan for llama.cpp
özkan pakdil · Mar 22, 2026
CUDA Vulkan
Making CUDA Checkpointing 15x Faster on a B300: A Worklog
Henry Zhu · Oct 29, 2026
CUDA Performance Optimization
Restore LLM Inference Capacity in Seconds with Shadow Engine Recovery in NVIDIA Dynamo
NVIDIA Corporation · Aug 25, 2026
Agentic AI / Generative AI Data Science
Atom #hdxty3k
Brandur Leach · Aug 11, 2026
user-experience software development
Getting Fortran running on GPU's natively
Fortran Lang Discourse · Jul 28, 2026
CUDA NVIDIA
Benchmarking Qwen 3.6 35B MoE (3B active) on an RTX 3090
gpjt · Jul 24, 2026
neural networks CUDA
Discover more posts →
AUTHOR
RECENT POSTS FROM THE AUTHOR
Choose how you want to continue.
Continue with GitHub Continue with Google
By continuing, you agree to our Privacy Policy.