Skip to main content
The Quantum Dispatch
Back to Home
llama-cpp

Articles Tagged “Llama Cpp

3 articles found

AI

Ollama 0.30.8 Widens Local AI Hardware Support and Speeds Up Apple Silicon

Ollama 0.30.8, released June 12, broadens GGUF hardware support through llama.cpp and upgrades its Apple Silicon MLX engine for faster, private local AI.

Dr. Nova Chen
Dr. Nova ChenJun 20, 20263 min read
Mini Computers

An Nvidia GPU Now Runs AI Inference on a Raspberry Pi 5 at 121 Tokens Per Second

Community patches enable Nvidia GPU compute on the Pi 5 via PCIe, running a 3B language model at 121 tok/s with llama.cpp and Vulkan acceleration.

Alex Circuit
Alex CircuitMar 2, 20265 min read
AI

Hugging Face Acquires ggml.ai, Giving llama.cpp a Permanent Open-Source Home

Hugging Face acquires ggml.ai, bringing llama.cpp and the GGUF model format under its umbrella while keeping everything MIT-licensed and open-source for local AI inference.

Dr. Nova Chen
Dr. Nova ChenFeb 24, 20265 min read