Articles Tagged “Local LLM Hardware”
8 articles found
GEEKOM IT13 Max Linux Benchmarks on Ubuntu 26.04 LTS
The Core Ultra 9 185H mini PC posts 14,980 Geekbench multi-core on Ubuntu 26.04, with working USB4, dual 2.5GbE, and 8.6W idle draw at $735.
Sparse Mixture of Experts Explained for 2026 Models
Why a 2.4T-parameter model can be cheaper than a 70B one: what active parameters mean, how routing works, and what MoE really costs to self-host in 2026.
LLM Quantization Guide: GGUF vs AWQ vs MLX in 2026
A practical guide to LLM quantization formats — GGUF, AWQ, GPTQ and MLX — with VRAM math, quality trade-offs and picks for every kind of machine.
Best Mini PC for Local LLMs in 2026: A Buyer's Guide
A practical 2026 buyer's guide to the best mini PCs for running local LLMs, comparing unified memory, NPUs, and price so you can self-host with confidence.
Firefly's AIBOX-K3 Lands May 12 — A $349 RISC-V Edge AI Mini PC Running 30B Local LLMs at 60 TOPS
Firefly launched the AIBOX-K3 Edge AI mini PC on May 12, 2026 — a fanless desktop chassis pairing the SpacemiT K3 octa-core RISC-V SoC with 60 TOPS of AI compute, starting at $349.
Banana Pi's BPI-SM10 Brings 60 TOPS RISC-V AI to a Tiny SBC That Runs 30B Local LLMs
Banana Pi launched the BPI-SM10 developer kit and a K3 Pico-ITX SBC on April 24, 2026 — a SpacemiT K3 RISC-V platform with 60 TOPS, up to 32GB LPDDR5, and on-device 30B-parameter LLM inference.
AMD Ryzen 9 Home Lab AI: Geekom Mini PC AI A7 MAX Drops to an All-Time Low of $639
Geekom's AI A7 MAX packs AMD Ryzen 9 7940HS in a 4×4-inch chassis with 16GB DDR5, now at $639 — making local AI inferencing accessible for home lab builders.
Sipeed's llmdev.guide Benchmarks Every Mini PC for Local AI Performance
Sipeed launched an interactive hardware comparison tool on March 30 that visualizes tokens-per-second benchmarks across dozens of mini PCs, SBCs, and GPUs for local LLM deployment.