Articles Tagged “Local AI”
15 articles found
Ollama Raises $65M to Power Local Open-Source AI
Ollama closed a $65M Series B led by Theory Ventures on July 9, growing to 8.9M monthly developers and a presence in 85% of the Fortune 500.
Exo Labs' local.ai Helps You Run Frontier AI on Your Own Hardware
Exo Labs launched local.ai, a free platform that matches the best AI model to your own hardware and shows when running locally beats paying per API token.
Poolside's Laguna XS 2.1 Puts a Free Open-Weight Coding Model on Your Machine
Poolside released Laguna XS 2.1 on July 2, 2026 — a free, permissively licensed open-weight coding model that scores 70.9% on SWE-bench Verified and runs locally.
Ollama v0.31.1 Boosts Local AI Performance on Apple Silicon
Ollama v0.31.1 makes Gemma 4 about 90% faster on Apple Silicon via multi-token prediction, advancing local AI performance and privacy.
Ollama 0.30.8 Widens Local AI Hardware Support and Speeds Up Apple Silicon
Ollama 0.30.8, released June 12, broadens GGUF hardware support through llama.cpp and upgrades its Apple Silicon MLX engine for faster, private local AI.
DiffusionGemma Generates Text 4x Faster With Open Diffusion-Based Decoding
Google DeepMind released DiffusionGemma, an open 26B model that generates text via parallel diffusion decoding, reaching up to 2,000 tokens per second and running locally.
Gemma 4 QAT Lands in Ollama, Cutting Local AI Memory by ~72%
Quantization-aware-trained Gemma 4 weights are now runnable in Ollama, cutting VRAM roughly 72% so a 26B model fits on a 16GB laptop for self-hosted AI.
Cohere's North Mini Code Runs an Open Coding Agent on One GPU
Cohere's North Mini Code is a 30B open-weight coding model under Apache 2.0 that runs on a single H100, scoring 83.2% on SWE-Bench Verified with a 256K context.
Google's DiffusionGemma Brings 4x-Faster Text Diffusion to Local AI
Google DeepMind's DiffusionGemma is a 26B open-weight model that writes text in parallel — topping 1,000 tokens/sec and running locally in just 18GB of VRAM.
Holo3.1 Brings Fast, Private Computer-Use AI Agents to Your Own Machine
H Company's open-weight Holo3.1 agents automate desktop and mobile tasks locally, with sizes from 0.8B to 35B and quantized builds that run on consumer hardware.
ASUS Ascent QN10: First Snapdragon X2 Elite Mini PC Hits 80 TOPS
The ASUS Ascent QN10 is the first Snapdragon X2 Elite mini PC, packing an 18-core Oryon CPU and an 80 TOPS NPU for local AI in a 0.7-liter box.
Qwen3.6 Arrives on Ollama: Run a 35B Agentic Coding AI Locally With 256K Context
Alibaba's Qwen3.6 is now on Ollama — a 35B open-weight model with 256K context, vision support, and thinking preservation built for agentic coding workflows you can run on your own hardware.
Beelink's SER10 MAX Ships With AMD's Ryzen AI 9 HX 470 — Bringing Serious AI Compute to Your Desk
The Beelink SER10 MAX pairs AMD's latest Ryzen AI 9 HX 470 processor with a compact desktop form factor, targeting local AI inference and creative workloads.
Minix Unveils Six New Mini PCs With Up to 180 TOPS of AI Compute
From 36-watt office boxes to 180 TOPS AI workstations, Minix’s 2026 mini PC lineup spans every tier of the local AI computing spectrum.
Hugging Face Acquires ggml.ai, Giving llama.cpp a Permanent Open-Source Home
Hugging Face acquires ggml.ai, bringing llama.cpp and the GGUF model format under its umbrella while keeping everything MIT-licensed and open-source for local AI inference.