Articles Tagged “Apple Silicon”
10 articles found

Mac Studio M5 Ultra vs DGX Spark: Local AI Speed Tested
In Tom's Hardware tests, the M5 Ultra Mac Studio finished an agentic AI benchmark in under half a DGX Spark's time using 16% less energy. Full breakdown.

Ollama Text-to-Speech: How to Run Phonon Voices on a Mac
Ollama 0.40.11 adds local text-to-speech with Gradium's 31M-parameter Phonon model, running 35% faster than Gradium's own runtime on an M5 Max MacBook Pro.

Muse Spark Open: Running Meta's 816B Model on Mac Studio
Muse Spark Open puts Meta's 816B-parameter flagship in open weights, with a 1M-token context and a path to run it on two 512GB M5 Ultra Mac Studios.

Google AI Edge Foresight: Offline Meeting Notes on a Mac
Google AI Edge Foresight is a Mac app that takes meeting notes fully offline, pairing the 740M-parameter EmbeddingGemma 2 with a Gemma 4 assistant.

Run Local LLMs on a Mac: MLX and oMLX Step-by-Step Guide
A step-by-step guide to running local LLMs on Apple Silicon with mlx-lm and oMLX: install, chat, 4-bit quantize and serve an API on port 8000.

Asahi Linux Adds Official Apple M3 Support at Last
Asahi Linux now installs on M3, M3 Pro and M3 Max Macs, with Wi-Fi, webcam, USB and AV1 decode all working. The GPU and sleep are still to come.

On-Device Piano Model Autocompletes Music on iPhone
A 125M-parameter transformer generates about 108 piano notes per second on an iPhone 15, trained on 300 million note events with no cloud call.
PyTorch 2.13 Brings FlexAttention to Apple Silicon
PyTorch 2.13 landed July 8 with FlexAttention on Apple Silicon — up to 12x faster attention on Mac GPUs and 4x lower memory for LM training.
Gemma 4 Runs 90% Faster on Apple Silicon in Ollama
Ollama v0.32.0 makes Google's Gemma 4 nearly 90% faster on Apple Silicon via multi-token prediction — local AI on a laptop just got a lot snappier.
Ollama v0.31.1 Boosts Local AI Performance on Apple Silicon
Ollama v0.31.1 makes Gemma 4 about 90% faster on Apple Silicon via multi-token prediction, advancing local AI performance and privacy.
