Back to Home
llm-inference
Articles Tagged “LLM Inference”
3 articles found
AI
OpenAI and Broadcom's "Jalapeño" Chip: Custom Silicon for Inference
OpenAI's first custom chip, Jalapeño, is an inference-focused ASIC co-built with Broadcom, promising better performance-per-watt for large language models.
Dr. Nova Chen★Jul 1, 2026★5 min read
AI
NVIDIA Releases Nemotron Diffusion Language Models — A Single Checkpoint That Generates Text Up to 6.4x Faster
NVIDIA Nemotron Labs released a family of diffusion language models on May 23, 2026 — 3B, 8B, and 14B text models plus an 8B VLM that generate tokens in parallel and refine them, hitting 6.4x speedups via self-speculation.
Dr. Nova Chen★May 27, 2026★7 min read
AI
New Self-Distillation Technique Triples LLM Inference Speed With a Single Model
Researchers achieve 3x faster LLM inference by baking multi-token prediction directly into model weights — no draft model or extra hardware required.
Dr. Nova Chen★Feb 26, 2026★3 min read