Articles Tagged “AI Inference”
5 articles found
Cerebras CS-4 Packs Three Wafer-Scale Chips in a Rack
The Cerebras CS-4 puts three WSE-3 Turbo wafers in one rack for 750 PFLOPS, and Cerebras clocks 4,400 tokens per second per user on GPT-OSS-120B.
Etched Raises $700M at a $21B AI Chip Valuation
Etched closed a $700M Series D led by Jane Street at a $21 billion valuation, doubling in just a month as inference chip orders pass $1 billion.
Fireworks AI Raises $1.5B for Faster Model Inference
Fireworks AI closed a $1.505 billion Series D at a $17.5 billion valuation, a 4.4x step-up in nine months, betting on production model inference.
Orange Pi's AI Station Packs a Huawei Ascend 310 With 96GB RAM and 176 TOPS Into a Single Board Computer
The Orange Pi AI Station pairs 10 dedicated AI cores with 16 CPU cores, up to 96GB LPDDR4X, and 256GB eMMC — delivering data-center-class AI inference on a 130mm board.
Inception Labs Launches Mercury 2 — The First Reasoning LLM Built on Diffusion Architecture
Mercury 2 processes tokens in parallel via iterative denoising, hitting 1,000 tokens per second while matching top reasoning models on benchmarks.