← All news

Hardware

Homelabber uses second-gen Optane memory sticks to run a 2.8-trillion-parameter AI model on CPU alone

A Reddit homelab user ran Moonshot AI’s 2.8-trillion-parameter Kimi K3 CPU-only on Optane PMem 200 at 0.85 tokens/s with a 1-bit quant.

Read the full story on Tom's Hardware.

Read at source (opens in a new tab)

Latest from Tom's Hardware

Latest digest

Week 44 EN

Open the digest

Sources

69 active sources

24 Turkish · 45 English

All sources