Community Articles

via Decrypt · By Decrypt Editorial

China's Xiaomi MiMo Is Now 15X Faster Than ChatGPT and Claude

DE
Decrypt Editorial
(08:57 PM UTC)
1 min read
JM
Reviewed byJames Mitchell

In brief

  • Xiaomi and inference partner TileRT have broken 1,000 tokens per second on a 1-trillion-parameter model, a first at that scale, using a standard 8-GPU commodity node—not custom chips.
  • The speed comes from FP4 quantization on the model's expert layers and DFlash speculative decoding, which proposes a full block of tokens in one pass instead of one at a time.
  • A limited API trial opens June…

Add COINOTAG as a Preferred Source

Add COINOTAG to your preferred sources in Google News and Search to see our coverage first.

Add on Google

Source

Decrypt Editorial · Decrypt

Read original →

Comments
Comments
Other Community Articles