a trillion weights, mostly asleep

Most of the Model Never Wakes Up

LongCat-2.0 holds 1.6 trillion parameters and wakes 48 billion to answer any token. A sparse model is the admission, cast in silicon, that intelligence is mostly knowing which small part of yourself to wake, and that the deciding happens where you cannot watch.