Mamba-3B-SlimPJ opens a state-space language model

Dec 14, 2023

Researchers release 2.8-billion-parameter model weights trained on SlimPajama under Apache 2.0.

Open weights let developers explore a state-space alternative to Transformer language models.

Sources