May 6, 2024
DeepSeek introduces efficient mixture-of-experts and multi-head latent attention.
Downloadable model weights. License terms and commercial permissions vary by release; this is not a claim that the entire training stack is open.
Explore on Humanity Unfolds