DeepSeek-MoE
DeepSeekMoE 16B, utilizing a Mixture-of-Experts architecture, enhances computational efficiency with a reduction to 40% of operations. Matching the performance of models like LLaMA2 7B, its Base and Chat versions support English and Chinese, enabling deployment on a single GPU without quantization. Available under specific licensing for research and commercial applications.
