Highly efficient mixture-of-expert (MoE) model from Alibaba
Qwen1.5-MoE-A2.7B is a small mixture-of-expert (MoE) model with only 2.7 billion activated parameters yet matches the performance of state-of-the-art 7B models like Mistral 7B and Qwen1.5-7B.
| Тип | Модель |
| Категория | LLMs |
| Цена | открытый код |
| Системы | Web |
| Язык сайта | en |
| Рейтинг | 5.00 (2 отзывов) |
| Запуск | 2024-04-02 |