DBRX
Databricks released the 文本 model · Launched on 2024-03
Open Source
文本
开源
API 可用
模型简介
DBRX is an open-source MoE model launched by data platform giant Databricks, adopting a fine-grained expert mixture architecture. It performs excellently in programming, mathematics, and general reasoning, achieving 73.7% accuracy on MMLU. DBRX is a representative work trained by Databricks with an investment of $10 million, showcasing the strength of enterprise-level platforms in the large model field.
核心特性
- 细粒度 MoE 架构
- 132B 总参数
- 36B 活跃参数
- 编程能力强
核心优势
- MoE 架构创新
- 企业级质量
- 开源可商用
技术规格
参数量
132B (36B 激活)
上下文窗口
32K tokens
API 支持
Yes
开源状态
Open Source
发布日期
2024-03
提供商
Databricks
价格信息
免费开源
基准测试
MMLU 73.7%, HumanEval 70.1%, 企业级开源模型标杆