- Published on
Databricks has unveiled DBRX, a new open-source LLM.
DBRX outperforms established open models like GPT-3.5 and Grok-1 on a range of benchmarks, including language understanding, programming, and math tasks.
The model uses a fine-grained mixture-of-experts architecture, which Databricks claims provides efficiency improvements in both training and inference.
DBRX Instruct even surpasses specialised coding models like CodeLLaMA-70B on programming tasks.