- Published on
OpenChat is an open-source language model based on a 7 billion parameter version of the transformer architecture.
It has been trained using a method called C-RLFT, which uses reinforcement learning to fine-tune the model on a mixed-quality dataset of instruction-oriented data.
The developers claim that OpenChat outperforms ChatGPT, even though it has fewer parameters, demonstrating the effectiveness of the training approach.
The model can be accessed through an OpenAI-compatible API and is designed to handle high-throughput traffic for deployment on consumer GPUs.
The developers have made the model and training code publicly available, and it is licensed under the Apache 2.0 license, meaning that commercial use is permitted.