- Published on
Nous Research has unveiled Hermes 3, a new series of open language models designed for enhanced personalisation and adaptability. The models are available in 8B, 70B, and 405B parameter versions.
Built by fine-tuning Llama 3.1, Hermes 3 offers improved reasoning capabilities and creative expression compared to previous versions. The 405B variant achieves state-of-the-art results among open models on several evaluations.
Key features include a 128K token context window, advanced long-term memory retention, complex roleplaying abilities, and enhanced agentic function-calling. The models are trained on approximately 390 million tokens across diverse domains including general instructions, expert knowledge, mathematics, coding and tool use.
A notable characteristic is the models' high steerability through system prompts, particularly in the 405B version which can exhibit unique behaviours like "Amnesia Mode" when given blank system prompts.
The models are available on Hugging Face under an open license. Nous Research emphasises Hermes 3's neutral alignment and flexibility compared to more restricted commercial models.