Nous: Hermes 2 Mistral 7B DPO

This is the flagship 7B Hermes model, a Direct Preference Optimization (DPO) of Teknium/OpenHermes-2.5-Mistral-7B. It shows improvement across the board on all benchmarks tested - AGIEval, BigBench Reasoning, GPT4All, and TruthfulQA. The model prior to DPO was trained on 1,000,000 instructions/chats of GPT-4 quality or better, primarily synthetic data as well as other high quality datasets.

Hermes 2 Mistral 7B DPO has a 8,192 token context window.

Hermes 4 70B, Hermes 4 405B, Hermes 3 70B Instruct and 1 more are other text models from Nous Research.

Hermes 2 Mistral 7B DPO was released on February 21, 2024. Its knowledge cutoff is September 30, 2023.