Hugging Face: Zephyr 7B

Zephyr is a series of language models that are trained to act as helpful assistants. Zephyr-7B-β is the second model in the series, and is a fine-tuned version of mistralai/Mistral-7B-v0.1 that was trained on a mix of publicly available, synthetic datasets using Direct Preference Optimization (DPO).

Zephyr 7B has a 4,096 token context window.

Zephyr 7B was released on August 2, 2023. Its knowledge cutoff is October 31, 2023.