Hermes-2-Mixtral-8x7B DPO & SFT: New Crown of Open Source LLMs

Nous Research has unveiled its latest achievement in the realm of artificial intelligence, the Hermes-2-Mixtral-8x7B. This large language model (LLM) represents a significant step forward in AI capabilities, pushing the boundaries of what's possible in natural language processing. In this deep dive, we will explore the technical details and benchmark data that set the Hermes-2-Mixtral-8x7B apart.

Article Summary

• The Hermes-2-Mixtral-8x7B, developed by Nous Research, is a groundbreaking large language model, excelling in various benchmarks with its dual variants, SFT and DPO, optimized for supervised fine-tuning and data parallelism, respectively.
• Featuring state-of-the-art performance on tasks like GPT4All, AGIEval, and BigBench, the model achieves an impressive average accuracy, particularly notable in the ARC Challenge with a score of 75.70%.
• The model introduces the advanced ChatML prompt format for enhanced multi-turn dialogues, along with quantized versions for varied computational environments, demonstrating Nous Research's commitment to innovation in AI technology.

Overview of Hermes-2-Mixtral-8x7B

The Hermes-2-Mixtral-8x7B is built on an expansive training dataset, primarily comprising over 1,000,000 entries generated by GPT-4, supplemented with high-quality data from various open datasets. It is available in two distinct variants:

• SFT (Supervised Finetune Only): Specialized for supervised fine-tuning applications.
• DPO (Data Parallelism Only): Focuses on optimizing data parallelism for enhanced performance.

How to Try Hermes-2-Mixtral-8x7B Online

Experience the future of conversation with Anakin AI's premiere chatbots: the Hermes-2-Mixtral-8x7B SFT and Hermes-2-Mixtral-8x7B DPO. These advanced AI chatbots are designed to cater to your specific interaction needs with unparalleled expertise and efficiency.

Whether you require the highly specialized knowledge of the SFT model or the rapid, wide-reaching capabilities of the DPO model, Anakin AI provides a seamless and sophisticated user experience.

• Test the expert knowledge and precision of the Hermes-2-Mixtral-8x7B SFT here, perfect for in-depth conversations on complex subjects.

Hermes-2-Mixtral-8x7B SFT | Online Chatbot | Anakin.ai

Test out the power of Open Source LLMs with this Online Chatbot!

Anakin.aiSam Altwoman0

• Experience the swift and scalable responses of the Hermes-2-Mixtral-8x7B DPO here, ideal for handling high volumes of queries with ease.

Hermes-2-Mixtral-8x7B DPO | Online Chatbot | Anakin.ai

Want to test out the latest features of Hermes-2-Mixtral-8x7B DPO? Try this Online Chatbot!

Anakin.aiSam Altwoman0

Dive into the future of digital communication and let these chatbots demonstrate the power of AI-driven interaction. Visit Anakin AI online now to engage with Hermes-2-Mixtral-8x7B SFT and DPO — your gateway to intelligent conversation.

Benchmarking Hermes-2-Mixtral-8x7B: How Good Is It?

GPT4All Benchmark

The GPT4All benchmark is a comprehensive test of language models' performance across various tasks. The Hermes-2-Mixtral-8x7B has demonstrated exceptional results in this benchmark, surpassing many of its predecessors and competitors.

Benchmark Results

The following table presents the detailed performance metrics of Hermes-2-Mixtral-8x7B in the GPT4All benchmark:

Average Accuracy: 75.70%

AGIEval Benchmark for Hermes-2-Mixtral-8x7B

The AGIEval benchmark evaluates the model's performance in tasks requiring advanced general intelligence capabilities.

For the AGIEval benchmark, here's how the Hermes-2-Mixtral-8x7B scored:

Average Accuracy: 46.05%

This section of the article provides a technical and detailed overview of the Hermes-2-Mixtral-8x7B model, focusing on its architecture, variants, and performance in key benchmarks. The use of tables helps in presenting the benchmark data clearly, aiding in the comprehension of the model's capabilities. Continue the article by expanding on other benchmarks, features, and comparisons to other models

BigBench Benchmark for Hermes-2-Mixtral-8x7B

The BigBench benchmark tests the model's abilities in a wide array of tasks, emphasizing reasoning, understanding, and problem-solving skills.

Benchmark Results

Below is a detailed breakdown of Hermes-2-Mixtral-8x7B's performance in the BigBench benchmark:

Average Score: 49.70%

Advanced Features and Compatibility

ChatML Prompt Format

Hermes-2-Mixtral-8x7B utilizes the innovative ChatML prompt format, enhancing the structure and versatility of multi-turn chat dialogues. This format:

• Enables precise control over the conversation flow.
• Supports system prompts for guided interactions.
• Is compatible with OpenAI's API, offering familiarity for those who have used ChatGPT.

Quantization and Accessibility

To accommodate various computational environments, Hermes-2-Mixtral-8x7B offers quantized versions, ensuring efficient performance across different setups:

• SFT+DPO Version: Link
• SFT Only Version: Link

Various quantizations by TheBloke are also available, catering to diverse needs.

How to Run and Use Hermes-2-Mixtral-8x7B Locally

Method 1. run Hermes-2-Mixtral-8x7B using Hugging Face Transformers

Hermes-2-Mixtral-8x7B is not just a theoretical marvel but also a practical tool. Here's an example of how one can utilize the model using HuggingFace Transformers:

import torch
from transformers import LlamaTokenizer, MixtralForCausalLM

tokenizer = LlamaTokenizer.from_pretrained('NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO', trust_remote_code=True)
model = MixtralForCausalLM.from_pretrained(
    "NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO",
    torch_dtype=torch.float16,
    device_map="auto",
    load_in_8bit=False,
    load_in_4bit=True,
    use_flash_attention_2=True
)

prompt = "system\nYou are Hermes 2, a superintelligent AI.\nuser\nTell me about quantum mechanics."
input_ids = tokenizer(prompt, return_tensors="pt").input_ids.to("cuda")


generated_ids = model.generate(input_ids, max_new_tokens=100)
response = tokenizer.decode(generated_ids[0], skip_special_tokens=True)
print(response)

This example demonstrates the ease of integrating Hermes-2-Mixtral-8x7B into various AI and data processing tasks, making it a versatile tool for professionals across sectors.

Method 2. Hermes-2-Mixtral-8x7B Using WasmEdge

Alternatively, you can also run Hermes-2-Mixtral-8x7B with WasmEdge. To run the model on your device, follow these steps:

Install WasmEdge: Use the command below to install WasmEdge along with the required plugin:

curl -sSf https://raw.githubusercontent.com/WasmEdge/WasmEdge/master/utils/install.sh | bash -s -- --plugin wasi_nn-ggml

Download the Nous-Hermes-2-Mixtral-8x7B Model: Retrieve the GGUF file of the model, which is several GBs in size, using this command:

curl -LO https://huggingface.co/second-state/Nous-Hermes-2-Mixtral-8x7B-SFT-GGUF/resolve/main/Nous-Hermes-2-Mixtral-8x7B-SFT-Q5_K_M.gguf

Download the Chat Application Wasm File: This cross-platform portable Wasm file allows you to interact with the model via command line. The Rust source code for the app is available here. Download the file using:

curl -LO https://github.com/second-state/LlamaEdge/releases/latest/download/llama-chat.wasm

To start chatting with the model in your terminal, simply input the following command:

wasmedge --dir .:. --nn-preload default:GGML:AUTO:Nous-Hermes-2-Mixtral-8x7B-SFT-Q5_K_M.gguf llama-chat.wasm -p chatml

Conclusion

Nous Research's Hermes-2-Mixtral-8x7B stands as a landmark achievement in the field of AI and natural language processing. With its state-of-the-art performance, innovative features, and user-friendly design, it represents the next leap forward in the capabilities of language models. Whether for academic research, business analytics, or creative endeavors, Hermes-2-Mixtral-8x7B is poised to revolutionize how we interact with and leverage AI technology.