Mythalion 13B - Your Ultimate Chatbot Companion

Mythalion 13B is the culmination of cutting-edge AI technology, blending the power of Pygmalion-2 13B and Gryphe's MythoMax L2 13B models. This innovative chatbot is designed to engage, entertain, and assist users in various interactive scenarios. Whether you're looking for creative writing assistance or a fun chat companion, Mythalion 13B is here to deliver.

Model Details

Our Mythalion 13B is based on the Llama-2 architecture and represents a unique collaboration between PygmalionAI and Gryphe. By merging the capabilities of Pygmalion-2 13B with MythoMax L2 13B, we've created a versatile and powerful chatbot that excels in role-playing and casual conversation. According to feedback from our testers, Mythalion 13B shines particularly in RP (Role Play) and chat scenarios.

For the best results, we recommend following the recommended generation settings for SillyTavern, which can be found on our blogpost. This chatbot is available for both commercial and non-commercial use, in accordance with the Llama-2 license.

Prompting

Mythalion 13B can be prompted using two different formatting styles: Alpaca and Pygmalion/Metharme.

Alpaca Formatting:

Instruction:

Response:

Pygmalion/Metharme Formatting:

Enter RP mode. Pretend to be {{char}} whose persona follows:
{{persona}}

You shall reply to the user while staying in character and generate long responses.

For example:

Hello! {model's response goes here}

The model has been trained on prompts using three different roles, denoted by the following tokens: <instruction>, <user_input>, and <response>. These tokens can be used to create engaging and interactive conversations with Mythalion 13B.

Limitations and Biases

It's important to note that the primary use-case for Mythalion 13B is fictional writing and entertainment. While it excels in creative scenarios, it was not fine-tuned to be safe or completely harmless. The base model, as well as this fine-tuned version, have been trained on data that may contain profanity, lewd content, or offensive text. Therefore, outputs generated by Mythalion 13B might occasionally include socially unacceptable or undesirable text, even if the initial prompt does not contain any offensive elements. Additionally, the model's responses may sometimes be factually incorrect or misleading.

How to Use Mythalion 13B

Using Mythalion 13B is as simple as providing a prompt in either Alpaca or Pygmalion/Metharme formatting, and the chatbot will generate a response accordingly. Feel free to experiment, interact, and have fun with the chatbot's capabilities.

To get started, you can choose from various quantisation methods and download the corresponding GGUF files, as described in the "Provided Files" section above. Make sure you select the quantisation method that best suits your requirements and system capabilities.

Whether you're a writer seeking inspiration, an RP enthusiast, or simply looking for engaging conversation, Mythalion 13B is here to elevate your experience.

Compatibility

Mythalion 13B GGUF files are compatible with llama.cpp from August 27th onwards, as of commit d0cee0d36d5be95a0d9088b674dbb27354107221. They are also supported by various third-party UIs and libraries, as listed in the repository.

How to Download GGUF Files

You can download GGUF files through multiple methods, including clients/libraries like LM Studio, LoLLMS Web UI, Faraday.dev, and more. Additionally, manual downloaders can use the huggingface-hub Python library to download individual model files.

Detailed instructions on downloading and using GGUF files are provided in the repository.

How to Run Mythalion 13B

Depending on your needs and system capabilities, you can run Mythalion 13B using llama.cpp, text-generation-webui, or from Python code using the ctransformers library. The repository provides comprehensive guides and examples to help you get started with each method.

Conclusion

Thank you for choosing Mythalion 13B as your chatbot companion. Get ready to unleash your creativity, engage in captivating conversations, and enjoy the limitless possibilities of AI-powered interactions.