YankaGPT-8B-v0.1
| Property | Value |
|---|---|
| Model Size | 8B parameters |
| Base Model | YandexGPT5-lite |
| Format | GGUF |
| Training Dataset | ~210MB high-quality RP data |
| Model URL | Hugging Face |
What is YankaGPT-8B-v0.1?
YankaGPT-8B-v0.1 is a specialized language model fine-tuned from YandexGPT5-lite, specifically designed for roleplay (RP) and creative writing in Russian. The model leverages a carefully curated dataset of approximately 210 megabytes, featuring high-quality translations of RP content from advanced models like Claude 3.5.
Implementation Details
The model implements a straightforward fine-tuning approach without RLHF or DPO techniques. It uses the ChatML format and requires specific configurations for optimal performance.
- Temperature: 0.8
- Top-p: 0.9
- DRY multiplier: 0.4~0.6
- System prompts should be in English for better integration with existing character cards
Core Capabilities
- Creative writing and storytelling in Russian
- Role-playing interactions with defined characters
- Unique content generation
- Character-based dialogue management
Frequently Asked Questions
Q: What makes this model unique?
The model's specialization in Russian-language creative writing and roleplay, combined with its high-quality training dataset derived from top-tier language models, makes it particularly suited for creative applications and character interactions.
Q: What are the recommended use cases?
YankaGPT is ideal for creative experiments, role-playing interactions, and generating unique content in Russian. It's particularly effective when used with English system prompts and character cards for optimal performance.
