Mythorica-L3-8B
Property | Value |
---|---|
Parameter Count | 8.03B |
Model Type | Language Model (LLaMA Architecture) |
License | LLaMA 3 |
Tensor Type | BFloat16 |
Merge Method | DARE-TIES |
What is Mythorica-L3-8B?
Mythorica-L3-8B is a specialized language model designed for creative writing and roleplaying scenarios. Created through a sophisticated merge of three foundational models using the DARE-TIES methodology, it combines the strengths of Hathor_Tahsin (50%), LexiMaid (30%), and Chara (20%) to create a unique model optimized for narrative generation and character interactions.
Implementation Details
The model employs a novel merging approach utilizing both DARE (Dense/Sparse Approximation of Representations) and TIES architectures. It's implemented with BFloat16 precision and includes specific density configurations for each base model (0.8, 0.7, and 0.75 respectively) to optimize performance and capability retention.
- Merged using mergekit framework with int8 masking
- Weighted contribution system for balanced capabilities
- Optimized for both dense and sparse knowledge retention
Core Capabilities
- Advanced storytelling and narrative generation
- Character-focused dialogue creation
- Immersive world-building
- Creative writing assistance
- Role-playing scenario generation
Frequently Asked Questions
Q: What makes this model unique?
The model's distinctive feature is its specialized merge configuration using DARE-TIES, which preserves the storytelling capabilities of multiple models while maintaining coherent output. The weighted combination of three different models provides a balance between creative writing, character interaction, and narrative consistency.
Q: What are the recommended use cases?
This model is particularly suited for creative writing projects, role-playing scenarios, character development, and interactive storytelling applications. It excels in generating detailed narratives and maintaining consistent character voices throughout extended interactions.