Mythorica-L3-8B

Maintained By
Arkana08

Mythorica-L3-8B

PropertyValue
Parameter Count8.03B
Model TypeLanguage Model (LLaMA Architecture)
LicenseLLaMA 3
Tensor TypeBFloat16
Merge MethodDARE-TIES

What is Mythorica-L3-8B?

Mythorica-L3-8B is a specialized language model designed for creative writing and roleplaying scenarios. Created through a sophisticated merge of three foundational models using the DARE-TIES methodology, it combines the strengths of Hathor_Tahsin (50%), LexiMaid (30%), and Chara (20%) to create a unique model optimized for narrative generation and character interactions.

Implementation Details

The model employs a novel merging approach utilizing both DARE (Dense/Sparse Approximation of Representations) and TIES architectures. It's implemented with BFloat16 precision and includes specific density configurations for each base model (0.8, 0.7, and 0.75 respectively) to optimize performance and capability retention.

  • Merged using mergekit framework with int8 masking
  • Weighted contribution system for balanced capabilities
  • Optimized for both dense and sparse knowledge retention

Core Capabilities

  • Advanced storytelling and narrative generation
  • Character-focused dialogue creation
  • Immersive world-building
  • Creative writing assistance
  • Role-playing scenario generation

Frequently Asked Questions

Q: What makes this model unique?

The model's distinctive feature is its specialized merge configuration using DARE-TIES, which preserves the storytelling capabilities of multiple models while maintaining coherent output. The weighted combination of three different models provides a balance between creative writing, character interaction, and narrative consistency.

Q: What are the recommended use cases?

This model is particularly suited for creative writing projects, role-playing scenarios, character development, and interactive storytelling applications. It excels in generating detailed narratives and maintaining consistent character voices throughout extended interactions.

The first platform built for prompt engineering