Noromaid-13B-v0.3-GGUF
| Property | Value |
|---|---|
| Parameter Count | 13B |
| Model Type | LLaMA-based |
| License | cc-by-nc-4.0 |
| Quantization | GGUF format with multiple compression options |
What is Noromaid-13B-v0.3-GGUF?
Noromaid-13B-v0.3-GGUF is a specialized language model created by IkariDev and Undi, optimized for roleplay (RP), erotic roleplay (ERP), and general text generation tasks. This GGUF version, quantized by TheBloke, offers various compression levels for efficient deployment across different hardware configurations.
Implementation Details
The model utilizes the Alpaca instruction format and incorporates multiple specialized datasets, including the no_robots dataset for enhanced human-like behavior, private Aesir RP datasets, and Spicyboros 3.1. It's available in multiple GGUF quantizations ranging from 2-bit to 8-bit, allowing users to balance between model size and performance.
- Multiple quantization options (Q2_K through Q8_0)
- File sizes ranging from 5.43GB to 13.83GB
- Compatible with modern LLM frameworks including llama.cpp
Core Capabilities
- Specialized roleplay and creative writing generation
- General text completion and conversation
- Context window of 4096 tokens
- GPU-accelerated inference support
Frequently Asked Questions
Q: What makes this model unique?
This model combines specialized training data for roleplay with efficient GGUF quantization, making it particularly effective for creative writing while being deployable on various hardware configurations.
Q: What are the recommended use cases?
The model excels at roleplay, creative writing, and general text generation tasks. It's particularly suitable for users requiring local deployment with various hardware constraints due to its multiple quantization options.
