Tess-M-Creative-v1.0-GPTQ
Property | Value |
---|---|
Parameter Count | 5.11B |
Base Model | Yi-34B-200K |
License | Yi-34B License |
Quantization | GPTQ (Multiple Options) |
What is Tess-M-Creative-v1.0-GPTQ?
Tess-M-Creative-v1.0-GPTQ is a quantized version of the Tess language model series, specifically optimized for creative tasks. This model represents a careful balance between performance and efficiency, offering multiple quantization options to suit different hardware configurations and use cases.
Implementation Details
The model is based on the Yi-34B-200K architecture and has been quantized using GPTQ technology, with various configurations available including 3-bit, 4-bit, and 8-bit options. It uses a specialized prompt template called Synthia-CoT that encourages structured thinking and detailed responses.
- Multiple GPTQ configurations available (3-bit to 8-bit)
- Context length of 8192 tokens
- Optimized for creative writing and roleplay
- Implements Tree of Thoughts reasoning
Core Capabilities
- Creative writing and storytelling
- Role-playing and character interaction
- Design concept exploration
- Novel idea generation
- Structured reasoning using Tree of Thoughts methodology
Frequently Asked Questions
Q: What makes this model unique?
This model specializes in creative tasks while offering multiple quantization options for different hardware setups. Its Tree of Thoughts reasoning approach allows for more structured and coherent creative output.
Q: What are the recommended use cases?
The model excels at creative writing, roleplay, design tasks, and exploring novel concepts. While it can handle STEM topics, it's optimized for creative rather than technical tasks.