bartowski/Crimson_Dawn-v0.2-GGUF-torrent
bartowski/Crimson_Dawn-v0.2-GGUF · Hugging Face
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
| Filename | Quant Type | File Size | Split | Description |
|---|---|---|---|---|
| Crimson_Dawn-v0.2-Q6_K_L.gguf | Q6_K_L | 10.38GB | False | Uses Q8_0 for embed and output weights. Very high quality, near perfect, recommended. |
| Crimson_Dawn-v0.2-Q6_K.gguf | Q6_K | 10.06GB | False | Very high quality, near perfect, recommended. |
| Crimson_Dawn-v0.2-Q5_K_L.gguf | Q5_K_L | 9.14GB | False | Uses Q8_0 for embed and output weights. High quality, recommended. |
| Crimson_Dawn-v0.2-Q5_K_M.gguf | Q5_K_M | 8.73GB | False | High quality, recommended. |
| Crimson_Dawn-v0.2-Q4_K_M.gguf | Q4_K_M | 7.48GB | False | Good quality, default size for most use cases, recommended. |
| Crimson_Dawn-v0.2-IQ4_XS.gguf | IQ4_XS | 6.74GB | False | Decent quality, smaller than Q4_K_S with similar performance, recommended. |
| Crimson_Dawn-v0.2-Q3_K_L.gguf | Q3_K_L | 6.56GB | False | Lower quality but usable, good for low RAM availability. |
| Crimson_Dawn-v0.2-Q3_K_M.gguf | Q3_K_M | 6.08GB | False | Low quality. |
| Crimson_Dawn-v0.2-IQ3_M.gguf | IQ3_M | 5.72GB | False | Medium-low quality, new method with decent performance comparable to Q3_K_M. |
Recommendations:
- For most users, Q6_K_L or Q6_K would be the best choice for the highest quality.
- If you need to save space, Q5_K_L or Q5_K_M are good alternatives.
- For low RAM availability, Q4_K_M or IQ4_XS are recommended.
- Avoid Q3_K_M and lower, as they offer lower quality.