bartowski/Phi-3.1-mini-128k-instruct-GGUF-torrent
bartowski/Phi-3.1-mini-128k-instruct-GGUF · Hugging Face
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
| File Name | Size (GB) | Type | Author | Time |
|---|---|---|---|---|
| Phi-3.1-mini-128k-instruct-IQ2_M.gguf | 1.32 | LFS | Llamacpp quants | about 5 hours ago |
| Phi-3.1-mini-128k-instruct-IQ2_S.gguf | 1.22 | LFS | Llamacpp quants | about 5 hours ago |
| Phi-3.1-mini-128k-instruct-IQ2_XS.gguf | 1.15 | LFS | Llamacpp quants | about 5 hours ago |
| Phi-3.1-mini-128k-instruct-IQ3_M.gguf | 1.86 | LFS | Llamacpp quants | about 5 hours ago |
| Phi-3.1-mini-128k-instruct-IQ3_XS.gguf | 1.63 | LFS | Llamacpp quants | about 5 hours ago |
| Phi-3.1-mini-128k-instruct-IQ3_XXS.gguf | 1.51 | LFS | Llamacpp quants | about 5 hours ago |
| Phi-3.1-mini-128k-instruct-IQ4_XS.gguf | 2.06 | LFS | Llamacpp quants | about 5 hours ago |
| Phi-3.1-mini-128k-instruct-Q2_K.gguf | 1.42 | LFS | Llamacpp quants | about 5 hours ago |
| Phi-3.1-mini-128k-instruct-Q2_K_L.gguf | 1.51 | LFS | Llamacpp quants | about 5 hours ago |
| Phi-3.1-mini-128k-instruct-Q3_K_L.gguf | 2.09 | LFS | Llamacpp quants | about 5 hours ago |
| Phi-3.1-mini-128k-instruct-Q3_K_M.gguf | 1.96 | LFS | Llamacpp quants | about 5 hours ago |
| Phi-3.1-mini-128k-instruct-Q3_K_S.gguf | 1.68 | LFS | Llamacpp quants | about 5 hours ago |
| Phi-3.1-mini-128k-instruct-Q3_K_XL.gguf | 2.17 | LFS | Llamacpp quants | about 5 hours ago |
| Phi-3.1-mini-128k-instruct-Q4_K_L.gguf | 2.47 | LFS | Llamacpp quants | about 5 hours ago |
| Phi-3.1-mini-128k-instruct-Q4_K_M.gguf | 2.39 | LFS | Llamacpp quants | about 5 hours ago |
| Phi-3.1-mini-128k-instruct-Q4_K_S.gguf | 2.19 | LFS | Llamacpp quants | about 5 hours ago |
| Phi-3.1-mini-128k-instruct-Q5_K_L.gguf | 2.88 | LFS | Llamacpp quants | about 5 hours ago |
| Phi-3.1-mini-128k-instruct-Q5_K_M.gguf | 2.82 | LFS | Llamacpp quants | about 5 hours ago |
| Phi-3.1-mini-128k-instruct-Q5_K_S.gguf | 2.64 | LFS | Llamacpp quants | about 5 hours ago |
| Phi-3.1-mini-128k-instruct-Q6_K.gguf | 3.14 | LFS | Llamacpp quants | about 5 hours ago |
| Phi-3.1-mini-128k-instruct-Q6_K_L.gguf | 3.18 | LFS | Llamacpp quants | about 5 hours ago |
| Phi-3.1-mini-128k-instruct-Q8_0.gguf | 4.06 | LFS | Llamacpp quants | about 5 hours ago |
| Phi-3.1-mini-128k-instruct-f32.gguf | 15.3 | LFS | Llamacpp quants | about 5 hours ago |