bartowski/Phi-3.1-mini-4k-instruct-GGUF-torrent
bartowski/Phi-3.1-mini-4k-instruct-GGUF · Hugging Face
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
| File Name | Size |
|---|---|
| Phi-3.1-mini-4k-instruct-IQ2_M.gguf | 1.32 GB |
| Phi-3.1-mini-4k-instruct-IQ2_S.gguf | 1.22 GB |
| Phi-3.1-mini-4k-instruct-IQ2_XS.gguf | 1.15 GB |
| Phi-3.1-mini-4k-instruct-IQ3_M.gguf | 1.86 GB |
| Phi-3.1-mini-4k-instruct-IQ3_XS.gguf | 1.63 GB |
| Phi-3.1-mini-4k-instruct-IQ3_XXS.gguf | 1.51 GB |
| Phi-3.1-mini-4k-instruct-IQ4_XS.gguf | 2.06 GB |
| Phi-3.1-mini-4k-instruct-Q2_K.gguf | 1.42 GB |
| Phi-3.1-mini-4k-instruct-Q2_K_L.gguf | 1.7 GB |
| Phi-3.1-mini-4k-instruct-Q3_K_L-Q8.gguf | 2.17 GB |
| Phi-3.1-mini-4k-instruct-Q3_K_L-f32.gguf | 2.75 GB |
| Phi-3.1-mini-4k-instruct-Q3_K_L.gguf | 2.09 GB |
| Phi-3.1-mini-4k-instruct-Q3_K_M.gguf | 1.96 GB |
| Phi-3.1-mini-4k-instruct-Q3_K_S.gguf | 1.68 GB |
| Phi-3.1-mini-4k-instruct-Q3_K_XL.gguf | 2.36 GB |
| Phi-3.1-mini-4k-instruct-Q4_K_L.gguf | 2.65 GB |
| Phi-3.1-mini-4k-instruct-Q4_K_M.gguf | 2.39 GB |
| Phi-3.1-mini-4k-instruct-Q4_K_S.gguf | 2.19 GB |
| Phi-3.1-mini-4k-instruct-Q5_K_L.gguf | 3.06 GB |
| Phi-3.1-mini-4k-instruct-Q5_K_M.gguf | 2.82 GB |
| Phi-3.1-mini-4k-instruct-Q5_K_S.gguf | 2.64 GB |
| Phi-3.1-mini-4k-instruct-Q6_K.gguf | 3.14 GB |
| Phi-3.1-mini-4k-instruct-Q6_K_L.gguf | 3.37 GB |
| Phi-3.1-mini-4k-instruct-Q8_0.gguf | 4.06 GB |
| Phi-3.1-mini-4k-instruct-Q8_0_L.gguf | 4.25 GB |
| Phi-3.1-mini-4k-instruct-f32.gguf | 15.3 GB |
| Phi-3.1-mini-4k-instruct.imatrix | 2.23 MB |