Models

unsloth/Phi-3-mini-4k-instruct-bnb-4bit

Text Generation • 4B • Updated Sep 3, 2024 • 37.3k • 39

MaziyarPanahi/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • 71B • Updated Jul 29, 2024 • 121k • 40

hugging-quants/Meta-Llama-3.1-8B-Instruct-GPTQ-INT4

Text Generation • 8B • Updated Aug 7, 2024 • 9.01k • 40

Qwen/Qwen2.5-32B-Instruct-AWQ

Text Generation • 33B • Updated Oct 9, 2024 • 1.04M • 90

Qwen/Qwen2.5-Coder-1.5B-Instruct-AWQ

Text Generation • 2B • Updated Nov 18, 2024 • 95.4k • 4

unsloth/Qwen2.5-Coder-7B-bnb-4bit

Text Generation • 8B • Updated Nov 12, 2024 • 14.9k • 13

unsloth/Qwen2.5-Coder-7B-Instruct-bnb-4bit

Text Generation • 4B • Updated Nov 12, 2024 • 98k • 8

unsloth/llava-1.5-7b-hf-bnb-4bit

Image-Text-to-Text • 4B • Updated Feb 13 • 194k • 5

da-fr/Mistral-NeMo-Minitron-8B-ARChitects-Full-bnb-4bit

8B • Updated Dec 3, 2024 • 18 • 7

MaziyarPanahi/Llama-3.3-70B-Instruct-GGUF

Text Generation • 71B • Updated Dec 7, 2024 • 121k • 20

MaziyarPanahi/Mistral-Small-24B-Instruct-2501-GGUF

Text Generation • 24B • Updated Jun 23 • 122k • 7

unsloth/Llama-3.1-8B-unsloth-bnb-4bit

Text Generation • 5B • Updated Feb 15 • 5.71k • 5

empirischtech/DeepSeek-R1-Distill-Qwen-32B-gptq-4bit

Text Generation • Updated Feb 16 • 1.13k • 5

RichardErkhov/MrezaPRZ_-_CodeLlama-7B-postgres-expert-4bits

7B • Updated Feb 26 • 16 • 1

secemp9/TraceBack-12b

Text Generation • 7B • Updated Mar 14 • 62 • 32

MaziyarPanahi/gemma-3-1b-it-GGUF

Text Generation • 1.0B • Updated Mar 12 • 122k • 11

RichardErkhov/zjj815_-_Qwen1.5-4B-Chinese-toxic-content-detection-4bits

4B • Updated Apr 6 • 31 • 1

unsloth/Qwen3-14B-unsloth-bnb-4bit

Text Generation • 15B • Updated May 13 • 48.6k • 10

unsloth/Qwen3-1.7B-unsloth-bnb-4bit

Text Generation • 2B • Updated May 13 • 47.8k • 10

mlx-community/Qwen3-0.6B-4bit

Text Generation • Updated Apr 28 • 6.02k • 7

mlx-community/Qwen3-4B-4bit

Text Generation • Updated Apr 28 • 8.11k • 10

wolfofbackstreet/Qwen2.5-Omni-3B-4Bit

6B • Updated May 1 • 14 • 4

mlx-community/Josiefied-Qwen3-8B-abliterated-v1-4bit

Text Generation • 1B • Updated May 1 • 216 • 3

Qwen/Qwen3-8B-AWQ

Text Generation • 8B • Updated May 21 • 103k • 30

Qwen/Qwen3-4B-AWQ

Text Generation • 4B • Updated May 21 • 138k • 20

Qwen/Qwen2.5-Omni-7B-AWQ

Any-to-Any • 11B • Updated May 15 • 33.5k • 15

Qwen/Qwen3-0.6B-MLX-4bit

Text Generation • 83.9M • Updated Jul 29 • 1.3k • 15

Qwen/Qwen3-14B-MLX-4bit

Text Generation • 2B • Updated Jul 7 • 421 • 6

mlx-community/Josiefied-DeepSeek-R1-0528-Qwen3-8B-abliterated-v1-4bit

Text Generation • 1B • Updated May 29 • 130 • 2

ReadyArt/Cydonia-24B-v3-AWQ

24B • Updated Jun 9 • 22 • 1