Inference Providers
Active filters: 5-bit
LiquidAI/LFM2.5-350M-MLX-5bit
Text Generation
• 66.5M • Updated • 232
• 2
juanquivilla/sotto-cleanup-lfm25-350m-mlx-5bit
Text Generation
• 66.5M • Updated • 1.47k
• 2
MaziyarPanahi/BioMistral-7B-GGUF
Text Generation
• 7B • Updated • 3.4k
• 58
MaziyarPanahi/Meta-Llama-3-8B-Instruct-GGUF
Text Generation
• 8B • Updated • 110k
• 102
MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF
Text Generation
• 7B • Updated • 122k
• 134
MaziyarPanahi/Llama-3-Groq-8B-Tool-Use-GGUF
Text Generation
• 8B • Updated • 493
• 7
MaziyarPanahi/Meta-Llama-3.1-8B-Instruct-GGUF
Text Generation
• 8B • Updated • 196k
• 34
MaziyarPanahi/Phi-3.5-mini-instruct-GGUF
Text Generation
• 4B • Updated • 456k
• 27
MaziyarPanahi/Qwen3-0.6B-GGUF
Text Generation
• 0.8B • Updated • 172k
• 11
MaziyarPanahi/Qwen3-14B-GGUF
Text Generation
• 15B • Updated • 170k
• 9
MaziyarPanahi/GLM-4.6V-Flash-GGUF
Text Generation
• 9B • Updated • 61.4k
• 4
LiquidAI/LFM2.5-1.2B-Instruct-MLX-5bit
Text Generation
• 0.2B • Updated • 30
• 4
LiquidAI/LFM2.5-1.2B-JP-MLX-5bit
Text Generation
• 0.2B • Updated • 25
• 4
NexVeridian/Qwen3.5-122B-A10B-5bit
Text Generation
• 122B • Updated • 228
• 1
Brooooooklyn/Qwen3.5-35B-A3B-UD-Q5_K_XL-mlx
Text Generation
• 8B • Updated • 502
• 2
Brooooooklyn/Qwen3.5-27B-UD-Q5_K_XL-mlx
Text Generation
• 8B • Updated • 187
• 1
mlx-community/granite-4.0-3b-vision-5bit
Image-Text-to-Text
• 1B • Updated • 143
• 1
mlx-community/gemma-4-31b-it-5bit
Image-Text-to-Text
• 6B • Updated • 1.59k
• 1
mlx-community/gemma-4-26b-a4b-it-5bit
Image-Text-to-Text
• 5B • Updated • 1.37k
• 1
mlx-community/gemma-4-31b-5bit
Image-Text-to-Text
• 6B • Updated • 778
• 1
mlx-community/gemma-4-26b-a4b-5bit
Image-Text-to-Text
• 5B • Updated • 1.68k
• 1
LoneStriker/Yi-6B-200K-5.0bpw-h6-exl2
Text Generation
• Updated • 4
Text Generation
• 3B • Updated • 228
• 6
MaziyarPanahi/Tess-XS-v1-3-yarn-128K-Mistral-7B-Instruct-v0.1-GGUF
Text Generation
• 7B • Updated • 499
• 6
MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.1-GGUF
Text Generation
• 7B • Updated • 440
• 4
MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.2-GGUF
Text Generation
• 7B • Updated • 514
• 5
MaziyarPanahi/NeuralPipe-7B-slerp-GGUF
Text Generation
• 7B • Updated • 230
• 3
MaziyarPanahi/NeuralPipe-7B-slerp-v0.2-GGUF
Text Generation
• 7B • Updated • 115
• 2
MaziyarPanahi/Mistral-7B-Instruct-v0.1-16k-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 101
• 2
MaziyarPanahi/rfp_instruct_model-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 64
• 2