Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

107

Full-text search

Active filters: compsci

mradermacher/Llama3.1-70B-PlumChat-GGUF

71B • Updated Nov 19, 2024 • 118

mradermacher/Llama3.1-70B-PlumChat-i1-GGUF

71B • Updated Nov 19, 2024 • 497

Triangle104/Llama3.2-3B-ShiningValiant2-Q4_K_S-GGUF

Text Generation • 3B • Updated Nov 19, 2024 • 7

Triangle104/Llama3.2-3B-ShiningValiant2-Q4_K_M-GGUF

Text Generation • 3B • Updated Nov 19, 2024 • 7

Triangle104/Llama3.2-3B-ShiningValiant2-Q5_K_S-GGUF

Text Generation • 3B • Updated Nov 19, 2024 • 9

Triangle104/Llama3.2-3B-ShiningValiant2-Q5_K_M-GGUF

Text Generation • 3B • Updated Nov 19, 2024 • 17

Triangle104/Llama3.2-3B-ShiningValiant2-Q6_K-GGUF

Text Generation • 3B • Updated Nov 19, 2024 • 11

Triangle104/Llama3.2-3B-ShiningValiant2-Q8_0-GGUF

Text Generation • 3B • Updated Nov 19, 2024 • 13

Triangle104/Llama3.1-8B-ShiningValiant2-Q4_K_S-GGUF

Text Generation • 8B • Updated Nov 24, 2024 • 6 • 1

Triangle104/Llama3.1-8B-ShiningValiant2-Q4_K_M-GGUF

Text Generation • 8B • Updated Nov 24, 2024 • 9 • 1

Triangle104/Llama3.1-8B-ShiningValiant2-Q5_K_S-GGUF

Text Generation • 8B • Updated Nov 24, 2024 • 6 • 1

Triangle104/Llama3.1-8B-ShiningValiant2-Q5_K_M-GGUF

Text Generation • 8B • Updated Nov 24, 2024 • 10 • 1

Triangle104/Llama3.1-8B-ShiningValiant2-Q6_K-GGUF

Text Generation • 8B • Updated Nov 24, 2024 • 8 • 1

Triangle104/Llama3.1-8B-ShiningValiant2-Q8_0-GGUF

Text Generation • 8B • Updated Nov 24, 2024 • 11 • 1

Triangle104/Llama3.1-8B-PlumMath-Q4_K_S-GGUF

Text Generation • 8B • Updated Dec 26, 2024 • 12

Triangle104/Llama3.1-8B-PlumMath-Q4_K_M-GGUF

Text Generation • 8B • Updated Dec 26, 2024 • 13

Triangle104/Llama3.1-8B-PlumMath-Q5_K_S-GGUF

Text Generation • 8B • Updated Dec 26, 2024 • 9

Triangle104/Llama3.1-8B-PlumMath-Q6_K-GGUF

Text Generation • 8B • Updated Dec 26, 2024 • 14

Triangle104/Llama3.1-8B-PlumMath-Q5_K_M-GGUF

Text Generation • 8B • Updated Dec 26, 2024 • 9

Triangle104/Llama3.1-8B-PlumMath-Q8_0-GGUF

Text Generation • 8B • Updated Dec 26, 2024 • 13

Triangle104/Llama3.1-8B-PlumCode-Q4_K_S-GGUF

8B • Updated Jan 18 • 25

Triangle104/Llama3.1-8B-PlumCode-Q4_K_M-GGUF

8B • Updated Jan 18 • 30

Triangle104/Llama3.1-8B-PlumCode-Q5_K_S-GGUF

8B • Updated Jan 18 • 30

Triangle104/Llama3.1-8B-PlumCode-Q5_K_M-GGUF

8B • Updated Jan 18 • 25

Triangle104/Llama3.1-8B-PlumCode-Q6_K-GGUF

8B • Updated Jan 18 • 25

Triangle104/Llama3.1-8B-PlumCode-Q8_0-GGUF

8B • Updated Jan 18 • 17

ValiantLabs/Qwen3-8B-ShiningValiant3

Text Generation • 8B • Updated 5 days ago • 26 • 3

mradermacher/Qwen3-8B-ShiningValiant3-GGUF

8B • Updated Jul 8 • 639 • 2

Triangle104/Qwen3-8B-ShiningValiant3-Q4_K_S-GGUF

Text Generation • 8B • Updated Jul 8 • 25

Triangle104/Qwen3-8B-ShiningValiant3-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 8 • 11