Models

QuantTrio/DeepSeek-R1-0528-GPTQ-Int4-Int8Mix-Lite

Text Generation • 721B • Updated Aug 30, 2025 • 11 • 1

QuantTrio/DeepSeek-R1-0528-GPTQ-Int4-Int8Mix-Compact

Text Generation • 847B • Updated Jun 19, 2025 • 8 • 5

QuantTrio/DeepSeek-R1-0528-GPTQ-Int4-Int8Mix-Medium

Text Generation • 912B • Updated Jun 20, 2025 • 43 • 1

brandonbeiler/InternVL3-38B-FP8-Dynamic

Image-Text-to-Text • 38B • Updated Jun 23, 2025 • 62

brandonbeiler/InternVL3-78B-FP8-Dynamic

Image-Text-to-Text • 78B • Updated Jun 23, 2025 • 71

brandonbeiler/InternVL3-8B-FP8-Dynamic

Image-Text-to-Text • 8B • Updated Jun 23, 2025 • 11 • 2

dengcao/GLM-4.1V-9B-Thinking-GPTQ-Int4-Int8Mix

Image-Text-to-Text • 15B • Updated Jul 7, 2025 • 31 • 2

dengcao/GLM-4.1V-9B-Thinking-AWQ

Image-Text-to-Text • 10B • Updated Jul 7, 2025 • 279k • 1

brandonbeiler/Skywork-R1V3-38B-FP8-Dynamic

Image-Text-to-Text • 38B • Updated Jul 18, 2025 • 10 • 1

koushd/Qwen3-235B-A22B-Instruct-2507-AWQ

Text Generation • 235B • Updated Aug 26, 2025 • 65 • 4

QuantTrio/Qwen3-235B-A22B-Instruct-2507-GPTQ-Int4-Int8Mix

Text Generation • 248B • Updated Aug 20, 2025 • 317 • 2

QuantTrio/Qwen3-235B-A22B-Instruct-2507-AWQ

Text Generation • 235B • Updated Aug 19, 2025 • 2.76k • 10

QuantTrio/GLM-4.1V-9B-Thinking-GPTQ-Int4-Int8Mix

Text Generation • 15B • Updated Sep 5, 2025 • 5 • 1

QuantTrio/GLM-4.1V-9B-Thinking-AWQ

Text Generation • 10B • Updated Sep 5, 2025 • 245

QuantTrio/Qwen3-Coder-480B-A35B-Instruct-AWQ

Text Generation • 480B • Updated Aug 19, 2025 • 515 • 8

QuantTrio/Qwen3-Coder-480B-A35B-Instruct-GPTQ-Int4-Int8Mix

Text Generation • 534B • Updated Sep 5, 2025 • 184 • 6

QuantTrio/Qwen3-235B-A22B-Thinking-2507-AWQ

Text Generation • 235B • Updated Sep 5, 2025 • 1.71k • 5

QuantTrio/Qwen3-235B-A22B-Thinking-2507-GPTQ-Int4-Int8Mix

Text Generation • 253B • Updated Sep 5, 2025 • 128 • 2

QuantTrio/GLM-4.5-Air-AWQ-FP16Mix

Text Generation • 24B • Updated Sep 5, 2025 • 3.16k • 14

QuantTrio/GLM-4.5-Air-GPTQ-Int4-Int8Mix

Text Generation • 20B • Updated Sep 5, 2025 • 2.76k • 10

QuantTrio/Qwen3-30B-A3B-Instruct-2507-GPTQ-Int8

Text Generation • 31B • Updated Sep 5, 2025 • 899 • 9

QuantTrio/GLM-4.5-GPTQ-Int4-Int8Mix

Text Generation • 55B • Updated Aug 30, 2025 • 5 • 5

QuantTrio/GLM-4.5-AWQ

Text Generation • 53B • Updated Sep 5, 2025 • 24 • 9

QuantTrio/Qwen3-30B-A3B-Thinking-2507-AWQ-BF16Mix

Text Generation • 14B • Updated Sep 5, 2025 • 132 • 4

QuantTrio/Qwen3-30B-A3B-Thinking-2507-GPTQ-Int8

Text Generation • 31B • Updated Sep 5, 2025 • 721 • 2

QuantTrio/Qwen3-30B-A3B-Thinking-2507-AWQ

Text Generation • 31B • Updated Sep 5, 2025 • 84.9k • 2

QuantTrio/KAT-V1-40B-GPTQ-Int4-Int8Mix

Text Generation • 47B • Updated Sep 5, 2025 • 16

QuantTrio/Qwen3-Coder-30B-A3B-Instruct-GPTQ-Int8

Text Generation • 31B • Updated Sep 5, 2025 • 2.47k • 6

QuantTrio/Qwen3-Coder-30B-A3B-Instruct-AWQ

Text Generation • 31B • Updated Sep 5, 2025 • 175k • 5

EliovpAI/Qwen3-14B-FP8-KV

Text Generation • 15B • Updated Aug 1, 2025 • 13 • 2