neuralmagic
's Collections
DeepSeek-R1-Distill Quantized
updated
RedHatAI/DeepSeek-R1-Distill-Llama-8B-FP8-dynamic
Text Generation
•
8B
•
Updated
•
301
•
5
RedHatAI/DeepSeek-R1-Distill-Llama-70B-FP8-dynamic
Text Generation
•
71B
•
Updated
•
2.39k
•
10
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-FP8-dynamic
Text Generation
•
33B
•
Updated
•
1.57k
•
9
RedHatAI/DeepSeek-R1-Distill-Llama-70B-quantized.w8a8
Text Generation
•
71B
•
Updated
•
345
•
2
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-FP8-dynamic
Text Generation
•
15B
•
Updated
•
1.09k
•
3
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-FP8-dynamic
Text Generation
•
8B
•
Updated
•
1.22k
•
1
RedHatAI/DeepSeek-R1-Distill-Qwen-1.5B-quantized.w8a8
Text Generation
•
2B
•
Updated
•
3.68k
•
2
RedHatAI/DeepSeek-R1-Distill-Qwen-1.5B-FP8-dynamic
Text Generation
•
2B
•
Updated
•
32
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-quantized.w8a8
Text Generation
•
15B
•
Updated
•
3.07k
•
2
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-quantized.w8a8
Text Generation
•
8B
•
Updated
•
4.2k
•
5
RedHatAI/DeepSeek-R1-Distill-Llama-8B-quantized.w4a16
Text Generation
•
2B
•
Updated
•
417
RedHatAI/DeepSeek-R1-Distill-Llama-8B-quantized.w8a8
Text Generation
•
8B
•
Updated
•
171k
•
2
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-quantized.w4a16
Text Generation
•
3B
•
Updated
•
258
•
1
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16
Text Generation
•
2B
•
Updated
•
339
•
2
RedHatAI/DeepSeek-R1-Distill-Qwen-1.5B-quantized.w4a16
Text Generation
•
0.6B
•
Updated
•
9
•
1
RedHatAI/DeepSeek-R1-Distill-Llama-70B-quantized.w4a16
Text Generation
•
11B
•
Updated
•
493
•
5
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-quantized.w4a16
Text Generation
•
6B
•
Updated
•
524
•
5
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-quantized.w8a8
Text Generation
•
33B
•
Updated
•
6.18k
•
13