Hugging Face's logo

ut-enyac
/
Llama-2-7b-hf-uniql-1.0-masked-lora-rft-w4a16

Safetensors
llama
Model card Files
xet
Community
YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

UniQL: Unified Quantization and Low-rank Compression for Adaptive Edge LLMs

Downloads last month
18
Safetensors
Model size
0.9B params
Tensor type
I32
·
F16
·
U8
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Collection including ut-enyac/Llama-2-7b-hf-uniql-1.0-masked-lora-rft-w4a16