Upload README.md with huggingface_hub

README.md

@@ -0,0 +1,43 @@
+---
+base_model: GoToCompany/llama3-8b-cpt-sahabatai-v1-instruct
+language:
+- en
+- id
+- jv
+- su
+license: llama3
+tags:
+- llama-cpp
+- gguf
+---
+
+                # Supa-AI/llama3-8b-cpt-sahabatai-v1-instruct-gguf
+                This model was converted to GGUF format from [`GoToCompany/llama3-8b-cpt-sahabatai-v1-instruct`](https://huggingface.co/GoToCompany/llama3-8b-cpt-sahabatai-v1-instruct) using llama.cpp.
+                Refer to the [original model card](https://huggingface.co/GoToCompany/llama3-8b-cpt-sahabatai-v1-instruct) for more details on the model.
+
+                ## Available Versions
+                - `llama3-8b-cpt-sahabatai-v1-instruct.q2_k.gguf` (q2_k)
+- `llama3-8b-cpt-sahabatai-v1-instruct.q3_k_m.gguf` (q3_k_m)
+- `llama3-8b-cpt-sahabatai-v1-instruct.q4_0.gguf` (q4_0)
+- `llama3-8b-cpt-sahabatai-v1-instruct.q4_k_m.gguf` (q4_k_m)
+- `llama3-8b-cpt-sahabatai-v1-instruct.q5_0.gguf` (q5_0)
+- `llama3-8b-cpt-sahabatai-v1-instruct.q5_k_m.gguf` (q5_k_m)
+- `llama3-8b-cpt-sahabatai-v1-instruct.q6_k.gguf` (q6_k)
+- `llama3-8b-cpt-sahabatai-v1-instruct.q8_0.gguf` (q8_0)
+
+                ## Use with llama.cpp
+                Replace `FILENAME` with one of the above filenames.
+
+                ### CLI:
+                ```bash
+                llama-cli --hf-repo Supa-AI/llama3-8b-cpt-sahabatai-v1-instruct-gguf --hf-file FILENAME -p "Your prompt here"
+                ```
+
+                ### Server:
+                ```bash
+                llama-server --hf-repo Supa-AI/llama3-8b-cpt-sahabatai-v1-instruct-gguf --hf-file FILENAME -c 2048
+                ```
+
+                ## Model Details
+                - **Original Model:** [GoToCompany/llama3-8b-cpt-sahabatai-v1-instruct](https://huggingface.co/GoToCompany/llama3-8b-cpt-sahabatai-v1-instruct)
+                - **Format:** GGUF