Spaces:
Runtime error
Runtime error
| title: CzechBench Leaderboard | |
| emoji: 🥇 | |
| colorFrom: green | |
| colorTo: indigo | |
| sdk: gradio | |
| app_file: app.py | |
| pinned: true | |
| license: apache-2.0 | |
| datasets: | |
| - CIIRC-NLP/agree-cs | |
| - ctu-aic/anli_cs | |
| - CIIRC-NLP/arc-cs | |
| - facebook/belebele | |
| - ctu-aic/ctkfacts_nli | |
| - CIIRC-NLP/czech_news_simple-cs | |
| - fewshot-goes-multilingual/cs_facebook-comments | |
| - CIIRC-NLP/gsm8k-cs | |
| - hynky/klokan-qa | |
| - fewshot-goes-multilingual/cs_mall-product-reviews | |
| - CIIRC-NLP/mmlu-cs | |
| - Pehy/cs_sqad-3.0 | |
| - pauli31/czech-subjectivity-dataset | |
| - CIIRC-NLP/truthful_qa-cs | |
| Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference | |
| Most of the variables to change for a default leaderboard are in env (replace the path for your leaderboard) and src/display/about. | |
| Results files should have the following format: | |
| ``` | |
| { | |
| "config": { | |
| "model_dtype": "torch.float16", # or torch.bfloat16 or 8bit or 4bit | |
| "model_name": "path of the model on the hub: org/model", | |
| "model_sha": "revision on the hub", | |
| }, | |
| "results": { | |
| "task_name": { | |
| "metric_name": score, | |
| }, | |
| "task_name2": { | |
| "metric_name": score, | |
| } | |
| } | |
| } | |
| ``` | |
| Request files are created automatically by this tool. |