2x7B AWQ
Collection
Mixture of experts 2 x 7B. • 20 items • Updated
jsfs11/MixtureofMerges-MoE-2x7b-SLERPv0.9 AWQ
- Model creator: jsfs11
- Original model: MixtureofMerges-MoE-2x7b-SLERPv0.9
Model Summary
MixtureofMerges-MoE-2x7b-SLERPv0.9 is a merge of the following models using LazyMergekit:
- Downloads last month
- 2
Model tree for solidrust/MixtureofMerges-MoE-2x7b-SLERPv0.9-AWQ
Base model
jsfs11/MixtureofMerges-MoE-2x7b-SLERPv0.9Collection including solidrust/MixtureofMerges-MoE-2x7b-SLERPv0.9-AWQ
Evaluation results
- normalized accuracy on AI2 Reasoning Challenge (25-Shot)test set Open LLM Leaderboard73.120
- normalized accuracy on HellaSwag (10-Shot)validation set Open LLM Leaderboard88.760
- accuracy on MMLU (5-Shot)test set Open LLM Leaderboard65.000
- mc2 on TruthfulQA (0-shot)validation set Open LLM Leaderboard74.830
- accuracy on Winogrande (5-shot)validation set Open LLM Leaderboard83.580
- accuracy on GSM8k (5-shot)test set Open LLM Leaderboard69.220