📊 Benchmark
| Groups | Version | Filter | n-shot | Metric | Value | Stderr | ||
|---|---|---|---|---|---|---|---|---|
| tmmluplus | 2 | none | acc | ↑ | 0.2507 | ± | 0.0031 | |
| none | acc_norm | ↑ | 0.2507 | ± | 0.0031 | |||
| - tmmluplus_STEM | 2 | none | acc | ↑ | 0.2486 | ± | 0.0073 | |
| none | acc_norm | ↑ | 0.2486 | ± | 0.0073 | |||
| - tmmluplus_humanities | 2 | none | acc | ↑ | 0.2490 | ± | 0.0103 | |
| none | acc_norm | ↑ | 0.2490 | ± | 0.0103 | |||
| - tmmluplus_other | 2 | none | acc | ↑ | 0.2511 | ± | 0.0046 | |
| none | acc_norm | ↑ | 0.2511 | ± | 0.0046 | |||
| - tmmluplus_social_sciences | 2 | none | acc | ↑ | 0.2518 | ± | 0.0056 | |
| none | acc_norm | ↑ | 0.2518 | ± | 0.0056 |
- Downloads last month
- 5
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support