Reading Comprehension On Muserc
Metrics
Average F1
EM
Results
Performance results of various models on this benchmark
Comparison Table
| Model Name | Average F1 | EM |
|---|---|---|
| russiansuperglue-a-russian-language | 0.587 | 0.242 |
| russiansuperglue-a-russian-language | 0.806 | 0.42 |
| Model 3 | 0.687 | 0.278 |
| Model 4 | 0.76 | 0.427 |
| unreasonable-effectiveness-of-rule-based | 0.45 | 0.071 |
| Model 6 | 0.769 | 0.446 |
| Model 7 | 0.646 | 0.327 |
| mt5-a-massively-multilingual-pre-trained-text | 0.844 | 0.543 |
| Model 9 | 0.83 | 0.561 |
| Model 10 | 0.742 | 0.399 |
| Model 11 | 0.729 | 0.333 |
| Model 12 | 0.673 | 0.364 |
| Model 13 | 0.706 | 0.308 |
| Model 14 | 0.642 | 0.319 |
| Model 15 | 0.941 | 0.819 |
| Model 16 | 0.639 | 0.239 |
| Model 17 | 0.815 | 0.537 |
| Model 18 | 0.653 | 0.221 |
| unreasonable-effectiveness-of-rule-based | 0.671 | 0.237 |
| Model 20 | 0.74 | 0.546 |
| unreasonable-effectiveness-of-rule-based | 0.0 | 0.0 |
| Model 22 | 0.711 | 0.324 |