Word Sense Disambiguation On Russe
평가 지표
Accuracy
평가 결과
이 벤치마크에서 각 모델의 성능 결과
모델 이름 | Accuracy | Paper Title | Repository |
|---|---|---|---|
| heuristic majority | 0.595 | Unreasonable Effectiveness of Rule-Based Heuristics in Solving Russian SuperGLUE Tasks | - |
| ruBert-base finetune | 0.706 | - | - |
| majority_class | 0.587 | Unreasonable Effectiveness of Rule-Based Heuristics in Solving Russian SuperGLUE Tasks | - |
| Random weighted | 0.528 | Unreasonable Effectiveness of Rule-Based Heuristics in Solving Russian SuperGLUE Tasks | - |
| ruBert-large finetune | 0.682 | - | - |
| RuGPT3XL few-shot | 0.565 | - | - |
| RuBERT conversational | 0.729 | - | - |
| RuGPT3Medium | 0.642 | - | - |
| MT5 Large | 0.633 | - | - |
| RuGPT3Large | 0.647 | - | - |
| ruRoberta-large finetune | 0.715 | - | - |
| YaLM 1.0B few-shot | 0.587 | - | - |
| Multilingual Bert | 0.69 | - | - |
| SBERT_Large | 0.654 | - | - |
| Baseline TF-IDF1.1 | 0.57 | RussianSuperGLUE: A Russian Language Understanding Evaluation Benchmark | |
| ruT5-base-finetune | 0.682 | - | - |
| RuGPT3Small | 0.57 | - | - |
| Human Benchmark | 0.805 | RussianSuperGLUE: A Russian Language Understanding Evaluation Benchmark | |
| Golden Transformer | 0.587 | - | - |
| SBERT_Large_mt_ru_finetuning | 0.657 | - | - |
0 of 22 row(s) selected.