HyperAI

Natural Language Inference On Lidirus

Metriken

MCC

Ergebnisse

Leistungsergebnisse verschiedener Modelle zu diesem Benchmark

Modellname
MCC
Paper TitleRepository
SBERT_Large_mt_ru_finetuning0.218--
SBERT_Large0.209--
RuGPT3Medium0.01--
RuGPT3Small-0.013--
RuBERT conversational0.178--
majority_class0Unreasonable Effectiveness of Rule-Based Heuristics in Solving Russian SuperGLUE Tasks-
RuGPT3XL few-shot0.096--
Random weighted0Unreasonable Effectiveness of Rule-Based Heuristics in Solving Russian SuperGLUE Tasks-
MT5 Large0.061mT5: A massively multilingual pre-trained text-to-text transformer
RuGPT3Large0.231--
ruBert-base finetune0.224--
YaLM 1.0B few-shot0.124--
Multilingual Bert0.189--
Golden Transformer0--
heuristic majority0.147Unreasonable Effectiveness of Rule-Based Heuristics in Solving Russian SuperGLUE Tasks-
ruT5-large-finetune0.32--
ruT5-base-finetune0.267--
ruBert-large finetune0.235--
RuBERT plain0.191--
ruRoberta-large finetune0.339--
0 of 22 row(s) selected.