HyperAI超神経

Reading Comprehension On Reclor

評価指標

Test

評価結果

このベンチマークにおける各モデルのパフォーマンス結果

モデル名
Test
Paper TitleRepository
WWZ69.7--
5BitClan56.9--
BERT-large49.8--
DeBERTa-v2-xxlarge-AMR-LE-Contraposition77.2--
TwistedFate25.3--
Gariscat40.5--
MERIT w/ reasoning aware63.2--
BERT-large+MNLI50.3--
alsace59.2--
MERIt-deberta-v2-xxlarge deberta.v2.xxlarge.path.override_True.norm_1.1.0.w2.A100.cp200.s4279.3--
Knowledge model79.2--
RoBERTa-single63.5Logiformer: A Two-Branch Graph Transformer Network for Interpretable Logical Reasoning
ALBERT-XXLarge-V262.6--
xlnet-large-uncased [extended data]69.3--
RoBERTa-single58.9Fact-driven Logical Reasoning for Machine Reading Comprehension
XLNet-base50.4ReClor: A Reading Comprehension Dataset Requiring Logical Reasoning
BachTE26.0--
ro_DA_CE_v100_22461.7--
ELECTRA and ALBERT71.0Answer Uncertainty and Unanswerability in Multiple-Choice Machine Reading Comprehension-
Tournament266.7--
0 of 39 row(s) selected.