Natural Language Understanding On Streusle

評価指標

Full F1 (Preps)

評価結果

このベンチマークにおける各モデルのパフォーマンス結果

モデル名
Full F1 (Preps)
Paper TitleRepository
RoBERTa + Linear78.2--
GloVe (pred POS/lemmas)58.0Lexical Semantic Recognition-
BERT (gold POS/lemmas)71.4Lexical Semantic Recognition-
BiLSTM + MLP (auto syntax)53.6Comprehensive Supersense Disambiguation of English Prepositions and Possessives-
GloVe (none)58.1Lexical Semantic Recognition-
BERT (pred POS/lemmas)71.6Lexical Semantic Recognition-
SVM (feature-rich, gold syntax)59.5Comprehensive Supersense Disambiguation of English Prepositions and Possessives-
BiLSTM + MLP (gold syntax)58.9Comprehensive Supersense Disambiguation of English Prepositions and Possessives-
GloVe (gold POS/lemmas)61.0Lexical Semantic Recognition-
SVM (feature-rich, auto syntax)55.7Comprehensive Supersense Disambiguation of English Prepositions and Possessives-
BERT (none)70.9Lexical Semantic Recognition-
0 of 11 row(s) selected.