Word Sense Disambiguation On Supervised

Metrics

SemEval 2007

SemEval 2013

SemEval 2015

Senseval 2

Senseval 3

Results

Performance results of various models on this benchmark

Model Name	SemEval 2007	SemEval 2013	SemEval 2015	Senseval 2	Senseval 3	Paper Title	Repository
supWSD<sub>emb</sub>	63.1	66.8	71.8	72.7	70.6	-	-
BERT (nearest neighbour)	63.3	69.2	74.4	73.8	71.6	Improved Word Sense Disambiguation Using Pre-Trained Contextualized Word Representations
context2vec	61.3	65.6	71.9	71.8	69.1	-	-
GAS<sub>ext</sub>	--*	67.2	72.6	72.2	70.5	Incorporating Glosses into Neural Word Sense Disambiguation
SemCor+WNGT, vocabulary reduced, ensemble	66.81	72.63	74.46	75.15	70.11	Improving the Coverage and the Generalization Ability of Neural Word Sense Disambiguation through Hypernymy and Hyponymy Relationships	-
SANDWiCH	80.9	92.6	91.5	87.8	85.7	SANDWiCH: Semantical Analysis of Neighbours for Disambiguating Words in Context ad Hoc
SparseLMMS+WNGC	73.0	79.4	81.3	79.6	77.3	Sparsity Makes Sense: Word Sense Disambiguation Using Sparse Contextualized Word Representations	-
ELMo	62.2	66.2	71.3	71.6	69.6	Deep contextualized word representations
Bi-LSTM<sub>att+LEX</sub>	63.7*	66.4	72.4	72.0	69.4	Neural Sequence Learning Models for Word Sense Disambiguation	-
EWISER	71.0	78.9	79.3	78.9	78.4	Breaking Through the 80% Glass Ceiling: Raising the State of the Art in Word Sense Disambiguation by Incorporating Knowledge Graph Information
ConSeC	77.4	83.2	85.2	82.3	79.9	ConSeC: Word Sense Disambiguation as Continuous Sense Comprehension
GAS	--*	66.7	71.6	72.0	70.0	Incorporating Glosses into Neural Word Sense Disambiguation
Bi-LSTM<sub>att+LEX+POS</sub>	64.8*	66.9	71.5	72.0	69.1	Neural Sequence Learning Models for Word Sense Disambiguation	-
BERT (linear projection)	68.1	71.1	76.2	75.5	73.6	Improved Word Sense Disambiguation Using Pre-Trained Contextualized Word Representations
ARES	71.0	77.3	83.2	78.0	77.1	With More Contexts Comes Better Performance: Contextualized Sense Embeddings for All-Round Word Sense Disambiguation	-
supWSD	60.2	65.8	70.0	71.3	68.8	-	-
ESR	77.0	81.5	84.1	81.3	79.9	Improved Word Sense Disambiguation with Enhanced Sense Representations
ESR+WNGC	78.5	82.3	85.3	82.5	80.2	Improved Word Sense Disambiguation with Enhanced Sense Representations
MFS baseline	54.5	63.8	67.1	65.6	66.0	-	-
ESCHER SemCor	76.3	82.2	83.2	81.7	77.8	ESC: Redesigning WSD with Extractive Sense Comprehension

0 of 26 row(s) selected.