HyperAIHyperAI

Command Palette

Search for a command to run...

Console

Word Sense Disambiguation On Words In Context

Metrics

Accuracy

Results

Performance results of various models on this benchmark

Paper Title
COSINE + Transductive Learning85.3Fine-Tuning Pre-trained Language Model with Weak Supervision: A Contrastive-Regularized Self-Training Approach
PaLM 540B (finetuned) 78.8PaLM: Scaling Language Modeling with Pathways
ST-MoE-32B 269B (fine-tuned)77.7ST-MoE: Designing Stable and Transferable Sparse Expert Models
DeBERTa-Ensemble77.5DeBERTa: Decoding-enhanced BERT with Disentangled Attention
Vega v2 6B (fine-tuned)77.4Toward Efficient Language Model Pretraining and Downstream Adaptation via Self-Evolution: A Case Study on SuperGLUE
UL2 20B (fine-tuned)77.3UL2: Unifying Language Learning Paradigms
Turing NLR v5 XXL 5.4B (fine-tuned)77.1Toward Efficient Language Model Pretraining and Downstream Adaptation via Self-Evolution: A Case Study on SuperGLUE
T5-XXL 11B76.9Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
DeBERTa-1.5B76.4DeBERTa: Decoding-enhanced BERT with Disentangled Attention
ST-MoE-L 4.1B (fine-tuned)74ST-MoE: Designing Stable and Transferable Sparse Expert Models
SenseBERT-large 340M72.1SenseBERT: Driving Some Sense into BERT
SenseBERT-base 110M70.3SenseBERT: Driving Some Sense into BERT
PaLM 2-L (one-shot)66.8PaLM 2 Technical Report
BERT-large 340M65.5WiC: the Word-in-Context Dataset for Evaluating Context-Sensitive Meaning Representations
FLAN-T5-Large 783M64.7LaMini-LM: A Diverse Herd of Distilled Models from Large-Scale Instructions
LaMini-F-T5 783M63.8LaMini-LM: A Diverse Herd of Distilled Models from Large-Scale Instructions
Context2vec59.3WiC: the Word-in-Context Dataset for Evaluating Context-Sensitive Meaning Representations
DeConf58.7WiC: the Word-in-Context Dataset for Evaluating Context-Sensitive Meaning Representations
SW2V58.1WiC: the Word-in-Context Dataset for Evaluating Context-Sensitive Meaning Representations
ElMo57.7WiC: the Word-in-Context Dataset for Evaluating Context-Sensitive Meaning Representations
0 of 37 row(s) selected.
Word Sense Disambiguation On Words In Context | SOTA | HyperAI