HyperAI

Linguistic Acceptability On Cola

Metriken

Accuracy
MCC

Ergebnisse

Leistungsergebnisse verschiedener Modelle zu diesem Benchmark

Vergleichstabelle
ModellnameAccuracyMCC
can-bert-eat-rucola-topological-data-analysis88.2%0.726
roberta-a-robustly-optimized-bert-pretraining67.8%-
exploring-the-limits-of-transfer-learning51.1%-
not-all-layers-are-equally-as-important-every82.7-
acceptability-judgements-via-examining-the82.1%0.565
rucola-russian-corpus-of-linguistic-0.6
how-to-train-bert-with-an-academic-budget57.1-
clear-contrastive-learning-for-sentence64.3%-
Modell 968.2%-
ernie-20-a-continual-pre-training-framework63.5%-
texttt-tasksource-structured-dataset87.15%-
squeezebert-what-can-computer-vision-teach46.5%-
exploring-the-limits-of-transfer-learning67.1%-
learning-to-encode-position-for-transformer69%-
lm-cppf-paraphrasing-guided-data-augmentation14.1%-
structbert-incorporating-language-structures69.2%-
data2vec-a-general-framework-for-self-160.3%-
ernie-enhanced-language-representation-with52.3%-
q8bert-quantized-8bit-bert65.0-
exploring-the-limits-of-transfer-learning41.0%-
xlnet-generalized-autoregressive-pretraining69%-
not-all-layers-are-equally-as-important-every82.6-
albert-a-lite-bert-for-self-supervised69.1%-
informer-transformer-likes-informed-attention59.83%-
a-statistical-framework-for-low-bitwidth67.5-
can-bert-eat-rucola-topological-data-analysis87.3%0.695
llm-int8-8-bit-matrix-multiplication-for68.6%-
bert-pre-training-of-deep-bidirectional60.5%-
distilbert-a-distilled-version-of-bert49.1%-
spanbert-improving-pre-training-by64.3%-
acceptability-judgements-via-examining-the88.6%-
big-bird-transformers-for-longer-sequences58.5%-
ernie-20-a-continual-pre-training-framework55.2%-
19091035143.3%-
not-all-layers-are-equally-as-important-every77.6-
entailment-as-few-shot-learner86.4%-
charformer-fast-character-transformers-via51.8%-
exploring-the-limits-of-transfer-learning61.2%-
not-all-layers-are-equally-as-important-every76.1-
exploring-the-limits-of-transfer-learning70.8%-
fnet-mixing-tokens-with-fourier-transforms78%-
multi-task-deep-neural-networks-for-natural68.4%-
q-bert-hessian-based-ultra-low-precision65.1-