HyperAI초신경

Machine Translation On Wmt2016 Romanian

평가 지표

BLEU score

평가 결과

이 벤치마크에서 각 모델의 성능 결과

모델 이름
BLEU score
Paper TitleRepository
CMLM+LAT+1 iterations31.24Incorporating a Local Translation Mechanism into Non-autoregressive Translation-
FLAN 137B (few-shot, k=9)38.1Finetuned Language Models Are Zero-Shot Learners
HeadMask (Random-18)32.85Alleviating the Inequality of Attention Heads for Neural Machine Translation-
Attentional encoder-decoder + BPE33.3Edinburgh Neural Machine Translation Systems for WMT 16
FLAN 137B (zero-shot)37.3Finetuned Language Models Are Zero-Shot Learners
NAT +FT + NPD31.44Non-Autoregressive Neural Machine Translation
BART (TextBox 2.0)-TextBox 2.0: A Text Generation Library with Pre-trained Language Models-
MLM pretraining35.3Cross-lingual Language Model Pretraining
FlowSeq-large (IWD n = 15)32.03FlowSeq: Non-Autoregressive Conditional Sequence Generation with Generative Flow
FlowSeq-large (NPD n = 30)32.91FlowSeq: Non-Autoregressive Conditional Sequence Generation with Generative Flow
Denoising autoencoders (non-autoregressive)30.30Deterministic Non-Autoregressive Neural Sequence Modeling by Iterative Refinement
FlowSeq-large (NPD n = 15)32.46FlowSeq: Non-Autoregressive Conditional Sequence Generation with Generative Flow
fast-noisy-channel-modeling40.3Language Models not just for Pre-training: Fast Online Neural Noisy Channel Modeling-
GenTranslate33.5GenTranslate: Large Language Models are Generative Multilingual Speech and Machine Translators
FlowSeq-large30.69FlowSeq: Non-Autoregressive Conditional Sequence Generation with Generative Flow
FlowSeq-base30.16FlowSeq: Non-Autoregressive Conditional Sequence Generation with Generative Flow
Adaptively Sparse Transformer (1.5-entmax)33.1Adaptively Sparse Transformers
HeadMask (Impt-18)32.95Alleviating the Inequality of Attention Heads for Neural Machine Translation-
Levenshtein Transformer (distillation)33.26Levenshtein Transformer
CMLM+LAT+4 iterations33.26Incorporating a Local Translation Mechanism into Non-autoregressive Translation-
0 of 21 row(s) selected.