Extreme Summarization On Gem Xsum
評価指標
Parameters
ROUGE-2
評価結果
このベンチマークにおける各モデルのパフォーマンス結果
モデル名 | Parameters | ROUGE-2 | Paper Title | Repository |
|---|---|---|---|---|
| PEGASUS | 568 M | 23.2 | The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics | - |
| PaLM (finetuning)-540B | 540 B | 21.2 | PaLM: Scaling Language Modeling with Pathways | |
| T5-XXL | - | 21.0 | PaLM: Scaling Language Modeling with Pathways | |
| ByT5 | - | - | ByT5: Towards a token-free future with pre-trained byte-to-byte models | |
| PaLM (finetuning)-62B | 62 B | 18.5 | PaLM: Scaling Language Modeling with Pathways | |
| mT5 | - | - | ByT5: Towards a token-free future with pre-trained byte-to-byte models |
0 of 6 row(s) selected.