Extreme Summarization On Gem Xsum
评估指标
Parameters
ROUGE-2
评测结果
各个模型在此基准测试上的表现结果
比较表格
| 模型名称 | Parameters | ROUGE-2 |
|---|---|---|
| the-gem-benchmark-natural-language-generation | 568 M | 23.2 |
| palm-scaling-language-modeling-with-pathways-1 | 540 B | 21.2 |
| palm-scaling-language-modeling-with-pathways-1 | - | 21.0 |
| byt5-towards-a-token-free-future-with-pre | - | - |
| palm-scaling-language-modeling-with-pathways-1 | 62 B | 18.5 |
| byt5-towards-a-token-free-future-with-pre | - | - |