Extreme Summarization On Gem Xsum
Metrics
Parameters
ROUGE-2
Results
Performance results of various models on this benchmark
Comparison Table
| Model Name | Parameters | ROUGE-2 |
|---|---|---|
| the-gem-benchmark-natural-language-generation | 568 M | 23.2 |
| palm-scaling-language-modeling-with-pathways-1 | 540 B | 21.2 |
| palm-scaling-language-modeling-with-pathways-1 | - | 21.0 |
| byt5-towards-a-token-free-future-with-pre | - | - |
| palm-scaling-language-modeling-with-pathways-1 | 62 B | 18.5 |
| byt5-towards-a-token-free-future-with-pre | - | - |