Language Modelling On C4
評価指標
Perplexity
Steps
TPUv3 Hours
評価結果
このベンチマークにおける各モデルのパフォーマンス結果
比較表
| モデル名 | Perplexity | Steps | TPUv3 Hours |
|---|---|---|---|
| primer-searching-for-efficient-transformers | 12.69 | 1M | 16.5K |
| llm-int8-8-bit-matrix-multiplication-for | 12.45 | - | - |
| primer-searching-for-efficient-transformers | 13.25 | 1M | 15.7K |
| n-grammer-augmenting-transformers-with-latent-1 | 14.79 | - | - |
| llm-int8-8-bit-matrix-multiplication-for | 14.43 | - | - |
| llm-int8-8-bit-matrix-multiplication-for | 15.91 | - | - |
| primer-searching-for-efficient-transformers | 12.35 | 1M | 17.3K |
| n-grammer-augmenting-transformers-with-latent-1 | 15.01 | - | - |
| llm-int8-8-bit-matrix-multiplication-for | 13.3 | - | - |