Logical Reasoning On Big Bench Logic Grid
評価指標
Accuracy
評価結果
このベンチマークにおける各モデルのパフォーマンス結果
モデル名 | Accuracy | Paper Title | Repository |
|---|---|---|---|
| PaLM-62B (few-shot, k=5) | 36.5 | PaLM 2 Technical Report | |
| PaLM-540B (few-shot, k=5) | 42.4 | PaLM 2 Technical Report | |
| Gopher-280B (few-shot, k=5) | 35.1 | Scaling Language Models: Methods, Analysis & Insights from Training Gopher | |
| Chinchilla-70B (few-shot, k=5) | 44 | Training Compute-Optimal Large Language Models |
0 of 4 row(s) selected.