Logical Reasoning On Big Bench Strategyqa
평가 지표
Accuracy
평가 결과
이 벤치마크에서 각 모델의 성능 결과
모델 이름 | Accuracy | Paper Title | Repository |
|---|---|---|---|
| PaLM-62B (few-shot, k=5) | 65.4 | PaLM: Scaling Language Modeling with Pathways | |
| Chinchilla-70B (few-shot, k=5) | 68.3 | Training Compute-Optimal Large Language Models | |
| Gopher-280B (few-shot, k=5) | 61.0 | Scaling Language Models: Methods, Analysis & Insights from Training Gopher | |
| PaLM-540B (few-shot, k=5) | 73.9 | PaLM: Scaling Language Modeling with Pathways |
0 of 4 row(s) selected.