Multiple Choice Question Answering Mcqa On 31
Metrics
Accuracy
Results
Performance results of various models on this benchmark
Model Name | Accuracy | Paper Title | Repository |
---|---|---|---|
PaLM-62B (few-shot, k=5) | 59.4 | PaLM: Scaling Language Modeling with Pathways | |
PaLM-540B (few-shot, k=5) | 71.9 | PaLM: Scaling Language Modeling with Pathways | |
Gopher-280B (few-shot, k=5) | 59.1 | Scaling Language Models: Methods, Analysis & Insights from Training Gopher | |
Chinchilla-70B (few-shot, k=5) | 65.6 | Training Compute-Optimal Large Language Models |
0 of 4 row(s) selected.