HyperAI

Multiple Choice Question Answering Mcqa On 31

Métriques

Accuracy

Résultats

Résultats de performance de divers modèles sur ce benchmark

Nom du modèle
Accuracy
Paper TitleRepository
PaLM-62B (few-shot, k=5)59.4PaLM: Scaling Language Modeling with Pathways
PaLM-540B (few-shot, k=5)71.9PaLM: Scaling Language Modeling with Pathways
Gopher-280B (few-shot, k=5)59.1Scaling Language Models: Methods, Analysis & Insights from Training Gopher
Chinchilla-70B (few-shot, k=5)65.6Training Compute-Optimal Large Language Models
0 of 4 row(s) selected.