HyperAI

Logical Reasoning On Big Bench Strategyqa

Métriques

Accuracy

Résultats

Résultats de performance de divers modèles sur ce benchmark

Nom du modèle
Accuracy
Paper TitleRepository
PaLM-62B (few-shot, k=5)65.4PaLM: Scaling Language Modeling with Pathways
Chinchilla-70B (few-shot, k=5)68.3Training Compute-Optimal Large Language Models
Gopher-280B (few-shot, k=5)61.0Scaling Language Models: Methods, Analysis & Insights from Training Gopher
PaLM-540B (few-shot, k=5)73.9PaLM: Scaling Language Modeling with Pathways
0 of 4 row(s) selected.