HyperAIHyperAI

Logical Reasoning On Big Bench Strategyqa

المقاييس

Accuracy

النتائج

نتائج أداء النماذج المختلفة على هذا المعيار القياسي

اسم النموذج
Accuracy
Paper TitleRepository
PaLM-62B (few-shot, k=5)65.4PaLM: Scaling Language Modeling with Pathways-
Chinchilla-70B (few-shot, k=5)68.3Training Compute-Optimal Large Language Models-
Gopher-280B (few-shot, k=5)61.0Scaling Language Models: Methods, Analysis & Insights from Training Gopher-
PaLM-540B (few-shot, k=5)73.9PaLM: Scaling Language Modeling with Pathways-
0 of 4 row(s) selected.
Logical Reasoning On Big Bench Strategyqa | SOTA | HyperAI