Common Sense Reasoning On Big Bench Known

評価指標

Accuracy

評価結果

このベンチマークにおける各モデルのパフォーマンス結果

モデル名
Accuracy
Paper TitleRepository
Gopher-280B (few-shot, k=5)63.6Scaling Language Models: Methods, Analysis & Insights from Training Gopher-
PaLM-540B (few-shot, k=5)73.9PaLM: Scaling Language Modeling with Pathways-
Chinchilla-70B (few-shot, k=5)65.2Training Compute-Optimal Large Language Models-
0 of 3 row(s) selected.
Common Sense Reasoning On Big Bench Known | SOTA | HyperAI超神経