HyperAI超神经

Common Sense Reasoning On Big Bench Winowhy

评估指标

Accuracy

评测结果

各个模型在此基准测试上的表现结果

模型名称
Accuracy
Paper TitleRepository
PaLM-62B (few-shot, k=5)61.0PaLM: Scaling Language Modeling with Pathways
PaLM-540B (few-shot, k=5)65.9PaLM: Scaling Language Modeling with Pathways
Gopher-280B (few-shot, k=5)56.7Scaling Language Models: Methods, Analysis & Insights from Training Gopher
Chinchilla-70B (few-shot, k=5)62.5Training Compute-Optimal Large Language Models
0 of 4 row(s) selected.