Common Sense Reasoning On Big Bench Winowhy

평가 지표

Accuracy

평가 결과

이 벤치마크에서 각 모델의 성능 결과

모델 이름
Accuracy
Paper TitleRepository
PaLM-62B (few-shot, k=5)61.0PaLM: Scaling Language Modeling with Pathways-
PaLM-540B (few-shot, k=5)65.9PaLM: Scaling Language Modeling with Pathways-
Gopher-280B (few-shot, k=5)56.7Scaling Language Models: Methods, Analysis & Insights from Training Gopher-
Chinchilla-70B (few-shot, k=5)62.5Training Compute-Optimal Large Language Models-
0 of 4 row(s) selected.
Common Sense Reasoning On Big Bench Winowhy | SOTA | HyperAI초신경