Memorization On Big Bench Hindu Knowledge

評価指標

Accuracy

評価結果

このベンチマークにおける各モデルのパフォーマンス結果

モデル名
Accuracy
Paper TitleRepository
PaLM-540B (few-shot, k=5)95.4PaLM: Scaling Language Modeling with Pathways-
PaLM-62B (few-shot, k=5)77.7PaLM: Scaling Language Modeling with Pathways-
Gopher-280B (few-shot, k=5)80Scaling Language Models: Methods, Analysis & Insights from Training Gopher-
0 of 3 row(s) selected.
Memorization On Big Bench Hindu Knowledge | SOTA | HyperAI超神経