HyperAI超神経
ホームニュース最新論文チュートリアルデータセット百科事典SOTALLMモデルGPU ランキング学会
検索
サイトについて
HyperAI超神経

Question Answering On Strategyqa

評価指標

Accuracy

評価結果

このベンチマークにおける各モデルのパフォーマンス結果

モデル名
Accuracy
Paper TitleRepository
Rethinking with retrieval (GPT-3)77.73Rethinking with Retrieval: Faithful Large Language Model Inference
SearchChain-Chain-of-Action: Faithful and Multimodal Question Answering through Large Language Models
PaLM 540B76.4Transcending Scaling Laws with 0.1% Extra Compute-
Least-to-Most-Least-to-Most Prompting Enables Complex Reasoning in Large Language Models
Self-Evaluation Guided Decoding (Codex, CoT, single reasoning chain, 6-shot gen, 4-shot eval)77.2--
SearchChain-Search-in-the-Chain: Interactively Enhancing Large Language Models with Search for Knowledge-intensive Tasks
CoA w/o actions-Chain-of-Action: Faithful and Multimodal Question Answering through Large Language Models
CoA-Chain-of-Action: Faithful and Multimodal Question Answering through Large Language Models
Least-to-Most-Chain-of-Action: Faithful and Multimodal Question Answering through Large Language Models
U-PaLM 540B76.6Transcending Scaling Laws with 0.1% Extra Compute-
Minerva 540B61.9Transcending Scaling Laws with 0.1% Extra Compute-
PaLM 2 (few-shot, CoT, SC)90.4PaLM 2 Technical Report
0 of 12 row(s) selected.