Multiple Choice Qa
多项选择题回答(MCQA)是自然语言处理的一项子任务,要求模型根据给定的问题、候选选项及其支持上下文,预测最符合问题的最佳答案。该任务旨在评估模型的理解能力和推理能力,具有广泛的应用价值,如智能教育、在线测评和知识检索等。
BIG-bench (Hyperbaton)
BIG-bench (Movie Recommendation)
BIG-bench (Navigate)
BIG-bench (Novel Concepts)
BIG-bench (Ruin Names)
FrenchMedMCQA
CamemBERT
IndicGLUE WSTP Pa
MedMCQA
Meditron-70B (CoT + SC)
MMLU (Abstract Algebra)
GAL 30B (zero-shot)
MMLU (Anatomy)
Med-PaLM 2 (ER)
MMLU (Astronomy)
Chinchilla (few-shot, k=5)
MMLU (Clinical Knowledge)
MMLU (College Biology)
Chinchilla (few-shot, k=5)
MMLU (College Chemistry)
Chinchilla (few-shot, k=5)
MMLU (College Computer Science)
Chinchilla (few-shot, k=5)
MMLU (College Mathematics)
GAL 120B (zero-shot)
MMLU (College Medicine)
MMLU (College Physics)
MMLU (Econometrics)
Gopher (few-shot, k=5)
MMLU (Electrical Engineer)
GAL 120B (zero-shot)
MMLU (Elementary Mathematics)
Chinchilla (few-shot, k=5)
MMLU (Formal Logic)
Gopher (few-shot, k=5)
MMLU (High School Biology)
Chinchilla (few-shot, k=5)
MMLU (High School Chemistry)
Chinchilla (few-shot, k=5)
MMLU (High School Computer Science)
GAL 120B (zero-shot)
MMLU (High School Mathematics)
GAL 120B (zero-shot)
MMLU (High School Physics)
MMLU (High School Statistics)
MMLU (Machine Learning)
Chinchilla (few-shot, k=5)
MMLU (Medical Genetics)
MMLU (Professional medicine)