Home News Latest Papers Tutorials Datasets Events Wiki SOTA LLM Models

English

Multiple Choice Qa

Benchmark List

All benchmarks related to this task

mmlu-elementary-mathematics

Best model: Chinchilla (few-shot, k=5)

Metrics

mmlu-college-biology

Best model: Chinchilla (few-shot, k=5)

Metrics

mmlu-high-school-biology

Best model: Chinchilla (few-shot, k=5)

Metrics

mmlu-college-chemistry

Best model: Chinchilla (few-shot, k=5)

Metrics

mmlu-high-school-chemistry

Best model: Chinchilla (few-shot, k=5)

Metrics

mmlu-college-computer-science

Best model: Chinchilla (few-shot, k=5)

Metrics

mmlu-high-school-mathematics

Best model: GAL 120B (zero-shot)

Metrics

mmlu-electrical-engineer

Best model: GAL 120B (zero-shot)

Metrics

mmlu-formal-logic

Best model: Gopher (few-shot, k=5)

Metrics

Best model: Meditron-70B (CoT + SC)

Metrics

Best model: CamemBERT

Metrics

Best model: Med-PaLM 2 (ER)

Metrics

mmlu-abstract-algebra

Best model: GAL 30B (zero-shot)

Metrics

mmlu-econometrics

Best model: Gopher (few-shot, k=5)

Metrics

mmlu-high-school-computer-science

Best model: GAL 120B (zero-shot)

Metrics

mmlu-machine-learning

Best model: Chinchilla (few-shot, k=5)

Metrics

mmlu-college-mathematics

Best model: GAL 120B (zero-shot)

Metrics

Best model: Chinchilla (few-shot, k=5)

Metrics

indicglue-wstp-pa

Metrics

mmlu-college-physics

Metrics

mmlu-high-school-physics

Metrics

mmlu-high-school-statistics

Metrics

mmlu-clinical-knowledge

Metrics

mmlu-professional-medicine

Metrics

mmlu-college-medicine

Metrics

big-bench-hyperbaton

Metrics

big-bench-movie-recommendation

Metrics

big-bench-navigate

Metrics

big-bench-ruin-names

Metrics

big-bench-novel-concepts

Metrics

mmlu-medical-genetics

Metrics