Multiple Choice Question Answering Mcqa On 18
평가 지표
Accuracy
평가 결과
이 벤치마크에서 각 모델의 성능 결과
모델 이름 | Accuracy | Paper Title | Repository |
---|---|---|---|
GAL 120B (zero-shot) | 42.2 | Galactica: A Large Language Model for Science | |
OPT (few-shot, k=5) | 21.6 | Galactica: A Large Language Model for Science | |
Gopher (few-shot, k=5) | 34.3 | Galactica: A Large Language Model for Science | |
BLOOM (few-shot, k=5) | 18.6 | Galactica: A Large Language Model for Science | |
Chinchilla (few-shot, k=5) | 46.1 | Galactica: A Large Language Model for Science |
0 of 5 row(s) selected.