Auto Debugging On Big Bench Lite
평가 지표
Exact string match
평가 결과
이 벤치마크에서 각 모델의 성능 결과
모델 이름 | Exact string match | Paper Title | Repository |
|---|---|---|---|
| PaLM 62B (few-shot, k=5) | 38.2 | PaLM: Scaling Language Modeling with Pathways | |
| PaLM 8B (few-shot, k=5) | 14.7 | PaLM: Scaling Language Modeling with Pathways | |
| PaLM 540B (few-shot, k=5) | 38.2 | PaLM: Scaling Language Modeling with Pathways |
0 of 3 row(s) selected.