Code Generation On Res Q
평가 지표
pass@1
평가 결과
이 벤치마크에서 각 모델의 성능 결과
비교 표
| 모델 이름 | pass@1 |
|---|---|
| res-q-evaluating-code-editing-large-language | 30.0 |
| res-q-evaluating-code-editing-large-language | 58.0 |
| res-q-evaluating-code-editing-large-language | 20.0 |
| res-q-evaluating-code-editing-large-language | 18.0 |
| res-q-evaluating-code-editing-large-language | 30.0 |
| res-q-evaluating-code-editing-large-language | 36.0 |
| res-q-evaluating-code-editing-large-language | 46.0 |
| res-q-evaluating-code-editing-large-language | 29.0 |
| res-q-evaluating-code-editing-large-language | 37.0 |