Code Generation On Res Q
Metriken
pass@1
Ergebnisse
Leistungsergebnisse verschiedener Modelle zu diesem Benchmark
Vergleichstabelle
| Modellname | pass@1 |
|---|---|
| res-q-evaluating-code-editing-large-language | 30.0 |
| res-q-evaluating-code-editing-large-language | 58.0 |
| res-q-evaluating-code-editing-large-language | 20.0 |
| res-q-evaluating-code-editing-large-language | 18.0 |
| res-q-evaluating-code-editing-large-language | 30.0 |
| res-q-evaluating-code-editing-large-language | 36.0 |
| res-q-evaluating-code-editing-large-language | 46.0 |
| res-q-evaluating-code-editing-large-language | 29.0 |
| res-q-evaluating-code-editing-large-language | 37.0 |