Code Search On Codesearchnet
평가 지표
Go
JS
Java
Overall
PHP
Python
Ruby
평가 결과
이 벤치마크에서 각 모델의 성능 결과
비교 표
| 모델 이름 | Go | JS | Java | Overall | PHP | Python | Ruby |
|---|---|---|---|---|---|---|---|
| graphcodebert-pre-training-code | 84.1 | 71.1 | 75.7 | 77.4 | 72.5 | 87.9 | 73.2 |
| codet5-open-code-large-language-models-for | 92.4 | 70..8 | 76.1 | 77.1 | 69.8 | 75.6 | 77.7 |
| codebert-a-pre-trained-model-for-programming | 69.3 | 74.8 | 86.8 | 76.0 | 70.6 | 84.0 | 70.6 |
| text-and-code-embeddings-by-contrastive-pre | 97.7 | 86.0 | 94.0 | 93.4 | 96.7 | 99.8 | 86.3 |
| text-and-code-embeddings-by-contrastive-pre | 97.5 | 86.5 | 94.4 | 93.5 | 97.2 | 99.9 | 85.5 |
| codet5-open-code-large-language-models-for | 92.7 | 71.3 | 76.2 | 77.4 | 70.1 | 75.8 | 78.0 |