Code Generation On Codexglue Codesearchnet
Metrics
Java/BLEU
Java/CodeBLEU
Java/EM
Python/BLEU
Python/CodeBLEU
Python/EM
Results
Performance results of various models on this benchmark
Comparison Table
| Model Name | Java/BLEU | Java/CodeBLEU | Java/EM | Python/BLEU | Python/CodeBLEU | Python/EM |
|---|---|---|---|---|---|---|
| retrieval-augmented-code-generation-and | 28.98 | 33.18 | 10.21 | 24.43 | 30.21 | 9.61 |
| gap-gen-guided-automatic-python-code | - | - | - | 22.3 | 24.1 | - |