Code Repair On Codexglue Bugs2Fix
Metrics
Accuracy (medium)
Accuracy (small)
Results
Performance results of various models on this benchmark
Comparison Table
| Model Name | Accuracy (medium) | Accuracy (small) |
|---|---|---|
| fix-bugs-with-transformer-through-a-neural-1 | 13.87 | 24.04 |
| codexglue-a-machine-learning-benchmark | 5.2 | 16.4 |