Code Generation On Django
Metriken
Accuracy
BLEU Score
Ergebnisse
Leistungsergebnisse verschiedener Modelle zu diesem Benchmark
| Paper Title | |||
|---|---|---|---|
| MarianCG | 81.83 | 90.41 | MarianCG: a code generation transformer model inspired by machine translation |
| BERT + TAE | 81.03 | - | Code Generation from Natural Language with Less Prior and More Monolingual Data |
| TranX + BERT w/mined | 81.03 | 79.86 | The impact of lexical and grammatical processing on generating code from natural language |
| Reranker | 80.2 | - | Reranking for Neural Semantic Parsing |
| LUKEMarian | 78.50 | 89.34 | Leveraging pre-trained language models for code generation |
| RoBERTaMarian | 77.95 | 88.91 | Leveraging pre-trained language models for code generation |
| BERTMarian | 76.68 | 56.55 | Leveraging pre-trained language models for code generation |
| Tranx | 73.7 | - | TRANX: A Transition-based Neural Abstract Syntax Parser for Semantic Parsing and Code Generation |
| ELECTRAMarian | 65.32 | 53.02 | Leveraging pre-trained language models for code generation |
| lpn (Ling et al., 2016) | 62.3 | 77.6 | Latent Predictor Networks for Code Generation |
| Phrasal Statistical MT (Ling et al., 2016) | 31.5 | 47.6 | Latent Predictor Networks for Code Generation |
0 of 11 row(s) selected.