Code Generation On Conala Ext
評価指標
BLEU
評価結果
このベンチマークにおける各モデルのパフォーマンス結果
モデル名 | BLEU | Paper Title | Repository |
|---|---|---|---|
| External Knowledge With API | 20.37 | Incorporating External Knowledge through Pre-training for Natural Language to Code Generation | |
| BART Base | 34.35 | Reading StackOverflow Encourages Cheating: Adding Question Text Improves Extractive Code Generation | |
| External Knowledge With API + Reranking | 20.54 | Incorporating External Knowledge through Pre-training for Natural Language to Code Generation | |
| TranX | 18.85 | TRANX: A Transition-based Neural Abstract Syntax Parser for Semantic Parsing and Code Generation | |
| BART W/ Mined | 35.32 | Reading StackOverflow Encourages Cheating: Adding Question Text Improves Extractive Code Generation | |
| Reranker | 19.85 | Reranking for Neural Semantic Parsing | - |
0 of 6 row(s) selected.