Code Generation On Conala Ext
评估指标
BLEU
评测结果
各个模型在此基准测试上的表现结果
模型名称 | BLEU | Paper Title | Repository |
|---|---|---|---|
| External Knowledge With API | 20.37 | Incorporating External Knowledge through Pre-training for Natural Language to Code Generation | - |
| BART Base | 34.35 | Reading StackOverflow Encourages Cheating: Adding Question Text Improves Extractive Code Generation | - |
| External Knowledge With API + Reranking | 20.54 | Incorporating External Knowledge through Pre-training for Natural Language to Code Generation | - |
| TranX | 18.85 | TRANX: A Transition-based Neural Abstract Syntax Parser for Semantic Parsing and Code Generation | - |
| BART W/ Mined | 35.32 | Reading StackOverflow Encourages Cheating: Adding Question Text Improves Extractive Code Generation | - |
| Reranker | 19.85 | Reranking for Neural Semantic Parsing | - |
0 of 6 row(s) selected.