Code Generation On Conala Ext
评估指标
BLEU
评测结果
各个模型在此基准测试上的表现结果
比较表格
| 模型名称 | BLEU |
|---|---|
| incorporating-external-knowledge-through-pre | 20.37 |
| reading-stackoverflow-encourages-cheating | 34.35 |
| incorporating-external-knowledge-through-pre | 20.54 |
| tranx-a-transition-based-neural-abstract | 18.85 |
| reading-stackoverflow-encourages-cheating | 35.32 |
| reranking-for-neural-semantic-parsing | 19.85 |