Program Synthesis On Spoc Testp
评估指标
Success rate @budget 100
评测结果
各个模型在此基准测试上的表现结果
比较表格
| 模型名称 | Success rate @budget 100 |
|---|---|
| graph-based-self-supervised-program-repair | 38.5 |
| spoc-search-based-pseudocode-to-code | 34.2 |
各个模型在此基准测试上的表现结果
| 模型名称 | Success rate @budget 100 |
|---|---|
| graph-based-self-supervised-program-repair | 38.5 |
| spoc-search-based-pseudocode-to-code | 34.2 |