Code Generation On Wikisql
평가 지표
Exact Match Accuracy
Execution Accuracy
평가 결과
이 벤치마크에서 각 모델의 성능 결과
비교 표
| 모델 이름 | Exact Match Accuracy | Execution Accuracy |
|---|---|---|
| bidirectional-attention-for-sql-generation | 69 | 62.5 |
| typesql-knowledge-based-type-aware-neural | - | 82.6 |
| seq2sql-generating-structured-queries-from | 48.3 | 59.4 |
| content-enhanced-bert-based-text-to-sql | 83.7 | 89.2 |
| tranx-a-transition-based-neural-abstract | 68.6 | 78.6 |
| seq2sql-generating-structured-queries-from | 23.4 | 35.9 |
| natural-language-to-structured-query | 62.8 | 68.0 |
| semantic-parsing-with-syntax-and-table-aware | 61.0 | 74.6 |
| semantic-parsing-with-syntax-and-table-aware | 60.7 | 74.4 |
| typesql-knowledge-based-type-aware-neural | - | 73.5 |