Text To Sql On Spider 1
評価指標
Exact Match Accuracy (in Dev)
Execution Accuracy (in Dev)
評価結果
このベンチマークにおける各モデルのパフォーマンス結果
モデル名 | Exact Match Accuracy (in Dev) | Execution Accuracy (in Dev) | Paper Title | Repository |
|---|---|---|---|---|
| T5-3B+PICARD | 75.5 | 79.3 | PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Models | |
| RASAT | 72.6 | 76.6 | RASAT: Integrating Relational Structures into Pretrained Seq2Seq Model for Text-to-SQL | |
| T5-3B | 71.5 | 74.4 | PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Models | |
| RASAT+PICARD | 75.3 | 80.5 | RASAT: Integrating Relational Structures into Pretrained Seq2Seq Model for Text-to-SQL |
0 of 4 row(s) selected.