Text To Sql On Spider 1
Metrics
Exact Match Accuracy (in Dev)
Execution Accuracy (in Dev)
Results
Performance results of various models on this benchmark
Model Name | Exact Match Accuracy (in Dev) | Execution Accuracy (in Dev) | Paper Title | Repository |
|---|---|---|---|---|
| T5-3B+PICARD | 75.5 | 79.3 | PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Models | |
| RASAT | 72.6 | 76.6 | RASAT: Integrating Relational Structures into Pretrained Seq2Seq Model for Text-to-SQL | |
| T5-3B | 71.5 | 74.4 | PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Models | |
| RASAT+PICARD | 75.3 | 80.5 | RASAT: Integrating Relational Structures into Pretrained Seq2Seq Model for Text-to-SQL |
0 of 4 row(s) selected.