Text To Sql On Spider 1
평가 지표
Exact Match Accuracy (in Dev)
Execution Accuracy (in Dev)
평가 결과
이 벤치마크에서 각 모델의 성능 결과
모델 이름 | Exact Match Accuracy (in Dev) | Execution Accuracy (in Dev) | Paper Title | Repository |
|---|---|---|---|---|
| T5-3B+PICARD | 75.5 | 79.3 | PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Models | |
| RASAT | 72.6 | 76.6 | RASAT: Integrating Relational Structures into Pretrained Seq2Seq Model for Text-to-SQL | |
| T5-3B | 71.5 | 74.4 | PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Models | |
| RASAT+PICARD | 75.3 | 80.5 | RASAT: Integrating Relational Structures into Pretrained Seq2Seq Model for Text-to-SQL |
0 of 4 row(s) selected.