Text To Sql On Spider 1

Exact Match Accuracy (in Dev)

Execution Accuracy (in Dev)

Results

Performance results of various models on this benchmark

			Paper Title
T5-3B+PICARD	75.5	79.3	PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Models
RASAT+PICARD	75.3	80.5	RASAT: Integrating Relational Structures into Pretrained Seq2Seq Model for Text-to-SQL
RASAT	72.6	76.6	RASAT: Integrating Relational Structures into Pretrained Seq2Seq Model for Text-to-SQL
T5-3B	71.5	74.4	PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Models

0 of 4 row(s) selected.