HyperAIHyperAI

Command Palette

Search for a command to run...

Console

Text To Sql On Spider

المقاييس

Exact Match Accuracy (Dev)
Exact Match Accuracy (Test)
Execution Accuracy (Test)

النتائج

نتائج أداء النماذج المختلفة على هذا المعيار المرجعي

عنوان الورقةCode
datagpt-sql-7B + InvalidSQL-Feedback81.6--DataGpt-SQL-7B: An Open-Source Language Model for Text-to-SQL
RESDSQL-3B + NatSQL80.572.079.9RESDSQL: Decoupling Schema Linking and Skeleton Parsing for Text-to-SQL
datagpt-sql-7B80.3--DataGpt-SQL-7B: An Open-Source Language Model for Text-to-SQL
T5-SR77.272.475.2T5-SR: A Unified Seq-to-Seq Decoding Strategy for Semantic Parsing
Graphix-3B+PICARD77.1-77.6Graphix-T5: Mixing Pre-Trained Transformers with Graph-Aware Layers for Text-to-SQL Parsing
T5-3B + PICARD75.571.9 75.1PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Models
DAIL-SQL + GPT-4 + Self-Consistency74.4-86.6Text-to-SQL Empowered by Large Language Models: A Benchmark Evaluation
SADGA + GAP73.170.1-SADGA: Structure-Aware Dual Graph Aggregation Network for Text-to-SQL
RATSQL + GAP71.8--Learning Contextual Representations for Semantic Parsing with Generation-Augmented Pre-Training
T5-3B+NatSQL+Token Preprocessing69.4-78Improving Generalization in Language Model-Based Text-to-SQL Semantic Parsing: Two Simple Semantic Boundary-Based Techniques
RYANSQL (BERT)66.658.2-RYANSQL: Recursively Applying Sketch-based Slot Fillings for Complex Text-to-SQL in Cross-Domain Databases
MAPO + TABERTLarge (K = 3)64.5--TaBERT: Pretraining for Joint Understanding of Textual and Tabular Data
MSc-SQL--84.7MSc-SQL: Multi-Sample Critiquing Small Language Models For Text-To-SQL Translation
code-davinci-002 175B (LEVER)---LEVER: Learning to Verify Language-to-Code Generation with Execution
PET-SQL-66.687.6PET-SQL: A Prompt-Enhanced Two-Round Refinement of Text-to-SQL with Cross-consistency
MARLO + Claude 2.1--84.0Learning Metadata-Agnostic Representations for Text-to-SQL In-Context Example Selection
DIN-SQL + GPT-4-6085.3DIN-SQL: Decomposed In-Context Learning of Text-to-SQL with Self-Correction
C3 + ChatGPT + Zero-Shot--82.3C3: Zero-shot Text-to-SQL with ChatGPT
XiYan-SQL--89.65A Preview of XiYan-SQL: A Multi-Generator Ensemble Framework for Text-to-SQL
DELLM + GPT-4---Knowledge-to-SQL: Enhancing SQL Generation with Data Expert LLM
0 of 20 row(s) selected.
Text To Sql On Spider | SOTA | HyperAI