HyperAIHyperAI超神経

Command Palette

Search for a command to run...

プラットフォーム

Text To Sql On Spider

評価指標

Exact Match Accuracy (Dev)
Exact Match Accuracy (Test)
Execution Accuracy (Test)

評価結果

このベンチマークにおける各モデルのパフォーマンス結果

Paper Title
datagpt-sql-7B + InvalidSQL-Feedback81.6--DataGpt-SQL-7B: An Open-Source Language Model for Text-to-SQL
RESDSQL-3B + NatSQL80.572.079.9RESDSQL: Decoupling Schema Linking and Skeleton Parsing for Text-to-SQL
datagpt-sql-7B80.3--DataGpt-SQL-7B: An Open-Source Language Model for Text-to-SQL
T5-SR77.272.475.2T5-SR: A Unified Seq-to-Seq Decoding Strategy for Semantic Parsing
Graphix-3B+PICARD77.1-77.6Graphix-T5: Mixing Pre-Trained Transformers with Graph-Aware Layers for Text-to-SQL Parsing
T5-3B + PICARD75.571.9 75.1PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Models
DAIL-SQL + GPT-4 + Self-Consistency74.4-86.6Text-to-SQL Empowered by Large Language Models: A Benchmark Evaluation
SADGA + GAP73.170.1-SADGA: Structure-Aware Dual Graph Aggregation Network for Text-to-SQL
RATSQL + GAP71.8--Learning Contextual Representations for Semantic Parsing with Generation-Augmented Pre-Training
T5-3B+NatSQL+Token Preprocessing69.4-78Improving Generalization in Language Model-Based Text-to-SQL Semantic Parsing: Two Simple Semantic Boundary-Based Techniques
RYANSQL (BERT)66.658.2-RYANSQL: Recursively Applying Sketch-based Slot Fillings for Complex Text-to-SQL in Cross-Domain Databases
MAPO + TABERTLarge (K = 3)64.5--TaBERT: Pretraining for Joint Understanding of Textual and Tabular Data
MSc-SQL--84.7MSc-SQL: Multi-Sample Critiquing Small Language Models For Text-To-SQL Translation
code-davinci-002 175B (LEVER)---LEVER: Learning to Verify Language-to-Code Generation with Execution
PET-SQL-66.687.6PET-SQL: A Prompt-Enhanced Two-Round Refinement of Text-to-SQL with Cross-consistency
MARLO + Claude 2.1--84.0Learning Metadata-Agnostic Representations for Text-to-SQL In-Context Example Selection
DIN-SQL + GPT-4-6085.3DIN-SQL: Decomposed In-Context Learning of Text-to-SQL with Self-Correction
C3 + ChatGPT + Zero-Shot--82.3C3: Zero-shot Text-to-SQL with ChatGPT
XiYan-SQL--89.65A Preview of XiYan-SQL: A Multi-Generator Ensemble Framework for Text-to-SQL
DELLM + GPT-4---Knowledge-to-SQL: Enhancing SQL Generation with Data Expert LLM
0 of 20 row(s) selected.
Text To Sql On Spider | SOTA | HyperAI超神経