HyperAIHyperAI초신경

Command Palette

Search for a command to run...

플랫폼

Text To Sql On Spider

평가 지표

Exact Match Accuracy (Dev)
Exact Match Accuracy (Test)
Execution Accuracy (Test)

평가 결과

이 벤치마크에서 각 모델의 성능 결과

Paper Title
datagpt-sql-7B + InvalidSQL-Feedback81.6--DataGpt-SQL-7B: An Open-Source Language Model for Text-to-SQL
RESDSQL-3B + NatSQL80.572.079.9RESDSQL: Decoupling Schema Linking and Skeleton Parsing for Text-to-SQL
datagpt-sql-7B80.3--DataGpt-SQL-7B: An Open-Source Language Model for Text-to-SQL
T5-SR77.272.475.2T5-SR: A Unified Seq-to-Seq Decoding Strategy for Semantic Parsing
Graphix-3B+PICARD77.1-77.6Graphix-T5: Mixing Pre-Trained Transformers with Graph-Aware Layers for Text-to-SQL Parsing
T5-3B + PICARD75.571.9 75.1PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Models
DAIL-SQL + GPT-4 + Self-Consistency74.4-86.6Text-to-SQL Empowered by Large Language Models: A Benchmark Evaluation
SADGA + GAP73.170.1-SADGA: Structure-Aware Dual Graph Aggregation Network for Text-to-SQL
RATSQL + GAP71.8--Learning Contextual Representations for Semantic Parsing with Generation-Augmented Pre-Training
T5-3B+NatSQL+Token Preprocessing69.4-78Improving Generalization in Language Model-Based Text-to-SQL Semantic Parsing: Two Simple Semantic Boundary-Based Techniques
RYANSQL (BERT)66.658.2-RYANSQL: Recursively Applying Sketch-based Slot Fillings for Complex Text-to-SQL in Cross-Domain Databases
MAPO + TABERTLarge (K = 3)64.5--TaBERT: Pretraining for Joint Understanding of Textual and Tabular Data
MSc-SQL--84.7MSc-SQL: Multi-Sample Critiquing Small Language Models For Text-To-SQL Translation
code-davinci-002 175B (LEVER)---LEVER: Learning to Verify Language-to-Code Generation with Execution
PET-SQL-66.687.6PET-SQL: A Prompt-Enhanced Two-Round Refinement of Text-to-SQL with Cross-consistency
MARLO + Claude 2.1--84.0Learning Metadata-Agnostic Representations for Text-to-SQL In-Context Example Selection
DIN-SQL + GPT-4-6085.3DIN-SQL: Decomposed In-Context Learning of Text-to-SQL with Self-Correction
C3 + ChatGPT + Zero-Shot--82.3C3: Zero-shot Text-to-SQL with ChatGPT
XiYan-SQL--89.65A Preview of XiYan-SQL: A Multi-Generator Ensemble Framework for Text-to-SQL
DELLM + GPT-4---Knowledge-to-SQL: Enhancing SQL Generation with Data Expert LLM
0 of 20 row(s) selected.
Text To Sql On Spider | SOTA | HyperAI초신경