HyperAIHyperAI超神経
ホームニュース最新論文チュートリアルデータセット百科事典SOTALLMモデルGPU ランキング学会
検索
サイトについて
HyperAIHyperAI超神経

Text To Sql On Spider

評価指標

Exact Match Accuracy (Dev)
Exact Match Accuracy (Test)
Execution Accuracy (Test)

評価結果

このベンチマークにおける各モデルのパフォーマンス結果

モデル名
Exact Match Accuracy (Dev)
Exact Match Accuracy (Test)
Execution Accuracy (Test)
Paper TitleRepository
T5-3B + PICARD75.571.9 75.1PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Models-
MSc-SQL--84.7MSc-SQL: Multi-Sample Critiquing Small Language Models For Text-To-SQL Translation-
T5-3B+NatSQL+Token Preprocessing69.4-78Improving Generalization in Language Model-Based Text-to-SQL Semantic Parsing: Two Simple Semantic Boundary-Based Techniques-
datagpt-sql-7B + InvalidSQL-Feedback81.6--DataGpt-SQL-7B: An Open-Source Language Model for Text-to-SQL-
SADGA + GAP73.170.1-SADGA: Structure-Aware Dual Graph Aggregation Network for Text-to-SQL-
MAPO + TABERTLarge (K = 3)64.5--TaBERT: Pretraining for Joint Understanding of Textual and Tabular Data-
T5-SR77.272.475.2T5-SR: A Unified Seq-to-Seq Decoding Strategy for Semantic Parsing-
DAIL-SQL + GPT-4 + Self-Consistency74.4-86.6Text-to-SQL Empowered by Large Language Models: A Benchmark Evaluation-
code-davinci-002 175B (LEVER)---LEVER: Learning to Verify Language-to-Code Generation with Execution-
PET-SQL-66.687.6PET-SQL: A Prompt-Enhanced Two-Round Refinement of Text-to-SQL with Cross-consistency-
RESDSQL-3B + NatSQL80.572.079.9RESDSQL: Decoupling Schema Linking and Skeleton Parsing for Text-to-SQL-
MARLO + Claude 2.1--84.0Learning Metadata-Agnostic Representations for Text-to-SQL In-Context Example Selection-
DIN-SQL + GPT-4-6085.3DIN-SQL: Decomposed In-Context Learning of Text-to-SQL with Self-Correction-
RYANSQL (BERT)66.658.2-RYANSQL: Recursively Applying Sketch-based Slot Fillings for Complex Text-to-SQL in Cross-Domain Databases-
Graphix-3B+PICARD77.1-77.6Graphix-T5: Mixing Pre-Trained Transformers with Graph-Aware Layers for Text-to-SQL Parsing-
datagpt-sql-7B80.3--DataGpt-SQL-7B: An Open-Source Language Model for Text-to-SQL-
C3 + ChatGPT + Zero-Shot--82.3C3: Zero-shot Text-to-SQL with ChatGPT-
RATSQL + GAP71.8--Learning Contextual Representations for Semantic Parsing with Generation-Augmented Pre-Training-
XiYan-SQL--89.65A Preview of XiYan-SQL: A Multi-Generator Ensemble Framework for Text-to-SQL-
DELLM + GPT-4---Knowledge-to-SQL: Enhancing SQL Generation with Data Expert LLM-
0 of 20 row(s) selected.
Text To Sql On Spider | SOTA | HyperAI超神経