HyperAIHyperAI超神経
ホームニュース論文チュートリアルデータセット百科事典SOTALLMモデルGPU ランキング学会
検索
サイトについて
HyperAIHyperAI超神経

Code Generation On Wikisql

評価指標

Exact Match Accuracy
Execution Accuracy

評価結果

このベンチマークにおける各モデルのパフォーマンス結果

モデル名
Exact Match Accuracy
Execution Accuracy
Paper TitleRepository
Bidirectional Attention for SQL Generation6962.5Bidirectional Attention for SQL Generation
TypeSQL+TC (Yu et al., 2018)+-82.6TypeSQL: Knowledge-based Type-Aware Neural Text-to-SQL Generation
Seq2SQL (Zhong et al., 2017)48.359.4Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learning
NL2SQL-RULE83.789.2Content Enhanced BERT-based Text-to-SQL Generation
Tranx68.678.6TRANX: A Transition-based Neural Abstract Syntax Parser for Semantic Parsing and Code Generation
Seq2Seq (Zhong et al., 2017)23.435.9Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learning
PT-MAML (Huang et al., 2018)62.868.0Natural Language to Structured Query Generation via Meta-Learning
STAMP+RL (Sun et al., 2018)+61.074.6Semantic Parsing with Syntax- and Table-Aware SQL Generation-
STAMP (Sun et al., 2018)+60.774.4Semantic Parsing with Syntax- and Table-Aware SQL Generation-
TypeSQL (Yu et al., 2018)-73.5TypeSQL: Knowledge-based Type-Aware Neural Text-to-SQL Generation
0 of 10 row(s) selected.