HyperAI초신경

홈 뉴스 최신 연구 논문 튜토리얼 데이터셋 백과사전 SOTA LLM 모델 GPU 랭킹 컨퍼런스

한국어

HyperAI초신경

Code Generation On Wikisql

평가 지표

Exact Match Accuracy

Execution Accuracy

평가 결과

이 벤치마크에서 각 모델의 성능 결과

모델 이름	Exact Match Accuracy	Execution Accuracy	Paper Title	Repository
Bidirectional Attention for SQL Generation	69	62.5	Bidirectional Attention for SQL Generation	-
TypeSQL+TC (Yu et al., 2018)+	-	82.6	TypeSQL: Knowledge-based Type-Aware Neural Text-to-SQL Generation	-
Seq2SQL (Zhong et al., 2017)	48.3	59.4	Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learning	-
NL2SQL-RULE	83.7	89.2	Content Enhanced BERT-based Text-to-SQL Generation	-
Tranx	68.6	78.6	TRANX: A Transition-based Neural Abstract Syntax Parser for Semantic Parsing and Code Generation	-
Seq2Seq (Zhong et al., 2017)	23.4	35.9	Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learning	-
PT-MAML (Huang et al., 2018)	62.8	68.0	Natural Language to Structured Query Generation via Meta-Learning	-
STAMP+RL (Sun et al., 2018)+	61.0	74.6	Semantic Parsing with Syntax- and Table-Aware SQL Generation	-
STAMP (Sun et al., 2018)+	60.7	74.4	Semantic Parsing with Syntax- and Table-Aware SQL Generation	-
TypeSQL (Yu et al., 2018)	-	73.5	TypeSQL: Knowledge-based Type-Aware Neural Text-to-SQL Generation	-

0 of 10 row(s) selected.

Code Generation On Wikisql | SOTA | HyperAI초신경