HyperAI초신경

홈 뉴스 연구 논문 튜토리얼 데이터셋 백과사전 SOTA LLM 모델 GPU 랭킹 컨퍼런스

한국어

HyperAI초신경

Dialogue State Tracking On Cosql

평가 지표

interaction match accuracy

question match accuracy

평가 결과

이 벤치마크에서 각 모델의 성능 결과

모델 이름	interaction match accuracy	question match accuracy	Paper Title	Repository
GAZP+BERT	12.8	39.7	Grounded Adaptation for Zero-shot Executable Semantic Parsing
SyntaxSQL-con	2.2	14.1	CoSQL: A Conversational Text-to-SQL Challenge Towards Cross-Domain Natural Language Interfaces to Databases
RASAT+PICARD	26.5	55.7	RASAT: Integrating Relational Structures into Pretrained Seq2Seq Model for Text-to-SQL
HIE-SQL + GraPPa	24.6	53.9	HIE-SQL: History Information Enhanced Network for Context-Dependent Text-to-SQL Semantic Parsing	-
CD-Seq2seq	2.6	13.9	CoSQL: A Conversational Text-to-SQL Challenge Towards Cross-Domain Natural Language Interfaces to Databases
R²SQL + BERT	17.0	46.8	Dynamic Hybrid Relation Network for Cross-Domain Context-Dependent Semantic Parsing
RAT-SQL + SCoRe	21.2	51.6	SCoRe: Pre-Training for Context Representation in Conversational Semantic Parsing	-
Edit-SQL+BERT	13.7	40.8	Editing-Based SQL Query Generation for Cross-Domain Context-Dependent Questions
T5-3B + PICARD	23.7	54.6	PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Models

0 of 9 row(s) selected.