HyperAI초신경

홈 뉴스 최신 연구 논문 튜토리얼 데이터셋 백과사전 SOTA LLM 모델 GPU 랭킹 컨퍼런스

한국어

HyperAI초신경

Mmsql Performance On Mmsql

평가 지표

TDEX

평가 결과

이 벤치마크에서 각 모델의 성능 결과

모델 이름	TDEX	Paper Title	Repository
SQLCoder-8B	30.7	Evaluating and Enhancing LLMs for Multi-turn Text-to-SQL with Multiple Question Types
Gemini-1.5 Flash	65.8	Evaluating and Enhancing LLMs for Multi-turn Text-to-SQL with Multiple Question Types
Llama3-8B	64.0	Evaluating and Enhancing LLMs for Multi-turn Text-to-SQL with Multiple Question Types
GPT-4 Turbo	67.0	Evaluating and Enhancing LLMs for Multi-turn Text-to-SQL with Multiple Question Types
Llama3-70B	62.8	Evaluating and Enhancing LLMs for Multi-turn Text-to-SQL with Multiple Question Types
GPT-3.5 Turbo	64.1	Evaluating and Enhancing LLMs for Multi-turn Text-to-SQL with Multiple Question Types

0 of 6 row(s) selected.