Mmsql Performance On Mmsql
Metrics
TDEX
Results
Performance results of various models on this benchmark
Model Name | TDEX | Paper Title | Repository |
---|---|---|---|
SQLCoder-8B | 30.7 | Evaluating and Enhancing LLMs for Multi-turn Text-to-SQL with Multiple Question Types | |
Gemini-1.5 Flash | 65.8 | Evaluating and Enhancing LLMs for Multi-turn Text-to-SQL with Multiple Question Types | |
Llama3-8B | 64.0 | Evaluating and Enhancing LLMs for Multi-turn Text-to-SQL with Multiple Question Types | |
GPT-4 Turbo | 67.0 | Evaluating and Enhancing LLMs for Multi-turn Text-to-SQL with Multiple Question Types | |
Llama3-70B | 62.8 | Evaluating and Enhancing LLMs for Multi-turn Text-to-SQL with Multiple Question Types | |
GPT-3.5 Turbo | 64.1 | Evaluating and Enhancing LLMs for Multi-turn Text-to-SQL with Multiple Question Types |
0 of 6 row(s) selected.