HyperAI超神経

プラットフォーム

Table Based Fact Verification On Tabfact

評価指標

Test

Val

評価結果

このベンチマークにおける各モデルのパフォーマンス結果

			Paper Title
ARTEMIS-DA	93.1	-	ARTEMIS-DA: An Advanced Reasoning and Transformation Engine for Multi-Step Insight Synthesis in Data Analytics
Dater	93.0	-	Large Language Models are Versatile Decomposers: Decompose Evidence and Questions for Table-based Reasoning
PASTA	89.3	89.2	PASTA: Table-Operations Aware Fact Verification via Sentence-Table Cloze Pre-training
Chain-of-Table	86.61	-	Chain-of-Table: Evolving Tables in the Reasoning Chain for Table Understanding
Binder	86.0	-	Binding Language Models in Symbolic Languages
Tab-PoT	85.77	-	Efficient Prompting for LLM-based Generative Internet of Things
ReasTAP-Large	84.9	84.6	ReasTAP: Injecting Table Reasoning Skills During Pre-training via Synthetic Reasoning Examples
TAPEX-Large	84.2	84.6	TAPEX: Table Pre-training via Learning a Neural SQL Executor
T5-3b(UnifiedSKG)	83.68	83.97	UnifiedSKG: Unifying and Multi-Tasking Structured Knowledge Grounding with Text-to-Text Language Models
Salience-aware TAPAS	82.1	82.7	Table-based Fact Verification with Salience-aware Learning
TAPAS-Large classifier with Counterfactual + Synthetic pre-training	81.0	81.0	Understanding tables with intermediate pre-training
TabSQLify (col+row)	79.5	-	TabSQLify: Enhancing Reasoning Capabilities of LLMs Through Table Decomposition
NormTab (Targeted) + SQL	68.90	-	NormTab: Improving Symbolic Reasoning in LLMs Through Tabular Data Normalization
Table-BERT-Horizontal-T+F-Template	65.12	66.1	TabFact: A Large-scale Dataset for Table-based Fact Verification
BERT classifier w/o Table	50.5	50.9	TabFact: A Large-scale Dataset for Table-based Fact Verification

0 of 15 row(s) selected.

Table Based Fact Verification On Tabfact | SOTA | HyperAI超神経