HyperAI초신경

홈 뉴스 최신 연구 논문 튜토리얼 데이터셋 백과사전 SOTA LLM 모델 GPU 랭킹 컨퍼런스

한국어

HyperAI초신경

Table Based Fact Verification On Tabfact

평가 지표

Test

Val

평가 결과

이 벤치마크에서 각 모델의 성능 결과

모델 이름	Test	Val	Paper Title	Repository
TAPAS-Large classifier with Counterfactual + Synthetic pre-training	81.0	81.0	Understanding tables with intermediate pre-training
PASTA	89.3	89.2	PASTA: Table-Operations Aware Fact Verification via Sentence-Table Cloze Pre-training	-
T5-3b(UnifiedSKG)	83.68	83.97	UnifiedSKG: Unifying and Multi-Tasking Structured Knowledge Grounding with Text-to-Text Language Models
Table-BERT-Horizontal-T+F-Template	65.12	66.1	TabFact: A Large-scale Dataset for Table-based Fact Verification
ARTEMIS-DA	93.1	-	ARTEMIS-DA: An Advanced Reasoning and Transformation Engine for Multi-Step Insight Synthesis in Data Analytics	-
Binder	86.0	-	Binding Language Models in Symbolic Languages
TabSQLify (col+row)	79.5	-	TabSQLify: Enhancing Reasoning Capabilities of LLMs Through Table Decomposition	-
ReasTAP-Large	84.9	84.6	ReasTAP: Injecting Table Reasoning Skills During Pre-training via Synthetic Reasoning Examples	-
Chain-of-Table	86.61	-	Chain-of-Table: Evolving Tables in the Reasoning Chain for Table Understanding
Tab-PoT	85.77	-	Efficient Prompting for LLM-based Generative Internet of Things	-
TAPEX-Large	84.2	84.6	TAPEX: Table Pre-training via Learning a Neural SQL Executor
NormTab (Targeted) + SQL	68.90	-	NormTab: Improving Symbolic Reasoning in LLMs Through Tabular Data Normalization
BERT classifier w/o Table	50.5	50.9	TabFact: A Large-scale Dataset for Table-based Fact Verification
Dater	93.0	-	Large Language Models are Versatile Decomposers: Decompose Evidence and Questions for Table-based Reasoning
Salience-aware TAPAS	82.1	82.7	Table-based Fact Verification with Salience-aware Learning

0 of 15 row(s) selected.