HyperAI超神経

ホームニュース論文チュートリアルデータセット百科事典 SOTA LLMモデル GPU ランキング学会

サイトについて

日本語

HyperAI超神経

Text Summarization On Samsum Corpus

評価指標

ROUGE-1

ROUGE-L

評価結果

このベンチマークにおける各モデルのパフォーマンス結果

モデル名	ROUGE-1	ROUGE-L	Paper Title	Repository
Mistral 7B + SigExt	44.1	33.9	Salient Information Prompting to Steer Content in Prompt-based Abstractive Summarization
OmniVec2	59.1	63.7	OmniVec2 - A Novel Transformer based Network for Large Scale Multimodal and Multitask Learning	-
ConDigSum	54.3	45.2	Topic-Aware Contrastive Learning for Abstractive Dialogue Summarization
MoCa	55.13	50.88	Momentum Calibration for Text Generation	-
SICK	53.73	49.5	Mind the Gap! Injecting Commonsense Knowledge for Abstractive Dialogue Summarization
HAT-CNNDM	53.01	-	Hierarchical Learning for Generation with Long Source Sequences	-
InstructDS	55.3	46.7	Instructive Dialogue Summarization with Query Aggregations
HAT-CNNDM RL	-	48.84	Hierarchical Learning for Generation with Long Source Sequences	-
GPT-4o (HPT)	-	30	Hierarchical Prompting Taxonomy: A Universal Evaluation Framework for Large Language Models
CriSPO 3-shot	47.2	38.2	CriSPO: Multi-Aspect Critique-Suggestion-guided Automatic Prompt Optimization for Text Generation
PEGASUS 2B + SliC	54.37	45.89	Calibrating Sequence likelihood Improves Conditional Language Generation	-
BART-Large	52.6	42.1	Topic-Aware Contrastive Learning for Abstractive Dialogue Summarization

0 of 12 row(s) selected.