HyperAI초신경

홈 뉴스 연구 논문 튜토리얼 데이터셋 백과사전 SOTA LLM 모델 GPU 랭킹 컨퍼런스

한국어

HyperAI초신경

Text Summarization On Samsum Corpus

평가 지표

ROUGE-1

ROUGE-L

평가 결과

이 벤치마크에서 각 모델의 성능 결과

모델 이름	ROUGE-1	ROUGE-L	Paper Title	Repository
Mistral 7B + SigExt	44.1	33.9	Salient Information Prompting to Steer Content in Prompt-based Abstractive Summarization
OmniVec2	59.1	63.7	OmniVec2 - A Novel Transformer based Network for Large Scale Multimodal and Multitask Learning	-
ConDigSum	54.3	45.2	Topic-Aware Contrastive Learning for Abstractive Dialogue Summarization
MoCa	55.13	50.88	Momentum Calibration for Text Generation	-
SICK	53.73	49.5	Mind the Gap! Injecting Commonsense Knowledge for Abstractive Dialogue Summarization
HAT-CNNDM	53.01	-	Hierarchical Learning for Generation with Long Source Sequences	-
InstructDS	55.3	46.7	Instructive Dialogue Summarization with Query Aggregations
HAT-CNNDM RL	-	48.84	Hierarchical Learning for Generation with Long Source Sequences	-
GPT-4o (HPT)	-	30	Hierarchical Prompting Taxonomy: A Universal Evaluation Framework for Large Language Models
CriSPO 3-shot	47.2	38.2	CriSPO: Multi-Aspect Critique-Suggestion-guided Automatic Prompt Optimization for Text Generation
PEGASUS 2B + SliC	54.37	45.89	Calibrating Sequence likelihood Improves Conditional Language Generation	-
BART-Large	52.6	42.1	Topic-Aware Contrastive Learning for Abstractive Dialogue Summarization

0 of 12 row(s) selected.