Zero Shot Video Retrieval On Msr Vtt

评估指标

text-to-video Median Rank

text-to-video R@1

text-to-video R@10

text-to-video R@5

video-to-text Median Rank

video-to-text R@1

video-to-text R@10

video-to-text R@5

评测结果

各个模型在此基准测试上的表现结果

模型名称	text-to-video Median Rank	text-to-video R@1	text-to-video R@10	text-to-video R@5	video-to-text Median Rank	video-to-text R@1	video-to-text R@10	video-to-text R@5	Paper Title	Repository
LanguageBind(ViT-L/14)	2.0	42.8	76.0	67.5	3.0	38.3	77.8	65.8	LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignment
UMT-L (ViT-L/16)	-	42.6	73.1	64.4	-	38.6	69.6	59.8	Unmasked Teacher: Towards Training-Efficient Video Foundation Models
VideoCLIP	-	10.4	30.0	22.2	-	-	-	-	VideoCLIP: Contrastive Pre-training for Zero-shot Video-Text Understanding
Norton	-	10.7	-	24.1	-	-	-	-	Multi-granularity Correspondence Learning from Long-term Noisy Videos
mPLUG-2	-	47.1	79.0	69.7	-	-	-	-	mPLUG-2: A Modularized Multi-modal Foundation Model Across Text, Image and Video
OmniVL	-	34.6	66.6	58.4	-	-	-	-	OmniVL:One Foundation Model for Image-Language and Video-Language Tasks	-
MIL-NCE	-	9.9	32.4	24.0	-	-	-	-	End-to-End Learning of Visual Representations from Uncurated Instructional Videos
HiTeA-5M	-	29.9	62.9	54.2	-	-	-	-	HiTeA: Hierarchical Temporal-Aware Video-Language Pre-training	-
InternVideo2-1B	-	51.9	82.5	75.3	-	50.9	81.8	73.4	InternVideo2: Scaling Foundation Models for Multimodal Video Understanding
ALPRO	8	24.1	55.4	44.7	-	-	-	-	Align and Prompt: Video-and-Language Pre-training with Entity Prompts
Singularity-17M	-	34.0	66.7	56.7	-	-	-	-	Revealing Single Frame Bias for Video-and-Language Learning
MMT	66	-	-	14.4	-	-	-	-	Multi-modal Transformer for Video Retrieval
Singularity-5M	-	28.4	59.5	50.2	-	-	-	-	Revealing Single Frame Bias for Video-and-Language Learning
HiTeA-17M	-	34.4	69.9	60.0	-	-	-	-	HiTeA: Hierarchical Temporal-Aware Video-Language Pre-training	-
GRAM	-	54.8	83.9	-	-	52.9	82.9	-	Gramian Multimodal Representation Learning and Alignment
CLIP4Clip	4	32.0	66.9	57.0	-	-	-	-	CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval
SSML	-	8.0	29.3	21.3	-	-	-	-	Noise Estimation Using Density Estimation for Self-Supervised Multimodal Learning
InternVideo	-	40.7	-	-	-	39.6	-	-	InternVideo: General Video Foundation Models via Generative and Discriminative Learning
Clover	6	26.4	60	49.5	-	-	-	-	Clover: Towards A Unified Video-Language Alignment and Fusion Model
HowToCaption	3	37.6	73.3	62	-	-	-	-	HowToCaption: Prompting LLMs to Transform Video Annotations at Scale

0 of 39 row(s) selected.