HyperAI초신경

홈 뉴스 최신 연구 논문 튜토리얼 데이터셋 백과사전 SOTA LLM 모델 GPU 랭킹 컨퍼런스

한국어

HyperAI초신경

Visual Question Answering On Vip Bench

평가 지표

GPT-4 score (bbox)

GPT-4 score (human)

평가 결과

이 벤치마크에서 각 모델의 성능 결과

모델 이름	GPT-4 score (bbox)	GPT-4 score (human)	Paper Title	Repository
LLaVA-NeXT-Inst-IT-Qwen2-7B (Visual Prompt	50.5	49.0	Inst-IT: Boosting Multimodal Instance Understanding via Explicit Visual Prompt Instruction Tuning	-
InstructBLIP-13B (Visual Prompt)	35.8	35.2	InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuning
GPT-4V-turbo-detail:high (Visual Prompt)	60.7	59.9	GPT-4 Technical Report
GPT4ROI 7B (ROI)	35.1	-	GPT4RoI: Instruction Tuning Large Language Model on Region-of-Interest
Kosmos-2 (Discrete Token)	26.9	-	Kosmos-2: Grounding Multimodal Large Language Models to the World
Qwen-VL-Chat (Coordinates)	45.3	-	Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyond
LLaVA-1.5-13B (Visual Prompt)	41.8	42.9	Improved Baselines with Visual Instruction Tuning
Shikra-7B (Coordinates)	33.7	-	Shikra: Unleashing Multimodal LLM's Referential Dialogue Magic
LLaVA-1.5-13B (Coordinates)	47.1	-	Improved Baselines with Visual Instruction Tuning
GPT-4V-turbo-detail:low (Visual Prompt)	52.8	51.4	GPT-4 Technical Report
Qwen-VL-Chat (Visual Prompt)	39.2	41.7	Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyond
LLaVA-NeXT-Inst-IT-Vicuna-7B (Visual Prompt	45.1	48.2	Inst-IT: Boosting Multimodal Instance Understanding via Explicit Visual Prompt Instruction Tuning	-
ViP-LLaVA-13B (Visual Prompt)	48.3	48.2	Making Large Language Models Better Data Creators

0 of 13 row(s) selected.