Visual Question Answering 1
Benchmark List
All benchmarks related to this task
amber
Best model: RLAIF-V 12B
Metrics
View Details
benchlmm
Best model: GPT-4V
Metrics
View Details
clevr
Best model: NeSyCoCo Neuro-Symbolic
Metrics
View Details
earthvqa
Best model: SOBA
Metrics
View Details
grit
Best model: OFA
Metrics
View Details
mm-vet
Best model: Gemini 1.5 Pro (gemini-1.5-pro-002)
Metrics
View Details
mm-vet-w-o-external-tools
Best model: Emu-14B
Metrics
View Details
mmbench
Best model: LLaVA-InternLM2-ViT + MoSLoRA
Metrics
View Details
msrvtt-qa
Best model: Aurora (ours, r=64) Aurora (ours, r=64)
Metrics
View Details
textvqa-test-standard
Best model: PromptCap
Metrics
View Details
v-bench
Best model: IVM-Enhanced GPT4-V
Metrics
View Details
vip-bench
Best model: GPT-4V-turbo-detail:high (Visual Prompt)
Metrics
View Details
visualmrc
Best model: LayoutT5 (Large)
Metrics
View Details
vizwiz
Best model: Emu-I *
Metrics
View Details
vqa-v2
Best model: RLHF-V
Metrics
View Details
vqa-v2-test-dev
Best model: BLIP-2 ViT-G OPT 6.7B (fine-tuned)
Metrics
View Details
vqa-v2-test-std
Best model: LXMERT (low-magnitude pruning)
Metrics
View Details
coco
Metrics
View Details
coco-visual-question-answering-vqa-real-2
Metrics
View Details
gqa
Metrics
View Details
mapeval-visual
Metrics
View Details
mm-vet-v2
Metrics
View Details
mmhal-bench
Metrics
View Details
msvd-qa
Metrics
View Details
plotqa-d1
Metrics
View Details
plotqa-d2
Metrics
View Details
vqa-v2-val
Metrics
View Details