Visual Question Answering Vqa On Illusionvqa
评估指标
Accuracy
评测结果
各个模型在此基准测试上的表现结果
模型名称 | Accuracy | Paper Title | Repository |
|---|---|---|---|
| GPT4-Vision | 58.85 | IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models | |
| LLaVA-1.5-13B | 40 | IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models | |
| Gemini-Pro | 51.26 | IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models | |
| InstructBLIP-13B | 34.25 | IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models | |
| Gemini-Pro 4-shot | 52.87 | IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models | |
| CogVLM | 38.16 | IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models | |
| GPT4-Vision 4-shot | 62.99 | IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models |
0 of 7 row(s) selected.