Object Localization On Illusionvqa
Metrics
Accuracy
Results
Performance results of various models on this benchmark
Model Name | Accuracy | Paper Title | Repository |
|---|---|---|---|
| GPT4-Vision 4-shot+CoT | 49.7 | IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models | - |
| GPT4-Vision | 40 | IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models | - |
| Gemini-Pro 4-shot | 41.8 | IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models | - |
| InstructBLIP-13B | 24.3 | IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models | - |
| LLaVA-1.5-13B | 24.8 | IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models | - |
| CogVLM | 28 | IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models | - |
| Gemini-Pro | 43.5 | IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models | - |
| GPT4-Vision 4-shot | 46 | IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models | - |
| Gemini-Pro 4-shot+CoT | 33.9 | IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models | - |
0 of 9 row(s) selected.