Object Localization On Illusionvqa
評価指標
Accuracy
評価結果
このベンチマークにおける各モデルのパフォーマンス結果
モデル名 | Accuracy | Paper Title | Repository |
---|---|---|---|
GPT4-Vision 4-shot+CoT | 49.7 | IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models | |
GPT4-Vision | 40 | IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models | |
Gemini-Pro 4-shot | 41.8 | IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models | |
InstructBLIP-13B | 24.3 | IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models | |
LLaVA-1.5-13B | 24.8 | IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models | |
CogVLM | 28 | IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models | |
Gemini-Pro | 43.5 | IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models | |
GPT4-Vision 4-shot | 46 | IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models | |
Gemini-Pro 4-shot+CoT | 33.9 | IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models |
0 of 9 row(s) selected.