Multimodal Reasoning On Rebus

Metrics

Accuracy

Results

Performance results of various models on this benchmark

		Paper Title
GPT-4V	24.0	REBUS: A Robust Evaluation Benchmark of Understanding Symbols
Gemini Pro	13.2	REBUS: A Robust Evaluation Benchmark of Understanding Symbols
LLaVa-1.5-13B	1.8	REBUS: A Robust Evaluation Benchmark of Understanding Symbols
LLaVa-1.5-7B	1.5	REBUS: A Robust Evaluation Benchmark of Understanding Symbols
BLIP2-FLAN-T5-XXL	0.9	REBUS: A Robust Evaluation Benchmark of Understanding Symbols
CogVLM	0.9	REBUS: A Robust Evaluation Benchmark of Understanding Symbols
QWEN	0.9	REBUS: A Robust Evaluation Benchmark of Understanding Symbols
InstructBLIP	0.6	REBUS: A Robust Evaluation Benchmark of Understanding Symbols

0 of 8 row(s) selected.

Multimodal Reasoning On Rebus | SOTA | HyperAI