Object Localization On Reverie
Metrics
Nav-Length
Nav-OSucc
Nav-SPL
Nav-Succ
RGS
RGSPL
Results
Performance results of various models on this benchmark
Comparison Table
| Model Name | Nav-Length | Nav-OSucc | Nav-SPL | Nav-Succ | RGS | RGSPL |
|---|---|---|---|---|---|---|
| Model 1 | 17.91 | 34.2 | 23.61 | 30.28 | 16.83 | 13.28 |
| Model 2 | 48.61 | 44.56 | 14.85 | 30.8 | 19.02 | 9.2 |
| Model 3 | 39.05 | 30.63 | 11.61 | 19.88 | 11.28 | 6.08 |
| Model 4 | 14.09 | 20.18 | 15.47 | 18.52 | 8.8 | 7.29 |
| Model 5 | 14.88 | 26.67 | 19.48 | 24.62 | 12.65 | 10.0 |
| Model 6 | 13.7 | 37.84 | 22.26 | 31.04 | 19.47 | 14.03 |
| Model 7 | 36.54 | 31.88 | 11.91 | 21.61 | 11.41 | 6.18 |
| Model 8 | 21.3 | 56.91 | 36.06 | 52.51 | 31.88 | 22.06 |
| Model 9 | 8.67 | 57.12 | 47.78 | 50.16 | 34.69 | 32.99 |
| Model 10 | 13.3 | 39.57 | 31.34 | 35.52 | 18.04 | 15.96 |
| Model 11 | 17.18 | 53.81 | 37.01 | 50.33 | 31.69 | 22.85 |
| agent-journey-beyond-rgb-unveiling-hybrid | 17.86 | - | 41.54 | 54.39 | 36.11 | 27.31 |
| Model 13 | 15.86 | 32.91 | 23.99 | 29.61 | 16.5 | 13.51 |