Object Localization On Reverie
評価指標
Nav-Length
Nav-OSucc
Nav-SPL
Nav-Succ
RGS
RGSPL
評価結果
このベンチマークにおける各モデルのパフォーマンス結果
モデル名 | Nav-Length | Nav-OSucc | Nav-SPL | Nav-Succ | RGS | RGSPL | Paper Title | Repository |
|---|---|---|---|---|---|---|---|---|
| Airbert | 17.91 | 34.2 | 23.61 | 30.28 | 16.83 | 13.28 | - | - |
| SIA | 48.61 | 44.56 | 14.85 | 30.8 | 19.02 | 9.2 | - | - |
| REVERIE_Baseline | 39.05 | 30.63 | 11.61 | 19.88 | 11.28 | 6.08 | - | - |
| no init. OSCAR | 14.09 | 20.18 | 15.47 | 18.52 | 8.8 | 7.29 | - | - |
| init. OSCAR | 14.88 | 26.67 | 19.48 | 24.62 | 12.65 | 10.0 | - | - |
| 1637 | 13.7 | 37.84 | 22.26 | 31.04 | 19.47 | 14.03 | - | - |
| eaq | 36.54 | 31.88 | 11.91 | 21.61 | 11.41 | 6.18 | - | - |
| CVPR22 | 21.3 | 56.91 | 36.06 | 52.51 | 31.88 | 22.06 | - | - |
| OSMaN | 8.67 | 57.12 | 47.78 | 50.16 | 34.69 | 32.99 | - | - |
| damm1 | 13.3 | 39.57 | 31.34 | 35.52 | 18.04 | 15.96 | - | - |
| Shanks | 17.18 | 53.81 | 37.01 | 50.33 | 31.69 | 22.85 | - | - |
| SUSA | 17.86 | - | 41.54 | 54.39 | 36.11 | 27.31 | Agent Journey Beyond RGB: Unveiling Hybrid Semantic-Spatial Environmental Representations for Vision-and-Language Navigation | |
| init. PREVALENT | 15.86 | 32.91 | 23.99 | 29.61 | 16.5 | 13.51 | - | - |
0 of 13 row(s) selected.