Image Captioning On Vizwiz 2020 Test Dev
Metrics
B1
B2
B3
B4
CIDEr
METEOR
ROUGE-L
SPICE
Results
Performance results of various models on this benchmark
Comparison Table
| Model Name | B1 | B2 | B3 | B4 | CIDEr | METEOR | ROUGE-L | SPICE |
|---|---|---|---|---|---|---|---|---|
| Model 1 | 72.48 | 53.93 | 38.79 | 27.35 | 80.67 | 22.21 | 50.11 | 16.96 |
| Model 2 | 65.99 | 47.98 | 33.95 | 23.68 | 60.85 | 20.12 | 46.82 | 15.31 |
| Model 3 | 69.38 | 50.82 | 36.24 | 25.39 | 69.62 | 21.02 | 48.33 | 16.63 |
| Model 4 | 65.42 | 46.73 | 32.53 | 22.61 | 58.07 | 19.66 | 46.29 | 14.97 |
| Model 5 | 68.13 | 48.94 | 34.27 | 23.87 | 65.8 | 20.64 | 47.72 | 16.01 |
| Model 6 | 72.22 | 53.84 | 39.28 | 28.27 | 79.15 | 22.12 | 50.27 | 17.9 |
| Model 7 | 70.21 | 51.67 | 36.92 | 26.01 | 72.54 | 21.1 | 48.56 | 16.4 |
| Model 8 | 70.27 | 52.23 | 37.71 | 26.77 | 72.61 | 21.6 | 49.46 | 17.25 |
| Model 9 | 55.11 | 35.05 | 21.34 | 13.49 | 20.19 | 13.57 | 37.83 | 6.98 |
| Model 10 | 66.08 | 47.67 | 33.51 | 23.41 | 60.86 | 20.03 | 46.82 | 15.28 |
| Model 11 | 65.55 | 46.78 | 32.5 | 22.34 | 58.61 | 19.74 | 46.3 | 15.06 |
| Model 12 | 70.23 | 51.72 | 36.96 | 26.1 | 71.89 | 21.05 | 48.52 | 16.31 |
| Model 13 | 69.74 | 50.87 | 36.26 | 25.54 | 71.58 | 21.01 | 48.53 | 16.33 |
| Model 14 | 69.31 | 51.01 | 36.7 | 26.16 | 69.33 | 21.0 | 48.47 | 16.17 |
| Model 15 | 69.54 | 51.0 | 36.56 | 25.95 | 70.59 | 21.1 | 48.62 | 16.63 |
| Model 16 | 69.99 | 51.52 | 36.82 | 26.0 | 72.02 | 20.97 | 48.36 | 16.18 |
| Model 17 | 68.02 | 49.32 | 35.14 | 24.99 | 73.52 | 20.5 | 47.52 | 16.18 |
| Model 18 | 69.95 | 51.39 | 36.64 | 25.93 | 72.1 | 21.02 | 48.64 | 16.56 |
| Model 19 | 70.88 | 52.62 | 38.22 | 27.36 | 75.93 | 21.84 | 49.8 | 17.89 |
| Model 20 | 69.8 | 51.52 | 36.88 | 26.12 | 71.69 | 21.02 | 48.45 | 16.18 |
| Model 21 | 67.52 | 48.71 | 34.23 | 23.76 | 62.73 | 20.42 | 47.52 | 15.74 |
| Model 22 | 71.25 | 52.99 | 38.42 | 27.4 | 77.31 | 22.02 | 49.97 | 17.86 |
| Model 23 | 70.0 | 51.63 | 36.89 | 26.04 | 72.37 | 21.03 | 48.46 | 16.08 |
| Model 24 | 69.28 | 50.79 | 35.85 | 25.08 | 70.42 | 21.06 | 48.33 | 15.92 |
| Model 25 | 70.44 | 51.73 | 36.86 | 26.05 | 71.43 | 21.02 | 48.6 | 16.06 |
| Model 26 | 70.23 | 51.66 | 36.83 | 25.92 | 71.99 | 20.94 | 48.53 | 16.34 |
| Model 27 | 70.04 | 52.1 | 37.72 | 27.04 | 73.26 | 21.3 | 48.68 | 16.57 |
| Model 28 | 69.96 | 52.04 | 37.71 | 27.08 | 73.41 | 21.3 | 48.68 | 16.6 |
| Model 29 | 67.29 | 48.65 | 34.23 | 23.42 | 58.76 | 19.57 | 47.08 | 14.57 |
| Model 30 | 65.99 | 47.98 | 33.95 | 23.68 | 60.85 | 20.12 | 46.82 | 15.39 |
| Model 31 | 69.08 | 50.8 | 36.46 | 25.94 | 68.98 | 20.91 | 48.28 | 16.17 |
| Model 32 | 69.92 | 51.5 | 36.71 | 25.74 | 72.03 | 20.94 | 48.44 | 16.13 |
| Model 33 | 65.89 | 47.43 | 33.28 | 23.15 | 60.5 | 19.95 | 46.64 | 15.16 |
| Model 34 | 70.03 | 51.41 | 36.75 | 26.0 | 72.39 | 21.07 | 48.45 | 16.27 |
| Model 35 | 70.12 | 51.47 | 37.0 | 26.34 | 71.26 | 21.11 | 48.78 | 16.71 |
| Model 36 | 69.13 | 51.07 | 36.72 | 25.96 | 71.34 | 21.41 | 48.81 | 16.77 |
| Model 37 | 70.05 | 51.65 | 36.89 | 26.07 | 72.48 | 21.02 | 48.43 | 16.06 |
| Model 38 | 67.9 | 49.16 | 34.57 | 24.24 | 63.94 | 20.5 | 47.65 | 15.88 |
| Model 39 | 70.67 | 52.31 | 37.73 | 26.85 | 73.51 | 21.37 | 49.19 | 16.97 |
| Model 40 | 66.25 | 48.03 | 34.03 | 23.97 | 63.72 | 20.33 | 46.85 | 15.74 |
| Model 41 | 70.02 | 51.62 | 36.85 | 25.99 | 72.21 | 21.01 | 48.44 | 16.17 |
| Model 42 | 70.03 | 51.48 | 36.61 | 25.8 | 70.78 | 21.06 | 48.47 | 16.4 |
| Model 43 | 70.05 | 51.5 | 36.72 | 25.94 | 71.95 | 21.1 | 48.48 | 16.36 |
| Model 44 | 31.29 | 22.01 | 15.81 | 11.29 | 25.51 | 8.72 | 21.78 | 6.5 |
| Model 45 | 70.04 | 51.25 | 36.64 | 25.91 | 71.04 | 21.15 | 48.71 | 16.72 |
| Model 46 | 70.27 | 52.23 | 37.71 | 26.77 | 72.61 | 21.6 | 49.46 | 17.18 |
| Model 47 | 66.23 | 47.93 | 33.84 | 23.7 | 62.18 | 20.24 | 47.13 | 15.24 |
| Model 48 | 70.03 | 52.12 | 37.76 | 27.09 | 73.47 | 21.29 | 48.73 | 16.67 |
| Model 49 | 69.75 | 51.82 | 37.39 | 26.74 | 72.76 | 21.34 | 48.65 | 16.75 |
| Model 50 | 71.82 | 53.38 | 38.67 | 27.69 | 77.21 | 21.75 | 49.61 | 17.44 |