Slot Filling On Kilt Zero Shot Re
Metrics
Accuracy
F1
KILT-AC
KILT-F1
R-Prec
Recall@5
Results
Performance results of various models on this benchmark
Comparison Table
| Model Name | Accuracy | F1 | KILT-AC | KILT-F1 | R-Prec | Recall@5 |
|---|---|---|---|---|---|---|
| Model 1 | 11.22 | 16.79 | 0.0 | 0.0 | 0.0 | 0.0 |
| learning-dense-representations-of-phrases-at | 47.42 | 54.75 | 41.34 | 46.79 | 57.43 | 60.47 |
| Model 3 | 36.55 | 44.94 | 0.0 | 0.0 | 0.0 | 0.0 |
| kilt-a-benchmark-for-knowledge-intensive | 9.02 | 13.52 | 0.0 | 0.0 | 0.0 | 0.0 |
| Model 5 | 57.95 | 63.75 | 50.64 | 55.44 | 80.91 | 93.05 |
| Model 6 | 9.14 | 12.21 | 0.0 | 0.0 | 0.0 | 0.0 |
| Model 7 | 3.38 | 10.44 | 0.0 | 0.0 | 0.0 | 0.0 |
| Model 8 | 68.97 | 74.47 | 68.32 | 73.45 | 94.18 | 95.19 |
| Model 9 | 44.74 | 49.95 | 36.83 | 39.91 | 53.73 | 59.52 |
| Model 10 | 36.23 | 40.34 | 34.13 | 37.22 | 61.34 | 63.85 |
| Model 11 | 73.96 | 78.43 | 67.2 | 70.99 | 89.63 | 97.87 |
| Model 12 | 30.43 | 34.47 | 18.91 | 20.32 | 28.9 | 39.21 |
| Model 13 | 6.93 | 37.28 | 4.47 | 27.09 | 40.11 | 40.11 |
| Model 14 | 47.42 | 54.75 | 41.34 | 46.79 | 57.43 | 60.47 |
| Model 15 | 0.0 | 0.0 | 0.0 | 0.0 | 98.27 | 98.89 |
| Model 16 | 71.61 | 76.6 | 71.1 | 75.86 | 95.81 | 96.64 |
| Model 17 | 74.63 | 79.66 | 73.2 | 78.12 | 97.99 | 99.34 |
| Model 18 | 0.0 | 0.0 | 0.0 | 0.0 | 96.15 | 98.71 |
| Model 19 | 0.0 | 0.0 | 0.0 | 0.0 | 80.91 | 93.05 |
| Model 20 | 72.55 | 77.05 | 72.31 | 76.69 | 98.49 | 99.23 |
| Model 21 | 0.02 | 2.1 | 0.0 | 1.85 | 95.81 | 97.83 |