Knowledge Base Question Answering On Grailqa
Métriques
Compositional EM
Compositional F1
I.I.D. EM
I.I.D. F1
Overall EM
Overall F1
Zero-shot EM
Zero-shot F1
Résultats
Résultats de performance de divers modèles sur ce benchmark
Tableau comparatif
| Nom du modèle | Compositional EM | Compositional F1 | I.I.D. EM | I.I.D. F1 | Overall EM | Overall F1 | Zero-shot EM | Zero-shot F1 |
|---|---|---|---|---|---|---|---|---|
| retrack-a-flexible-and-efficient-framework | 61.5 | 70.9 | 84.4 | 87.5 | 58.1 | 65.3 | 44.6 | 52.5 |
| paths-over-graph-knowledge-graph-enpowered | - | - | - | - | - | - | - | - |