Command Palette
Search for a command to run...
3 months ago
Benchmarking Geospatial Question Answering Engines using the Dataset GeoQuestions1089
{Pierre Maret Manolis Koubarakis Myrto Tsokanaridou Michail Mitsios Mariangela Pollali Konstantinos Plas Eleni Tsalapati Dharmen Punjani Sergios-Anestis Kefalidis}

Abstract
We present the dataset GeoQuestions1089 for benchmarking geospatial question answering engines. GeoQuestions1089 is thelargest such dataset available presently and it contains 1089 questions, their corresponding GeoSPARQL or SPARQL queries and their answers over the geospatial knowledge graph YAGO2geo. We use GeoQuestions1089 to evaluate the effectiveness and efficiency of geospatial question answering engines GeoQA2 (an extension of GeoQA developed by our group) and the system of Hamzei et al. (2022).
Benchmarks
| Benchmark | Methodology | Metrics | 
|---|---|---|
| question-answering-on-geoquestions1089 | Hamzei et al. | Percentage correct: 19.04%  | 
| question-answering-on-geoquestions1089 | GeoQA2 | Percentage correct: 38.28%  | 
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.
AI Co-coding
Ready-to-use GPUs
Best Pricing
Hyper Newsletters
Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning 
Powered by  MailChimp