Math Word Problem Solving On Asdiv A
Métriques
Execution Accuracy
Résultats
Résultats de performance de divers modèles sur ce benchmark
Tableau comparatif
| Nom du modèle | Execution Accuracy |
|---|---|
| openmathinstruct-1-a-1-8-million-math | 84.7 |
| are-nlp-models-really-able-to-solve-simple | 76.9 |
| an-empirical-study-of-data-ability-boundary | 85.1 |
| an-empirical-study-of-data-ability-boundary | 78.6 |
| athena-mathematical-reasoning-with-thought | 86.4 |
| an-empirical-study-of-data-ability-boundary | 87.6 |
| are-nlp-models-really-able-to-solve-simple | 82.2 |
| are-nlp-models-really-able-to-solve-simple | 81.2 |
| athena-mathematical-reasoning-with-thought | 91 |