Math Word Problem Solving On Asdiv A
Metrics
Execution Accuracy
Results
Performance results of various models on this benchmark
Comparison Table
| Model Name | Execution Accuracy |
|---|---|
| openmathinstruct-1-a-1-8-million-math | 84.7 |
| are-nlp-models-really-able-to-solve-simple | 76.9 |
| an-empirical-study-of-data-ability-boundary | 85.1 |
| an-empirical-study-of-data-ability-boundary | 78.6 |
| athena-mathematical-reasoning-with-thought | 86.4 |
| an-empirical-study-of-data-ability-boundary | 87.6 |
| are-nlp-models-really-able-to-solve-simple | 82.2 |
| are-nlp-models-really-able-to-solve-simple | 81.2 |
| athena-mathematical-reasoning-with-thought | 91 |