Math Word Problem Solving On Asdiv A
評価指標
Execution Accuracy
評価結果
このベンチマークにおける各モデルのパフォーマンス結果
比較表
| モデル名 | Execution Accuracy |
|---|---|
| openmathinstruct-1-a-1-8-million-math | 84.7 |
| are-nlp-models-really-able-to-solve-simple | 76.9 |
| an-empirical-study-of-data-ability-boundary | 85.1 |
| an-empirical-study-of-data-ability-boundary | 78.6 |
| athena-mathematical-reasoning-with-thought | 86.4 |
| an-empirical-study-of-data-ability-boundary | 87.6 |
| are-nlp-models-really-able-to-solve-simple | 82.2 |
| are-nlp-models-really-able-to-solve-simple | 81.2 |
| athena-mathematical-reasoning-with-thought | 91 |