HyperAIHyperAI超神経

Command Palette

Search for a command to run...

プラットフォーム

Math Word Problem Solving On Mawps

評価指標

Accuracy (%)

評価結果

このベンチマークにおける各モデルのパフォーマンス結果

Paper Title
OpenMath-CodeLlama-70B (w/ code)95.7OpenMathInstruct-1: A 1.8 Million Math Instruction Tuning Dataset
MsAT-DeductReasoner94.3Learning Multi-Step Reasoning by Solving Arithmetic Tasks
ATHENA (roberta-large)93ATHENA: Mathematical Reasoning with Thought Expansion
Exp-Tree92.3An Expression Tree Decoding Strategy for Mathematical Equation Generation
Multi-view92.3Multi-View Reasoning: Consistent Contrastive Learning for Math Word Problem
ATHENA (roberta-base)92.2ATHENA: Mathematical Reasoning with Thought Expansion
Roberta-DeductReasoner92Learning to Reason Deductively: Math Word Problem Solving as Complex Relation Extraction
DeBERTa (PM + VM)91.0Math Word Problem Solving by Generating Linguistic Variants of Problem Statements
Graph2Tree with RoBERTa88.7Are NLP Models really able to Solve Simple Math Word Problems?
EPT88.7EPT-X: An Expression-Pointer Transformer model that generates eXplanations for numbers
GTS with RoBERTa88.5Are NLP Models really able to Solve Simple Math Word Problems?
GEO85.1Generating Equation by Utilizing Operators : GEO model
EPT-X84.57EPT-X: An Expression-Pointer Transformer model that generates eXplanations for numbers
EPT84.51Point to the Expression: Solving Algebraic Word Problems using the Expression-Pointer Transformer Model
Graph2Tree83.7Graph-to-Tree Learning for Solving Math Word Problems
LLaMA 2-Chat82.4Llama 2: Open Foundation and Fine-Tuned Chat Models
GPT-3.5 turbo (175B)80.3Math Word Problem Solving by Generating Linguistic Variants of Problem Statements
Toolformer44.0-
GPT-3 (175B)19.8-
Toolformer (disabled)15.0-
0 of 25 row(s) selected.