This paper proposed a simple neural network approach towards handwritten digit recognition using convolution. With machine learning algorithms like KNN, SVM/SOM, recognizing digits is considered as one of the unsolvable tasks due to its distinctiveness in the style of writing. In this paper, Convolution Neural Networks are implemented with an MNIST dataset of 70000 digits with 250 distinct forms of writings. The proposed method achieved 98.51% accuracy for real-world handwritten digit prediction with less than 0.1 % loss on training with 60000 digits while 10000 under validation.