In recent days speech recognition based systems are gaining more prominence and are used in a wide range of applications. Calculator has become an indispensable part of our lives, used at home, at local retail shops or at workplaces like banks, IT companies, medical laboratories etc. Speech recognized calculator is one of the speech recognition systems, in which the digits and operators spoken by the user with pauses in between are analyzed using various algorithms and finally one of the 10 digits (0 to 9) and one of the 5 operators(+, -, *, /, =) The objective of our paper is to design and implement the speech recognized calculator in MATLAB and Standalone Microcontroller. This designed system is able to take detect the digits and operators of the arithmetic expression whose result is to be calculated. In this paper we have used linear predictive method for recognizing the digit/operator in MATLAB and Analog Speech Recognition Chip.