Currently, the existing condition-based maintenance (CBM) diagnostic test practices for ultrasound require the tester to interpret test results manually. Different testers may give different opinions or interpretations of the detected ultrasound. It leads to wrong interpretation due to depending on tester experience. Furthermore, there is no commercially available product to standardize the interpretation of the ultrasound data. Therefore, the objective is the correct interpretation of an ultrasound, which is one of the CBM methods for medium switchgears, by using an artificial neural network (ANN), to give more accurate results when assessing their condition. Information and test results from various switchgears were gathered in order to develop the classification and severity of the corona, surface discharge, and arcing inside of the switchgear. The ultrasound data were segregated based on their defects found during maintenance. In total, 314 cases of normal, 160 cases of the corona, 149 cases of tracking, and 203 cases of arcing were collected. Noise from ultrasound data was removed before uploading it as a training process to the ANN engine, which used the extreme learning machine (ELM) model. The developed AI-based switchgear faults classification system was designed and incorporated with the feature of scalability and can be tested and replicated for other switchgear conditions. A customized graphical user interface (GUI), Ultrasound Analyzer System (UAS), was also developed, to enable users to obtain the switchgear condition or classification output via a graphical interface screen. Hence, accurate decision-making based on this analysis can be made to prioritize the urgency for the remedial works.