This paper proposed a new approach in predicting the local damage of reinforced concrete (RC) panels under impact loading using gradient boosting machine learning (GBML), one of the most powerful techniques in machine learning. A number of experimental data on the impact test of RC panels were collected for training and testing of the proposed model. With the lack of test data due to the high cost and complexity of the structural behavior of the panel under impact loading, it was a challenge to predict the failure mode accurately. To overcome this challenge, this study proposed a machine-learning model that uses a robust technique to solve the problem with a minimal amount of resources. Although the accuracy of the prediction result was not as high as expected due to the lack of data and the unbalance experimental output features, this paper provided a new approach that may alternatively replace the conventional method in predicting the failure mode of RC panel under impact loading. This approach is also expected to be widely used for predicting the structural behavior of component and structures under complex and extreme loads.