Automatic Classification of Mass Shape and Margin on Mammography with Artificial Intelligence: Deep CNN Versus Radiomics

The purpose of this study is to test the feasibility for deep CNN–based artificial intelligence methods for automatic classification of the mass margin and shape, while radiomic feature–based machine learning methods were also implemented in this study as baseline and for comparison study. In this retrospective study, 596 patients with breast mass that underwent mammography from 4 hospitals were enrolled from January 2012 to October 2019. Margin and shape of each mass were annotated according to BI-RADS by 2 experienced radiologists. Deep CNN–based AI was implemented for the classification task based on Resnet50. Balanced sampler and CBAM were also used to improve the performance of the Deep CNNs. As comparison, image texture features were extracted and then dimensionality reduction methods (such as PCA, ICA) and classical classifiers (such as SVM, DT, KNN) were used for classification task. Based on Python programming software, accuracy (ACC) was used to evaluate the performance of the model, and the model with the highest ACC value was selected. Deep CNN based on Resnet50 with balanced sampler and CBAM achieved the best performance for both margin and shape classification, with ACC of 0.838 and 0.874, respectively. For the radiomics-based machine learning, the best performance for margin was achieved as 0.676 by the combination of FA + RF, while the best performance for shape was 0.802 by the combination of PCA + MLP. The feasibility for automatic classification with coarse labeling of the mass shape and margin was testified with the deep CNN–based AI methods, while radiomic feature–based machine learning methods achieved inferior classification results.