Implementation of Xception and EfficientNetB3 for COVID-19 Detection on Chest X-Ray Image via Transfer Learning

Nadya Novalina; Mia Rizkinia

doi:10.62146/ijecbe.v1i2.14

Authors

Nadya Novalina Universitas Indonesia
Mia Rizkinia Universitas Indonesia https://orcid.org/0000-0003-3197-1611

DOI:

https://doi.org/10.62146/ijecbe.v1i2.14

Keywords:

COVID-19, CXR, classification, Convolutional Neural Network, transfer learning

Abstract

COVID-19 is a highly contagious infectious disease caused by the SARS-CoV-2 virus that can cause respiratory issues. The utilization of X-ray imaging has the potential to serve as an alternative means of detecting COVID-19 by offering insights into the condition of the lungs. Rapid and automated analysis of medical images and patterns can be achieved through deep learning techniques. In this study, we propose methods for the automatic classification of COVID-19 from Chest X-Ray images using CNN with transfer learning techniques, namely Xception and EfficientNetB3 architectures, as well as an ensemble of both architectures working in parallel. Additionally, we use Grad-CAM to visualize the regions of the X-ray image that are most important for the classification decision. The classification of COVID-19 is carried out for four types of classes: COVID-19, normal, bacterial pneumonia, and viral pneumonia. The proposed classifier models achieve an overall accuracy of 94.44% for the Xception classifier, 95.28% for the EfficientNetB3 classifier, and 94.44% for the parallel classifier. The accuracy value is higher than the other comparison classifiers accuracy values. Overall, the proposed classifiers can be recommended as tools to assist radiologists and clinical practitioners in diagnosing and following up with COVID-19 cases.

References

C. Wang, Z. Wang, G. Wang, J. Y.-N. Lau, K. Zhang, and W. Li, “COVID-19 in early 2021: current status and looking forward,” Signal Transduct. Target. Ther., vol. 6, no. 1, p. 114, Dec. 2021, doi: 10.1038/s41392-021-00527-1.

L. Falzone, G. Gattuso, A. Tsatsakis, D. Spandidos, and M. Libra, “Current and innovative methods for the diagnosis of COVID‑19 infection (Review),” Int. J. Mol. Med., vol. 47, no. 6, p. 100, Apr. 2021, doi: 10.3892/ijmm.2021.4933.

M. Ghaderzadeh and F. Asadi, “Deep Learning in the Detection and Diagnosis of COVID-19 Using Radiology Modalities: A Systematic Review,” J. Healthc. Eng., vol. 2021, pp. 1–10, Mar. 2021, doi: 10.1155/2021/6677314.

M. D. Toppenberg, T. E. M. Christiansen, F. Rasmussen, C. P. Nielsen, and E. M. Damsgaard, “Mobile X-ray outside the hospital: a scoping review,” BMC Health Serv. Res., vol. 20, no. 1, p. 767, Dec. 2020, doi: 10.1186/s12913-020-05564-0.

A. I. Khan, J. L. Shah, and M. M. Bhat, “CoroNet: A deep neural network for detection and diagnosis of COVID-19 from chest x-ray images,” Comput. Methods Programs Biomed., vol. 196, p. 105581, Nov. 2020, doi: 10.1016/j.cmpb.2020.105581.

M. Rahimzadeh and A. Attar, “A modified deep convolutional neural network for detecting COVID-19 and pneumonia from chest X-ray images based on the concatenation of Xception and ResNet50V2,” Informatics Med. Unlocked, vol. 19, p. 100360, 2020, doi: 10.1016/j.imu.2020.100360.

G. Marques, D. Agarwal, and I. de la Torre Díez, “Automated medical diagnosis of COVID-19 through EfficientNet convolutional neural network,” Appl. Soft Comput., vol. 96, p. 106691, Nov. 2020, doi: 10.1016/j.asoc.2020.106691.

U. Sait et al., “Curated Dataset for COVID-19 Posterior-Anterior Chest Radiography Images (X-Rays) V3,” Mendeley Data, 2021, doi: http://dx.doi.org/10.17632/9xkhgts2s6.3.

Kaggle, “Introduction to Kaggle Kernels.” https://www.kaggle.com/getting-started/44939 (accessed Dec. 03, 2021).

J. Deng, W. Dong, R. Socher, L.-J. Li, Kai Li, and Li Fei-Fei, “ImageNet: A large-scale hierarchical image database,” in 2009 IEEE Conference on Computer Vision and Pattern Recognition, Jun. 2009, pp. 248–255, doi: 10.1109/CVPR.2009.5206848.

Q. Xie, M.-T. Luong, E. Hovy, and Q. V. Le, “Self-training with Noisy Student improves ImageNet classification,” Nov. 2019, [Online]. Available: http://arxiv.org/abs/1911.04252.

F. Chollet, “Xception: Deep Learning with Depthwise Separable Convolutions,” in 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Jul. 2017, pp. 1800–1807, doi: 10.1109/CVPR.2017.195.

M. Tan and Q. V. Le, “EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks,” May 2019, [Online]. Available: http://arxiv.org/abs/1905.11946.

M. Lin, Q. Chen, and S. Yan, “Network In Network,” Dec. 2013, [Online]. Available: http://arxiv.org/abs/1312.4400.

L. Alzubaidi et al., “Review of deep learning: concepts, CNN architectures, challenges, applications, future directions,” J. Big Data, vol. 8, no. 1, p. 53, Dec. 2021, doi: 10.1186/s40537-021-00444-8.

P. Baldi and P. J. Sadowski, “Understanding Dropout,” in Advances in Neural Information Processing Systems, 2013, [Online]. Available: https://proceedings.neurips.cc/paper/2013/file/71f6278d140af599e06ad9bf1ba03cb0-Paper.pdf.

R. R. Selvaraju, M. Cogswell, A. Das, R. Vedantam, D. Parikh, and D. Batra, “Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization,” Int. J. Comput. Vis., vol. 128, no. 2, pp. 336–359, Feb. 2020, doi: 10.1007/s11263-019-01228-7.

J. Dj. Novaković, A. Veljović, S. S. Ilić, Ž. Papić, and T. Milica, “Evaluation of Classification Models in Machine Learning,” Theory Appl. Math. Comput. Sci., vol. 7, no. 1, pp. 39-, 2017.

J. Han, M. Kamber, and J. Pei, Data Mining, Third Edit. Elsevier, 2012.

A. Badawi and K. Elgazzar, “Detecting Coronavirus from Chest X-rays Using Transfer Learning,” COVID, vol. 1, no. 1, pp. 403–415, Sep. 2021, doi: 10.3390/covid1010034.