Explainable Deep Learning Approach for Mpox Skin Lesion Detection with Grad-CAM
DOI:
https://doi.org/10.60084/hjas.v2i2.216Keywords:
Artificial intelligence, Medical imaging, Monkeypox, XAIAbstract
Mpox is a viral zoonotic disease that presents with skin lesions similar to other conditions like chickenpox, measles, and hand-foot-mouth disease, making accurate diagnosis challenging. Early and precise detection of mpox is critical for effective treatment and outbreak control, particularly in resource-limited settings where traditional diagnostic methods are often unavailable. While deep learning models have been applied successfully in medical imaging, their use in mpox detection remains underexplored. To address this gap, we developed a deep learning-based approach using the ResNet50v2 model to classify mpox lesions alongside five other skin conditions. We also incorporated Grad-CAM (Gradient-weighted Class Activation Mapping) to enhance model interpretability. The results show that the ResNet50v2 model achieved an accuracy of 99.33%, precision of 99.34%, sensitivity of 99.33%, and an F1-score of 99.32% on a dataset of 1,594 images. Grad-CAM visualizations confirmed that the model focused on relevant lesion areas for its predictions. While the model performed exceptionally well overall, it struggled with misclassifications between visually similar diseases, such as chickenpox and mpox. These results demonstrate that AI-based diagnostic tools can provide reliable, interpretable support for clinicians, particularly in settings with limited access to specialized diagnostics. However, future work should focus on expanding datasets and improving the model's capacity to distinguish between similar conditions.
Downloads
References
- Karagoz, A., Tombuloglu, H., Alsaeed, M., Tombuloglu, G., AlRubaish, A. A., Mahmoud, A., Smajlović, S., Ćordić, S., Rabaan, A. A., and Alsuhaimi, E. (2023). Monkeypox (Mpox) Virus: Classification, Origin, Transmission, Genome Organization, Antiviral Drugs, and Molecular Diagnosis, Journal of Infection and Public Health, Vol. 16, No. 4, 531–541. doi:10.1016/j.jiph.2023.02.003.
- Ullah, M., Li, Y., Munib, K., and Zhang, Z. (2023). Epidemiology, Host Range, and Associated Risk Factors of Monkeypox: An Emerging Global Public Health Threat, Frontiers in Microbiology, Vol. 14. doi:10.3389/fmicb.2023.1160984.
- Yu, X., Shi, H., and Cheng, G. (2023). Mpox Virus: Its Molecular Evolution and Potential Impact on Viral Epidemiology, Viruses, Vol. 15, No. 4, 995. doi:10.3390/v15040995.
- Selvaraj, N., Shyam, S., Dhurairaj, P., Thiruselvan, K., Thiruselvan, A., Kancherla, Y., and Kandamaran, P. (2023). Mpox: Epidemiology, Clinical Manifestations and Recent Developments in Treatment and Prevention, Expert Review of Anti-Infective Therapy, Vol. 21, No. 6, 641–653. doi:10.1080/14787210.2023.2208346.
- Maronese, C. A., Avallone, G., Aromolo, I. F., Spigariolo, C. B., Quattri, E., Ramoni, S., Carrera, C. G., and Marzano, A. V. (2023). Mpox: An Updated Review of Dermatological Manifestations in the Current Outbreak, British Journal of Dermatology, Vol. 189, No. 3, 260–270. doi:10.1093/bjd/ljad151.
- van Nispen, C., Reffett, T., Long, B., Gottlieb, M., and Frawley, T. C. (2023). Diagnosis and Management of Monkeypox: A Review for the Emergency Clinician, Annals of Emergency Medicine, Vol. 81, No. 1, 20–30. doi:10.1016/j.annemergmed.2022.07.014.
- Biswas, D., and Tešić, J. (2024). Binarydnet53: A Lightweight Binarized CNN for Monkeypox Virus Image Classification, Signal, Image and Video Processing, Vol. 18, No. 10, 7107–7118. doi:10.1007/s11760-024-03379-8.
- Zhou, Y., and Chen, Z. (2023). Mpox: A Review of Laboratory Detection Techniques, Archives of Virology, Vol. 168, No. 8, 221. doi:10.1007/s00705-023-05848-w.
- Chauhan, R. P., Fogel, R., and Limson, J. (2023). Overview of Diagnostic Methods, Disease Prevalence and Transmission of Mpox (Formerly Monkeypox) in Humans and Animal Reservoirs, Microorganisms, Vol. 11, No. 5, 1186. doi:10.3390/microorganisms11051186.
- Maffert, P., Reverchon, S., Nasser, W., Rozand, C., and Abaibou, H. (2017). New Nucleic Acid Testing Devices to Diagnose Infectious Diseases in Resource-Limited Settings, European Journal of Clinical Microbiology & Infectious Diseases, Vol. 36, No. 10, 1717–1731. doi:10.1007/s10096-017-3013-9.
- Musa-Booth, T. O., Medugu, N., Adegboro, B., and Babazhitsu, M. (2023). A Review of the Epidemiology, Diagnosis, Treatment, Vaccines and Economic Impact of Human Monkeypox (Mpox) Outbreaks, African Journal of Clinical and Experimental Microbiology, Vol. 24, No. 1, 1–8.
- Noviandy, T. R., Nainggolan, S. I., Raihan, R., Firmansyah, I., and Idroes, R. (2023). Maternal Health Risk Detection Using Light Gradient Boosting Machine Approach, Infolitika Journal of Data Science, Vol. 1, No. 2, 48–55. doi:10.60084/ijds.v1i2.123.
- Mascarenhas, M., Afonso, J., Ribeiro, T., Andrade, P., Cardoso, H., and Macedo, G. (2023). The Promise of Artificial Intelligence in Digestive Healthcare and the Bioethics Challenges It Presents, Medicina, Vol. 59, No. 4, 790. doi:10.3390/medicina59040790.
- Noviandy, T. R., Idroes, G. M., Syukri, M., and Idroes, R. (2024). Interpretable Machine Learning for Chronic Kidney Disease Diagnosis: A Gaussian Processes Approach, Indonesian Journal of Case Reports, Vol. 2, No. 1, 24–32. doi:10.60084/ijcr.v2i1.204.
- Hidayat, T., Hadinata, E., Damanik, I. S., Vikki, Z., and Irvanizam, I. (2023). Implementation of Hybrid CNN-XGBoost Method for Leukemia Detection Problem, Infolitika Journal of Data Science, Vol. 1, No. 1, 15–21. doi:10.60084/ijds.v1i1.87.
- Li, Z., Koban, K. C., Schenck, T. L., Giunta, R. E., Li, Q., and Sun, Y. (2022). Artificial Intelligence in Dermatology Image Analysis: Current Developments and Future Trends, Journal of Clinical Medicine, Vol. 11, No. 22, 6826. doi:10.3390/jcm11226826.
- Yeasmin, M. N., Al Amin, M., Joti, T. J., Aung, Z., and Azim, M. A. (2024). Advances of AI in image-based computer-aided diagnosis: A review, Array, Vol. 23, 100357. doi:10.1016/j.array.2024.100357.
- Suganyadevi, S., Seethalakshmi, V., and Balasamy, K. (2022). A Review on Deep Learning in Medical Image Analysis, International Journal of Multimedia Information Retrieval, Vol. 11, No. 1, 19–38. doi:10.1007/s13735-021-00218-1.
- Maulana, A., Noviandy, T. R., Suhendra, R., Earlia, N., Bulqiah, M., Idroes, G. M., Niode, N. J., Sofyan, H., Subianto, M., and Idroes, R. (2023). Evaluation of Atopic Dermatitis Severity Using Artificial Intelligence, Narra J, Vol. 3, No. 3, e511. doi:10.52225/narra.v3i3.511.
- Suhendra, R., Suryadi, S., Husdayanti, N., Maulana, A., Noviandy, T. R., Sasmita, N. R., Subianto, M., Earlia, N., Niode, N. J., and Idroes, R. (2023). Evaluation of Gradient Boosted Classifier in Atopic Dermatitis Severity Score Classification, Heca Journal of Applied Sciences, Vol. 1, No. 2, 54–61. doi:10.60084/hjas.v1i2.85.
- Aijaz, S. F., Khan, S. J., Azim, F., Shakeel, C. S., and Hassan, U. (2022). Deep Learning Application for Effective Classification of Different Types of Psoriasis, Journal of Healthcare Engineering, Vol. 2022, 1–12. doi:10.1155/2022/7541583.
- Okamoto, T., Kawai, M., Ogawa, Y., Shimada, S., and Kawamura, T. (2022). Artificial Intelligence for the Automated Single-Shot Assessment of Psoriasis Severity, Journal of the European Academy of Dermatology and Venereology, Vol. 36, No. 12, 2512–2515. doi:10.1111/jdv.18354.
- Gao, W., Li, M., Wu, R., Du, W., Zhang, S., Yin, S., Chen, Z., and Huang, H. (2021). The Design and Application of an Automated Microscope Developed Based on Deep Learning for Fungal Detection in Dermatology, Mycoses, Vol. 64, No. 3, 245–251. doi:10.1111/myc.13209.
- Xu, J., Luo, Y., Wang, J., Tu, W., Yi, X., Xu, X., Song, Y., Tang, Y., Hua, X., Yu, Y., Yin, H., Yang, Q., and Huang, W. E. (2023). Artificial Intelligence-Aided Rapid and Accurate Identification of Clinical Fungal Infections by Single-Cell Raman Spectroscopy, Frontiers in Microbiology, Vol. 14. doi:10.3389/fmicb.2023.1125676.
- He, K., Zhang, X., Ren, S., and Sun, J. (2015). Deep Residual Learning for Image Recognition, Computer Vision and Pattern Recognition.
- Noviandy, T. R., Idroes, G. M., Hardi, I., Afjal, M., and Ray, S. (2024). A Model-Agnostic Interpretability Approach to Predicting Customer Churn in the Telecommunications Industry, Infolitika Journal of Data Science, Vol. 2, No. 1, 34–44. doi:10.60084/ijds.v2i1.199.
- Noviandy, T. R., Idroes, G. M., and Hardi, I. (2024). Enhancing Loan Approval Decision-Making: An Interpretable Machine Learning Approach Using LightGBM for Digital Economy Development, Malaysian Journal of Computing (MJOC), Vol. 9, No. 1, 1734–1745. doi:10.24191/mjoc.v9i1.25691.
- Selvaraju, R. R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., and Batra, D. (2017). Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization, 2017 IEEE International Conference on Computer Vision (ICCV), IEEE, 618–626. doi:10.1109/ICCV.2017.74.
- Holzinger, A., Biemann, C., Pattichis, C. S., and Kell, D. B. (2017). What Do We Need to Build Explainable AI Systems for the Medical Domain?, ArXiv Preprint ArXiv:1712.09923.
- Ali, S., Akhlaq, F., Imran, A. S., Kastrati, Z., Daudpota, S. M., and Moosa, M. (2023). The Enlightening Role of Explainable Artificial Intelligence in Medical & Healthcare Domains: A Systematic Literature Review, Computers in Biology and Medicine, Vol. 166, 107555. doi:10.1016/j.compbiomed.2023.107555.
- Chen, H., Gomez, C., Huang, C.-M., and Unberath, M. (2022). Explainable Medical Imaging AI Needs Human-Centered Design: Guidelines and Evidence from a Systematic Review, Npj Digital Medicine, Vol. 5, No. 1, 156. doi:10.1038/s41746-022-00699-2.
- Ali, S. N., Ahmed, M. T., Jahan, T., Paul, J., Sakeef Sani, S. M., Noor, N., Asma, A. N., and Hasan, T. (2024). A Web-Based Mpox Skin Lesion Detection System Using State-of-the-Art Deep Learning Models considering Racial Diversity, Biomedical Signal Processing and Control, Vol. 98, 106742. doi:10.1016/j.bspc.2024.106742.
- Ali, S. N., Ahmed, M. T., Paul, J., Jahan, T., Sani, S. M., Noor, N., and Hasan, T. (2022). Monkeypox Skin Lesion Detection Using Deep Learning Models: A Feasibility Study, ArXiv Preprint ArXiv:2207.03342. doi:10.48550/arXiv.2207.03342.
- Noviandy, T. R., Maulana, A., Zulfikar, T., Rusyana, A., Enitan, S. S., and Idroes, R. (2024). Explainable Artificial Intelligence in Medical Imaging: A Case Study on Enhancing Lung Cancer Detection through CT Images, Indonesian Journal of Case Reports, Vol. 2, No. 1, 6–14. doi:10.60084/ijcr.v2i1.150.
- He, K., Zhang, X., Ren, S., and Sun, J. (2016). Identity Mappings in Deep Residual Networks. doi:10.48550/arXiv.1603.05027.
- Idroes, G. M., Maulana, A., Suhendra, R., Lala, A., Karma, T., Kusumo, F., Hewindati, Y. T., and Noviandy, T. R. (2023). TeutongNet: A Fine-Tuned Deep Learning Model for Improved Forest Fire Detection, Leuser Journal of Environmental Studies, Vol. 1, No. 1, 1–8. doi:10.60084/ljes.v1i1.42.
- Tan, M., and Le, Q. (2019). EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks, International Conference on Machine Learning, PMLR, 6105–6114.
- Talukder, M. A., Layek, M. A., Kazi, M., Uddin, M. A., and Aryal, S. (2024). Empowering COVID-19 Detection: Optimizing Performance through Fine-Tuned EfficientNet Deep Learning Architecture, Computers in Biology and Medicine, Vol. 168, 107789. doi:10.1016/j.compbiomed.2023.107789.
- Huang, G., Liu, Z., Van Der Maaten, L., and Weinberger, K. Q. (2017). Densely Connected Convolutional Networks, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 4700–4708.
- Ashwini, A., Purushothaman, K. E., Rosi, A., and Vaishnavi, T. (2023). Artificial Intelligence based real-time automatic detection and classification of skin lesion in dermoscopic samples using DenseNet-169 architecture, Journal of Intelligent & Fuzzy Systems, Vol. 45, No. 4, 6943–6958. doi:10.3233/JIFS-233024.
- Gupta, N. (2021). A Pre-Trained Vs Fine-Tuning Methodology in Transfer Learning, Journal of Physics: Conference Series, Vol. 1947, No. 1, 012028. doi:10.1088/1742-6596/1947/1/012028.
- Llugsi, R., Yacoubi, S. El, Fontaine, A., and Lupera, P. (2021). Comparison between Adam, AdaMax and Adam W optimizers to implement a Weather Forecast based on Neural Networks for the Andean city of Quito, 2021 IEEE Fifth Ecuador Technical Chapters Meeting (ETCM), IEEE, 1–6. doi:10.1109/ETCM53643.2021.9590681.
- Petch, J., Di, S., and Nelson, W. (2022). Opening the Black Box: The Promise and Limitations of Explainable Machine Learning in Cardiology, Canadian Journal of Cardiology, Vol. 38, No. 2, 204–213. doi:10.1016/j.cjca.2021.09.004.
- Xu, H., and Shuttleworth, K. M. J. (2024). Medical Artificial Intelligence and the Black Box Problem: A View Based on the Ethical Principle of “Do No Harm”, Intelligent Medicine, Vol. 4, No. 1, 52–57. doi:10.1016/j.imed.2023.08.001.
- Noviandy, T. R., Maulana, A., Khowarizmi, F., and Muchtar, K. (2023). Effect of CLAHE-based Enhancement on Bean Leaf Disease Classification through Explainable AI, 2023 IEEE 12th Global Conference on Consumer Electronics (GCCE), IEEE, 515–516. doi:10.1109/GCCE59613.2023.10315394.
- Noviandy, T. R., Maulana, A., Emran, T. B., Idroes, G. M., and Idroes, R. (2023). QSAR Classification of Beta-Secretase 1 Inhibitor Activity in Alzheimer’s Disease Using Ensemble Machine Learning Algorithms, Heca Journal of Applied Sciences, Vol. 1, No. 1, 1–7. doi:10.60084/hjas.v1i1.12.
- Noviandy, T. R., Maulana, A., Idroes, G. M., Maulydia, N. B., Patwekar, M., Suhendra, R., and Idroes, R. (2023). Integrating Genetic Algorithm and LightGBM for QSAR Modeling of Acetylcholinesterase Inhibitors in Alzheimer’s Disease Drug Discovery, Malacca Pharmaceutics, Vol. 1, No. 2, 48–54. doi:10.60084/mp.v1i2.60.
- Noviandy, T. R., Idroes, G. M., and Hardi, I. (2024). An Interpretable Machine Learning Strategy for Antimalarial Drug Discovery with LightGBM and SHAP, Journal of Future Artificial Intelligence and Technologies, Vol. 1, No. 2, 84–95. doi:10.62411/faith.2024-16.
- Noviandy, T. R., Nisa, K., Idroes, G. M., Hardi, I., and Sasmita, N. R. (2024). Classifying Beta-Secretase 1 Inhibitor Activity for Alzheimer’s Drug Discovery with LightGBM, Journal of Computing Theories and Applications, Vol. 2, No. 2, 138–147. doi:10.62411/jcta.10129.
- Noviandy, T. R., Idroes, G. M., and Hardi, I. (2024). Machine Learning Approach to Predict AXL Kinase Inhibitor Activity for Cancer Drug Discovery Using XGBoost and Bayesian Optimization, Journal of Soft Computing and Data Mining, Vol. 5, No. 1, 46–56.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Ghazi Mauer Idroes, Teuku Rizky Noviandy, Talha Bin Emran, Rinaldi Idroes
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.