Machine Learning for Early Detection of Dropout Risks and Academic Excellence: A Stacked Classifier Approach

Authors

  • Teuku Rizky Noviandy Interdisciplinary Innovation Research Unit, Graha Primera Saintifika, Aceh Besar 23771, Indonesia
  • Zahriah Zahriah Department of Architecture and Urban Planning, Faculty of Engineering, Universitas Syiah Kuala, Banda Aceh 23111, Indonesia
  • Erkata Yandri Graduate School of Renewable Energy, Darma Persada University, Jl. Radin Inten 2, Pondok Kelapa, East Jakarta 13450, Indonesia
  • Zulkarnain Jalil Department of Physics, Faculty of Mathematics and Natural Sciences, Universitas Syiah Kuala, Banda Aceh 23111, Indonesia
  • Muhammad Yusuf Department of Pharmacy, STIKES Assyifa Aceh, Aceh 23242, Indonesia
  • Nur Intan Saidaah Mohamed Yusof Faculty of Pharmacy, Universiti Teknologi MARA Selangor, Bandar Puncak Alam 42300, Malaysia
  • Andi Lala School of Mathematics and Applied Sciences, Universitas Syiah Kuala, Banda Aceh 23111, Indonesia
  • Rinaldi Idroes School of Mathematics and Applied Sciences, Universitas Syiah Kuala, Banda Aceh 23111, Indonesia

DOI:

https://doi.org/10.60084/jeml.v2i1.191

Keywords:

Machine learning, Academic excellence, Dropout risks, Stacked classifier, Educational data

Abstract

Education is important for societal advancement and individual empowerment, providing opportunities, developing essential skills, and breaking cycles of poverty. Nonetheless, the path to educational success is marred by challenges such as achieving academic excellence and preventing student dropouts. Early identification of students at risk of dropping out or those likely to excel academically can significantly enhance educational outcomes through tailored interventions. Traditional methods often fall short in precision and foresight for effective early detection. While previous studies have utilized machine learning to predict student performance, the potential for more sophisticated ensemble methods, such as stacked classifiers, remains largely untapped in educational contexts. This study develops a stacked classifier integrating the predictive strengths of LightGBM, Random Forest, and logistic regression. The model achieved an accuracy of 80.23%, with precision, recall, and F1-score of 79.09%, 80.23%, and 79.20%, respectively, surpassing the performance of the individual models tested. These results underscore the stacked classifier's enhanced predictive capability and transformative potential in educational settings. By accurately identifying students at risk and those likely to achieve academic excellence early, educational institutions can better allocate resources and design targeted interventions. This approach optimizes educational outcomes and supports informed policymaking, fostering environments conducive to student success.

Downloads

Download data is not yet available.

References

  1. Chankseliani, M., Qoraboyev, I., and Gimranova, D. (2021). Higher Education Contributing to Local, National, and Global Development: New Empirical and Conceptual Insights, Higher Education, Vol. 81, No. 1, 109–127. doi:10.1007/s10734-020-00565-8.
  2. Calavia, M. B., Blanco, T., and Casas, R. (2021). Fostering Creativity as a Problem-Solving Competence through Design: Think-Create-Learn, a Tool for Teachers, Thinking Skills and Creativity, Vol. 39, 100761. doi:10.1016/j.tsc.2020.100761.
  3. Chen, X. M. (2021). Integration of Creative Thinking and Critical Thinking to Improve Geosciences Education, The Geography Teacher, Vol. 18, No. 1, 19–23. doi:10.1080/19338341.2021.1875256.
  4. Zelenkovski, K., Prodanova, J., and Kocarev, L. (2024). Exploring Citizen Perceptions and Values for a Responsible Society, Social Science Quarterly, Vol. 105, No. 2, 296–310. doi:10.1111/ssqu.13353.
  5. Daniel, J. (2010). Mega-Schools, Technology and Teachers: Achieving Education for All, Routledge.
  6. Sadler, D. R. (2017). Academic Achievement Standards and Quality Assurance, Quality in Higher Education, Vol. 23, No. 2, 81–99. doi:10.1080/13538322.2017.1356614.
  7. Abdallah, A. K., and Abdallah, R. K. (2023). Achieving Academic Excellence: The Intersection of Teacher Development, Quality Education, and Entrepreneurship, Innovations in Teacher Development, Personalized Learning, and Upskilling the Workforce, IGI Global, 136–158.
  8. Nir, A. E., and Zilberstein‐Levy, R. (2006). Planning for Academic Excellence: Tenure and Professional Considerations, Studies in Higher Education, Vol. 31, No. 5, 537–554. doi:10.1080/03075070600922725.
  9. Brophy, J. (2004). Motivating Students to Learn, Routledge.
  10. Siegle, D., Rubenstein, L. D., and Mitchell, M. S. (2014). Honors Students’ Perceptions of Their High School Experiences, Gifted Child Quarterly, Vol. 58, No. 1, 35–50. doi:10.1177/0016986213513496.
  11. De Witte, K., Cabus, S., Thyssen, G., Groot, W., and van den Brink, H. M. (2013). A Critical Review of the Literature on School Dropout, Educational Research Review, Vol. 10, 13–28. doi:10.1016/j.edurev.2013.05.002.
  12. Del Bonifro, F., Gabbrielli, M., Lisanti, G., and Zingaro, S. P. (2020). Student Dropout Prediction, 129–140. doi:10.1007/978-3-030-52237-7_11.
  13. Samuel, R., and Burger, K. (2020). Negative Life Events, Self-Efficacy, and Social Support: Risk and Protective Factors for School Dropout Intentions and Dropout., Journal of Educational Psychology, Vol. 112, No. 5, 973–986. doi:10.1037/edu0000406.
  14. Bañeres, D., Rodríguez-González, M. E., Guerrero-Roldán, A.-E., and Cortadas, P. (2023). An Early Warning System to Identify and Intervene Online Dropout Learners, International Journal of Educational Technology in Higher Education, Vol. 20, No. 1, 3. doi:10.1186/s41239-022-00371-5.
  15. Bañeres, D., Rodríguez, M. E., Guerrero-Roldán, A. E., and Karadeniz, A. (2020). An Early Warning System to Detect At-Risk Students in Online Higher Education, Applied Sciences, Vol. 10, No. 13, 4427. doi:10.3390/app10134427.
  16. de Vasconcelos, A. N., Freires, L. A., Loureto, G. D. L., Fortes, G., da Costa, J. C. A., Torres, L. F. F., Bittencourt, I. I., Cordeiro, T. D., and Isotani, S. (2023). Advancing School Dropout Early Warning Systems: The IAFREE Relational Model for Identifying At-Risk Students, Frontiers in Psychology, Vol. 14. doi:10.3389/fpsyg.2023.1189283.
  17. Maulana, A., Noviandy, T. R., Sasmita, N. R., Paristiowati, M., Suhendra, R., Yandri, E., Satrio, J., and Idroes, R. (2023). Optimizing University Admissions: A Machine Learning Perspective, Journal of Educational Management and Learning, Vol. 1, No. 1, 1–7. doi:10.60084/jeml.v1i1.46.
  18. Pallathadka, H., Wenda, A., Ramirez-Asís, E., Asís-López, M., Flores-Albornoz, J., and Phasinam, K. (2023). Classification and Prediction of Student Performance Data Using Various Machine Learning Algorithms, Materials Today: Proceedings, Vol. 80, 3782–3785. doi:10.1016/j.matpr.2021.07.382.
  19. Zeineddine, H., Braendle, U., and Farah, A. (2021). Enhancing Prediction of Student Success: Automated Machine Learning Approach, Computers & Electrical Engineering, Vol. 89, 106903. doi:10.1016/j.compeleceng.2020.106903.
  20. Noviandy, T. R., Nainggolan, S. I., Raihan, R., Firmansyah, I., and Idroes, R. (2023). Maternal Health Risk Detection Using Light Gradient Boosting Machine Approach, Infolitika Journal of Data Science, Vol. 1, No. 2, 48–55. doi:10.60084/ijds.v1i2.123.
  21. Maulana, A., Idroes, G. M., Kemala, P., Maulydia, N. B., Sasmita, N. R., Tallei, T. E., Sofyan, H., and Rusyana, A. (2023). Leveraging Artificial Intelligence to Predict Student Performance: A Comparative Machine Learning Approach, Journal of Educational Management and Learning, Vol. 1, No. 2, 64–70. doi:10.60084/jeml.v1i2.132.
  22. Yağcı, M. (2022). Educational Data Mining: Prediction of Students’ Academic Performance Using Machine Learning Algorithms, Smart Learning Environments, Vol. 9, No. 1, 11. doi:10.1186/s40561-022-00192-z.
  23. Lakkaraju, H., Aguiar, E., Shan, C., Miller, D., Bhanpuri, N., Ghani, R., and Addison, K. L. (2015). A Machine Learning Framework to Identify Students at Risk of Adverse Academic Outcomes, Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, ACM, New York, NY, USA, 1909–1918. doi:10.1145/2783258.2788620.
  24. Marwaha, A., and Singla, A. (2020). A Study of Factors to Predict At-Risk Students Based on Machine Learning Techniques, 133–141. doi:10.1007/978-981-13-8618-3_15.
  25. Muñoz-Carpio, J. C., Jan, Z., and Saavedra, A. (2021). Machine Learning for Learning Personalization to Enhance Student Academic Performance., LALA, 88–99.
  26. Martins, M. V., Tolledo, D., Machado, J., Baptista, L. M. T., and Realinho, V. (2021). Early Prediction of student’s Performance in Higher Education: A Case Study, 166–175. doi:10.1007/978-3-030-72657-7_16.
  27. Realinho, V., Vieira Martins, M., Machado, J., and Baptista, L. (2021). Predict Students’ Dropout and Academic Success, UCI Machine Learning Repository. doi:10.24432/C5MC89.
  28. Noviandy, T. R., Idroes, G. M., and Hardi, I. (2024). Enhancing Loan Approval Decision-Making: An Interpretable Machine Learning Approach Using LightGBM for Digital Economy Development, Malaysian Journal of Computing (MJOC), Vol. 9, No. 1, 1734–1745. doi:10.24191/mjoc.v9i1.25691.
  29. Noviandy, T. R., Maulana, A., Idroes, G. M., Irvanizam, I., Subianto, M., and Idroes, R. (2023). QSAR-Based Stacked Ensemble Classifier for Hepatitis C NS5B Inhibitor Prediction, 2023 2nd International Conference on Computer System, Information Technology, and Electrical Engineering (COSITE), IEEE, 220–225. doi:10.1109/COSITE60233.2023.10250039.
  30. Supriatna, D. J. I., Saputra, H., and Hasan, K. (2023). Enhancing the Red Wine Quality Classification Using Ensemble Voting Classifiers, Infolitika Journal of Data Science, Vol. 1, No. 2, 42–47. doi:10.60084/ijds.v1i2.95.
  31. Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Prettenhofer, P., Weiss, R., and Dubourg, V. (2011). Scikit-learn: Machine learning in Python, The Journal of Machine Learning Research, Vol. 12, 2825–2830.
  32. Idroes, G. M., Noviandy, T. R., Maulana, A., Zahriah, Z., Suhendrayatna, S., Suhartono, E., Khairan, K., Kusumo, F., Helwani, Z., and Abd Rahman, S. (2023). Urban Air Quality Classification Using Machine Learning Approach to Enhance Environmental Monitoring, Leuser Journal of Environmental Studies, Vol. 1, No. 2, 62–68. doi:10.60084/ljes.v1i2.99.
  33. Noviandy, T. R., Maulana, A., Idroes, G. M., Emran, T. B., Tallei, T. E., Helwani, Z., and Idroes, R. (2023). Ensemble Machine Learning Approach for Quantitative Structure Activity Relationship Based Drug Discovery: A Review, Infolitika Journal of Data Science, Vol. 1, No. 1, 32–41. doi:10.60084/ijds.v1i1.91.
  34. Shah, K., Patel, H., Sanghvi, D., and Shah, M. (2020). A Comparative Analysis of Logistic Regression, Random Forest and KNN Models for the Text Classification, Augmented Human Research, Vol. 5, No. 1, 12. doi:10.1007/s41133-020-00032-0.
  35. Carvalho, D. V, Pereira, E. M., and Cardoso, J. S. (2019). Machine learning interpretability: A survey on methods and metrics, Electronics, Vol. 8, No. 8, 832.

Downloads

Published

2024-05-24

How to Cite

Noviandy, T. R., Zahriah, Z., Yandri, E., Jalil, Z., Yusuf, M., Mohamed Yusof, N. I. S., Lala, A., & Idroes, R. (2024). Machine Learning for Early Detection of Dropout Risks and Academic Excellence: A Stacked Classifier Approach. Journal of Educational Management and Learning, 2(1), 28–34. https://doi.org/10.60084/jeml.v2i1.191

Issue

Section

Articles