Designing an Intelligent Decision Support System for Evaluating Teaching Effectiveness in Technology-Enhanced Classrooms
Abstract
The rapid digital transformation of education has significantly increased the adoption of technology-enhanced classrooms, generating substantial educational data that can support intelligent instructional evaluation. However, conventional teacher assessment systems remain limited by subjectivity, inconsistent evaluation standards, and the inability to analyze multidimensional learning analytics data effectively. This study aims to design an Intelligent Decision Support System (IDSS) for evaluating teaching effectiveness in smart classroom environments using the ELECTRE (Elimination and Choice Translating Reality) method integrated with Artificial Intelligence (AI)-based educational analytics. The proposed framework combines learning analytics indicators, machine learning models, and outranking-based multi-criteria decision-making to support transparent and data-driven educational governance. The evaluation criteria include student engagement, attendance rate, assignment completion, student satisfaction, learning outcomes, classroom interaction, technology integration, and instructor responsiveness. The computational process involved decision matrix construction, normalization, weighted normalization, concordance-discordance analysis, and aggregate dominance evaluation. The results demonstrated that the ELECTRE method effectively identified dominant teaching alternatives and handled conflicting instructional criteria systematically. Teacher 3 achieved the highest performance ranking due to superior instructional performance across all evaluation indicators. Additionally, AI-based predictive analysis improved evaluation accuracy and instructional pattern identification within technology-enhanced classrooms. The study contributes theoretically by extending the application of ELECTRE within intelligent educational DSS frameworks and practically by providing educational institutions with a scalable and transparent mechanism for evaluating teaching effectiveness. The proposed system supports smart educational governance, data-driven decision-making, and sustainable classroom quality assurance in digital learning ecosystems.
References
Basri, B., Syarli, S., & Febryanti, F. (2018). Multi-Attribute Analysis With AHP Algorithm to Optimize Student Ranking Recomendation in Educational Process. International Conference Research on Education, Social, Science and Technology (ICREST) 2018.
Chutia, T., & Baruah, N. (2024). A review on emotion detection by using deep learning techniques. In Artificial Intelligence Review (Vol. 57, Issue 8). Springer Netherlands. https://doi.org/10.1007/s10462-024-10831-1
Confalonieri, R., Coba, L., Wagner, B., & Besold, T. R. (2021). A historical perspective of explainable Artificial Intelligence. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 11(1), 1–21. https://doi.org/10.1002/widm.1391
Diranisha, V., Agung Triayudi, & Ratih Titi Komalasari. (2024). Implementation of K-Nearest Neighbour (KNN) Algorithm and Random Forest Algorithm in Identifying Diabetes. SAGA: Journal of Technology and Information System, 2(2), 234–244. https://doi.org/10.58905/saga.v2i2.253
Efendi, Y., Wira H, T., & Khoirunnisa, E. (2016). Penerapan Teknologi AR (Augmented Reality) pada Pembelajaran Energi Angin Kelas IV SD di Rumah Pintar Al-Barokah. Studia Informatika: Jurnal Sistem Informasi, 9(1), 29–47.
He, W., Xu, G., & Kruck, S. E. (2014). Online IS Education for the 21st Century. Journal of Information Systems Education, 25(2), 106.
Karismariyanti, M. (2011). Simulasi Pendukung Keputusan Penerima Beasiswa Menggunakan Metode Composite Performance Index. Jurnal Teknologi Informasi.
Mimis, M., El Hajji, M., Es-saady, Y., Oueld Guejdi, A., Douzi, H., & Mammass, D. (2019). A Framework for Smart Academic Guidance Using Educational Data Mining. Education and Information Technologies, 24(2), 1379–1393. https://doi.org/10.1007/s10639-018-9838-8
Mujanah, S., Anshori, M. Y., Rahmalia, D., & Herlambang, T. (2022). Application genetic algorithm to improve transportation problem of cement distribution using Artificial Bee Colony. AIP Conference Proceedings, 2577. https://doi.org/10.1063/5.0096127
Naznin, K., Al Mahmud, A., Nguyen, M. T., & Chua, C. (2025). ChatGPT Integration in Higher Education for Personalized Learning, Academic Writing, and Coding Tasks: A Systematic Review. Computers, 14(2), 53. https://doi.org/10.3390/computers14020053
Nibrosu Rohid, Rahma Sugihartati, Bagong Suyanto, Daniel Susilo, & Afriul Zikri. (2025). Digital Activism in Contemporary Islamic Politics: A Critical Analysis of Social Media’s Impact on Islamic Movements. MILRev: Metro Islamic Law Review, 4(1), 208–233. https://doi.org/10.32332/milrev.v4i1.10159
Octaviani, P. A., Wilandari, Y., & Ispriyanti, D. (2014). PENERAPAN METODE KLASIFIKASI SUPPORT VECTOR MACHINE (SVM) PADA DATA AKREDITASI SEKOLAH DASAR (SD) DI KABUPATEN MAGELANG. Jurnal Gaussian, 3(4), 811–820. https://ejournal3.undip.ac.id/index.php/gaussian/article/view/8092
Sabrina, A. (2022). Pendidikan Agama Islam pada Remaja Keluarga Migran di Kabupaten Blora. Journal of Basic Educational Studies, 2(1), 85–97.
Sari, D. R., Rofiqo, N., Hartama, D., Windarto, A. P., & Wanto, A. (2019). Analysis of the Factors Causing Lazy Students to Study Using the ELECTRE II Algorithm. Journal of Physics: Conference Series, 1255(1). https://doi.org/10.1088/1742-6596/1255/1/012007
Septiana, I., Irfan, M., Atmadja, A. R., & Subaeki, B. (2016). Sistem Pendukung Keputusan Penentu Dosen Penguji Dan Pembimbing Tugas Akhir Menggunakan Fuzzy Multiple Attribute Decision Makingdengan Simple Additive Weighting (Studi Kasus: Jurusan Teknik Informatika Uin Sgd Bandung). 1, 43–50.
Sreenivasa Rao, K., Swapna, N., & Praveen Kumar, P. (2018). Educational data mining for student placement prediction using machine learning algorithms. 7(1.2), 43–46. https://www.scopus.com/record/display.uri?eid=2-s2.0-85039905840&origin=resultslist&sort=plf-f&src=s&nlo=&nlr=&nls=&imp=t&sid=cef64bec2bb16165caba094409f48a0a&sot=br&sdt=sisr&sl=62&s=SOURCE-ID%2821100805731%29+AND+PUBYEAR+IS+2018+AND+NOT+DOCTYPE%28ip%29&r
Sudarsono, B., Saputra, W. N. E., & Ghozali, F. A. (2025). Improving student readiness for future professional activities: the Industry-Integrated Self-Design Project Learning (i-SDPL) model. The Education and Science Journal, 27(6), 29–54. https://doi.org/10.17853/1994-5639-2025-6-29-54
Susanto, R., Agustina, N., & Rozali, Y. A. (2020). Analysis of the application of the pedagogical competency model case study of public and private primary schools in West Jakarta Municipality, Dki Jakarta Province). Elementary Education Online, 19(3), 167–182. https://doi.org/10.17051/ILKONLINE.2020.03.114
Tin, T. T., Kit, C. M., Theng, S. Y., Jie, N. C. W., Chung, S. W., Keat, T. C., Kit, C. J., & Tiung, L. K. (2023). Big Data Analysis: the Influence of Science and Maths Education on Pregnancy Outcomes: Examining the Mediating Effects of Cumulative Gpa, Birth Control, and Bad Habits. Journal of Theoretical and Applied Information Technology, 101(20), 6560–6571.
Triyanto, T., Kholifah, N., Nurtanto, M., Ramadhan Nur, H., Nugroho Saputro, I., Nur Istanti, H., & Gadi, A. C. Z. (2024). Student e-learning effectiveness based on pedagogy, evaluation and technology dimensions (PET-D): Empirical studies in higher education in the COVID-19 epidemic. Multidisciplinary Science Journal, 6(12), 2024245. https://doi.org/10.31893/multiscience.2024245
Troussas, C., Krouska, A., Mylonas, P., & Sgouropoulou, C. (2025). Personalized Instructional Strategy Adaptation Using TOPSIS: A Multi-Criteria Decision-Making Approach for Adaptive Learning Systems. Information, 16(5), 409. https://doi.org/10.3390/info16050409
Wimatra, A., Nasution, D., Harumy, T. H. F., & Sunardi. (2016). Backpropagation model for BIDIKMISI recipients. Internetworking Indonesia Journal, 8(2).
Wozney, L., Venkatesh, V., & Abrami, P. (2006). Implementing Computer Technologies: Teachers’ Perceptions and Practices. Journal of Technology and Teacher Education. https://doi.org/10.1016/j.tcs.2005.09.058
Yalçin, N., & Alisawi, M. (2024). Introducing a novel dataset for facial emotion recognition and demonstrating significant enhancements in deep learning performance through pre-processing techniques. Heliyon, 10(20), 1–22. https://doi.org/10.1016/j.heliyon.2024.e38913
Yang, S. J. H., Ogata, H., Matsui, T., & Chen, N. S. (2021). Human-centered artificial intelligence in education: Seeing the invisible through the visible. Computers and Education: Artificial Intelligence, 2(January), 100008. https://doi.org/10.1016/j.caeai.2021.100008
Yanti, D., Heryadi, D. Y., Juliana, Cakranegara, P. A., & Kadyrov, M. (2023). Developing rural communication through digital innovation for village tourism. Jurnal Studi Komunikasi (Indonesian Journal of Communications Studies), 7(3), 696–712. https://doi.org/10.25139/jsk.v7i3.7384
Zanakis, S. H., Solomon, A., Wishart, N., & Dublish, S. (1998). Multi-attribute decision making: A simulation comparison of select methods. European Journal of Operational Research, 107(3), 507–529. https://doi.org/10.1016/S0377-2217(97)00147-1
Zer, P. P. P. A. N. W. F. I. R. H., Masitha, Windarto, A. P., & Wanto, A. (2019). Analysis of the ELECTRE Method on the Selection of Student Creativity Program Proposals. Journal of Physics: Conference Series, 1255(1). https://doi.org/10.1088/1742-6596/1255/1/012011
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Ramadiani, Azainil Azainil, Kenya Permata Kusumadewi, Guellica Agnesia Claudia Thanos, Toong Hai Sam
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
