User Satisfaction-Driven Requirement Mapping for Learning Management Systems in Higher Education: A PLS-SEM Approach

Muhammad Fahmi Alby; Muharman Lubis; Luthfi Ramadani

doi:10.59261/jbt.v7i2.630

Authors

Muhammad Fahmi Alby UIN Raden Intan Lampung
Muharman Lubis UIN Raden Intan Lampung
Luthfi Ramadani UIN Raden Intan Lampung

DOI:

https://doi.org/10.59261/jbt.v7i2.630

Keywords:

cognitive presence, computer self-efficacy, feature interactivity, learning management system, moSCoW, needs mapping

Abstract

Background: The widespread adoption of Learning Management Systems (LMSs) in higher education has intensified the need for systematic, user-centered system evaluation. Despite the growing utilization of LMSs, few studies have simultaneously integrated psychological, cognitive, and technical factors into a unified requirement-mapping framework.

Objective: This study investigates the determinants of LMS user satisfaction in higher education using six constructs: Expectation of Quality, Software Adequacy, Feature Interactivity, Cognitive Presence, Computer Self-Efficacy, and Time Management.

Methods: A quantitative survey was employed to collect data from 132 students and 83 lecturers. The data were analyzed using Partial Least Squares Structural Equation Modeling (PLS-SEM) via SmartPLS, with 5,000-subsample bootstrapping.

Results: Expectation of Quality (β = 0.312), Feature Interactivity (β = 0.284), Software Adequacy (β = 0.347), and Time Management (β = 0.198) showed significant positive effects on user satisfaction. Cognitive Presence (β = −0.164) and Computer Self-Efficacy (β = −0.128) exhibited significant negative relationships with user satisfaction. A requirement-mapping model was developed using the MoSCoW prioritization approach.

Conclusion: LMS user satisfaction is primarily driven by system quality, feature interactivity, and time management. The integrated technical–psychological model offers a practical framework for user-centered LMS design and development prioritization.

References

Abid, A., Tufail, A. H., Ahmed Salem, O. M., A. Nawaz, N., Farooq, U., Abid, I., & Ishaq, K. (2024). An evaluation framework and comparative analysis of the widely used learning management systems. Plos One, 19(12), e0311111. https://doi.org/10.1371/journal.pone.0311111

Acharya, A., & Sinha, D. (2013). Assessing the quality of M-learning systems using ISO/IEC 25010. International Journal of Scientific Research.

Adom, D., Hussein, E., & Agyem, J. A. (2018). Theoretical and conceptual framework: Mandatory ingredients of a quality research. International Journal of Scientific Research, 7.

Al-Fraihat, D., Joy, M., Masa'deh, R., & Sinclair, J. (2020). Evaluating E-learning systems success: An empirical study. Computers in Human Behavior, 102, 67–86. https://doi.org/10.1016/j.chb.2019.08.004

Al-Maani, D. I., & Bani-Salameh, H. (2017). A generic model for evaluating the usability of learning management systems. Proceedings of the Second International Conference on Internet of Things, Data and Cloud Computing. https://doi.org/10.1145/3018896.3018921

Burgos, M. P. (2021). Learning management system for data structures and algorithm. International Journal of Science, Technology, Engineering and Mathematics. https://doi.org/10.53378/352852

Cheng, M., & Yuen, A. H. K. (2018). Student continuance of learning management system use: A longitudinal exploration. Computers & Education, 120, 241–253. https://doi.org/10.1016/j.compedu.2018.02.004

Coulianos, N., Sapalidou, A., Krouska, A., Troussas, C., & Sgouropoulou, C. (2023). Evaluating E-learning process on virtual classroom systems using an ISO-based model. In A. Krouska, C. Troussas, & J. Caro (Eds.), Novel & intelligent digital systems: Proceedings of the 2nd International Conference (NiDS 2022) (pp. 33–45). Springer International Publishing. https://doi.org/10.1007/978-3-031-17601-2_4

Dhiman, N., Gupta, A., Arora, N., & George, B. (2022). User attitude towards E-learning platforms: An insight through the expectation confirmation model and the affordance theory lens. FIIB Business Review. https://doi.org/10.1177/23197145221130666

Drach, V., Simavoryan, S. Z., Pugachevsky, I. S., Torkunova, J. V., & Ilichev, V. Y. (2024). Deploying a learning management system: A university case study. Ekonomika i Upravlenie: Problemy, Resheniya. https://doi.org/10.36871/ek.up.p.r.2024.08.07.002

Fiqri, A., Alfarisy, A., & Sutabri, T. (2023). Evaluasi kualitas learning management system berdasarkan ISO 25010 pada SMK Muhammadiyah 1 Palembang. Explore: Jurnal Sistem Informasi dan Telematika. https://doi.org/10.36448/jsit.v14i1.3116

Garrison, D. R., Anderson, T., & Archer, W. (1999). Critical inquiry in a text-based environment: Computer conferencing in higher education. The Internet and Higher Education, 2(2–3), 87–105. https://doi.org/10.1016/s1096-7516(00)00016-6

Hair, J. F., Risher, J. J., Sarstedt, M., & Ringle, C. M. (2019). When to use and how to report the results of PLS-SEM. European business review, 31(1), 2-24.

Hasani, L. M., Santoso, H. B., & Junus, K. (2022). Designing asynchronous online discussion forum interface and interaction based on the community of inquiry framework. The International Review of Research in Open and Distributed Learning, 23(2), 191–213. https://doi.org/10.19173/irrodl.v23i2.6016

Huda, B., Sediyono, E., Hartomo, K., Sembiring, I., Fauzi, A., & Hananto, A. (2023). Evaluation quality of E-learning X using ISO/IEC 25010 framework and design thinking approach. 2023 6th International Conference on Information and Communications Technology (ICOIACT), 114–119. https://doi.org/10.1109/ICOIACT59844.2023.10455796

Hulland, J. (2020). Conceptual review papers: Revisiting existing research to develop and refine theory. AMS Review, 10, 27–35. https://doi.org/10.1007/s13162-020-00168-7

Li, B., & Nong, X. (2022). Automatically classifying non-functional requirements using deep neural network. Pattern Recognition, 132. https://doi.org/10.1016/j.patcog.2022.108948

Limonthy, S., & Madyatmadja, E. D. (2024). Factors influencing student individual performance of University XYZ through the use of mobile learning management system. Journal of Computer Science. https://doi.org/10.3844/jcssp.2024.276.290

Lubis, M., Hasibuan, M. A., & Andreswari, R. (2022). Satisfaction measurement in the blended learning system of the university: The literacy mediated-discourses (LM-D) framework. Sustainability, 14(19), 12929. https://doi.org/10.3390/su141912929

Mahowald, K., Ivanova, A. A., Blank, I., Kanwisher, N., Tenenbaum, J. B., & Fedorenko, E. (2024). Dissociating language and thought in large language models. Trends in Cognitive Sciences, 28, 517–540. https://doi.org/10.1016/j.tics.2024.01.011

Marsafawy, H. E., Roy, R., & Ali, F. (2022). Measuring learning outcomes: Bridging accreditation requirements and LMS functionalities. Quality Assurance in Education. https://doi.org/10.1108/qae-11-2021-0186

Miranda, E. (2022). Moscow rules: A quantitative exposé (pp. 19–34). https://doi.org/10.1007/978-3-031-08169-9_2

Nawanda, A. K., & Tambotoh, J. (2024). Evaluating the success of learning management systems using the EESS model and expected confirmation theory. Jurnal Sistem Informasi Bisnis. https://doi.org/10.21456/vol14iss4pp337-352

Park, Y. (2024). Professor's perception on the functional indicators of learning management system (LMS) to support data-based adaptive learning: Focusing on local S university. Korean Association for Learner-Centered Curriculum and Instruction. https://doi.org/10.22251/jlcci.2024.24.1.231

Sagrado, J., & Águila, I. M. D. (2020). Assisted requirements selection by clustering. Requirements Engineering, 26, 167–184. https://doi.org/10.1007/s00766-020-00341-1

Souza, F. M. de, Silva, R. F. da, Lins, É. F., & Junior, H. A. de M. J. M. (2024). Digital literacies as social practices in collaborative learning. Saberes: Revista Interdisciplinar de Filosofia e Educação. https://doi.org/10.21680/1984-3879.2024v24n1id35536

Sridharan, S., Saravanan, D., Srinivasan, A. K., & Murugan, B. (2021). Adaptive learning management expert system with evolving knowledge base and enhanced learnability. Education and Information Technologies, 26(5), 5895–5916. https://doi.org/10.1007/s10639-021-10560-w

Suriaman, A., Manurung, K., Mukrim, M., Apridayani, A., & Agussatriana, A. (2023). Effective or impractical? Discussing students' perceptions toward learning management systems in English language learning. International Journal of Language Education, 7(2). https://doi.org/10.26858/ijole.v7i2.43495

Thakre, N. V. (2024). Learning system application. Gurukul International Multidisciplinary Research Journal. https://doi.org/10.69758/GIMRJ2406I8V12P120

Turnbull, D., Chugh, R., & Luck, J.-A. (2021). Issues in learning management systems implementation: A comparison of research perspectives between Australia and China. Education and Information Technologies, 26, 3789–3810. https://doi.org/10.1007/s10639-021-10431-4

Yonia, D. L., Anggraini, R. N. E., Sarno, R., Haryono, A., Septiyanto, A. F., & Mulyanto, S. (2024). E-learning evaluation using information technology infrastructure library 4 with ISO/IEC 25010 indicators. 2024 IEEE International Conference on Artificial Intelligence and Mechatronics Systems (AIMS), 1–6. https://doi.org/10.1109/AIMS61812.2024.10512570

Zuev, V., Kakisheva, L., Denissova, N., Kumargazhanova, S., & Smailova, S. (2021). Development of a set of requirements for the hardware and software of LMS services of the university. International Journal of Emerging Technologies in Learning, 16. https://doi.org/10.3991/ijet.v16i21.25239