Efficiency Evaluation of E-Learning Courses at Payam Noor University Based on Learning Usability Criteria

Document Type: Original Article


Department of Educational Sciences and Psychology, Payam Noor University, Tehran, Iran



Background: The aim of this study is to evaluate e-learning systems at Payam Noor University (PNU) based on learning usability criteria. Methods: This was an applied research in terms of purpose and a descriptive survey in terms of data analysis. The statistical population included 2600 undergraduate and graduate students at the Shahriar branch of PNU using e-learning methods in 2019-2020 academic year. The sample size was estimated using Morgan table. A total of 335 participants were selected through stratified sampling. The validity of questionnaire was verified by consulting 25 experts in distance education using Delphi method, and the reliability of the total questionnaire, as measured by Cronbach’s alpha, was found to be (α=0.73). Statistical analysis was conducted using SPSS 26. Results: In the e-learning courses offered by PNU, the components of “visibility”, “flexibility”, “course management”, “accessibility”, “consistency and functionality”, “memorability”, “completeness” and “aesthetics” are in a favorable situation (p <0.001). However, the components of “error prevention”, “interactivity, feedback and help”, “assessment strategy” and “reducing redundancy” are not in a favorable situation (P>0.05). Conclusion: Educational institutions should not merely focus on content in their design of e-learning courses. They should also incorporate interactive and group exercises so that students can understand educational materials, and actively and creatively engage in the learning process based on their personal experiences.


Martinez-Caro E. Factors Affecting Effectiveness in E-Learning: An Analysis in Production Management Courses. Computer Applications in Engineering Education.2011; 19(3):572 – 581. DOI: 10.1002/cae.20337
Hubalovsky S, Hubalovska M, Musilek M. Assessment of the influence of adaptive E-learning on learning effectiveness of primary school pupils. Computers in Human Behavior. 2019 Mar 1;92:691-705. doi: 10.1016/j.chb.2018.05.033
Choi H. A problem-based learning trial on the Internet involving undergraduate nursing students. Journal of Nursing Education. 2003 Aug 1;42(8):359-63. DOI: 10.3928/0148-4834-20030801-07
Holmes B, Gardner J. E-learning: Concepts and practice. Sage; 2006.
Liao HL, Lu HP. Richness versus parsimony antecedents of technology adoption model for E-learning websites. InInternational Conference on Web-Based Learning 2008 Aug 20 (pp. 8-17). Springer, Berlin, Heidelberg. DOI: 10.1007/978-3-540-85033-5_2.
Vanitha V, Krishnan P, Elakkiya R. Collaborative optimization algorithm for learning path construction in E-learning. Computers & Electrical Engineering. 2019 Jul 1;77:325-38.    DOI:10.1016/J.COMPELECENG.2019.06.016
Mahmodi, M. Measuring Electronic Learning Readiness of Semnan University Students. Higher Education Letter, 2015; 8(31): 113-134.
Nikolić V, Petković D, Denić N, Milovančević M, Gavrilović S. Appraisal and review of e-learning and ICT systems in teaching process. Physica A: Statistical Mechanics and its Applications. 2019 Jan 1;513:456-64. DOI: 10.1016/j.physa.2018.09.003
Firipis A, Chandrasekaran S, Joordens M. Influence of Critical Thinking on Creativity When Using Mobile Devices for Learning. Asian Education Studies, 2018; 3(2), p40. doi: 10.20849/aes.v3i2.366
Erhel S, Jamet E. Digital game-based learning: Impact of instructions and feedback on motivation and learning effectiveness. Computers & education. 2013 Sep 1;67:156-67.   DOI: 10.1016/j.compedu.2013.02.019
Cinquin PA, Guitton P, Sauzéon H. Online e-learning and cognitive disabilities: A systematic review. Computers & Education. 2019 Mar 1;130:152-67.       DOI:10.1016/j.compedu.2018.12.004.
Spylka M, Sofianopoulou CH. E-Learning, a dynamic tool for the cognitive development of primary school pupils in Greece. InINTED2016 Proceedings 2016 (pp. 998-1007). IATED.    doi: 10.21125/inted.2016.1228
Yazdani F, Ebrahimzadeh E, Zandi B, Aleepoor B, Zare H. Effectiveness of the Electronic Learning System at the virtual college of Oloome Hadees. The Journal of New Thoughts on Education, 2010; 6(3): 137-183. doi: 10.22051/jontoe.2010.215
Lughofer E. On-line active learning: a new paradigm to improve practical useability of data stream modeling methods. Information Sciences. 2017 Nov 1;415:356-76.    doi:10.1016/j.ins.2017.06.038
Karahoca D, Karahoca A, Karaoglu A, Gulluoglu B, Arifoglu E. Evaluation of web based learning on student achievement in primary school computer courses. Procedia-Social and Behavioral Sciences. 2010 Jan 1;2(2):5813-9.     DOI: 10.1016/j.sbspro.2010.03.948
Fernandez A, Insfran E, Abrahão S. Usability evaluation methods for the web: A systematic mapping study. Information and software Technology. 2011 Aug 1;53(8):789-817.      DOI: 10.1016/j.infsof.2011.02.007
Omoda-Onyait G, Lubega JT. E-learning readiness assessment model: A case study of higher institutions of learning in Uganda. InInternational Conference on Hybrid Learning 2011 Aug 10 (pp. 200-211). Springer, Berlin, Heidelberg.      DOI: 10.1007/978-3-642-22763-9_19
Paechter M, Maier B, Macher D. Students’ expectations of, and experiences in e-learning: Their relation to learning achievements and course satisfaction. Computers & education. 2010 Jan 1;54(1):222-229.    DOI: 10.1016/j.compedu.2009.08.005
Esmaeeli H, Rahmani Sh, Kazemi A, Aliahmadi M. Evaluation of E-Learning of the virtual learning program from the student's point of view. Public Management Research. 2016;9(34): 203-222. doi: 10.22111/jmr.2017.3109
Khatib Zanjani N. The Evaluation of E-Learning in Payame Noor University and Compare with Other Selected Universities in the World and Iran. Quarterly Journal of Research in School and Virtual Learning. 2017; 5:81-94.
Aman zadeh A, Al Noman FM. studying the influence of training based on web and computer and mobile learning on students' critical thinking skills and creative thinking in students of Mazandaran province universities. Research in School and Virtual Learning Journal. 2015; 3(9): 57-68.
Anarinejad, A., Mohammadi, M. The Practical Indicators for Evaluation of E-Learning in Higher Education in Iran. Interdisciplinary Journal of Virtual Learning in Medical Sciences, 2020; 5(1): 11-25.
Zeytoonli AH, Rezaei Soufi M. Study the Effectiveness of E-Learning Courses in Payame Noor University, Communication Management in Sports Media, 2017; 4(13): 48-55.
Tseng M, Lin R, Chen H. Evaluating the effectiveness of e‐learning system in uncertainty", Industrial Management & Data Systems, 2011; 111(6), 869-889.     doi:10.1108/02635571111144955
Vahidi, H. Designing a Domestic E-readiness Assessment Model for the Deployment of Mobile Learning. Interdisciplinary Journal of Virtual Learning in Medical Sciences, 2020; 4(1): 1-10.
Farazkish, M., Montazer, G. E-Learning Readiness among Faculty Members of Iranian Universities: A Survey of 23 Universities. Interdisciplinary Journal of Virtual Learning in Medical Sciences, 2019; 10(4): 54-64. doi: 10.30476/ijvlms.2019.84302.1003
Rafiei M, Ghaffari H, Khorami M. Evaluating the Effectiveness of E-Learning Method in Human Resource Education (Case Study of Markazi Province PNU). Research in School and Virtual Learning. 2017; 4(16), 71-84.