Design, Implementation, and Evaluation of Online Open-Book Exams: Insights from Medical Students’ Perspectives

Document Type : Brief Report

Authors

1 Department of Medical Education, Virtual School of Medical Education and Management, Shahid Beheshti University of Medical Sciences, Tehran, Iran

2 Department of LIME, Research Affiliated Faculty, Karolinska Institute, Solna, Sweden

3 Department of E-Learning in Medical Sciences, Virtual School and Center of Excellence in e-Learning, Shiraz University of Medical Sciences, Shiraz, Iran

4 Department of Medical Education, Vice of Center for Recruitment and Affairs of Academic Members and Elites, Shahrekord University of Medical Sciences, Shahrekord, Iran

5 Department of School of Medical Education and Educational Technology, Shahid Beheshti University of Medical Sciences, Tehran, Iran

Abstract

Assessing students is a crucial aspect of the educational process, closely tied to the quality of their learning. Employing a one-group interventional study, we designed and conducted open-book online exams for doctoral students in medical education at Shahid Beheshti University of Medical Sciences (SBUMS), focusing on their perspectives regarding open-book online examination. This assessment spanned from April 2019 to August 2022. To gauge student satisfaction, we utilized Patrick’s evaluation model, employing a researcher-developed questionnaire with confirmed validity and reliability. Additionally, a critique session was conducted for further insights. The analysis of participant satisfaction levels indicates positive feedback and agreement among students regarding the implementation of open-book online examinations. According to the majority of students, this assessment system provided them with valuable and novel experiences. They believed that the online environment stimulated their eagerness to respond to exams, and the ability to access resources enhanced their maneuverability to address all aspects of the questions and designed scenarios. Students expressed concerns during the exam about unforeseen issues typical of online exams, such as power outages, internet interruptions, malfunctioning of exam equipment, etc., potentially hindering their success. The results of this study demonstrate the satisfaction and agreement of doctoral students in medical education with the implementation of open-book online examinations. 

Keywords

References

  1. Sousa M, Dal Mas F, Pesqueira A, Lemos C, Verde JM, Cobianchi L. The potential of AI in health higher education to increase the students’ learning outcomes. The potential of AI in health higher education to increase the students’ learning outcomes. 2021(2):488-97.
  2. Tsvetkova M, Saenko N, Levina V, Kondratenko L, Khimmataliev D. Organizing Students’ Independent Work at Universities for Professional Competencies Formation and Personality Development. International Journal of Instruction. 2021 Oct;14(4):503-28.
  3. Itani M, Itani M, Kaddoura S, Al Husseiny F. The impact of the COVID-19 pandemic on on-line examination: Challenges and opportunities. Glob. J. Eng. Educ. 2022;24:105-20.
  4. Cummings BA. Exploring the role of open book high-stakes examinations in 2021 and beyond. Canadian Medical Education Journal. 2022;13(4):49-52.
  5. Kaidy BA. Do GPA, Age, and Credits Completed Result in Statistically Significant Differences in MSLQ Total Scores? (Doctoral dissertation, Capella University).
  6. Maki PL, Shea P, editors. Transforming digital learning and assessment: A guide to available and emerging practices and building institutional consensus. Taylor & Francis; 2023 Jul 3.
  7. Wong JT, Bui NN, Fields DT, Hughes BS. A learning experience design approach to online professional development for teaching science through the arts: Evaluation of teacher content knowledge, self-efficacy and STEAM perceptions. Journal of Science Teacher Education. 2023 Aug 18;34(6):593-623.
  8. Ashri D, Sahoo BP. Open book examination and higher education during COVID-19: Case of University of Delhi. Journal of Educational Technology Systems. 2021 Sep;50(1):73-86.
  9. Bansal D. Open book examinations: modifying pedagogical practices for effective teaching and learning. The Law Teacher. 2022 Jul 3;56(3):354-67.
  10. Abu-Snoubar TK, Aldowkat I, Al-Shboul Y, Atiyat MA, Al-Hyari H. The attitudes of Jordanian English language and literature undergraduate students toward open-book exams. InFrontiers in Education 2022 Dec 19 (Vol. 7, p. 1050587). Frontiers.
  11. Tatari F, Raoufian H, Mashhadi M, Gazerani A. Effect of group open-book assessment on students’ learning and satisfaction: a quasi-experimental study. Neuropsychiatria i Neuropsychologia/Neuropsychiatry and Neuropsychology. 2021;16(1):87-91.
  12. Carrasco GA, Behling KC, Lopez OJ. Evaluation of the role of incentive structure on student participation and performance in active learning strategies: a comparison of case-based and team-based learning. Medical teacher. 2018 Apr 3;40(4):379-86.
  13. Wenzel K, Schweppe J, Rummer R. Are open‐book tests still as effective as closed‐book tests even after a delay of 2 weeks?. Applied Cognitive Psychology. 2022 May;36(3):699-707.
  14. Durning SJ, Dong T, Ratcliffe T, Schuwirth L, Artino Jr AR, Boulet JR, Eva K. Comparing open-book and closed-book examinations: a systematic review. Academic medicine. 2016 Apr 1;91(4):583-99.
Interdisciplinary Journal of Virtual Learning in Medical Sciences
Volume 14, Issue 4 - Serial Number 55
December 2023
Pages 330-336

Files

Share

How to cite

Statistics