Investigation on the Role of Learning Theory in Learning Analytics

Document Type : Original Article

Authors

1 Department of Educational Technology, Faculty of Psychology and Educational Sciences, Allameh Tabataba’i University, Tehran, Iran

2 Department of Assessment and Measurement, Faculty of Psychology and Educational Sciences, Allameh Tabataba’i University.

Abstract

Background: Studies have shown that there is a gap between theory and practice in the use of learning analytics in educational settings. Some researchers attribute this gap to not taking learning theories into consideration in the use of learning analytics in educational contexts. This study was conducted to address the role of learning theory in applying learning analytics in educational contexts. Methods: This is a qualitative study and the study design is content analysis. Thematic analysis was used as the research method. Data for this study was collected through an interview with 14 experts in the fields of learning analytics and learning theory who were selected purposefully. Theoretical saturation method was used to determine the sample size. Content analysis techniques were used to analyze data and content validity index (CVI) and Cohen’s kappa coefficient were performed to measure the validity and reliability of the findings. Results: Data analysis was performed to identify three main roles for learning theory in learning analytics including underpinning role, guiding role, and sense-making role. Conclusion: The results suggest that first, learning theory should underlie learning analytics (where to begin). Second, application of learning analytics in educational settings should be guided by learning theory (what and how to do), and third, learning analytics’ reports should be interpreted based on the learning theory implications for education (answer to question why).

Keywords

References

Prensky M. Digital natives, digital immigrants part 1. On the horizon. 2001 Sep 1;9(5):1-6. https://doi.org/10.1108/10748120110424816
Zeide E. The structural consequences of big data-driven education. Big data. 2017 Jun 1;5(2):164-72. https://doi.org/10.1089/big.2016.0061
Cooper MM. Data-driven education research. Science. 2007 Aug 31;317(5842):1171-1183. https://doi.org/10.1126/science.317.5842.1171
Mokhtari K, Rosemary CA, Edwards PA. Making instructional decisions based on data: What, how, and why. The Reading Teacher. 2007 Dec 1;61(4):354-9. http://dx.doi.org/10.1598/RT.61.4.10
Siemens G, Long P. Penetrating the fog: Analytics in learning and education. EDUCAUSE review. 2011;46(5):30.
Lu OH, Huang JC, Huang AY, Yang SJ. Applying learning analytics for improving students engagement and learning outcomes in an MOOCs enabled collaborative programming course. Interactive Learning Environments. 2017 Feb 17;25(2):220-34. https://doi.org/10.1080/10494820.2016.1278391
Ifenthaler D. Are higher education institutions prepared for learning analytics?. TechTrends. 2017 Jul 1;61(4):366-71. http://dx.doi.org/10.1007/s11528-016-0154-0
Banihashem SK, Aliabadi K, Ardakani SP, Delaver A, Ahmadabadi MN. Learning analytics: A critical literature review. Interdisciplinary Journal of Virtual Learning in Medical Sciences. 2018; 9(2). https://dx.doi.org/10.5812/ijvlms.63024
Mah DK. Learning analytics and digital badges: Potential impact on student retention in higher education. Technology, Knowledge and Learning. 2016 Oct 1;21(3):285-305. https://doi.org/10.1007/s10758-016-9286-8
de Freitas S, Gibson D, Du Plessis C, Halloran P, Williams E, Ambrose M, Dunwell I, Arnab S. Foundations of dynamic learning analytics: Using university student data to increase retention. British Journal of Educational Technology. 2015 Nov;46(6):1175-88. https://doi.org/10.1111/bjet.12212
Conde MA, Hernandez-Garcia A. Learning analytics for educational decision making. Comput Hum Behav. 2015;47:1–3. https://doi.org/10.1016/j.chb.2014.12.034
Lawson C, Beer C, Rossi D, Moore T, Fleming J. Identification of ‘at risk’students using learning analytics: the ethical dilemmas of intervention strategies in a higher education institution. Educational Technology Research and Development. 2016 Oct 1;64(5):957-68. https://doi.org/10.1007/s11423-016-9459-0
Siemens G. Learning analytics: The emergence of a discipline. American Behavioral Scientist. 2013 Oct;57(10):1380-400. https://doi.org/10.1177%2F0002764213498851
Stewart C. Learning Analytics: Shifting from theory to practice. Journal on Empowering Teaching Excellence. 2017;1(1):10. https://doi.org/10.15142/T3G63W
Knight S, Shum SB, Littleton K. Epistemology, assessment, pedagogy: where learning meets analytics in the middle space. Journal of Learning Analytics. 2014 Aug 7;1(2):23-47. https://doi.org/10.18608/jla.2014.12.3
Wong J, Baars M, de Koning BB, van der Zee T, Davis D, Khalil M, Houben GJ, Paas F. Educational Theories and Learning Analytics: From Data to Knowledge. InUtilizing Learning Analytics to Support Study Success 2019 (pp. 3-25). Springer, Cham. https://doi.org/10.1007/978-3-319-64792-0_1
Ertmer PA. Addressing first-and second-order barriers to change: Strategies for technology integration. Educational technology research and development. 1999 Dec 1;47(4):47-61. https://doi.org/10.1007/BF02299597
Wise AF. Designing pedagogical interventions to support student use of learning analytics. InProceedings of the fourth international conference on learning analytics and knowledge 2014 Mar 24 (pp. 203-211). ACM. http://dx.doi.org/10.1145/2567574.2567588
Gašević D, Dawson S, Rogers T, Gasevic D. Learning analytics should not promote one size fits all: The effects of instructional conditions in predicting academic success. The Internet and Higher Education. 2016 Jan 1; 28:68-84. https://doi.org/10.1016/j.iheduc.2015.10.002
Gašević D, Dawson S, Siemens G. Let’s not forget: Learning analytics are about learning. TechTrends. 2015 Jan 1;59(1):64-71. https://doi.org/10.1007/s11528-014-0822-x
Siemens G. Learning and knowing in networks: Changing roles for educators and designers. ITFORUM for Discussion. 2008 Jan 27; 27:1-26
Banihashem SK, Aliabadi K. Connectivism: implications for distance education. Interdisciplinary Journal of Virtual Learning in Medical Sciences. 2017;8(3). https://dx.doi.org/10.5812/ijvlms.10030
Goldie JG. Connectivism: A knowledge learning theory for the digital age?. Medical teacher. 2016 Oct 2;38(10):1064-9. https://doi.org/10.3109/0142159X.2016.1173661
Tennyson RD, Rasch M. Linking cognitive learning theory to instructional prescriptions. Instructional Science. 1988 Dec 1;17(4):369-85. https://doi.org/10.1007/BF00056222
Siemens, G. Connectivism. A learning theory for the digital age. International Journal of Instructional Technology and Distance Learning, 2005;2(1).
Akdeniz C. Instructional Process and Concepts in Theory and Practice. Singapore: Springer; 2016.
Bell F. Connectivism: Its place in theory-informed research and innovation in technology-enabled learning. The International Review of Research in Open and Distributed Learning. 2011 Mar 25;12(3):98-118. http://usir.salford.ac.uk/13064/
Mergel, B. Instructional design and learning theory. University of Saskatchewan. 1998. https://etad.usask.ca/802papers/mergel/mergel.pdf
Ertmer PA, Newby TJ. Behaviorism, cognitivism, constructivism: Comparing critical features from an instructional design perspective. Performance improvement quarterly. 2013;26(2):43-71. https://doi.org/10.1002/piq.21143
Altun S, Büyükduman FI. Teacher and student beliefs on constructivist instructional design: A case study. Kuram ve Uygulamada Egitim Bilimleri. 2007;7(1):30.
Richardson V. Constructivist teaching and teacher education: Theory and practice. In Constructivist teacher education 2005 Aug 15 (pp. 13-24). Routledge. http://dx.doi.org/10.4324/9780203973684
Braun, V., Clarke, V., Hayfield, N., & Terry, G. Thematic analysis. Handbook of research methods in health social sciences, 2018;1-18. http://dx.doi.org/10.1191/1478088706qp063oa
Terry G, Hayfield N, Clarke V, Braun V. Thematic analysis. The Sage handbook of qualitative research in psychology. 2017 Mar 31:17-37.
Braun V, Clarke V. Using thematic analysis in psychology. Qualitative research in psychology. 2006 Jan 1;3(2):77-101. https://doi.org/10.1191/1478088706qp063oa
Strauss A, Corbin J. Basics of qualitative research. Sage publications; 1998.
Glaser B, Strauss AL. The discovery of grounded theory: Strategies for qualitative research. 1967;139.
Böhm A. Theoretical Coding: Text Analysis in Grounded Theory. In Flick U. Kardoff E. & Stenlkne I. (Eds). A Companion to Qualitative Research. 2004:270-275.
Maher C, Hadfield M, Hutchings M, de Eyto A. Ensuring rigor in qualitative data analysis: A design research approach to coding combining NVivo with traditional material methods. International Journal of Qualitative Methods. 2018 Jul 9;17(1):1609406918786362. https://doi.org/10.1177%2F1609406918786362
Scott C, Medaugh M. Axial Coding. The International Encyclopedia of Communication Research Methods. 2017 Apr 24:1-2. https://doi.org/10.1002/9781118901731.iecrm0012
Robrecht LC. Grounded theory: Evolving methods. Qualitative health research. 1995 May;5(2):169-77. https://doi.org/10.1177%2F104973239500500203
Koh E, Shibani A, Tan JP, Hong H. A pedagogical framework for learning analytics in collaborative inquiry tasks: An example from a teamwork competency awareness program. In Proceedings of the Sixth International Conference on Learning Analytics & Knowledge 2016 Apr 25 (pp. 74-83). ACM. https://doi.org/10.1145/2883851.2883914
Mezirow, J. Transformative learning theory. In Contemporary Theories of Learning. Routledge. 2018;114-128. https://doi.org/10.4324/9781315147277-8
Akers RL, Jennings WG. Social learning theory. The Handbook of Criminological Theory. 2015 Aug 25;4:230-40. https://doi.org/10.1002/9781118512449
Interdisciplinary Journal of Virtual Learning in Medical Sciences
Volume 10, Issue 4
December 2019
Pages 14-27

Files

Share

How to cite

Statistics