The Impact of Reward Types and Leaderboard Use in Kahoot-Based Math Learning: A Quasi-Experimental Study

Articles in Press

Document Type : Original Article

Authors

1 Department of Educational Technology, Faculty of Humanities, Tarbiat Modares University, Tehran, Iran

2 Department of Educational Technology, Kharazmi University, Tehran, Iran

3 Department of E-learning in Medical Sciences, Virtual School and Center of Excellence in E-learning, Shiraz University of Medical Sciences, Shiraz, Iran

10.30476/ijvlms.2025.104640.1320

Abstract

Background: Motivation plays a critical role in student engagement and learning outcomes. However, limited research has compared the effects of tangible versus intangible rewards in game-based learning environments. This study aimed to investigate the comparative effects of tangible and intangible rewards on students’ motivation and engagement when using the Kahoot platform for mathematics education.
Methods: This study utilized a quasi-experimental approach with pre-test and post-test assessments, conducted among 277 elementary students between September 2020 and June 2021. Using convenience sampling, participants were assigned to three groups: a control group (95 students), an experimental group using Kahoot with intangible rewards (90 students), and a second experimental group using Kahoot with both tangible and intangible rewards (92 students). The intervention was carried out over a six-week period. Content validity was confirmed using the Content Validity Ratio (CVR), with all items exceeding 0.80 and an overall agreement coefficient of 0.84. The reliability was verified with a test–retest correlation of 0.70.
Results: The comparative analysis revealed that Kahoot-based learning was more effective than social network-based instruction. Furthermore, the group that received both tangible and intangible rewards demonstrated significantly greater learning gains compared to those who received only intangible rewards (p<0.05).
Conclusion: The findings support the use of gamified platforms such as Kahoot to enhance mathematics learning, particularly when leaderboard-based reward strategies are employed. Future research should investigate the long-term effects of different reward types and their influence on sustaining student motivation.

Highlights

Farzaneh Jafari (Google Scholar)

Keywords

References

  1. Volk M, Cotič M, Zajc M, Starcic AI. Tablet-based cross-curricular maths vs. traditional maths classroom practice for higher-order learning outcomes. Comput Educ. 2017;114:1-23. doi: 10.1016/j.compedu.2017.06.004.
  2. Yeh CY, Cheng HN, Chen Z-H, Liao CC, Chan T-W. Enhancing achievement and interest in mathematics learning through Math-Island. Res Pract Technol Enhanc Learn. 2019;14(1):5. doi: 10.58459/rptel.2019.14%p.
  3. Fadda D, Pellegrini M, Vivanet G, Zandonella Callegher C. Effects of digital games on student motivation in mathematics: A meta‐analysis in K‐12. J Comput Assist Learn. 2022;38(1):304-25. doi: 10.1111/jcal.12618.
  4. Christopher L, Waworuntu A. Java programming language learning application based on octalysis gamification framework. IJNMT (International Journal of New Media Technology). 2021;8(1):65-9. doi: 10.31937/ijnmt.v8i1.2049.
  5. Looyestyn J, Kernot J, Boshoff K, Ryan J, Edney S, Maher C. Does gamification increase engagement with online programs? A systematic review. PloS one. 2017;12(3):e0173403. doi: 10.1371/journal.pone.0173403. PubMed PMID: 28362821; PubMed Central PMCID: PMC5376078.
  6. Hergenhahn BR, Olson MH. An Introduction to Theories of Personality. 6th edition. New Jersey, U.S: Prentice-Hall, Inc; 2003. P. 309.
  7. Sailer M, Sailer M. Gamification of in‐class activities in flipped classroom lectures. Br J Educ Technol. 2021;52(1):75-90. doi: 10.1111/bjet.12948.
  8. Tejedor-García C, Escudero-Mancebo D, Cardeñoso-Payo V, González-Ferreras C. Using challenges to enhance a learning game for pronunciation training of English as a second language. IEEE Access. 2020;8:74250-66. doi: 10.1109/ACCESS.2020.2988406.
  9. Ding L, Kim C, Orey M. Studies of student engagement in gamified online discussions. Comput Educ. 2017;115:126-42. doi: 10.1016/j.compedu.2017.06.016.
  10. Hamari J. Do badges increase user activity? A field Experiment on the Effects of Gamification. Comput Human Behav. 2017;71:469-78. doi: 10.1016/j.chb.2015.03.036.
  11. De Pontes RG, Medeiros KH, Guerrero DD, de Figueiredo JC. Analyzing the impact of leaderboards in introductory programming courses’ short-length activities. 2018 IEEE Frontiers in Education Conference (FIE); 2018 Oct 03-06; San Jose, CA, USA. USA: IEEE; 2018. doi:10.1109/FIE.2018.8658937.
  12. Indrawati I, Marzuki M, Malik AR. Investigating the effect of reward and punishment on the student’s learning achievement and discipline. LEEA. 2021;4(2):2597-3819. doi: 10.31539/leea.v4i2.1860 .
  13. Martins ER, Geraldes WB, Afonseca UR, Gouveia LMB. Using Kahoot as a Learning Tool. Information Systems for Industry 40. USA: Springer; 2019. doi: 10.1007/978-3-030-14850-8_11.
  14. Wang AI, Tahir R. The Effect of Using Kahoot! for Learning–A Literature Review. Comput Educ. 2020;149:103818. doi:10.1016/j.compedu.2020.103818.
  15. Licorish SA, Owen HE, Daniel B, George JL. Students’ perception of Kahoot!’s influence on teaching and learning. Res Pract Technol Enhanc Learn. 2018;13(1):1-23. doi:10.1186/s41039-018-0078-8.
  16. Ismail M, Sa’Adan N, Samsudin M, Hamzah N, Razali N, Mahazir I. Implementation of the Gamification Concept Using KAHOOT! Among TVET Students: An Observation. International Conference on Electrical, Electronic, Informatics and Vocational Education (ICE-ELINVO 2018); 2018 Sep 13; Yogyakarta, Indonesia. J Phys: Conf Ser. 2018;1140 012013. doi:10.1088/1742-6596/1140/1/012013.
  17. Tóth Á, Lógó P, Lógó E. The Effect of the Kahoot Quiz on the Student's Results in the Exam. Period Polytech Soc Manag Sci. 2019;27(2):173-9. doi: 10.3311/PPso.12464.
  18. Bai S, Gonda DE, Hew KF. Effects of tangible rewards on student learning performance, knowledge construction, and perception in fully online gamified learning. Proceedings of 2021 IEEE International Conference on Engineering Technology, and Education (TALE); 2021 Dec 5-8, Wuhan, Hubei Province, China. Danvers, MA: IEEE; 2021.
  19. Xiao Y, Hew KFT. Intangible rewards versus tangible rewards in gamified online learning: Which promotes student intrinsic motivation, behavioural engagement, cognitive engagement and learning performance? Br J Educ Technol. 2024;55(1):297-317. doi:10.1111/bjet.13361.
  20. Mazeas A, Duclos M, Pereira B, Chalabaev A. Evaluating the Effectiveness of Gamification on Physical Activity: Systematic Review and Meta-analysis of Randomized Controlled Trials. J Med Internet Res. 2022;24(1):e26779. doi: 10.2196/26779. PubMed PMID: 34982715; PubMed Central PMCID: PMC8767479.
  21. Landers RN, Bauer KN, Callan RC. Gamification of task performance with leaderboards: A goal setting experiment. Comput Human Behav. 2017;71:508-15. doi:10.1016/j.chb.2015.08.008.
  22. Arora P, Fazlul I, Musaddiq T, Vats A. Can social recognition for teachers and principals improve student performance? Evidence from India. Appl Econ Lett. 2023;30(18):2589-96. doi: 10.1080/13504851.2022.2099799.
  23. Singh CKS, Mulyadi D, Ong ET. Exploring the use of Kahoot! to monitor learning performance among students in higher education. Train lang cult. 2024;8(4):36-47. doi: 10.22363/2521-442X-2024-8-4-36-47.
  24. Maraza-Quispe B, Traverso-Condori LC, Torres-Gonzales SB, Reyes-Arco R, Tinco-Túpac S, Reyes-Villalba E, et al. Impact of the use of gamified online tools: A study with Kahoot and Quizizz in the educational context. Int J Inf Educ Technol. 2024;14(1):132-40. doi: 10.18178/ijiet.2024.14.1.2033.
  25. Park S, Kim S. Leaderboard Design Principles to Enhance Learning and Motivation in a Gamified Educational Environment: Development Study. JMIR Serious Games. 2021;9(2):e14746. doi: 10.2196/14746. PubMed PMID: 33877049; PubMed Central PMCID: PMC8097522.
  26. Skinner CH, Bennett J, Richardson R, Scott K, Wheat LS, Martinez J. Educational equity, academic standards, and countercontrol: Preventing academic deficits with supplemental interdependent rewards. Psychol Sch. 2023;60(1):5-22. doi: 10.1002/pits.22756.
  27. Ratinho E, Martins C. The role of gamified learning strategies in student's motivation in high school and higher education: A systematic review. Heliyon. 2023;9(8):e19033. doi: 10.1016/j.heliyon.2023.e19033. PubMed PMID: 37636393; PubMed Central PMCID: PMC10448467.
  28. Wu X, Santana S. Impact of Intrinsic and Extrinsic Gaming Elements on Online Purchase Intention. Front Psychol. 2022 Jun 9;13:885619. doi: 10.3389/fpsyg.2022.885619. PubMed PMID: 35756248; PubMed Central PMCID: PMC9220799.
Interdisciplinary Journal of Virtual Learning in Medical Sciences

Articles in Press, Accepted Manuscript
Available Online from 14 December 2025

Files

History

  • Receive Date: 02 November 2024
  • Revise Date: 23 September 2025
  • Accept Date: 14 October 2025
  • Publish Date: 14 December 2025

Share

How to cite

Statistics