The Bright and Dark Sides of AI Dependency on Students’ Critical Thinking: The Roles of Cognitive Fatigue and Engagement

Main Article Content

Mohamad Arief Rafsanjani
Riza Yonisa Kurniawan
Handri Dian Wahyudi
Prattana Srisuk

Abstract

Background/ problem: The rise of artificial intelligence (AI) use in education has sparked debate about its potential association with students’ critical thinking, while existing studies have reported inconsistent findings.


Objective/ purpose: This study examined how AI dependency affects students’ critical thinking disposition through the mediating roles of cognitive fatigue and engagement.


Design and Methodology: A cross-sectional survey was conducted among 639 university students in Java, Indonesia, using convenience sampling design. Data were collected through an online questionnaire and analyzed using partial least squares structural equation modeling (SEM-PLS).


Results: The findings show that AI dependency does not directly affect students' critical thinking disposition (β = .05, p = .31). Instead, cognitive fatigue (β = -.60, p = .00) and engagement (β = .36, p = .00) significantly mediate the relationship in contrasting ways. On one hand, AI dependency increases cognitive fatigue, which subsequently weakens students' critical thinking disposition. On the other hand, AI dependency promotes engagement, which in turn strengthens critical thinking disposition.


Conclusion and Implications: These findings suggest that AI dependency influence students’ critical thinking disposition indirectly through contrasting cognitive and behavioral pathways. From a behavioral-science perspective, modifiable student–AI interaction behaviors shape these outcomes. Educators should promote reflective AI engagement, require independent verification of AI-generated outputs, and design learning activities that maintain students’ responsibility for reasoning and decision-making. Strategies that limit cognitive offloading, uncritical acceptance of AI outputs, and excessive dependency help prevent cognitive fatigue and support students’ critical thinking disposition.

Downloads

Download data is not yet available.

Article Details

How to Cite
Rafsanjani, M. A., Kurniawan, R. Y., Wahyudi, H. D., & Srisuk, P. (2026). The Bright and Dark Sides of AI Dependency on Students’ Critical Thinking: The Roles of Cognitive Fatigue and Engagement. The Journal of Behavioral Science, 21(3), 123–138. https://doi.org/10.69523/tjbs.2026.298843
Section
Research Articles

References

Agustinova, D. E., Aman, A., Sariyatun, S., Darmawan, W., Pangestu, D. A., & Razzaq, R. A. (2026). The effect of artificial intelligence-based literacy model in history learning on the critical thinking skills of high school students in Yogyakarta. International Online Journal of Education and Teaching, 13(2), 110–118. https://iojet.org/index.php/IOJET/article/view/2318

Ahmed, S., & Rasul, M. E. (2023). Examining the association between social media fatigue, cognitive ability, narcissism and misinformation sharing: Cross-national evidence from eight countries. Scientific Reports, 13(1), 15416. https://doi.org/10.1038/s41598-023-42614-z

Bayly-Castaneda, K., & Ramirez-Montoya, M. S. (2025). Empowering financial decision-making with AI agents: A case study on critical thinking development. Revista Iberoamericana de Tecnologias del Aprendizaje, 20, 220–226. https://doi.org/10.1109/RITA.2025.3600114

Bernava, G., Nucita, A., Iannizzotto, G., Caprì, T., & Fabio, R. A. (2021). Proteo: A framework for serious games in telerehabilitation. Applied Sciences, 11(13), 5935. https://doi.org/10.3390/app11135935

da Silva Cezar, B. G., & Maçada, A. C. G. (2023). Cognitive overload, anxiety, cognitive fatigue, avoidance behavior and data literacy in big data environments. Information Processing & Management, 60(6), 103482. https://doi.org/10.1016/j.ipm.2023.103482

Gil-Gómez, J. A., Manzano-Hernández, P., Albiol-Pérez, S., Aula-Valero, C., Gil-Gómez, H., & Lozano-Quilis, J. A. (2017). USEQ: A short questionnaire for satisfaction evaluation of virtual rehabilitation systems. Sensors, 17(7), 1589. https://doi.org/10.3390/s17071589

Goh, A. Y. H., Hartanto, A., & Majeed, N. M. (2025). Generative artificial intelligence dependency: Scale development, validation, and its motivational, behavioral, and psychological correlates. Computers in Human Behavior Reports, 20, 100845. https://doi.org/10.1016/j.chbr.2025.100845

Hair, J. F., Risher, J. J., Sarstedt, M., & Ringle, C. M. (2019). When to use and how to report the results of PLS-SEM. European Business Review, 31(1), 2–24. https://doi.org/10.1108/EBR-11-2018-0203

Hair, J., & Alamer, A. (2022). Partial least squares structural equation modeling (PLS-SEM) in second language and education research: Guidelines using an applied example. Research Methods in Applied Linguistics, 1(3), 100027. https://doi.org/10.1016/j.rmal.2022.100027

Hinss, M. F., Brock, A. M., & Roy, R. N. (2022). Cognitive effects of prolonged continuous human-machine interaction: The case for mental state-based adaptive interfaces. Frontiers in Neuroergonomics, 3, 935092. https://doi.org/10.3389/fnrgo.2022.935092

Kancharla, K., Kanagaraj, S., & Ram Gopal, C. N. (2022). Neuropsychological evaluation of cognitive failure and excessive smartphone use: A path model analysis. Biomedical and Pharmacology Journal, 15(4), 2185–2191. https://doi.org/10.13005/bpj/2555

Karamuk, E. (2025). The automation trap: Unpacking the consequences of over-reliance on AI in education and its hidden costs. In Pitfalls of AI Integration in Education: Skill Obsolescence, Misuse, and Bias (pp. 151–174). https://doi.org/10.4018/979-8-3373-0122-8.ch007

Katsenou, R., Kotsidis, K., Papadopoulou, A., Anastasiadis, P., & Deliyannis, I. (2025). Beyond assistance: Embracing AI as a collaborative co-agent in education. Education Sciences, 15(8), 1006. https://doi.org/10.3390/educsci15081006

King, M. F., & Bruner, G. C. (2000). Social desirability bias: A neglected aspect of validity testing. Psychology & Marketing, 17(2), 79–103. https://doi.org/10.1002/(SICI)1520-6793(200002)17:2<79::AID-MAR2>3.0.CO;2-0

Kohli, J., & Farzana, O. I. (2026). Enhancing critical thinking assessment through AI-student dialogue analysis. In A. Kumar, R. Juárez Ramírez, M. de los Angeles Quezada, & D. Chinnathambi (Eds.), Mathematical methods in artificial intelligence: Intelligent systems (pp. 319–330). De Gruyter. https://doi.org/10.1515/9783112234952-032

Kotnik, P., Roelands, B., & Bogataj, Š. (2024). Prolonged theoretical classes impact students’ perceptions: An observational study. Frontiers in Psychology, 15, 1278396. https://doi.org/10.3389/fpsyg.2024.1278396

Oliva-Córdova, L. M., Álvarez-Icaza, I., & George-Reyes, C. E. (2025). Evaluation of generative AI use to foster critical thinking in higher education. IEEE Revista Iberoamericana de Tecnologias del Aprendizaje, 20, 237–243. https://doi.org/10.1109/RITA.2025.3597848

Palarimath, S., Maran, P., Venkateswaran, R., Wilfred Blessing, N. R., Shiny, K. V., & Renuga, S. (2024). Integrating artificial intelligence and multiple intelligences for advanced educational models. In 2024 International Conference on Electrical Electronics and Computing Technologies (ICEECT) (pp. 1–6). IEEE. https://doi.org/10.1109/ICEECT61758.2024.10739034

Reicho, M., Otrel-Cass, K., Ebner, M., Brünner, B., Freinhofer, D., & Irfan, J. (2026). Generative AI literacy across education and business: Competencies, obstacles, and benefits—a systematic literature review. International Journal of Educational Technology in Higher Education, 23, 23. https://doi.org/10.1186/s41239-026-00596-8

Risko, E. F., & Gilbert, S. J. (2016). Cognitive offloading. Trends in Cognitive Sciences, 20(9), 676–688. https://doi.org/10.1016/j.tics.2016.07.002

Romeo, G., & Conti, D. (2026). Exploring automation bias in human–AI collaboration: A review and implications for explainable AI. AI & SOCIETY, 41(1), 259–278. https://doi.org/10.1007/s00146-025-02422-7

Rozaimee, F., & Mumin, M. A. (2025). ChatGPT integration in writing development: Student experiences and perspectives. World Journal of English Language, 15(8), 74–83. https://doi.org/10.5430/wjel.v15n8p74

Rudolph, J., Tan, S., & Tan, S. (2023). ChatGPT: Bullshit spewer or the end of traditional assessments in higher education? Journal of Applied Learning & Teaching, 6(1), 342–363. https://doi.org/10.37074/jalt.2023.6.1.9

Sanchez-Lopez, A. L., Jimenez-Perez, M. I., Perfecto-Avalos, Y., Navarro-Lopez, D. E., Esparza-Sanchez, J., & Lopez Mena, E. R. (2025). Integration of artificial intelligence as a tool to enhance critical thinking skills and foster learning in bioengineering education. In 2025 IEEE Global Engineering Education Conference (EDUCON) (pp. 1–5). IEEE. https://doi.org/10.1109/EDUCON62633.2025.11016586

Shaikh, S. A., & Jagirdar, A. H. (2026). Beyond AI dependence: Pedagogical approaches to strengthen student reasoning and analytical skills. In Empowering Learners With AI: Strategies, Ethics, and Frameworks (pp. 185–200). https://doi.org/10.4018/979-8-3373-7386-7.ch008

Shetgaonkar, A., Pradhan, D., Arora, L., Girija, S. S., Raj, A., & Kapoor, S. (2025). Mitigating clinician information overload: Generative AI for integrated EHR and RPM data analysis. In 2025 IEEE 49th Annual Computers, Software, and Applications Conference (COMPSAC) (pp. 2032–2039). IEEE. https://doi.org/10.1109/COMPSAC65507.2025.00284

Skulmowski, A. (2023). The cognitive architecture of digital externalization. Educational Psychology Review, 35(4), 101. https://doi.org/10.1007/s10648-023-09818-1

Sosu, E. M. (2013). The development and psychometric validation of a Critical Thinking Disposition Scale. Thinking Skills and Creativity, 9, 107–119. https://doi.org/10.1016/j.tsc.2012.09.002

Stuchlikova, L., & Weis, M. (2024). From information to insight: Reimagining critical thinking pedagogy in the age of artificial intelligence. In 2024 International Conference on Emerging eLearning Technologies and Applications (ICETA) (pp. 591–598). IEEE. https://doi.org/10.1109/ICETA63795.2024.10850787

Suntharalingam, P. (2026). Using AI to Foster Creativity, Critical Thinking, and Innovation in Students. In R. Abdelaal & M. Kayyali (Eds.), Intelligent Learning Tools, Enhancing Student Skills, and Career Preparedness (pp. 89-124). IGI Global Scientific Publishing. https://doi.org/10.4018/979-8-3373-9225-7.ch004

Suriano, R., Plebe, A., Acciai, A., & Fabio, R. A. (2025). Student interaction with ChatGPT can promote complex critical thinking skills. Learning and Instruction, 95, 102011. https://doi.org/10.1016/j.learninstruc.2024.102011

Sweller, J. (1988). Cognitive load during problem solving: Effects on learning. Cognitive Science, 12(2), 257–285. https://doi.org/10.1016/0364-0213(88)90023-7

Tian, J., & Zhang, R. (2025). Learners' AI dependence and critical thinking: The psychological mechanism of fatigue and the social buffering role of AI literacy. Acta Psychologica, 260, 105725. https://doi.org/10.1016/j.actpsy.2025.105725

Venugopal, K., & Vakamullu, G. (2025). Assessment of higher education students' dependency on AI tools in an Indian indigenized context. In Indigenous Teaching Disciplines and Perspectives for Higher Education (pp. 309–338). https://doi.org/10.4018/979-8-3693-9296-6.ch015

Yang, H., Zeng, Y., Xing, H., & Hu, P. (2026). Fatigued by uncertainties: Exploring the cognitive and emotional costs of generative AI usage. International Journal of Information Management, 87, 103010. https://doi.org/10.1016/j.ijinfomgt.2025.103010

Zaal, E., Ongena, Y., van der Velden, N., Loughnan, D., & Hoeks, J. (2026). Unraveling honest responding: A systematic review on the effectiveness of social desirability bias reduction methods in survey research. Quality & Quantity, 60(3), 10359-10391. https://doi.org/10.1007/s11135-026-02664-7

Zhang, W., & Liu, X. (2025). Artificial intelligence-generated content empowers college students’ critical thinking skills: What, how, and why. Education Sciences, 15(8), 977. https://doi.org/10.3390/educsci15080977