Identifying Key Factors Influencing the Development of Higher Order Thinking Skills (HOTS) in Students: A Systematic Literature Review

Authors

  • Ismeirita Ismeirita Universitas Pendidikan Indonesia, Indonesia
  • Eeng Ahman Universitas Pendidikan Indonesia, Indonesia
  • Dadang Dahlan Universitas Pendidikan Indonesia, Indonesia
  • Dedi Supendra University of Sheffield, United Kingdom

DOI:

https://doi.org/10.35445/alishlah.v17i3.6627

Keywords:

higher order thinking skills, systematic literature review, critical thinking, creative thinking

Abstract

Higher-order thinking skills (HOTS), encompassing critical thinking, creative thinking, and problem-solving, are essential competencies for 21st-century learners. Despite extensive research, a holistic synthesis of the multidimensional factors influencing HOTS remains limited. This study employed a Systematic Literature Review (SLR) following PRISMA guidelines to identify and analyze factors affecting HOTS. A total of 42 peer-reviewed articles indexed in Scopus, published between 2014 and 2024, were reviewed. Articles were assessed for quality using CASP and JBI checklists, and thematic analysis was conducted using NVivo software. Analysis revealed six main dimensions influencing HOTS: individual, learning environment, teacher, curriculum, contextual and cultural, and affective, encompassing 16 sub-themes. The individual dimension emerged as the most influential (26%), followed by learning environment (24%), teacher (23%), curriculum (11%), contextual and cultural (9%), and affective (7%). The findings highlight the multifaceted nature of HOTS development, with particular emphasis on internal student attributes and teacher competence. Practical implications include the need for personalized learning approaches, enhanced teacher training in problem-based pedagogy, and adaptive, culturally responsive curricula. These insights can inform educational policy and classroom practice aimed at fostering HOTS across educational levels.

References

Agustini, K., Santyasa, I. W., Tegeh, I. M., Santyadiputra, G. S., & Mertayasa, I. N. E. (2022). "Quantum Flipped Learning and Students’ Cognitive Engagement in Achieving Their Critical and Creative Thinking in Learning." International Journal of Emerging Technologies in Learning (iJET), 17(18), 4-25.

Ahmed, A. O. A., & AbdAlgane, M. (2023). "Blending Creative Approaches to English Language Learning: Shaping Critical Thinkers." Journal of Language Teaching and Research, 14(4), 1058-1064.

Bratslavsky, L., Wright, A., Kritselis, A., & Luftig, D. (2019). "The Strategically Ambiguous Assignment: An Approach to Promoting Critical and Creative Thinking in Visual Communication." Journal of Visual Literacy, 38(4), 285-304.

Brookhart, S. M. (2010). How to assess higher-order thinking skills in your classroom. Ascd.

Brookhart, S. M. (2019), "Assessment of Higher Order Thinking Skills (HOTS) dalam Pembelajaran," Educational Psychologist.

Chen, K., & Chen, C. (2021). "Effects of STEM Inquiry Method on Learning Attitude and Creativity." EURASIA Journal of Mathematics, Science and Technology Education, 17(11).

Chini JC, Carmichael A, Rebello NS, Puntambekar S (2009). Does the Teaching Learning Interview Provide an Accurate Snapshot of Classroom Learning?. Proceedings of the 2009 Physics Education Research Conference, AIP Publications, July 29-30.

Cojorn, K., & Sonsupap, K. (2024). "Examining science teachers' TPACK impact on students' post-pandemic thinking skills." International Journal of Advanced Applied Science and Technology (IJAAS), 5(5), 45-60.

Farah, A., & Al-Hattami, A. (2023). "An Exploration Study of Students’ Engagement and Perception of the Teaching and Learning Environment." Journal of Education and Learning, 16(3), 45-60.

Fathonah, S., Cahyono, E., Haryani, S., Sarwi, S., & Lestari, N. H. (2024). "Application of Multirepresentation-Based Creative Problem-Solving Learning Models to Improve Critical and Creative Thinking Skills for Students." International Journal of Cognitive Research in Science, Engineering and Education (IJCRSEE), 12(1), 185-200.

Fongkanta, P., & Buakanok, F. S. (2024). "Development novice teachers’ higher-order thinking skills through online problem-based learning platform: A mixed methods experimental research." Jurnal Cakrawala Pendidikan, 43(3), 1-15.

Haddaway, N. R., Page, M. J., Pritchard, C. C., & McGuinness, L. A. (2022). PRISMA2020: An R package and Shiny app for producing PRISMA 2020-compliant flow diagrams, with interactivity for optimised digital transparency and Open Synthesis Campbell Systematic Reviews, 18, e1230.

Hariyadi, A., Dumiyati, T., Tukiyo, & Darmuki, A. (2023). "The Effectiveness of PBL Collaborated with PjBL on Students’ 4C in the Course of Basic Education." International Journal of Instruction, 16(3), 897-914.

Harris, J., Mishra, P., & Koehler, M. (2009). Teachers’ Technological Pedagogical Content Knowledge and Learning Activity Types: Curriculum-Based Technology Integration Reframed. Journal of Research on Technology in Education, 41(4), 393-416.

Horan R (2007). The Relationship Between Creativity and Intelligence: A Combined Yogic- Scientific Approach. Creativity Res. J. 19(2–3): 179-202

Hursen, C. (2020). "The Effect of Problem-Based Learning Method Supported by Web 2.0 Tools on Academic Achievement and Critical Thinking Skills in Teacher Education." Technology, Knowledge and Learning, 26(3), 515-533.

Hwang, G.-J., & Kuo, F.-R. (2015). "A Structural Equation Model to Analyse the Antecedents to Students' Web-Based Problem-Solving Performance." Australasian Journal of Educational Technology, 31(4), 1-12.

Indrianto, A. T. L., Oktavio, A., Azmi, A., Abdullah, A., Isa, N. M., Adityaji, R., & Subadi, L. (2024). "Exploration of the teaching and learning model using the design thinking method in developing community-based tourism." Revista de Gestão Social e Ambiental (RGSA), 18(1), e04740.

Jayalakshmi, A. V., & Biswala, A. (2023). "Open book environment for enhancing the thinking skills in the Indian pre-service social studies teachers." Journal of e-Learning and Knowledge Society (Je-LKS), 19(3), 92-98.

Johnson, D. W., Johnson, R. T., & Smith, K. A. (2010). "Cooperative Learning Returns to College: What Evidence is There That It Works?". Change: The Magazine of Higher Learning, 55(4), 26-35.

Jonassen, D. H. (2000). Computers as Mindtools for Schools: Engaging Critical Thinking. Merrill/Prentice Hall.

Karadeniz, A. (2017). "The Relationship Between Faculty of Education Students’ Argumentation Skills and Critical Thinking, Creative Thinking and Problem Solving Skills." Australasian Journal of Educational Technology, 33(4), 1-12.

Kemdikbud (2013), "Konsep Penilaian K13," Kementerian Pendidikan dan Kebudayaan

Kemdikbud (2021), "Panduan Pembelajaran dan Asesmen Jenjang Pendidikan Dasar dan Menengah (SD/MI, SMP/MTs, SMA/SMK/MA)," Kementerian Pendidikan, Kebudayaan, Riset, dan Teknologi

Koesnandar, A., Setiawan, Y., & Sarifudin, S. (2022). Pemanfaatan Pusat Sumber Belajar (PSB) Digital untuk Inovasi Pembelajaran. Jurnal Teknodik, 26(1), 63-77.

Lavi, R., & Marti, D. (2023). "A Proposed Case-Based Learning Framework for Fostering Undergraduate Engineering Students’ Creative and Critical Thinking." Journal of Science Education and Technology, 32(3), 898-911.

Li, X.-Z., Chen, C.-C., & Kang, X. (2022). "Research on the cultivation of sustainable development ability of higher vocational students by creative thinking teaching method." Frontiers in Psychology, 13, 979913.

Lim S, Smith J (2008). The Structural Relationships of Parenting Style, Creative Personality, and Loneliness. Creativity Res. J. 20(4):412- 419.

Lord, K. C. (2019). "Flexible Learning: The Design Thinking Process as a K-12 Educational Tool." Journal of Higher Education Theory and Practice, 19(7), 2531-2542.

Mahmud, M. M., & Wong, S. F. (2022). "Digital age: The importance of 21st century skills among the undergraduates." Frontiers in Education, 7, 950553.

Marshall JC, Robert M, Horton RM (2011). The Relationship of Teacher - Facilitated, Inquiry-Based Instruction to Student Higher-Order Thinking. School Science and Mathematics.

Mishra, P., & Koehler, M. J. (2006). "Technological Pedagogical Content Knowledge: A Framework for Teacher Knowledge," Teachers College Record, 108(6), 1017-1054.

Montazemi AR, Hamed SHQ (2015). Factors affecting adoption of online banking: A meta-analytic structural equation modeling study. Inform. Manage. 52:210-226.

Nasir, N. A., Kiong, T. T., Sai’en, S., Qi, W., Azid, N. W., Singh, C. K. S., Ichwanto, M. A., & Juhari, M. I. (2023). "The Effects of Thinking Styles and Inventive Problem-Solving on the Problem-Solving Skills for Design and Technology Students." Journal of Technical Education and Training, 15(4), 11-22.

Nurrijal, R., Setyosari, P., Kuswandi, D., & Ulfa, S. (2023). "Creative Problem Solving Process Instructional Design in the Context of Blended Learning in Higher Education." International Journal of Education and Information Technologies, 14(2), 123-135.

OECD (2023). Innovative Learning Environments: Design, Implementation, and Impact. Paris: OECD Publishing.

OECD, P. (2019). Science Framework in PISA 2018 Assessment and Analytical Framework. OECD Publishing

Onoda, S. (2022). "Enhancing Creative Thinking, Critical Thinking, and Interactional Skills through Problem-Solving Group Projects among Undergraduate English Majors in Japan." 3L: Language, Linguistics, Literature, 28(2), 1-17.

Panadero, E. (2017), "A Review of Self-regulated Learning: Six Models and Four Directions for Research," Frontiers in Psychology.

Pannells TC, Claxton AF (2008). Happiness, Creative Ideation, and Locus of Control. Creativity Res. J. 20(1): 67-71

Paputungan, F., & Inaku, R. (2022), "Affective Theory According to Experts," Journal of Education and Culture (JEaC), Vol. 2 No. 2, October 2022. ISSN: 2986-1012 (Media Online).

Pascarella ET, Wang JS, Trolian TL, Blaich C (2013). How the instructional and learning environments of liberal arts colleges enhance cognitive development. Higher Educ. 66:569-583

Pinto-Llorente, A. M., Casillas-Martín, S., Cabezas-González, M., & García-Peñalvo, F. J. (2018). "Building, Coding and Programming 3D Models via a Visual Programming Environment." Quality & Quantity, 52, 2455-2468.

Pintrich, P. R., & Schunk, D. H. (2002), "Motivation in Education: Theory, Research, and Applications," Educational Psychologist.

Poce, A., Amenduni, F., & De Medio, C. (2019). "From Tinkering to Thinkering. Tinkering as Critical and Creative Thinking Enhancer." Journal of e-Learning and Knowledge Society (Je-LKS), 4(2), 1-12.

Priyaadharshini, M., & Vinayaga Sundaram, B. (2018). "Evaluation of Higher-Order Thinking Skills Using Learning Style in an Undergraduate Engineering in Flipped Classroom."

Resnick, L. B. (1987), "Education and Learning to Think," dalam Knowledge and Learning: Issues, Controversies, and Opportunities, American Educational Research Association.

Sani, R. (2019), "Pembelajaran Berbasis HOTS: Pendekatan Gaya Belajar," Journal of Learning Sciences,

Sang, G., Liang, J.-C., Chai, C. S., Dong, Y., & Tsai, C.-C. (2018). "Teachers’ Actual and Preferred Perceptions of Twenty-First Century Learning Competencies: A Chinese Perspective." Asia Pacific Education Review, 19(2), 307-317.

Sáenz-Rodríguez, R. R., Ramirez-Asis, E. E., Dextre-Martínez, W. R., & Guerra-Muñoz, M. E. (2021). "Cooperative learning enhances critical thinking in Peruvian economics university students." Economic Annals-XXI, 193(9-10), 146-151.

Sastradinata, B. L. N. (2023). Transformasi Mindset dalam Membangun Kemampuan Berpikir Kritis Melalui Metode Pembelajaran Aktif. Deepublish.

Schunk, D. H., & Zimmerman, B. J. (2007). Motivational Strategies for Learning and Performance. Journal of Educational Psychology, 99(3), 331-340.

Shari T, Eileen J, David P (1993). Teaching Thinking Dispositions: From transmission to enculturation. Theory into Practice. 32(3): 147-153.

Shulman, L. S. (1987). "Knowledge and Teaching: Foundations of the New Reform," Harvard Educational Review, 57(1), 1-22.

Silvia PJ (2008). Creativity and Intelligence Revisited: A Latent Variable Analysis of Wallach and Kogan (1965). Creativity Res. J. 20(1):34-39

Sukatiman, M., Akhyar, M., Siswandari, & Roemintoyo (2020). "Enhancing Higher-Order Thinking Skills in Vocational Education through Scaffolding-Problem Based Learning." Open Engineering, 15(7), 1-12.

Smith F (1992). To think: In language, learning, and education. London: Routledge.

Suradika, A., Dewi, H. I., & Nasution, M. I. (2023). "Project-Based Learning and Problem-Based Learning Models in Critical and Creative Students." Jurnal Pendidikan IPA Indonesia, 12(1), 1-12.

Stein, N. L., & Lane, S. (2017), "Higher Order Thinking Skills (HOTS) dalam Pembelajaran Berbasis Proses Kognitif," Journal of Educational Psychology,

Tinajero, C., & Mayo, E. (2024), "Classic and Modern Models of Self-regulated Learning: Integrative and Componential Analysis," Frontiers in Psychology.

Ulger, K. (2016). "The Relationship between Creative Thinking and Critical Thinking Skills of Students." Hacettepe University Journal of Education, 32(1), 1-12.

Ulger, K. (2018). "The Effect of Problem-Based Learning on the Creative Thinking and Critical Thinking Disposition of Students in Visual Arts Education." Interdisciplinary Journal of Problem-Based Learning, 12(1), 1-12.

Voon, X. P., Wong, S. L., Wong, L.-H., Khambari, M. N. M., & Syed-Abdullah, S. I. S. (2022). "Developing Computational Thinking Competencies through Constructivist Argumentation Learning: A Problem-Solving Perspective." International Journal of Information and Education Technology (IJIET), 12(6), 1650-1659.

Wang, Y.-P. (2021). "Effects of Online Problem-Solving Instruction and Identification Attitude Toward Instructional Strategies on Students' Creativity." Frontiers in Psychology, 12, 771128.

Wang, M. C., Haertel, G. D., & Walberg, H. J. (2023). "Toward a Knowledge Base for School Learning". Review of Educational Research, 68(3), 249-294.

Wijnen, F., Walma van der Molen, J., & Voogt, J. (2022). "Primary teachers’ attitudes towards using new technology and stimulating higher-order thinking in students: A profile analysis." Education and Information Technologies, 28, 6347-6372.

Winarto, W., Cahyono, E., Sumarni, W., Sulhadi, S., Wahyuni, S., & Sarwi, S. (2022). "Science Teaching Approach Ethno-SETSaR to Improve Pre-Service Teachers’ Creative Thinking and Problem Solving Skills." Journal of Technology and Science Education, 12(2), 327-344.

Yang, Y.-T. C. (2014). "Virtual CEOs: A Blended Approach to Digital Gaming for Enhancing Higher Order Thinking and Academic Achievement among Vocational High School Students." Computers & Education, 81, 281-295.

Yasa, A. D., Rahayu, S., Handayanto, S. K., & Ekawati, R. (2024). "Evaluating the Impact of Smart Learning-Based Inquiry on Enhancing Digital Literacy and Critical Thinking Skills." Smart Learning Environments, 11(2), 219-233.

Youssef, N. H. (2024). "The level of fulfillment of mathematics teaching requirements among teachers in the intermediate stage to develop higher-order thinking skills." Eurasia Journal of Mathematics, Science and Technology Education, 20(9), em2503.

Zaqiah, Q. Y., Heryati, Y., & Narongraksakhet, I. (2021). "Implementation of Thematic-Integrative Learning to Enhance Students’ Skill in the 4.0 Era." Jurnal Pendidikan Islam, 7(2), 243-256.

Zhou, Y., Ning, Y., Chen, J., Zhang, W., & Wijaya, T. T. (2024). "Development and validation of Mathematical Higher-Order Thinking Scale for high school students." Psychology in the Schools, 57(1), 123-135.

Zohar, A., & Dori, Y. J. (2003). Higher-order thinking skills and low-achieving students: Are they mutually exclusive? The Journal of the Learning Sciences, 12(2), 145–181.

Downloads

Published

2025-09-30

How to Cite

Ismeirita, I., Ahman, E., Dahlan, D., & Supendra, D. (2025). Identifying Key Factors Influencing the Development of Higher Order Thinking Skills (HOTS) in Students: A Systematic Literature Review. AL-ISHLAH: Jurnal Pendidikan, 17(3), 5242–5257. https://doi.org/10.35445/alishlah.v17i3.6627

Issue

Vol. 17 No. 3 (2025): SEPTEMBER 2025

Section

Articles

Citation Check

License

Authors who publish with this journal agree to the following terms:

  1. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
  2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
  3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.