Enhancing Learning Outcomes: A Meta-Analysis of the Effectiveness of STEM Education Approaches

Annisa Tishana; Ganefri Ganefri; Asmar Yulastri; Giatman Giatman; Fuji Astuti; Dedy Irfan; Hansi Effendi

doi:10.35445/alishlah.v17i2.6713

Enhancing Learning Outcomes: A Meta-Analysis of the Effectiveness of STEM Education Approaches

Annisa Tishana, Ganefri Ganefri, Asmar Yulastri, Giatman Giatman, Fuji Astuti, Dedy Irfan, Hansi Effendi

Abstract

This study investigates the effectiveness and variability of STEM education implementation in Indonesian vocational (SMK) and senior secondary (SMA) schools. Given the growing emphasis on STEM to enhance critical 21st-century skills, understanding the consistency and influencing factors of its outcomes is essential. A meta-analysis was conducted, incorporating multiple studies on STEM education implementation. The analysis focused on effect size, heterogeneity, and the factors contributing to outcome variability. Data visualization techniques and statistical models were employed to assess consistency across studies. The analysis revealed a high degree of heterogeneity among the studies (I² = 82.604%), indicating substantial differences in research design, methods, and participant characteristics. Despite this variability, the combined effect size was significant (intercept estimate = 0.307, p < 0.001), with a 95% confidence interval of 0.128–0.485. This confirms that the STEM approach consistently yields positive outcomes, particularly in fostering critical thinking, creativity, and collaboration. The findings suggest that despite contextual differences, STEM education provides meaningful benefits. However, variations in implementation—driven by factors such as teaching quality, resources, and institutional support—impact effectiveness. To reduce this disparity, policy integration is needed to support teacher training, industry collaboration, and resource allocation. A holistic, well-supported, and context-sensitive approach to STEM education is essential. Strengthening teacher competency, ensuring adequate facilities, and aligning with industry needs can enhance the effectiveness and sustainability of STEM initiatives in secondary education.

Keywords

STEM education outcomes; Vocational High Shcool; Meta Analysis

Full Text:

PDF

References

Agussuryani, Q., Sudarmin, S., Sumarni, W., Cahyono, E., & Ellianawati, E. (2022). STEM literacy in growing vocational school student HOTS in science learning: A meta-analysis. International Journal of Evaluation and Research in Education, 11(1), 51–60. https://doi.org/10.11591/ijere.v11i1.21647

Altuntaş, E. Ç., & Barut, N. B. (2023). Forest education experiences of vocational high school students. EJERCongress, 463–475.

Amahoroe, R. (2021). Pengembangan Desain Praktikum Berbasis Stem Pada Pembuatan Tempe Dari Fermentasi Biji Nangka (Artocarpus Heterophyllus) Untuk Meningkatkan Literasi Siswa Smk. Molluca Journal of Chemistry Education (MJoCE), 11(2), 129–140. https://doi.org/10.30598/mjocevol11iss2pp129-140

Ananingtyas, R. S. A., Sakti, R. E., Hakim, M. H., & Putra, F. N. (2022). Pengembangan Media Pembelajaran Berbasis Arduino pada Pembelajaran STEM dalam Meningkatkan Literasi Sains dan Digital. Briliant: Jurnal Riset Dan Konseptual, 7(1), 178. https://doi.org/10.28926/briliant.v7i1.795

Arifin, A. M., Pujiastuti, H., & Sudiana, R. (2020). Pengembangan media pembelajaran STEM dengan augmented reality untuk meningkatkan kemampuan spasial matematis siswa. Jurnal Riset Pendidikan Matematika, 7(1), 59–73. https://doi.org/10.21831/jrpm.v7i1.32135

Artika, T. D., & Widiani, K. A. (2024). Penggunaan STEM Worksheet Sebagai Upaya Melatih kemampuan Berpikir Kritis Siswa SMP dalam Pembelajaran IPA. Seminar Nasional IPA XIV, 601–611.

Asigigan, S. I., & Samur, Y. (2021). The effect of gamified stem practices on students’ intrinsic motivation, critical thinking disposition levels, and perception of problem-solving skills. International Journal of Education in Mathematics, Science and Technology, 9(2), 332–352. https://doi.org/10.46328/IJEMST.1157

ASLI, A., & ZSOLDOS-MARCHIS, I. (2021). Teaching applications of Mathematics in other disciplines: teachers’ opinion and practice. Acta Didactica Napocensia, 14(1), 142–150. https://doi.org/10.24193/adn.14.1.11

Asunda, P., Faezipour, M., Tolemy, J., & Do Engel, M. T. (2023). Embracing Computational Thinking as an Impetus for Artificial Intelligence in Integrated STEM Disciplines through Engineering and Technology Education. Journal of Technology Education, 34(2), 43–63. https://doi.org/10.21061/jte.v34i2.a.3

Briyanda, D., Nurjanah, N., & Setiawati, T. (2023). E-Modul Berbasis STEM Mata Pelajaran Boga Dasar Untuk Siswa SMK Jasa Boga Kelas X. Pedagogik: Jurnal Pendidikan, 18(1), 19–27. https://doi.org/10.33084/pedagogik.v18i1.4724

Cain, E. J., Valauri, A., Perry, J. R., & Deloach, A. (2024). Exploring How Rural Schools and Communities Influence the Academic Journeys of College Students in STEM Majors. Rural Educator, 45(3), 15–33. https://doi.org/10.55533/2643-9662.1417

Çengel, M., Alkan, A., & Yıldız, E. P. (2019). Evaluate the attıtudes of the pre-servıce teachers towards STEM and STEM’s sub dımensıons. International Journal of Higher Education, 8(3), 257–267. https://doi.org/10.5430/ijhe.v8n3p257

ÇEVİK, M., BAKİOĞLU, B., & TEMİZ, Z. (2024). The Effects of Out-of-School Learning Environments on STEM Education: Teachers’ STEM Awareness and 21st-Century Skills. Kuramsal Eğitimbilim, 17(1), 57–79. https://doi.org/10.30831/akukeg.1309078

Chalim, M. N., Mariani, S., & Wijayanti, K. (2019). Kemampuan Komunikasi Matematis Siswa SMK Ditinjau dari Self Efficacy pada Setting Pembelajaran Project Based Learning Terintegrasi STEM. PRISMA, Prosiding Seminar Nasional Matematika, 2, 540–550. https://journal.unnes.ac.id/sju/index.php/prisma/article/view/29049/12789

Dona, M., Usboko, R., Made Parsa, I., Zet, D., Baitanu, Y., Pendidikan, P., Elektro, T., Nusa, U., & Adisucipto, C. J. (2021). Penerapan Pembelajaran Stem Dengan Model Pjbl Di Kelas Xi Titl Smk N 2 Kupang Untuk Meningkatkan Kemampuan Berpikir Kreatif Siswa. Jurnal SPEKTRO , 4(1), 9–11. https://ejurnal.undana.ac.id/index.php/spektro/article/view/5006

Doolittle, P., Wojdak, K., & Walters, A. (2023). Defining Active Learning: A Restricted Systematic Review. Teaching and Learning Inquiry, 11. https://doi.org/10.20343/teachlearninqu.11.25

Fitriyana, N., Wiyarsi, A., Pratomo, H., & Marfuatun, M. (2024). the Importance of Integrated Stem Learning in Chemistry Lesson: Perspectives From High School and Vocational School Chemistry Teachers. Journal of Technology and Science Education, 14(2), 418–437. https://doi.org/10.3926/jotse.2356

Hansen, M. (n.d.). EdWorkingPaper No . 24-1024 STEM teacher workforce in high-need schools resilient despite shrinking supply and increasing demand. 24, 0–43.

Hidayah, R. N., Wiyono, K., & Ismet. (2021). Analisis Kebutuhan Elearning Berbasis Stem Mata Pelajaran Fisika Di Smkn Sumetera Selatan. Redesain Pembelajaran IPA Yang Adaptif Di Masa Pandemi Covid-19, 1–8.

Hussim, H., Rosli, R., Mohd Nor, N. A. Z., Maat, S. M., Mahmud, M. S., Iksan, Z., Rambely, A. S., Mahmud, S. N., Halim, L., Osman, K., & Lay, A. N. (2024). A Systematic Literature Review of Informal STEM Learning. European Journal of STEM Education, 9(1), 1–10. https://doi.org/10.20897/ejsteme/14609

Jones, M. G., Childers, G., & Stanley, R. (2020). Science Instruction in STEM and Non-STEM High Schools. Electronic Journal for Research in Science & Mathematics Education, 24(4), 69–90.

Kiromah, A., Sudarti, S., & Rohatin, R. (2020). ANALISIS AKTIVITAS BELAJAR SISWA PADA PEMBELAJARAN FISIKA MENGGUNAKAN MODEL PROBLEM BASED LEARNING DENGAN PENDEKATAN STEM (Pokok Bahasan Gaya dan Hukum Newton). Jurnal Pembelajaran Fisika, 9(4), 165. https://doi.org/10.19184/jpf.v9i4.17983

Kristensen, M. A., Larsen, D. M., Seidelin, L., & Svabo, C. (2023). The Role of Mathematics in STEM Activities: Syntheses and a Framework from a Literature Review. International Journal of Education in Mathematics, Science and Technology, 12(2), 418–431. https://doi.org/10.46328/ijemst.3357

Kulakoglu, B., & Kondakci, Y. (2023). STEM Education as a Concept Borrowing Issue: Perspectives of School Administrators in Turkey. ECNU Review of Education, 6(1), 84–104. https://doi.org/10.1177/20965311221107390

Mahendra, C., Prabowo, R. E., Paath, D. K., Mili, W. N., & Annawati, B. D. (2023). Gamifikasi dalam Pendidikan STEM : Transformasi Pembelajaran dan Pemberdayaan Siswa menuju Industri 5 . 0. Inovasi Pendidikan Fisika, 12(3), 92–100.

Mansour, N., Çevik, M., Yağci, A., Alotaibi, S. B. M., & El-Deghaidy, H. (2024). Modeling the Factors Influencing Secondary Students’ Performance in Stem Subjects. Journal of Baltic Science Education, 23(3), 518–535. https://doi.org/10.33225/JBSE/24.23.518

Marsiti, C. I. R., Santyasa, I. W., Sudatha, I. G. W., & Sudarma, I. K. (2023). Pengembangan Multimedia Pembelajaran Pada Elemen Pengolahan Makanan Dan Minuman Sub Elemen Hidangan Soup. Jurnal Pendidikan Teknologi Dan Kejuruan, 20(1), 35–45.

McSween, V. K. (2024). An Integrative Approach to STEM Workforce Preparation in a Biomedical Science Course [Quality Improvement]. International Journal on Social and Education Sciences, 6(2), 174–187. https://doi.org/10.46328/ijonses.653

Meirani, R. K., & Intania, N. (2023). Key Elements of Total Quality Management Implementation in Vocational High School. Proceedings of International Conference on Research in Education and Science, 9(1), 424–439.

Mirawati, N. (2019). Penerapan model pembelajaran berbasis STEM pada siswa SMK dengan Program Kejuruan ATPH. Prosiding Diskusi Panel Nasional Pendidikan Matematika, 0812(50), 45–50. https://proceeding.unindra.ac.id/index.php/DPNPMunindra/article/view/231

Mukhlis, M., Suwandi, S., Rohmadi, M., & Setiawan, B. (2023). Higher Order Thinking Skills in Reading Literacy Questions at Vocational High Schools in Indonesia. International Journal of Language Education, 7(4), 615–632. https://doi.org/10.26858/ijole.v7i4.37603

Ni’mah, A., Mariani, S., & Prabowo, A. (2019). Kemampuan koneksi matematis dan entrepreneurship siswa SMK dalam model pembelajaran Project Based Learning dengan pendekatan terintegrasi STEM. Prosiding Seminar Nasional MIPA Kolaborasi 2018, November, 100–113.

Nurtanto, M., Pardjono, P., Widarto, W., & Ramdani, S. D. (2020). The effect of STEM-EDP in professional learning on automotive engineering competence in vocational high school. Journal for the Education of Gifted Young Scientists, 8(2), 633–649. https://doi.org/10.17478/JEGYS.645047

Periatna, D., Putri Mubarika, M., & Yaniawati, P. (2019). Implementasi pendekatan Science Technology Engineering and Mathematics (STEM) untuk meningkatkan kemampuan pemecahan masalah siswa SMK. Pasundan Journal of Mathematics Education : Jurnal Pendidikan Matematika, 9(Vol 9 No.2), 56–68. https://doi.org/10.23969/v9i2.2713

Rahayu, P., & Suhartini, R. (2020). Peran Pembelajaran Stem Dalam Penerapan Adobe Animate Terhadap Hasil Belajar Siswa Smk Tata Busana. Universitas Negeri Surabaya, 11.

Rivera, S., Kiiza, I., Kavanagh, K., Dewaters, J., Galluzzo, B., & Ramsdell, M. (2016). Challenges & Opportunities for STEM Teachers in Rural Schools : A Case Study. 420–432.

Ruijuan, L., Srikhoa, S., & Jantharajit, N. (2023). Blending of collaborative and active learning instructional methods to improve academic performance and self-motivation of vocational students. Asian Journal of Education and Training, 9(4), 130–135. https://doi.org/10.20448/edu.v9i4.5211

Sa’adhah, E., Yuniarti, N., Pendidikan, S., & Mekatronika, T. (2019). the Implementation of Science, Technology, Engineering and Matemathics Learning Model As an Basic in Improving Activity and Results of Student Learning in Electrical and Electronic Study Subject Matter in Vocational Secondary School 1 Nanggulan. Jurnal Pendidikan Teknik Mekatronika, 9(1), 40–46. http://journal.student.uny.ac.id/ojs

Salcedo, O. H., Carrejo, D. J., & Luna, S. (2023). Engineering Praxis Ethos: Designing Experiences to Support Curricular and Instructional Improvement in STEM Education. International Journal of Education in Mathematics, Science and Technology, 12(1), 20–39. https://doi.org/10.46328/ijemst.3218

Seskir, Z. C., Goorney, S. R., & Chiofalo, M. L. (2024). Educating to the “Culture” of Quantum Technologies: A Survey Study on Concepts for Public Awareness. European Journal of STEM Education, 9(1), 1–9. https://doi.org/10.20897/ejsteme/14193

Setyabudi, D., & Sari, L. N. (2020). Pengembangan Modul IPA berbasis Science Technology Engineering and Mathematics (STEM) untuk SMK Kelas X. Prosiding Seminar Nasional Pendidikan Biologi 2020, 11–22.

Sintia Devi, B., Subali, B., & Artikel, S. (2021). 2021) Unnes Physics Education Journal Terakreditasi SINTA 3 Jurusan Fisika, Fakultas Matematika dan Ilmu Pengetahuan Alam. Upej, 10(2), 50229. http://journal.unnes.ac.id/sju/index.php/upej

Suglo, E. K. (2024). Exploring the Impact of Deep Learning Activities in the Mathematics Classroom on Students’ Academic Performance: A Comprehensive Study. Online Submission. https://doi.org/10.20944/preprints202403.1551.v1

Suh, E. K., Zollman, A., & Hoffman, L. (n.d.). STEM SMART : Unpacking the Research on Teachers ’ Beliefs about Essential Life Skills and Dispositions. 28(2), 1–16.

Suryaman, Zaki, A., Suharyanto, & Winoto, S. (2023). Tripartite Interconnection to Serve High Quality and Competitiveness of Vocational School Students in Industry. Journal of Social Studies Education Research, 14(2), 75–96.

Thies, S. L. J., Knobloch, N. A., Wang, H., & Nelson, B. J. (2024). High School Students ’ Motivation Regarding an Integrated STEM Food System Project. 68(2020), 107–118.

Tishana, A., Ahyanuardi, A., Irfan, D., & Effendi, H. (2024). Developing Android-Based E-Modules for Project-Based Learning in Basic Electrical. AL-ISHLAH: Jurnal Pendidikan, 16(2), 1757–1770. https://doi.org/10.35445/alishlah.v16i2.5267

Tuong, H. A. (2023). Teaching In Vietnam : Developing Students ’ Real-World. Journal of Technology and Science Education, 13(1), 73–91.

Twaddle, J., & Smith, T. (2023). STEM Pedagogical Content Knowledge of Preservice Teachers. International Journal of Multidisciplinary Perspectives in Higher Education, 8(1), 168–182.

Wahono, B., Sholihah, I. M., & Narulita, E. (2023). Visual Content Analysis of STEM-Related Content in Indonesian Vocational High Schools Biology Textbooks. Journal of Science Learning, 6(3), 281–293. https://doi.org/10.17509/jsl.v6i3.53772

Wannapiroon, P., Nilsook, P., Techakosit, S., & Kamkhuntod, S. (2021). STEM Literacy of Students in Vocational Education. International Journal of Technology in Education and Science, 5(4), 527–549. https://doi.org/10.46328/ijtes.253

Yamamoto, S., Alverson, C., McCoid-Goudy, L., Castle, H., & Burr, J. (2022). STEM and High School Students with Disabilities: A Qualitative Review of the Research Literature. Journal of Science Education for Students with Disabilities, 25(1), 1–24. https://doi.org/10.14448/jsesd.14.0006

Yekti, S. M. P., & Perdana, R. D. P. (2019). Analisis Kebutuhan Pengembangan Modul Matematika Berbasis STEM (Science, Technology, Engineering, And Mathematics) sebagai Upaya Penguatan Karakter Dan Peningkatan Daya Saing Lulusan SMK. Dharma Pendidikan, 14(April 2019), 56–67. http://journal.stkipnganjuk.ac.id/index.php/jdp/article/view/105%0Ahttp://journal.stkipnganjuk.ac.id/index.php/jdp/article/download/105/138

Yilmaz, H. S. (2022). A Study of Determination of Benchmarks during the New Formation of Integrated STEM Leader Preparation Program. European Journal of STEM Education, 7(1), 1–13. https://doi.org/10.20897/ejsteme/12634

DOI: https://doi.org/10.35445/alishlah.v17i2.6713