Evaluating Project-Based Learning Success: Unveiling Insights through Supervised Machine Learning Assessment

Wawan Kurniawan; Cicyn Riantoni; Neneng Lestari

doi:10.35445/alishlah.v16i1.4365

Evaluating Project-Based Learning Success: Unveiling Insights through Supervised Machine Learning Assessment

Wawan Kurniawan, Cicyn Riantoni, Neneng Lestari

Abstract

In physics education research, the success of implementing the project-based learning model is typically assessed based on students' learning outcomes. There are very few studies that specifically evaluate the success of implementing the project-based learning model in terms of the process. This is due to the difficulty of assessing the process itself. The aim of this research was to obtain information on the success profile of implementing the Project Based Learning (PBL) model assessed using Supervised Machine Learning. This research used a qualitative descriptive method. The subjects of the research were 60 undergraduate students Jambi University. Data was collected based on the students' success in each stage of PBL. The stages of PBL include 1) project team introduction and planning; 2) initial research phase for information gathering; 3) creation, development, initial evaluation, and prototyping; 4) second research phase; 5) final development stage; and 6) publication of the product or artefact. Every stage of project-based learning is structured using supervised machine learning. This aims to facilitate students' direct involvement in project-based learning in supervised machine learning, enabling teachers to rapidly evaluate and give feedback. The success of project-based learning depends mostly on the precision of the students' group in project design, as indicated by studies. If the planning process is executed well, including tool and material selection, project execution procedures, and good design, students will have no challenges during the product creation stage.

Keywords

Assessment; Machine learning; Project based learning

Full Text:

PDF

References

Afriana, J., Permanasari, A., & Fitriani, A. (2016). Project based learning integrated to stem to enhance elementary school’s students scientific literacy. Jurnal Pendidikan IPA Indonesia, 5(2), 261–267. https://doi.org/10.15294/jpii.v5i2.5493

Anazifa, R. D., & Djukri. (2017). Project- based learning and problem- based learning: Are they effective to improve student’s thinking skills? Jurnal Pendidikan IPA Indonesia, 6(2), 346–355. https://doi.org/10.15294/jpii.v6i2.11100

Chassignol, M., Khoroshavin, A., Klimova, A., & Bilyatdinova, A. (2018). Artificial Intelligence trends in education: A narrative overview. Procedia Computer Science, 136, 16–24. https://doi.org/10.1016/j.procs.2018.08.233

Chen, H., & Yang, J. (2021). Application of IT-Integrated Project-Based Learning in the Teaching Reform of Undergraduate Education. International Journal of Emerging Technologies in Learning, 16(5), 248–260. https://doi.org/10.3991/ijet.v16i05.21085

Engelhardt, P. V., & Beichner, R. J. (2004). Students’ understanding of direct current resistive electrical circuits. American Journal of Physics, 72(1), 98–115. https://doi.org/10.1119/1.1614813

Erdoğan, Y., & Dede, D. (2015). Computer assisted project-based instruction: The effects on science achievement, computer achievement and portfolio assessment. International Journal of Instruction, 8(2), 177–188. https://doi.org/10.12973/iji.2015.8214a

Helle, L., Tynjälä, P., & Olkinuora, E. (2006). Project-based learning in post-secondary education - Theory, practice and rubber sling shots. Higher Education, 51(2), 287–314. https://doi.org/10.1007/s10734-004-6386-5

Horanai, H., Maejima, Y., & Ding, L. (2022). An Education Tool at Supports Junior Learners in Studying Machine Learning. Frontiers in Artificial Intelligence and Applications, 360, 111–116. https://doi.org/10.3233/FAIA220432

Jaime, A., Blanco, J. M., Domínguez, C., Sánchez, A., Heras, J., & Usandizaga, I. (2016). Spiral and Project-Based Learning with Peer Assessment in a Computer Science Project Management Course. Journal of Science Education and Technology, 25(3), 439–449. https://doi.org/10.1007/s10956-016-9604-x

Johnson, M., & Smith, M. (2008). Designing Appropriate Scaffolding for Student Science Projects. Journal of College Science Teaching, 38, 24–29. Retrieved from http://search.ebscohost.com/login.aspx?direct=true&db=eric&AN=EJ824987&site=ehost-live%5Cnhttp://www.nsta.org/publications/browse_journals.aspx?action=issue&id=10.2505/3/jcst08_038_02

Kanetaki, Z., Stergiou, C., Bekas, G., Troussas, C., & Sgouropoulou, C. (2022). A Hybrid Machine Learning Model for Grade Prediction in Online Engineering Education. International Journal of Engineering Pedagogy, 12(3), 4–23. https://doi.org/10.3991/IJEP.V12I3.23873

Kapusuz, K. Y., & Can, S. (2014). A Survey on Lifelong Learning and Project-based Learning among Engineering Students. Procedia - Social and Behavioral Sciences, 116, 4187–4192. https://doi.org/10.1016/j.sbspro.2014.01.914

Kock, Z. J., Taconis, R., Bolhuis, S., & Gravemeijer, K. (2014). Creating a Culture of Inquiry in the Classroom While Fostering an Understanding of Theoretical Concepts in Direct Current Electric Circuits: a Balanced Approach. International Journal of Science and Mathematics Education, 13(1), 45–69. https://doi.org/10.1007/s10763-014-9535-z

Kokotsaki, D., Menzies, V., & Wiggins, A. (2016). Project-based learning: A review of the literature. Improving Schools, 19(3), 267–277. https://doi.org/10.1177/1365480216659733

Korur, F., Efe, G., Erdogan, F., & Tunç, B. (2017). Effects of Toy Crane Design-Based Learning on Simple Machines. International Journal of Science and Mathematics Education, 15(2), 251–271. https://doi.org/10.1007/s10763-015-9688-4

Lampos, V., Mintz, J., & Qu, X. (2021). An artificial intelligence approach for selecting effective teacher communication strategies in autism education. Npj Science of Learning, 6(1). https://doi.org/10.1038/s41539-021-00102-x

Lokare, V. T., Kiwelekar, A. W., & Netak, L. D. (2022). Analysis of the Influence of Physiologial and Cognition Measures in Higher Education using Machine Learning. International Journal of Performability Engineering, 18(2), 117–127. https://doi.org/10.23940/ijpe.22.02.p6.117127

Mustapha, R., Sadrina, Nashir, I. M., Azman, M. N. A., & Hasnan, K. A. (2020). Assessing the implementation of the project-based learning (PJBL) in the department of mechanical engineering at a Malaysian polytechnic. Journal of Technical Education and Training, 12(1 Special Issue), 100–118. https://doi.org/10.30880/jtet.2020.12.01.011

Mutakinati, L., Anwari, I., & Yoshisuke, K. (2018). Analysis of students’ critical thinking skill of middle school through stem education project-based learning. Jurnal Pendidikan IPA Indonesia, 7(1), 54–65. https://doi.org/10.15294/jpii.v7i1.10495

Nani, K. La, & Kusumah, Y. S. (2015). The Effectiveness Ofict-Assisted Project- Based Learning In Enhancing Students’ Statistical Communication Ability. International Journal of Education and Research, 3(8), 187–196. Retrieved from http://www.ijern.com/

Nugroho, O. F., Permanasari, A., & Firman, H. (2019). The movement of stem education in Indonesia: Science teachers’ perspectives. Jurnal Pendidikan IPA Indonesia, 8(3), 417–425. https://doi.org/10.15294/jpii.v8i3.19252

Pfister, H. (2004). Illustrating Electric Circuit Concepts with the Glitter Circuit. The Physics Teacher, 42(6), 359–363. https://doi.org/10.1119/1.1790344

Sangam, D., & Jesiek, B. K. (2012). Conceptual understanding of Resistive Electric Circuits among first-year engineering students. ASEE Annual Conference and Exposition, Conference Proceedings. https://doi.org/10.18260/1-2--21097

Sanusi, I. T., Oyelere, S. S., Vartiainen, H., Suhonen, J., & Tukiainen, M. (2022). A systematic review of teaching and learning machine learning in K-12 education. In Education and Information Technologies. Springer US. https://doi.org/10.1007/s10639-022-11416-7

Siemens, G. (2013). Learning Analytics. American Behavioral Scientist, 57(10), 1380–1400. https://doi.org/10.1177/0002764213498851

Siew, N. M., & Ambo, N. (2018). Development and evaluation of an integrated project-based and stem teaching and learning module on enhancing scientific creativity among fifth graders. Journal of Baltic Science Education, 17(6), 1017–1033. https://doi.org/10.33225/jbse/18.17.1017

Smith, D. P., & van Kampen, P. (2011). Teaching electric circuits with multiple batteries: A qualitative approach. Physical Review Special Topics - Physics Education Research, 7(2), 020115. https://doi.org/10.1103/PhysRevSTPER.7.020115

Sormunen, K., Juuti, K., & Lavonen, J. (2020). Maker-Centered Project-Based Learning in Inclusive Classes: Supporting Students’ Active Participation with Teacher-Directed Reflective Discussions. International Journal of Science and Mathematics Education, 18(4), 691–712. https://doi.org/10.1007/s10763-019-09998-9

Stetzer, M. R., van Kampen, P., Shaffer, P. S., & McDermott, L. C. (2013). New insights into student understanding of complete circuits and the conservation of current. American Journal of Physics, 81(2), 134–143. https://doi.org/10.1119/1.4773293

Surjanti, J., Prakoso, A. F., Kurniawan, R. Y., Sakti, N. C., & Nurlaili, E. I. (2022). Development of High Order Thinking Skills in Indonesian Teachers. Obrazovanie i Nauka, 24(3), 104–125. https://doi.org/10.17853/1994-5639-2022-3-104-125

Tekbıyık, A., Baran Bulut, D., & Sandalcı, Y. (2022). Effects of a summer robotics camp on students STEM career interest and knowledge structure. Journal of Pedagogical Research, 6(2), 91–109. https://doi.org/10.33902/jpr.202212606

Wang, H., Zhang, W., Sun, F., & Zhang, W. (2017). A comparison study of machine learning based algorithms for fatigue crack growth calculation. Materials, 10(5). https://doi.org/10.3390/ma10050543

Wu, B., & Zheng, C. (2021). An Analysis of the Effectiveness of Machine Learning Theory in the Evaluation of Education and Teaching. Wireless Communications and Mobile Computing, 2021. https://doi.org/10.1155/2021/4456222

Wurdinger, S., Haar, J., Hugg, R., & Bezon, J. (2007). A qualitative study using project-based learning in a mainstream middle school. Improving Schools, 10(2), 150–161. https://doi.org/10.1177/1365480207078048

DOI: https://doi.org/10.35445/alishlah.v16i1.4365