Development of Data-Driven Educational Decision Implementation Guidelines Assisted by Formative Tests in Science Learning

Suwito Singgih; Agista Sintia Dewi Adila; Ismun Nisa Nadhifah; Syakira Alfi Kurnia; Aza Mazita

doi:10.35445/alishlah.v16i3.5311

Development of Data-Driven Educational Decision Implementation Guidelines Assisted by Formative Tests in Science Learning

Suwito Singgih, Agista Sintia Dewi Adila, Ismun Nisa Nadhifah, Syakira Alfi Kurnia, Aza Mazita

Abstract

Data-Based Educational Decisions (DDED) is an important part of the learning process where DDED is used to improve the quality of learning. This research purpose to develop Data Driven Educational Decision Implementation Guidelines (DDED) supporting formative tests in IPA learning. DDED is an adaptation of Data Drive Decision Making (DDDM) in learning. DDED is based on Data Drive Decision Making (DDDM), which is a decision-making process that has been widely applied in the world of management. The DDED directs teachers to be adaptive and flexible in implementing various methods, models, teaching materials and learning media based on student access. The development design used is 4D which consists of defining, designing, developing and deploying. The content of the guidelines has been agreed through expert consensus through the fuzzy delphi technique. Fuzzy Delphi Method to create a broad and detailed understanding, especially in education. The consensus indicated that formative tests should include relevant questions and quizzes, comprising both multiple-choice and essay formats, aligning with the principles of DDED. The resulting guideline tests the level of validity and user response. Users respond well to the guidelines developed.

Keywords

DDED; Formative Tests; Guides; Science Learning

Full Text:

PDF

References

Achen J, Harrison C, Cohen-Vogel L. Data Use as Instructional Reform: Exploring Educators’ Reports of Classroom Practice. Leadersh Policy Sch [Internet]. 2018 Apr 3;17(2):296–325. Available from: https://www.tandfonline.com/doi/full/10.1080/15700763.2016.1278244

Aiken, L. R. (1996). Rating scales and checklists: Evaluating behavior, personality, and attitudes. John Wiley & Sons.

Arikunto, S. (2009). Dasar-Dasar Evaluasi Pendidikan Edisi (Revisi). Jakarta: Bumi Aksara.

Black P, Wiliam D. Developing the theory of formative assessment. Educ Assessment, Eval Account [Internet]. 2009 Feb 23;21(1):5–31. Available from: http://link.springer.com/10.1007/s11092-008-9068-5

Cheng, C. H., & Lin, Y. (2002). Evaluating the best main battle tank using fuzzy decision theory with linguistic criteria evaluation. European journal of operational research, 142(1), 174-186. https://doi.org/10.1016/S0377-2217(01)00280-6

Chu, H. C., & Hwang, G. J. (2008). A Delphi-based approach to developing expert systems with the cooperation of multiple experts. Expert systems with applications, 34(4), 2826-2840. https://doi.org/10.1016/j.eswa.2007.05.034

Cisterna D, Gotwals AW. Enactment of Ongoing Formative Assessment: Challenges and Opportunities for Professional Development and Practice. J Sci Teacher Educ. 2018 Apr 3;29(3):200–22.

Cosner S. Leading the Ongoing Development of Collaborative Data Practices: Advancing a Schema for Diagnosis and Intervention. Leadersh Policy Sch [Internet]. 2012 Jan;11(1):26– 65. Available from: http://www.tandfonline.com/doi/abs/10.1080/15700763.2011.577926

Datnow A, Park V, Kennedy‐Lewis B. Affordances and constraints in the context of teacher collaboration for the purpose of data use. J Educ Adm [Internet]. 2013 May 3;51(3):341–62. Available from: https://www.emerald.com/insight/content/doi/10.1108/09578231311311500/full/html

Downey, Christopher.; Kelly A. Professional attitudes to the use of data in England. In: Data-based Decision Making in Education: Challenges and Opportunities. 2013. p. 69–89.

Du, Y. (2022). Application of the Data-Driven Educational Decision-Making System to Curriculum Optimization of Higher Education. Wireless Communications and Mobile Computing, 2022, 1-8.

Gita, S. D., Annisa, M., & Nanna, W. I. (2018). Pengembangan modul IPA materi hubungan makhluk hidup dan lingkungannya berbasis pendekatan kontekstual. LENSA (Lentera Sains): Jurnal Pendidikan IPA, 8(1). https://doi.org/10.24929/lensa.v8i1.28

Gronlund, Norman E. dan Robert L. Linn. 1985. Measurement and Evaluation in Teaching. New York: Macmillan Publising Company.

Gulo, A. (2022). Penerapan Model Discovery Learning Terhadap Hasil Belajar Peserta Didik Pada Materi Ekosistem. Educativo: Jurnal Pendidikan, 1(1), 307-313. https://doi.org/10.56248/educativo.v1i1.54

Hermawati, H., Nurcahyono, N. A., & Setiani, A. (2018). Proses Pelaksanaan Remedial Teaching Terhadap Ketuntasan Belajar Matematika Peserta Didik. SOSIOHUMANIORA: Jurnal Ilmiah Ilmu Sosial Dan Humaniora, 4(2). https://doi.org/10.30738/sosio.v4i2.2823

Hondrich AL, Hertel S, Adl-Amini K, Klieme E. Implementing curriculum-embedded formative assessment in primary school science classrooms. Assess Educ Princ Policy Pract. 2016 Jul 2;23(3):353–76.

Hoogland I, Schildkamp K, van der Kleij F, Heitink M, Kippers W, Veldkamp B, et al. Prerequisites for data-based decision making in the classroom: Research evidence and practical illustrations. Teach Teach Educ [Internet]. 2016 Nov;60:377–86. Available from: https://linkinghub.elsevier.com/retrieve/pii/S0742051X16301408

Kayan-Fadlelmula F, Sellami A, Abdelkader N, Umer S. A systematic review of STEM education research in the GCC countries: trends, gaps and barriers. Int J STEM Educ [Internet]. 2022 Jan 3;9(1):2. Available from: https://stemeducationjournal.springeropen.com/articles/10.1186/s40594-021-00319-7

Lai, Mei Kuin; Schildkamp K. In-Service Teacher Professional Learning: Use of Assessment in Data-based Decision-making. In: Handbook of Human and Social Conditions in Assessment. 2016. p. 18.

Lai MK, McNaughton S. Analysis and Discussion of Classroom and Achievement Data to Raise Student Achievement. In: Data-based Decision Making in Education [Internet]. Dordrecht: Springer Netherlands; 2013. p. 23–47. Available from: http://link.springer.com/10.1007/978-94-007-4816-3_3

Lai MK, Schildkamp K. Data-based Decision Making: An Overview. In: Data-based Decision Making in Education [Internet]. Dordrecht: Springer Netherlands; 2013. p. 9–21. Available from: http://link.springer.com/10.1007/978-94-007-4816-3_2

Marsh, Julie A.; Pane, John F.; Hamilton LS. Making Sense of Data-Driven Decision Making in Education: Evidence from Recent RAND Research [Internet]. RAND Corporation; 2006. Available from: https://www.rand.org/pubs/occasional_papers/OP170.html

McCallum S, Milner MM. The effectiveness of formative assessment: student views and staff reflections. Assess Eval High Educ [Internet]. 2021 Jan 2;46(1):1–16. Available from: https://www.tandfonline.com/doi/full/10.1080/02602938.2020.1754761

Monteiro V, Mata L, Santos NN. Assessment Conceptions and Practices: Perspectives of Primary School Teachers and Students. Front Educ [Internet]. 2021 Apr 7;6. Available from: https://www.frontiersin.org/articles/10.3389/feduc.2021.631185/full

Murry Jr, J. W., & Hammons, J. O. (1995). Delphi: A versatile methodology for conducting qualitative research. The review of higher education, 18(4), 423-436. https://doi.org/10.1353/rhe.1995.0008

Nadhifah IN. Identifying Indonesian Students Qualitative Conceptions of Force and Motion. University College London; 2016.

Nadhifah IN. Pengembangan Perangkat Penilaian Afektif dan Karakter pada Pembelajaran Fisika Untuk Sekolah Menengah Atas [Internet]. UIN SUNAN KALIJAGA.; 2012. Available from: https://digilib.uin-suka.ac.id/id/eprint/7249/

Nadhifah, Ismun Nisa; Adila, Agista Sintia Dewi ; Lestari A. Deskripsi Pemahaman, Persepsi dan Kendala Terhadap Penerapan Asesmen Formatif pada Guru IPA di Wonosobo. PENDIPA J Sci Educ [Internet]. 2023;7(1):14–23. Available from: https://ejournal.unib.ac.id/pendipa/article/view/26148

Pham T, Pham LH. Implementing Formative Assessment in Vietnamese Classrooms: Strategies to Navigate Cultural and Structural Obstacles. In 2021. p. 137–50. Available from: https://link.springer.com/10.1007/978-981-16-0057-9_9

Prenger R, Schildkamp K. Data-based decision making for teacher and student learning: a psychological perspective on the role of the teacher. Educ Psychol [Internet]. 2018 Jul 3;38(6):734–52. Available from: https://www.tandfonline.com/doi/full/10.1080/01443410.2018.1426834

Reeves TD, Summers KH, Grove E. Examining the landscape of teacher learning for data use: The case of Illinois. Boylan M, editor. Cogent Educ [Internet]. 2016 Dec 31;3(1):1211476. Available from: https://www.tandfonline.com/doi/full/10.1080/2331186X.2016.1211476

Saido, G. A. M., Siraj, S., DeWitt, D., & Al-Amedy, O. S. (2018). Development of an instructional model for higher order thinking in science among secondary school students: a fuzzy Delphi approach. International Journal of Science Education, 40(8), 847-866. https://doi.org/10.1080/09500693.2018.1452307

Song Y, Sparks JR. Building a game-enhanced formative assessment to gather evidence about middle school students’ argumentation skills. Educ Technol Res Dev [Internet]. 2019 Oct 28;67(5):1175–96. Available from: http://link.springer.com/10.1007/s11423-018-9637-3

Rosyida, N. I., Nugraha, S. W., Agustin, U., Rochman, C., & Nuryantini, A. Y. (2023). Optimalisasi Program Remedial Berdasarkan Instrumen Akreditasi Satuan Pendidikan Dalam Pembelajaran Diferensiasi Kurikulum Merdeka. Jurnal Evaluasi Pendidikan, 14(1), 12-16. https://doi.org/10.21009/jep.v14i1.36763

Thiagarajan, S. (1974). Instructional development for training teachers of exceptional children: A sourcebook.

VanTassel-Baska, J. (2012). Analyzing Differentiation in the Classroom. Gifted Child Today, 35(1), 42–48. https://doi.org/10.1177/1076217511427431

von der Embse NP, Schoemann AM, Kilgus SP, Wicoff M, Bowler M. The influence of test-based accountability policies on teacher stress and instructional practices: a moderated mediation model. Educ Psychol [Internet]. 2017 Mar 16;37(3):312–31. Available from: https://www.tandfonline.com/doi/full/10.1080/01443410.2016.1183766

Zainuddin Z, Shujahat M, Haruna H, Chu SKW. The role of gamified e-quizzes on student learning and engagement: An interactive gamification solution for a formative assessment system. Comput Educ [Internet]. 2020 Feb;145:103729. Available from: https://linkinghub.elsevier.com/retrieve/pii/S0360131519302829

DOI: https://doi.org/10.35445/alishlah.v16i3.5311