Evaluating Elasticity-Science Process Skills (E-SPS) in Construction Instrumen through Rasch Modelling

Diki Chen, Heru Kuswanto, Mundilarto Mundilarto, Ika Pratiwi, Muslimin Boma, Yovita Salsa Brilliant Hanindy

Abstract


The assessment of material elasticity science process skills in high school students requires validated and reliable instruments. This study aims to develop and validate a set of multiple-choice questions using the Rasch model to ensure their suitability for educational assessments. This quantitative research employed a model approach based on the Rasch model. The instrument consisted of multiple-choice questions designed to evaluate material elasticity science process skills. The validation process included two stages: content validation and construct validation. Content validation involved eight practicing teachers as validators, while construct validation was conducted with a sample of 32 high school students. Data analysis was performed using MNSQ infit, MNSQ outfit, delta, discrimination index, item differential power, and item difficulty level, with the assistance of Quest data analysis software. The results of the analysis from Quest revealed that only 10 questions met the Rasch model criteria. Among these, question number six was identified as the most difficult. The validation process demonstrated that the developed questions are appropriate for assessing the targeted skills based on the Rasch model. The findings indicate that the validated instrument is reliable and suitable for evaluating material elasticity science process skills in high school students. This study underscores the importance of rigorous validation processes in developing educational assessments. The developed multiple-choice questions, validated through the Rasch model, are feasible for use in assessing material elasticity science process skills. Future research should explore the application of this instrument in various educational contexts to further confirm its reliability and effectiveness across different student demographics.

Keywords


Elasticity; Science process skills Rasch model; Validation

References


Alavi, K., Isa, K., & Palpanadan, S. T. (2020). Application of Rasch Model on Resilience in Higher Education: An Examination of Validity and Reliability of Malaysian Academician Happiness Index (MAHI). International Journal of Higher Education, 9(4), 261-271. https://doi.org/10.5430/ijhe.v9n4p261

Astalini, A., Darmaji, D., Kurniawan, DA, & Chen, D. (2021). Investigating student perceptions based on gender differences using e-module mathematics physics in multiple integral materials. Journal of Indonesian Science Education , 9 (4), 602-619. https://doi.org/10.24815/jpsi.v9i4.21297

Bakri, F., Marsal, O., & Muliyati, D. (2019). Textbooks equipped with augmented reality technology for physics topics in high school. Journal of Research & Development of Physics Education , 5 (2), 113-122. http://journal.unj.ac.id/unj/index.php/jpppf/article/view/12343

Chan, SW, Looi, CK, & Sumintono, B. (2021). Assessing computational thinking abilities among Singapore secondary students: a Rasch model measurement analysis. Journal of Computers in Education , 8 , 213-236. https://doi.org/10.1007/s40692-020-00177-2

Chang, S. C., Hsu, T. C., & Jong, M. S. Y. (2020). Integration of the peer assessment approach with a virtual reality design system for learning earth science. Computers & Education, 146, 1-15. https://doi.org/10.1016/j.compedu.2019.103758

Darmana, A., Sutiani, A., Nasution, H. A., Ismanisa, I., & Nurhaswinda, N. (2021). Analysis of RASCH model for the validation of chemistry national exam instruments. Jurnal Pendidikan Sains Indonesia (Indonesian Journal of Science Education), 9(3), 329-345. http://doi.org/10.24815/jpsi.v9i3.19618

Gunawan, G., Harjono, A., Hermansyah, H., & Herayanti, L. (2019). Guided Inquiry Model Through Virtual Laboratory To Enhance Students' Science Process Skills On Heat Concept. Journal of Educational Horizons , 38 (2), 259-268. http://dx.doi.org/10.21831/cp.v38i2.23345

Hendriani, W., & Septarini, B. G. (2016). Pengembangan tes berpikir kritis dengan pendekatan item response theory. Jurnal Penelitian dan Evaluasi Pendidikan, 20(1), 45-55. http://repository.unair.ac.id/id/eprint/95550

Hiğde, E., & Aktamış, H. (2022). The effects of STEM activities on students' STEM career interests, motivation, science process skills, science achievements and views. Thinking Skills and Creativity , 43 (1), 1-15. https://doi.org/10.1016/j.tsc.2022.101000

Maison, M., Kurniawan, DA, Wirayuda, RP, & Chen, D. (2022). Process Skills-Based E-Module: Impact On Analytical Thinking Skills. Journal of Physics Education Research & Development , 8 (1), 23-34. http://journal.unj.ac.id/unj/index.php/jpppf/article/view/21664

Mufida, SN, Sigit, DV, & Ristanto, RH (2020). Integrated project-based e-learning with science, technology, engineering, arts, and mathematics (PjBeL-STEAM): its effect on science process skills. Biosphere: Journal of Biology Education , 13 (2), 183-200. http://journal.unj.ac.id/unj/index.php/biosphere/article/view/15688

Ningtyas, L. E., & Asri, M. T. (2021). Profile of 10th grade high school students misconception on virus topic based on three-tier multiple choice diagnostic test. Berkala Ilmiah Pendidikan Biologi (BioEdu), 10(3), 674-682. https://doi.org/10.26740/bioedu.v10n3.p674-682

Nunaki, JH, Siagian, SIR, Nusantari, E., Kandowangko, NY, & Damopolii, I. (2020, March). Fostering students' process skills through inquiry-based science learning implementation. Journal of Physics: Conference Series , 1521 (4), 1-6. https://doi.org/10.1088/1742-6596/1521/4/042030

Nur, L., Nurani, L. A., Suryana, D., & Ahmad, A. (2020). Rasch model application on character development instrument for elementary school students. International Journal of Learning, Teaching and Educational Research, 19(3), 437-459. https://doi.org/10.26803/ijlter.19.3.24

Planinic, M., Boone, WJ, Susac, A., & Ivanjek, L. (2019). Rasch analysis in physics education research: Why measurement matters. Physical Review Physics Education Research , 15 (2), 1-21. https://doi.org/10.1103/PhysRevPhysEducRes.15.020111

Putranta, H., & Supahar, S. (2019). Development of physics-tier tests (PysTT) to measure students' conceptual understanding and creative thinking skills: a qualitative synthesis. Journal for the Education of Gifted Young Scientists , 7 (3), 747-775. https://doi.org/10.17478/jegys.587203

Rahayu, W., Putra, MDK, Rahmawati, Y., Hayat, B., & Koul, RB (2021). Validating an Indonesian Version of the What Is Happening in This Class?(WIHIC) Questionnaire Using a Multidimensional Rasch Model. International Journal of Instruction , 14 (2), 919-934. https://doi.org/10.29333/iji.2021.14252a

Rokhmat, J., & Putrie, SD (2019). A strategy of scaffolding development to increase students' problem-solving abilities: The case of physics learning with a causalitic-thinking approach. Journal of Turkish Science Education , 16 (4), 569-579. https://doi.org/10.36681/tused.2020.8

Siregar, E., Rajagukguk, J., & Sinulingga, K. (2020). Improvement of science process skills using scientific inquiry models with algodoo media and quotient adversity in high school students. Journal of Transformative Education and Educational Leadership , 1 (2), 53-65. https://jteel.unimed.ac.id/index.php?journal=jteel&page=article&op=view&path%5B%5D=23

van de Grift, WJ, Houtveen, TA, van den Hurk, HT, & Terpstra, O. (2019). Measuring teaching skills in elementary education using the Rasch model. School Effectiveness and School Improvement , 30 (4), 455-486. https://doi.org/10.1080/09243453.2019.1577743

Yang, H., Su, J., & Bradley, KD (2020). Applying the Rasch model to evaluate the self-directed online learning scale (SDOLS) for graduate students. International Review of Research in Open and Distributed Learning , 21 (3), 99-120. https://doi.org/10.19173/irrodl.v21i3.4654

Yunzal, AN, & Casinillo, LF (2020). Effect of physics education technology (PhET) simulations: evidence from stem students' performance. Journal of Education Research and Evaluation , 4 (3), 221-226. https://doi.org/10.23887/jere.v4i3.27450




DOI: https://doi.org/10.35445/alishlah.v16i2.4703

Refbacks

  • There are currently no refbacks.


Copyright (c) 2024 Diki Chen, Heru Kuswanto, Mundilarto Mundilarto, Ika Pratiwi, Muslimin Boma

Al-Ishlah Jurnal Pendidikan Abstracted/Indexed by:

    

 


 

Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.