Development of Numerical Literacy Question Instrument based on Computational Thinking for Mathematics Learning

Zafrullah Zafrullah; Syukrul Hamdi; Astri Wahyuni; Rina Safitri; Resky Nuralisa Gunawan; Yoel Istiawanto

doi:10.35445/alishlah.v%vi%i.5985

Development of Numerical Literacy Question Instrument based on Computational Thinking for Mathematics Learning

Zafrullah Zafrullah, Syukrul Hamdi, Astri Wahyuni, Rina Safitri, Resky Nuralisa Gunawan, Yoel Istiawanto

Abstract

This study is developmental research that aims to develop a numeracy literacy instrument based on computational thinking in mathematics learning, using the Plomp model to ensure the quality and relevance of the instrument. Selection of respondents using Cluster Random Sampling involving 220 grade 8 students at 5 State Junior High Schools in Bantul Yogyakarta, the instrument was tested for content validity using the Aiken method, resulting in an average validity score of 0.81, indicating that the instrument is valid. Confirmatory Factor Analysis (CFA) results showed that all latent variables had loading factor values above 0.5, these items more accurately represent numerical literacy abilities based on the computational thinking being measured.. Construct Reliability (CR) and Average Variance Extracted (AVE) analysis show that all dimensions meet the criteria, although the Problem Decomposition dimension requires more attention to its indicators because its AVE value is only slightly above the minimum limit. This study is limited to a relatively small number of respondents, so it is necessary to expand the sample coverage to increase the generalizability of the results. This research develops an effective instrument to improve mathematics learning and prepare students for final exams such as the Asesmen Standardisasi Pendidikan Daerah (ASPD) with better numeracy literacy skills.

Keywords

Numeracy Literacy; Computational Thinking; Mathematics Learning

Full Text:

PDF

References

Alavi, M., Biros, E., & Cleary, M. (2024). Notes to factor analysis techniques for construct validity. Canadian Journal of Nursing Research, 56(2), 164–170.

Alsaleh, N. J. (2020). Teaching Critical Thinking Skills: Literature Review. Turkish Online Journal of Educational Technology-TOJET, 19(1), 21–39.

Angeli, C., & Giannakos, M. (2020). Computational thinking education: Issues and challenges. In Computers in human behavior (Vol. 105, p. 106185). Elsevier.

Arustamyan, Y., Siddikova, Y., Sadullaeva, N., Solieva, M., & Khasanova, N. (2020). Assessment of Educational Process and its Organization. International Journal of Psychosocial Rehabilitation, 24(S1), 573–578.

Aspbury-Miyanishi, E. (2024). Guided attention strategies for developing teacher sight. Teacher Development, 1–16.

Biesta, G. (2021). World-centred education: A view for the present. Routledge.

Carpenter, S. K., Witherby, A. E., & Tauber, S. K. (2020). On students’(mis) judgments of learning and teaching effectiveness. Journal of Applied Research in Memory and Cognition, 9(2), 137–151.

Cheung, G. W., Cooper-Thomas, H. D., Lau, R. S., & Wang, L. C. (2024). Reporting reliability, convergent and discriminant validity with structural equation modeling: A review and best-practice recommendations. Asia Pacific Journal of Management, 41(2), 745–783.

Compeau, D., Correia, J., & Bennett Thatcher, J. (2022). When Constructs Become Obsolete: A Systematic Approach to Evaluating and Updating Constructs for Information Systems Research. MIS Quarterly, 46(2).

Dekker, T. J. (2020). Teaching critical thinking through engagement with multiplicity. Thinking Skills and Creativity, 37, 100701.

Fenn, J., Tan, C.-S., & George, S. (2020). Development, validation and translation of psychological tests. BJPsych Advances, 26(5), 306–315.

Firdausa, A. R., & Istiyono, E. (2019). Developing instrument for assessing student collaboration in vocational high schools. Journal of Physics: Conference Series, 1273(1), 12043.

González-Salamanca, J. C., Agudelo, O. L., & Salinas, J. (2020). Key competences, education for sustainable development and strategies for the development of 21st century skills. A systematic literature review. Sustainability, 12(24), 10366.

Habib, S., Rahayu, M., Dinta, S. A., Fariq, W. M., Maula, I., & Riadi, H. (2024). Human Resource Management in Improving The Quality of A Productive Educational Environment From Al-Qur’an Perspective; Analysis of Jalalain’s Tafsir. IJIRME: International Journal Of Innovative Research In Multidiciplinary Education, 3, 1072–1080.

Hanapi, N. M., & Kamal, M. M. M. (2024). Jigsaw classroom: A process of cooperative learning and discussion. Semarak International Journal of Innovation in Learning and Education, 1(1), 24–31.

Hilkenmeier, F., Bohndick, C., Bohndick, T., & Hilkenmeier, J. (2020). Assessing distinctiveness in multidimensional instruments without access to raw data–a manifest Fornell-Larcker criterion. Frontiers in Psychology, 11, 223.

Isharyadi, R., & Juandi, D. (2023). A systematics literature review of computational thinking in mathematics education: Benefits and challenges. Formatif: Jurnal Ilmiah Pendidikan MIPA, 13(1).

Islamiati, A., Fitria, Y., Sukma, E., Fitria, E., & Oktari, S. T. (2024). The Influence of The Problem Based Learning (PBL) Model and Learning Style on the Thinking Abilities. Jurnal Penelitian Pendidikan IPA, 10(4), 1934–1940.

Istiyono, E. (2020). Pengembangan instrumen penilaian dan analisis hasil belajar fisika dengan teori tes klasik dan modern. Yogyakarta: UNY Press. L, I.(2019). Evaluasi Dalam Proses Pembelajaran. Jurnal Manajemen Pendidikan Islam, 9, 478–492.

Kalkbrenner, M. T. (2023). Alpha, omega, and H internal consistency reliability estimates: Reviewing these options and when to use them. Counseling Outcome Research and Evaluation, 14(1), 77–88.

Kasani, H. A., Mourkani, G. S., Seraji, F., & Abedi, H. (2020). Identifying the weaknesses of formative assessment in the e-learning management system. Journal of Medical Education, 19(2).

Kennedy, I. (2022). Sample size determination in test-retest and Cronbach alpha reliability estimates. British Journal of Contemporary Education, 2(1), 17–29.

Khasawneh, Y., Khasawneh, N., & Khasawneh, M. (2024). Exploring the long-term effects: Retention and transfer of skills in gamified learning environment. International Journal of Data and Network Science, 8(1), 195–200.

Kusumawardani, W., & Aminatun, T. (2024). PBL in Blended Learning Design to Increase Critical Thinking and Problem-Solving Skills. Jurnal Penelitian Pendidikan IPA, 10(6), 3303–3308.

Lee, H.-Y., Wu, T.-T., Lin, C.-J., Wang, W.-S., & Huang, Y.-M. (2024). Integrating Computational thinking into scaffolding learning: An innovative approach to enhance Science, Technology, Engineering, and Mathematics hands-on learning. Journal of Educational Computing Research, 62(2), 431–467.

Lee, H. (2024). The rise of ChatGPT: Exploring its potential in medical education. Anatomical Sciences Education, 17(5), 926–931.

Loewenthal, K. M., & Lewis, C. A. (2020). An introduction to psychological tests and scales. Routledge.

Lyon, J. A., & J. Magana, A. (2020). Computational thinking in higher education: A review of the literature. Computer Applications in Engineering Education, 28(5), 1174–1189.

Mayola, E., Ayuni, R. T., & Adhelia, C. (2023). Development of Instruments for Learning Independence for High School Students: Construct Validity and Reliability. Beginner: Journal of Teaching and Education Management, 1(2), 91–103.

Ng, D. T. K., Wu, W., Leung, J. K. L., Chiu, T. K. F., & Chu, S. K. W. (2024). Design and validation of the AI literacy questionnaire: The affective, behavioural, cognitive and ethical approach. British Journal of Educational Technology, 55(3), 1082–1104.

Nicol, D. (2021). The power of internal feedback: Exploiting natural comparison processes. Assessment & Evaluation in Higher Education, 46(5), 756–778.

Oermann, M. H., Gaberson, K. B., & De Gagne, J. C. (2024). Evaluation and testing in nursing education. Springer Publishing Company.

Palts, T., & Pedaste, M. (2020). A model for developing computational thinking skills. Informatics in Education, 19(1), 113–128.

Pandey, P., & Pandey, M. M. (2021). Research methodology tools and techniques. Bridge Center.

Piwowar-Sulej, K. (2021). Human resources development as an element of sustainable HRM–with the focus on production engineers. Journal of Cleaner Production, 278, 124008.

Plomp, T. (2013). Educational design research: An introduction. Educational Design Research, 11–50.

Polat, E., Hopcan, S., Kucuk, S., & Sisman, B. (2021). A comprehensive assessment of secondary school students’ computational thinking skills. British Journal of Educational Technology, 52(5), 1965–1980.

Quadir, B., Yang, J. C., & Wang, W. (2024). Factors influencing the acquisition of English skills in an English learning environment using Rain Classroom. Interactive Learning Environments, 32(1), 1–19.

Rakhmawati, Y., & Mustadi, A. (2022). The circumstances of literacy numeracy skill: Between notion and fact from elementary school students. Jurnal Prima Edukasia, 10(1), 9–18.

Reilly, C., & Reeves, T. C. (2024). Refining active learning design principles through design-based research. Active Learning in Higher Education, 25(1), 81–100.

Rodríguez del Rey, Y. A., Cawanga Cambinda, I. N., Deco, C., Bender, C., Avello‐Martínez, R., & Villalba‐Condori, K. O. (2021). Developing computational thinking with a module of solved problems. Computer Applications in Engineering Education, 29(3), 506–516.

Saritepeci, M. (2020). Developing computational thinking skills of high school students: Design-based learning activities and programming tasks. The Asia-Pacific Education Researcher, 29(1), 35–54.

Saroyan, A., & Amundsen, C. (2023). Rethinking teaching in higher education: From a course design workshop to a faculty development framework. Taylor & Francis.

Schmidt, J. T., & Tang, M. (2020). Digitalization in education: challenges, trends and transformative potential. Führen Und Managen in Der Digitalen Transformation: Trends, Best Practices Und Herausforderungen, 287–312.

Suchyadi, Y., Sundari, F. S., Sutisna, E., Sunardi, O., Budiana, S., Sukmanasa, E., & Windiyani, T. (2020). Improving The Ability Of Elementary School Teachers Through The Development Of Competency Based Assessment Instruments In Teacher Working Group, North Bogor City. Journal Of Community Engagement (JCE), 2(1), 1–5.

Sürücü, L., & Maslakci, A. (2020). Validity and reliability in quantitative research. Business & Management Studies: An International Journal, 8(3), 2694–2726.

Thalhah, S. Z., Tahrim, T., & Sari, R. E. (2022). Development of lecturer performance assessment instruments through the plomp model in higher education. AL-ISHLAH: Jurnal Pendidikan, 14(2), 1527–1540.

Tomlinson, B. (2023). Developing materials for language teaching. Bloomsbury Publishing.

Tungkunanan, P. (2020). Learning Model of Undergraduate Students: Confirmatory Factor Analysis. International Journal of Instruction, 13(3), 665–678.

Wang, Z., Chen, Z., Gong, B., & Feng, Z. (2024). The interactive effects of instructors’ guidance frequency and type on Chinese secondary school students’ learning. Education and Information Technologies, 29(9), 11257–11280.

Williamson, B., Eynon, R., & Potter, J. (2020). Pandemic politics, pedagogies and practices: digital technologies and distance education during the coronavirus emergency. In Learning, media and technology (Vol. 45, Issue 2, pp. 107–114). Taylor & Francis.

Wilson, M. (2023). Constructing measures: An item response modeling approach. Routledge.

Afrullah, Z., Gunawan, R. N., Haidir, H., & Ramadhani, A. M. (2024). Implementasi penggunaan kemampuan computational thinking pada sekolah anak-anak: Analisis bibliometrik (2014–2024). Jurnal Binagogik, 11(2), 201–225.

Zafrullah, Z., Suyanto, S., Wahyuni, A., Ayuni, R. T., & Novilanti, F. R. E. (2023). Development of Android-based Learning to Improve Computational Thinking Skills in Junior High School. Jurnal Cendekia: Jurnal Pendidikan Matematika, 7(2), 1309–1320. https://doi.org/10.31004/cendekia.v7i2.2239

DOI: https://doi.org/10.35445/alishlah.v%25vi%25i.5985