Main Article Content

Abstract

This research is focused on the creation of a valid and dependable tool designed for the assessment of students' metacognitive abilities within the context of the Research Methodology course. The research methodology employed for this research follows the Research and Development (R&D) framework outlined by Mardapi, which encompasses ten distinct phases. The participants involved in this research comprised four lecturers responsible for instructing research methodology courses and a total of 61 students who were enrolled in these courses. The data collected for this research consisted of quantitative data acquired through expert validation questionnaires and trial instruments. Data analysis was conducted employing quantitative techniques, specifically utilizing Microsoft Excel and employing the Item Response Theory (IRT) Politomus data analysis approach within the R programming environment. The research outcomes indicated that the instrument employed to evaluate students' metacognitive skills in the research methodology course achieved a valid status as per expert evaluations, meeting the criteria for goodness. It was found to be valid in terms of the response distribution across all 24 items, and collectively, the instrument items were deemed capable of offering insights into the state of the test participants (respondents) by more than 85%. Moreover, the instrument demonstrated a very high level of reliability as 0,94.

Keywords

Metacognition Instruments IRT polytomus

Article Details

How to Cite
Nurnaningsih , N., & Amrin, A. (2024). Development of E-Assessment Instruments for Assessing Metacognition Skills of Students in The Research Methodology Course. Yupa: Historical Studies Journal, 8(1), 24-34. https://doi.org/10.30872/yupa.v8i1.2992

References

  1. Azwar, S. (2016). Cognitive Ability Test Construction. Learning Library
  2. DeVellis, R. F. (2016). Scale development: Theory and applications (Fourth). SAGE Publications Inc.
  3. Diella, D., & Ardiansyah, R. (2017). The Correlation of Metacognition with Critical Thinking Skills of Grade XI Students on Human Excretion System Concept. Journal of Science Research and Learning, 3(2), 134. https://doi.org/10.30870/jppi.v3i2.2576
  4. Hong, W. H., Vadivelu, J., Daniel, E. G. S., & Sim, J. H. (2015). Thinking about thinking: changes in first-year medical students' metacognition and its relation to performance. Medical Education Online, 20(1). https://doi.org/10.3402/MEO.V20.27561
  5. Huda, K., Suyanta, Priambodo, Y. A., Ardwiyanti, D., Usman, M., & Alvionita, D. (2021). The Improvement of students' metacognition skills on natural science education using guided inquiry models. Journal of Physics: Conference Series, 1882(1). https://doi.org/10.1088/1742-6596/1882/1/012027
  6. Kundre, O. T., & Pratini, H. S. (2019). Students' Thinking Process in View of Their Metacognition Ability in Designing Mathematics Learning. OLIVIA THERESIA KUNDRE, HANIEK SRI PRATINI 1 COMMUNICATION PATTERNS OF SALAFIYAH PESANTREN EDUCATION STUDENT THINKING PROCESS IN TERMS OF M. 1-10.
  7. Mardapi, D. (2018). Test and Non-Test Instrument Preparation Techniques (A. Setiawan (Ed.); First). Mitra Cendekia Press.
  8. Mitsea, E., Drigas, A., & Mantas, P. (2021). Soft Skills & Metacognition as Inclusion Amplifiers in the 21st Century. International Journal of Online and Biomedical Engineering, 17(4), 121-132. https://doi.org/10.3991/ijoe.v17i04.20567
  9. Ramadhan, A. A., & Pratana, C. (2020). Students' metacognition skill: How the implementation in chemistry learning? Journal of Physics: Conference Series, 1440(1). https://doi.org/10.1088/1742-6596/1440/1/012013
  10. S. Azwar. (2014). Psychological Scale Formulation (Second). Learning Library.
  11. Wells, C. S., Hambleton, R. K. & Purwono, U. (2008). Item response theory. Polytomous response IRT models and aplicatios. Handout delivered on the Training of Educational Assessment and Psychology (Psychometry), at Yogyakarta State University.