An Investigation of Components and the Development of an Instrument for Measuring Academic Writing Skills
A Case Study of Undergraduate Students in a Private University
Abstract
This study aimed to develop and validate a reliable instrument for assessing academic writing skills among undergraduate students, with a focus on learners in Thailand. The research involved a two-phase approach. Initially, a comprehensive questionnaire was designed by synthesizing key insights from relevant literature and conducting in-depth interviews with five purposively selected key informants, including academic experts in English language education and assessment (IOC index process). The second phase involved the administration of the instrument to a sample of 586 undergraduate students selected through simple random sampling from a private university. The validity and reliability of the instrument were thoroughly evaluated using multiple statistical techniques. Content validity was ensured by expert review, resulting in an acceptable content validity index. The reliability analysis showed a strong overall Cronbach’s alpha coefficient of 0.86, indicating high internal consistency. Construct validity was examined through confirmatory factor analysis, which revealed an excellent model fit with empirical data (Chi-square=5, p=0.172, CFI=0.99, RMSEA=0.034). Factor loadings of the components ranged from 0.63 to 0.84, demonstrating the robustness of the instrument in capturing the essential dimensions of academic writing skills. These findings highlight the utility of the developed instrument as a tool for educators and researchers to evaluate and improve academic writing competencies effectively. The study also emphasizes the importance of precise measurement tools in enhancing pedagogical practices and fostering academic excellence in English as a Foreign Language (EFL) setting. Future research should explore the application of this instrument across diverse cultural and educational contexts to further refine its generalizability and impact.