A DEVELOPMENT OF GOODNESS SCALE BY USING ANCHORING VIGNETTES FOR SCORE ADJUSTMENT การพัฒนามาตรวัดคุณค่าความดีโดยใช้แองเคอร์ริง วินเยตต์ ปรับแก้ค่าคะแนน
Main Article Content
Abstract
Anchoring vignettes is an instrument that can be used to reduce the problem of validate individual scores in different self-assessment. The purpose of this research was to develop and test psychometric properties of Goodness Scale using anchoring vignettes for score adjustment. Research were students in Grade 9 from schools in Bangkok, 57 students by simple random sampling for analyze the sequence of vignettes items and reliability and 250 students by stratified random sampling for analyze confirmatory factor analysis. Instrument was goodness scale. For the data analysis, reliability were analyzed by using SPSS, Confirmatory factor models were validated by LISREL, whereas the anchoring vignettes’ order validation were done by using R. Findings were as follows; 1) content validity of goodness scale in sets of anchoring vignettes ranged between 0.71 to 1.00 and sets of rating scale items ranged between 0.57 to 1.00, 2) score adjustment of goodness scale with R showed decimal which the position of the response compared to the other respondents, 3) there was no reversal sequence of goodness scale in sets of anchoring vignettes, and 4) goodness scale in sets of rating scale items had reliability after score adjustment of whole scale was 0.914 and for its subscale ranged between 0.717 to 0.878. Construct validity analyzed by confirmatory factor analysis revealed that the model of Goodness was fitted to the empirical data (Chi-square = 1.78, df = 2, p = 0.411, GFI = 0.997, AGFI = 0.979, RMR = 0.03, RMSEA = 0.000).
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
The owner of the article does not copy or violate any of its copyright. If any copyright infringement occurs or prosecution, in any case, the Editorial Board is not involved in all the rights to the owner of the article to be performed.
References
Choothong, M. (2014). A development of students’ achievement motivation assessment tool using anchoring vignette (Master thesis). Bangkok: Chulalongkorn University. [in Thai]
Denzin, N. K., & Lincoln, Y. S. (2005). Introduction: The discipline and practice of qualitative research. In N. K. Denzin & Y. S. Lincoln (Eds.), The Sage handbook of qualitative research (pp. 1–32). Sage Publications.
Grol-Prokopczyk, H. (2014). Age and sex effects in anchoring vignette studies: Methodological and empirical contributions. Survey Research Methods, 8(1), 1-17.
Hair, J., Black, W., Babin, B., & Anderson R. (2010). Multivariate data analysis a global perspective. New Jersey: Hamilton Printing.
Kapteyn, A., Smith, J. P., Soest, A. V., & Vonkova, H. (2011). Anchoring vignettes and response consistency. Labor Popul. WR-840, 1–33. 10.2139/ssrn.1799563
King, G., & Wand, J. (2007). Comparing Incomparable Survey Responses: New Tools for Anchoring Vignettes. Political Analysis, 15(1), 46-66.
Kyllonen, P. C. (2017). Measurement of 21st century skills within the common core state standards. In Innovation Research Symposium on Technology Enhanced Assessment. Retrieved January 12, 2020, from https://www.ets.org/Media/Research/pdf/session5-kyllonen-paper-tea2012.pdf
Mildred, L. P. (2017). Questionnaire research a practical guide (4th ed.). Routledge.
National Institute of Development Administration. (2012). Growing good program curriculum for grade 9 students. Retrieved January 12, 2020, from http://growinggood.org/2012/12/หลักสูตร-ม-3 [in Thai]
Pasiphol, S. (2013). Measurement and evaluation in education. Bangkok: Chulalongkorn University Press. [in Thai]
Wand, J., King, G., & Lau, O. (2019). Laucpolr: Censored ordered probit. In anchors: Statistical analysis of surveys with anchoring vignettes. Retrieved May 2, 2018, from https://rdrr.io/cran/anchors/man/cpolr.html
Wilgenburg, K. V. (2010). The validity of anchoring vignettes: Testing response consistency with an experimental. Netspar, 1-30.