MANY-FACET RASCH MEASUREMENT MODEL: CONCEPTS AND NECESSARY STATISTIC FOR PERFORMANCE ASSESSMENT
Article Sidebar
Main Article Content
Abstract
Many-Facet Rasch Measurement Model is a measurement model that is widely used for the analysis of educational instruments, which can be found especially in a performance assessment situation related to more than two facets, including examinee, item, and rater. The psychometric properties of the instruments are analyzed across each facet of the model and are invariant. However, this model is quite complex because the interpretation of the model’s analysis is different depending on each facet, and the interpretation criterion is different depending on the analyst's objectives. Therefore, this article will present the Many-Facet Rasch Measurement Model concepts, writing the command for the model’s analysis, and the necessary statistic for the model’s analysis. Readers could use these guidelines for analyzing and interpreting their performance assessment using Many-Facet Rasch Measurement Model’s analysis properly.
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
The owner of the article does not copy or violate any of its copyright. If any copyright infringement occurs or prosecution, in any case, the Editorial Board is not involved in all the rights to the owner of the article to be performed.
References
American Educational Research Association, American Psychological Association & National Council on Measurement in Education. (2014). Standards for Educational and Psychological Testing. American Educational Research Association
Andrich, D. (1978). A rating scale formulation for ordered response categories. Psychometrika, 43(4), 561 – 573. https://doi.org/10.1007/BF02293814
Bohlig, M., Fisher, W. P., Masters, G. N., & Bond, T. (1998). Content validity and misfitting Items. Rasch Measurement Transactions, 12(1), 607.
Bond, T. G., Yan, Z., & Heene, M. (2021). Applying the Rasch model: Fundamental measurement in human sciences (4th ed.). London: Routledge.
Eckes, T. (2009). Introduction to many-facet Rasch measurement. Peter Lang Edition.
Eckes, T. (2019). Many-facet Rasch measurement: Implications for rather mediated language assessment. In V. Aryadoust & M. Raquel (Eds.), Quantitative data analysis for language assessment volume I: Fundamental techniques. (pp. 153-176). Routledge.
Edwards, A. S., Edwards, K. E., & Wesolowski, B. C. (2019). The psychometric evaluation of a wind band performance rubric using the Multifaceted Rasch Partial Credit Measurement Model. Research Studies in Music Education, 1-25. https://doi.org/10.1177/1321103X18773103
Johnson, R. L., Penny, J. A., & Gordon, B. (2009). Assessing Performance: Designing, Scoring and Validating Performance Tasks. The Guilford Press.
Kanjanawasee, S. (2020). Modern test theories (5th ed.). Bangkok: CU Press.
Kim, P. (2020). Many-Facet Partial Credit Model analysis of Dörnyei’s L2 motivational self-system. Journal of Second and Multiple Language Acquisition, 8(4), 111-128.
Krishnan, S., & Idris, N. (2018). Using partial credit model to improve the quality of an instrument. International Journal of Evaluation and Research in Education (IJERE), 7(4), 313-316. 10.11591/ijere.v7.i4.pp313-316
Linacre, J. M. (1994). Many-faceted Rasch measurement. MESA Press.
Linacre, J. M. (2000). Comparing “Partial Credit Models” (PCM) and “Rating Scale Models” (RSM). Rasch Measurement Transactions, 14, 768.
Linacre, J. M. (2010). When to stop removing items and persons in Rasch misfit analysis? Rasch Measurement Transactions, 23(4), 1241.
Linacre, J. M. (2002a). Understanding Rasch measurement: Optimizing rating scale category effectiveness. Journal of Applied Measurement, 3(1), 85-106.
Linacre, J. M. (2002b). What do Infit and Outfit, Mean-square and Standardized mean? Archives of Rasch Measurement, 16, 871-882.
Linacre, J. M. (2003). Rasch power analysis: size vs. significance: standardized Chi-Square fit statistic. Rasch Measurement Transactions, 17(1), 918–919.
Linacre, J. M. (2022a). A User Guide to FACETS (Version 3.84.0) [Computer software]. https://www.winsteps.com/a/Facets-Manual.pdf
Linacre, J. M. (2022b). A User Guide to WINSTEPS (Version 5.2.3) [Computer software]. https://www.winsteps.com/a/Winsteps-Manual.pdf
Masters, G. N. (1982). A Rasch model for partial credit scoring. Psychometrika, 47(2), 149–174.
Myford, C. M., & Wolfe, E. W. (2004). Detecting and measuring rater effects using many-facet Rasch measurement: Part II. Journal of applied measurement, 5(2), 189-227.
Myung, I. J. (2003). Tutorial on maximum likelihood estimation. Journal of Mathematical Psychology, 47(1), 90–100. https://doi.org/10.1016/S0022-2496(02)00028-7
Smith, R. M. (1996). Polytomous mean-square fit statistics. Rasch Measurement Transactions, 10(3), 516-517.
Wesolowski, B. C., Amend, R. M., Barnstead, T. S., Edwards, A. S., Everhart, M., Goins, Q., Grogan III, R. J., Herceg, A. M., Jenkins, S. I., Johns, P. M., McCarver, C. J., Schaps, R E., Sorrell, G. W., & Williams, J. D. (2017). The development of a secondary-level solo wind instrument performance rubric using the Multifaceted Rasch Partial Credit Measurement Model. Journal of Research in Music Education, 65, 95–119.
Wesolowski, B. C. (2019). An examination of differential item functioning in a rubric to assess solo music performance. Musicae Scientiae, 1-15. https://doi.org/10.1177/1029864919859928
Wright, B. D., & Linacre, J. M. (1994). Reasonable mean-square fit values. Rasch Measurement Transactions, 8, 370-371.
Wright, B. D., & Masters, G. N. (2002). Number of person or item strata. Rasch Measurement Transaction, 16(3), 888.