MULTICULTURAL COMPETENCE: VALIDITY AND ASSESSMENT STRATEGIES IN DIVERSE CULTURAL CONTEXTS
Main Article Content
Abstract
Multicultural competence is a multidimensional construct encompassing awareness, knowledge, and skills that reflect holistic learning in culturally diverse contexts. However, assessing this competence still faces several limitations, such as unclear conceptual components, the interchangeable use of “multicultural competence” and “cross-cultural competence” without clearly distinguishing their meanings, and the bias in self-report methods that may not accurately reflect actual behavior. Effective assessment thus requires a well-defined conceptual framework and empirical evidence to support valid interpretation. This paper adopts Messick’s unified concept of validity, which emphasizes the consideration of multiple aspects-content, substantive, structural, generalization, relations with other variables, and the consequences of score use-alongside Kane’s argument-based validation framework, which organizes inferences leading to decisions based on assessment results and systematically gathers evidence to support each step of the reasoning chain. Appropriate assessment strategies should be diverse and integrative, incorporating various methods such as self-report, situational judgment test, behavioral observation, measurement invariance analysis across cultural groups, and stakeholder participation. These strategies aim to ensure accurate, reliable, and culturally responsive evaluations. This article proposes a comprehensive assessment approach that reflects the complexity of multicultural competence and supports the development of valid, practical, and applicable tools aligned with global competence goals in the 21st century.
Article Details
References
American Educational Research Association (AERA), American Psychological Association (APA), And National Council on Measurement in Education (NCME). (2014). Standards for educational and psychological testing. (7th ed.). United States of America: American Psychological Association.
ASCD. (2024). How to give effective feedback to your students [Webinar]. ASCD. Retrieved June 25, 2025, from https://www.ascd.org/webinars/how-to-give-effective-feedback-to-your-students
Banks, J. A. (2014). An introduction to multicultural education. (5th ed.). London: Pearson.
Campinha-Bacote, J. (2002). The process of cultural competence in the delivery of healthcare services: A model of care. Journal of Transcultural Nursing, 13(3), 181-184.
Deardorff, D. K. (2006). Identification and assessment of intercultural competence as a student outcome of internationalization. Journal of Studies in International Education, 10(3), 241-266.
Griffith, R. L. et al. (2016). Assessing Intercultural Competence in Higher Education: Existing Research and Future Directions. Retrieved June 25, 2025, from https://www.mccc.edu/~lyncha/documents/Assessinginterculturalcompetence-ets212112.pdf
Kane, M. T. (1992). An argument-based approach to validity. Psychological Bulletin, 112(3), 527-535.
Kane, M. T. (2006). Validation. Educational measurement. (4th ed.). Westport, CT: Praeger.
Kane, M. T. (2013). Validating the interpretations and uses of test scores. Journal of Educational Measurement, 50(1), 1-73.
Lie, D. A. et al. (2011). Does cultural competency training of health professionals improve patient outcomes? A systematic review and proposed algorithm for future research. Journal of General Internal Medicine, 26(3), 317-325.
Luo, J. & Chan, C. K. Y. (2022). Qualitative methods to assess intercultural competence in higher education research: A systematic review with practical implications. Educational Research Review, 37(2022), 100476. https://doi.org/10.1016/j.edurev.2022.100476 .
Messick, S. (1989). Validity. Educational Measurement. (3rd ed.). New York: American Council on Education and Macmillan.
Messick, S. (1995). Validity of psychological assessment: Validation of inferences from persons’ responses and performances as scientific inquiry into score meaning. American Psychologist, 50(9), 741-749.
OECD. (2020). Global competence for an inclusive world. Paris: OECD Publishing.
PISA. (2018). PISA 2018 assessment and analytical framework. Paris: OECD Publishing.
Pope, R. L. & Reynolds, A. L. (1997). Multicultural competence in student affairs. New Jersey: Jossey-Bass.
Pope, R. L. et al. (2019). Multicultural Competence in Student Affairs: Advancing Social Justice and Inclusion. San Francisco: John Wiley & Sons.
Sue, D. W. et al. (1992). Multicultural counseling competencies and standards: A call to the profession. Journal of Counseling & Development, 70(4), 477-486.
Ting-Toomey, S. (1999). Communicating across cultures. New York: The Guilford Press.
UNESCO. (2021). Education for sustainable development: Towards achieving the SDGs. Paris: UNESCO Publishing.
Van de Vijver, F. & Leung, K. (1997). Methods and data analysis for cross cultural research. Thousand Oaks, CA: Sage Publications.
Wilcox, M. M. et al. (2020). Who’s multiculturally competent? Everybody and nobody: A multimethod examination. The Counseling Psychologist, 48(4), 369-401.
Zumbo, B. D. (1999). A handbook on the theory and methods of differential item functioning (DIF): Logistic regression modeling as a unitary framework for binary and Likert-type (ordinal) item scores. Ottawa, ON: Directorate of Human Resources Research and Evaluation, Department of National Defense.