Objective: This study was aimed at determining the external validity of the psychometric properties of a two-factor Collegiate Learning Assessment Performance Task Diagnostic Instrument (CLAPTDI) for use in assessing learning skills among predominantly black college students. The construct validity of the two factors CLAPTDI had been established in a previous study exploratory and confirmatory factor analyses. Establishing the external validity involved conducting a multi-group test of the measurement instrument’s factorial scores equivalence across panels of lower class and upper class students from a predominantly black college. Method: The study relied on a strict test of equivalence categorization by focusing on tests for invariance across the two groups with respect to factor loadings, intercepts, and error factor loadings by estimating the difference in chi-square goodness-of-fit statistic and comparative fit index (CFI). Sets of measurement and structural parameters were put to the test in a logically ordered and increasingly restrictive manner. Results: The analyses found that the CLAPTDI scale’s factorial measurement structure was invariant across lower class and upper class PBC students. Conclusion: The collegiate learning assessment performance task diagnostic instrument with two latent factors and five observed variables is a valid measurement scale for assessing the level of analytic reasoning and problem solving learning among predominantly black college students.
The study is one of very few studies which have investigated the external validity of the psychometric properties of a two-factor Collegiate Learning Assessment Performance Task Diagnostic Instrument (CLAPTDI) for use in assessing learning skills among predominantly black college students.
AAC and U, 2005. Liberal education outcomes. Washington, DC: Association of American Colleges and Universities.
AASCU, 2006. Value-added assessment perspectives. Washington, DC: American Association of State Colleges and Universities.
Arbuckle, J.L., 2016. IBM SPSS AMOS 24 user's guide [Computer Software and Manual]: New York:NY; IBM.
Arum, R., J. Josipa and M. Velez, 2008. Learning to reason and communicate in college: Initial report of findings from the CLA longitudinal study. New York: The Science Research Council.
Banta, T.W. and G.R. Pike, 2007. Revisiting the blind alley of value-added. Assessment update. Bloomington, IN: National Survey of Student Engagement, 19(1).
Blunch, N.J., 2010. Introduction to structural equation modeling using SPSS and AMOS. Thousand Oak, CA: Sage Publication.
Brown, T.A., 2006. Confirmatory factor analysis for applied research. New York: Guildford Press.
Byrne, B.M., 2010. Structural equation modeling with AMOS: Basic concept, applications, and programming. 2nd Edn., New York, USA: Taylor & Francis Group, Routledge.
Cheung, G.W. and R.B. Renwsvolt, 2002. Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 9(2): 233-255. View at Google Scholar | View at Publisher
Hair, J.F., W.C. Black, B.J. Babin, R.E. Anderson and R.L. Tatham, 2016. Multivariate data analysis. Upper Saddle River, N.J: Pearson Prentice Hall.
Hornes, J.L., J.J. McArdle and R. Mason, 1983. When is invariance not invariant: A practical scientist’s look at the ethereal concept of factor invariance. Psychologist, 1(1): 179-188. View at Google Scholar
Hu, L. and P.M. Bentler, 1999. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1): 1-55. View at Google Scholar | View at Publisher
Mertler, C.A. and R.A. Vannatta, 2013. Advanced and multivariate statistical analytical methods: Practical application and interpretation. Glendale CA: Pyrczak Publishing.
Mongkuo, M.Y., N. Lucas and K. Walsh, 2013. Initial validation of collegiate learning assessment performance task diagnostic instrument for historically black colleges and universities. British Journal of Education, Society, and Behavioral Science, 3(3): 282-299.