Flexible Computerized Adaptive Tests to Detect Misconceptions and Estimate Ability Simultaneously
Abstract: The Scaling Individuals and Classifying Misconceptions (SICM) model is an advanced psychometric model that can provide feedback to examinees’ misconceptions and a general ability simultaneously. These two types of feedback are represented by a discrete and a continuous latent variable, respectively, in the SICM model....
Authors: Bao, Y., Shen, Y., Wang, S., & Bradshaw, L.
Publication Year: 2020
Journal: Applied Psychological Measurement
Bao, Y., Shen, Y., Wang, S., & Bradshaw, L. (2020) Flexible Computerized Adaptive Tests to Detect Misconceptions and Estimate Ability Simultaneously. Applied Psychological Measurement, DOI: 10.1177/0146621620965730.
A Semi-supervised learning-based Diagnostic Classification Method Using Artificial Neural Networks
A Semi-supervised learning-based Diagnostic Classification Method Using Artificial Neural Networks
Abstract: The purpose of cognitive diagnostic modeling (CDM) is to classify students' latent attribute profiles using their responses to the diagnostic assessment. In recent years, each diagnostic classification model (DCM) makes different assumptions about the relationship between a student's response pattern and attribute profile...
Authors: Xue, K., & Bradshaw, L
Publication Year: 2020
Journal: Frontiers in Psychology
Xue, K., & Bradshaw, L. (2020) A Semi-supervised learning-based Diagnostic Classification Method Using Artificial Neural Networks. Frontiers in Psychology. DOI: 10.3389/fpsyg.2020.618336
Interpreting probabilistic classifications from diagnostic psychometric models
Interpreting probabilistic classifications from diagnostic psychometric models
Abstract: Although much research has been conducted on the psychometric properties of cognitive diagnostic models, they are only recently being used in operational settings to provide results to examinees and other stakeholders...
Authors: Bradshaw, L., & Levy, R
Publication Year: 2019
Journal: Educational Measurement: Issues and Practice
Bradshaw, L., & Levy, R. (2019) Interpreting probabilistic classifications from diagnostic psychometric models. Educational Measurement: Issues and Practice, 38 (2), 79-88.
Surveying Middle Grades Teachers’ Reasoning About Fraction Arithmetic in Terms of Measured Quantities
Surveying Middle Grades Teachers’ Reasoning About Fraction Arithmetic in Terms of Measured Quantities
Abstract: The authors report a novel survey that narrows the gap between information about teachers’ knowledge of fraction arithmetic provided, on the one hand, by measures practical to administer at scale and, on the other, by close analysis of moment-to-moment cognition. In particular, the survey measured components that would support reasoning directly with measured quantities, not by executing computational algorithms, to solve problems...
Authors: Izsák, A., Jacobson, E., & Bradshaw, L
Publication Year: 2019
Journal: Journal of Research in Mathematics Education
Izsák, A., Jacobson, E., & Bradshaw, L. (2019). Surveying Middle Grades Teachers’ Reasoning About Fraction Arithmetic in Terms of Measured Quantities. Journal of Research in Mathematics Education, 50(2), 156-209.
Assessing Growth in a Diagnostic Classification Model Framework
Assessing Growth in a Diagnostic Classification Model Framework
Abstract: A common assessment research design is the single-group pre-test/post-test design in which examinees are administered an assessment before instruction and then another assessment after instruction. In this type of study, the primary objective is to measure growth in examinees, individually and collectively...
Authors: Madison, M., & Bradshaw, L
Publication Year: 2018
Journal: Psychometrika
Madison, M., & Bradshaw, L. (2018). Assessing Growth in a Diagnostic Classification Model Framework. Psychometrika, 83(4), 963-990.
An Attribute-level Item Selection Method for DCM-CAT
An Attribute-level Item Selection Method for DCM-CAT
Abstract: Diagnostic classification models (DCMs) can provide multidimensional diagnostic feedback about students’ mastery levels of knowledge components or attributes. One advantage of using DCMs is the ability to accurately and reliably classify students into mastery levels with a relatively small number of items per attribute...
Authors: Bao, Y., & Bradshaw, L
Publication Year: 2018
Journal: Measurement: Interdisciplinary Research and Perspectives
Bao, Y., & Bradshaw, L. (2018). An Attribute-level Item Selection Method for DCM-CAT. Measurement: Interdisciplinary Research and Perspectives, 16(4), 209-255.
Evaluating Intervention Effects in a Diagnostic Classification Model Framework
Evaluating Intervention Effects in a Diagnostic Classification Model Framework
Abstract: The evaluation of intervention effects is an important objective of educational research. One way to evaluate the effectiveness of an intervention is to conduct an experiment that assigns individuals to control and treatment groups...
Authors: Madison, M., & Bradshaw, L
Publication Year: 2018
Journal: Journal of Educational Measurement
Madison, M., & Bradshaw, L. (2018). Evaluating Intervention Effects in a Diagnostic Classification Model Framework. Journal of Educational Measurement, 55(1), 32-51.
Development and Psychometric Evaluation of the Autism Stigma and Knowledge Questionnaire (ASK-Q)
Development and Psychometric Evaluation of the Autism Stigma and Knowledge Questionnaire (ASK-Q)
Abstract: ...
Authors: Harrison, A., Bradshaw, L., Naqvi, N., Campbell, J., & Paff, M
Publication Year: 2017
Journal: Journal of Autism and Development Disorders
Harrison, A., Bradshaw, L., Naqvi, N., Campbell, J., & Paff, M. (2017). Development and Psychometric Evaluation of the Autism Stigma and Knowledge Questionnaire (ASK-Q). Journal of Autism and Development Disorders, 47(10), 3281-3295.
Comparison of relative fit indices for diagnostic model selection
Comparison of relative fit indices for diagnostic model selection
Abstract: The purpose of this study was to thoroughly examine the performance of three information-based fit indices-Akaike's Information Criterion (AIC), Bayesian Information Criterion (BIC), and sample-size-adjusted BIC (SABIC)-using the log-linear cognitive diagnosis model and a set of well-known item response theory (IRT) models...
Authors: Sen, S. & Bradshaw, L
Publication Year: 2017
Journal: Applied Psychological Measurement
Sen, S. & Bradshaw, L. (2017). Comparison of relative fit indices for diagnostic model selection. Applied Psychological Measurement, 41(6), 422-438.
Invariance Principles for General Diagnostic Models
Invariance Principles for General Diagnostic Models
Abstract: In item response theory (IRT), the invariance property states that item parameter estimates are independent of the examinee sample, and examinee ability estimates are independent of the test items. While this property has long been established and understood by the measurement community for IRT models, the same cannot be said for diagnostic classification models (DCMs)...
Authors: Bradshaw, L. & Madison, M.
Publication Year: 2016
Journal: International Journal of Testing
Bradshaw, L. & Madison, M. (2016). Invariance Principles for General Diagnostic Models. International Journal of Testing, 16(2), 99-118.
The impact of Q-matrix designs on diagnostic classification accuracy in the presence of attribute hierarchies
The impact of Q-matrix designs on diagnostic classification accuracy in the presence of attribute hierarchies
Abstract: There is an increasing demand for assessments that can provide more fine-grained information about examinees. In response to the demand, diagnostic measurement provides students with feedback on their strengths and weaknesses on specific skills by classifying them into mastery or nonmastery attribute categories....
Authors: Liu, R., Huggins-Manley, A.C., Bradshaw, L.
Publication Year: 2016
Journal: Educational and Psychological Measurement
Liu, R., Huggins-Manley, A.C., Bradshaw, L. (2016). The impact of Q-matrix designs on diagnostic classification accuracy in the presence of attribute hierarchies. Educational and Psychological Measurement, 77(2), 420-440.
A comprehensive framework for integrating innovated psychometric methodology into educational research
A comprehensive framework for integrating innovated psychometric methodology into educational research
Abstract: ...
Authors: Templin, J., Bradshaw, L., & Paek, P.
Publication Year: 2016
Journal: Psychometric methods in mathematics education: Opportunities, challenges, and interdisciplinary collaborations
Templin, J., Bradshaw, L., & Paek, P. (2016). A comprehensive framework for integrating innovated psychometric methodology into educational research. In A. Izsák, J. Remillard, & J. Templin (Eds.), Psychometric methods in mathematics education: Opportunities, challenges, and interdisciplinary collaborations (pp. 97-117). Journal of Research in Mathematics Education Monograph Series No. 15. Reston, VA: National Council of Teachers of Mathematics.
The Effects of Q-Matrix Design on Classification Accuracy in the Log-Linear Cognitive Diagnosis Model
The Effects of Q-Matrix Design on Classification Accuracy in the Log-Linear Cognitive Diagnosis Model
Abstract: Diagnostic classification models are psychometric models that aim to classify examinees according to their mastery or non-mastery of specified latent characteristics. These models are well-suited for providing diagnostic feedback on educational assessments because of their practical efficiency and increased reliability when compared with other multidimensional measurement models...
Authors: Madison, M., & Bradshaw, L.
Publication Year: 2015
Journal: Educational and Psychological Measurement
Madison, M., & Bradshaw, L. (2015). The effects of Q-matrix design on classification accuracy in the log-linear cognitive diagnosis model Educational and Psychological Measurement, 75 (3), 491-511.
Diagnosing teachers’ understandings of rational number: Building a multidimensional test within the diagnostic classification model framework
Diagnosing teachers’ understandings of rational number: Building a multidimensional test within the diagnostic classification model framework
Abstract: We report a multidimensional test that examines middle grades teachers’ understanding of fraction arithmetic, especially multiplication and division. The test is based on four attributes identified through an analysis of the extensive mathematics education research literature on teachers’ and students’ reasoning in this content area...
Authors: Bradshaw, L., Izsák, A., Templin, J., & Jacobson, E.
Publication Year: 2014
Journal: Educational Measurement: Issues and Practice
Bradshaw, L., Izsák, A., Templin, J., & Jacobson, E. (2014). Diagnosing teachers’ understandings of rational number: Building a multidimensional test within the diagnostic classification model framework. Educational Measurement: Issues and Practice, 33(1), 2-14.
Combining scaling and classification: A psychometric model for scaling ability and diagnosing misconceptions
Combining scaling and classification: A psychometric model for scaling ability and diagnosing misconceptions
Abstract: Traditional testing procedures typically utilize unidimensional item response theory (IRT) models to provide a single, continuous estimate of a student’s overall ability. Advances in psychometrics have focused on measuring multiple dimensions of ability to provide more detailed feedback for students, teachers, and other stakeholders...
Authors: Bradshaw, L., & Templin, J.
Publication Year: 2014
Journal: Psychometrika
Bradshaw, L., & Templin, J. (2014). Combining scaling and classification: A psychometric model for scaling ability and diagnosing misconceptions. Psychometrika, 79 (3), 403-425.
Diagnosing psychosocial research attributes: An illustration of diagnostic classification modeling
Diagnosing psychosocial research attributes: An illustration of diagnostic classification modeling
Abstract: ...
Authors: Jurich, D., & Bradshaw, L.
Publication Year: 2014
Journal:
Jurich, D., & Bradshaw, L. (2014). Diagnosing psychosocial research attributes: An illustration of diagnostic classification modeling. International Journal of Testing, 14, 49-72.
Hierarchical diagnostic classification models: A family of models for estimating and testing attribute hierarchies
Hierarchical diagnostic classification models: A family of models for estimating and testing attribute hierarchies
Abstract: Although latent attributes that follow a hierarchical structure are anticipated in many areas of educational and psychological assessment, current psychometric models are limited in their capacity to objectively evaluate the presence of such attribute hierarchies. This paper introduces the Hierarchical Diagnostic Classification Model (HDCM), which adapts the Log-linear Cognitive Diagnosis Model to cases where attribute hierarchies are present...
Authors: Templin, J., & Bradshaw, L.
Publication Year: 2014
Journal: Psychometrika
Templin, J., & Bradshaw, L. (2014). Hierarchical diagnostic classification models: A family of models for estimating and testing attribute hierarchies. Psychometrika, 79(2) 317-339.
The use and misuse of psychometric models
The use and misuse of psychometric models
Abstract: The purpose of our paper entitled Hierarchical Diagnostic Classification Models: A Family of Models for Estimating and Testing Attribute Hierarchies (Templin & Bradshaw, 2014) was two-fold: to create a psychometric model and framework that would enable attribute hierarchies to be parameterized as dependent binary latent traits, and to formulate an empirically driven hypothesis test for the purpose of falsifying proposed attribute hierarchies....
Authors: Templin, J., & Bradshaw, L.
Publication Year: 2014
Journal:
Templin, J., & Bradshaw, L. (2014). The use and misuse of psychometric models. Psychometrika, 79(2) 347-354.
Measuring the reliability of diagnostic classification model examinee estimates
Measuring the reliability of diagnostic classification model examinee estimates
Abstract: Over the past decade, diagnostic classification models (DCMs) have become an active area of psychometric research. Despite their use, the reliability of examinee estimates in DCM applications has seldom been reported. In this paper, a reliability measure for the categorical latent variables of DCMs is defined...
Authors: Templin, J., & Bradshaw, L.
Publication Year: 2013
Journal: Templin, J., & Bradshaw, L
Templin, J., & Bradshaw, L. (2013). Measuring the reliability of diagnostic classification model examinee estimates. Journal of Classification, 30(2), 251-275.
Students’ reasoning about probability in the context of a raffle
Students’ reasoning about probability in the context of a raffle
Abstract: Assessing students’ conceptions related to independence and probability has been the focus of research in probability education for over 40 years. While we know a lot from past studies about predictable ways students may reason with well-known tasks, developing a diagnostic assessment that can be used by teachers to inform instruction demands the use of familiar and unfamiliar contexts...
Authors: Lee, H. S., Famularo, L., Masters, J., Bradshaw, L., & Sanei, H. R.
Publication Year: 2019
Journal: Actas del Tercer Congreso International Virtual de Educación Estadística
Lee, H. S., Famularo, L., Masters, J., Bradshaw, L., & Sanei, H. R. (2019). Students’ reasoning about probability in the context of a raffle. In J. M. Contreras, M. M. Gea, M. M. López-Martín y E. Molina-Portillo (Eds.), Actas del Tercer Congreso International Virtual de Educación Estadística. Available at www.ugr.es/local/fqm126/civeest.html
Diagnostic classification models
Diagnostic classification models
Abstract: Diagnostic classification models (DCMs) are a class of psychometric models that characterize examinee traits as categorical latent variables. When coupled with careful assessment design principles, DCMs hold promise for reliably estimating high dimensionality under feasible testing conditions in order to provide a multivariate view of a student's knowledge that is aligned with cognitive theory...
Authors: Bradshaw, L.
Publication Year: 2018
Journal: The SAGE Encyclopedia of Educational Research, Measurement, and Evaluation
Bradshaw, L. (2018) Diagnostic classification models. In Frey, B. (Ed.), The SAGE Encyclopedia of Educational Research, Measurement, and Evaluation, 507-512.
Diagnostic classification models
Diagnostic classification models
Abstract: ...
Authors: Bradshaw, L.
Publication Year: 2018
Journal: Measurement Theory and Application for the Social Sciences
Bradshaw, L. (2018). Diagnostic classification models. In D. Bandalos (Ed.), Measurement Theory and Application for the Social Sciences. New York, NY: Guilford Press, 446-477.
Diagnostic Classification Models: A Multivariate Classification Approach for Cognitively Complex Assessment
Diagnostic Classification Models: A Multivariate Classification Approach for Cognitively Complex Assessment
Abstract: ...
Authors: Bradshaw, L.
Publication Year: 2016
Journal: Handbook of Cognition and Assessment
Bradshaw, L. (2016). Diagnostic Classification Models: A Multivariate Classification Approach for Cognitively Complex Assessment. In A. Rupp, & J. Leighton (Eds.), Handbook of Cognition and Assessment. Wiley-Blackwell, 297-326.
An Evaluation of Diagnostic Classification Model-based Computer Adaptive Testing Algorithm for PARCC Diagnostic Assessments in Mathematics Comprehension and Decoding
An Evaluation of Diagnostic Classification Model-based Computer Adaptive Testing Algorithm for PARCC Diagnostic Assessments in Mathematics Comprehension and Decoding
Abstract: ...
Authors: Bradshaw, L.
Publication Year: 2015
Journal:
Bradshaw, L. (2015a). An Evaluation of Diagnostic Classification Model-based Computer Adaptive Testing Algorithm for PARCC Diagnostic Assessments in Mathematics Comprehension and Decoding. Technical Report. Pearson Education.
FlexMIRT Estimation Accuracy under Expected Field Test Designs for Diagnostic Classification Model-based PARCC Diagnostic Assessments
FlexMIRT Estimation Accuracy under Expected Field Test Designs for Diagnostic Classification Model-based PARCC Diagnostic Assessments
Abstract: ...
Authors: Bradshaw, L.
Publication Year: 2015
Journal:
Bradshaw, L. (2015b). FlexMIRT Estimation Accuracy under Expected Field Test Designs for Diagnostic Classification Model-based PARCC Diagnostic Assessments. Technical Report. Pearson Education.
PARCC Diagnostic Assessments: Design Research for Diagnostic Classification Model-based PARCC Diagnostic Assessments in Mathematics Comprehension and Decoding
PARCC Diagnostic Assessments: Design Research for Diagnostic Classification Model-based PARCC Diagnostic Assessments in Mathematics Comprehension and Decoding
Abstract: ...
Authors: Bradshaw, L.
Publication Year: 2014
Journal:
Bradshaw, L. (2014a). PARCC Diagnostic Assessments: Design Research for Diagnostic Classification Model-based PARCC Diagnostic Assessments in Mathematics Comprehension and Decoding. Technical Report. Pearson Education.