Objective: To explore the fitful of L in Likert-type scales.This article proposes L for assessing individual fit based on two theory models:the Guttman's psychometric model and Graded response mode.Methods: Carlo Monte data simulation method was used,the number of items was 40,the score was 0,1 and 2.Project parameters included difficulty and discrimination.The sample size was 1000 and 100 was repeated under an experimental condition.In the practical research,using the Big Five Personality Questionnaire (FFI),1108 college and high school students were tested to investigate the effect of L on the reliability and validity of FFI.Results: Simulation studies showed that L was close to normal distribution in the Likert scale.L could detect all kinds of aberrant response.Correct rejection rate for all kinds of aberrant response was about 95% and the accuracy rate of random response and compromise response were 100%.Practical research showed that the reliability and construct validity were promoted when different proportions of aberrant individuals were removed.When 50% aberrant individuals were deleted,the reliability of A,C,E,N and O increased from 0.635,0.789,0.725,0.830,0.714 to 0.727,0.871,0.823,0.913,0.841;χ2/df decreased from 7.594,6.999,10.872,16.445,14.047 to 3.113,2.432,3.635,3.784,7.093.Conclusion: L can effectively detect the aberrant responses in Likert scales,and improve the reliability and validity of the test.
|
1 Paulhus DL, Reid DB. Enhancement and denial in socially desirable responding. Journal of Personality and Social Psychology, 1991, 60(2):307
2 Meijer RR, Egberink IJL, Emons WHM, et al. Detection and validation of unscalable item score patterns using item response theory:An illustration with Harter's Self-Perception Profile for Children. Journal of Personality Assessment, 2008, 90(3):227-238
3 Zickar MJ, Drasgow F. Detecting faking on a personality instrument using appropriateness measurement. Applied Psychological Measurement, 1996, 20(1):71-87
4 Ferrando PJ, Chico E. Detecting dissimulation in personality test scores:A comparison between person-fit indices and detection scales. Educational and Psychological Measurement, 2001, 61(6):997-1012
5 Ponocny I, Klauer KC. Towards identification of unscalable personality questionnaire respondents:The use of person fit indices. Psychological Test and Assessment Modeling, 2002, 44(1):94
6 刘拓, 曹亦薇, 戴晓阳. 个人拟合指标在艾森克人格测验中的应用. 中国临床心理学杂志, 2011, 19(3):323-326
7 王昭, 郭庆科, 韩丹. 个人拟合指数对人格测验的影响及意义. 心理科学, 2012, 35(5):1225-1232
8 Meijer RR, Sijtsma K. Methodology review:Evaluating person fit. Applied Psychological Measurement, 2001, 25(2):107-135
9 Levine MV, Rubin DB. Measuring the appropriateness of multiple-choice test scores. Journal of Educational Statistics, 1979, 4(4):269-290
10 Drasgow F, Levine MV, Williams EA. Appropriateness measurement with polychotomous item response models and standardized indices. British Journal of Mathematical and Statistical Psychology, 1985, 38:67-86
11 Raiche G, Blais JG. Characterization of the Distribution of the Lz Index of Person Fit According to the Estimated Proficiency Level. Online Submission, 2005. 28
12 Armstrong RD, Stoumbos ZG, Kung MT, et al. On the performance of the lz person-fit statistic. Practical Assessment, Research & Evaluation, 2007
13 De La Torre J, Deng W. Improving Person-Fit Assessment by Correcting the Ability Estimate and Its Reference Distribution. Journal of Educational Measurement, 2008, 45(2):159-177
14 Dodeen H, Darabi M. Person-fit:relationship with four personality tests in mathematics. Research Papers in Education, 2009, 24(1):115-126
15 Magis D, Raîche G, Béland S. A didactic presentation of Snijders's lz* index of person fit with emphasis on response model selection and ability estimation. Journal of Educational and Behavioral statistics, 2012, 37(1):57-81
16 刘拓, 曹亦薇, 戴晓阳. 个人不拟合对 IRT 项目参数估计的影响及净化对策. 中国临床心理学杂志, 2011, 19(5):622-624
17 Emons WHM. Detection and diagnosis of person misfit from patterns of summed polytomous item scores. Applied Psychological Measurement, 2009, 33(8):599-619
18 Franndo PJ. Factor-analytic procedures for assessing response pattern scalability. Multivariate Behavioral Reserch, 2007, 42:481-508
19 Franndo PJ. Some statistics for assessing person-fit based on continuous-response models. Applied Psychological Measurement, 2010, 34(4):219-237
20 Conijn JM, Emons WHM, van Assen MALM, et al. On the usefulness of a multilevel logistic regression approach to person-fit analysis. Multivariate Behavioral Research, 2011, 46(2):365-388
21 Tendeiro JN, Meijer RR. A CUSUM to Detect Person Misfit A Discussion and Some Alternatives for Existing Procedures. Applied Psychological Measurement, 2012, 36(5):420-442
22 Guttman L. A basis for scaling qualitative data. American Sociological Review, 1944, 9:139-150
23 Samejima F. Estimation of latent ability using a response pattern of graded scores. Psychometrika Monograph Supplement, 1969
24 杜文久. IRT 多级评分项目参数估计及其在测验中的应用. 应用概率统计, 2000, 16:350-365
25 郭庆科, 周晶. Likert量表分析中不同 IRT模型的有效性. 心理学探新, 2004, 3:67-70
26 Sijtsma K, Meijer RR. The person response function as a tool in person-fit research. Psychometrika, 2001, 66:191-208
27 丁强, 卢家楣, 陈宁. 青少年责任感问卷的编制. 中国临床心理学杂志, 2014, 22(5):831-834, 830
28 伍新春, 刘畅, 胡艳蕊, 等. 父亲教养投入问卷的编制及其信效度检验. 中国临床心理学杂志, 2015, 23(4):576-579
|