Автор |
Reynolds, Trudy |
Автор |
Perkins, Kyle |
Автор |
Brutten, Sheila |
Дата выпуска |
1994 |
dc.description |
The goals of this study were threefold: (1) to provide a comparative analysis of five different item analysis indices using both IRT and non-IRT indices; (2) to describe the characteristics of flagged items; and (3) to investigate the appropriateness of logistic regression as an item analysis technique for further studies. The performance of five item analysis indices was examined in this study; p-value, point-biserial correlation, Rasch b parameter, Rasch χ<sup>2</sup> fit and χ<sup>2</sup> from the logistic regression model. A factor analysis indicated that the first factor was a difficulty factor and included the Rasch b and p-value indices, whereas the second factor represented the discrimination power of an item and consisted of the Rasch χ<sup>2</sup> fit, χ<sup>2</sup> from the logistic regression and the point-biserial correlation. There was a tendency for difficult items to exhibit more unusual response patterns. The χ<sup> 2</sup> from the logistic regression fit was found to be an appropriate index when a researcher is attempting to detect items that function differentially and when the subject pool consists of varying ability groups. |
Издатель |
Sage Publications |
Название |
A comparative item analysis study of a language testing instrument |
Тип |
Journal Article |
DOI |
10.1177/026553229401100102 |
Print ISSN |
0265-5322 |
Журнал |
Language Testing |
Том |
11 |
Первая страница |
1 |
Последняя страница |
13 |
Аффилиация |
Reynolds, Trudy, Southern Illinois University School of Medicine |
Аффилиация |
Perkins, Kyle, Southern Illinois University at Carbondale |
Аффилиация |
Brutten, Sheila, Southern Illinois University at Carbondale |
Выпуск |
1 |
Библиографическая ссылка |
Agresti, A.1990: Categorical data analysisNew York : Wiley. |
Библиографическая ссылка |
Bock, D.R.1975: Multivariate statistical methods in behavioral researchNew York: McGraw-Hill. |
Библиографическая ссылка |
Crocker, L. and Algina, J. 1986: Introduction to classical and modern test theory New York: Holt, Rinehart & Winston. |
Библиографическая ссылка |
Educational Testing Service1988: Test of English as a Foreign Language (Form 3KTF12). Princeton, NJ: Author. |
Библиографическая ссылка |
Henning, G.H.1987: A guide to language testing: development, evaluation, researchCambridge, MA: Newbury House. |
Библиографическая ссылка |
Hill, J.R.1989: Screening for potentially biased items in testing programs . Educational Measurement: Issues and Practice 8, 5-11. |
Библиографическая ссылка |
Horn, J.L.1965: A rationale and test for the number of factors in factor analysis. Psychometrika30, 179-85. |
Библиографическая ссылка |
Perkins, K. and Brutten, S.R. 1993: A comparison of indices for the identification of misfitting items. In Douglas, D. and Chappelle, C., editors, A new decade of language testing. Alexandria, VA: Teachers of English to Speakers of other Languages, Inc., 83-97. |
Библиографическая ссылка |
Perkins, K. and Miller, L.M. 1984: Comparative analyses of English as a second language reading comprehension data: classical test theory and latent trait measurement. Language Testing 1, 21-32. |
Библиографическая ссылка |
Reckase, M.D.1979: Unifactor latent trait models applied to multifactor tests: results and implications. Journal of Educational Statistics4, 207-30. |
Библиографическая ссылка |
SAS user's guide: statistics, version 5 edition1985: Cary, NC: SAS Institute. |
Библиографическая ссылка |
Shepard, L.A., Camilli, G. and Williams, D.M. 1985: Validity of approximation techniques for detecting item bias. Journal of Educational Measurement 22, 77-105. |
Библиографическая ссылка |
Tuckman, B.W.1978: Conducting educational research (second edition)New York: Harcourt Brace Jovanovich. |
Библиографическая ссылка |
Vale, C.D.1986: User's manual for ITEMAN, RASCAL and ASCALSt Paul, MN: Assessment Systems Corporation. |