Автор |
Norcini, John, J. |
Автор |
Hancock, E., William |
Автор |
Webster, George, D. |
Автор |
Grosso, Louis, J. |
Автор |
Shea, Judy, A. |
Дата выпуска |
1988 |
dc.description |
Despite the growing popularity of performance tests, scores on such measures have rarely been interpreted from a criterionreferenced perspective. This paper describes a test of skill in reading electrocardiographs (ECGs). Using generalizability theory, the errors of measurement and standard setting were estimated both alone and together from a criterionreferenced perspective. Performance on this test was also compared with a measure of the quality of training plus the multiplechoice questions and patient-management problems used in a medical certifying examination. Generalizabilityanalysesproduced positive results for the standard setting procedure and the ECGs, both separately and together. The preliminary validity evidence for scores was encouraging. The criterion-referenced ECGs ranked groups of examinees as expected based on prior education and examination experience. The criterion-referenced ECGs also had modest correlations with traditional measures of physician competence. |
Издатель |
SAGE PUBLICATIONS, INC. |
Название |
A Criterion-Referenced Examination of Physician Competence |
Тип |
Journal Article |
DOI |
10.1177/016327878801100107 |
Print ISSN |
0163-2787 |
Журнал |
Evaluation & the Health Professions |
Том |
11 |
Первая страница |
98 |
Последняя страница |
112 |
Аффилиация |
Shea, Judy, A., American Board of Internal Medicine |
Выпуск |
1 |
Библиографическая ссылка |
ANGOFF, W. H. (1971) "Scales, norms and equivalent scores," in R. L. Thorndike (ed.) Educational Measurement. Washington DC: American Council on Education. |
Библиографическая ссылка |
BRENNAN, R. L. (1983) Elements of Generalizability Theory. Iowa City, IA: ACT |
Библиографическая ссылка |
BRENNAN, R. L. (1984) "Estimating the dependability of the scores," in R. A. Berk (ed.) A Guide to Criterion-Referenced Test Construction. Baltimore, MD: John Hopkins University Press. |
Библиографическая ссылка |
BRENNAN, R. L. and M. T. KANE (1977) "An index of dependability for mastery tests."J. of Educ. Measurement14, 277-289. |
Библиографическая ссылка |
BRENNAN, R. L. and R. E. LOCKWOOD (1980) "A comparison of the Nedelsky and Angoff cutting score procedures using generalizability theory."Applied Psych. Measurement4, 105-126. |
Библиографическая ссылка |
CRONBACH, L. J., G. C. GLESSER, H. NANDA and N. RAJARATNAM (1972) The dependability of behavioral measurements: theory of generalizability for scores and profiles. New York: John Wiley. |
Библиографическая ссылка |
GLASER, R. (1963) "Instructional technology and the measurement of learning outcomes."Amer. Psychologist18, 519-521. |
Библиографическая ссылка |
GLASER, R. and A. J. NITKO (1971) "Measurement in learning and instruction," in R.L. Thorndike (ed.) Educational Measurement. Washington DC: American Council on Education. |
Библиографическая ссылка |
HAERTEL, E. (1985) "Construct validity and criterion-referenced testing."Rev. of Educ. Research, 55 (1): 23-46. |
Библиографическая ссылка |
HAMBLETON, R.K. (1984) "Validating the test scores," in R. A. Berk (ed.) A Guide to Criterion-Referenced Test Construction. Baltimore, MD: John Hopkins University Press. |
Библиографическая ссылка |
KANE, M. and J. WILSON (1984) "Errors of measurement and standard setting in mastery testing."Applied Psych. Measurement8, 107-115. |
Библиографическая ссылка |
LIVINGSTON, S. A. (1977) "Psychometric techniques for criterion-referenced testing and behavioral assessment," in J. D. Cone and R. P. Hawkins (eds.) Behavioral Assessment: New Directions in Clinical Psychology. New York: Brunner/ Mazel. |
Библиографическая ссылка |
MILLMAN, J. (1974) "Criterion-referenced measurement," in W. J. Popham (ed.) Evaluation in Education: Current Applications. Berkeley, CA: McCutchan. |
Библиографическая ссылка |
MOSIER, C. I. (1943) "On the reliability of a weighted composite."Psychometrika8, 161-168. |
Библиографическая ссылка |
NORCINI, J. J., D. B. SWANSON, L. J. GROSSO and G. D. WEBSTER (1985) "Reliability, validity and efficiency of various item formats in assessment of physician competence."Medical Education19 (3): 238-247. |
Библиографическая ссылка |
Panel on the General Professional Education of the Physician (1984) Physicians for the Twenty-First Century: the GPEP Report. Washington, DC: Association of American Medical Colleges. |
Библиографическая ссылка |
POPHAM, W. J. (1978) Criterion-Referenced Measurement. NJ: Prentice-Hall. |