The impact of courts on teacher competence testing

In a second response to J. Patrick Rooney, the author counters Mr. Rooney's criticisms and defends the role of Educational Testing Service on the test bias issue.

ETS Replies to Golden Rule on “Golden Rule”

In this response to “Golden Rule on ‘Golden Rule,’” Greg Anrig reasserts his position that the “Golden Rule settlement” was a mistake. He argues that its application in Illinois has not improved the passing rate for black candidates relative to white candidates and that it has inappropriately been used as a precedent for proposed legislature mandates in other states.

ETS on “Golden Rule”

Six item bias detection techniques (distractor analysis, the Mantel-Haenszel procedure, Angoff's delta plot, Angoff's modified delta plot, Stricker's partial correlation index, and direct comparison of item difficulties) were compared for their ability to identify biased items at three stages of test development. The techniques were applied to items administered during the spring 1989 item pilot (n=about 1,000 for each of 36 forms), the fall 1989 form pilot (n=about 460 for each of three tests), ard the spring 1990 final test version (n=about 46,000 each for the reading, mathematics, and language tests) of the Grade 9 Alabama Basic Competency Tests. Four subgroup pairs were analyzed for the reading, mathematics, and language tests; each administration; and each technique. The subgroup pairs included black versus white females, blacx versus white males, black females versus black males, and white females versus white males. The method with the greatest stability across administrations was the direct difficulty difference, followed closely by distractor analysis. The Mantel-Haenszel procedure and trl partial correlation index both showed weak to moderate stability. .'he poorest results concerning stability were found for both Angoff techniques. The modified Angoff version is not a desirable technique, since it can identify inappropriate items. Results suggest the possible use of more than one index to examine a set of items. A 60-item list of references is included. (SLD) *****************************************************************k***** Reproductions supplied by EDRS are the best that can be made from the original document. *********************************************************************** U.E. DEPARTMENT OF EDUCATION Office of Educational Research and Improvement EDU5ATIONAL RESOURCES INFORMATION CENTER (ERIC) rWfhis document has been reproduced as received from the person or organization originating it r Minor changes have been made to improve reproduction quality Points of view or opinions stated in this docu ment do not necessarily represent official OEM position or policy "PERMISSION TO REPRODUCE THIS MATERIAL HAS BEEN GRANTED BY Itibleo# O'iOrtitTO THE EDUCATIONAL RESOURCES INFORMATION CENTER (ERIC)." A COMPARISON OF METHODS FOR DETECTING ITEM BIAS Marcia R. O'Neal Evaluation and Assessment Laboratory The University of Alabama Paper presented at the annual meeting of the Mid-South Educational Research Association, Lexingtor, Kentucky, November 13-15, 1991.

/pdf/a-comparison-of-methods-for-detecting-item-bias-4decybd6ja.pdf

A Comparison of Methods for Detecting Item Bias.

Nine Facts about the SAT That Might Surprise You. Statistical Report.

The Chief Executive Officer of the company that brought the original Golden Rule lawsuit explains why the lawsuit was brought how it was settled, and what he now, 3 years after the settlement, thinks of it.

Golden Rule on “Golden Rule”

In this rejoinder to Anrig's criticisms in the last issue of EM, Rooneg responds to Anrig's arguments and reasserts his position that the Golden Rule settlement was necessarg and reasonable and has been effective.

J. Patrick Rooney

Papers

Golden Rule on “Golden Rule”

A Response from Golden Rule to "ETS on 'Golden Rule'".