National Academies Press: OpenBook
« Previous: 5 Conclusions
Suggested Citation:"References." National Research Council. 1999. Uncommon Measures: Equivalence and Linkage Among Educational Tests. Washington, DC: The National Academies Press. doi: 10.17226/6332.
×

References

Achieve, Inc. 1998 About Achieve. Available electronically at http://www.achieve.org [March 1].

Anastasi, A. 1982 Psychological Testing, Fifth edition. New York: MacMillian Publishing Company.


Beaton, A.E., and E.J. Gonzalez 1993 Comparing the NAEP Trial State Assessment results with the IAEP international results. In Setting Performance Standards for Student Achievement: Background Studies. Stanford, CA: National Academy of Education.

1995 The NAEP Primer. Center for the Study of Testing, Evaluation, and Educational Policy. Chestnut Hill, MA: Boston College.

Beaton, A.E., and R. Zwick 1990 The Effect of Changes in the National Assessment: Disentangling the NAEP

1985-1986 Reading Anomaly. Report No. 17-TR-21, Educational Testing Service, National Assessment of Educational Progress, Princeton, NJ.

Behuniak, P., and C. Tucker 1992 The potential of criterion-referenced tests with projected norms. Applied Measurement in Education 5(4):337-353.

Bianchini, John C., et al. 1974 Anchor Test Study. Final Report. Volume 1, Individual Norms and School Grade Norms, Grades 4, 5, and 6. Educational Testing Service, Berkeley, CA. ERIC microfiche collection, ED092602.

1975 Investigation of the Appropriateness of the Anchor Test Study Equating Results for Selected Subgroups. Final Report. Educational Testing Service, Princeton, NJ.

Suggested Citation:"References." National Research Council. 1999. Uncommon Measures: Equivalence and Linkage Among Educational Tests. Washington, DC: The National Academies Press. doi: 10.17226/6332.
×

Bloxom, B., P.J. Pashley, W.A. Nicewander, and D. Yan 1995 Linking to a large-scale assessment: An empirical evaluation. Journal of Educational and Behavioral Statistics 20 (Spring):1-26.

Bond, L., E. Roeber, and S. Connealy 1998 Trends in State Student Assessment Programs: Fall 1997. Washington, DC: Council of Chief State School Officers.

Bond, L., and R.M. Jaeger 1993 Judged Congruence Between Various State Assessment Tests in Mathematics and the 1990 National Assessment of Educational Progress Item Pool for Grade-8 Mathematics. Center for Educational Research and Evaluation. Greensboro NC: University of North Carolina.

Breland, H.M., et al. 1994 Performance versus objective testing and gender: An exploratory study of an advanced placement history examination. Journal of Educational Measurement 31(4):275-293.

Campbell, J.R., P.L. Donahue, C.M. Reese, and G.W. Phillips 1994 NAEP 1994 Reading Report Card for the Nation and the States. Office of Educational Research and Improvement, National Center for Educational Statistics. Washington, DC: U.S. Department of Education.

Cizek, G.J. 1993 Reactions to National Academy of Education report, “Setting Performance Standards for Student Achievement." Unpublished letter written to the National Assessment Governing Board.

Cronbach, L.J. 1984 Essentials of Psychological Testing, Fourth edition. New York: Harper & Row.


Education Week 1998 Quality Counts '98: The Urban Challenge: Public Education in the 50 States. Washington, DC: Education Week.

Ercikan, K. 1997 Linking statewide tests to the NAEP: Accuracy of combining test results across states. Applied Measurement in Education 10(2):145-159.


Feldt, L.S., and R.L. Brennan 1989 Reliability. Pp. 105-146 Educational Measurement, Third edition. R.L. Linn, ed. New York: MacMillian Publishing Company.

Frechtling, J.A. 1993 Administrative Uses of School Testing Programs. Pp. 475-483 in Educational Measurement, Third edition. R.L. Linn, ed. New York: MacMillian Publishing Company.


Glaser, R. 1963 Instructional technology and the measurement of learning outcomes: Some questions. American Psychologist 18:519-521.

Gulliksen, H.O. 1950 Theory of Mental Tests. New York: Wiley. (Reprinted 1995, Hillsdale, NJ: Erlbaum & Associates.)

Suggested Citation:"References." National Research Council. 1999. Uncommon Measures: Equivalence and Linkage Among Educational Tests. Washington, DC: The National Academies Press. doi: 10.17226/6332.
×

Haertel, E.H. 1996 Test linking and comparability. In Proceedings from the California Comparability Symposium, September 1997. Los Angeles, CA: County Office of Education.

Herman, J. 1997 Large-Scale Assessment in Support of School Reform: Lessons in the Search for Alternative Measures. Center for the Study of Evaluation, National Center for Research on Evaluation . University of California, Los Angeles.

Hill, R. 1998 Using NAEP to Compare State Data—While It's Still Possible. Paper presented at the annual meeting of the National Council for Measurement in Education, San Diego, CA. Dover, NH: Advanced Systems, Inc.

Holland, P.W., and D.B. Rubin, eds. 1982 Test Equating. New York: Academic Press.


Jones, L.V. 1997 National Tests and Educational Reform: Are They Compatible? Policy Information Center, Educational Testing Service, Princeton, NJ.


Kane, M. 1993 Comments on the National Academy of Education Evaluation of the National Assessment Governing Board Levels. Unpublished letter.

Kenney, P., and E. Silver 1997 Content Analysis Project—State and NAEP Mathematics Assessment. Proposal Summary. Learning Research and Development Center, University of Pittsburgh.

Kentucky Department of Education 1995 KIRIS Accountability Cycle I Technical Manual. Frankfort: Kentucky Department of Education.

Kintsch, W. 1998 Comprehension: A Paradigm for Cognition. New York: Cambridge University Press.

Kiplinger, V.L., and R.L. Linn 1996 Raising the stakes of test administration: The impact on student performance on the National Assessment of Educational Progress. Educational Assessment 3(2):111-133.

Kolen, M.J., and R.L. Brennan 1995 Test Equating: Methods and Practices. New York: Springer-Verlag.

Koretz, D. 1998 Evidence Pertaining to the Validity of Score Gains on the Kentucky Instructional Results Information System (KIRIS). Paper presented at the symposium: Establishing Meaning: Validity Evidence for the Kentucky Instructional Results Information System (KIRIS), at the annual meeting of the National Council on Measurement in Education, April 16, San Diego, CA. RAND, Washington, DC.

Koretz, D., R.L. Linn, S. Dunbar, and L. Shepard 1991 The Effects of High-Stakes Testing on Achievement: Preliminary Findings About Generalization Across Tests. Paper presented at American Educational Research Association, April, Chicago, IL. RAND, Washington, DC.

Suggested Citation:"References." National Research Council. 1999. Uncommon Measures: Equivalence and Linkage Among Educational Tests. Washington, DC: The National Academies Press. doi: 10.17226/6332.
×

Levine, R., A. Rathbun, R. Selden, and A. Davis 1998 NAEP's Constituents: What Do They Want? Report of the NAEP Constituents' Survey and Focus Groups. Washington, DC: National Center for Education Statistics.

Linn, R L. 1993 Linking results of distinct assessments. Applied Measurement in Education 6(1):83-102.

Linn, R.L., and V.L. Kiplinger 1995 Linking statewide tests to the National Assessment of Educational Progress: Stability of Results. Applied Measurement in Education 8(2):135-156.

Linn, R.L., D.M. Koretz, E.L. Baker, and L. Burstein 1991 The Validity and Credibility of the Achievement Levels for the 1990 National Assessment of Educational Progress in Mathematics. Los Angeles, CA: Center for Research on Evaluation Statistics.

Linn, R.L., L. Shepard, and E. Hartka 1992 The relative standing of states in the 1990 trial state assessment: The influence of choice of content, statistics, and subpopulation breakdowns. In Studies for the Evaluation of the National Assessment of Educational Progress Trial State Assessment. Stanford, CA: National Academy of Education.

Lorch, R.F., and P. Van den Broek 1997 Understanding reading comprehension: Current and future contributions of cognitive science. Contemporary Educational Psychology 22:213-247.

Lord, F.M., and M.R. Novick 1968 Statistical Theories of Mental Test Scores. Reading, MA: Addison-Wesley.

Loret, P.G., A. Seder, J.C. Bianchini, and C.A. Vale 1972 A Description of the Anchor Test Study. Princeton, NJ: Educational Testing Service.

1973 The Anchor Test Study: Administration of the Study. Educational Testing Service, Princeton, NJ. Available ERIC microfiche collection, ED076672.


McDonnell, L. 1994 Policy makers' Views of Student Assessment. CSE Technical Report 378. Los Angeles, CA: National Center for Research on Evaluation Standards, and Student Testing.

1997 The Politics of State Testing: Implementing New Student Assessments. CSE Technical Report 424. Los Angeles, CA: National Center for Research on Evaluation, Standards, and Student Testing.

McLaughlin, D. 1998 Study of the Linkages of 1996 NAEP and State Mathematics Assessments in Four States. Final Report. John C. Flanagan Research Center, Education Statistics Services Institute, American Institutes for Research. American Institutes for Research, Palo Alto, CA.

McLaughlin, M.W., L.A. Shepard, and J.A. O'Day 1995 Improving Education Through Standards-Based Reform. Stanford, CA: National Academy of Education.

Mead, A.D., and F. Drasgow 1993 Equivalence of Computerized and Paper-and-Pencil Cognitive Ability Tests: A Meta-Analysis. Psychological Bulletin 114:449-458.

Suggested Citation:"References." National Research Council. 1999. Uncommon Measures: Equivalence and Linkage Among Educational Tests. Washington, DC: The National Academies Press. doi: 10.17226/6332.
×

Messick, S. 1989 Validity. Pp. 13-103 in Educational Measurement, Third edition. R.L. Linn, ed. New York: MacMillian Publishing Company.

Mislevy, R.J. 1992 Linking Educational Assessments: Concepts, Issues, Methods, and Prospects. Princeton, NJ: Educational Testing Service.

Mislevy, R.J., A.E. Beaton, B. Kaplan, and K.M. Sheehan 1992 Estimating population characteristics from sparse matrix sample of item responses. Journal of Educational Measurement 29:131-154.

Mosteller, F.C. 1995 The Tennessee study of class size in the early school grades. The Future of Children: Critical Issues For Children and Youths 5(2):113-127.

National Center for Education Statistics 1998 Linking the National Assessment of Educational Progress and the Third International Mathematics and Science Study: Eighth Grade Results. Eugene Johnson and Adriane Siegendorf, eds. NCES 98-500. Washington, DC: U.S. Department of Education.

National Council of Teachers of English 1996 Standards for the English Language Arts: A Joint Project of the National Council of Teachers of English and the International Reading Association. Urbana, IL: National Council of Teachers of English.

National Council of Teachers of Mathematics 1989 Curriculum and Evaluation Standards for School Mathematics. Reston, VA: National Council of Teachers of Mathematics.

National Research Council 1996 Evaluation of "Redesigning the National Assessment of Educational Progress." Committee on the Evaluation of National and State Assessments of Educational Progress, Board on Testing and Assessment, National Research Council. Washington, DC: National Academy Press.

1998 Preventing Reading Difficulties in Young Children. Catherine E. Snow, M. Susan Burns, and Peg Griffin, eds. Committee on Preventing Reading Difficulties in Young Children, Commission on Behavioral and Social Sciences and Education. Washington, DC: National Academy Press.

1999a Evaluation of the Voluntary National Tests: Phase 1. L.L. Wise, R.M. Hauser, K.J. Mitchell, and M.J. Feuer. Board on Testing and Assessment, National Research Council. Washington, DC: National Academy Press.

1999b Grading the Nation's Report Card: Evaluating NAEP and Transforming the Assessment of Educational Progress. J. Pellegrino, L. Jones, and K. Mitchell, eds. Committee on the Evaluation of National and State Assessments of Educational Progress, Board on Testing and Assessment. Washington, DC: National Academy Press.

1999c High-Stakes: Testing for Tracking, Promotion, and Graduation. Jay P. Heubert and Robert M. Hauser, eds. Committee on Appropriate Test Use, Board on Testing and Assessment, National Research Council. Washington, DC: National Academy Press.

Suggested Citation:"References." National Research Council. 1999. Uncommon Measures: Equivalence and Linkage Among Educational Tests. Washington, DC: The National Academies Press. doi: 10.17226/6332.
×

O'Neil, H.F., B. Sugrue, J. Abedi, E. Baker, and S. Golen 1992 Final Report of Experimental Studies on Motivation and NAEP Test Performance. Los Angeles, CA: Center for Research on Evaluation, Standards, and Student Testing.


Pashley, P.J., and G.W. Phillips 1993 Toward World-Class Standards: A Research Study Linking International and National Assessments. Center for Educational Progress. Princeton, NJ: Educational Testing Service.

Peterson, N.S., M.J. Kolen, and H.D. Hoover 1993 Scaling, norming, and equating. Pp. 221-262 in Educational Measurement , Third edition. R.L. Linn, ed. New York: MacMillian Publishing Company.

Poyla, G. 1980 On solving mathematical problems in high school. In Problem Solving in School Mathematics: 1980 Yearbook, S. Krulik, ed. Reston, VA: National Council of Teachers of Mathematics.

Pressley, M. and P. Afflerbach 1995 Verbal Protocols of Reading: The Nature of Constructively Responsive Reading. Hillsdale, NJ: Lawrence Erlbaum Associates.


Roeber, E., L. Bond, and S. Connealy 1998 Annual Survey of State Student Assessment Programs. Fall 1997. Washington, DC: Council of Chief State School Officers.


Shavelson, R.J., G.P. Baxter, and J. Pine 1992 Performance assessments: Political rhetoric and measurement reality. Educational Researcher 21(4):22-27.

Shepard, L.A., R.G. Glaser, and R. Linn 1993 Setting Performance Standards for Student Achievement: A Report of the National Academy of Education of the NAEP Trial State Assessment: An Evaluation of the 1992 Achievement Levels. Stanford, CA: National Academy of Education.

Shepard, L.A., R.J. Flexer, E.H. Hiebert, and S.F. Marion 1996 Effects of introducing classroom performance assessments on student learning. Educational Measurement Issues and Practices 15(3):7-18.

Shepard, L.A., and K.C. Dougherty 1991 Effects of High-Stakes Testing on Instruction. Paper presented at the meeting of the American Educational Research Association/National Council on Measurement in Education, Chicago, IL. University of Colorado, Boulder.

Stufflebeam, D.M., R.M. Jaeger, and M. Scriven 1991 National Assessment Governing Board's Inaugural 1990-91 Effort to Set Achievement Levels on the National Assessment of Educational Progress. Washington, DC: National Assessment Governing Board.


U.S. Congress, Office of Technology Assessment 1992 Testing in American Schools: Asking the Right Questions. OTA-SET-519, February 1992. Washington, DC: U.S. Government Printing Office.

U.S. Department of Education, National Center for Education Statistics 1997 The NAEP Guide. J. Calderone, L.M. King, and N. Harkay, eds. National Center for Education Statistics. NCES 97-990. Washington, DC: U.S. Department of Education.

Suggested Citation:"References." National Research Council. 1999. Uncommon Measures: Equivalence and Linkage Among Educational Tests. Washington, DC: The National Academies Press. doi: 10.17226/6332.
×

U.S. General Accounting Office 1993 Educational Achievement Standards: NAGB's Approach Yields Misleading Interpretations. GAO/PEMD-93-12. Washington, DC: U.S. Government Printing Office.

Virginia Department of Education 1997 The Virgina State Assessment Program: Transition From the Iowa Tests of Basic Skills and the Tests of Academic Proficiency to the Stanford 9. Virginia Department of Education.


Waltman, K.K. 1997 Using performance standards to link statewide achievement results to NAEP. Journal of Educational Measurement 34(2):101-121.

Wester, Anita 1995 The importance of the item format with respect to gender differences in test performance: A study of open-format items in the DTM Test. Scandinavian Journal of Educational Research 39(4):335-346.

Williams, V., K. Billeaud, L. Davis, D. Thissen, and E. Sanford 1995 Projecting to the NAEP Scale: Results from the North Carolina End-of-Grade Testing Program. Technical Report #34. Chapel Hill, NC: National Institute of Statistical Sciences, University of North Carolina, Chapel Hill.

Wu, G., M. Royal, and D. McLaughlin 1997 Development of a SASS 1993-94 School-Level Student Achievement Subfile: Using State Assessments and State NAEP. Feasibility Study. Education Statistics Services Institute, American Institutes for Research, Washington, DC.


Yen, W. 1996 Linking Tests for AB 265. In Proceedings from the California Comparability Symposium, September 1997. Los Angeles, CA: County Office of Education.

1998 Linking Assessment to NAEP and Providing Individual Student Scores. Paper presented to the Committee on Equivalency and Linkage of Educational Tests, March. CTB-McGraw Hill, Monterey, CA.

Yen, W., and S. Ferrara 1997 The Maryland School Performance Assessment Performance Program: Performance assessment with psychometric quality suitable for high-stakes usage. Journal of Educational and Psychological Measurement 57(1):60-84.

Suggested Citation:"References." National Research Council. 1999. Uncommon Measures: Equivalence and Linkage Among Educational Tests. Washington, DC: The National Academies Press. doi: 10.17226/6332.
×
Page 94
Suggested Citation:"References." National Research Council. 1999. Uncommon Measures: Equivalence and Linkage Among Educational Tests. Washington, DC: The National Academies Press. doi: 10.17226/6332.
×
Page 95
Suggested Citation:"References." National Research Council. 1999. Uncommon Measures: Equivalence and Linkage Among Educational Tests. Washington, DC: The National Academies Press. doi: 10.17226/6332.
×
Page 96
Suggested Citation:"References." National Research Council. 1999. Uncommon Measures: Equivalence and Linkage Among Educational Tests. Washington, DC: The National Academies Press. doi: 10.17226/6332.
×
Page 97
Suggested Citation:"References." National Research Council. 1999. Uncommon Measures: Equivalence and Linkage Among Educational Tests. Washington, DC: The National Academies Press. doi: 10.17226/6332.
×
Page 98
Suggested Citation:"References." National Research Council. 1999. Uncommon Measures: Equivalence and Linkage Among Educational Tests. Washington, DC: The National Academies Press. doi: 10.17226/6332.
×
Page 99
Suggested Citation:"References." National Research Council. 1999. Uncommon Measures: Equivalence and Linkage Among Educational Tests. Washington, DC: The National Academies Press. doi: 10.17226/6332.
×
Page 100
Next: Glossary »
Uncommon Measures: Equivalence and Linkage Among Educational Tests Get This Book
×
Buy Paperback | $40.00 Buy Ebook | $31.99
MyNAP members save 10% online.
Login or Register to save!
Download Free PDF

The issues surrounding the comparability of various tests used to assess performance in schools received broad public attention during congressional debate over the Voluntary National Tests proposed by President Clinton in his 1997 State of the Union Address. Proponents of Voluntary National Tests argue that there is no widely understood, challenging benchmark of individual student performance in 4th-grade reading and 8th-grade mathematics, thus the need for a new test. Opponents argue that a statistical linkage among tests already used by states and districts might provide the sort of comparability called for by the president's proposal.

Public Law 105-78 requested that the National Research Council study whether an equivalency scale could be developed that would allow test scores from existing commercial tests and state assessments to be compared with each other and with the National Assessment of Education Progress.

In this book, the committee reviewed research literature on the statistical and technical aspects of creating valid links between tests and how the content, use, and purposes of education testing in the United States influences the quality and meaning of those links. The book summarizes relevant prior linkage studies and presents a picture of the diversity of state testing programs. It also looks at the unique characteristics of the National Assessment of Educational Progress.

Uncommon Measures provides an answer to the question posed by Congress in Public Law 105-78, suggests criteria for evaluating the quality of linkages, and calls for further research to determine the level of precision needed to make inferences about linked tests. In arriving at its conclusions, the committee acknowledged that ultimately policymakers and educators must take responsibility for determining the degree of imprecision they are willing to tolerate in testing and linking. This book provides science-based information with which to make those decisions.

  1. ×

    Welcome to OpenBook!

    You're looking at OpenBook, NAP.edu's online reading room since 1999. Based on feedback from you, our users, we've made some improvements that make it easier than ever to read thousands of publications on our website.

    Do you want to take a quick tour of the OpenBook's features?

    No Thanks Take a Tour »
  2. ×

    Show this book's table of contents, where you can jump to any chapter by name.

    « Back Next »
  3. ×

    ...or use these buttons to go back to the previous chapter or skip to the next one.

    « Back Next »
  4. ×

    Jump up to the previous page or down to the next one. Also, you can type in a page number and press Enter to go directly to that page in the book.

    « Back Next »
  5. ×

    Switch between the Original Pages, where you can read the report as it appeared in print, and Text Pages for the web version, where you can highlight and search the text.

    « Back Next »
  6. ×

    To search the entire text of this book, type in your search term here and press Enter.

    « Back Next »
  7. ×

    Share a link to this book page on your preferred social network or via email.

    « Back Next »
  8. ×

    View our suggested citation for this chapter.

    « Back Next »
  9. ×

    Ready to take your reading offline? Click here to buy this book in print or download it as a free PDF, if available.

    « Back Next »
Stay Connected!