Questions? Call 888-624-8373

PAPERBACK
list:$21.00
Web:$18.90
add to cart

Rights & Permissions

Free PDF Access

topleft topright

Designing a Market Basket for NAEP: Summary of a Workshop (2000)
Board on Testing and Assessment (BOTA)

Page
61
bottomleft bottomright

The following HTML text is provided to enhance online readability. Many aspects of typography translate only awkwardly to HTML. Please use the page image as the authoritative form to ensure accuracy.


DESIGNING A MARKET BASKET FOR NAEP: SUMMARY OF A WORKSHOP

APPENDIX A

Workshop Agenda and Participants

AGENDA

Workshop on Market-Based Reporting

February 7-8, 2000

Monday, February 7

Open Session

10:00-10:15

Opening Remarks

Pat DeVito, Chair

10:15-12:15

Goals, Purposes, Uses, Plans, and Options for the NAEP Market Basket

Facilitators: Audrey Qualls and Douglas Herrmann

Topics:

  1. What are the primary objectives for market-basket administration, market-basket reporting, and the short form?

  2. Who are the proposed users for market-basket materials and the short form?

  3. What types of inferences are expected to be supported by the short form and market-basket results?

  4. What is the status of research and development work on the market-basket and short form?

  5. What are the Board's plans for pursuing work on the market basket/short form—with regard to the 2000 assessment and subsequent work?

Page
61

Below are the first 10 and last 10 pages of uncorrected machine-read text (when available) of this chapter, followed by the top 30 algorithmically extracted key phrases from the chapter as a whole.
Intended to provide our own search engines and external engines with highly rich, chapter-representative searchable text on the opening pages of each chapter. Because it is UNCORRECTED material, please consider the following text as a useful but insufficient proxy for the authoritative book pages.

Do not use for reproduction, copying, pasting, or reading; exclusively for search engines.

OCR for page 61
DESIGNING A MARKET BASKET FOR NAEP: SUMMARY OF A WORKSHOP APPENDIX A Workshop Agenda and Participants AGENDA Workshop on Market-Based Reporting February 7-8, 2000 Monday, February 7 Open Session 10:00-10:15 Opening Remarks Pat DeVito, Chair 10:15-12:15 Goals, Purposes, Uses, Plans, and Options for the NAEP Market Basket Facilitators: Audrey Qualls and Douglas Herrmann Topics: What are the primary objectives for market-basket administration, market-basket reporting, and the short form? Who are the proposed users for market-basket materials and the short form? What types of inferences are expected to be supported by the short form and market-basket results? What is the status of research and development work on the market-basket and short form? What are the Board's plans for pursuing work on the market basket/short form—with regard to the 2000 assessment and subsequent work?

OCR for page 62
DESIGNING A MARKET BASKET FOR NAEP: SUMMARY OF A WORKSHOP   Speakers: Roy Truby, National Assessment Governing Board Andrew Kolstad, National Center of Education Statistics Robert Mislevy, Educational Testing Service John Mazzeo, Educational Testing Service Questions and Answers 12:15-12:45 Lunch in the meeting room 12:45-2:45 The Policy Perspective Moderators/Discussion Facilitators: Linda Bryant and Lou Fabrizio Topics: What information needs might be served by market-basket reporting? Who would use the results? How would they be used? What information needs might be served by the market basket/short form? Who might use it and how? What if district-level results were available or could be generated from the short form? Who might use the results and how? What are the implications of market-basket reporting for other national, state, and local assessment programs? Speakers: Wayne Martin, Council of Chief State School Officers Marilyn McConachie, Vice Chair, Illinois State Board of Education Carrol Thomas, Superintendent of Schools, Beaumont, TX Marlene Hartzman, Office of Accountability, Montgomery County, MD

OCR for page 63
DESIGNING A MARKET BASKET FOR NAEP: SUMMARY OF A WORKSHOP Discussion and Synthesis of Ideas 2:45-3:30 The First in the World Experience with TIMSS Moderators: Melody Carswell and Maryellen Donahue Speakers: Paul Kimmelman, Superintendent, West Northfield School District 31, IL David Kroeze, Superintendent, Northbrook School District 27, IL Tuesday, February 8 Open Session 8:00-8:30 Continental breakfast 8:30-10:00 The Perspective of Users and Practitioners Moderators/Discussion Facilitators: LeAnn Gamache and Maryellen Donahue Topics: What information needs might be served by market-basket reporting and the market basket/short form? Who would use the results? How would they be used? Will the content and skill coverage be adequate? What if district-level results were available or could be generated from the short form? Who might use the results and how? What are the implications of the market basket for state and local assessment programs? What are the implications of the market basket for state and local curriculum and instructional practices?

OCR for page 64
DESIGNING A MARKET BASKET FOR NAEP: SUMMARY OF A WORKSHOP   Speakers: Ronald Costello, Assistant Superintendent, Noblesville, IN Patricia Kenney, University of Pittsburgh Joe O'Reilly, Unified School District, Mesa, AZ Scott Trimble, Office of Assessment, Kentucky Dept. of Education Discussion and Synthesis of Ideas 10:00-10:30 A Reporter's Perspective Facilitators: Douglas Herrmann and LeAnn Gamache Topics: What information needs might be served by market-basket reporting and the market basket/short form? Who would use the results? How would they be used? What information does the public want to know about student achievement? To what extent will the proposed market basket fulfill these needs? How might market-basket results be interpreted by the press and the public? What cautions and guidance should be considered? Speaker: Richard Colvin, Los Angeles Times Discussion and Synthesis of Ideas 10:30-10:45 Break 10:45-12:30 The Measurement Perspective Moderators/Discussion Facilitators: Mark Reckase and Duane Steffey Topics: What issues should be considered in trying to implement the use of market-basket forms and/or market-basket reporting?

OCR for page 65
DESIGNING A MARKET BASKET FOR NAEP: SUMMARY OF A WORKSHOP   To what extent will the current plans for the market basket (and/or short form) produce results that will fulfill the intended purposes? What types of inferences would be supported by market-basket results? Will market-basket reporting pose any threats to the validity of inferences from national and state NAEP? Specific comments regarding procedures for assembling the market basket, deriving scores, reporting performance information, and making comparisons with national/state NAEP results. Speakers: Darrell Bock, University of Chicago Don McLaughlin, American Institutes for Research David Thissen, UNC Chapel Hill Discussion and Synthesis of Ideas 12:30-1:30 Lunch in meeting room 1:30-2:00 The Milwaukee Experience with District-Level Results Facilitators: Linda Bryant and Lou Fabrizio Speaker: Paul Cieslak, Milwaukee Public Schools 2:00-2:45 Comparisons with the Consumer Price Index Facilitators: Duane Steffey Speaker: Kenneth Stewart, Bureau of Labor Statistics 2:45 Workshop Adjourns

OCR for page 66
DESIGNING A MARKET BASKET FOR NAEP: SUMMARY OF A WORKSHOP PARTICIPANTS R. Darrell Bock, University of Chicago Mary Lyn Bourque, National Assessment Governing Board Linda Bryant, Westwood Elementary School, Pittsburg Peggy Carr, National Center for Educational Statistics Paul Cieslak, Milwaukee Public Schools Richard Lee Colvin, Los Angeles Times Ronald Costello, Noblesville Schools, IN Patricia Dabbs, National Center for Educational Statistics Pasquale DeVito, Rhode Island Department of Education Maryellen Donahue, Boston Public Schools Lou Fabrizio, North Carolina Department of Public Instruction LeAnn Gamache, Littleton Public Schools, CO Arnold Goldstein, National Center for Educational Statistics Steve Gorman, National Center for Educational Statistics Marlene Hartzman, Montgomery County Public Schools Douglas Herrmann, Indiana State University Carol Johnson, National Center for Educational Statistics Patricia Kenney, University of Pittsburgh Paul L. Kimmelman, West Northfield School District, IL Kaeli Knowles, National Research Council Judith Koenig, National Research Council Andrew Kolstad, National Center for Educational Statistics David Kroeze, Northbrook School District 27, IL Wayne Martin, Council of Chief State School Officers John Mazzeo, Educational Testing Service Marilyn McConachie, Illinois State Board of Education Donald McLaughlin, American Institutes for Research Robert Mislevy, Educational Testing Service Karen Mitchell, National Research Council Joseph O'Reilly, Mesa Unified School District, AZ Audrey Quails, Iowa Testing Program Mark Reckase, Michigan State University Alex Sedlacek, National Center for Educational Statistics Larry Snowhite, MCA Enterprises, Inc. Holly Spurlock, National Center for Educational Statistics Duane Steffey, San Diego State University Ken Stewart, Bureau of Labor Statistics

OCR for page 67
DESIGNING A MARKET BASKET FOR NAEP: SUMMARY OF A WORKSHOP Alan Thiemann, Association of Test Publishers David Thissen, University of North Carolina, Chapel Hill Carrol Thomas, Beaumont Independent School District, TX C. Scott Trimble, Kentucky Department of Education Roy Truby, National Assessment Governing Board Lauress Wise, Human Resources Research Organization

Representative terms from entire chapter:

market basket