NAEP Reporting Practices Investigating District-Level and Market-Basket Reporting (2001) / Chapter Skim
Currently Skimming:
Executive Summary
Executive Summary
Pages 1-12
The Chapter Skim interface presents what we've algorithmically identified as the most significant single chunk of text within every page in the chapter.
Select key terms on the right to highlight them within pages of the chapter.
From page 1... ...
NAEP's sponsors believe that NAEP could provide useful data about educational achievement below the state level. They suggest that below state results "could provide an important source of data for informing a variety of education reform efforts at the local level" (National Assessment Governing Board, 1995b)
|
From page 2... ...
Percent correct scores, a metric NAEP's sponsors believe is widely understood, will be used to summarize performance on the collection of items. STUDY APPROACH At the request of the Department of Education, the National Research Council formed the Committee on NAEP Reporting Practices to address questions about the desirability, feasibility, and potential impact of implementing these reporting practices.
|
From page 3... ...
One workshop focused on district-level reporting, the other addressed market-basket reporting. DISTRICT-LEVEL REPORTING NAEP's sponsors believe that reporting district-level NAEP results would support local and state education reform efforts.
|
From page 4... ...
If market research suggests that there is little or no interest in district-level reporting, NAEP's sponsors should not continue to invest NAEP's limited resources pursuing district-level reporting. RECOMMENDATION: If the decision is made to proceed with district-level reporting, NAEP's sponsors should develop and implement a plan for program evaluation, similar to the research conducted during the initial years of the Trial State Assessment, that would investigate the quality and utility of district-level NAEP data.
|
From page 5... ...
NAEP's sponsors believe that percent correct scores would have immediate meaning to the public. Based on workshop participants' reactions, it is doubtful that percent correct scores would be more easily understood than the achievement-level results that NAEP currently reports.
|
From page 6... ...
Initial plans call for a fourth-grade mathematics short form, but the ultimate plan might be to develop short forms for a variety of subjects for states to use in years when NAEP assessments are not scheduled for particular subjects. The policy guiding development of the short forms stipulates that results be reported using NAEP achievement levels.
|
From page 7... ...
In considering the proposals to develop and report a summary measure from the existing NAEP frameworks, the committee realized that the purpose and construction of the CPI market basket differs fundamentally from the corresponding elements of current NAEP proposals. The task of building an educational parallel to the CPI is formidable and appears to differ conceptually from
|
From page 8... ...
RECOMMENDATION: If, given the issues raised about marketbasket reporting, NAEP's sponsors wish to pursue the development of this concept, they should consider developing an educational index that possesses characteristics analogous to those of the Consumer Price Index: (1) is descriptive rather than reflecting policy makers' and educators' aspirations; (2)
|
From page 9... ...
Given the amount of attention that below-state results would likely receive, whether derived from main NAEP or via a NAEP short form, significant attention should be devoted to product design. As part of our study, the committee hoped to be able to review prototypic reports for the proposed reporting methods.
|
From page 10... ...
IMPLICATIONS FOR NAEP AND LOCAL EDUCATIONAL SYSTEMS The two proposed reporting practices would provide new information that would receive attention from new audiences audiences that may have not previously attended to NAEP results. The use of such information by policy makers, state and local departments of education, the press, and the lay public could have a significant impact on NAEP and on state and local assessment, curriculum, and instruction.
|
From page 11... ...
We therefore recommend: RECOMMENDATION: The potential is high for significant impact on curriculum and /or assessment at the local levels. If either district-level reporting or market-basket reporting, with or without a short form, is planned for implementation, the program sponsors should develop and implement intensive support systems to assist districts anti states in appropriate uses and interpretations of any such NAEP results reported.
|
Key Terms
This material may be derived from roughly machine-read images, and so is provided only to facilitate research.
More
information on Chapter Skim is available.