The following HTML text is provided to enhance online
readability. Many aspects of typography translate only awkwardly to HTML.
Please use the page image
as the authoritative form to ensure accuracy.
Small-Area Estimates of School-Age Children in Poverty: Evaluation of Current Methodology
APPENDIX
D
Use of School Lunch Data in New York State for the Estimation of School-Age Children in Poverty: An Analysis
James H. Wyckoff and Frank Papa
This analysis uses data from the National School Lunch Program in New York State as an alternative to census data in estimating the number of poor children (aged 5-17) for use in the allocation of Title I funds to school districts. This analysis considers two uses of poverty estimates in the Title I allocations. First, for the purpose of estimating the number of school-age children who are in poor families in 1989, we compare estimates from using school lunch data for 1990 with estimates from the Census Bureau's constant-share method that is based on 1980 census data. Second, we examine the sensitivity of various methods in estimating the 15 percent threshold for concentration grants. In conclusion, we examine some of the difficulties we encountered in attempting to use school lunch data for this purpose. Although this analysis may provide some interesting insights to some evaluation questions, it only reflects the experience in one state; other states may well differ in critical ways that would lead outcomes to change as well.
The data for this analysis cover public schools and come from the New York State Education Department Report 325 for February 1990, printed on July 10, 1992. The 325 Report is an accounting of the number of eligible applicants for free and reduced-price school lunches by school. Our data include all public school reports.1
1
Some of the state's 3,279 public schools did not send reports to the New York State Education Department: most of those 389 schools did not operate a school lunch program. Those observations are treated as zeros in the analysis.
Reports from private schools are also available but they have not been included in this analysis: 804 private schools reported 42,828 free and reduced-price school lunch applicants in February 1990. This number represents about 12 percent of all school lunch applicants.
Below are the first 10 and last 10 pages of uncorrected machine-read text (when available) of this chapter, followed by the top 30 algorithmically extracted key phrases from the chapter as a whole. Intended to provide our own search engines and external engines with highly rich, chapter-representative searchable text on the opening pages of each chapter.
Because it is UNCORRECTED material, please consider the following text as a useful but insufficient proxy for the authoritative book pages.
Do not use for reproduction, copying, pasting, or reading; exclusively for search engines.
OCR for page 226
Small-Area Estimates of School-Age Children in Poverty: Evaluation of Current Methodology
APPENDIX
D
Use of School Lunch Data in New York State for the Estimation of School-Age Children in Poverty: An Analysis
James H. Wyckoff and Frank Papa
This analysis uses data from the National School Lunch Program in New York State as an alternative to census data in estimating the number of poor children (aged 5-17) for use in the allocation of Title I funds to school districts. This analysis considers two uses of poverty estimates in the Title I allocations. First, for the purpose of estimating the number of school-age children who are in poor families in 1989, we compare estimates from using school lunch data for 1990 with estimates from the Census Bureau's constant-share method that is based on 1980 census data. Second, we examine the sensitivity of various methods in estimating the 15 percent threshold for concentration grants. In conclusion, we examine some of the difficulties we encountered in attempting to use school lunch data for this purpose. Although this analysis may provide some interesting insights to some evaluation questions, it only reflects the experience in one state; other states may well differ in critical ways that would lead outcomes to change as well.
The data for this analysis cover public schools and come from the New York State Education Department Report 325 for February 1990, printed on July 10, 1992. The 325 Report is an accounting of the number of eligible applicants for free and reduced-price school lunches by school. Our data include all public school reports.1
1
Some of the state's 3,279 public schools did not send reports to the New York State Education Department: most of those 389 schools did not operate a school lunch program. Those observations are treated as zeros in the analysis.
Reports from private schools are also available but they have not been included in this analysis: 804 private schools reported 42,828 free and reduced-price school lunch applicants in February 1990. This number represents about 12 percent of all school lunch applicants.
OCR for page 227
Small-Area Estimates of School-Age Children in Poverty: Evaluation of Current Methodology
ESTIMATES OF POOR CHILDREN
The school lunch method for estimating the number of poor children in each school district is conceptually similar to the census constant-share method. County totals of poor children are allocated to specific school districts on the basis of an estimate of the ratio of poor children in the district to the county total. The school lunch ratio is computed by the ratio of free (or free and reduced-price) school lunch applicants in a school district to those in the county. This ratio is then multiplied by the total number of poor school-age children in the county (from the 1990 census) to arrive at the school district estimate. When districts cross county boundaries, the district is assigned to the county in which the school district administrative office is located.2 In summary:
where:
Ỹj′ is the school lunch estimate of poor school-age children in school district j,
is the number of school lunch applicants in county i, school district j in 1990,
is the number of school lunch applicants in county i in 1990, and
is the 1990 census estimate of poor school-age children in county i.
The evaluation below compares these estimates of poor school-age children to those estimated using the census constant-share method, which applies the 1980 census shares of poor school-age children for school districts (or parts of school districts) within counties to the 1990 census county estimates of poor school-age children (synthetic method (2) in Chapter 7). Mean algebraic and absolute percentage errors are estimated for each method by using the 1990 census totals for school districts as “truth.” Table D-1, Table D-2 and Table D-3 summarize these results.
Table D-1 illustrates the distribution of the algebraic percentage errors, unweighted and when each district is weighted by the number of school-age children from families in poverty. Each of the methods results in estimates with some very large errors. For example, consider the weighted results. All three methods have at least 15 percent of the districts with errors of at least 40 percent. This pattern is also illustrated in Table D-2, which shows unweighted estimates broken down by various school district characteristics. Regardless of method, the errors are very large on average and in most categories.
2
We also computed estimates by employing school-level data to form county pieces when schools of a district are located in more than one county. Roughly 35 percent of the districts cross county boundaries. This estimation method produces estimates that are very close to the method that does not account for the county pieces. As a result, we present only the results that assign a whole district to the county of the district's administrative office.
OCR for page 228
Small-Area Estimates of School-Age Children in Poverty: Evaluation of Current Methodology
TABLE D-1 Distribution of Algebraic Percentage Errors for Children Aged 5-17 in Families in Poverty, Various Models, Unweighted and Weighted, New York State School Districts in Evaluation Universe, 1990 (N = 623), in percent
Distribution of Algebraic Percentage Errors
Census Constant 1980 Share
Free Lunch
Free and Reduced-Price Lunch
Unweighted
Mean
31.2
7.1
14.0
Less than −40.0%
10.3
20.4
17.7
−40.0 to −20.0%
11.4
12.4
12.8
−19.9 to −10.0%
10.6
9.5
9.1
−9.9 to −0.1%
9.0
9.5
10.1
0.0 to 9.9%
10.6
12.0
9.8
10.0 to 19.9%
7.7
6.6
7.5
20.0 to 39.9%
11.9
11.9
10.3
40.0% and more
28.6
17.8
22.6
Weighted by Related Children Age 5-17 in Poverty, 1990 Census
Mean
0.8
1.6
1.3
Less than −40.0%
5.0
8.1
6.8
−40.0 to −20.0%
16.0
11.0
13.7
−19.9 to −10.0%
17.0
10.0
12.1
−9.9 to −0.1%
28.6
10.8
29.8
0.0 to 9.9%
7.2
33.8
11.8
10.0 to 19.9%
8.1
8.1
5.0
20.0 to 39.9%
8.1
7.9
8.9
40% and more
10.1
10.3
11.9
NOTES: The census constant 1980 share estimates are calculated as described in Chapter 7 (within-county shares method (2)). The school lunch estimates are formed by multiplying the 1990 census estimates of related children aged 5-17 in families in poverty for the county by the school district 's share of the county's free (free and reduced-price) lunch participants. The mean unweighted algebraic percentage error is the sum over all school districts of the algebraic difference between the estimate of poor school-age children from a model and the 1990 census estimate as a proportion of the census estimate for each district, divided by the number of districts. The weighted mean weights each difference by the census number of poor school-age children in the district.
OCR for page 229
Small-Area Estimates of School-Age Children in Poverty: Evaluation of Current Methodology
Weighting by the number of poor school-age children in 1990 substantially reduces the percentage errors across all methods, as shown in Table D-3. This approach yields results that are quite similar across all three models. Mean algebraic percentage errors are relatively small; however, as one would expect, mean absolute percentage errors are much larger. Most of the patterns of errors with respect to school district attributes are as would be expected. For example, school districts with small total population have larger errors than districts with larger populations.
An important result of this analysis is that even after some effort in data preparation, the school lunch method is still not meaningfully better than the census constant-share method. At least in New York State it does not appear that using school lunch data results in significant gains in estimating school-age children from poor families.
ESTIMATES OF THE CONCENTRATION GRANT THRESHOLD
Eligibility for Title I concentration grants is based on having a school-age poverty rate of at least 15 percent or at least 6,500 poor children.3 Current Title I allocations employ a two-stage eligibility criterion. A district must be in a county that meets the 15 percent (or 6,500) rule, and the district itself must meet that criterion. Under the proposed direct allocation system, grants will be made directly to districts and, as such, eligibility will be determined solely with regard to district poverty rates, without regard to county poverty rates. The proposed direct allocation method also permits states to aggregate the allocations to districts that have total population of less than 20,000 and reallocate this total based on alternative data, such as those from the National School Lunch Program. It is of interest to examine eligibility for concentration grants in those districts with less than 20,000 population under three different scenarios: the current two-stage process, the direct allocation process to districts without controls, and direct allocations when school district poverty estimates must sum to the census county totals. We examine how concentration grants eligibility differs under these circumstances when school lunch data are used rather than census constant-share estimates, using 1990 census ratio-adjusted counts as the measure of truth.
3
Children eligible for Title I are not limited to school-age children from poor families (see Chapter 2). However, for the purpose of this analysis, which is to examine the census constant-share estimates of school-age children from poor families, eligibility is so characterized.
OCR for page 230
Small-Area Estimates of School-Age Children in Poverty: Evaluation of Current Methodology
TABLE D-2 Mean Absolute and Algebraic Percentage Errors for Children Aged 5-17 in Families in Poverty, Various Methods, New York State School Districts in Evaluation Universe, 1990, Unweighted, in percent
Census Constant 1980 Share
Free Lunch
Free and Reduced-Price Lunch
Category
Percent of Districts (N = 623)
Mean Absolute % Error
Mean Algebraic % Error
Mean Absolute % Error
Mean Algebraic % Error
Mean Absolute % Error
Mean Algebraic % Error
Total
100.0
53.4
31.2
48.7
7.1
52.1
14.0
1990 School District Population
Under 2,500
11.9
66.3
34.0
57.4
4.6
59.8
10.1
2,500-4,999
14.3
41.2
15.8
40.1
−0.4
41.9
4.2
5,000-7,499
17.5
57.7
32.6
65.8
30.4
71.2
38.8
7,500-9,999
10.8
58.7
28.3
47.2
−12.1
45.7
−10.1
10,000-14,999
12.5
61.3
45.1
53.2
22.1
60.4
31.3
15,000-19,999
9.5
43.5
29.8
39.3
−6.3
43.1
1.3
20,000-29,999
10.8
67.2
55.8
47.3
14.1
54.3
27.8
30,000-39,999
5.3
36.5
11.6
37.2
−9.0
38.3
−3.3
40,000-49,999
2.9
42.6
25.1
36.7
−14.4
36.9
−8.0
50,000-99,999
3.9
24.9
10.7
24.2
−7.0
26.5
−2.9
100,000 or more
0.8
12.0
−12.0
5.1
5.1
4.7
−0.9
1980-1990 Population Growth
Decrease of 10.0% or more
3.9
45.5
30.6
23.4
−0.9
31.8
10.0
Decrease of 5.0-9.9%
12.0
54.7
34.9
63.0
7.0
67.5
11.0
Decrease of 0.1-4.9%
24.4
48.1
27.1
39.3
−10.3
40.4
−4.9
Increase of 0.0-4.9%
21.8
50.6
28.1
47.9
20.4
51.2
27.7
Increase of 5.0-9.9%
15.9
58.2
35.8
43.0
12.0
47.2
20.1
Increase of 10.0% or more
22.0
59.4
33.4
60.6
11.3
64.6
19.4
Percentage Poor School-Age Children, 1990
0.0%
2.3
0.0
0.0
0.0
0.0
0.0
0.0
0.1%-5.9%
34.2
97.7
83.6
81.4
22.2
90.2
37.6
6.0-8.9%
16.1
42.1
20.1
41.9
2.7
44.8
8.9
9.0-12.4%
17.0
33.1
8.7
41.0
6.8
41.7
10.6
12.5-16.4%
15.1
26.4
3.0
22.6
−2.0
22.0
0.8
16.5-23.9%
11.9
23.6
−15.6
24.3
−10.4
23.4
−12.3
24.0% or more
3.5
24.6
−20.6
24.2
−16.3
24.5
−21.4
OCR for page 231
Small-Area Estimates of School-Age Children in Poverty: Evaluation of Current Methodology
This page in the original is blank.
OCR for page 232
Small-Area Estimates of School-Age Children in Poverty: Evaluation of Current Methodology
Census Constant 1980 Share
Free Lunch
Free and Reduced-Price Lunch
Category
Percent of Districts (N = 623)
Mean Absolute % Error
Mean Algebraic % Error
Mean Absolute % Error
Mean Algebraic % Error
Mean Absolute % Error
Mean Algebraic % Error
Change in Poverty Rates for Children, 1980-1990
Decrease of 10.0% or more
4.5
132.1
129.3
101.8
48.1
103.3
51.8
Decrease of 5.0-9.9%
11.9
95.9
93.4
64.5
47.5
73.4
57.2
Decrease of 0.1-4.9%
46.1
55.8
50.2
53.4
11.5
57.0
20.5
Increase of 0.0-4.9%
29.2
23.9
−18.7
33.8
−13.5
34.5
−8.6
Increase of 5.0-9.9%
7.1
37.6
−37.1
26.4
−23.1
26.1
−21.5
Increase of 10.0% or more
1.3
59.1
−59.1
44.2
−36.2
43.9
−42.0
Percent of Population Black, 1990
0.0-0.9%
15.1
29.9
9.9
33.3
5.3
34.8
9.8
1.0-4.9%
36.9
48.6
23.9
46.7
17.2
50.0
22.0
5.0-9.9%
34.7
64.5
42.0
54.0
0.2
57.5
8.2
10.0-24.9%
13.3
64.5
47.1
57.8
0.9
64.2
11.7
Percent of Population Hispanic, 1990
0.0-0.9%
22.6
38.4
16.0
41.3
13.8
45.3
19.2
1.0-4.9%
49.3
48.8
28.4
40.8
9.9
44.1
18.4
5.0-9.9%
28.1
73.7
48.3
68.5
−3.2
71.5
2.0
NOTES: The census constant 1980 share estimates are calculated as described in Chapter 7 (within-county shares method (2)). The school lunch estimates are formed by multiplying the 1990 census estimates of related children aged 5-17 in families in poverty for the county by the school district 's share of the county's free (free and reduced-price) lunch participants. The mean unweighted absolute (algebraic) percentage error is the sum over all school districts of the absolute (algebraic or signed) difference between the estimate of poor school-age children from a model and the 1990 census estimate as a proportion of the census estimate for each district, divided by the number of districts.
Of the 623 districts in New York State that are in the census evaluation universe, 476 are in districts that had less than 20,000 total population in 1990. As shown in Table D-4, these 476 districts represent 76 percent of all districts in the evaluation universe for New York, but they contain only 35 percent of the poor children aged 5-17 in the census evaluation universe.
Table D-5, Table D-6, Table D-7 and Table D-8 examine estimates of the number of districts and percentage of school-age children who are in poor families under alternative estimation methods in 1990. The census counts are the ratio-adjusted estimates of school-age children who are in poor families from the 1990 census. Census-based
OCR for page 233
Small-Area Estimates of School-Age Children in Poverty: Evaluation of Current Methodology
estimates (within-county shares method (2) estimates) use the 1990 census counts of county school-age children who are in poor families and allocate these totals to school districts by the school district 's share of county totals from the 1980 census. The model-based estimates (within-county shares method (1) estimates) use a similar approach, but with the county estimates of school-age children who are in poor families in 1989 produced from the Census Bureau's county model. The school lunch estimates are produced, as outlined above, by using 1990 county ratio-adjusted estimates of school-age children who are in poor families from the 1990 census and allocating them to constituent school districts by the share of
OCR for page 234
Small-Area Estimates of School-Age Children in Poverty: Evaluation of Current Methodology
TABLE D-3 Mean Absolute and Algebraic Percentage Errors for Children Aged 5-17 in Families in Poverty, Various Methods, New York State School Districts in Evaluation Universe, 1990, Weighted by Children Aged 5-17 in Poverty, 1990 Census, in percent
Census Constant 1980 Share
Free Lunch
Free and Reduced-Price Lunch
Category
Percent of Districts (N = 623)
Mean Absolute % Error
Mean Algebraic % Error
Mean Absolute % Error
Mean Algebraic % Error
Mean Absolute % Error
Mean Algebraic % Error
Total
100.0
23.9
0.8
22.3
1.6
24.2
1.3
1990 School District Population
Under 2,500
11.9
43.4
13.8
38.5
−7.4
39.2
−4.5
2,500-4,999
14.3
30.4
4.2
31.6
−11.2
31.8
−7.3
5,000-7,499
17.5
31.6
−0.1
34.2
1.3
34.9
3.9
7,500-9,999
10.8
32.5
−4.4
32.6
−4.6
30.0
−4.5
10,000-14,999
12.5
34.8
13.2
32.0
6.8
35.6
10.9
15,000-19,999
9.5
21.6
4.0
24.9
0.9
28.7
5.3
20,000-29,999
10.8
37.8
21.4
36.3
13.8
39.7
21.1
30,000-39,999
5.3
31.5
−2.0
27.9
3.1
28.1
3.4
40,000-49,999
2.9
33.6
9.4
34.0
−6.8
35.6
−6.3
50,000-99,999
3.9
18.3
−0.4
21.0
−1.5
24.0
−3.2
100,000 or more
0.8
10.4
−10.4
3.4
3.4
5.3
−3.0
1980-1990 Population Growth
Decrease of 10.0% or more
3.9
31.2
26.2
9.8
2.2
24.2
7.7
Decrease of 5.0-9.9%
12.0
13.7
−4.2
10.2
−3.8
17.0
9.8
Decrease of 0.1-4.9%
24.4
20.8
−3.7
17.2
1.9
17.1
1.1
Increase of 0.0-4.9%
21.8
31.1
9.9
32.5
8.6
33.1
11.5
Increase of 5.0-9.9%
15.9
30.1
2.2
29.9
0.3
30.6
3.3
Increase of 10.0% or more
22.0
32.4
2.9
39.0
2.0
38.0
4.6
Percentage of Poor School-Age Children, 1990
0.0%
2.3
0.0
0.0
0.0
0.0
0.0
0.0
0.1-5.9%
34.2
53.4
40.3
47.1
−5.3
52.1
8.7
6.0-8.9%
16.1
34.0
9.6
34.3
2.8
36.7
8.6
9.0-12.4%
17.0
22.2
4.5
36.3
19.5
38.5
23.5
12.5-16.4%
15.1
22.7
−2.1
19.6
−1.6
20.0
−2.3
16.5-23.9%
11.9
19.0
−14.8
18.2
1.4
16.2
−3.3
24.0% or more
3.5
11.3
−10.1
5.4
−0.6
9.1
−7.8
OCR for page 235
Small-Area Estimates of School-Age Children in Poverty: Evaluation of Current Methodology
This page in the original is blank.
OCR for page 236
Small-Area Estimates of School-Age Children in Poverty: Evaluation of Current Methodology
Census Constant 1980 Share
Free Lunch
Free and Reduced-Price Lunch
Category
Percent of Districts (N = 623)
Mean Absolute % Error
Mean Algebraic % Error
Mean Absolute % Error
Mean Algebraic % Error
Mean Absolute % Error
Mean Algebraic % Error
Change in Poverty Rates for Children, 1980-1990
Decrease of 10.0% or more
4.5
79.3
75.3
64.9
19.5
68.2
23.5
Decrease of 5.0-9.9%
11.9
47.0
38.1
41.4
31.7
43.1
32.4
Decrease of 0.1-4.9%
46.1
32.1
23.1
36.0
7.1
37.9
12.0
Increase of 0.0-4.9%
29.2
19.0
−15.0
20.9
−4.8
21.1
−3.6
Increase of 5.0-9.9%
7.1
16.9
−15.7
8.5
−5.2
12.0
−10.5
Increase of 10.0% or more
1.3
10.6
−10.6
5.5
−1.2
7.8
−7.7
Percent of Population Black, 1990
0.0-0.9%
15.1
21.4
−0.5
22.4
−2.6
23.8
−0.9
1.0-4.9%
36.9
24.4
0.5
23.6
0.5
24.6
0.0
5.0-9.9%
34.7
30.1
2.4
32.0
4.6
32.1
4.1
10.0-24.9%
13.3
16.9
−0.6
9.8
0.0
14.5
−0.3
Percent of Population Hispanic, 1990
0.0-0.9%
22.6
22.7
0.7
23.5
0.0
25.5
0.7
1.0-4.9%
49.3
20.1
−0.5
15.0
0.5
18.1
0.0
5.0-9.9%
28.1
34.8
4.1
40.8
5.4
39.3
5.2
NOTE: See notes to Table D-2.
that school district's free (or free and reduced-price) school lunch eligibles relative to the county total.
Table D-5 and Table D-6 provide estimates for the two-tier concentration grant eligibility for districts with total population (from the 1990 census) of less than 20,000. That is, districts must be in counties where at least 15 percent (or 6,500) of the school-age children are poor and in a district that also meets this criterion.4 If we take the census counts as our measure of “truth,” then employing school
4
In Table D-5 and Table D-6, county eligibility is determined by the county counts from the 1990 census. Within each of these eligible counties, the alternative methods listed are used to determine school district eligibility.
OCR for page 237
Small-Area Estimates of School-Age Children in Poverty: Evaluation of Current Methodology
lunch data will likely overstate eligibility. As shown in Table D-5, roughly 50 percent more districts and school-age children are estimated to be eligible with free school lunch data than with the census counts. This problem is further magnified when the free and reduced-price lunch counts are employed. Table D-6 illustrates where each method errs relative to the eligibility categorization of the census counts: as might be expected, the school lunch estimates produce a substantial number of false positives.
Table D-7 and Table D-8 provide a similar analysis for direct allocations. Now districts must only meet the single criterion that the district has at least 15 percent of its school-age children who are poor (or at least a total of 6,500). These estimates also show the effect of imposing county controls on the use of school
OCR for page 238
Small-Area Estimates of School-Age Children in Poverty: Evaluation of Current Methodology
TABLE D-4 New York State Districts in Evaluation Universe Above and Below the 20,000 Population Threshold for Pooling Allocations (N = 623)
Districts
Poor Children Aged 5-17
Category
Number
Percent
Number
Percent
School District Total Population
Less than 20,000
476
76.4
61,236
35.0
At least 20,000
147
23.6
113,556
65.0
TABLE D-5 Concentration Grant Eligibility at County and School District Level, Various Methods for New York State Districts in Evaluation Universe with Less than 20,000 Population, 1990 (N = 476)
Districts
Poor Children Aged 5-17
Method
Number
Percent
Number
Percent
Census Counts
76
16.0
16,689
27.3
Census-based Estimates
78
16.4
14,162
23.1
Model-based Estimates
76
16.0
14,134
23.1
Free Luncha
112
23.5
21,662
35.4
Free and Reduced-price Luncha
136
28.6
24,515
40.0
NOTES: Cell entries are for school districts and poor school-age children that would be eligible for concentration grants according to various methods (see text) under the current two-stage allocation process (i.e., both county and school district have more than 6,500 or more than 15% poor school-age children). The total number of poor school-age children in districts with less than 20,000 population is 61,236.
aSome school districts (54 or 11.3%) did not report school lunch data.
lunch estimates. (The county controls are equivalent to the estimates produced by equation 1, above.) The school lunch estimates without controls greatly overstate concentration grant eligibility. Imposing county controls substantially improves the accuracy of these estimates.
Table D-9 shows mean algebraic and absolute percentage errors for the various estimation methods. Here the school lunch estimates have either been
OCR for page 239
Small-Area Estimates of School-Age Children in Poverty: Evaluation of Current Methodology
TABLE D-6 Concentration Grant Eligibility at County and School District Level, Census Counts Compared to Various Other Methods for New York State Districts in Evaluation Universe with Less than 20,000 Population, 1990 (N = 476)
Census Not Eligible
Census Eligible
Estimate Not Eligible
Estimate Eligible
Estimate Not Eligible
Estimate Eligible
Method
% Districts
% Poor Children Aged 5-17
% Districts
% Poor Children Aged 5-17
% Districts
% Poor Children Aged 5-17
% Districts
% Poor Children Aged 5-17
Census-based Estimates
78.6
68.0
5.5
4.8
5.0
8.9
10.9
18.4
Model-based Estimates
78.8
68.1
5.3
4.6
5.3
8.8
10.7
18.4
Free Luncha
75.4
63.6
8.6
9.2
1.1
1.0
14.9
26.2
Free and Reduced-price Luncha
71.2
59.8
12.8
13.0
0.2
0.2
15.8
27.1
NOTE: See notes to Table D-5.
aSome school districts (54 or 11.3%) did not report school lunch data.
OCR for page 240
Small-Area Estimates of School-Age Children in Poverty: Evaluation of Current Methodology
TABLE D-7 Concentration Grant Eligibility at School District Level, Various Methods for New York State Districts in Evaluation Universe with Less than 20,000 Population, 1990 (N = 476)
Districts
Poor Children Aged 5-17
Method
Number
Percent
Number
Percent
Census Counts
115
24.2
25,343
41.4
Census-based Estimates
114
24.0
19,596
32.0
Model-based Estimates
109
22.9
18,285
29.9
Free Luncha
214
45.0
39,222
64.1
Free and Reduced-price Luncha
294
61.8
48,835
79.8
Free Lunch with Controlsa ,b
124
26.1
25,024
40.9
Free and Reduced-price Lunch with Controlsa ,b
127
26.7
24,045
39.3
NOTES: Cell entries are for school districts and poor school-age children that would be eligible for concentration grants according to various methods (see text) under a direct allocation process (i.e., the school district has more than 6,500 or more than 15% poor school-age children). The total number of poor school-age children in districts with less than 20,000 population is 61,236.
aSome school districts (54 or 11.3%) did not report school lunch data.
bControls are imposed at the county level so that number of poor children and number of children in the school district must sum to county census counts for 1990.
controlled to the statewide total of school-age children living in poor families for the 476 districts with populations of less than 20,000 or to a similar county total. With these controls in place, each of the methods has roughly the same algebraic and absolute percentage errors. This result is interesting as the school lunch estimates with county controls had the potential to be either better or worse than the estimates with state controls. We would in general expect them to be better as there is a tighter level of control imposed. It is possible that they are worse as a result of lack of precision that occurs when school districts cross county boundaries and school lunch data are coded to the county where the district office is located.
PROBLEMS WITH THIS APPROACH
Using school lunch data to estimate the number of poor children for each school district has several potential problems, based on the experience in New York State. As has been widely acknowledged:
OCR for page 241
Small-Area Estimates of School-Age Children in Poverty: Evaluation of Current Methodology
TABLE D-8 Concentration Grant Eligibility at School District Level, Census Counts Compared to Various Other Methods for New York State Districts in Evaluation Universe with Less than 20,000 Population, 1990 (N = 476)
Census Not Eligible
Census Eligible
Estimate Not Eligible
Estimate Eligible
Estimate Not Eligible
Estimate Eligible
Method
% Districts
% Poor Children Aged 5-17
% Districts
% Poor Children Aged 5-17
% Districts
% Poor Children Aged 5-17
% Districts
% Poor Children Aged 5-17
Census-based Estimates
65.3
49.5
10.5
9.1
10.7
18.5
13.5
22.9
Model-based Estimates
66.6
52.1
9.2
6.5
10.5
18.1
13.7
23.3
Free Luncha
52.5
34.0
23.3
24.7
2.5
2.0
21.6
39.4
Free and Reduced-price Luncha
37.0
19.7
38.9
38.9
1.3
0.6
22.9
40.8
Free Lunch with Controlsa ,b
66.8
50.0
9.0
8.7
7.1
9.2
17.0
32.2
Free and Reduced-price Lunch with Controlsa ,b
65.6
49.8
10.3
8.9
7.8
11.0
16.4
30.4
NOTE: See notes to Table D-7.
aSome school districts (54 or 11.3%) did not report school lunch data.
bControls are imposed at the county level so that number of poor children and number of children in the school district must sum to county census counts for 1990.
OCR for page 242
Small-Area Estimates of School-Age Children in Poverty: Evaluation of Current Methodology
TABLE D-9 Mean Absolute and Algebraic Percentage Errors for Children Aged 5-17 in Families in Poverty, Various Methods, Unweighted and Weighted, New York State School Districts in Evaluation Universe with Less than 20,000 Population, 1990 (N = 476)
Unweighted
Weighted by Poor School-Age Children
Method
Mean Absolute % Error
Mean Algebraic % Error
Mean Absolute % Error
Mean Algebraic % Error
Census-based Estimates
54.9
30.8
30.6
4.3
Model-based Estimates
54.3
27.2
31.5
0.1
Free Luncha
52.9
9.8
32.3
−0.1
Free and Reduced-price Luncha
55.1
13.4
32.6
−0.1
Free Lunch with Controlsb
54.6
12.6
31.7
−0.1
Free and Reduced-price Lunch with Controlsb
55.7
13.3
31.7
−0.1
NOTES: See text for the calculation of poor school-age children by each method. The mean unweighted algebraic percentage error is the sum over all school districts of the algebraic difference between the estimate of poor school-age children from a model and the 1990 census estimate as a proportion of the census estimate for each district, divided by the number of districts. The weighted mean weights each difference by the census number of poor school-age children in the district.
aControls are imposed at the state level so that the number of poor children and number of children in the school district must sum to the state census count for 1990 for districts with less than 20,000 population.
bControls are imposed at the county level so that number of poor children and number of children in the school district must sum to county census counts for 1990 for districts with less than 20,000 population.
OCR for page 243
Small-Area Estimates of School-Age Children in Poverty: Evaluation of Current Methodology
Participants in the National School Lunch Program are not the target population of Title I:
— There are differences in eligibility between Title I and school lunch.
— There are differences in reporting geography: Title I counts residents, school lunch counts by location of the school the child attends.
Not all eligible students apply for the school lunch program, and application rates appear to be uneven across schools.
Some schools choose not to participate in the school lunch program.
Other difficulties include:
New York State has a number of regional (groups of counties) educational authorities with students, and they participate in the school lunch program; how to allocate these students is an issue.
In New York State, the school lunch program is administered separately from most other programs, which can make use of the administrative data difficult (e.g., schools sometimes have separate identification numbers, which makes matching to other data very time consuming).
Items in cart [0]
