National Patterns of R&D Resources Future Directions for Content and Methods: Summary of a Workshop (2013) / Chapter Skim
Currently Skimming:
4 Statistical Models and Administrative Records as Supplements to Surveys
4 Statistical Models and Administrative Records as Supplements to Surveys
Pages 49-62
The Chapter Skim interface presents what we've algorithmically identified as the most significant single chunk of text within every page in the chapter.
Select key terms on the right to highlight them within pages of the chapter.
From page 49... ...
the effects of the timeliness and quality of the census and survey inputs into National Patterns in comparison with alternative sources of such information. Relevant to the second issue is the question of whether administrative sources of information, which would generally be more timely, might have comparable quality to that currently collected on the five census and surveys used as inputs into National Patterns.
|
From page 50... ...
USING STATISTICAL MODELS TO ESTIMATE R&D FUNDS TO AND FROM NONPROFIT INSTITUTIONS Nonprofit institutions both provide and receive R&D funds to and from other organizations, including other nonprofit institutions. These funds are often captured by NCSES on its R&D censuses and surveys when the provider or the recipient is not a nonprofit institution.
|
From page 51... ...
To produce current estimates of industry funding of R&D performed by nonprofit organizations, NCSES assumes that the annual growth in funding from industry to nonprofit organizations changes in constant proportion to the annual growth in industry-to- industry funding. Since industry-to-industry funding is estimated on an annual basis, this assumption allows inferences about annual growth of funding from industry to nonprofit organizations, which has not been directly estimated since 1997.
|
From page 52... ...
. • For R&D funds provided by nonprofit institutions, BRDIS collects data on funding to industry (though it commingles those funds with government research funding)
|
From page 53... ...
, hospitals, and universities and colleges. Some nonprofit institutions are known both as funders and as recipients, including the Howard Hughes Medical Institute and the Monterey Bay Aquarium Research Institute (which is an operating unit of the David and Lucile Packard Foundation)
|
From page 54... ...
Alexander added that this rise had also changed philanthropy through the use of multiple initiatives to improve outcome evaluation, efforts to measure grantee satisfaction with the funding process, and a greater focus on innovation in programs and service delivery. At the same time, however, he said, nonprofit organizations are facing the same pressures as all institutions because of the "great recession." As a result, nonprofit organizations may face structural changes, with the growing use of program-related investments and dedicated venture philanthropic funds.
|
From page 55... ...
Furthermore, Alexander asserted, current administrative data collections are insufficient to collect consistent and comprehensive information on nonprofit R&D activities because research activities are often embedded in nonresearch programs, and classification systems do not treat R&D funds consistently. Also, nonprofit organizations have little incentive to provide details on their activities, and the data they do provide are delivered in nonmachinereadable formats; in particular, most IRS Form 990s are published online as image pdfs.
|
From page 56... ...
Fernando Galindo-Rueda suggested the possibility of collecting such information as a byproduct of the data collections carried out by the Bureau of Economic Analysis in producing the national income and product accounts. STAR METRICS AND VIVO Interest in STAR METRICS for this workshop reflects current trends of declining response rates for federal censuses and surveys and increasing
|
From page 57... ...
provided a presentation on the current status of STAR METRICS and a related program called VIVO.4 Overview King started by observing that there is a need for common data standards and open platforms to improve our understanding of how science is done. STAR METRICS establishes such data standards to support empirical studies of science impacts.
|
From page 58... ...
A possible application of VIVO is to provide topic modeling using natural language processing, with topic tags provided for each document in the database. It is planned that VIVO will provide expertise locators for review panels and funding announcements.
|
From page 59... ...
King answered between one and two dozen. STAR METRICS for Edit and Imputation Cohen's presentation considered using STAR METRICS to improve National Patterns.
|
From page 60... ...
Census and survey responses might be preferable because administrative records systems often contain errors as a result of matching problems and other data linkage errors. But STAR METRICS values might be preferred to survey and census responses since the actual documentation of the grant is used for data entry, which may reduce various sources of measurement error, such as recall error.
|
From page 61... ...
In addition to using the STAR METRICS values only as survey surrogates, in situations in which data have been collected recently for a large number of census and STAR METRICS pairs, using such paired data in addition to the analogous STAR METRICS value for the missing census response might enable one to develop a model-based imputation for missing census responses that would be preferable to using the analogous STAR METRICS value as a surrogate. Cohen added that, more broadly, even in situations in which the census response is available, again assuming that STAR METRICS data are shown to be more reliable, and further assuming that one discovered that STAR 7 For instance, the most recent Federal Committee on Statistical Methodology Research Conference, held in January 2012, included a presentation entitled "Evaluating Job Data in the Redesigned SIPP Using Administrative Records" by Martha Stinson of the Census Bureau.
|
From page 62... ...
values, one might model this relationship and then use such a model to "adjust" census responses. In this case, one is in effect estimating the census response using the combination of census and STAR METRICS responses for all institutions (possibly using not only data for the current time period, but also historical data)
|
Key Terms
This material may be derived from roughly machine-read images, and so is provided only to facilitate research.
More
information on Chapter Skim is available.