Since its inception in 1977 from an amalgam of federal authorities, the U.S. Department of Energy (DOE) has administered numerous programs aimed at developing applied energy technologies. In recent years, federal oversight of public expenditures has emphasized the integration of performance and budgeting. Notably, the Government Performance and Results Act (GPRA) was passed in 1993 in response to questions about the value and effectiveness of federal programs. GPRA and other mandates have led agencies to develop indicators of program performance and program outcomes. The development of indicators has been watched with keen interest by Congress, which has requested of the National Research Council (NRC) a series of reports using quantitative indicators to evaluate the effectiveness of applied energy research and development (R&D).
The first such report took a retrospective view of the first 3 years of DOE R&D programs on fossil energy and energy efficiency. The report found that DOE-sponsored research had netted large commercial successes, such as advanced refrigerator compressors, electronic lighting ballasts, and emission control technology for flue gas desulfurization. However, some programs were judged to be costly failures in which large R&D expenditures did not result in a commercial energy technology. A follow-up NRC committee was assigned the task of adapting the methodology to the assessment of the future payoff of continuing programs.
Evaluating the outcome of R&D expenditures requires an analysis of program costs and benefits. Doing so is not a trivial matter. First, the analysis of costs and benefits must reflect the full range of public benefits that are envisioned, accounting for environmental and energy security impacts as well as economic effects. Second, the analysis must consider how likely the research is to succeed and how valuable the research will be if successful. Finally, the analysis must consider what might happen if the government did not support the project: Would some non-DOE entity undertake it or an equivalent activity that would produce some or all of the benefits of government involvement?
This second report continues to investigate the development and use of R&D outcome indicators and applies the benefits evaluation methodology to six DOE R&D activities. It provides further definition for the development of indicators for environmental and security benefits and refines the evaluation process based on its experience with the six DOE R&D case studies.
Table of Contents
|2 Results of Applying the Methodology||14-39|
|3 Methodology for Prospective Evaluation of Deparment of Energy Programs||40-51|
|4 Expert Panel Process||52-59|
|5 Conclusions and Recommendations||60-63|
|Appendix A PART Assessment Questions||67-70|
|Appendix B Committee Biographies||71-74|
|Appendix C Statement of Task||75-76|
|Appendix D Letter Report||77-91|
|Appendix E Committee and Panel Activities||92-94|
|Appendix F Guidance on Prospective Benefits Evaluation||95-106|
|Appendix G Information to Be Requested of the Department of Energy||107-110|
|Appendix H Report of the Panel on DOE's Integrated Gasification Combined Cycle Technology R&D Program||111-131|
|Appendix I Report of the Panel on DOE's Carbon Sequestration Program||132-151|
|Appendix J Report of the Panel on DOE's Natural Gas Exploration and Production R&D Program||152-170|
|Appendix K Report of the Panel on DOE's Distributed Energy Resources Program||171-186|
|Appendix L Report of the Panel on DOE's Light-Duty Vehicle Hybrid Technology R&D Program||187-207|
|Appendix M Report of the Panel on DOE's Chemical Industrial Technologies Program||208-219|
The National Academies Press (NAP) has partnered with Copyright Clearance Center's Rightslink service to offer you a variety of options for reusing NAP content. Through Rightslink, you may request permission to reprint NAP content in another publication, course pack, secure website, or other media. Rightslink allows you to instantly obtain permission, pay related fees, and print a license directly from the NAP website. The complete terms and conditions of your reuse license can be found in the license agreement that will be made available to you during the online order process. To request permission through Rightslink you are required to create an account by filling out a simple online form. The following list describes license reuses offered by the National Academies Press (NAP) through Rightslink:
Click here to obtain permission for the above reuses. If you have questions or comments concerning the Rightslink service, please contact:
Rightslink Customer Care
Tel (toll free): 877/622-5543
To request permission to distribute a PDF, please contact our Customer Service Department at 800-624-6242 for pricing.
To request permission to translate a book published by the National Academies Press or its imprint, the Joseph Henry Press, please click here to view more information.