National Academies Press: OpenBook

The National Energy Modeling System (1992)

Chapter: Appendix A-1: Scope of Work

« Previous: 4. Implementaion of NEMS
Suggested Citation:"Appendix A-1: Scope of Work." National Research Council. 1992. The National Energy Modeling System. Washington, DC: The National Academies Press. doi: 10.17226/1997.
×

APPENDIX A-1
SCOPE OF WORK

A Review of the Department of Energy's National Energy Modeling System (NEMS) by the National Research Council (NRC)

The Department of Energy (DOE) uses a variety of energy and economic models to forecast energy supply and demand. It also uses a variety of more narrowly focussed analytical tools to examine energy policy options. For the purpose of this scope of work, this set of models and analytical tools is called the National Energy Modeling System (NEMS).

THE PROBLEM.

The NEMS is the result of many years of development of energy modeling and analysis tools, many of which were developed for different applications and under different assumptions. As such, NEMS is believed to be less than satisfactory in certain areas. For example, NEMS is difficult to keep updated and expensive to use. Various outputs are often difficult to reconcile. Products were not required to interface, but were designed to stand alone. Because different developers were involved, the inner workings of the NEMS are often not easily or fully understood.

Even with these difficulties, however, NEMS comprises the best tools currently identified to deal with our global, national and regional energy modeling and energy analysis needs.

Suggested Citation:"Appendix A-1: Scope of Work." National Research Council. 1992. The National Energy Modeling System. Washington, DC: The National Academies Press. doi: 10.17226/1997.
×

ANALYSIS OF THE PROBLEM

With the goal of evaluating and improving the NEMS, the National Academy of Sciences, National Research Council is requested to review NEMS and advise DOE in the following areas regarding energy modeling and policy analysis tools:

Energy Data: Are the quality and types of data that are currently gathered and available to DOE adequate for NEMS? If not, what additional data should be gathered? If some critical data are not obtainable, what alternatives are available?

Modeling Assumptions: Are the assumptions embodied in models internally consistent and valid? Is it possible to reduce the number of assumptions currently built into the models and the scenario runs?

Energy and Economic Models: What is the availability of other models or data, not currently being utilized in NEMS, that might be useful in improving the NEMS? Are there any gaps in the NEMS in terms of supply/demand feedbacks, consideration of international factors, weaknesses in analyzing certain policy options or other shortcomings?

Role of NEMS in Energy Policymaking: In general, what are both the capabilities and practical limitations of energy forecasting tools? Taking such limitations into account, what are the appropriate uses of forecasting tools in developing the National Energy Strategy (NES)? What other alternatives are available for developing long-range energy policy? How might they be incorporated into future NEMS/NES development?

PROPOSED EFFORT

A 21-month study by NRC is proposed for accomplishing a review of the NEMS modeling and analysis needs, to be conducted in two parts:

First Part of Review

The first part of the review will be completed six months from contract award. NRC will examine the composition of the NEMS and its initial application with respect to a representative slate of analytical tasks. NRC will define and apply criteria to evaluate the capabilities and adequacy of the NEMS for its intended purposes of forecasting and analyzing a variety of energy supply, end-use and environmental issues. In this context, NRC will review, primarily through briefings and presentations from EIA and other DOE sources, NEMS assumptions and methodologies. Particular emphasis will be given to the review of significant components of NEMS as they concern the cost and performance (output) curves for energy supply and end use technologies, environmental releases. NRC will also review the Department's plans for further development of NEMS. NRC will, within six months of contract award, prepare and issue an initial report of its findings. This report, following NRC peer review procedures, will be forwarded to DOE for use in support of the development of the National Energy Strategy.

Suggested Citation:"Appendix A-1: Scope of Work." National Research Council. 1992. The National Energy Modeling System. Washington, DC: The National Academies Press. doi: 10.17226/1997.
×

The report will present findings and conclusions regarding the efficacy of the NEMS in its early configuration, the reasonableness and adequacy of the underlying data, assumptions and methodology, and make recommendations, as appropriate, for near term action by DOE. The report may also outline the steps NRC will take in conducting the second part of the review.

Second Part of Review

In the second part of the review, to be completed 21 months after contract award, NRC will evaluate the NEMS and plans for further development in greater detail. On the strength of this evaluation, the NRC will provide recommendations for improving the models, data and associated analytical tools comprising the system, and for future model development and data collection in order to enhance DOE capabilities for strategic planning. In its review, NRC will address relevant long-range issues and will appraise the robustness and the flexibility of the NEMS to support the DOE policy making process. NRC will examine the adequacy of the models and analytical tools and the quality of data to support relevant policy analyses and development, in all supply and demand sectors, including renewables and in environmental and new technologies areas.

In particular, NRC will examine DOE needs and priorities for the NEMS over the long term. NRC will then identify what system improvements can be made cost effectively and new directions that could be undertaken within the state of the art, given emerging policy issues and other requirements and constraints that will confront DOE in the early 1990's and beyond.

An important part of this review is for NRC to assess the adequacy of current data collection for NEMS and related analyses in terms of its scope, frequency, sample sizes, and other statistical characteristics. An assessment will be made of the role that new data might service in enhancing the capabilities of the NEMS to meet its intended objectives. NRC will make recommendations on data requirements needed to more effectively support the DOE policy-making process and suggest priorities for new data collection and ways that data needs can be met cost effectively.

In its assessment of the modeling activities in DOE, NRC will define and address issues it considers critical in contexts such as the following:

(1) applications history of models in the NEMS; (2) completeness and adequacy of model documentation both for those running the models and those using them; (3) validity of the models in terms of how well the theoretical concepts, data bases, and operations approximate relevant aspects of the real world, including behavioral effects that impact on energy supply and demand; (4) treatment of uncertainties in both model construction and application; (5) integrity of the models in their representation in the computer codes which make them operational; (6) quality of model forecasts, and extent of out-of-system adjustments to outputs needed to account for conceptual and practical limitations of the models; (7) interfaces within the system and the ease with which the models can be maintained and updated; and (8) usability of the system including costs associated with use and upkeep of the system.

Suggested Citation:"Appendix A-1: Scope of Work." National Research Council. 1992. The National Energy Modeling System. Washington, DC: The National Academies Press. doi: 10.17226/1997.
×

In executing the foregoing assessment, it is expected that NRC will rely on existing information and documentation and will not undertake any original model or data validation efforts. In order to assure timely advice enabling effective allocation of DOE resources to the continuing development of the NEMS, NRC may, as appropriate, issue brief advisory reports on findings and recommendations considered significant. The advisory reports will be subject to peer review. NRC will issue, within 21 months of contract award, a peer reviewed final report to the DOE covering their findings and recommendations during the duration of the study.

ANTICIPATED RESULTS

NRC's report, after the first part of the review is completed, will provide informed judgements on the capabilities and adequacy of NEMS for its intended purposes, taking account of its initial applications and will advise the DOE with regard to further NEMS development.

NRC's findings and recommendations at the end of the second part of the review will provide DOE an assessment of NEMS, suggesting the level of confidence appropriate for its analytical products, and guiding its continued development and application. It is expected that NRC's interim advisory reports and final recommendations will enhance DOE's capabilities for strategic planning over the long term.

REPORTING

NRC's findings and recommendations will take the form of the reports described under “Proposed Effort.” All reports will be subject to regular NRC report review procedures. Reports will be provided to DOE and to other appropriate individuals and agencies. Briefings will be conducted as necessary.

Suggested Citation:"Appendix A-1: Scope of Work." National Research Council. 1992. The National Energy Modeling System. Washington, DC: The National Academies Press. doi: 10.17226/1997.
×
Page 97
Suggested Citation:"Appendix A-1: Scope of Work." National Research Council. 1992. The National Energy Modeling System. Washington, DC: The National Academies Press. doi: 10.17226/1997.
×
Page 98
Suggested Citation:"Appendix A-1: Scope of Work." National Research Council. 1992. The National Energy Modeling System. Washington, DC: The National Academies Press. doi: 10.17226/1997.
×
Page 99
Suggested Citation:"Appendix A-1: Scope of Work." National Research Council. 1992. The National Energy Modeling System. Washington, DC: The National Academies Press. doi: 10.17226/1997.
×
Page 100
Next: Appendix A-2: Committee Charge »
The National Energy Modeling System Get This Book
×
Buy Paperback | $50.00
MyNAP members save 10% online.
Login or Register to save!
Download Free PDF

This book addresses the process and actions for developing enhanced capabilities to analyze energy policy issues and perform strategic planning activities at the U.S. Department of Energy (DOE) on an ongoing basis.

Within the broader context of useful analytical and modeling capabilities within and outside the DOE, this volume examines the requirements that a National Energy Modeling System (NEMS) should fulfill, presents an overall architecture for a NEMS, identifies data needs, and outlines priority actions for timely implementation of the system.

  1. ×

    Welcome to OpenBook!

    You're looking at OpenBook, NAP.edu's online reading room since 1999. Based on feedback from you, our users, we've made some improvements that make it easier than ever to read thousands of publications on our website.

    Do you want to take a quick tour of the OpenBook's features?

    No Thanks Take a Tour »
  2. ×

    Show this book's table of contents, where you can jump to any chapter by name.

    « Back Next »
  3. ×

    ...or use these buttons to go back to the previous chapter or skip to the next one.

    « Back Next »
  4. ×

    Jump up to the previous page or down to the next one. Also, you can type in a page number and press Enter to go directly to that page in the book.

    « Back Next »
  5. ×

    Switch between the Original Pages, where you can read the report as it appeared in print, and Text Pages for the web version, where you can highlight and search the text.

    « Back Next »
  6. ×

    To search the entire text of this book, type in your search term here and press Enter.

    « Back Next »
  7. ×

    Share a link to this book page on your preferred social network or via email.

    « Back Next »
  8. ×

    View our suggested citation for this chapter.

    « Back Next »
  9. ×

    Ready to take your reading offline? Click here to buy this book in print or download it as a free PDF, if available.

    « Back Next »
Stay Connected!