|
Items in cart [4] |
Questions? Call 888-624-8373 |
| Copyright © 2009. National Academy of Sciences. All rights reserved. Terms of Use and Privacy Statement |
Below are the first 10 and last 10 pages of uncorrected machine-read text (when available) of this chapter, followed by the top 30 algorithmically extracted key phrases from the chapter as a whole.
Intended to provide our own search engines and external engines with highly rich, chapter-representative searchable text on the opening pages of each chapter.
Because it is UNCORRECTED material, please consider the following text as a useful but insufficient proxy for the authoritative book pages.
Do not use for reproduction, copying, pasting, or reading; exclusively for search engines.
OCR for page R1
Review of NASA's
An Assessment of NASks
Pioneering Revolutionary Technology Program
Committee for the Review of NASA's
Pioneering Revolutionary Technology (PRT) Program
Aeronautics and Space Engineering Boarcl
Division on Engineering and Physical Sciences
NATIONAL RESEARCH COUNCIL
OF THE NATIONAL ACADEMIES
THE NATIONAL ACADEMIES PRESS
Washington, D.C.
www.nap.edu
OCR for page R2
THE NATIONAL ACADEMIES PRESS 500 Fifth Street, N.W.
Washington, DC 20001
NOTICE: The project that is the subject of this report was approved by the Governing Board of the
National Research Council, whose members are drawn from the councils of the National Academy of
Sciences, the National Academy of Engineering, and the Institute of Medicine. The members of the com-
mittee responsible for the report were chosen for their special competences and with regard for appropriate
balance.
This study was supported by Contract No. NASW 99037 between the National Academy of Sciences
and the National Aeronautics and Space Administration. Any opinions, findings, conclusions, or recom-
mendations expressed in this publication are those of the authoress and do not necessarily reflect the views
of the agency that provided support for the project.
International Standard Book Number 0-309-09080-6 (Book)
International Standard Book Number 0-309-52759-7 (PDF)
Cover images courtesy of the National Aeronautics and Space Administration.
Available in limited supply from:
Aeronautics and Space Engineering Board
500 Fifth Street, N.W.
Washington, DC 20001
(202) 334-2855
Copyright 2003 by the National Academy of Sciences. All rights reserved.
Printed in the United States of America
Additional copies are available from:
National Academy Press
Box 285
500 Fifth Street, N.W.
Washington, DC 20055
(800) 624-6242
(202) 334-3313 (in the Washington
metropolitan area)
http://www.nas.edu
OCR for page R3
THE NATIONAL ACADEMIES
Advisers to the Nation on Stiente, Engineering, aniMeditine
The National Academy of Sciences is a private, nonprofit, self-perpetuating society of distinguished schol-
ars engaged in scientific and engineering research, dedicated to the furtherance of science and technology
and to their use for the general welfare. Upon the authority of the charter granted to it by the Congress in
1863, the Academy has a mandate that requires it to advise the federal government on scientific and tech-
nical matters. Dr. Bruce M. Alberts is president of the National Academy of Sciences.
The National Academy of Engineering was established in 1964, under the charter of the National Acad-
emy of Sciences, as a parallel organization of outstanding engineers. It is autonomous in its administration
and in the selection of its members, sharing with the National Academy of Sciences the responsibility for
advising the federal government. The National Academy of Engineering also sponsors engineering pro-
grams aimed at meeting national needs, encourages education and research, and recognizes the superior
achievements of engineers. Dr. Wm. A. Wulf is president of the National Academy of Engineering.
The Institute of Medicine was established in 1970 by the National Academy of Sciences to secure the
services of eminent members of appropriate professions in the examination of policy matters pertaining to
the health of the public. The Institute acts under the responsibility given to the National Academy of
Sciences by its congressional charter to be an adviser to the federal government and, upon its own initiative,
to identify issues of medical care, research, and education. Dr. Harvey V. Fineberg is president of the
Institute of Medicine.
The National Research Council was organized by the National Academy of Sciences in 1916 to associate
the broad community of science and technology with the Academy's purposes of furthering knowledge and
advising the federal government. Functioning in accordance with general policies determined by the Acad-
emy, the Council has become the principal operating agency of both the National Academy of Sciences and
the National Academy of Engineering in providing services to the government, the public, and the scientific
and engineering communities. The Council is administered jointly by both Academies and the Institute of
Medicine. Dr. Bruce M. Alberts and Dr. Wm. A. Wulf are chair and vice chair, respectively, of the National
Research Council.
www. nationa l-academies.org
OCR for page R4
COMMITTEE FOR THE REVIEW OF NASA'S PIONEERING REVOLUTIONARY
TECHNOLOGY (PRT) PROGRAM
RAYMOND S. COLLADAY, Chair, Consultant and President (retired), Lockheed Martin
Astronautics, Denver
BENJAMIN BUCHBINDER, NASA (retired), Bonaire, Netherlands Antilles
LEONARD H. CAVENY, Ballistic Missile Defense Organization (retired), Fort Washington,
Maryland
SERGIO GUARRO, Aerospace Corporation, E1 Segundo, California (from June 2002 until
April 2003)
DAVID J. KASIK, The Boeing Company, Seattle
DIMITRI MAVRIS, Georgia Institute of Technology, Atlanta
DENNIS K. McBRIDE, Potomac Institute for Policy Studies, Arlington, Virginia
TODD J. MOSHER, Utah State University, Logan
JAMES ODOM, Science Applications International Corporation, Huntsville, Alabama
LEE D. PETERSON, University of Colorado, Boulder
JOSEPH B. REAGAN (NAE), Lockheed Martin Missiles and Space (retired), Saratoga,
California
CYNTHIA R. SAMUELSON, Logistics Management Institute, McLean, Virginia
MARC SNIR, University of Illinois, Urbana-Champaign
MICHAEL J. ZYDA, Naval Postgraduate School, Monterey, California
PANEL ON COMPUTING, INFORMATION, AND COMMUNICATIONS TECHNOLOGIES (CICT)
MICHAEL J. ZYDA, Chair, Naval Postgraduate School, Monterey, California
WILLIAM COHEN, Consultant, Pittsburgh (from June 2002 until June 2003)
DELORES M. ETTER (NAE), United States Naval Academy, Annapolis, Maryland
MARY JEAN HARROLD, Georgia Institute of Technology, Atlanta
CHANDRIKA KAMATH, Lawrence Livermore National Laboratory, Livermore, California
DAVID J. KASIK, The Boeing Company, Seattle
ALFRED U. MacRAE (NAE), MacRae Technologies, Berkeley Heights, New Jersey
DUANE T. McRUER (NAE), Systems Technology, Inc., Manhattan Beach, California
RICHARD MULLER (NAE), University of California, Berkeley
CYNTHIA R. SAMUELSON, Logistics Management Institute, McLean, Virginia
JUDE SHAVLIK, University of Wisconsin, Madison
SANDEEP SINGHAL, ReefEdge, Inc., Fort Lee, New Jersey
MARC SNIR, University of Illinois, Urbana-Champaign
PANEL ON ENGINEERING FOR COMPLEX SYSTEMS (ECS)
DENNIS K. McBRIDE, Chair, Potomac Institute for Policy Studies, Arlington, Virginia
TORA K. BIKSON, RAND Corporation, Santa Monica, California
BENJAMIN BUCHBINDER, NASA (retired), Bonaire, Netherlands Antilles
PHILIP R. COHEN, Oregon Health and Science University, Beaverton
SERGIO GUARRO, Aerospace Corporation, E1 Segundo, California (from June 2002 until
April 2003)
MYRON HECHT, SoHaR Incorporated, Beverly Hills, California
JIM LARUS, Microsoft Research, Redmond, Washington
DIMITRI MAVRIS, Georgia Institute of Technology, Atlanta
RONALD WESTRUM, Consultant, Ann Arbor, Michigan (from June 2002 until February 2003)
F. GORDON WILLIS, Vulcan Works, LLC, Ann Arbor, Michigan
~v
OCR for page R5
PANEL ON ENABLING CONCEPTS AND TECHNOLOGIES (ECT)
LEE D. PETERSON, Chair, University of Colorado, Boulder
CLINTON A. BOYE, Sandia National Laboratories, Albuquerque, New Mexico
LEONARD H. CAVENY, Ballistic Missile Defense Organization (retired), Fort
Washington, Maryland
STANLEY V. GUNN, Rocket~yne (retired), Chatsworth, California
ANTHONY K. HYDER, University of Notre Dame, South Bend, Indiana
DIMITRIS C. LAGOUDAS, Texas A&M University, College Station
TODD J. MOSHER, Utah State University, Logan
JAY S. PEARLMAN, The Boeing Company, Seattle
JOSEPH B. REAGAN (NAE), Lockheed Martin Missiles and Space (retired), Saratoga,
California
NANCY R. SOTTOS, University of Illinois, Urbana-Champaign
GREGORY G. SPANJERS, Air Force Research Laboratory, Albuquerque, New Mexico
MICHAEL J. STALLARD, Aerospace Corporation, Albuquerque, New Mexico
COMMITTEE AND PANELS STAFF
KAREN E. HARWELL, Study Director
DOUGLAS H. BENNETT, Program Officer
GEORGE M. LEVIN, Director, Aeronautics and Space Engineering Board
BRIDGET R. EDMONDS, Senior Project Assistant
JENNIFER D. PINKERMAN, Research Associate
ANNA L. FARRAR, Financial Associate
v
OCR for page R6
AERONAUTICS AND SPACE ENGINEERING BOARD
WILLIAM W. HOOVER, Chair, U.S. Air Force (retired), Williamsburg, Virginia
A. DWIGHT ABBOTT, Aerospace Corporation (retired), Palos Verdes Estates, California
RUZENA K. BAJCSY (NAE/IOM), University of California, Berkeley
JAMES (MICKY) BLACKWELL, Lockheed Martin (retired), Marietta, Georgia
ANTHONY J. BRODERICK, Aviation Safety Consultant, Catlett, Virginia
SUSAN M. COUGHLIN, Aviation Safety Alliance, Washington, D.C.
ROBERT L. CRIPPEN, Thiokol Propulsion (retired), Palm Beach Gardens, Florida
DONALD L. CROMER, USAF (retired) and Hughes Space and Communications (retired),
Fallbrook, California
JOSEPH FULLER, Jr., Futron Corporation, Bethesda, Maryland
RICHARD GOLASZEWSKI, GRA Incorporated, Jenkintown, Pennsylvania
JAMES M. GUYETTE, Rolls-Royce North America, Chantilly, Virginia
JOHN L. JUNKINS (NAE), Texas A&M University, College Station
JOHN M. KLINEBERG, Space Systems/Loral (retired), Redwood City, California
ILAN M. KROO, Stanford University, Stanford, California
JOHN K. LAUBER, Airbus North America, Inc., Washington, D.C.
GEORGE K. MUELLNER, The Boeing Company, Seal Beach, California
DAVA J. NEWMAN, Massachusetts Institute of Technology, Cambridge
JAMES G. O'CONNOR (NAE), Pratt & Whitney (retired), Coventry, Connecticut
MALCOLM O'NEILL, Lockheed Martin Corporation, Bethesda, Maryland
CYNTHIA R. SAMUELSON, Logistics Management Institute, McLean
KATHRYN C. THORNTON, University of Virginia, Charlottesville
HANSEL E. TOOKES II, Raytheon International (retired), Falls Church, Virginia
DIANNE S. (WILEY) PALMER, The Boeing Company, Washington, D.C.
THOMAS L. WILLIAMS, Northrop Grumman, Bethpage, New York
, Virginia
GEORGE M. LEVIN, Director
v~
OCR for page R7
Preface
The Committee for the Review of NASA's Pio-
neering Revolutionary Technology (PRT) Program of
the National Research Council (NRC) and its three sup-
porting panels have completed an approximately 20-
month-long study evaluating the technical quality of
the National Aeronautics and Space Administration's
(NASA's) PRT program. The statement of task for this
study is given in Appendix A. The study was spon-
sored by NASA and conducted by a committee and
three supporting panels appointed by the NRC (see
Appendix B for biographies of committee and panel
members). The Office of Management and Budget
(OMB) requested the review and assisted in the formu-
lation of the statement of task.
This report provides a technical assessment of the
quality of the PRT program and its components and
offers recommendations for improving the program.
The committee and panels note that they refrained from
drawing any conclusions on matters of budget or rec-
ommending increases in budget levels. While some
areas may suffer from a lack of critical mass, recom-
mendations for increased resources to address the prob-
lem are of little value to management and have been
avoided. The committee and panels also refrained, as
much as possible, from commenting on matters related
to programmatics and program organization unless a
link could be established between these concerns and
technical quality, portfolio management, or interaction
within NASA and with the external technical commu-
nity. NASA's Aerospace Technology Advisory Com-
mittee (ATAC) and its PRT subcommittee hold an an-
nual relevance and programmatic review for the PRT
program.
. .
via
The committee and panels did not assess other pro-
grams within NASA on which the PRT program and its
portfolio depend or other programs within NASA that
research similar technology areas. The committee and
panels did recommend when these programs should be
integrally connected and the PRT portfolios managed
with the global NASA investment in mind.
I wish to take this opportunity to thank the chairs
and members of the three supporting panels for their
leadership, detailed assessments, and commitment of
time to the review. Their input has been vital to the
quality of the entire review. On behalf of the commit-
tee and panels, I would also like to thank the various
NASA program managers and technical staff for their
cooperation in providing the information necessary to
complete the review and in hosting our panel members
at various site visits and for their open discussion dur-
ing these opportunities. We also thank those who took
the time to participate in committee and panel meet-
ings and provide background materials. Finally, this
study and the final report would not have been possible
without the expert support of the NRC staff. Their dedi-
cation to keeping the review on track deserves special
recognition and thanks. Thanks go especially to Karen
E. Harwell, study director, for her professional steering
of the overall committee effort as well as her support to
the ECT panel, and to Douglas H. Bennett for his sup-
port to the CICT and ECS panels.
Raymond S. Colladay, Chair
Committee for the Review of NASA's
Pioneering Revolutionary Technology
(PRT) Program
OCR for page R8
Acknowledgment of Reviewers
This report has been reviewed in draft form by individuals chosen for their diverse perspectives and technical
expertise, in accordance with procedures approved by the National Research Council's (NRC's) Report Review
Committee. The purpose of this independent review is to provide candid and critical comments that will assist the
institution in making its published report as sound as possible and to ensure that the report meets institutional
standards for objectivity, evidence, and responsiveness to the study charge. The review comments and draft manu-
script remain confidential to protect the integrity of the deliberative process. We wish to thank the following
individuals for their review of this report:
Dwight Abbott, Aerospace Corporation (retired),
Douglas Allen, Schafer Corporation,
George Apostolakis, Massachusetts Institute of Technology,
Daniel Baker, University of Colorado,
Vicki Bier, University of Wisconsin,
John Evans, COMSAT (retired),
Michael Frank, Safety Factor Associates, Inc.,
Henry Helvajian, Aerospace Corporation,
William Howard, Consultant,
James McGroddy, IBM Corporation,
Phil Papadopoulos, University of California, San Diego,
Suraj Rawal, Lockheed Martin Corporation,
Walter Robb, Vantage Management, Inc.,
Richard Schwartz, Purdue University,
Norman Sleep, Stanford University,
Patrick Stadter, Johns Hopkins University Applied Physics Laboratory,
David Waltz, NEC Research Institute, Inc. (retired), and
Mary Young, HRL Laboratories.
Although the reviewers listed above have provided many constructive comments and suggestions, they were
not asked to endorse the conclusions or recommendations, nor did they see the final draft of the report before its
release. The review of this report was overseen by Alexander H. Flax, Consultant. Appointed by the National
Research Council, he was responsible for making certain than an independent examination of this report was carried
out in accordance with institutional procedures and that all review comments were carefully considered. Respon-
sibility for the final content of this report rests entirely with the authoring committee and the institution.
. . .
vail
OCR for page R9
Contents
EXECUTIVE SUMMARY
1 INTRODUCTION
Background, 11
Approach to Assessment, 11
Report Organization and Development, 12
Reference, 12
2 OVERALL ASSESSMENT OF THE PIONEERING REVOLUTIONARY
TECHNOLOGY PROGRAM
Overall Assessment, 13
Common Themes, 14
Systems Analysis, 14
Benchmarking and Metrics, 15
External Peer Review and Competition, 15
Stability and Continuity, 17
Research Portfolio Balance, 17
Technology Transition, 19
References, 19
Briefings, 19
3 REPORT OF THE PANEL ON COMPUTING, INFORMATION, AND
COMMUNICATIONS TECHNOLOGY
Introduction, 20
Review Process, 21
Overall Observations on the CICT Program, 21
General Observations, 22
Research Program Architecture, 23
Fix
1
11
13
20
OCR for page R10
XCONTENTS
Service-Oriented Tasks, 23
Final Research Applications, 26
Final Products and Research Benchmarks, 26
Research Portfolio, 27
Detailed Assessment of Research Portfolio, 27
Overlap with Other PRT Programs, 28
Expanding Existing Research Areas, 28
Critical Computing Expertise That May Be Missing, 30
Research Plans and Methodology, 30
Task Deliverables and Their Fit to NASA Goals, 31
Maturing a Technology, 31
Reviewing and Selecting Proposals, 32
Technology Readiness Level, 33
Reorganization of Projects and Management Structure, 33
Technical Community Connections, 33
Awareness of Relevant Research, 35
Use of Talent Inside and Outside NASA, 36
Benchmark Datasets and Problem Sets, 36
Facilities, Personnel, and Equipment, 36
References, 37
Briefings, 37
4 REPORT OF THE PANEL ON ENGINEERING FOR COMPLEX SYSTEMS
Introduction, 38
Review Process, 38
General Observations, 39
Programmatic Risk Management, 39
Technical Quality, 40
Challenge Areas, 41
Specific Task Discussions, 41
System Reasoning for Risk Management, 42
Connections to the External Community, 43
Research Portfolio, 44
People and Facilities, 44
Methodology, 45
Quality of Work, 45
Observations on Specific SRRM Tasks, 45
Knowledge Engineering for Safety and Success, 45
Human and Organizational Risk Management, 45
Knowledge Management, 47
Observations on Specific KESS Tasks, 47
Resilient Systems and Operations, 49
Intelligent and Adaptive Operations and Control, 49
Resilient Software Engineering, 49
Observations on Specific RSO Tasks, 51
References, 52
Briefings, 52
OCR for page R11
CONTENTS
5 REPORT OF THE PANEL ON ENABLING CONCEPTS AND
TECHNOLOGIES
Introduction, 53
Review Process, 54
General Observations, 55
Goals and Research Portfolio, 55
Technical Quality, 57
Management and Strategic Planning, 59
NASA Cross-Enterprise Technology Research Announcements, 62
Advanced Systems Concepts Project, 64
General Observations, 64
Technology Assessment Analysis Element, 67
Revolutionary Aerospace Systems Concepts Element, 69
NASA Institute for Advanced Concepts Element, 70
Energetics Project, 71
Introduction, 71
General Observations, 71
Research Portfolio and System Analysis, 71
Research Plans and Mission Direction, 73
Methodology, 74
Personnel and Technical Community Connections, 74
Facilities and Equipment, 75
Advanced Energy Systems Element, 75
Onboard Propulsion Element, 77
Advanced Spacecraft and Science Components Project, 79
Advanced Measurement and Detection Element, 79
Distributed and Micro-Spacecraft Element, 82
Resilient Materials and Structures Element, 87
Space Environmental Effects Element, 90
References, 92
Briefings, 93
Annex: Technology Graduation Paths Examples of the Maturation Process
in the ECT Advanced Measurement and Detection Element, 94
Briefings, 94
APPENDIXES
A Statement of Task
B Committee and Panel Members Biographies
C PRT Program Organization
D Committee and Panel Activities
E Task Questionnaires
F Acronyms and Abbreviations
x~
53
101
104
115
117
120
122
i
OCR for page R12
Tables and Figures
TABLES
3- 1 Computing, Information, and Communications Technology (CICT) Program
Organization and Budget, FY2002-2003, 20
3-2 Relationship of Technology Expertise Areas to NASA Abilities and
Goals, 24
4-1 Engineering for Complex Systems (ECS) Program Organization and Budget,
FY2002-2003, 38
5-1 Enabling Concepts and Technologies (ECT) Program Organization and
Budget, FY2002 and FY2003, 54
5-2 Cross-Enterprise Technology Development NRA Awards, 63
5-A-1 Graduation Paths for Various AMD Technologies, 96
FIGURES
3-1
5-1
5-2
5-3
Pioneering Revolutionary Technology (PRT) program organization and
FY2002 budget, 2
Future expansion of the technology for human-centered computing, 29
ECT program implementation strategy, 55
Space technology program funding history, 60
Historical cost and mass distribution of small satellites, 66
Distribution of NASA ECT microspacecraft technology projects, 66
Graduation paths used by the Advanced Measurement and Detection
element, 95
Graduation path for uncooled thermopile broadband detector arrays, 95
Organization of the NASA Pioneering Revolutionary Technology (PRT)
program, FY2002, 116
. .
x~
