Research Matrix

SBIR Review Objectives


Assessment of the program

Consideration of operational improvements to the program


quality of research

commercialization of SBIR funded research/economic and non-economic benefits

small business innovation/growth (incl.minority owned)

use of small business research to advance agency missions

program design

service to participants

efficiency of SBIR program administration

program evaluation


* How does the qualityof SBIR funded research compare that of other government funded R&D?

* What is the over all economic impact of SBIR funded research? * What fraction of that impact is attributable to SBIR funding?

* How to broaden participation and replenishing contractors? * Possibility of link SBIR with state/regional programs?

* How to increase agency up take while continuing to support high-risk research?

* Time and award limits? * Review process and criteria? * Intra- and inter-agency interface? * New funding model to build collaborative networks?

* How can SBIR better serve technology entrepreneurs? * Lessons from angels? Corporate R&D?

* How to leverage economies of scale in program administration while allowing each agency full management autonomy?

* How to evaluate SBIR success: Appropriate measures? Impact of skew in returns?


peer review scores, publication counts, citation analyses

sales; follow-up funding (e.g. angel, VC, corporate); drug development progress; IPOs

patent counts and other IP/employment or job growth, number of new technology firms

agency procurement of products resulting from SBIR work



speed of response to applicants; administrative cost per dollar awarded


The National Academies of Sciences, Engineering, and Medicine
500 Fifth St. N.W. | Washington, D.C. 20001

Copyright © National Academy of Sciences. All rights reserved.
Terms of Use and Privacy Statement

Below are the first 10 and last 10 pages of uncorrected machine-read text (when available) of this chapter, followed by the top 30 algorithmically extracted key phrases from the chapter as a whole.
Intended to provide our own search engines and external engines with highly rich, chapter-representative searchable text on the opening pages of each chapter. Because it is UNCORRECTED material, please consider the following text as a useful but insufficient proxy for the authoritative book pages.

Do not use for reproduction, copying, pasting, or reading; exclusively for search engines.

OCR for page 58
ANNEX F: Research Matrix SBIR Review Objectives Assessment of the program Consideration of operational improvements to the program quality of commercializat small business use of small program service to efficiency of program research ion of SBIR innovation / business design participants SBIR evaluation funded growth research to program research / (incl. advance administrati economic minority agency on and non- owned) missions economic benefits Questions * How does * What is the * How to * How to * Time and * How can * How to * How to the quality overall broaden increase award SBIR leverage evaluate of SBIR economic participati agency limits? * better economies SBIR funded impact of on and uptake Review serve of scale in success: research SBIR replenishi while process technolog program Appropriat compare funded ng continuing and y administra e that of research? contractor to support criteria? * entreprene tion while measures? other * What s? high-risk Intra- and urs? allowing Impact of governme fraction of * research? inter- * Lessons each skew in nt funded that Possibility agency from agency full returns? R&D? impact is of link interface? angels? manageme attributabl SBIR with * New Corporate nt e to SBIR state/regio funding R&D? autonomy funding? nal model to ? programs? build collaborati ve networks? Measures peer review sales; follow- patent counts agency ? ? speed of [all] scores, up funding and other procureme response publicatio (e.g. angel, IP / nt of to n counts, VC, employme products applicants; citation corporate); nt or job resulting administra analyses drug growth, from SBIR tive cost developme number of work per dollar nt new awarded progress; technolog IPOs y firms 58

OCR for page 58
Key * Difficulty * Skew of * Measures of Major inter- Documenting * Response * Shift from * Appropriate research both of returns: actual agencies / time paper to implement issues / measuring estimates success difference addressin * Ease of electronic ation of challeng quality and of returns failure s in use of g the application program GPRA in es of invariably (both SBIR to problem of * Outreach manageme this identifying dominated project meet "backwate activities nt context? proper by a few and firm agency r" status * reference big level) missions of SBIR Possibility group "winners"` * programs of using * Relationsh within some Significant ip of agencies funds for inter- Federal program agency and state administra and inter- programs tion industry in this difference context s Desired * SBIR is working better* Projects are being tracked* Measures exist of long-term impacts outcom es 59

OCR for page 58
Assessment of the program Consideration of operational improvements to the program commercializatio use of small n of SBIR funded small business business efficiency of research / quality of innovation / service to program research to SBIR program program design research economic and growth (incl. participants evaluation administration advance agency non-economic minority owned) missions benefits X X X X Phase I survey X X X X X Phase II survey survey of "program X X X X X managers" X X X X X X case studies agency program X X X X X X studies proposed study of X X X X X X X repeat winners proposed bibliometric analysis comparing X SBIR firms with X X (similar) non-SBIR firms 60