Biomedical and Behavioral Research Scientists: Their Training and Supply: Volume III: Commissioned Papers (1989)

Below is the uncorrected machine-read text of this chapter, intended to provide our own search engines and external engines with highly rich, chapter-representative searchable text of each book. Because it is UNCORRECTED material, please consider the following text as a useful but insufficient proxy for the authoritative book pages.

E: z o v A: o p no z o an o 'e v, a; - me v) be o o ~— 4_ o ~ ~ ~ ~ · l ~ ~ v - - 7 . ~ ~ ~ , ~ Rid · ~ ~ ~ ~ ~ i e ~ ~ ~ ~ ~ / ~ ~ , L ED _ - - - - - e~ E A-1

Ad o ·~, u o v, in z o ~ - 5 At, o 3 _ _ Cal <; E ~ == ~ .4) =. , A= ~ =O ~ A* ~ -A a ~ a ~ E ~ ~ E ° E ~ ~ .o Y o P. _ ~ . ~ ~ Cat Z .O ·- o .~ 5c`e was 5~ .~ ~ ~ D .5 . 3 ~ ;^ ~ :^ I. Cat ~ I. 3 ~ 3 ~ _ ~ D O ._ _ en ._ ._ Cal tD O ·e en o ._ ~ C`- ._ · A;; . ~ e~ O ~;) V' ~ ·O D C~ 4 - 3 => ~ ~ E ~ a ~ ~ a 5' 9 E g.~tooEo ~Eau2E ;5 o =~ E o ~ 3 ~ o 3 9 o E ~ o^ e ~=E e ~ ~ -. C) ~ ~ ~ 3 ~ =* eg.s ;~ O a 0 ~ ~ ~ ~ (,,, ~ ~ O ~ . ~ ~ 2 ~ 3 ~ D ._ U' ._ CJ C: ~ ~ O e~ ._ _ ~ e~ C - L O :: ~ e~ A-2 ~, :~S fi ~ ~ o · ~ ~ ·~ ·b C, U) Ct.s D p~ Ct ~ 5 O * 4~ ~ * ~ ~ :- -. ~ 4_ ~ o O C) ~ ~ ,~ 3 cn ~ - ~ V, _ ~ Z ° C`- U, q.> Ct °

Do So o ~ v, c z o ~ ~ o m Cal CQ z o cq 5 ~7 o Cal W <; q <: I_ 7 U. be o I b~ ~ ~ ~ ~ ~ I 1_ ~ ~ EMS it 3 ~ ~t ' E 0, 5 = ~ ~ 3 ~ 3 ~ E _ ._ ._ :: u, ~ e5 ._ ~ ~ o U. ~ At ~ Cal — ~ en ~ _ ~ o ~ :~._ ~ V, S C~ ~ I en _ en O ~ O A-3

v, 5 En A o ~ V, a ~ o ~ V, o A 5 q a: U. Cot o f o . ~ Cut o ·3 ~ ~ C) ._ ~ ._ ~ · _ C) Cut O o o 3 Cut C`. Cut ~3 - Cut ._ U. Cat 1 Cut o D Ct C~ · _ C) cn ~ ~ .a bO ~ a ~ · ~ ·6 .a Ct ~ 4— Ct ~ O C) ~ ~: · .= . ~ .w ~ C) O ~ ~o tD L O c: ;^ o ._ ~ C) ~ O ~ ~- ~ ca C~ ~ .o e~ ~0 C o o ~ 3 ·5 ·= 4— ~_ cn D · _ bO C~ C~ ~ * _ ~ .a ~ ¢) ct ~ s:: ~ · - _ _ ~ .~ C~ 4_ ._ Q" C~ D C) ~ _ "C~. Ct ,~ D 3 o X . ·~ ~_ - ~q ~ L .> O C~ ~ C~ z 4— C~ ._ A-4 ~- -° o ~ ~: <~.o S E_ :~ =~ ~ ~ .a ~ O u. O :, C) O .s C~ ~ . 3

o ¢ a z ¢2 ¢ v, o In In c 9 T y z U!) O ~0 O Cal a ~ ·e -5 ~ ~ g ~ 9 Y D D E 3 D Y 5 ~ a u D D E to ~ ~ ° ° E ~g E = v ~ L4 ·s 3 ~ ~ 0 _ ~ I 0 ~ ._ cut fL) ·— ~ ~ a. ._ ~ ~ ~ 0 ~ S ~ .~ ~ be _ ._ . ~-R c' s en ~ u' .— == A-5 4_ c~ 0 ·~ c~ _ 3 ·~ 3 3 ·o ~ ~ _ L I I 3 ;~ {: ~ ,o ~ _ u, :: ~ ~ _ ~_ o u, o ~ u, ~o 4_ b4 =^ a~ c~ ~ s ~ ~ o · - 'v . ~ 5 o c~ c~ ~ ~ ·s zol' oo o~ ~; E~ - 4— .5 s~ c~ u, ._ - o c~ ~4 - . s~ ·= u' ._ 0 0 ._ ._ * * *

APPENDIX B For the purposes of this paper, certain basic criteria were used to identify the evaluation studies chosen for review: . . The focus of the study was on NRSA programs. Studies of research trading in general (e.g., Zumeta, 1983), although their populations may have included NRSA awarders, were not included as formal evaluations of these programs. "Data books" such as those produced by NIH (1988) and ADAMHA (1989a) were not classified as formal evaluations depite the fact that they provide data on number of awards and soundings levels. This type of document, however, is considered when discussing the availability of information on major evaluation questions (e.g., levels of program participation). The results had to exist in a form that was available for at least limited dissemination. Ad studies presented in Appendixes C and D were either formal published reports or reports prepared for internal and/or limited distribution (upon requested to interested parties). Other evaluation-related activities for which no "wr~te-up" was available (e.g., computer printouts for which results were not summarized or informal staff attempts to gather preliniinary data on outcomes of awarders) were not considered. They are, however, discussed in the paper, where appropnate. S=teen ~ndiviclual evaluation efforts met these cnteria, and the major characteristics of each are summarized in Appendixes C and D. Appendix C presents information related to the coverage of each study In terms of: (~) the agency administenng the programs (i.e., NIH or ADAMHA); (2) whether the study focused on a particular program or specific institute (e.g., N1MH); (3) the major category of training evaluated (e.g., predoctoral vs. postdoctoral); (4) whether the focus of the program was on traiIling MDs, PhDs, or undergraduates; (5) the major fields of scientific training incorporated (e.g., biomedical vs. clinical sciences); (6) the time penod examined (e.g., 1978-81 awardees); and (7) the major questions addressed by the evaluation. In Appendix D are described selected methodological characteristics so as to better ~ _ ~ . . ~ ~ . . ~ . ~ ~ . ~ . . ~ ~ ~ ~ ^^ depict how evaluations were conducted and identity how program outcomes and/or effects were examined, given that the majority of studies reviewed attempted to address these types of questions. B-l

A; Q Q A: w A; o U. o _ ·~ og .t o I: _ . ~- o 8~ a A ~ O .C, ~" C: _ ~ a ~ . ~ O ~ ~ O ~ ~ in O? En ad , 0 ~ X X X X X X X X X X X X X X X .= ~ ~ =~ ~ C ~ ~ ~ ~ CM ~ =< ~ .E ~ "CH ~o ~ ~ ~ .S ~ ~ ~ ~ o X X X X X X X X X X X X X X X ~ X X ~ X X X X X X X X X X X X X X X X X ~ ~o ~o cr~ ~ _ ~ ~ ~ ~ ~ C~ ~ C~ U o Z U Z U Z U C-1

:- .~ - r CO 0^ A; ~3 o V' It o ._ o o d~ .. 0~ of O 5. Cod ~ .5 ~~ O m TIC E 0 i~ X ~ .5 ,; X O ~ ._ COIL E 0 0 ~ LIZ Me ~ u' <t i. i~ He ;^ v, tic X XX cO ~ i.Q t-~:~ X X x x x~ x u~ oo - "z 3 ~_ o ~— ~ Zo ~ &a 3 C-2 X X r ~ ~ cYL ~ {E~ 8 X X X X X X X X X X ~C X X ~ u, ~ 3 X X r~ , o ~S Cq X X ~ Xgg Xto aa x x x Pt ~ _ O \~} _ ~ C ¢~` r ~ ~ U' a ~ ~ ~ c~

~ ~ n .5 8 _ C ~ .- U. V o V, _ O ~ V 53 O ~ to ~ ~ ~1 ~ _ cr' ~ ~ _ ~ . - m my_ O U O ~ &~ ig _) ._ ~ ~ 0 |:: ~ Z U. ~ ~ ~ 3 o Hi :^ V, 1 3 A o .a E ~q E oo o ~'S~ ~ ~ O CO ~ X~ X ~. ~Z ~X~ X X o~ _ Y ~C X X X X X X' X ~ X X P~ ~ X X . X X X~ X~ ~4 r~ X ~ X o ~o oo ~ C~ ._ V' X X := ~ :~* _ X X X X X ~o oo - ~ ~; o ~ C-3 r _. - V ·O ^' ~ ·b a5: ~` · ~ IL) .s ~ E ·_.! _ C2 o' ~ ~ _ ~ ~ ~ _ ~ ~ ~ C' ~ o ° ~ ~ {:: .— ~ ~ ~ — 3 aa ~ ~ O ~ ~ l~ ~ ~h ~ `~ ~ .~ ~ e O ~ U te ~! I~ ~ <) g y u ' a r. ~ ,g , ag u t~ :~ _~ ~ .> O ~ ~ . g · ~ ,: ~ . E .s ~ ~ O ~ ~ o ~ ~ ~ _ ~ ~ ~ ~ E ~ ° c Z ;o~ 0 5 o 5 ~ 5 5 o ~ D o E _ E _ ~ E, ~ ~ o ~ ~ ~ ~ ~ ~ — 2 U} o ~ ~ ~ ~ U, ~ U, — ~ ~ ~ ~ ~ ~ ~ ·_ ~ 0~ CY ~ D 0' u :` ~ ~ , , ~ c~D 9~~ ~- 1 - · _ E. v ~ & y ~ o o oE o 4 - o :a ~ ~ o i ~o .o _ e ~ E) U, ._ *

v, ~ - ~ .= .S o ~ of ~ o ~ ~ cog a] Van z fir a ~5 a: o U. U e a y 5 · 5 8 E me y E EN ~ y ~ ~ a 3 ~ D ~ y ~ ~ ~ o ~ ~ ~ E ~ o o o o o o 4, 5Y o o o Y g =` Z ·E 8 ~ ~ ye g y o o o o E Y C) 2= X o o o-~ ~ ~ ~ , g ~ 3 . g 3 3 g 3 y 8 3 E Y a 1 , S y Z O ~ y y O O O D-1 ~ U' ·= a .c 9 Y -3 = y E E g ~ 3 , Y y E Y g Y g O E 3 = i .e e Y ~, e ~ O :3 0 0 0 0 0 0 ~a ca ~ 0 ~ ._ _ ~ ~ ~ P~ .g ~ ~ a ·3 . ~ ~ a ~ e ~ E ~ O ~ ~ 0 3 5~ =~ o o o , ~ 0 0 ~ a D E 0 .° X ~ ~ ¢~°, ~8O ~°, ° ~ O O O o 3 8 -3 3 0 O ~ ~ ~ ~ c~ c c~. -° .. ° c ~ ~ 1; ~ ° ~ ° ~ E == O ~ E =5 a o O ~. ~ ·9 0 ~ ·— u~ ~ — c~ a e E ' Y ° . 5 'Y c .~ 0 c 0 0 c~ oo c o~ · ~ ~ ~ o - c ~ ~ ~ ~c ~ oc c~ ~ ~ a~> ~ -8 ~ Z C C C~ ~ ~ ~ O O ~ C,' . . ~ ~ ~ . 0.> r ~l ~~~ ct O O o 8 V, - . ° ~ ~E E . ~ ~ ,,, _ g _ ~ ~ rt4 ?~ ~s E ~ . _% e. 0 ~ ~ '; ~ ~ O O co c~ x u, ~ ~ ~ 3 ~ ~ ~ 0 r_ ~ 0 r— ~ ~ O ~ ~ ~ ~ O ~ ~ ~ 0 ~ c 3 ~ ~.5 .. 0 0 3 <, E ~ o 0 0 0

a) - g ~ - a, L§~i ~ ~ a? a' rm a; Be; In o ·] ~ ·~. o En o o o ;^ I' o ~ o ~ :^ a, or .8 ·9 9 ~ B! $~9' ld a~9~a~; ~ o ~ ill ~ ~ . ~ ' ~ by, ~ 1 ~ ~ o o eo . ~ ,=~ ° 0 0 0 0 0 o oo - ~ e . s ~, U. O O O O ;a ~q 0- & ~ rl j " ' 9 '= 9 3 . ~ 1 3 a · . ~ ~ 9 ~ ~ ~ ~ · g ~ ~ ~ ~ ~ 8 ~ ~ o o o o o o o o ~ o o o o ~ o o o o C~ {: 3 I° ° ~ m~: ~ C ~ 0 — 0 .1 ~ t. ~ _ - o ·:S .8 D-2

A, pi; a; = o o ~4 - - ~ ·e ·l ~ - ~ L a, a; ~ Cat - C': _ w En U. Cat U. a o V) o e ~ ~ 0 00 `8 ~ 9~8 ~ g id' ~8 e X ~ =. ~ ~ C ~ .§ .8 5.~ O 8 o ~ of ·~o d! ~ U. ~ a ~ i CE ~ · ~ 8 Y ~ o o o V, C-. h1 M'I~= o c .]o ~ ~ 8 ·t o 8 tgC y 59 CO ~ o lp #m C~ '= o Z~ o ~ 3 0 ~ ~ o y y Y 8 7 8 8 .m .C .. "~.-- ~ ·- ~ ~ ~ 5 g ~ ~ ~ c o o o o ~7 o~ ~ — ":8 u- :~ |_ ._ to U o o U!} 00 s ~ S ~ ,.S Q ~ ~ ¢: ~ ~ ~ ~ .3 U' ~ .S.G .S .9 ~ [~-N V ~c~a~- o o o o os ~ re oo :~.~ ~ 5 £_ ~ o 3 c ~ ~ D ._ ~ _ ~ O ~ D ~ ~ Z .5 oo o d, _~ — — ._ o - 3 Z ~ D-3 Y 3 aY 38 3'i .° ~o ~ ~c ~ 6 _ ~ ' o o ._ .~ ._ o ._ ._ t_ ~ ~ oa~t o ~ o ~ ~ ._ ~ C~ U, oo s ~ 5 s q~ X o 3 i ~ Y . ~ ~ 3y j ~ ~ ~ ·~.~o V]V 3 3 o o o o o o o o ~a ~ to J 3 3 t° c ~ ~ ~ o ~ 3 ~ c o ~ 3 ~ _ o X (~\ :q — '-~ V o o ~o x - o

A, - ~ lo v, ·. :' '3 ~ _ 5 p o ',3, ·S w 8 CO o o. .N - I_ o :e 2 z a `5 >] C ~ _ i! C _ C— ~ . 5 ~ ~ . ~ .,. ::: ~ Y .8 {a ~ . ~ ~ c o 00 ~ S · ~ O ~ O O so ·e A. g.s ~ ~-e a ~ ,] 0 ~Z o ~ ~ ~ ~ ~ §- 3 o C) 5 ° ·_ ~ ~ .L ~ ~ ~ Y o o o o o o ~,c ~ o~# ~ _ _ s.e ~ .O o :: ~ ~ ~ ~ C ~ ~ 5 ~ ~ ~ - o .5; o ,,: ~._ ~ o o o z ~ 8 ~ =, ~ ~ _ ~ ~ o ~ ~ ~ ~ ~o .. [~ 3 o o o o o ko oo oO~ ·s - ~ U3 ~ 5 o ~ ._ `,. P. o o o o z - 3 8 o o ° ~ CO ]~s C~ oG ~ ~ Z ~ ~ &¢ 0 o o o D-4 o ~ ~ ='3 ~ ~ ~ 00 ~ ~ 0 -5 ~ ~ ~ E 3 Y <, y ~ ~ E o o o o o - 5 3 o = §] E! ~ Z o o o ~o - - .

s c) v - Q Pi a; Ed V, En z CO A a o GO .~ .d ·! a O 8 o of '~d V ~ Hi; :e 71 73 I- ' ' i L l Z ~ s l; ~ ~ 3 ~ | y i i E ~ · — E IYS;!~ . ii] ~ ~= 'I 13 be. . o o o o o o o o .7 ~ .5 ~ O ~ K O O O O ~ — Y Y Y E E ~ Y 8 _ :o ~; ~ ~, 8 y ~, 3 0 0 0 0 0 0 0 0 =~ Zo ~o 3 ~ ~ 8° Y ~ ! e Z8~'3~7 o o ~ o o o o o o .e ~ ~ _ ~ 3¢ I ~ _ ~ ~ a Z; 8 D-5 S e 0 e 3 oll o" 3 =< boO ° E E ~ ~: o ·5 0 {.., o~ l o o~ 0 o ._ - ut o bO C~ ·g ~ ~ E _ 0 ~ E ~ s; =~ 0 0 z 3 ~a ~ U. O ~ ~ C ^. 5.> O ~a ~ ~ .s o 0\ _ cS,,

. I: - is ~4 v o a Q a od _ u: Hi o cut _ u, hi o ·,, Oq a co o En v, c, 00 . ~. u' t_ O . Pa ~ g O 8 ;^ . ~ D-iD7~ Is a o o o .f ~q ~ .: o o no =~ ~§ o =8 ~ o ~ D &.5 . ~ -a i)~ Q%¢ O O O oo 0\ u, . o oo ~ s ~ ·~ ~-~ o o ~ ~ .~- ~ Bi+-ai {- ~q - o c z u, c$~ ~ o ·= - ~ - E~ ~ o o ~o oo - 3 S ~. ~ ~q ~ ~ 8 .S U. U. o ~ =u ~ t: ~E ~ o .ao e~ 8 E ~ ~ E o o o = = ~_ ~ _ 3 ~q '~ ~ ~ ~ D O O O o ~ E ~ E S ~ ° ~ j ~ j ~ ~ ~ ~ Esa ~ ,~ ~ =0 O O O _ _ v, D-6 o

- s .~ a, :O o g ~ - - At ED v, Hi 5 ·o o o :E ~ 8 to ~ lo .a U. i 3 g its lo. s ~t 5 o as o :^ 59 U' ~ o o I.§ .~ C) 'I ~ o o z ip go ~ o 9 of o ¢¢ o o o Go CH _ IS o o D-7