Below are the first 10 and last 10 pages of uncorrected machine-read text (when available) of this chapter, followed by the top 30 algorithmically extracted key phrases from the chapter as a whole.
Intended to provide our own search engines and external engines with highly rich, chapter-representative searchable text on the opening pages of each chapter. Because it is UNCORRECTED material, please consider the following text as a useful but insufficient proxy for the authoritative book pages.
Do not use for reproduction, copying, pasting, or reading; exclusively for search engines.
OCR for page 30
Learning and Instruction: A SERP Research Agenda 2 Reading Mastering the mechanics of fluent reading and the ability to comprehend text provides a key to acquiring knowledge in all other domains of learning. Given the escalating demands for text comprehension that pervade virtually every aspect of contemporary life in the United States, as well as the stagnating performance of students in reading mastery and reading comprehension, strengthening the knowledge base in ways that can support practice should be a high priority. This chapter is divided into two parts: one on early reading and one on reading comprehension beyond the early years. In many respects the parts overlap: teacher education is a major theme in both, as is research and development to improve instructional interventions. In the school context, reading is treated differently in the early years than it is in the years after third grade. From fourth grade on, the emphasis switches from learning to read to reading to learn. Because a central purpose of the SERP work is to provide R&D that is useful to practice, we adopt the division used by schools. We would expect the SERP R&D network to operate in a highly interactive fashion, with research and methods used on one set of questions informing those used on other, related research efforts.
OCR for page 31
Learning and Instruction: A SERP Research Agenda EARLY READING STUDENT KNOWLEDGE The Destination: What Should Children Know and Be Able to Do? There is an unusual degree of consensus regarding the goals of early reading instruction. The consensus is captured in the National Research Council report, Preventing Reading Difficulties in Young Children (National Research Council, 1998) and in the report of the National Reading Panel, Teaching Children to Read (National Institute of Child Health and Human Development, 2000). The goals are often expressed in terms of the competencies children should be able to demonstrate at the end of third grade: (a) reading age-appropriate literature independently with pleasure and interest, (b) reading age-appropriate explanatory texts with comprehension for the purpose of learning, and (c) talking and writing about those texts in age-appropriate ways. Achieving these goals requires simultaneous development of an interdependent set of abilities: decoding skills, reading fluency, oral language development, vocabulary development, comprehension skills, and the ability to encode speech into writing. The Route: Progression of Understanding The foundation for early reading lies in the earlier, informal acquisition of language. With little effort, children with intact neurological systems acquire the sounds of their language, its vocabulary, and its methods of conveying meaning (National Research Council, 1998). The path that children travel in acquiring language is predictable (National Research Council, 1998), although the age at which particular skills and abilities are mastered varies somewhat. Babies comprehend words during the first year of life generally well before they can produce them. Once production begins, usually during the second year, vocabulary grows steadily, and single word utterances become sentences that increase in length and complexity. As the ability to produce and understand more complex sentences develops, children are less reliant on the immediate context to support
OCR for page 32
Learning and Instruction: A SERP Research Agenda meaning. This “decontextualized” language eases the transition to school, where it is the common parlance. As proficiency with language use grows, children develop the ability to think about language. Before that ability develops, they do not distinguish between the word and the object to which it refers. “Snake” is thus deemed to be a “long” word, and “caterpillar” a “short” word (National Research Council, 1998:50). Children can begin to develop rudimentary metalinguistic skills as early as age 3. Acquiring this ability allows children to play with, analyze, and pass judgment on the correctness of language. The trajectory of language development described above is universal, although the richness of the environment affects the pace and extent of language development powerfully (Hart and Risley, 1995; Huttenlocher, 1998). For example, Graves and Slater (1987) found that first graders from higher income families had a vocabulary that was double the size of those from lower income families. The differences are highly relevant because verbal ability generally, and vocabulary development particularly, are good predictors of success in early reading. While normal language development supports reading acquisition, other abilities required for effective reading mastery are unlikely to develop unless children receive formal instruction. With few exceptions, children need systematic instruction in the alphabetic principle to learn to decode words and to learn how to encode words in writing (Adams et al., 1998). This instruction is what is referred to as “phonics.” But successful phonics instruction rests on a more fundamental ability: phonemic awareness. This is the awareness, for example, that the word “cat” consists of three separable sounds: c/ a/ t. The distinction is important because phonics instruction that teaches the mapping of separate sounds onto letters requires for success that a student hear those separate sounds. Learning the alphabetic principle is a prerequisite to reading. However, it is not nearly sufficient to help children reach the desired third grade competencies. Phonics instruction must be integrated with comprehension instruction, opportunities to develop fluency in reading through practice, instruction to enhance and practice oral and written language abilities, and opportunities to acquire rich vocabulary and background knowledge. The failure of any one of these will result in falling short of the third grade goals. If fluency does not develop, little mean-
OCR for page 33
Learning and Instruction: A SERP Research Agenda ing is taken from a text that a child must plod through. If background knowledge is inadequate, even a fluent reader will be unable to engage with and learn from the text. The components of successful reading are tightly intertwined. There is strong empirical support, for example, for the relationship between young children’s oral language and subsequent reading proficiency (Bishop and Adams, 1990; Scarborough, 1989; Share et al., 1984). Oral language, vocabulary in particular, is essential for understanding the text that is read. In addition recent longitudinal research suggests that young children’s vocabulary is associated with improved decoding skills (Lonigan et al., 2000; Wagner et al., 1997), as well as growth in phonological sensitivity (Bowey, 1994; Lonigan et al., 1998, 2000; Wagner et al., 1993, 1997). In addition to building vocabulary, oral language instruction can extend a child’s ability to understand and use academic, or literate, language. This is the decontextualized language that minimizes contextual cues and shared assumptions (e.g., by explicitly encoding referents for pronouns, actions, and locations; Olson, 1977; see Box 2.1).1 These extensions of discourse in the decontextualized register of academic language are what predict literacy success into middle school, controlling for home variables (Dickinson and Sprague, 2001). These relationships between preschool oral language and middle school reading comprehension are clearly mediated by decoding instruction in the primary grades (Whitehurst and Lonigan, 2001). But the point is that language intervention that builds vocabulary and decontextualized language structures needs to occur prior to and during decoding instruction, rather than later. Writing is at the heart of mastering the alphabetic system. Writing starts with the encoding of speech to print. The ability to phonemically segment sounds in speech and represent them in conventional writing develops over time. A complete repre- 1 Decontextualized language is at the core of literacy instruction because it allows literate individuals to communicate without personal interaction. This literate language or academic language is a specific oral language register valued in traditional schooling (Cook-Gumperz, 1973; Heath, 1983). For example, in conversation we rely on shared context to disambiguate pronouns and referents in the sentence “He wants to go there next time.” In written language we are expected to clarify the who, where, when (e.g., Sally wants to go to the beach the next time you make a trip.)
OCR for page 34
Learning and Instruction: A SERP Research Agenda sentation of a word’s spelling in memory developed through writing will enhance the speed and accuracy with which it is recognized (Ehri, 1998; Perfetti, 1992). Thus, the writing of words supports the reading of words and, over time, builds toward the writing of text, which can support the comprehension of text. In addition to understanding the contributors to successful reading acquisition, there is also an extensive research base on the typical hurdles that children encounter (National Research Council, 1998; National Institute of Child Health and Human Development, 2000). It is now well established that a significant number of children have difficulty learning the alphabetic principle because they have not developed phonemic awareness. Among children who learn to decode words but do not comprehend well, fluency is often the culprit; if children struggle slowly through a text, their comprehension when they have finished will be poor. Fluency can suffer if children spend too little time actively engaged in effective reading practice, or if vocabulary and background knowledge are too weak to allow the student to read with understanding. BOX 2.1 Decontextualized Language Instruction in the Early Years Links between decontextualized language and literacy have been made by Dickinson and his colleagues in a longitudinal study of 85 children from low-income families started in 1987 (Dickinson and Tabors, 2001; Dickinson and Sprague, 2001). Significant prekindergarten variables that influenced literacy development were quality of teachers’ talk and curriculum quality. Quality of teacher talk was measured in rare word usage, ability to listen to children and to extend their comments, and tendency to engage children in cognitively challenging conversations (i.e., conversations about nonpresent topics). The prekindergarten variables of quality of teacher talk, vocabulary environment, and curriculum quality predicted kindergarten outcomes above and beyond home variables, thereby emphasizing the importance of instruction in literate language and a quality emergent literacy curriculum in preschool classrooms for children from low-income homes. Composite variables that significantly influenced kindergarten literacy and vocabulary scores were home variables of literacy support, density of rare words used, and extended discourse. Kindergarten outcomes in turn predicted vocabulary and reading comprehension scores in middle school (Dickinson and Sprague, 2001).
OCR for page 35
Learning and Instruction: A SERP Research Agenda The Vehicle: Curriculum and Pedagogy Because there is general agreement on the goals of early reading instruction and a fairly solid research base on the contributors to success in achieving those goals, the targets of quality early reading instruction are fairly clear: phonemic awareness and phonemic decoding skills, fluency in word recognition and text processing, construction of meaning, vocabulary, spelling, and writing (Foorman and Torgesen, 2001). Box 2.2 reproduces the curricular components for first to third grade recommended by the National Research Council Committee on the Prevention of Reading Difficulties in Young Children. Knowing the components of effective instruction is critical, but it is only a start. It falls far short of knowing how to effectively integrate the various components, how to allocate time among those components, and how to carry out instruction effectively in a classroom context in which children differ significantly in their preparation for learning and rate of progress on each of the components. And when a goal of instruction is to motivate children to read for pleasure, the how of instruction is at least as important as the what. The research literature makes clear that there is no single answer to the instructional questions posed (National Research Council, 1998; Fletcher et al., 2002). Effective reading teachers use a variety of instructional strategies and curricula successfully. For example, while teaching phonics is a critical component of effective instruction, there are multiple approaches to doing so effectively (see Box 2.3). Many teachers rely largely on basal readers for teaching the alphabetic principle, supplemented by trade books for children’s reading practice, guided reading for comprehension instruction, and books read aloud for vocabulary development and further comprehension modeling. Other teachers place more emphasis on children’s writing as one source of instruction about the alphabetic principle, systematic minilessons in grapheme-phoneme correspondences using word sorts and other procedures (but no basals), and careful assignment of trade books to children for practice and comprehension instruction. Some reading curricula that have shown gains for groups of at-risk children involve fairly strict adherence to instructional scripts to deliver all the literacy instruction to highly homogeneous reading groups, whereas others use
OCR for page 36
Learning and Instruction: A SERP Research Agenda BOX 2.2 Curriculum Components for Reading Instruction in First Through Third Grade Beginning readers need explicit instruction and practice that lead to an appreciation that spoken words are made up of smaller units of sounds, familiarity with spelling-sound correspondences and common spelling conventions and their use in identifying printed words, “sight” recognition of frequent words, and independent reading, including reading aloud. Fluency should be promoted through practice with a wide variety of well-written and engaging texts at the child’s own comfortable reading level. Children who have started to read independently, typically second graders and above, should be encouraged to sound out and confirm the identities of visually unfamiliar words they encounter in the course of reading meaningful texts, recognizing words primarily through attention to their letter-sound relationships. Although context and pictures can be used as a tool to monitor word recognition, children should not be taught to use them to substitute for information provided by the letters in the word. Because the ability to obtain meaning from print depends so strongly on the development of word recognition accuracy and reading fluency, both of the latter should be regularly assessed in the classroom, permitting timely and effective instructional response when difficulty or delay is apparent. Beginning in the earliest grades, instruction should promote comprehension by actively building linguistic and conceptual knowledge in a rich variety of domains, as well as through direct instruction about such comprehension strategies as summarizing the main idea, predicting events and outcomes of upcoming text, drawing inferences, and monitoring for coherence and misunderstandings. This instruction can take place while adults read to students or when students read themselves. heterogeneous grouping for most instruction, reverting to homogeneous grouping only to teach specific skills. To extend the metaphor, there are different vehicles that are capable of making the journey to the desired destination. But the route traveled by any vehicle must cover certain territory to reach the destination, including decoding territory, oral language and vocabulary development territory, comprehension territory, and writing territory. But while there are multiple instructional approaches used by effective teachers, there are many ineffective teachers whose students do not reach the destination at all. The National Assessment of Educational Progress (NAEP) for the year 2000 found 37 percent of all fourth graders and 60 percent of black and Hispanic graders reading below the
OCR for page 37
Learning and Instruction: A SERP Research Agenda Once children learn some letters, they should be encouraged to write them, to use them to begin writing words or parts of words, and to use words to begin writing sentences. Instruction should be designed with the understanding that the use of invented spelling is not in conflict with teaching correct spelling. Beginning writing with invented spelling can be helpful for developing understanding of the identity and segmentation of speech sounds and sound-spelling relationships. Conventionally correct spelling should be developed through focused instruction and practice. Primary grade children should be expected to spell previously studied words and spelling patterns correctly in their final writing products. Writing should take place regularly and frequently to encourage children to become more comfortable and familiar with it. Throughout the early grades, time, materials, and resources should be provided with two goals: (a) to support daily independent reading of texts selected to be of particular interest for the individual student and beneath the individual student’s frustration level, in order to consolidate the student’s capacity for independent reading, and (b) to support daily assisted or supported reading and rereading of texts that are slightly more difficult in wording or in linguistic, rhetorical, or conceptual structure in order to promote advances in the student’s capabilities. Throughout the early grades, schools should promote independent reading outside school by such means as daily at-home reading assignments and expectations, summer reading lists, encouraging parent involvement, and working with community groups, including public librarians, who share this goal. SOURCE: National Research Council (1998). “basic” level (National Center for Education Statistics, 2001).2 It is therefore of utmost importance that knowledge gleaned from the study of effective practice and from research on reading instruction be carefully articulated, tested in rigorous research, and incorporated into instructional programs and into teacher education programs. Checkpoints: Assessment The general consensus in the field of early reading that has emerged from a relatively strong research base extends to the 2 Categories include below basic, basic, proficient, and advanced.
OCR for page 38
Learning and Instruction: A SERP Research Agenda early indicators of reading difficulties. Effective indicators are emerging from longitudinal databases (e.g., Fletcher et al., 2002; O’Connor and Jenkins, 1999; Scarborough, 1998; Torgesen, 2002; Vellutino et al., 2000; Wood et al., 2001). These indicators can provide valuable information to teachers regarding the instructional needs of individual students. Predictiveness of particular skills depends on how and when they are assessed, but, in general, phonological awareness and its theoretically related construct of letter-sound knowledge in kindergarten and the beginning of first grade are predictive of first grade outcomes, as is word recognition at the beginning of first grade. In second grade word reading continues to be a strong predictor of second grade outcomes, with reading fluency and reading comprehension becoming increasingly important predictors of reading outcomes. For children at risk of reading difficulties due to poverty and language background, oral language in general and vocabulary in particular are critical to reading success (Foorman et al., in press; National Research Council, 1998; Dickinson and Tabors, 2001). There are a number of models for screening children in kindergarten, first grade, and second grade for reading prob- BOX 2.3 Phonics Instructional Approaches Analogy phonics: teaching students unfamiliar words by analogy to known words (e.g., recognizing that the rime segment of an unfamiliar word is identical to that of a familiar word, and then blending the known rime with the new word onset, such as reading brick by recognizing that ick is contained in the known word kick, or reading stump by analogy to jump). Analytic phonics: teaching students to analyze letter-sound relations in previously learned words to avoid pronouncing sounds in isolation. Embedded phonics: teaching students phonics skills by embedding phonics instruction in text reading, a more implicit approach that relies to some extent on incidental learning. Phonics through spelling: teaching students to segment words into phonemes and to select letters for those phonemes (i.e., teaching students to spell words phonemically). Synthetic phonics: teaching students to explicitly convert letters into sounds (phonemes) and then blend the sounds to form recognizable words. SOURCE: National Institute of Child Health and Human Development (2000).
OCR for page 39
Learning and Instruction: A SERP Research Agenda lems.3 These assessments engage teachers—some more and some less formally—in collecting data on which to base curricular decisions about individual children. Both the Texas Primary Reading Inventory (TPRI) and the Virginia Phonological Awareness and Literacy Screening (PALS) have been implemented on a statewide basis. Many children who master the process of reading nonetheless do poorly at developing broader literacy skills (RAND, 2002a). While there are fairly good predictors of difficulty in learning to read, predictors of comprehension problems are less well developed. Assessments of vocabulary and writing ability, both of which support comprehension, are underdeveloped. While there are many standardized tests of vocabulary and writing in use, they provide only normative information relative to students in the same age or grade and therefore are not adequate to provide individual feedback that can guide instruction. Vocabulary tests that assess the breadth and depth of word meanings are required to give teachers information about which words to target for instruction. Likewise, writing protocols that are evaluated for spelling, mechanics, grammar, word choice, ideas, and organization are needed to provide the basis for the revision process so fundamental to the development of skilled writing. TEACHER KNOWLEDGE Reading teachers need to understand the current state of knowledge on the course of literacy development, and the role of reading instruction in supporting that development. The specific areas of study that would align teacher preparation with the learning experiences that should be provided to children in the classroom are outlined in detail in Preventing Reading Difficulties (National Research Council, 1998:285-287). We are far from the goal of effectively providing all reading teachers with 3 These include the Observation Survey developed in New Zealand (Clay, 1993); the South Brunswick, New Jersey, Early Literacy Portfolio (Salinger and Chittenden, 1994); the Primary Language Record (Barr et al., 1988); the Work Sampling System (Meisels, 1996-1997); the Texas Primary Reading Inventory; and the Phonological Awareness and Literacy Screening developed at the University of Virginia (see Foorman et al., 2001, for summaries of all of these programs).
OCR for page 40
Learning and Instruction: A SERP Research Agenda access to that knowledge base. But we know a great deal about what the knowledge is. There are two major teaching challenges, however, that are likely to require more than understanding the knowledge base: integrating the components of early reading instruction into an effective reading program and differentiating instruction for children with different competences. Integrating Instruction Knowing the components of effective reading instruction does not ensure that a teacher will be able to integrate these in practice. With the multiple demands of managing a classroom, teachers often look to curriculum materials to simplify their complex task. For the majority of teachers in the United States, these are basal readers (National Research Council, 1998). The content of the basals influence’s how teachers allocate instructional time. The research base on phonics instruction is stronger than that on vocabulary instruction, oral language instruction, writing, and comprehension. Perhaps because dimensions of effective phonics instruction are better defined, basal reading programs place more emphasis on phonics. In many places, considerably more time is now invested in phonological awareness teaching and practice than would be recommended based on the research, which suggests that 18-20 hours is sufficient (National Institute of Child Health and Human Development, 2000). With little attention paid to vocabulary and writing instruction in the basals, Foorman and Schatschneider (in press) observed little attention to these critical activities (i.e., less than 10 percent of instruction) in observations of 114 first and second grade teachers in 17 high-poverty schools. The National Reading Panel concluded that “teachers must understand that…. systematic phonics instruction should be integrated with other reading instruction in phonemic awareness, fluency, and comprehension strategies to create a complete reading program” (National Institute of Child Health and Human Development, 2000:11). But this is not now standard practice. Differentiating Instruction Children who have mastered the alphabetic principle simply do not need phonics instruction that is as intense as that needed by their peers who have not achieved such mastery. Furthermore, as Box 2.2 suggests, a critical aspect of an effective instructional program is daily practice reading
OCR for page 55
Learning and Instruction: A SERP Research Agenda The Reader The capacity to comprehend text varies enormously across students. Some of the contributors to that variation are well established (see National Institute of Child Health and Human Development, 2000, and RAND, 2002a, for elaboration). These include the following: Comprehension capacity builds on successful initial reading instruction; Comprehension capacity is coincident with good oral language skills (vocabulary and listening comprehension); Students who have had rich exposure to literacy experiences are more likely to succeed at reading comprehension; Maturing cognitive capacities, including attention, memory, analytical ability, inferencing ability, and visualization ability, contribute to comprehension ability; Good comprehenders actively monitor their understanding and use strategies that help them retain, organize, and evaluate information; The growing store of background knowledge acquired both inside and outside school contributes to comprehension capacity; and The motivation that the student brings to reading contributes to comprehension. The Text Features of a text can facilitate or complicate comprehension. But the relationship is not simple. We know how to make a text easy or hard to read, for example, by controlling vocabulary and syntax, by using an appropriate rhetorical structure, and by calibrating the information in the text to the readers’ prior knowledge. However, what is crucial for comprehension is neither the reader nor the text alone, but the reader-text interaction. The goal is to engage the reader as actively as possible, so that the reader will utilize his or her prior knowledge to make inferences and construct a situation model that integrates this prior knowledge with the newly acquired textual information. A text designed to be maximally readable may leave the reader passive, resulting in the readers’ knowing the textbook by heart (and doing very well on an exam that tests for rote knowledge). But that knowledge may be inert, inflexible knowl-
OCR for page 56
Learning and Instruction: A SERP Research Agenda edge that will not help the student to solve novel problems and understand new texts requiring that the knowledge be brought to bear. The problem, then, requires careful attention. If the text is too hard and relies on background knowledge that the reader does not have, he or she will not be able to construct a good situation model and comprehension will fail. If it is too easy, comprehension may remain superficial. The Activity The pedagogical problem for comprehension is to get the reader to engage in the right kind of processing, in which what is “right” depends on the purpose of the activity. Different purposes for engaging with text place very different demands on the reader and suggest different standards for adequate comprehension. Skimming a text for particular information that can help solve a problem is quite different from studying a text to be conversant with its entire content. Reading a novel for pleasure imposes different demands from reading the same novel in order to critique features of the author’s technique and style. The same reader may have good comprehension skills for one purpose and weak skills for another. Assessing progress and making course corrections both require focus on all three factors. While strengthening a particular weakness of the reader may be the appropriate response to inadequate progress in some cases, providing a text that is more appropriate to the reader’s background knowledge or providing activities that have a greater capacity to engage the student may be more appropriate in others. The teacher’s task is complex. Assessments that can assist a teacher in diagnosing the nature of the problem for an individual student have not yet been developed. TEACHER KNOWLEDGE What do we want teachers to know and be able to do with respect to reading comprehension? The answer proposed in the RAND report is to “enact practices that reflect the orchestration of knowledge about readers, texts, purposeful activity, and contexts for the purpose of advancing students’ thoughtful, competent, and motivated reading”(RAND, 2002a:29-30). That orchestration is highly complex because the amount of support that individual students need is likely to differ considerably, and
OCR for page 57
Learning and Instruction: A SERP Research Agenda because the support any given student needs may change with different texts. This kind of “adaptive expertise” requires that a teacher have a deep understanding of comprehension processes and approaches to supporting them. Mastering decontextualized rules of instruction will not be adequate (National Research Council, 2000). Metacognitive strategy instruction is a case in point. To teach metacognitive strategies effectively, teachers must have a good grasp themselves of the text content and of the strategies. But their knowledge must be conditionalized; they must know which strategies are most effective for which students and which types of content. They must be able to respond flexibly and opportunistically when the intervention is needed to aid student comprehension rather than using strategy instruction as the end in itself. Research by Palincsar et al. (1989) suggests that the preconceptions that many teachers hold regarding student learning are at odds with the research-based conceptions incorporated in reciprocal teaching. In one study with first grade teachers, for example, the teachers’ own goals for student listening comprehension emphasized the ability to follow a sequence of directions, and instruction was limited to the support of that goal. The teachers believed that collaboratively constructing the meaning of text was beyond their students’ abilities. Pilot studies of reciprocal teaching using teachers whose beliefs were in accordance with the program showed significant gains for 85 percent of students. But in the hands of first grade teachers with discordant beliefs, only 47 percent of their first graders showed comparable improvement, even after the teachers were trained in the technique by the researchers. In other work as well, Palincsar and her colleagues found that teachers who conceptualize reading as a sequence of isolated skills require considerable support and coaching to overcome the propensity to use the strategies in a routine fashion. Without that support, their students show gains in tests of strategy use, but not in reading comprehension (Palincsar, 1986). Teachers’ conceptions regarding collaborative learning more generally diverge from the research base as well. While research suggests that student performance in collaborative groups exceeds individual performance, teachers generally believe that collaborative groups support social goals but not cognitive gains (Palincsar et al., 1989).
OCR for page 58
Learning and Instruction: A SERP Research Agenda The National Reading Panel reviewed quantitative studies of teacher preparation in the area of strategy instruction for reading comprehension and found four that met their methodological criteria. The conclusions drawn from these few studies reinforce the findings above, suggesting that to be effective teachers required extensive instruction in explaining what they were teaching, modeling their thinking processes, encouraging student inquiry, and keeping students engaged. But the studies provided little guidance on which aspects of the teacher preparation were most effective (National Institute of Child Health and Human Development, 2000). RESEARCH AGENDA In the area of reading comprehension, the panel proposes four initiatives: to conduct R&D on assessments of reading comprehension; to conduct R&D on the teacher knowledge requirements for effective use of proven approaches to metacognitive strategy instruction; to advance the knowledge base on the components of effective comprehension instruction across grades; and to undertake a benchmarking effort to define expectations for comprehension across the school years. Initiative 1: Assessments of Comprehension All research on the effectiveness of interventions to support reading comprehension requires that the phenomenon of comprehension be measured. In laboratory research, different levels of text comprehension can be distinguished (Kintsch, 1998; Graesser et al., 1997). Comprehension can be deep in the sense that the information is integrated with prior knowledge and can be used for problem solving or other purposes. In contrast, comprehension can be shallow, focusing on the text itself. In this case, new knowledge is inert; it is not integrated into the reader’s general knowledge base or used when applicable for problem solving. Current reading comprehension assessments do not effec-
OCR for page 59
Learning and Instruction: A SERP Research Agenda tively capture this distinction. Tests that are widely used today require students to answer questions that often assess only superficial aspects of comprehension. If deeper understanding of text is the goal of instruction, those tests will be inadequate to inform decisions about instructional effectiveness. Indeed, Box 2.5 suggests that inferencing ability and recall are different aspects of comprehension, and measuring recall only can be highly misleading. New assessments must therefore be a high priority. Since comprehension is not a unitary process, it is necessary to assess separately the different components of comprehension. Just how many independent components exist is a matter of some disagreement (Pearson and Hamm, 2002). Rigorous research to push further on a working answer to that question is under way and should be continued and extended. Hannon and Daneman (2001), for example, designed a comprehensive test that measures four different components of comprehension: a reader’s ability to recall a text, the ability to make inferences based on explicitly stated facts, the ability to access general word knowledge, and the ability to make inferences that require integration of prior knowledge with text information. These four components proved to be good predictors of performance on a variety of comprehension tasks. Kintsch et al. (2001) pursued a similar goal when they assessed separately how well people could reproduce a text and how well they could answer simple problem-solving (inference) tasks for which information in that text is required. Importantly, promising initial developments must be followed through to ensure both their validity and their practicality. Evaluation of internal construct validity examines how well the assessment explains comprehension performance in com- BOX 2.5 Measuring Recall Alone Does Not Measure Comprehension In a study by Mannes and Kintsch (1987), students read one of two versions of a chapter: one was well organized and explicit; the other was slightly disorganized and left some things unsaid. When asked to recall the chapter, the well-organized version produced 25 percent more recall. However, when understanding was tested by inference questions, the less explicit version was better by 75 percent. Making readers draw their own inferences when studying had its benefits, but if measured by a test that merely required them to reproduce the text, the reverse would appear true.
OCR for page 60
Learning and Instruction: A SERP Research Agenda parison to what is considered a reliable measure of that performance. The benchmark might be the ratings on one or more indepth interviews that thoroughly explore and rate students’ comprehension of a text. Questions of practicality must also be investigated. Measuring comprehension could be made more reliable if testing time and scoring time were not constraints. However both are valuable resources, and balancing quality and practicality will require attention. Box 2.6 gives an example from the recently revised SAT. It provides a measure of deep comprehension in the very practical (for scoring purposes) multiple-choice format. But perhaps most importantly for improving educational outcomes, the instructional validity of the assessment must be investigated: Does it provide information that can be used to productively shape an understanding of the student’s instructional needs? Can it help guide the teacher’s instructional decisions? The SAT question posed in Box 2.6 provides insight into the student’s ability to understand the literary use of a word in context that requires a fairly sophisticated understanding. But BOX 2.6 Comprehending Text on the Revised SAT In its recent revision of the SAT, the College Board includes the item below in the verbal section: Dinosaurs have such a powerful grip on the public consciousness that it is easy to forget just how recently scientists became aware of them. A 2-year-old child today may be able to rattle off three dinosaur names, but in 1824, there was only one known dinosaur. Period. The word “dinosaur” didn’t even exist in 1841. Indeed, in those early years, the world was baffled by the discovery of these absurdly enormous reptiles. The statement “Period” in the middle of the paragraph primarily serves to emphasize the: authoritative nature of a finding lack of flexibility in a popular theory stubborn nature of a group of researchers limited knowledge about a subject refusal of the public to accept new discoveries Answer: (D). SOURCE: Education Week (2002).
OCR for page 61
Learning and Instruction: A SERP Research Agenda the assessment information becomes useful for instruction only if instructional approaches to developing that understanding are known and available to teachers. While we discuss this research first, clearly the ongoing work of developing and improving assessment tools must be directly influenced by other components of the research agenda. The definition of comprehension used to establish internal validity will depend on what one wants students to know and be able to do. As research knowledge improves, the benchmarks change (see Initiative 4), and so must the assessments. SERP will be a particularly productive environment for this iterative work, because the research on these interdependent questions is conducted within a single, well-integrated network. Initiative 2: Teacher Knowledge and Metacognition Strategy Instruction While reading comprehension has been defined as upstream because much of the fundamental work to understand and measure the phenomenon has not yet been done, strategy instruction provides an opportunity for improving comprehension that is further downstream. Several programs, including reciprocal teaching, text talk, and questioning the author, provide clearly articulated approaches to metacognitive strategy instruction that substantially improve reading comprehension, particularly for struggling students. While the techniques involved can be simply and briefly described, to effectively execute strategy instruction in the classroom proves a challenge for many teachers. The panel therefore recommends an R&D effort to develop instructional materials, protocols, and supports for teachers who are learning to use strategy instruction in the classroom. The effort should include careful identification of teacher conceptions regarding student learning and effective instruction in reading comprehension, as well as their divergence with the research base that undergirds the intervention.5 Instructional 5 Clearly there is overlap across disciplines in research on teacher conceptions of student learning and of effective teaching. One benefit of carrying out a program of research in the context of a network on learning and instruction is that the work on various research projects within the network would be closely integrated and designed so that results can easily be compared and accumulated.
OCR for page 62
Learning and Instruction: A SERP Research Agenda experiences that can support conceptual change should be developed and tested for effectiveness. Because reading comprehension is a problem across all disciplines, the research should be conducted separately with teachers in different fields. The nature of the texts that allow teachers to master the nuances of matching strategy use with text type and comprehension goals should be studied carefully. As in the teacher learning initiative in early reading, a variety of tools for supporting teacher learning should be considered separately and in combination. The development should be undertaken as a research effort, in which program components or tools are tried and tested with classroom teachers. Dimensions of variation to be studied should include discipline and grade level taught, experience level, and school demographic characteristics (e.g., suburban high-scoring schools, in urban low-scoring schools, schools serving language minority learners). The products should be tested during and after development for their impact on teacher understanding, changes in practice, and attitudes toward the product or program. Dimensions of effective use should also be examined, including the time and feedback required for mastery. Initiative 3: Instructional Practices to Support Reading Comprehension The variety of contributors to successful reading comprehension listed above suggest there are many potentially productive avenues for improving student performance. But from the perspective of practice, the list begs for greater clarity regarding which factors have the greatest capacity to influence comprehension outcomes, which can be most effectively influenced instructionally, and which interventions are most productive, in which combinations, at which ages. Indeed, these questions are so fundamental to practice in so critical an area that our current ignorance is rather astonishing. Research could be designed to test the “which” questions in much the same way as research on effective reading instruction in earlier years. Teachers who consistently beat the odds with the performance of their students in the area of reading comprehension could be identified and compared with other teachers whose students consistently achieve less. The observation would include the constellation of practices that they employ,
OCR for page 63
Learning and Instruction: A SERP Research Agenda the mix of activities, the distribution of time spent on various tasks, and the assessment measures to which they attend and respond. This work must be coupled with research to test the core hypotheses experimentally, so that the causal mechanisms are clarified. As with reading instruction in the earlier years, features are likely to differ by grade and by the average achievement level and language development of the students in the classroom. Designing the research to look at various levels (e.g., third, sixth, and ninth grade) and at classrooms chosen to represent a wide variety of demographic factors (e.g., in suburban high-scoring schools, urban low-scoring schools, schools serving language minority learners) would again be required to draw implications for practice with specific attention to differences for students in different demographic groups and in different grades. The next phase of R&D would involve the design of interventions that incorporate those components into instruction systematically, in an effort to verify their effectiveness experimentally, and to assess their efficacy with a wider array of students and reading curricula or subject matter. The interventions should address both teacher learning and student learning. The design and testing phases of the development projects would look much like those in the initiative on early reading interventions. An important benefit of an R&D network is that the expertise in doing this type of work begins to accumulate in an organizational setting in which what is learned—both in research outcomes and in the conduct of research and development—has a continuing influence on future R&D projects and designs. Initiative 4: Benchmarks for Comprehension Simultaneously with the efforts to explore, identify, then rigorously test best practices in comprehension instruction, it is crucial that the educational research and practice communities collaborate with stakeholders, such as future employers, faculty in community colleges and universities, and others interested in educational outcomes, to define what adequate reading comprehension is for readers of various ages. The SERP networks are in a unique position to engage in this kind of stock-taking on
OCR for page 64
Learning and Instruction: A SERP Research Agenda a regular basis. Indeed, this is an important raison d’être of the networks. Ultimately, of course, defining what readers should be able to comprehend constitutes a decision based on a society’s values and willingness to invest in education as much as it does on research. Research can make a unique contribution, however, regarding what is achievable at what ages. Examples include research on children’s developing abilities to consider simultaneously opposing perspectives, to understand the motivations and intentions of others, and to distinguish between their own beliefs and knowledge. Furthermore, establishing reasonable benchmarks for comprehension can be informed by considering historical, international, and economic perspectives. A useful place to begin is with an understanding of the endpoint. What should an 18-year-old be able to comprehend? One dimension that would enter into any benchmarking process is defined by the complexity of the text she or he might be expected to read. Presumably 18-year-olds should be expected to understand general-purpose texts—newspapers, magazines, novels, popularized presentations of science or history, introductory university level textbooks—with no difficulty. Reading these texts presupposes a minimum vocabulary of 40,000 words, the capacity to process fairly complex syntax, and some flexibility in processing various discourse structures. But the readability or complexity of the text is only one dimension defining comprehension level. Another is the depth of processing that one can expect of the text being read. One might well expect an 18-year-old to understand nonliteral uses of language in text, for example, irony, parody, sarcasm; to appreciate stylistic niceties in text; to consider the possibility that “factual” texts include intentional misrepresentations, biased or limited perspectives, incomplete representations of reality, and errors; to process fiction as being about themes or issues and not just about plot; to appreciate cogent arguments in texts with which the reader nonetheless disagrees; and to read for attitude and perspective rather than just for information. If the capacities outlined above can reasonably be expected of an 18-year-old reader, then what are the developmental benchmarks that characterize progress toward that point? Once the endpoint is established, it is relatively easy to work backward in order to define the expected comprehension capacity of younger students. If these are defined for the dimension of text complex-
OCR for page 65
Learning and Instruction: A SERP Research Agenda ity, then a linear projection is probably reasonable: children learn a certain number of new vocabulary words a year, and there is no strong reason to believe, for example, that during some years they can only learn fewer and during other years can learn more. But the depth-of-processing dimension is limited by children’s cognitive capacities—their theory of mind level, their capacities to take others’ perspectives, to coordinate multiple perspectives, and to distinguish belief from knowledge. We would need to call on the knowledge built up from basic research in cognitive development in order to establish reasonable expectations about children’s capacities for deeper processing of texts. Elaborations of that work might well be helpful in deciding at what age the majority of children would be most susceptible to being taught about multiple perspectives in text, or about the use of textual features to raise doubts or questions, or other subtleties of processing. Thus benchmarks for comprehension, while not themselves a simple matter of drawing conclusions from research findings, could be deeply informed by a set of research activities that considered both basic cognitive development and the array of standards identified by various groups with a wide array of interests and experiences. Establishing an initial set of benchmarks, and developing assessments of them, would help improve outcomes in reading comprehension simply by proffering a common understanding of what needs to be taught and learned. The initial set of benchmarks should be subject to regular review and recalibration. In fact, the comprehension-instruction agenda outlined above and the benchmarking agenda sketched here should be constantly confronting one another. As improved instruction in reading comprehension raises learners’ capacities, the benchmarks can be ratcheted up to ensure that the proper balance between high standards and opportunities to succeed is maintained.
Representative terms from entire chapter: