Issues In Educational Research, 10(1), 2000, 1-20.

Effectiveness of a metacognitive reading program for poor readers

Merle E. Bruce
Avondale College

Gregory L. Robinson
The University of Newcastle

This paper reports on the second of two studies designed to assess the effectiveness of a metacognitive approach to teaching word identification and reading comprehension skills to upper primary poor readers, and to investigate effective methods for implementing the program in the regular classroom. To improve word identification skills, experimental subjects were given metacognitive training in the analysis and monitoring of word identification strategies. Reciprocal teaching procedures, incorporating the word identification strategies, were used for comprehension training. Subjects in control conditions received either (a) normal classroom reading activities, or (b) normal classroom activities plus phonics-based remedial instruction. To facilitate implementation of the program in the regular classroom a three phase model was used during which responsibility for instruction was gradually passed from the experimenter to the class teacher. Measures of (a) word identification, (b) metacognitive awareness of word identification cues, and (c) comprehension were taken on several occasions during the study.

Results of repeated measures analysis of variance showed significantly greater improvements for subjects in the experimental condition. However, most of the improvements took place in the experimenter-led, rather than the teacher-led phase of the Study. The implications of these findings for classroom practice are discussed in the light of current research.


Introduction

Recent Australian surveys suggest that somewhere between 10% and 20% of primary school children have persistent and significant problems in learning to read (House of Representative Standing Committee on Employment, Education and Training, 1992; Waring, Prior, Sanson, & Smart, 1996). Research indicates that for the majority of poor readers the basic source of their difficulty is failure to develop accurate and efficient (i.e., automatic) word recognition skills (Stanovich, 1986, 1992). Poor decoding skills may, in turn, place comprehension processes at risk, due in part to the fact that poor readers devote so much attention to the decoding task that there are not enough cognitive resources left for construction of meaning (Näslund, & Samuels,1992; Stanovich, 1986, 1992). Furthermore, children who fail to develop good word recognition skills in the early grades begin to dislike reading and hence avoid reading wherever possible. This lack of practice in turn further inhibits growth in reading (Juel, 1988; Stanovich, 1986, 1992, 1993-1994). In addition, affective and motivational problems resulting from repeated failure can lead to attitudes of "learned helplessness" whereby students give up trying and so perpetuate the failure cycle (Borkowski, Carr, Relinger, & Pressley, 1990; Paris & Winograd, 1990).

Although the consequences of a number of years of reading failure suggest a poor prognosis (Juel, 1988; Stanovich, 1986, 1992; Waring et al., 1996), there are also some positive implications for educational practice. This may be particularly so in the area of metacognitive functioning, i.e., in awareness and regulation of appropriate strategies for identifying unfamiliar words (Spedding & Chan, 1993, 1994; Stanovich, 1986). In particular, research by Spedding and Chan (1993, 1994) confirmed that Year 5 poor readers' problems with word identification may reflect deficiencies in the metacognitive abilities that underlie this skill. Poor readers of this age group were found to be inferior in metacognitive abilities involving the use of orthographic cues, morphological cues and context cues. Poor readers were less strategic than average readers in using these cues and were often unaware of the strategies they did use. This research suggests that a training program for upper primary poor readers should include metacognitive instruction in the strategic and flexible use of a variety of word identification cues. However, while metacognitive research (both laboratory and classroom-based) has provided valuable insights into effective methods for improving the comprehension of poor readers (e.g., Bruce & Chan, 1991; Garner, 1992; O'Shea & O'Shea, 1994; Palincsar & Brown, 1984; Pressley, Brown, El-Dinary, & Afflerbach, 1995; Swanson & De La Paz, 1998), there has been little parallel research into metacognitive approaches to teaching word identification skills (for exceptions see Gaskins, Gaskins, & Gaskins, 1991; Lenz & Hughes, 1990; Thompson & Taymans, 1994). An effective instructional program for poor readers may thus need to include metacognitive training in appropriate strategies for identifying unfamiliar words, as well as use of metacognitive strategies for developing comprehension skills.

The general aim of this project, therefore, was to investigate the effectiveness of a metacognitive instructional program for improving both the word identification and the comprehension skills of upper primary poor readers. The project also aimed to explore effective and efficient ways of implementing a program of this kind in the classroom setting.

The specific research questions asked in the consecutive studies involved in this project were as follows.

  1. How does the effectiveness of a metacognitive approach to teaching word identification skills compare with the effectiveness of a traditional approach to teaching unfamiliar words (i.e., supplying and pronouncing the word), for a group of upper primary poor readers?

  2. How does a program involving a metacognitive approach to teaching word identification skills followed by reciprocal teaching of comprehension skills, compare with a program focusing only on reciprocal teaching of comprehension and using the traditional approach to identifying unfamiliar words?

  3. To what extent will a metacognitive word identification program improve the metacognitive abilities in word identification and the word recognition skills of a group of upper primary poor readers?

  4. What is the best method for training and supporting regular class teachers to implement such a metacognitive training program for poor readers in a regular classroom setting?
The research consisted of two consecutive studies. Study One, which has been discussed in Bruce and Robinson (1999) was designed to answer questions one, two and three of the research questions and involved trialing of the metacognitive word identification and reading comprehension program described above. In this study subjects in the experimental group received a full program of metacognitive word identification strategies and reciprocal teaching of comprehension strategies, as described for Study Two later in this paper. The control subjects received only reciprocal teaching of comprehension strategies along with the traditional approach to teaching unfamiliar words in both training phases. For the purposes of this study the traditional approach consisted of the teacher or another student merely supplying the unknown word. All training sessions in this study were conducted by the experimenter using small groups of four to eight subjects on a withdrawal basis.

In brief, results of the analysis for Study One in relation to research questions 1, 2, and 3 were as follows.

  1. The metacognitive instruction in word identification strategies had a greater facilitative effect on students' word recognition abilities than did the use of traditional methods of teaching word identification during the reciprocal teaching program. This is an important finding in view of the fact that automatic and accurate word identification is likely to enhance reading comprehension (Näslund & samuels, 1992; Stanovich, 1986, 1992). However, the traditional methods of word study within the reciprocal teaching context did result in significant improvements in word recognition skills, which is an interesting finding given that there have been questions about the efficacy of reciprocal teaching of comprehension for students who are inadequate decoders (Moore, 1988; Rosenshine & Meister, 1994).

  2. A combination of metacognitive word identification strategies and reciprocal teaching of comprehension was more effective than reciprocal teaching of comprehension with traditional methods of word identification for improving both word identification and comprehension scores. This was consistent with research evidence regarding the value of metacognitive strategy instruction for improving both word identification and comprehension in poor readers (Gaskins et al., 1991; Lenz & Hughes, 1990; Thompson & Taymans, 1994).

  3. Metacognitive instruction in word identification strategies was also found to be more likely than traditional methods of word identification to promote improved metacognitive skills in word identification, although the traditional methods did result in significant improvements. In particular it was found that training of the experimental subjects in the use of morphological and orthographic cues appeared to facilitate their improved abilities in word identification.
During Study One poor readers were withdrawn for instruction by the experimenter, with no effort made to involve the teachers, because of the exploratory nature of the study. Study Two aimed to address research question four, namely: What is the best method for training and supporting regular class teachers to implement such a metacognitive training program for poor readers in a regular classroom setting?

Method

Study Two involved three phases in which instruction was passed from the experimenter to the class teacher. In the first phase, poor readers in the experimental group were taught in small groups by either the experimenter or a research assistant. The second phase involved incorporation of the program into the classroom reading group structure using a team teaching format, with responsibility for implementation of the program gradually being shifted from the experimenter or research assistant to the class teachers. In the third phase, the class teachers were fully responsible for implementation of the program, with regular monitoring by the experimenter. During these phases the subjects in the control group received regular reading instruction from their classroom teachers, and half of them were also withdrawn for special phonics-based remedial instruction for 30-45 minutes, three to four days per week.

Subjects

The subjects for this study were seventy poor readers selected from eleven Year 5 and Year 6 classrooms in five public schools in a semi-urban area of NSW. Poor readers were defined as those having a discrepancy of 18 months or more between their chronological ages and their word recognition reading ages. Students who met the discrepancy criterion, but who had known intellectual or sensory disability, or whose reading deficit was due to learning English as a second language, were excluded from the sample. There was a total of six participating classes for the Experimental Group (two Year 6 and four Year 5 classes), and five participating classes for the Control Group (two Year 5, two Year 6, and one composite Year 5/6 class). There were forty-four subjects in the Experimental Group (18 boys, 26 girls) and twenty-six subjects in the Control Group (13 boys, 13 girls).

Measures

Measures of word identification, metacognitive awareness and monitoring of word identification cues, and comprehension were taken on several occasions. The assessment instruments used are described below.
  1. St Lucia Graded Word Reading Test (Andrews, 1973) was used to measure accuracy of word identification.

  2. Metacognitive Abilities in Word Identification (Spedding & Chan, 1993, 1994), which is an individually administered test designed to assess metacognitive abilities in the knowledge and regulation of phonic, orthographic, morphological and context cues in word identification.

  3. Tests of Reading Comprehension (TORCH) (Mossenson, Hill, & Masters, 1987) which is an untimed individual silent reading test designed so as to enable analysis of the child's proficiency on a variety of reading tasks ranging from simple literal interpretation through to complex inferential and analytical skills.

The training program

The metacognitive instructional program was based on reciprocal teaching (Palincsar, 1987; Palincsar & Brown, 1984), which has proved successful in both laboratory and classroom settings for improving the comprehension of students who are adequate decoders but poor comprehenders (see reviews by Moore, 1988, and Rosenshine & Meister, 1994). Reciprocal teaching involves teacher and students taking turns leading a dialogue aimed at revealing meaning of text. During the dialogue the leader (teacher or student) uses four comprehension-fostering strategies: (i) clarifying any misunderstandings, (ii) questioning concerning the gist, (iii) summarising the content, and (iv) predicting future content. All these activities are embedded in as natural dialogue as possible, with the teacher and students giving feedback to each other.

Prior to reciprocal teaching to improve comprehension skills, subjects in the experimental group were given reciprocal instruction in metacognitive word identification strategies to improve decoding ability. The word identification program was called The Clever Kid's Reading Program, and it trained children in the flexible and strategic use of three word identification strategies (or Clever Kids' Cues) commonly used by competent readers: (i) Consider the Context (semantic and syntactic cues), (ii) Compare with known words or word parts (phonemic and orthographic cues), and (iii) Carve up the word parts (structural and morphological cues). To help students monitor and control their use of those strategies (cues), they were taught to use the Clever Kids' Motto: (i) Look for the cues, (ii) Be flexible, and (iii) Ask: Does it make sense?

Instructional materials consisted of a total of 30 short passages (200-400 words in length) written at the Year 4 to Year 5 readability level, and each containing factual material in narrative or descriptive form. Each of the passages was structured to target a particular word identification strategy. For example, the passage may contain a number of multi-syllable words requiring children to Carve up the Word Parts. Every time an unfamiliar word was encountered, the group was encouraged to work collaboratively in using the Clever Kids' Motto and Cues to identify the word, while the teacher provided modelling, guided feedback and coaching as necessary. Instruction took place on three 30-minute sessions per week. In general three days (i.e., three 30 minute sessions) were spent on each passage, making the program 30 weeks in length.

Experimental design

An Instructional Group (2) x Year (2) x Testing Occasion (3) repeated measures design was employed, with testing occasions being the within-subjects factor, as depicted in Figure 1.



Phase One
Small Group Instruction
Phase Two
Team Teaching

Phase Three
Class Teaching

Experi-
mental
Group
Pre-
test
Metacognitive instruction in word identification in small groups


Experimenter and assistant
Reciprocal teaching of comprehension strategies in small groups


Experimenter and assistant
Reciprocal teaching of comprehension strategies (including use of metacognitive word identification strategies)

Team teaching in groups by experimenter/ assistant and class teachers, leading to incorporation of the program into the classroom reading group structure

Mid-
test
Reciprocal teaching of comprehension strategies (including use of metacognitive word identification strategies)

Class teachers
Post-
test
Preparation Stage (experimenter-led)Classroom Stage (teacher-led)
Control Group Pre-
test
Regular classroom reading lessons test plus phonics-based remedial instruction


Classteachers
Mid-
test
Regular classroom reading lessons test plus phonics-based remedial instruction

Classteachers
Post-
test
Weeks
involved
46 35 210 3

Figure 1: A schema of the experimental design for Study Two

During training phase one, the poor readers in the experimental group were withdrawn during the regular classroom reading period for small group instruction in the metacognitive word identification and comprehension program developed in Study One. Instruction of the poor reader groups in this phase was undertaken by the experimenter and (for one class) a research assistant who was a qualified teacher.

During training phase two the program was extended to include all the children in the class. The class teachers and the experimenter or research assistant shared the teaching during this phase, with responsibility for implementing the program gradually being shifted from the experimenter or research assistant to the class teacher. By the fourth week of training, the pupils in each classroom were divided into two groups, with the experimenter or research assistant and the class teacher leading out in one group each. The poor readers were incorporated into one or more of these groups, thus enabling them to both contribute to the larger group in a socially supportive environment and learn from the modelling of their more competent peers.

During training phase three the class teachers continued the program as part of their regular classroom reading instruction. They were also asked to cue students to use the strategies at other times during the day when and where appropriate, e.g., use of the questioning and summarising strategies in an Environmental Studies lesson. During this phase the experimenter visited each classroom periodically to observe progress and discuss any difficulties being encountered. Two or three lessons from each classroom were also tape recorded and transcribed to assess the degree to which class teachers continued cuing poor readers to use the metacognitive word identification strategies. There was however, very little evidence from the transcripts that this occurred. This may have been because the teachers were not actively involved in teaching word identification strategies during the first phase of the intervention, and thus were not familiar with the procedures of the program.

Subjects were administered a number of tests on each of the three testing occasions. The testing sequence for each of these measures is shown in Figure 2, below.


Pre-testMid-testPost-test
Word Recognition
St Lucia
***
Metacognition
in Word Identification
**
Comprehension
Silent Reading TORCH
***

Figure 2: The testing sequence for Study Two

Results

Analysis of the results revealed that Year level was found to be a significant factor only for the St Lucia measure, hence a second analysis was undertaken for all other measures using only Group and Testing Occasion. Table 1 contains the group means and standard deviations for each of the measures.

Table 1: Means and standard deviations of the dependent measures for
the experimental and control groups


ExperimentalControl

Year 5Year 6Year 5Year 6

MeanSDMeanSDMeanSDMeanSD

St Lucia
Pre-test 33.274.8037.695.6536.074.4842.203.52
Mid-test 42.407.7447.465.4037.874.9348.505.04
Post-test 47.5310.0355.009.0142.537.0953.505.30


ExperimentalControl

MeanSDMeanSD

Metacognitive abilities in word identification
Use of Cues
Phonic Cues
Pre-test 2.881.812.681.38
Mid-test 3.321.862.401.61
Orthographic Cues
Pre-test 4.531.215.000.76
Mid-test 5.000.954.880.83
Morphological Cues
Pre-test 3.371.513.921.19
Mid-test 4.071.314.401.16
Context Cues
Pre-test 4.421.255.160.69
Mid-test 5.440.595.200.50

TORCH
Pre-test 33.077.8536.087.36
Mid-test 40.078.3638.177.47
Post-test 43.276.8541.387.00


Analysis of the results revealed no significant three-way interactions at the multivariate level. However, there were several two-way interactions, all of which occurred in the contrast between the first and second testing occasions. These interactions will be discussed below.

Word reading

Results of repeated measures analyses of variance for the St Lucia test are shown in Table 2.

Table 2: Summary of results of Group (2) x Occasion (3) repeated measures
analyses of variance for St Lucia

Source of Variation dfSSMSFp

St Lucia
Between Subjects
Group 18.698.690.08.783
Year 12403.732403.7321.24 .001
Group x Year 1139.87139.871.24.270
Error 647241.94113.16

Within Subjects
Occasion 24408.782204.39165.63.001
Group x Occasion 2380.83190.4114.31.001
Year x Occasion 2115.4157.714.34.015
Group x Year x Occ 227.0113.501.01.365
Error 1281703.5913.31



Results of the analysis for word reading in isolation (St Lucia) revealed a significant occasion main effect, F(2,128) = 165.63, p<.001, which indicates that the methods of teaching word recognition to both groups had been effective. There were also two significant two-way interactions.

First there was a significant Group x Testing Occasion interaction, F(2,128) = 14.31, p<.001. Univariate results showed that this interaction occurred in the contrast between the first and second testing occasions, F(1,64) = 24.34, p<.001. The mean raw scores of the experimental group improved eight points from pre- to mid-test representing a mean improvement in word recognition reading age of approximately eleven months during the four-month period. During the same time period, the mean raw score of the control group improved about four points, representing a mean improvement in word recognition reading age of approximately four months.

During the four months between the mid- and post-testing occasions the experimental subjects showed a mean improvement of approximately six points, representing eight months mean improvement in word recognition reading age, while the control subjects showed a mean improvement of approximately five points, representing a mean increase in word recognition reading age of seven months. The slower rate of improvement for the experimental subjects during this phase would tend to confirm the impression gained from the recorded class lessons, that class teachers did not appear to implement the metacognitive word identification strategies to any great extent, as discussed previously. On the other hand, the phonics based instruction (mentioned previously) provided for many of the control subjects is likely to have been a factor in their improvement by the time of the final testing occasion, as such instruction is likely to improve the proficiency of word recognition (Bateman, 1991; Ekwall & Shanker, 1988; McCormick & Becker, 1996).

There was also a significant Year x Occasion interaction, F(2,128) = 4.34, p<.05. Univariate results revealed that the Year x Occasion interaction occurred on the contrast between the pre- and mid-testing occasions, F(1,64) = 6.81, p<.05. Regardless of experimental condition, the Year 6 subjects showed a greater rate of improvement than the Year 5 subjects, during this period. This may have been because the added maturity of the older students enabled them to profit more readily from their respective interventions (metacognitive strategy instruction for the experimental group and phonics-based remedial instruction for the control group) (Cross & Paris, 1988; Paris, Saarnio, & Cross, 1986).

The results for the St Lucia indicate the effectiveness of the metacognitive word identification program for improving word recognition skills, especially when conducted by the researcher or research assistant. As discussed previously, improved accuracy of word recognition is likely to lead to improved comprehension due to the fact that more cognitive resources are available for the construction of meaning (Näslund & Samuels, 1992; Perfetti, 1986; Spear-Swerling & Sternberg, 1994; Stanovich, 1992).

Metacognitive abilities in word identification

The metacognitive abilities in word identification measure was taken on the pre- and mid-testing occasions. The results of repeated measures analyses of variance is shown in Table 3. Results showed a significant occasion main effect and a significant Group x Occasion interaction.

Table 3: Summary of results of Group (2) x Occasion (2) repeated measures analysis of variance for use of metacognitive cues in word identification scores

Source of Variation dfSSMSFp

Phonic Cues
Between Subjects
Group 19.669.662.05.157
Error 64301.144.71

Within Subjects
Occasion 10.200.200.17.685
Group x Occ 14.014.013.40.794
Error 6475.571.18

Orthographic Cues
Between Subjects
Group 10.920.920.56.456
Error 64104.421.63

Within Subjects
Occasion 10.920.922.87.095
Group x Occ 12.642.648.28.005
Error 6420.420.32

Morphological Cues
Between Subjects
Group 16.036.032.09.153
Error 64184.772.89

Within Subjects
Occasion 110.9510.9516.94.001
Group x Occ 10.400.400.62.434
Error 6441.360.65

Context Cues
Between Subjects
Group 11.991.992.38.127
Error 6453.440.84

Within Subjects
Occasion 18.808.8014.09.001
Group x Occ 17.527.5212.05.001
Error 6439.940.62



Significant occasion main effects were found for use of morphological cues, F(1,64) = 16.94, p<.001, and use of context cues, F(1,64) = 14.09, p<.001, for identifying unknown words, with both experimental and control subjects making significantly more use of both these cues for word identification by the mid-testing occasion. There were also significant Group x Occasion interactions for use of orthographic cues, F(1,64) = 8.28, p<.05, and the use of context cues, F(1,64) = 12.05, p<.001. The subjects in the experimental group showed greater improvement on these measures than did the subjects in the control group.

Research indicates that fluency in word recognition skills is facilitated by specific instruction in subword units of English orthography such as onset/rime spelling patterns (e.g., st/art), syllables, and root words and affixes (e.g., Alexander & Pate, 1991; Barker, Torgesen, & Wagner, 1992; Goswami, 1994; Henry, 1993; McCormick & Becker, 1996). In particular, it has been suggested that upper primary poor readers (the subjects of this study) benefit from extended instruction in onset/rime analogy strategies (Goswami, 1994), and syllabic and morphological patterns (Henry, 1993). In addition, as upper grade children become more proficient in the use of decoding strategies, they are more likely to use context to monitor comprehension (e.g., for self-corrections) rather than as a primary method of word identification (Foorman, Francis, Fletcher, & Lynn, 1996; Nicholson, 1991; Pratt, Kemp, & Martin, 1996; Stanovich & Siegel, 1994; Yeu & Goetz, 1994).

It would appear that the metacognitive word identification program used in this study facilitated subjects' use of each of these strategies. The Clever Kid's Cues, Compare with known words and Carve up the word parts, were designed to cue the use of both analogy strategies, and syllabic and morphological strategies. The Clever Kid's Motto, Ask, Does it make sense? combined with the cue Consider the Context, was designed to cue subjects to use context as an aid to comprehension. The control subjects also improved significantly. This improvement was possibly because of the phonetic/syllabic remedial instruction received by many of the control subjects, which could have facilitated use of such strategies, but not necessarily made them aware of reasons for using the strategies.

The fact that significant improvement did not occur in the phonic strategy area both for experimental and control groups, has a number of possible explanations. First, the teaching of phonics can be very difficult because of the irregularities between letters and sounds in English, as indicated by the predominance of phonological problems among poor readers (Glez & López, 1994; Spear-Swerling & Sternberg, 1994; Stanovich & Siegel, 1994; Vellutino, Scanlon, Sipay, Small, Chen, Pratt, & Denckla, 1996). Second, many students in this study seemed to find this section of the test very difficult and were confused about what was required of them. In addition, phonic rules were not specifically taught in this intervention.

Reading comprehension

The Tests of Reading Comprehension (TORCH) measured silent reading comprehension. Parallel forms of the test were administered on each of the three testing occasions, as indicated earlier. The results of repeated measures analyses of variance is shown in Table 4 below.

Table 4: Summary of results of Group (2) x Occasion (3) repeated
measures analyses of variance for TORCH comprehension scores

Source of Variation dfSSMSFp

TORCH
Between Subjects
Group 13.153.15.03.872
Error 637610.53120.80

Within Subjects
Occasion 21833.53916.7636.37.001
Group x Occ 2243.31121.664.83.010
Error 1263175.8825.21



Results of the analysis of the TORCH comprehension tests showed a significant occasion main effect, F(2,126) = 36.37, p<.001, with both groups improving in silent reading comprehension. There was also a significant Group x Occasion interaction, F(2,126) = 4.83, p<.01. Univariate results revealed that this was situated in the contrast between the pre- and mid-testing occasions, F(1,63) = 9.25, p<.01. The improvement in silent reading comprehension from pre- to mid-test parallels the improvement in word recognition during this same period. As indicated previously, this confirms that the metacognitive instruction was more effective than regular class teaching (often supplemented by phonics instruction) when undertaken by the experimenter and assistant. However this metacognitive instruction was no more effective than regular class activities when undertaken by class teachers. The general improvement in comprehension in both groups however, would suggest that as the experimental and control groups became more proficient at word recognition they may be able to devote more of their attentional resources to comprehension of text (Näslund & Samuels, 1992; Perfetti, 1986; Spear-Swerling & Sternberg, 1994; Stanovich, 1984, 1986, 1992).

There is likely to be a cyclic effect, with improved word identification skills and significantly greater metacognitive awareness in use of context cues by the experimental group leading to improved comprehension. Improved word identification could allow more reliable use of context cues as an aid to word identification (Foorman et al., 1996; Pratt et al, 1996; Stanovich, 1993-1994; Yeu & Goetz, 1994). This in turn would allow attentional resources to be directed to comprehension.

It should be noted however, that all of the significant improvements for the experimental subjects occurred during the first, experimenter-led, stage of the study. There may have been several reasons for failure to maintain significant rates of improvement during the second stage. It may have been partly because less time and attention was available for the poor readers when the program was moved from the withdrawal to the classroom setting. It may also have been due to the fact that the teachers did not appear to implement the word identification strategies, possibly because they did not feel that they owned the program (Coley, De Pinto, Craig, & Gardner, 1993; Gersten & Brengelman, 1996; Gersten, Vaughn, Deshler, & Schiller, 1997; Wong, 1997), as they were not responsible for setting it up in the first place.

Another possibility is that the poor readers may have needed more time to consolidate and internalise the improvements made during the first stage of the intervention. Finally, it may be that the initial improvement would have happened whoever instructed, hence this may be all that could be expected from the experimental method used.

Conclusion

It is important that research-based methods are able to be effectively implemented in the regular classroom. More success in this aspect might have been achieved if teachers had responsibility for its implementation from the beginning, rather than taking over responsibility after the program has been set up by the experimenter. This would generate greater ownership of the program, leading to more faithful implementation of each of its components (Coley et al., 1993; Gersten & Brengelman, 1996; Wong, 1997).

In addition, it may be that pupil interest in the metacognitive word identification strategy instruction would be best maintained when it is combined with some reciprocal teaching from the beginning of instruction. This suggestion grew out of observations that many students lost interest after several weeks of the metacognitive word identification activities, and it was not until reciprocal teaching of comprehension was introduced in the second phase of the study that their interest was reactivated. This is consistent with reported evidence of the highly motivational nature of reciprocal teaching procedures (Coley at al., 1993; Palincsar, 1987; Speece, MacDonald, Kilsheimer, & Krist, 1997).

A number of limitations arise from the results of this project which could form the basis for future research. Subject samples were drawn from a limited urban to semi-urban area of the NSW coast. Replication in other areas would help add validity to the results. There was also a restriction to the amount of coaching and modelling which the experimenter was able to provide for teachers. Teachers may need a great deal of coaching, modelling and support if they are to adopt a style of teaching which promotes metacognitive awareness and monitoring of strategies (Gersten et al., 1997; Pressley & El-Dinary, 1997; Wong, 1997).

Questions also remain as to the optimal length of the intervention. Future research could explore whether increased time devoted to the first phase, i.e., intensive word identification strategy instruction plus a modified form of reciprocal teaching, would lead to continued significant improvements in comprehension. It may be that more time devoted to increasing fluency in word identification in a format which children find motivating (i.e., combined with modified reciprocal teaching), would lead to more effective and efficient benefits when reciprocal teaching is more fully implemented at a later stage. This seemed to be the case in Study One, when experimental subjects, who had the benefit of instruction in metacognitive word identification strategies prior to reciprocal teaching of comprehension, made just as rapid gains in silent reading comprehension after a few weeks of reciprocal teaching, as had the control subjects who received reciprocal teaching with traditional methods of word identification throughout the intervention.

Reciprocal teaching of comprehension skills and a metacognitive approach to teaching word identification skills have been identified as effective tools in the search for methods to assist children with reading difficulties. These studies have helped verify their value, but more investigation is needed of whether they can be effectively implemented in regular class situations.

References

Alexander, P.A. & Pate, P.E. (1991). An interactive model of word recognition: A practical stance on a relentless debate. Reading, Writing, and Learning Disabilities, 7, 43-58.

Andrews, R.J. (1973). St Lucia Graded Word Reading Test. Brisbane: Teaching and Testing Resources.

Barker, T.A., Torgesen, J.K., & Wagner, R.K. (1992). The role of orthographic processing skills on five different reading tasks. Reading Research Quarterly, 27(4), 334-345.

Bateman, B. (1991). Teaching word recognition to slow learning children. Journal of Reading, Writing, and Disabilities International, 7(1), 1-16.

Borkowski, J.G., Carr, M., Relinger, E., & Pressley, M. (1990). Self-regulated cognition: Interdependence of metacognition, attributions, and self-esteem. In B.F. Jones, & L. Idol (Eds.), Dimensions of thinking and cognitive instruction (pp 53-92). Hillsdale, NJ: Lawrence Erlbaum.

Bruce, M.E., & Chan, L.K.S. (1991). Reciprocal teaching and transenvironmental programming: A program to facilitate the reading comprehension of students with reading difficulties. Remedial and Special Education, 12(5), 44-54.

Bruce, M.E., & Robinson, G.L. (1999). A metacognitive program for improving the word identification and reading comprehension skills of upper primary poor readers. Paper presented at the joint AARE-NZARE Conference, Melbourne, Vic, 29 November to 3 December. http://publications.aare.edu.au/96pap/brucm96077.txt

Coley, J.D., DePinto, T., Craig, S., & Gardner, R. (1993). From college to classroom: Three teachers' accounts of their adaptations of reciprocal teaching. The Elementary School Journal, 94(2), 255-266.

Cross, D.R. & Paris, S.G. (1988). Developmental and instructional analyses of children's metacognition and reading comprehension. Journal of Educational Psychology, 80(2), 131-142.

Ekwall, E.E. & Shanker, J.L. (1988). Diagnosis and remediation of the disabled reader. 3rd Ed. Boston: Allyn and Bacon.

Foorman, B.R., Francis, D.J., Fletcher, J.M. & Lynn, A. (1996). Relation of phonological and orthographic processing to early reading: Comparing two approaches to regression-based reading-level-match designs. Journal of Educational Psychology, 88(4), 439-652.

Garner, R. (1992). Metacognition and self-monitoring strategies. In S.J. Samuels & A.E. Farstrup (Eds.), What research has to say about reading instruction, 2nd Ed. (pp. 236-252). Newark, DE: International Reading Association.

Gaskins, R.W., Gaskins, J.C., & Gaskins, I.W. (1991). A decoding program for poor readers - and the rest of the class, too! Language Arts, 68(3), 213-225.

Gersten, R., & Brengelman, S. (1996). The quest to translate research into classroom practice: The emerging knowledge base. Remedial and Special Education, 17(2), 67-74.

Gersten, R., Vaughn, S., Deshler, C., & Schiller, E. (1997). What we know about using research findings; Implications for improving special education practice. Journal of Learning Disabilities, 30(5), 466-476.

Glez, J.E.J. & Lopez, R. (1994). Is it true that the difference in reading performance between students with and without LD cannot be explained by IQ? Journal of Learning Disabilities, 27(3), 155-163.

Goswami, U. (1994). The role of analogies in reading development. Support for Learning, 9(1), 22-26.

Henry, M.K. (1993). Morphological structure: Latin and Greek roots and affixes as upper grade code strategies. Reading and Writing: An Interdisciplinary Journal, 5(2), 227-241.

House of Representatives Standing Committee on Employment, Education and Training (1992). The literacy challenge: A report on strategies for early intervention for literacy and learning for Australian children. Canberra, ACT: Australian Government Publishing Service.

Juel, C. (1988). Learning to read and write: A longitudinal study of 54 children from first through fourth grades. Journal of Educational Psychology, 80(4), 437-447.

Lenz, B.K., & Hughes, C.A. (1990). A word identification strategy for adolescents with learning disabilities. Journal of Learning Disabilities, 23(3), 149-158,163.

McCormick, S., & Becker, E.Z. 1996). Word recognition and word identification: A review of research on effective instructional practices with learning disabled students. Reading Research and Instruction, 36(1), 5-17.

Moore, P.J. (1988). Reciprocal teaching and reading comprehension: A review. Journal of Research in Reading, 11(1), 3-14.

Mossenson, L., Hill, P., & Masters, G. (1987). Tests of Reading Comprehension. Hawthorn, Vic: ACER.

Näslund, J.C. & Samuels, S.J. (1992). Automatic access to word sounds and meaning in decoding written text. Reading and Writing Quarterly: Overcoming Learning Difficulties, 8(2), 135-156.

Nicholson, T. (1991). Do children read words better in context or in lists? A classic study revisited. Journal of Educational Psychology, 83(4), 444-450.

O'Shea, L.J. & O'Shea, D.K. (1994). A component analysis of metacognition in reading comprehension: The contributions of awareness and self-regulation. International Journal of Disability, Development and Education, 41(1), 15-32.

Palincsar, A.S. (1987). Reciprocal teaching: Can student discussion boost comprehension? Instructor, 96(5), 56-58.

Palincsar, A.S., & Brown, A.L. (1984). Reciprocal teaching of comprehension fostering and monitoring activities. Cognition and Instruction, 1(2), 117-175.

Paris, S.G., Saarnio, D.A., & Cross, D. R. (1986). A metacognitive curriculum to promote children's reading and learning. Australian Journal of Psychology, 38(2), 107-123.

Paris, S.G., & Winograd, P. (1990). How metacognition can promote academic learning and instruction. In B.J. Jones & L. Idol (Eds.), Dimensions of thinking and cognitive instruction (pp.15-51). Hillsdale, NJ: Lawrence Erlbaum Associates.

Perfetti, C.A. (1986). Continuities in reading acquisition, reading skill, and reading disability. Remedial and Special Education, 7(1), 11-21.

Pratt, C., Kemp, N., & Martin, F. (1996). Sentence context and word recognition in children with average reading ability and with a specific reading disability. Australian Journal of Psychology, 48(3), 149-154.

Pressley, M., Brown, R., El-Dinary, P.B., & Afflerbach, P. (1995). The comprehension instruction that students need: Instruction fostering constructively responsive reading. Learning Disabilities Research and Practice, 10(4), 215-224,

Pressley, M., & El-Dinary, P.B. (1997). What we know about translating comprehension-strategies instruction research into practice. Journal of Learning Disabilities, 30(5), 486-488, 512.

Rosenshine, B., & Meister, C. (1994). Reciprocal teaching: A review of the research. Review of Educational Research, 64(4), 479-530.

Spedding, S., & Chan, L.K.S. (1993). Metacognition, word identification, and reading competence. Contemporary Educational Psychology, 18(1), 91-100.

Spedding, S., & Chan, L.K.S. (1994). Metacognitive abilities in word identification: Assessment and instruction. Australian Journal of Remedial Education, 26(3), 8-12.

Speece, D.L., MacDonald, V., Kilsheimer, L. & Krist, J. (1997). Research to Practice: Preservice teachers reflect on reciprocal teaching. Learning Disabilities Research and Practice, 12(3), 177-187.

Spear-Swerling, L., & Sternberg, R.J. (1994). The road not taken: An integrative theoretical model of reading disability. Journal of Learning Disabilities, 27(2), 91-103,122.

Stanovich, K.E. (1984). The interactive-compensatory model of reading: A confluence of developmental, experimental, and educational psychology. Remedial and Special Education, 5(3), 11-19.

Stanovich, K.E. (1986). Matthew effects in reading: Some consequences of individual differences in the acquisition of literacy. Reading Research Quarterly, 21(4), 360-407.

Stanovich, K.E. (1992). Speculations on the causes and consequences of individual differences in early reading acquisition. In P.B. Gough, L.C. Ehri, & R. Treiman (Eds.), Reading acquisition (pp. 307-342). Hillsdale, NJ: Lawrence Erlbaum Associates.

Stanovich, K.E. (1993-1994). Romance and reality. The Reading Teacher, 47(4), 280-291.

Stanovich, K.E. & Siegel, L.S. (1994). Phenotypic performance profile of children with reading disabilities: A regression-based test of the phonological-core variable-difference model. Journal of Educational Psychology, 86(1), 24-53.

Swanson, P.N., & De La Paz, S. (1998). Teaching effective comprehension strategies to students with learning and reading disabilities. Intervention in School and Clinic, 33(4), 209-218.

Thompson, K.L., & Taymans, J.M. (1994). Development of a reading strategies program: Bridging gaps among decoding, literature, and thinking skills. Intervention in School and Clinic, 30(1), 17-27

Vellutino, F.R., Scanlon, D.M., Sipay, E.R., Small, S.G., Chen, R., Pratt, A., & Denckla, M.B. (1996). Cognitive profiles of difficult-to-remediate and readily remediated poor readers: Early intervention as a vehicle for distinguishing between cognitive and experiential deficits as basic causes of specific reading disability. Journal of Educational Psychology, 88(4), 601-638.

Waring, S., Prior, M., Sanson, A., & Smart, D. (1996). Predictors of 'recovery' from reading disability. Australian Journal of Psychology, 48(3), 160-166.

Wong, B.Y.L. (1997). Clearing hurdles in teacher adoption and sustained use of research-based instruction. Journal of Learning Disabilities, 30(5), 482-485.

Yeu, Y.H.K., & Goetz, E.T. (1994). Context effects on word recognition and reading comprehension of poor and good readers: A test of the interactive-compensatory hypothesis. Reading Research Quarterly, 29(1), 179-18.

Authors: Dr Merle Bruce is a senior lecturer in Special Education at Avondale College, NSW. Her research interests, which arose out of her previous teaching experience, centre around the use of metacognitive training programs to improve the reading skills of children with learning difficulties.

Dr Greg Robinson is a senior lecturer at the Special Education Centre, University of Newcastle. He has worked as a secondary school teacher and school psychologist, and currently coordinates courses related to learning disabilities/literacy problems. He also has a clinical diagnostic role which involves working with children and adults with learning disabilities.

Please cite as: Bruce, M. E. and Robinson, G. L. (2000). Effectiveness of a metacognitive reading program for poor readers. Issues in Educational Research, 10(1), 1-20. http://www.iier.org.au/iier10/bruce.html


[IIER Vol 10, 2000] [IIER Home]

© 2000 Issues in Educational Research
Last revision: 4 Sep 2013. URL: http://www.iier.org.au/iier10/bruce.html
HTML: Clare McBeath, Curtin University [c.mcbeath@bigpond.com] and Roger Atkinson [rjatkinson@bigpond.com]
During the period 17 Mar 2001 to 30 July 2001 the previous URL for this article, http://cleo.murdoch.edu.edu.au/gen/iier/iier10/bruce.html, recorded 541 accesses.