This Campbell systematic review looks at the effect of continuing professional development (CPD) approaches for education professionals on educational and social outcomes for children, and also any effects on professional practice.
The review summarises evidence from 51 studies, including 48
randomised controlled trials, however, only 26 studies were included in the
meta-analysis. The 51 studies were grouped into three CPD areas: social and
emotional development interventions, language and literacy development
interventions, and stress reduction interventions.
The main findings of the review were:
- No effect of CPD on social and emotional
development interventions on pupil academic outcomes. The weighted average
effect size = +0.05.
- No effect of CPD language and literacy
development interventions on pupil academic outcomes. The weighted average
effect size = +0.04.
- It was not possible to draw any conclusions
concerning the effectiveness or ineffectiveness of CPD on social and emotional
development or language and literacy development interventions on teacher
- As there was only one study in the CPD category
of stress reduction interventions, it was not possible to draw any conclusions.
The researchers conclude that there is insufficient evidence
for conclusions to be drawn, with the exception of language and literacy
development interventions. For this type of CPD, there seems to be no positive
impact on pupil academic outcomes.
of continuing professional development training of welfare professionals on
outcomes for children and young people: A systematic review (November 2019), Campbell Systematic Reviews
Kristin Rogde and colleagues from the Campbell Collaboration have completed a systematic review that examines the effects of linguistic comprehension teaching on generalised measures of language and reading comprehension skills. Examples of linguistic comprehension skills include vocabulary, grammar and narrative skills.
The authors searched literature dating back to 1986, and
identified 43 studies to include in the review, including samples of both
pre-school and school-aged participants. Randomised controlled trials and
quasi-experiments with a control group and a pre-post design were included.
Key findings of the review were as follows:
- The linguistic comprehension programmes
included in the review display a small positive immediate effect on generalised
outcomes of linguistic comprehension.
- The effect of the programmes on generalised
measures of reading comprehension is negligible.
- Few studies report follow-up assessment of
According to the authors, linguistic comprehension teaching has
the potential to increase children’s general linguistic comprehension skills.
However, there is variability in effects related to the type of outcome measure
that is used to examine the effect of such instruction on linguistic
effect of linguistic comprehension instruction on generalized language and
reading comprehension skills: A systematic review (November 2019), Campbell Systematic Reviews
This Campbell systematic review examines the evidence on the correlation between teacher qualifications and the quality of early childhood learning environments, as measured by the Environment Rating Scale (ERS). The review summarises findings from 48 studies with 82 independent samples. The studies had to be comparative or correlational and report either an overall quality scale or an environment rating scale.
Overall, the review suggests that higher teacher
qualifications are positively associated with classroom quality in early
childhood education and care (effect size = +0.20). The review also suggests a
positive correlation between teacher qualifications and classroom quality on a
number of subscales, including:
structure – focusing on the schedule, time for free play, group time and
provisions for children with disabilities (ES = +0.22).
– this relates to fine motor, art, music/movement, blocks, sand/water, dramatic
play, nature/science, maths/number, use of digital technologies, and promoting
acceptance of diversity (ES = +0.20).
and reasoning – encouraging children to communicate, use language to
develop reasoning skills, and the informal use of language (ES = +0.20).
The researchers conclude that while there is evidence for
the relationship between teacher qualification and classroom quality as
measured by the ERS, further research is also needed into the specific knowledge
and skills that are learned by teachers with higher qualifications that enable
them to complete their roles effectively. It is important to note also, that
while higher quality in early childhood education and care may lead to improved
outcomes for children, we cannot assume that this is the case.
relationship between teacher qualification and the quality of the early
childhood education and care environment (January 2017), Campbell Systematic Reviews, Volume 13, Issue 1.
Reducing class size is often suggested as a way of improving pupil performance. However evidence from a new Campbell systematic review suggests that reducing class size has at best only a very small effect.
The review summarises findings from relevant studies that measured the effects of class size on academic achievement. A total of 127 studies were analysed, including 45 studies that used data from the US Student Teacher Achievement Ratio (STAR) programme that reduced class sizes substantially in kindergarten to grade 3 (Years 1 to Year 4). However only ten studies, including four of the STAR programme, could be included in the meta-analysis.
Their analysis focused on effects on maths and reading and found a small positive effect of reducing class size on pupils’ reading achievement and a negative, but statistically insignificant, effect on maths. For reading, the weighted average effect size was +0.11, and the weighted average effect size for maths was -0.03.
For the four studies using data from the STAR programme, the researchers found a positive effect of smaller class sizes for both reading and maths. However, the average effect sizes were still very small and do not change the overall finding.
Source: Small class sizes for improving student achievement in primary and secondary schools: a systematic review (October 2018), Campbell Systematic Reviews 2018:10
A new Campbell Collaboration systematic review has been published, which looks at the impact of Teach for America on learning outcomes.
Teach for America (TFA) is a nationwide teacher preparation programme designed to address the shortage of effective teachers, specifically in high-poverty rural and urban schools across the United States. The systematic review by Herbert Turner and colleagues considered the impact of TFA-prepared teachers relative to novice teachers, and alumni relative to veteran teachers. The impacts studied were for K–12 (Years 1–13) pupil outcomes in maths, English and science.
A total of 24 studies were eligible for the review. However, once the research design, study quality and comparison groups were considered, this was reduced to four qualifying studies.
The review found no significant effect on reading by TFA teachers in their first or second year teaching elementary grades (Years 1–6) when compared with non-TFA novice teachers. There was a small positive impact for pre-K to grade 2 (Reception to Year 3) teachers on reading, but not on maths. However, given the small evidence base, the review counsels that these results should be treated with caution.
Source: What are the effects of Teach for America on math, English language arts, and science outcomes of K–12 students in the USA? (June 2018), A Campbell Systematic Review 2018:7
Many studies have been conducted to examine the impact for pupils of later school start times, some of which can be found in previous issues of Best Evidence in Brief. This Campbell systematic review summarises the findings from 17 studies to examine the evidence on the impact of later school start times on pupils’ mental health and academic performance.
The studies included in the review were randomised controlled trials, controlled before-and-after studies and interrupted time series studies with data for pupils aged 13 to 19 and that compared different school start times. The studies reported on 11 interventions in six countries, with a total of almost 300,000 pupils.
The main results of the review suggest that later school starts may be associated with positive academic benefits and psychosocial outcomes. Later school start times also appear to be associated with an increase in the amount of sleep children get. Effect sizes ranged from +0.38 to +2.39, equivalent to an extra 30 minutes to 2 hours of sleep each night. However, the researchers point out that, overall, the quality of the body of evidence is very low, and so the effects of later school start times cannot be determined with any confidence.
Source: Later school start times for supporting the education, health, and well-being of high school students: a systematic review (December 2017), A Campbell Systematic Review 2017:15