Evaluation of Challenge the Gap

An evaluation of the Challenge the Gap (CtG) programme for the Education Endowment Foundation found no evidence that the programme increased average achievement for either primary or secondary pupils overall.

Challenge the Gap is a two-year school improvement programme that aims to help schools improve the achievement of their disadvantaged pupils through a professional development programme for staff. The evaluation conducted by The University of Manchester, involved 21,041 pupils from 104 schools (64 primary schools and 39 secondary schools). Around 24% of pupils in the primary schools and 16% in the secondary schools were eligible for free school meals. The evaluation assessed the impact on all participating schools using 2015 Key Stage 2 or Key Stage 4 results. CtG schools were compared to schools with a similar socio-demographic profile.

No evidence was found that CtG increased the average achievement for either primary or secondary school pupils, overall. For children eligible for free school meals (FSM), those in CtG primary schools made two months’ additional progress (average effect size = +0.10) compared to similar children in non-CtG schools. In CtG secondary schools, FSM-eligible pupils made two months’ less progress compared to similar pupils in non-CtG secondary schools (average effect size = -0.10). The smaller number of FSM-eligible pupils in the trial means that these results are less secure than the overall findings.

Source: Challenge the Gap: Evaluation report and executive summary (July 2017), Education Endowment Foundation

Science professional development and pupil achievement: A cluster-randomised trial

Joseph Taylor of Abt Associates and colleagues conducted a rigorous study of the Science Teachers Learning Through Lesson Analysis (STeLLA) professional development (PD) programme.

STeLLA is designed to increase elementary (primary) teachers’ science knowledge. Instead of the standard practice of teaching pupils to memorise science concepts and then perform activities that prove these concepts, STeLLA teachers lead pupils to discover science concepts through experience and experimentation. One of STeLLA’s main tenets is to have pupils think through science problems aloud so that teachers can respond to pupils’ ideas and guide them to scientific conclusions and specific learning goals. Its other distinguishing feature is that during the course of a year, groups of 5–10 teachers led by a PD coach watch and critique videos of experienced science teachers’ lessons, later moving on to their own and their colleagues’ lessons, to analyse them regarding science content, teaching and learning. In addition, STeLLA teachers are taught by university-level science teachers the summer prior to implementation to provide them with greater science content knowledge, a process called “content deepening”.

In the current study, researchers used a cluster-randomised design to compare STeLLA to The Content Deepening Program, a PD programme that deepens teachers’ science knowledge through university faculty-led science teaching, like STeLLA does, but without STeLLA’s analysis-of-practice component. Seventy-seven schools, with 144 teachers and 2,823 fourth and fifth grade pupils (Years 5 and 6) in Colorado, were randomly assigned either to STeLLA (n=42 schools) or to The Content Deepening Program (n=35 schools) in two cohorts, the first in 2011–12 and the second in 2012–13. Teachers in both conditions experienced 88 hours of PD and had the same learning goals for their pupils. Pupils were pre- and post-tested on a science measure based on established assessments. Although the control group demonstrated a slight achievement advantage at baseline, results showed that pupils in STeLLA classes scored higher (effect size = +0.55) at post-test than pupils in classes whose teachers had been through The Content Deepening Program.

Source: The effect of an analysis-of-practice, videocase-based, teacher professional development program on elementary students’ science achievement (2017),  Journal of Research on Educational Effectiveness, Volume 10:  Issue 2