New guidance to support schools to put evidence to work in their classrooms

A new guidance report from the Education Endowment Foundation (EEF) aims to give schools the support they need to put evidence to work in their classrooms and implement new programmes and approaches effectively.

The report highlights how good and thoughtful implementation is crucial to the success of any teaching and learning strategy, yet creating the right conditions for implementation – let alone the structured process of planning, delivering and sustaining change – is hard.

The authors offer six recommendations to help schools give their innovations the very best chance by working carefully through the who, why, where, when and how of managing change. These recommendations can be applied to any school improvement decision: programmes or practices, whole-school or targeted approach, internally or externally generated ideas.

The report frames implementation in four stages: explore, prepare, deliver and sustain. It also provides guidance on how schools can create the right environment for change, from supporting staff to getting leadership on board.

Source: Putting evidence to work: a school’s guide to implementation. EEF Guidance Report (February 2018), Education Endowment Foundation

New analysis of the attainment gap

The Education Endowment Foundation (EEF) has published a new analysis of the state of the attainment gap in the UK. Using data from Key Stage 2 to predict how the attainment gap is likely to shift in the next five years, it reveals that there will be little or no headway in closing the gap between disadvantaged pupils and their classmates in the next five years.

Improvements in primary schools over the past few years mean that the gap between the proportion of disadvantaged pupils with at least a good pass at GCSE in English and maths and all other pupils is set to reduce from 24 percentage points (ppts) to 21.5 between 2017 and 2021. However, there will be little change in Attainment 8 (which measures average achievement in GCSE across eight subjects) and Progress 8 (which measures students’ progress between Key Stage 2 and Key Stage 4 across eight subjects) gaps. The Attainment 8 score gap of 11 points in 2017 will remain in 2021, while for Progress 8 the attainment gap is set to increase a little: from 14.8 ppts in 2017 to 15.6 ppts in 2021.

The analysis emphasises that even small improvements – just one or two GCSE passes compared to no qualifications – can have significant increases on a young person’s lifetime productivity returns and in national wealth. This highlights the importance of continuing to focus on improving results for currently low-attaining pupils.

The report also contains 15 key lessons from the first six years of the EEF on closing the attainment gap.

Source: The attainment gap: 2017 (January 2018), The Education Endowment Foundation

Talking in class boosts progress in maths, science and English

An intervention that trained teachers to improve and monitor the quality of classroom talk had a positive impact on primary pupils’ test scores in English, maths and science, a report published by the Education Endowment Foundation (EEF) reveals.

Seventy-six primary schools with higher-than-average proportions of disadvantaged pupils took part in a randomised control trial of the Dialogic Teaching intervention, which is designed to improve the quality of classroom talk as a means of increasing pupils’ engagement, learning and achievement. Year 5 teachers in 38 schools (2,493 pupils), and a teacher mentor from each school, received resources and training from the delivery team and then implemented the intervention over the course of the autumn and spring terms in the 2015/16 school year. A control group of 38 schools (2,466 pupils) continued with business as usual. Following the intervention, pupils were tested in English, maths and science.

The results showed that pupils in the intervention schools did better in the main outcome measures of English (effect size = +0.16), science (+0.12), and maths (+0.09) when compared with pupils in the control schools who didn’t receive the intervention. For pupils who received free school meals, the intervention had a higher impact on maths (+0.16), but around the same for English (+0.12) and science (+0.11). Teachers reported positive effects on pupil engagement and confidence, and on the whole the intervention was highly regarded by participating schools. However, some teachers felt that it would take longer than two terms to fully embed a Dialogic Teaching approach in their classrooms.

The Dialogic Teaching intervention was developed by the Cambridge Primary Review Trust and the University of York. This University of York news story has more.

Source: Dialogic teaching: evaluation report and executive summary (July 2017), Education Endowment Foundation

Scale-up evaluation of Switch-on disappoints

An independent evaluation for the Education Endowment Foundation (EEF) of the Switch-on intervention has found no evidence that it improves the reading outcomes of pupils struggling with literacy at Key Stage 1 (ages 5–7 years) compared to schools’ usual practices.

Switch-on is an intensive, targeted literacy intervention that aims to improve the reading skills of pupils who are struggling with literacy. There are two versions of the intervention: Switch-on Reading and Switch-on Reading and Writing. Both involve specially trained Teaching Assistants (TAs) delivering a tailored programme of literacy support in daily 20-minute sessions over a ten-week period.

Schools selected pupils in Year 3 who were working below age-related expectations at the end of Key Stage 1 and who did not have a high level of special needs. Each of the 184 participating schools was then randomly assigned to receive either Switch-on Reading, Switch-on Reading and Writing, or to continue their usual practices of supporting pupils with reading difficulties. In total, 999 pupils were involved in the trial.

Estimated effect sizes were zero and not statistically significant. The intervention also showed no effect on pupils eligible for free school meals. These findings contradict a previous, smaller EEF-funded evaluation of Switch-on which had shown signs of promise in raising reading outcomes for Year 7 pupils.

Source: Switch-on – effectiveness trial (May 2017), Education Endowment Foundation

Is the pen mightier than the computer?

The Education Endowment Foundation (EEF) has published a report assessing the impact of Abracadabra (ABRA), a 20-week online literacy programme, on literacy outcomes for Year 1 pupils. ABRA is composed of phonic fluency and comprehension activities based around a series of age-appropriate texts and is designed to be delivered by a teaching assistant to groups of three to five pupils in four 15-minute sessions per week. The EEF evaluation tested the ABRA online intervention alongside a paper-based alternative using the same material.

Fifty-one schools were randomly assigned to receive either a version of the intervention or to act as a control school delivering business as usual. In the schools receiving the intervention, pupils were randomised to receive the online intervention (ABRA), the paper-based intervention, or standard literacy provision.

Positive effects were found for both the online and paper-based interventions. Pupils in the online treatment group (effect size = +0.14) and the paper-based treatment group (ES = +0.23) both showed an improvement in literacy outcomes. The impact was higher for children eligible for free school meals for both ABRA (+0.37) and the paper-based intervention (+0.40). Pupils with below average pre-test outcomes seemed to benefit from ABRA, whereas the paper-based intervention seemed to benefit all pupils. Pupils who received normal literacy provision in the schools where the interventions took place did better than pupils who received normal literacy provision in control schools.

Source: ABRA: Online reading support: Evaluation report and executive summary (2016), Education Endowment Foundation

Catch up with Fresh Start phonics

The EEF has published an evaluation of Fresh Start, a phonics intervention that seeks to help pupils at risk of falling behind their peers in literacy.

The study in 10 schools in England looked at 433 Year 7 pupils who had not achieved National Curriculum Level 4b or above. Pupils were allocated to intervention and control groups and those who participated in Fresh Start were removed from regular English lessons for an hour three times a week.

Pupils who used Fresh Start made an estimated three months’ extra progress in literacy. The effect size was moderate (+0.24) and the EEF judged the evidence strength as moderate. Pupils who received free school meals showed the same effect size (+0.24), but the smaller numbers of participants in the subgroup made this finding less robust.

According to the EEF, all 10 schools in the study plan to continue using Fresh Start.

Source: Fresh Start (2015), Education Endowment Foundation.