Numeracy intervention shows promise for pupils struggling with maths

The Education Endowment Foundation has published an evaluation of 1stClass@Number, a 10-week numeracy intervention, delivered by teaching assistants, that provides intensive support for pupils struggling with maths.

A randomised controlled trial was conducted in 133 schools in south and west Yorkshire. Schools each nominated four children in Year 2 to participate, and the schools were then randomly assigned to either receive the intervention or to continue with normal teaching. A team from the University of Oxford evaluated the programme, which was delivered three times a week for 10 weeks in addition to normal mathematics instruction. A process evaluation collected additional data through observations, questionnaires and phone interviews.

Results showed that the intervention had a positive effect on Quantitative Reasoning Tests (effect size = +0.18) compared to pupils in the control group. Among pupils eligible for free school meals, those in the intervention group did not make any additional progress in the Quantitative Reasoning Test compared to control group pupils.

1stClass@Number seemed to have no impact on performance in end of Key Stage 1 maths tests compared to pupils in the control group. However, there was some evidence that the intervention widened the gap in Key Stage 1 maths results between pupils eligible for free school meals and their peers.

Source: 1stClass@Number: Evaluation report and executive summary (July 2018), Education Endowment Foundation

Classroom-based intervention for pupils with autism

Findings from a cluster randomised trial published in the Journal of Consulting and Clinical Psychology suggest that classroom teachers can effectively deliver a programme for young pupils with Autistic Spectrum Disorder (ASD) that results in better outcomes relative to usual school-based education.

Lindee Morgan and colleagues conducted a trial of the Social, Communication, Emotional Regulation and Transactional Support (SCERTS) intervention – a classroom-based, teacher-implemented intervention aimed at improving active engagement, adaptive communication, social skills, executive functioning and problem behaviour in elementary (primary) school pupils with ASD – to assess what improvement pupils in the intervention group made across a variety of measures compared to pupils in the control group. Sixty schools from three US states were randomly assigned to either the intervention or control groups. Teachers in the intervention group were trained in how to deliver the SCERTS programme and received coaching throughout the school year.

Results showed better outcomes for the intervention group than the control group on observed measures of classroom active engagement with respect to social interaction. The intervention group also had better outcomes on measures of adaptive communication, social skills and executive functioning (effect sizes ranged from +0.31 to +0.45).

Source: Cluster randomized trial of the classroom SCERTS intervention for elementary students with autism spectrum disorder (July 2018), Journal of Consulting and Clinical Psychology, Volume 86(7)

Good behaviour is no game

An evaluation conducted for the Education Endowment Foundation looked at whether the Good Behaviour Game (GBG) improved pupils’ reading skills and behaviour.

The GBG intervention is a classroom management approach designed to improve pupil behaviour and build confidence and resilience. The game is played in groups and rewards pupils for good behaviour. More than 3,000 Year 3 pupils from 77 UK schools took part in a randomised controlled trial of GBG over two years. Around a quarter of the pupils in the schools were eligible for free school meals, around a fifth were pupils with special educational needs, and 23% had English as an additional language.

The analysis indicated that, on average, GBG had no significant impact on pupils’ reading skills (effect size = +0.03) or their behaviour (concentration, disruptive behaviour and pro-social behaviour) when compared to the control group pupils. However, there was some tentative evidence that boys at risk of developing conduct problems showed improvements in behaviour.

Source: Good Behaviour Game: Evaluation report and executive summary (July 2018), Education Endowment Foundation

Evidence supports Foundations: Establishing Positive Discipline Policies

Safe and Civil Schools’ Foundations: Establishing Positive Discipline Policies is a programme designed to create a safer climate within a school and its surrounding grounds. It focuses on using proactive techniques instead of punishment to facilitate change, a technique referred to as school-wide positive behavioural intervention and support (SWPBIS). Foundations helps schools adopt and maintain these techniques by providing school teams with training and data-gathering materials, multiyear training, coaching support and school visits. The programme requires a team at each school to teach the staff these techniques, and data related to safety and behaviour is used to gauge what is working and what is not.

A randomised controlled trial in 32 US elementary (primary) schools in a large urban school district demonstrated that Foundations yielded improvements in school discipline, pupil safety policy and training, staff perceptions of pupils behaviour and suspension and tardiness rates over a two-year period. To determine if positive results of the programme would generalise into a “real world” setting, a second study continued to evaluate these elementary schools for two more years while also scaling up to add all remaining elementary and secondary schools in the district, when these schools adopted the programme without support from research funding.

In total, 74 regular public schools participated in the scale-up study. All schools received two years of Foundations training where school teams learned how to implement improvements related to safety, behaviour and discipline, and to collect and analyse related data to set goals for the next year.

As in the randomised study, schools in the second study showed gains in all areas. Specifically, after Foundations training, staff reported improved pupil behaviour, with fewer suspensions, absenteeism and tardiness, with a positive relationship evidenced between years of implementation and rates of effectiveness. The authors concluded that the improvements from the Foundations training were evidence that the programme generalises well into the real world setting.

Source: A randomized evaluation of the Safe and Civil Schools model for positive behavioral interventions and supports at elementary schools in a large urban school district, School Psychology Review, Volume 42, Issue 3

Scale-up of a Safe & Civil Schools’ model for school-wide positive behavioral interventions and supports (April 2016), Psychology in the Schools, Volume 53, Issue 4

The impact of wearing glasses on early literacy

In the previous issue of Best Evidence in Brief, we reported on a study  that showed how wearing glasses improved children’s reading. A similar study by Alison Bruce and colleagues (including the IEE’s Bette Chambers) looks at the impact of wearing glasses on children’s eyesight and early literacy in the UK.

Born in Bradford is a longitudinal study looking at the progress of a multi-ethnic birth cohort in the city of Bradford. From this cohort, 2,930 children underwent a vision screening test in their Reception year. The 432 children who failed the test were referred for follow-up (usually being prescribed glasses) and comprised the treatment group. A further 512 children who passed the sight test were chosen at random to make up the control group. All the children completed tests of literacy (Woodcock Reading Mastery Tests-Revised) and vocabulary (British Vocabulary Picture Scale) at school entry (Year 1) and after 12 months and 24 months. At the same time, researchers checked that the children were wearing their glasses.

The visual acuity of all children improved during the study, but those children who wore their glasses improved most and almost closed the gap on the control children. Letter identification scores declined by 1.5% for every one line reduction (on the LogMar sight chart) in visual acuity. The effect size of wearing glasses was +0.11. The results suggest that failure to wear glasses has implications for young children’s vision and education. Wearing glasses improves both visual acuity and has the potential to improve literacy.

Source: The effect of adherence to spectacle wear on early developing literacy: a longitudinal study based in a large multiethnic city, Bradford, UK (June 2018), BMJ Open

Do physically active lessons improve pupil engagement?

A study published in Health Education and Behavior looks at the effects of introducing physically active lessons into primary school classes. Emma Norris and colleagues used the Virtual Traveller (VT) intervention to evaluate whether physically active lessons had any effect on pupil engagement, physical activity and on-task behaviour.

Virtual Traveller is a programme of pre-prepared physically active lesson sessions delivered using classroom interactive whiteboards during regular lessons. A total of 219 children aged 8- to 9-years-old from 10 schools in Greater London took part in the cluster-randomised controlled trial. Children in the intervention schools received 10-minute VT sessions three times a week, for six weeks, during maths and English lessons. To assess the effectiveness of VT, pupils’ physical activity levels, on-task behaviour and engagement were measured at baseline (T0), at weeks two (T1) and four  (T2) of the six-week intervention, and at one week (T3) and three months (T4) post-intervention.

Pupils in the intervention group showed more on-task behaviour than those in the control at T1 and T2, but this was not maintained post-intervention. No difference in pupil engagement between the control and intervention groups was observed at any time point. VT was found to increase physical activity, but only during lesson time.

Source: Physically active lessons improve lesson activity and on-task behavior: a cluster-randomized controlled trial of the “Virtual Traveller” intervention (March 2018), Health Education & Behavior DOI: 10.1177/1090198118762106