What difference does it make?

We regularly quote effect sizes in Best Evidence in Brief as a measure of the impact of an intervention or approach. But what is the impact of a normal school year on children, and how much of that impact is due to the school? A study by Hans Lutyen and colleagues, published in School Effectiveness and School Improvement, attempts to find out.

The study analysed 3,500 pupils from 20 mostly independent (private) English primary schools on four different learning outcomes. These measures, part of the Interactive Computer Adaptive System (InCAS), were reading, general maths, mental arithmetic and developed ability, the last of which measures items such as vocabulary and non-verbal pattern recognition.

Children were measured on these outcomes from Years 1 to 6. Using a regression-discontinuity approach that exploited the discontinuity between the youngest pupils in one year and the oldest pupils in the year below, the researchers were able to identify the overall progress of the children, and the extent to which this was a result of the impact of the school.

The results showed a declining impact of a school year as children got older. The effect size of Year 1 ranged from +1.18 for mental arithmetic to +0.8 for general maths. By Year 6, effect sizes varied from +0.88 for general maths to +0.49 for reading and developed ability.

The effect of schooling itself accounted for an average of between 23.5% and 43.4% of this impact across the four measures. Put another way, the effect size of schooling in Year 1 ranged from +0.55 for reading to +0.31 for developed ability. By Year 6, effect sizes had fallen to between +0.27 for general maths and +0.08 for reading and developed ability.

The researchers suggest that, when setting benchmarks for educational interventions, it is not only important to consider the phase of the educational career, but also the specific measure.

Source: The contribution of schooling to learning gains of pupils in Years 1 to 6 (February 2017), School Effectiveness and School Improvement

Leave a Reply

Your email address will not be published. Required fields are marked *