The What Works Clearinghouse (WWC) has released a new topic area that focuses on the impact of charter schools on pupil achievement and other outcomes. As part of the launch, the WWC released three intervention reports, which review available research on an intervention or programme to determine if there is strong evidence that it has a positive impact on pupil outcomes.
The intervention reports examine the following three programmes:
- Knowledge is Power Program (KIPP), a non-profit network of more than 200 US public charter schools educating early childhood, elementary, middle and high school pupils. According to the WWC intervention report, research shows that KIPP had positive effects on mathematics achievement and English language achievement, and potentially positive effects on science achievement and social studies achievement for middle and high school pupils (Years 7 to 13), and no discernible effects on pupil progression (eg, high school graduation within four years of grade 9 (Year 10) entry) for high school pupils.
- Green Dot Public Schools, a non-profit organisation that operates more than 20 public charter middle and high schools in California, Tennessee and Washington. The WWC reports that Green Dot Public Schools had potentially positive effects on mathematics achievement, pupil progression, school attendance and English language achievement for high school pupils (Years 10 to 13).
- Harlem Children’s Zone (HCZ) Promise Academy Charter Schools, a non-profit organisation designed to serve low-income children and families living in Harlem in New York City. According to the intervention report, the WWC is unable to draw any conclusions based on available research about the effectiveness or ineffectiveness of the HCZ Promise Academy Charter Schools on elementary, middle and high school pupils. Research that meets WWC design standards is needed to determine the effectiveness or ineffectiveness of this intervention.
Source: Charter Schools, What Works Clearinghouse
Adding a self-regulation intervention to a school readiness programme can improve self-regulation, early academic skills and school readiness in children at higher risk for later school difficulties, according to the results of a study published in Early Childhood Research Quarterly.
Robert J Duncan and colleagues looked at the effect of adding a self-regulation intervention to the Bridge to Kindergarten (B2K) programme – a three-week summer school-readiness programme – in the US state of Oregon. The B2K programme is aimed at children with no prior preschool experience, and therefore considered to be at risk for later school difficulties.
Children from three to five years old were randomly assigned to either a control group (B2K only) or the intervention group (B2K plus intervention). Children in the intervention group received two 20- to 30-minute sessions per week, involving movement and music-based games that encouraged them to practise self-regulation skills.
Results from this randomised controlled trial indicated that children who received the intervention scored higher on measures of self-regulation than children who participated in the B2K programme alone. There were no significant effects on maths or literacy at the end of the programme. However, four months into kindergarten, children from the intervention group showed increased growth in self-regulation, maths and literacy compared to expected development.
Source: Combining a kindergarten readiness summer program with a self-regulation intervention improves school readiness (November 2017) Early Childhood Research Quarterly, Volume 42, 1st Quarter 2018
A new research brief by John F Pane and colleagues at the RAND Corporation asks the question: “Does personalised learning improve pupil learning more than other educational approaches?” As part of their report, the authors present findings from an evaluation of personalised learning (PL) schools conducted by RAND Corporation researchers for the Bill and Melinda Gates Foundation.
The research team analysed maths and reading scores for approximately 5,500 pupils in 32 US schools that received funding from the Next Generation Learning Challenges (NGLC) initiative to support highly personalised approaches to learning. These schools took the Northwest Evaluation Association (NWEA) Measures of Academic Progress (MAP) mathematics and reading assessments for one academic year: autumn 2014 to spring 2015. The research team compared the achievement of pupils in PL schools with matched peers attending non-PL schools and national norms.
Key findings from the research brief include:
- Early evidence suggests that PL can improve achievement for pupils, regardless of their starting level of achievement.
- Benefits of PL may take some time to emerge. Analyses suggest that effects may be more positive after schools have experience implementing PL.
- To date, the field lacks evidence on which practices are most effective or what policies must be in place to maximise the benefits.
The authors note that additional research is needed using more rigorous experimental studies.
Source: How Does Personalized Learning Affect Student Achievement? RAND Corporation, 2017.
During the past 30 years, thousands of articles have been written about technology’s effects on pupil achievement. In order to quantify technology’s effects on maths achievement, Jamaal Young at the University of Texas conducted a meta-analysis of all of the meta-analyses on the topic during the last three decades. His second-order meta-analysis was comprised of 19 meta-analyses representing 663 primary studies, more than 141,000 pupils and 1,263 effect sizes. Each meta-analysis that was included had to address the use of technology as a supplement to instruction, use pupil maths achievement as an outcome measure, report an effect size or enough data to calculate one, have been published after 1985 and be accessible to the public.
The author found that all technology enhancements positively affected pupil achievement, regardless of the technology’s purpose. However, technology that helped pupils perform computational functions had the greatest effects on pupil achievement, while combinations of enhancements demonstrated the least effects on pupil achievement. The author found that study quality and the type of technology used in the classroom were the main influencers on effect sizes. The highest-quality studies had the lowest effect sizes, which he attributes to their more rigorous analysis procedures. The high-quality reviews gave an overall effect size for the use of technology of +0.16 (compared with +0.38 for low- and +0.46 for medium-quality reviews).
Source: Technology-enhanced mathematics instruction: A second-order meta-analysis of 30 years of research (November 2017), Educational Research Review, Volume 22
A new research brief by Jennifer L Steele and colleagues, published by the RAND Corporation, presents new research on dual-language immersion (DLI) programmes. These programmes provide both native English speakers and children learning English as an additional language (EAL) with general academic teaching in two languages from kindergarten (Year 1) onwards.
In partnership with the American Councils on International Education and the Portland Public Schools in Oregon (PPS), the authors conducted a random-assignment study of DLI education. The goal was to estimate the causal effects of the district’s DLI programmes on pupil performance over time in reading, mathematics and science, and on EAL pupils’ reclassification as English proficient.
PBS allocates immersion slots using a random-assignment lottery process for those who apply to the programmes. The study focused on 1,625 DLI lottery applicants in the kindergarten cohorts from 2004–2005 to 2010–2011. Pupil achievement was tracked until 2013–2014.
Key findings of the study were as follows:
- PPS pupils randomly assigned to dual-language immersion programmes outperformed their peers on state reading tests by 13% of a standard deviation in grade 5 (Year 6) and by 22% of a standard deviation in grade 8 (Year 9).
- Immersion-assigned pupils did not show statistically significant benefits or deficits in terms of mathematics or science performance.
- There were no clear differences in the effects of dual-language immersion according to pupils’ native language.
- EAL pupils assigned to dual-language immersion were more likely than their peers to be classified as English proficient by grade 6 (Year 7). This effect was mostly attributed to EAL pupils whose native language was the same as one of the two languages taught.
Source: Dual-language immersion programs raise student achievement in English (2017), RAND Corporation Research Brief, RB-9903
New educational technology programmes are being released faster than researchers can evaluate them. The National Bureau of Economic Research in the US has written a working paper, Education Technology: An Evidence-Based Review, which discusses the evidence to date on the use of technology in the classroom, with the goal of finding decision-relevant patterns.
Maya Escueta and colleagues compiled publicly available quantitative research that used either randomised controlled trials or regression discontinuity designs (where pupils qualify for inclusion in a programme based on a cut-off score at pre-test). All studies had to examine the effects of an ed-tech intervention on any education-related outcome. Therefore, the paper included not only the areas of technology access, computer-assisted learning and online courses, but also the less-often-studied technology-based behavioural interventions.
Authors found that:
- Access to technology may or may not improve academic achievement at the K-12 level (Years 1–13), but does have a positive impact on the academic achievement of higher education students (ES=+0.14).
- Computer-assisted learning, when equipped with personalisation features, was an effective strategy, especially in maths.
- Behavioural intervention software, such as text-message reminders or e-messages instructing parents how to practise reading with their children, showed positive effects at all levels of education, and was also a cost-effective approach. Four main uses for behavioural intervention software emerged: encouraging parental involvement in early learning activities, communication between the school and parents, successfully transitioning into and through higher education, and creating mindset interventions. Research is recommended to determine the areas where behavioural intervention software is most impactful.
- Online learning courses had the least amount of research to examine and showed the least promise of the four areas. However, when online courses were accompanied by in-person teaching, the effect sizes increased to scores comparable to fully in-person courses.
Source: Education technology: an evidence-based review (August 2017), National Bureau of Economic Research (NBER) Working Paper No. 23744