Methodological and Sociological Reflections on Pupil Segregation in England with Dr Sean Demack

In 2015, Boylan et al. published the findings of an RCT-centred evaluation of a secondary maths programme funded by the DfE. Whilst the evaluation provided no evidence of impact (on improving maths attainment) for the programme, the multilevel analyses did uncover some striking structural patterns. A rare 3-level RCT design and analysis was adopted that acknowledged how pupils were clustered into classrooms which in turn were clustered into schools. The analyses revealed that the majority of pupil differences (or variance) in maths attainment were found at a structural level; between-schools and (predominantly) within-schools, between-classrooms. I have since reflected on the findings and implications of Boylan et al., (2015) in other projects and publications. First, in relation to evaluation research and design of RCTs that acknowledge the structural contexts of education and schools (Demack, 2019; Demack et al., 2022). Second, in relation to the sociology of education and the historical enthrallment with between- and within- school segregation of pupils in England (Demack, 2021 & 2023).

This paper highlights key findings from these publications and discusses their implications. Methodological reflections for RCT design are summarised alongside sociological reflections on educational equality of opportunity (in England). I begin with a visualisation of four statistical ‘extremes’ of pupil segregation before touching on key findings and implications. I end by returning to the visualisation to identify which of the statistical extremes best reflects the English education system.

• Demack, S. (2023) Pupils segregated: inequality engineered. Paper given at the Radical Statistics conference in Sheffield, March 25th 2023
• Demack, S., Boylan, M., Culliney, M. & Wolstenholme, C. (2022) Evaluation of Realistic Maths https://educationendowmentfoundation.org.uk/projects-and-evaluation/projects/realistic-maths-education
• Demack, S. (2021) The statistics of pupil segregation in England. RadStats 129, Demack129.pdf (radstats.org.uk)
• Demack, S. (2019) Does the classroom level matter in the design of educational trials? A theoretical and empirical review. https://educationendowmentfoundation.org.uk/public/files/Publications/Does_the_classroom_level_matter.pdf
• Boylan, M., Demack, S., Willis, B., Stevens, A., Adams, G. & Verrier, D. (2015) RCT-centred evaluation of Multiplicative reasoning professional development programme. https://www.gov.uk/government/publications/multiplicative-reasoning-professional-development-programme
• https://www.shu.ac.uk/about-us/our-people/staff-profiles/sean-demack