Education systems worldwide often rely on high-stakes accountability measures to gauge school effectiveness. But what if the very system designed to ensure quality inadvertently penalises some schools while unfairly rewarding others? Our recent cluster analysis of school performance measures (SPMs) reveals a concerning pattern, suggesting that demographics, not just great schools, play a significant role in a school’s perceived success. This raises a critical question: is our school accountability system truly fair, or are some schools benefiting from ‘performance-enhancing D.R.U.G.S.’?
The Uneven Playing Field: Four School Clusters
Our analysis identified four distinct clusters of schools, each with unique demographic profiles and corresponding performance trends:
- Cluster 1: The Uphill Battle. These schools serve a high percentage of disadvantaged students, often with low prior attainment and a high proportion of students with Special Educational Needs and Disabilities (SEND). Unsurprisingly, they consistently perform below average across all SPMs.
- Cluster 2: The Advantageous Ascent. In stark contrast, schools in this cluster have a low percentage of disadvantaged students, relatively higher prior attainment and low percentages of SEND and English as an Additional Language (EAL) students. These schools perform generally above average on all SPMs.
- Cluster 3: Navigating Complexity. This cluster comprises schools with a high percentage of disadvantaged students and a high proportion of EAL students, but typically low SEND and low prior attainment. While their overall performance measures are broadly average, they show a remarkable performance in % EBacc Entry and EBacc APS, significantly above the national average. This suggests, perhaps, that they are effectively supporting students to achieve in specific, academically rigorous pathways despite demographic challenges.
- Cluster 4: The Select Few. These are selective (ie grammar) schools, predominantly serving advantaged students with very high prior attainment and low SEND. Predictably, they perform significantly above average for all SPMs.
The ‘D.R.U.G.S.’ of Demographics: Demographically Related Unfair Grading of Schools
The disparities highlighted by these clusters are stark. It’s difficult to argue that a school in Cluster 4, with its inherent advantages, is necessarily “more effective” than a school in Cluster 1, grappling with significant demographic hurdles. This is where the analogy to performance-enhancing drugs in sport becomes incredibly relevant.
In competitive sports, strict regulations are in place to prevent athletes from using performance-enhancing drugs. Why? Because these substances create an unfair advantage, undermining the very principles of fair competition and merit.
Similarly, our school accountability system, when viewed through the lens of these clusters, appears to be contaminated by performance enhancing ‘D.R.U.G.S.’—Demographically Related Unfair Grading of Schools. The “advantage” to scholls of a high-achieving, low-needs student body (akin to a performance-enhancing substance) skews the playing field, making it incredibly difficult to truly assess the effectiveness of schools serving diverse and challenging populations.
What Does This Mean for Fairness and Equity?
If a school’s “grade” or “performance” is heavily influenced by the socio-economic background and prior attainment of its students, then are we truly measuring the school’s impact, or merely reflecting its intake?
- It undermines the hard work of schools in challenging circumstances. Schools in Clusters 1 and 3 are often working tirelessly to support their students, yet their performance may be unfairly judged against those with inherent advantages.
- It can misinform parents and policymakers. A ‘high-performing’ school might be celebrated, not for its innovative teaching or exceptional leadership, but simply because it admits students who are already high-achieving.
- It perpetuates inequality. If resources and recognition are disproportionately directed towards schools with built-in advantages, it exacerbates the challenges faced by schools serving disadvantaged communities.
Towards a More Equitable System
Just as we strive for a level playing field in sports, we must demand one in education. Our accountability systems need a serious re-evaluation. This isn’t about excusing underperformance but about developing metrics that genuinely reflect a school’s impact and value-add, regardless of its starting point.
Perhaps it’s time to consider:
- Contextualised measures: Accounting for student demographics and prior attainment when evaluating school performance.
- Progress-based metrics: Focusing on how much students learn and grow during their time at a school, rather than just their absolute attainment.
- Qualitative assessments: Incorporating broader measures of school quality, such as student well-being, community engagement, and curriculum breadth, which might not be captured by traditional SPMs.
Until we address the ‘D.R.U.G.S.’ of demographics, our high-stakes school accountability system will continue to be a flawed instrument, unfairly penalizing some and disproportionately rewarding others. It’s time for a system that truly champions fairness, equity, and the genuine impact of every school.