Learning from the CORE Districts' Focus on Measurement, Capacity Building, and Shared Accountability
Published

Summary

California and the US are undergoing a cultural shift in school accountability policies towards locally-determined measures of school performance. Lessons can be learned from the CORE districts, which developed an innovative accountability system, emphasizing support over sanctions, and utilizing multiple measures of school quality. The CORE districts' measurement system and collaboration hold promise for improving local systems, but efforts to build capacity remain a work in progress.

Early lessons from the CORE Districts
Published

Summary

California policy shifts gave school districts more control, but many lack expertise and capacity for improvement. The CORE districts applied continuous improvement in a Networked Improvement Community to close the math achievement gap for African American and Hispanic/Latino students. The four lessons learned were: create an improvement team, refine theories through systems analysis, interpret different data, and benefit from expert facilitation. Investment in continuous improvement can lead to powerful insights and reform.
Publication author
Published

Summary

To support policymaker discussions on including chronic absenteeism data in California's accountability system, PACE analyzed the CORE Districts' student chronic absenteeism data. It is feasible to include chronic absence as a measurement using the state's approach for rating school achievement based on outcome and improvement or by simply looking at performance in a given school year.
… absenteeism data in the state’s accountability system, PACE has conducted an analysis of the CORE Districts ’ student chronic absenteeism data. Chronic … … *This memo represents work underway as part of the CORE-PACE Research Partnership. For more information, visit …
Published

Summary

California’s shift towards continuous improvement in education makes understanding how districts and schools can learn to improve a more pressing question than ever. The CORE Improvement Community (CIC), a network of California school districts engaged in learning about improvement together, is an important testing ground to learn about what this work entails.
Publication author
Published

Summary

This report presents benchmarking data on self-report student surveys measuring social-emotional learning (SEL) from nearly half a million students in grades 4 through 12 across 8 CORE districts in California. The data provide means and standard deviations by construct, grade level, and subgroup, and can serve as a proxy for a nationally-normed sample for other schools across the country looking to administer the CORE survey.

A Research Summary and Implications for Practice
Published

Summary

Given the importance of a college degree for both individual and societal economic prosperity, policymakers and educators are focused on strengthening the path to college beyond college entry. In this report, we synthesize the existing literature on four factors key to educational attainment—aspirations and beliefs, academic preparation, knowledge and information, and fortitude and resilience—and the implications of each.
Practices and Supports Employed in CORE Districts and Schools
Published

Summary

This study explores ten "outlier schools" in California's CORE districts that have strong social-emotional learning outcomes. The brief and infographic summarize the various practices found in these schools and the common implementation challenges faced. The findings offer lessons that can help other schools and districts implement social-emotional learning at scale.

Evidence from the CORE Districts
Published

Summary

This study examines how social-emotional skills develop from Grade 4 to Grade 12 and vary by gender, socioeconomic status, and race/ethnicity. Based on self-report student surveys administered to around 400,000 students in California, the study finds that social-emotional skills do not increase uniformly and vary across subgroups. Females have higher social awareness but lower self-efficacy than males. Economically disadvantaged students show improvement in high school. White students report higher social-emotional skills than African American and Latinx students.
Publication authors
Published

Summary

This study examines the impact of target setting for non-academic indicators on school quality ratings in CORE districts' elementary schools. The authors found that non-academic measures of school quality vary over time, are not consistently associated with demographics, and are sensitive to small changes in rating thresholds. The results suggest a need for more research on target setting for non-academic indicators in school quality systems.
… indicators. Focusing on elementary schools within the CORE districts , we investigate how moving performance … ratings. We ask: (1) How does school performance on CORE’s school quality improvement measures vary across … This paper was produced as part of the CORE-PACE Research Partnership, which is focused on producing …
Published

Summary

This report examines the stability of school effects on social-emotional learning (SEL) over two years in California's CORE districts. The correlations among school effects in the same grades across different years are positive but lower than those for math and ELA. While these effects measure real contributions to SEL, their low stability draws into question whether including them in school performance frameworks and systems would be beneficial.

… a large-scale SEL survey administered in California’s CORE districts . We find that correlations among school … and structures for supporting SEL.9 At a district level, CORE Districts — a non-profit collaborative of California … is the Director of Quantitative Research of the CORE-PACE Research Partnership. Prior to this position he was a …
The Impact of Unmotivated Questionnaire Respondents on Data Quality
Publication authors
Published

Summary

This paper investigates the effect of student satisficing, the act of providing suboptimal survey responses, on data quality in a large-scale social-emotional learning survey. The study examines the prevalence and impact of satisficing among 409,721 students and finds that its effect on data quality is less significant than expected. The paper offers a practical approach to defining and calculating satisficing, useful for researchers, policymakers, and practitioners working with large-scale datasets.
An IRT Modeling Approach
Published

Summary

This study examines the properties of California's CORE Districts' SEL survey, which measures social-emotional learning in students. The survey was given to over 400,000 students in grades 3-12. The study uses both classical test theory and item response theory frameworks to analyze the data and make recommendations for modeling and scaling SEL survey data. Policy implications are discussed for educators, administrators, policy makers, and other stakeholders.
Evidence from the CORE Districts and the PACE/USC Rossier Poll
Publication author
Published

Summary

The increase in students opting out of standardized tests is a threat to accurately measuring student achievement. This brief examines the effects of opting out in the CORE districts and models how it could affect accountability measures. More opt-outs could significantly impact some metrics, but the growth measure is largely unaffected. Metrics tracking achievement by cohort are at risk of bias, even with low levels of opting out. Adjusting for characteristics of students who take the tests could be a solution.

Evidence from California’s CORE School Districts
Publication authors
Published

Summary

This paper examines which social-emotional skills are most important for student success and how they vary among student subgroups. It uses longitudinal data from over 200,000 fourth through seventh grade students in California to explore growth mindset gaps across student groups and shows the significant predictive power of growth mindset for academic achievement gains, even when controlling for other social-emotional skills and background characteristics.
… Mindset Learn More in School Evidence from California’s CORE School Districts Susana Claro Susanna Loeb While the … mindset learn more in school: Evidence from California’s CORE school districts [Working paper]. Policy Analysis for … This paper was produced as part of the CORE-PACE Research Partnership, which is focused on producing …
Findings from the First Large-Scale Panel Survey of Students
Published

Summary

This paper examines the use of social-emotional learning (SEL) measures to evaluate school-level growth in student outcomes. The study finds substantial differences across schools in SEL growth, suggesting that schools may contribute to students' SEL. However, caution is recommended in interpreting measures as the causal impacts of schools on SEL due to potential measurement error and omitted variables bias.
Evidence from California’s CORE Districts
Publication authors
Published

Summary

This paper uses a large dataset to confirm that self-management skills predict student success and are a better predictor of student learning than other socio-emotional skills. Students with higher levels of self-management experience almost 80 days of additional learning. The paper also describes self-management gaps across student groups.
… and Student Achievement Gains Evidence from California’s CORE Districts Susana Claro Susanna Loeb Existing research on … and student achievement gains: Evidence from California’s CORE Districts [Working paper]. Policy Analysis for … This paper was produced as part of the CORE-PACE Research Partnership, which is focused on producing …
Consistent Gender Differences in Students’ Self-Efficacy
Published

Summary

This brief examines the consistency of the drop in academic self-efficacy during middle school across various student groups, such as demographics, achievement level, and school of attendance. The study finds that the drop is essentially universal across all groups, despite some showing lower self-efficacy than others. Additionally, schools vary in their students' level of self-efficacy, but do not differ much in this trend. The drop in academic self-efficacy is steeper for female students, resulting in lower self-efficacy for girls than boys throughout middle and high school.
… exception is an early study using data from the California CORE districts that examined trends in students’ … Our analyses use data from five of the California CORE districts6 which received a waiver granting exemption … 5 This brief is based on a PACE working paper, which can be found here: …
Published

Summary

This study uses value-added models to explore whether social-emotional learning (SEL) surveys can measure effective classroom-level supports for SEL. Results show that classrooms differ in their effect on students' growth in self-reported SEL, suggesting that classroom-level effects may be larger than school-level effects. However, the low explanatory power of the SEL models means it's unclear if these are causal effects. The SEL measures also capture growth not measured by academic test scores, indicating that classrooms within schools may impact measurable student growth in SEL.
… brief applies value-added models to student surveys in the CORE Districts to explore whether social-emotional learning … brief applies value-added models to student surveys in the CORE Districts to explore whether social-emotional learning … Hans Fricke was the Director of Quantitative Research for PACE when producing this report; he is now an economist at …
Learning from the CORE Data Collaborative
Published

Summary

Effective data use is crucial for continuous improvement, but there is confusion about how it differs from data use for other purposes. This report explains what data are most useful for continuous improvement and presents a case study of how the CORE data collaborative uses a multiple-measures approach to support decision-making.