Education researchers use surveys widely. Yet, critics question respondents’ ability to provide high-quality responses. As schools increasingly use student surveys to drive policymaking, respondents’ (lack of) motivation to provide quality responses may threaten the wisdom of using surveys for data-based decision-making. To better understand student satisficing (sub-optimal responding on surveys) and its impact on data quality, we examined the pervasiveness and impact of this practice on a large-scale social-emotional learning survey administered to 409,721 students in grades 2-12. Findings...

While the importance of social-emotional learning for student success is well established, educators and researchers have less knowledge and agreement about which social-emotional skills are most important for students and how these skills distribute across student subgroups. Using a rich longitudinal dataset of 221,840 fourth through seventh grade students in California districts, this paper describes growth mindset gaps across student groups, and confirms, at a large scale, the predictive power of growth mindset for achievement gains, even with unusually rich controls for students’...

We illustrate the application of mixture IRT models to evaluate the possibility of respondent confusion due to the negative wording of certain items on a social-emotional learning (SEL) assessment. Using actual student self-report ratings on four social-emotional learning scales collected from students in grades 3-12 from CORE districts in the state of California, we also evaluate the consequences of the potential confusion in biasing student- and school-level scores as well as correlational relationships between SEL and student-level variables. Models of both full and partial confusion are...

Academic self-efficacy is a student’s belief in their ability to perform within a school environment. Prior research shows that students experience a drop in academic self-efficacy during middle school that is particularly steep for female students and results in lower self-efficacy for girls than boys throughout middle and high school. In this brief, we probe whether this pattern is consistent across student groups defined by demographics, achievement level, and school of attendance. We find unusual consistency: while non-white, low-achieving, and poor students show somewhat lower self...

This brief applies value-added models to student surveys in the CORE Districts to explore whether social-emotional learning (SEL) surveys can be used to measure effective classroom-level supports for SEL. The authors find that classrooms differ in their effect on students’ growth in self-reported SEL—even after accounting for school-level effects. Results suggest that classroom-level effects within schools may be larger than school-level effects. However, the low explanatory power of the SEL models means it is unclear that these are causal effects that have appropriately controlled for student...

The number of students opting out of standardized tests has grown in recent years. This phenomenon poses a potential threat to our ability to accurately measure student achievement in schools and districts. This brief documents the extent to which opting out is observed in the CORE districts and models how higher opt-out levels could affect various accountability measures. More students opting out could significantly impact some accountability measures in use in California, but the CORE districts’ growth measure is largely unaffected, as it reports the impact of schools on individual students’...

Existing research on self-management skills shows that measures of self-management predict student success. However, these conclusions are based on small samples or narrowly defined self-management measures. Using a rich longitudinal dataset of 221,840 fourth through seventh grade students, this paper describes self-management gaps across student groups, and confirms, at a large scale, the predictive power of self-management for achievement gains, even with unusually rich controls for students’ background, previous achievement, and measures of other social-emotional skills. Self-management is...

Although there is a robust body of literature studying targets for academic indicators within school quality systems few studies explore target setting for non-academic indicators. Focusing on elementary schools within the CORE districts, we investigate how moving performance targets for non-academic indicators affects school quality ratings. We ask: (1) How does school performance on CORE’s school quality improvement measures vary across schools and over time?; and (2) How does the setting of targets on CORE’s non-academic indicators at various levels impact the number and types of schools...

Charter schools enroll a growing share of public school students, leading to concerns about the financial implications of charter schools for traditional public schools. Using detailed expenditure data for school districts in California, this paper exploits variation in charter school enrollment across time and between districts to evaluate how district spending and overall financial health change as nearby charter sectors expand. The analysis shows that larger charter enrollment shares are associated with lower levels of per-pupil spending and reduced fiscal health in traditional public...

School value-added models are increasingly used to measure schools’ contributions to student success. At the same time, policymakers and researchers agree that schools should support students’ social-emotional learning (SEL) as well as academic development. Yet, the evidence regarding whether schools can influence SEL and whether statistical growth models can appropriately measure this influence is limited. Recent work shows meaningful differences across schools in changes in SEL scores by grade, but whether these differences represent the effects of schools is still unclear. The current paper...

Mounting evidence demonstrates that social-emotional skills are important for students’ academic and life success, yet there is limited evidence on how these skills develop over time and how this development varies across student subgroups. This study uses the first large-scale panel survey of social-emotional learning (SEL) to describe how four SEL constructs—growth mindset, self-efficacy, self-management, and social awareness—develop from Grade 4 to Grade 12, and how these trends vary by gender, socioeconomic status, and race/ethnicity. The results are based on self-report student surveys...

Measures of school-level growth in student outcomes are common tools used to assess the impacts of schools. The vast majority of these measures are based on standardized tests, even though emerging evidence demonstrates the importance of social-emotional skills (SEL). This paper uses the first large-scale panel surveys of students on SEL to produce and evaluate school-level value-added measures by grade for growth mindset, self-efficacy, self-management, and social awareness. We find substantive differences across schools in SEL growth, of magnitudes similar to those for academic achievement...

Chaffey College, a three campus college with approximately 20,000 students located California’s Inland Empire, has become the destination of many community college practitioners from around the country. The reason why? Over the past ten years, the college has become nationally-known as an institution with a “risk tolerant change-oriented culture” and a signature set of student support programs that produce impressive performance outcomes for Chaffey students.

When one observes many developmental classrooms, the most striking aspect is the heterogeneity of students. Some are “brush-up” students, who simply need to remember skills they have already learned. Some have been misplaced by placement exams, and similarly need very little additional instruction. Many — almost surely the majority — have failed to learn certain academic skills in many years of K-12 education, for reasons that are hotly debated. Others have learning disabilities or mental health issues, and colleges have no way of either diagnosing or treating such conditions. The result is...

Community colleges provide a substantial array of student support services, designed to help students master basic subjects and to learn “how to be college students.” However, the use of these services by instructors and students varies substantially. Some instructors rarely or never mention the availability of such services; others make the use of some services mandatory. But the largely voluntary nature of student services means that many students do not use these services, for reasons ranging from competing demands for their time to avoidance of stigma or stereotype threat. The result is...