A common, although misleading, refrain heard from education reform critics is that charter schools on average do no better on standardized tests than public schools. Less commonly discussed is the impact on other, non-test outcomes. A paper (working version) in the most recent Journal of Labor Economics by Kevin Booker and Brian Gill from Mathematica, Tim Sass from Florida State, and Ron Zimmer from Vanderbilt, looks at how attending a charter schools affects the probability of graduating high school and attending college for a sample of students from Chicago and Florida.
An important question in the literature is the extent to which selection bias is a problem. Do charter school students have different outcomes than public school students because the charters educate them somehow better or worse, or is it because people who decide to go to charter schools are systematically different than those who don’t? In order to control for this they look at the sub-group of students who attended a charter middle school, and compare outcomes for those who went onto a charter high school to those who went on to a public high school. The idea is that selection bias shouldn’t be an issue between those who are already attending a charter school, because as charter school attendees they should be similar in terms of whatever unobservable variables lead to charter attendance.
They find that in both Florida and Chicago, attending a charter high school increased graduation and college attendance rates. In Chicago, students were 7% more likely to graduate from high school if they attended a charter, in Florida it was 12% to 15%. Charters increased the probability of attending college by 8% to 10% in both Florida and Chicago. The authors argue that these results are consistent with the studies on the effects of attending a Catholic school, and a recent D.C. voucher experiment, both of which have been shown to improve educational attainment. Consistent with the literature on the affects of charter attendance on test scores, they find that the impact in Florida is stronger in urban areas.
These are important results to keep in mind. Given education reform critics skepticism of standardized testing, I expect results like this will receive more weight for them than studies that look only at test scores.

6 comments
Comments feed for this article
Wednesday ~ March 16th, 2011 at 9:53 am
BSE
I support charter schools and all, but I don’t find that very convincing. What about the unobserved characteristics that lead these students to choose the charter high school compared to the public high school? Unless I’m missing something they haven’t solved the problem at all.
I’m not a fatalist on the issue, I think its entirely possible/plausible that charter schools may improve school performance (I myself went to Catholic School), but for the moment that’s just my faith in markets speaking. It possible, but I’m not convinced we’ve figured it out, yet.
Wednesday ~ March 16th, 2011 at 11:20 am
Adam Ozimek
I’m not going to go into the econometrics, but they argue that the selection bias from those unobservables is, if anything, negative. They present some evidence for this in Florida.
Wednesday ~ March 16th, 2011 at 3:33 pm
Stuart Buck
You expect wrongly — opponents of standardized testing like Diane Ravitch never acknowledge this study (which has been available in draft form for a couple of years), even when it’s repeatedly brought to their attention.
Nor will they ever acknowledge the randomized evaluation finding that the DC voucher program raised the graduation rate by 12 percentage points (just for kids who were offered a voucher, but didn’t even necessarily use it). http://ies.ed.gov/ncee/pubs/20104018/index.asp
Friday ~ March 25th, 2011 at 10:24 am
Peter Robertson
I wish you would go into the econometrics. I will try to find and read the study, but I share the same question. As a supporter of charters, I intuitively think that a student who DID attend a charter middle school and then did NOT attend a charter high school is less likely to go to college than one who goes to charters for Middle and High schools – it’s important to understand why they left the charter.
Thursday ~ October 13th, 2011 at 12:02 am
Hit Coffee » Linkluster Sextio-Sex
[...] if you look at the metrics we’re “supposed to be” looking at, charter schools do well, according to one [...]
Friday ~ September 21st, 2012 at 2:28 am
School Choice in the Long Run | Alaskans for Choice in Education
[...] is a hopeful result, and it comports with other evidence I’ve seen on school choice and college [...]