value added?

Eight years ago, the L.A. Times published teachers’ ratings. New research tells us what happened next.

In 2010, the Los Angeles Times did something that hadn’t been done before.

The newspaper published test-score data for thousands of the city’s public school teachers, assigning them a rating based on how they influenced students’ results.

It caused a firestorm. Critics, including many teachers, railed against the measures as misleading and poorly constructed, warning that the data would demoralize teachers. The L.A. Times itself defended the release as necessary transparency.

In an accompanying story, one local teacher suggested it might also help children by empowering parents “to demand a good teacher.”

New research suggests that’s what happened next — but only for certain families.

Publishing the scores meant already high-achieving students were assigned to the classrooms of higher-rated teachers the next year, the study found. That could be because affluent or well-connected parents were able to pull strings to get their kids assigned to those top teachers, or because those teachers pushed to teach the highest-scoring students.

In other words, the academically rich got even richer — an unintended consequence of what could be considered a journalistic experiment in school reform.

“You shine a light on people who are underperforming and the hope is they improve,” said Jonah Rockoff, a professor at Columbia University who has studied these “value-added” measures. “But when you increase transparency, you may actually exacerbate inequality.”

That analysis is one of a number of studies to examine the lasting effects of the L.A. Times’ decision to publish those ratings eight years ago. Together, the results offer a new way of understanding a significant moment in the national debate over how to improve education, when bad teachers were seen as a central problem and more rigorous evaluations as a key solution.

The latest study, by Peter Bergman and Matthew Hill and published last month in the peer-reviewed journal Economics of Education Review, found that the publication of the ratings caused a one-year spike in teacher turnover. That’s not entirely surprising, considering many teachers felt attacked by the public airing of their ratings.

“Guilty as charged,” wrote one teacher with a low rating. “I am proud to be ‘less effective’ than some of my peers because I chose to teach to the emotional and academic needs of my students. In the future it seems I am being asked to put my public image first.”

But a separate study, by Nolan Pope at the University of Maryland, finds the publication of the ratings may have had some positive effects on students, perhaps by encouraging schools to better support struggling teachers.

Pope’s research showed that Los Angeles teachers’ performance, as measured by their value-added scores, improved after their scores were published. The effects were biggest for the teachers whose initial scores were lowest, and there was no evidence that the improvement was due to “teaching to the test.”

“These results suggest the public release of teacher ratings could raise the performance of low-rated teachers,” Pope concluded.

The two studies offer divergent pictures of the consequences of L.A. Times’ move. Pope did not find that higher-scoring students moved into the classrooms of higher-scoring teachers, while Bergman and Hill didn’t find clear evidence that teachers improved.

Those varying results are not entirely surprising, since the researchers used different methods. Pope’s research compared the same teachers before and after their value-added scores were published. Bergman and Hill took advantage of the fact that the L.A. Times only published scores for teachers who taught 60 or more students between 2003 and 2009, creating a natural experiment. The researchers then compared teachers who had taught just more than 60 kids to those teachers who had taught just under 60.

Rockoff of Columbia said he found both studies credible.

A third study, published in 2016, looks at an entirely different question: Did housing prices in Los Angeles increase near schools with more highly rated teachers?

Not really, according to the paper. That’s somewhat surprising, because past research has shown that housing zoned for schools with higher overall test scores and ratings is more expensive.

The researchers suggest that that might be because families had a hard time understanding what the ratings represented, and that some may have tuned out because of the surrounding controversy.

The results come in a very different political climate than around the time of the public release of the scores, when conversations about teacher performance had reached a fever pitch.

In 2010, then-Secretary of Education Arne Duncan praised the publication of teacher ratings. He used federal carrots and sticks to encourage states to use student test scores as part of how teachers are judged, a policy most states adopted.

But since then, states like New York and Virginia have barred the public release of this performance data, while media organizations have increasingly shied away from publicizing them. The new teacher evaluation systems have run into political challenges, and in some cases not had the hoped-for effects on student performance. And the federal education law passed in 2016 specifically banned the secretary of education from pushing teacher evaluation rules.

survey says

We asked Indiana teachers why they’re leaving the classroom: ‘Death by a thousand cuts’

PHOTO: Getty Images

In her first classroom at Indianapolis Public School 79 in 1977, art teacher Teresa Kendall had five whole potter’s wheels to herself. Plus clay. And a kiln.

She was under orders from her principal, she remembers, to make sure her students “have all the art they can have.”

Nearly 39 years, five layoffs, and four school districts later, she returned to Indianapolis Public Schools, where she was told there were just a handful of potter’s wheels in the entire district. She managed to get her hands on one, rescuing it from an unused classroom at Arlington High School.

Chalkbeat asks Indiana teachers: Why did you leave the classroom?

“It’s a huge difference,” Kendall said, comparing her situation to other schools she’s seen. “It just puts a knot in my stomach when I think about it … I think about what my kids at [School] 105 have to do without.”

Kendall said she spent hundreds of dollars on supplies, and she was overwhelmed by having to configure her 28-seat classroom to accommodate 62 students. At the end of last year, she decided to leave teaching altogether.

“It was the most solid community school I’ve ever been in, in all of my career,” Kendall said. “I miss it tremendously. But I couldn’t stay there.”

Carrie Black, an Indianapolis Public Schools spokeswoman, said classes might have been large at one point when the district was working to hire a substitute for a teacher on family leave, but the principal at School 105 said there were enough tables and chairs for the whole class. The principal also said teachers were told they could be reimbursed for supplies.

“Under no circumstances was she required to supply her art room in any way, shape, or form,” Black said. “So if she did, those were decisions she made on her own.”

More than 60 former Indiana teachers responded to a Chalkbeat survey about why they decided to leave teaching, a problem that policymakers and state lawmakers have said is part of the reason behind this year’s efforts to raise teacher salaries — which some educators and advocates say don’t go nearly far enough. Across the country, teachers have gone on strike and protested to demand better pay and working conditions, stirring up national conversation about the challenges they face.

Kendall, who has two master’s degrees, made $48,000 when she left IPS. The most she’d made, she said, was close to $62,000 when she taught in Lebanon. Now, she’s a paralegal.

The former teachers, from schools all over the state, reported a wide range of salaries over the years — from as low as $26,000 to more than $66,000. Now out of the classroom, they have found jobs as nurses, bus drivers, engineers, insurance agents, and seasonal park rangers. Some are unemployed, stay-at-home-parents, or graduate students.

While many former teachers said low pay or stagnant salaries contributed to their decisions to find other careers, more cited increasing responsibilities for reporting and testing, dwindling support and coaching from administrators, and “punitive” teacher evaluations.

Here is a selection of their reasons for leaving, lightly edited for clarity and length.

Too little pay

  • I had a third child and my entire paycheck was going toward insurance and childcare. I couldn’t afford to work.
  • State laws were being introduced that would make it next to impossible to ever increase my salary, or even to bargain to try to keep pace with the cost of living.
  • I was 20 years into teaching and felt undervalued, overworked, and underpaid for my education, training, and role as a teacher. I had reached the top of the pay scale and there was not room to advance. I didn’t want to become an administrator. Our insurance was steadily rising and with no pay raises, we were making less than what I had started with 20 years ago. My wife and I were both teachers and we both had to take part-time jobs to help pay the bills.
  • The level of stress, the constant demand on more and more of my time and energy with no compensation, and the low wages! Also the constant micromanaging!
  • In my 12th year I was making less than I did in year one. Health insurance was too costly, parents were overbearing, and the amount of accommodations needed for students was out of hand.

Too much testing, politics, and red tape

  • I couldn’t take any more of the state legislature’s disrespect of teachers. The loss of school funding, punitive evaluation methods, and absolute lack of willingness to truly listen to educators about our needs and what goes on in a classroom made me realize it wasn’t worth it anymore.
  • The constant change in state testing.
  • I had had it with ISTEP and school accountability practices demanding measurable outcomes and driving learning away from what we all know are best practices.
  • There was constant assessing without allowing kids to be kids and grow socially and mentally. Spent more hours assessing than teaching.
  • The time required to be spent on more red tape and paperwork instead of just doing what I knew was best for kids was too much.
  • I was working 10-12-hour days just to get state-mandated paperwork done AND papers graded. I loved my kids, I loved my school, I loved my principals, but I hated meetings every morning to appease legislators who are clueless, and I hated having to prove what a great teacher I was.
  • The time the job required meant my son and I were at school until 8 or 9 every night. All that time and dedication with no guarantee of a job? No thanks.
  • Teachers were treated as if we were entry level employees who could not make any decisions for themselves.
  • My afternoon classes had 39, 38, and 40 students. The Rise rubric [for teacher evaluations] made everyone feel like they were failures before even being evaluated.
  • I was dealing with burnout, and I was tired of working as many hours as I did and being as undervalued as I was. It felt like I constantly had administrators, parents and community members telling me what was wrong with how I did things.
  • I was expected to assign at least 10 math problems to every student every night. Since I had about 100 students, that’s about 1,000 math problems every night. Bottom line, time with my family is more important.
  • I felt overwhelmed by what the legislators were inflicting on us, the lack of true support from administrators, and just the stress that is teaching even in the best of times. Most of all — I was exhausted, I guess. Death by a thousand cuts, more or less.

negotiations

Aurora school board reverses course, accepts finding that district should have negotiated bonuses with union

Students in a math class at Aurora Central High School in April 2017. (Photo by Yesenia Robles, Chalkbeat)

Following weeks of criticism, the Aurora school board on Tuesday reversed course and accepted an arbitrator’s finding that a pilot bonus system violated the district’s agreement with the teachers union.

The Aurora school district rolled out an experiment last year to offer bonuses to some teachers and other staff in hard-to-fill positions, such as psychologists, nurses and speech language pathologists.

The teachers union argued that the plan should have been negotiated first. An arbitrator agreed and issued a report recommending that the pilot program stop immediately and that the district negotiate any future offerings. The union and school board are set to start negotiations next month about how to change teacher pay, using new money voters approved in November.

When school board members first considered the arbitrator’s report last month, they declined to accept the findings, which were not binding. That raised concerns for union members that the district might implement bonuses again without first negotiating them.

Tuesday’s new resolution, approved on a 5-1 vote, accepted the full arbitrator’s report and its recommendations. Board member Monica Colbert voted against the motion, and board member Kevin Cox was absent.

Back in January 2018, school board members approved a budget amendment that included $1.8 million to create the pilot for incentivizing hard-to-fill positions. On Tuesday, board member Cathy Wildman said she thought through the budget vote, the school board may have allowed the district to create that incentive program, even though the board now accepts the finding that they should have worked with union before trying this experiment.

“It was a board decision at that time to spend that amount on hard-to-fill positions,” Wildman said.

Board president Marques Ivey said he was not initially convinced by the arbitrator’s position, but said that he later read more and felt he could change his vote based on having more information.

Last month, the Aurora school board discussed the report with its attorney in a closed-door executive session. When the board met in public afterward, it chose not to uphold the entire report, saying that the board could not “come to an agreement.” Instead board members voted on a resolution that asked the school district to negotiate any future “long-term” incentive programs.

Union president Bruce Wilcox called the resolution “poorly worded” and slammed the board for not having the discussion in public, calling it a “backroom deal.” Several other teachers also spoke to the board earlier this month, reminding the newest board members’ of their campaign promises to increase transparency.

Board members responded by saying that they did not hold an official vote; rather the board was only deciding how to proceed in public. Colorado law prohibits schools boards from taking positions, or votes, in private.

The board on Tuesday also pushed the district to provide more detailed information about the results of the pilot and survey results that tried to quantify how it affected teachers deciding to work in Aurora.