L. A. Times uses value-added analysis to rate public school teachers

Public school students are graded and tested all the time. Schools are scored too — California rates them in an annual index.

Not so with teachers.

Nationally, the vast majority who seek tenure get it after a few years on the job, practically ensuring a position for life. After that, pay and job protections depend mostly on seniority, not performance.

That’s from The Los Angeles Times, which recently published a fascinating article about evaluating teachers (read it here). They used a statistical method known as “value-added analysis” to rate teacher effectiveness in Los Angeles public schools. They explained that, “Value-added analysis offers a rigorous approach. In essence, a student’s past performance on tests is used to project his or her future results. The difference between the prediction and the student’s actual performance after a year is the ‘value’ that the teacher added or subtracted.”

The Times obtained seven years of math and English test scores from the Los Angeles Unified School District and used the information to estimate the effectiveness of L.A. teachers — something the district could do but has not.[…]

Among the findings:

  • Highly effective teachers routinely propel students from below grade level to advanced in a single year. There is a substantial gap at year’s end between students whose teachers were in the top 10% in effectiveness and the bottom 10%. The fortunate students ranked 17 percentile points higher in English and 25 points higher in math.
  • Some students landed in the classrooms of the poorest-performing instructors year after year — a potentially devastating setback that the district could have avoided. Over the period analyzed, more than 8,000 students got such a math or English teacher at least twice in a row.
  • Contrary to popular belief, the best teachers were not concentrated in schools in the most affluent neighborhoods, nor were the weakest instructors bunched in poor areas. Rather, these teachers were scattered throughout the district. The quality of instruction typically varied far more within a school than between schools.
  • Although many parents fixate on picking the right school for their child, it matters far more which teacher the child gets. Teachers had three times as much influence on students’ academic development as the school they attend. Yet parents have no access to objective information about individual instructors, and they often have little say in which teacher their child gets.
  • Many of the factors commonly assumed to be important to teachers’ effectiveness were not. Although teachers are paid more for experience, education and training, none of this had much bearing on whether they improved their students’ performance.

I highly recommend reading the whole article. A question for teachers and administrators who read my blog: what do you think of value-added analysis, and using this as a tool to evaluate teachers? The article concedes that it should not be the sole method of evaluation, but suggests that it would be beneficial if it made up 30-50% of a teacher’s review.

195 thoughts on “L. A. Times uses value-added analysis to rate public school teachers”

  1. oh, and I have been told that some vendors who interact with teachers have offered to help sponsor some of the costs – not quite all, but that would be a good goal.

  2. In my opinion, Dr. Lathan should be entitled to a private meeting, pep rally, whatever – with staff, without the media present.

  3. stowell: Lathan certainly does not need YOU to speak for her. Do you talk to your mother the way you speak with Sharon? she is a taxpaying constituent and has EVERY right to question the shenanigans of d150 with the amount of money they bleed from the taxpayers in peoria…..pffft!

  4. 3 recent PJstar articles included that there was a budget shortfall again in D150, there was an armed mob of people roaming the streets of Peoria, and the Dunlap school district grew by an even larger amount than they expected. I wonder if there is any coorelation.

  5. I have the understanding that anyone is invited to the Monday meeting. I know when my husband recieved his invitation it was addressed to him, (district employee) or CURRENT RESIDENT.

  6. Jim, I have no reason not to believe that Dennis in Peoria gave us accurate information about only two board members being present. Evidently, there has been a change of plans if it will now be an open meeting with more than two board members present. Also, if it has now become an open meeting, the media will be present. If all that is true, then apparently Dr. Lathan has changed her mind. If that is the case, then I applaud her. In an earlier post (a few up) I stated that she has tacitly given her approval not to televise public comments and not to air meetings in a timely fashion. In the last post, I stated “Dr. Lathan is saying (not said) which implies that I believe her actions (not her words) reveal her attitude). I think that your request for me to tell you when Dr. Lathan has made such a statement indicates that you do not know the definition of the word tacit (therefore, you are implying that I am telling an untruth). My use of the word tacit (and the verb “is saying”) admits that I have never heard her make such a statement. I don’t know if your apology is needed or not. Actions and inactions speak louder than words, so until I Dr. Lathan requests that the board vote for a change, I will continue to assume that she is not in favor of changing the current plans.

  7. Jim, what do you mean, “I have been told that some vendors who interact with teachers have offered to help sponsor some of the costs – not quite all, but that would be a good goal.” Who are the vendors who interact with teachers? Why can’t you just say what you mean instead of making these cryptic comments? I am wondering why (with all the financial needs in our community) anyone would consider this a worthy cause.

  8. Sharon – “tacit” wasn’t in the post to which I responded, that referred to broadcasting board meetings and transparency. I spoke on that topic Monday. Names of vendors were not shared, so I don’t know – maybe benefits or 403(b) providers. It’s not cryptic to stay to the facts I know. I don’t agree at all that it benefits someone to throw out rumors and innuendo first(as you previously stated) because it will get corrected. You allowed me to sleep in most of your classes, yet awarded me an “A”. Why didn’t you hold yourself to the same standards you now apply? Arm-chair quarterbacking isn’t a game.

  9. Pam Adams will probably be at the Civic Center too this Monday. If any news reporter ( instigator is a better term) will be allowed to be there it will be her.

    How did everyone like the automated message about the Civic Center event? Where’s Leni Riefenstahl when you need her?

  10. Does anyone know if there ever was an official ruling on whether the “meet and greet” violated the Open Meetings Act ?

  11. “somebody that did not stay in one place long and still did some great things in each place that He was ”

    Actually Jesus’ mission covered an area from about Chillicothe to Peoria

  12. Wow. When I reposted from the District’s website that Staff Event notice, I had no idea it would become a two day issue on the Chronicle.

    What the hell, it’s a staff meeting for crying out loud. I for 1 don’t care to see it.

  13. “some vendors who interact with teachers”
    “Names of vendors were not shared, so I don’t know – maybe benefits or 403(b) provide”

    Jim: There is absolutely NO REASON for a vendor to be interacting with teachers in their capacity as such.

    “It’s not cryptic to stay to the facts I know.”

    Jim: If that were true, your posts would be blank.

    “You allowed me to sleep in most of your classes, yet awarded me an “A””

    Wow, Jim… I sure hope some 13 year old kid is posting under your name…
    Do you not know the purpose of school is different for the sons of Bradley Basketball Coaches and poor kids from the ghetto? …and you are on the school board… right?

  14. “Actually Jesus’ mission covered an area from about Chillicothe to Peoria”
    It would probably take just as long to travel that distance back then as it does to get here from NC today.

  15. “You allowed me to sleep in most of your classes, yet awarded me an “A””

    I think some would say you are “sleeping on the job” now as a School Board Member.

  16. My own primary complaint about the Civic Center event is not who is attending but who is paying for it. My second complaint is that teachers need to be (and want to be) in their rooms getting ready for school. Then, as long as the event is at the Civic Center, it would seem logical to me that Dr. Lathan would want the press to cover it. For the first time in history, District 150 is bringing in a record number of people new to the area to run its schools–I believe that as long as this event is being held it would be a time to introduce all of them formally to the city.
    Emerge, I, also, do not know what a staff meeting of this size is–never been to one. In District 150 they are usually called institutes.
    Jim continually embarrasses himself by bringing up the grade he did not deserve in my class. He never complained about it until the last year; he certainly didn’t mention it when he was running for the school board–to state that he wanted to end inflated grades in District 150, using himself as an example, or to reinstate weighted grades.
    Jim went to Washington Gifted, but when he came to Manual he chose to be in a basic English class (at least, in his senior year). I don’t know if he took the easy route for all his classes for all four years–maybe not. I taught basic English classes, not enriched. I am not certain whether or not District 150 had weighted grades at the time–I certainly hope so because, as Jim has implied, he possibly would not have earned an A in an enriched class where he belonged. Of course, I am trusting Jim’s memory–because I don’t remember what grades he earned. However, I do remember that he did a great job of brushing the snow off my car for $1. Jim, did you get A’s for all six grading periods? Shame on me! 🙂 All I really remember is that then and over the years, Jim has always treated me with respect–stopped in my room often over the years to say “Hi.” I know that Jim expected(and rightfully so) that I would support him and his ideas, etc., as a board member. That hasn’t happened as often as he or I would have expected.

  17. The truth is if events like the Civic Center one weren’t made mandatory very few people would go. If memory serves me correctly wasn’t it mandatory when Royster addressed the unwashed masses at the Civic Center?

  18. Here is the email word for word I received from Dist. 150:

    No. This is a staff meeting. No more than two Board of Education members will be in attendance at any one time.

    Stacey

    >>> Dennis Eggemeyer 8/25/2010 12:13 PM >>>
    Stacey,
    Will Dr. Lathan’s 8 am address to teachers and staff at the Civic Center be open to the media?
    Dennis Eggemeyer
    PCCEO, Inc.
    CAA Media Services Coordinator
    (309) 999-3826

    Now, if that changes as of today, that’s fine. But if it’s just a “Staff Meeting, and the Journal Star is allowed to send a reporter to write an article on it, I (and other TV media) should be allowed to shoot video of it.

  19. Sorry, Jim, I still have questions about your “vendor” post. You say that you don’t know the names of the vendors who might help pay for the Civic Center event. What did you know when you cast your “yes” vote on Monday? Did board members know how much the lease agreement and the food vendor agreement would cost when they cast their votes? I know that the information was not included in the two letters that were in the board member packet that was available to the public before the meeting.

  20. Come on folks. I know District 150 is in your sights, but they are having a staff meeting. New management and a new direction. Let them have it in peace for God’s sake.

  21. I just read Emerge’s post more carefully: it states: “10:30AM Staff meetings begin at individual schools”
    The event at the Civic Center was never called a “staff meeting”–there will be many staff meetings at 10:30 a.m., one at each of the schools.

  22. truth:
    “It would probably take just as long to travel that distance back then as it does to get here from NC today.’

    It isn’t about time travel, it is about community and neighborhoods… Jesus traveled within his own community. He didn’t go teaching in Turkey or Greece, Egypt or Persia (or America, sorry Mormons).

    Local school districts trying to meet the needs of local schools that are trying to meet the needs of local students.

    San Diego, Chicago, North Carolina… all in a matter of about 5 years… The San Diego school system is a mess… STILL. Chicago schools are a mess… STILL. I don’t know much about North Carolina schools.

    Resume building is great if you have something to show other than “Hey, I got hired for this position, but never did anything, ‘cuz I was only there 18 months and was too busy looking for another job”.

  23. “Come on folks. I know District 150 is in your sights, but they are having a staff meeting. New management and a new direction. Let them have it in peace for God’s sake.”

    Because, God knows, they only have the interest of the children in mind.
    (intentional sarcasm)

  24. Just got email from Stacey at Dist. 150:
    “Due to a possibility of more than two BOE members coming to our Staff Event on Monday, we will be posting a public notice. You should get it from Joan today.

    If you would like to come, you are welcome at 8:00 AM. Mult box will be in the back of the room.

    It is at the Peoria Civic Center, Hall D.”

    Ok, so I will be there ready to go with my camera and microphone line
    for the mult box.

  25. Victory!!! Let’s carry the momentum into all our concerns. Maybe the museum? What a huge victory for all the pesky bloggers and all their indignation.

  26. Oh, I forgot–the last time District 150 held a Meet and Greet Billy Dennis tried to get in and was turned away. I wonder if the district’s definition of the press has changed since then.

  27. I have not tested their policies since that time. The event in question was a “public meeting” in that a majority of a quorum of the board decided to attend a press conference to which was I was not invited and denied entrance. My work schedule and health generally keep me from attending most events these days.

  28. The PJStar article states that D150 anticipates 2,500 employees to attend the meeting at the Civic Center. I guess that explains why it couldn’t be held at Richwoods – the auditorium there holds half that. The cost to rent the facility itself is $2,500 – seems like money well spent to start the year off given all the change that has happened and is likely to continue.

    Of course, I imagine some will still complain about the potential $20,000 cost of the food. That runs an average of $8 per person. Personally, I consider the amount trivial but the consideration for the employees commendable and appreciated.

    To paraphrase Allen Iverson, we’re talkin’ ’bout BREAKFAST!

    http://www.youtube.com/watch?v=frsId3goYYE

  29. Good post Jon. Teachers rarely get anything from the schools. They are lucky to get an occassional donut. Breakfast once a year is the least they deserve.

  30. 150 Observor: Teachers rarely get supplies for their classrooms from District 150–most comes out of their own pockets. This breakfast will not say “appreciation” to teachers–they want to be in their classrooms getting ready for children. The PJS article didn’t mention whether or not Dolan, the speaker, will be paid and how much. I believe Dolan is a very credible and inspiring speaker, etc., but my guess is that he isn’t coming to Peoria to speak for free. What about his traveling expenses? Maybe he is coming at his own expense because the board wasn’t asked to approve this expenditure at the board meeting when they approved the Civic Center and the food.

  31. Yup, believe me, District 150 teachers spend more than $20,000 a year buying supplies for their room or helping out poor kids with what they need. One breakfast a year does not come close to showing their appreciation.

  32. Jon since you were calculating the cost, per person, for the event you forgot to calculate this…..
    2,500.00 rent is about 23 hours worth of pay for the superintendent and 20,000 for food is almost a months pay for the superintendent. She could pay that bill herself, couldn’t she? I doubt she is that committed to her job though.

  33. teachers also, resident authority on all things education, Ms. Sharon. When you channel Dr. Lathan and speak for all teachers, you must have some doozie conversations bouncing in your mind. Will you be handling negotiations too?

  34. Speaking for all–sounds like Jim again, but “Ms. Sharon” is a new touch–Jim, is that you or are there really two of you? Whoever you are, with how many teachers have you had this discussion (about where they would rather be Monday morning from 6:30 to 10:30)? Jim did mention that teachers associated with vendors had volunteered to pay for something. Maybe the union is paying for the speaker. Does anyone know?

  35. Many administrators were teachers. Few teachers were administrators. Many teachers think they know more about administration than the administrators.

    Unfortunately, it is true in most organizations that the non-managers tend to think they know more than the managers. Human nature. Now and then you find a non-manager that actually may realize that their knowledge and skill base is not unlimited. 🙂

  36. 150 Observer, most dedicated teachers have no desire to be administrators. I am always amazed by how quickly the teachers who become administrators forget the reality of the classroom. The problem with administrators is that they almost never consult with the teachers about anything. For instance, not one teacher was on the committee to revise the dress code. Teachers are expected to carry out all directives, but seldom have any input into what will work and what won’t.

  37. “Many administrators were teachers. Few teachers were administrators. Many teachers think they know more about administration than the administrators.”

    This doesn’t make any sense at all.. why are teachers becoming administrators then?

    Wouldn’t it be just as relevant to ask if many administrators think they know more about education than the teachers?

  38. Teachers become administrators for the wages, because they like leading, because teaching isn’t satisfying enough, because they like administration more and on and on.

  39. WOW, nobody was even shocked at how the breakdown of the costs for the Koolaid Rally at the Civic Center compaired with the superintendents salary.

  40. They say a picture is worth 1000 words…so video must be worth 100x that. I will be there to get Dr. Lathan’s opening speech, have it available on YouTube, hopefully to prove some folks wrong. Sorry, but other work tasks will prevent me from getting any other speakers.

    How many negative posters commenting here work for Dist. 150, that will be at this rally tomorrow? How many teachers/employees would tune in to a TV broadcast if it was done that way vs. getting their classroom/building ready?

    I really don’t think there is any facility (except the Stadium) that could hold 2,500 people. Holding it
    outdoors was probably out of the question. Maybe some of the money will be recouped from vendors/donations for the expense. As usual, we will have to wait and find out. Most importantly is the environment and the motivating mood that Dr. Lathan is trying to gear everyone up for. That I support.

  41. Sorry to have created such a stir, Dennis, and sorry to have put you in the middle of it. However, if you hadn’t reported that the press wasn’t invited, neither you nor the rest of the press would have been invited (in my opinion). I’m sorry, also, but I still believe it’s about the money and that the board and administration are saying that it’s OK to spend money if it’s for a cause they deem worthy. What I didn’t understand is why they didn’t deem it a great PR opportunity in the first place–why did they have to be goaded into letting you come. However, there are many causes that they do not deem worthy–some of which could have benefited from this $23,000. I guarantee you that they are too broke to give teachers supplies for their classrooms–items that are needed to run a classroom. The teachers will have to pay for so many, many items themselves. I hope you can understand that spending money on this breakfast is not the appreciation that will be meaningful to teachers. I know that I am jaded–been through too many speeches and promises. Does anyone believe that a speech by anyone is going to turn this district around? Again, this event was only held once before, and, unfortunately, many of us remember that the speech was not indicative of what was to come. Yes, any District 150 employees who have complained on this blog will be there tomorrow–it isn’t an RSVP invitation. Also, remember this is the same school board whose president stated (though disingenuously) that money would be saved by not broadcasting the public comment portion of board meetings. I can assure you that they haven’t saved $23,000 by that omission.

  42. No problem, Sharon. I don’t feel I was put in the middle.
    I just felt that parents should be able to hear what
    Dr. Lathan has to say, so they might also be motivated
    and encouraged to become more involved….be on the same page as teachers, staff, and administrators. Folks claim over and over that too many parents aren’t involved enough.

    I really don’t have an opinion 1 way or another on the money spent on this…I’ll leave that up to other people. (I have said before I live in Marquette Heights, so I don’t pay taxes to Dist. 150…but I care very much about Peoria issues)

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.