Blame the Pollsters too!

The right envisions the election playing out very differently.

If you’ve been reading my “2012 Polls” page, linked above and on the left side of the menu, you know that I constantly up date and report new Presidential and Senate polls as they are released.     So I’ve been swimming in polls, and will keep this up until election day.

Lately the polls are showing a rather pronounced trend towards Obama.    In the swing states that were either tied or leaning slightly, Obama has built sometimes large leads.   Taking the average of recent polls, Obama leads in all the swing states:

Ohio:   Obama + 7
Pennsylvania:  Obama + 9
Florida: Obama + 4
Iowa:  Obama + 4
Colorado:  Obama + 5
Nevada:  Obama + 5
Virginia:   Obama + 4
North Carolina:  Obama + 3

In the national polls it’s the same story:

Pew:  Obama + 8
Gallup Tracking:  Obama + 6
Bloomberg:  Obama + 6
National Journal:  Obama + 7
GWU/Battleground:  Obama + 3
Rasmussen tracking:  tie

The polls have turned dramatically towards Obama in the week since the Romney fundraiser video came out.   Whether its a short term bump or a shifting of the race to one in which Romney emerges as noncompetitive is unclear.   If I were a national pundit worried about my reputation I’d put in all sorts of caveats about how the race is not over.  My gut tells me that absent some kind of major external shock, Obama’s got this thing in the bag.

However, people on the right would argue that I’m living in a fool’s paradise, feeling secure about an election in which Obama is trailing his challenger.   Just as the media got blamed for Romney’s campaign foibles, many now blame the pollsters for creating an illusion that Obama is ahead when he’s not.    One commentator at a different blog thought this was part of an insidious campaign to demoralize Republicans.   Rush Limbaugh claims that the pollsters are in cahoots with Obama’s campaign to try to end the election early because they fear the debates.

A website called, which associates itself with Rush Limbaugh, Laura Ingraham, Thomas Sowell and Dick Morris, says the polls have it all wrong.    In fact, Romney is actually winning this election handily.   Their average has Romney up by 7.8% as of September 20th, the date of their last update  (the chart at the top of this post).

Their argument is simple, and on its face plausible.  Pollsters should weigh party ID just as they weigh other demographic factors in calculating their results.   I admit, I thought they did that.   But I’ve learned that pollsters believe that it would warp the data tremendously and we couldn’t trust the results if party identification was treated like race or ethnicity.

One reason for that is given by Amy Fried in her blog Pollways:

Voter ID trends are fluid, often reflecting the person’s preferences at the moment for one candidate or the other.

In other words, if people are trending towards Obama, it’s likely more people will identify themselves as Democrats.  If Mitt Romney is unpopular, it hurts the Republican brand.

Yet what about Rasmussen?

Rasmussen is a solid pollster.   Yet in this and past election cycles, he’s often shown a clear partisan lean to the Republicans.   This is especially true during the campaign cycle.   Rasmussen does weigh for party identification, and if he’s using his recent August poll numbers as a guide, he has the population as being more Republican than Democratic.  That is in opposition to the trends noted above.

I don’t know how he weighs it – his methodology page simply says:   “After the surveys are completed, the raw data is processed through a weighting program to insure that the sample reflects the overall population in terms of age, race, gender, political party, and other factors.”

There are two problems with that.   First, his methodology is automated, meaning he is focused on landlines which tends to be a more Republican population anyway.   So his survey on voter ID may be skewed.   Second, his data showing more Republicans than Democrats is contrary to most other indicators out there.

But the argument people make for considering party identification isn’t without any merit.   While party identification may fluctuate, most people do not change parties.   How many Republicans or Democrats do you know that veer back and forth?   Yet that makes it even more problematic to think there are more Republicans than Democrats out there.  From exit polls, we can get a fair sense of what party identification in the US is like.

Trends from 1939 to 2009 show both stability and flux, it’s hard to imagine there are really more Republicans now given past trends

The argument by supporters of Rasmussen (and critics of most pollsters) is that 2008 was an anomaly, voters shifted to the Democrats in response to the mideast wars and the popularity of Barack Obama’s campaign.   Now Obama’s shine has faded and the 2010 off year elections make it wrong to use 2008 data to predict turn out – whether by voter identification or even demographics.

Pollsters seem to understand that, and from what I can gather most use a number of ways to get their likely voter sample.  They screen respondents and look at demographic factors from the last two Presidential elections.   It may be that the youth and minorities will be more likely to stay home in 2012, but how much?   The conventional wisdom in the GOP has been that they have an enthusiasm edge, and if Rasmussen is using that to weigh his data (having fewer blacks, youth, Hispanics, etc.) then that could explain his results.

Voter enthusiasm has been rising, especially among Democrats. The idea Obama supporters will sit this one out is unlikely.

Yet all indications are that the enthusiasm gap is shrinking, and at this time Obama is generating enthusiasm while Romney is floundering.    Quinnipiac released polls on Wednesday showing Obama up 12 in Pennsylvania, 9 in Florida and 10 in Ohio.    Politico called these numbers jaw dropping.  Public Policy Polling also showed Obama up 7 in Iowa.  It appears like there has been a real shift towards Obama.

Therein lies the real reason not to trust Rasmussen’s numbers:  Almost every pollster is showing a shift to Obama at the state and national level.     Rasmussen has stayed flat.   To me this suggests that if he is weighing for party identification and makes demographic assumptions that understate Democratic enthusiasm his methodology is getting in the way of recognizing the trend.

These are all pollsters who have been around for quite awhile and have a good track record, including Rasmussen.   Their reputation is on the line.   They’ve been doing this and refining their methodology for years.   Is it really plausible that they all are making the same systemic error, either by conspiracy or chance?   Moreover, why would that “error” suddenly appear in mid-September, after all the polls had shown a close race before hand?  The evidence suggests Rasmussen’s method is flawed – though he could change how he weighs data as the race continues if he concludes that party ID is not favoring the Republicans and that the enthusiasm gap is disappearing.

Blaming the media and trying to find ways to disregard the preponderance of polls are both symptoms of the same disease: a campaign in distress.

UPDATE:   One other point – the same trend is being seen in Senate races around the country.   Democrats have built leads in seats that looked vulnerable, and candidates like Elizabeth Warren and Tammy Baldwin (MA and WI) have gone from being underdogs to favorites.   This reinforces the idea that the election is trending Democratic.

UPDATE 2:  Nate Silver did a thorough analysis of Rasmussen after the 2010 election cycle and found empirical evidence that Rasmussen is biased towards Republicans, and did very poorly.

  1. #1 by jesus criss on September 27, 2012 - 15:26

    Well thought-out and intelligent analysis.

  2. #2 by uncleFred on September 27, 2012 - 15:34

    Rasmussen use a three week moving average of party identification to weight his samples, not his monthly numbers. His polls reflected a “convention bounce” toward the Democrats which accounts for the Obamaward shift in his recent results. According to some pollsters that bounce is fading, if true it will start to show in Rasmussen’s results in the next few days and will be completely flushed out in about 10 more days.

    Rasmussen has published his political trends poll data stretching back to its initiation. If you examine this data you can see that in the aggregate political identification changes SLOWLY. The shift to the enormous advantage for the Democrats in 2008 took time as has the shift toward the current more modest Republican edge this year.

    The notion that this will turn to an 8 or more point Democrat advantage in two months is not supported by the movement of this poll at any time in its history.

    About the most the Democrats can hope for is parity in November, which was where things were in 2010.

    • #3 by Scott Erb on September 27, 2012 - 16:01

      I think you’re denying reality there Fred. Read Nate Silver’s take:

      I think Romney could still turn it around, but the odds are against him.

      • #4 by Norbrook on September 28, 2012 - 16:32

        Exactly. One of the things that made Nate Silver one of the “must read” people when it comes to looking at political polls was that he cut through a lot of the fog – and made accurate predictions of outcomes – during the 2008 primary and general election season. Which isn’t terribly surprising, considering that he was also the best baseball statistics analyst around. 😉

  3. #5 by dirtnrocksnomo on September 27, 2012 - 17:14

    The fact that Rasmussen has shown a clear partisan lean to the republicans tells me that it is not a reliable poll. 538 has been the mosts accurate information out there for the last 2 election cycles (2008-10) and is showing Obama expanding his lead. I think it is already too late for Romney and his robotic performance at the upcoming debate will be the death blow to his candidacy.

    I think this election is serving a dual purpose for the republican party. If Romney somehow pulls this off they will quickly get over their shock and move towards total destruction of the social contract that has made this country thrive for the last 70+ years. If they lose, which I suspect the will, it will allow them to purge the wing nutz from the party and return to a more traditional conservative ideology. I hope this is the case because many people, myself included, could get behind a rational conservative message. One that is not focused on the private lives of their fellow citizens and believes in scientific method. One can hope.

    • #6 by Scott Erb on September 27, 2012 - 17:38

      I think you’re right – a kind of creative destruction. I even wrote awhile back on what I think a successful Republican party might be like: (I wrote this last March)

      In any event, we need two competitive parties with different ideas. But they need to be able to compromise and be pragmatic, ideological jihad dooms democracy.

  4. #7 by thenewamericanlondoner on September 27, 2012 - 21:45

    “It’s fuzzy math, folks.” There’s a bittersweet political memory. Can’t Romney still take PA through that shameful effort at disenfranchisement?

    • #8 by classicliberal2 on September 27, 2012 - 21:54

      Not just PA. Repubs have been working overtime on their voter suppression efforts for a few years now. That’s the part that doesn’t show in the polls.

  5. #9 by Scott Erb on September 28, 2012 - 17:18

    The polls the last two days are still favorable to Obama, but the polling on Wednesday seems now to look like an outlier – or perhaps a peak of the post-video anti-Romney fallout. There is a chance Obama is peaking too soon.

    • #10 by nickgb on September 29, 2012 - 05:41

      Peaking too early is a problem that you face if you are a fundamentally flawed candidate who hits a popular chord, which doesn’t describe Obama. The GOP field, meanwhile, was a chorus of bad candidates who kept rising and swelling and then crashing as soon as any attention was paid to them. Obama, on the contrary, is a very good campaigner with a very professional staff. 2008 was an advanced course in how to run a campaign, and 2012 is just as good.

      There’s still lots of ways for this to go south, especially if economic conditions take a serious turn south and bring back the “things are always getting worse” tone. As long as we keep treading water economically (god, I hope it gets better), the focus is going to be on Mitt as a horrible candidate.

      TL;DR version: Obama won’t fuck up, so the focus stays on Mitt, who continues to fuck up. The only way out of that is if something external cripples Obama and makes people vote for “the other guy”, cuz god knows they won’t vote for Mitt.

    • #11 by Norbrook on September 29, 2012 - 22:54

      I expect that there will be variances in polling and any daily poll may show ups or downs. In terms of “peaking too soon,” one of the things I saw in the 2008 campaign was that the President was a master of timing. This campaign is a version 2 of his “no drama” campaign. We’re not seeing the intramural finger pointing or hints of panic that seem to be rampant on the Republican side.

  6. #12 by Scott Erb on September 28, 2012 - 20:27

    I did an update above with this link, but Nate Silver did an analysis of Rasmussen after the 2010 elections and found they did horribly. Claims Rasmussen is more accurate than others don’t withstand scrutiny. Link:

  7. #13 by Norbrook on September 28, 2012 - 21:57

    Deaniac83 over at The People’s View has a rather scathing look at Unskewed Polls methodology. They say they use “weighting” of polls, but then describe two entirely different methods of weighting, with the only common factor that they weight heavily towards “conservative.” The way they come up with that weight seems to be the tried-and-true Republican method of “making it up.” 🙄

    What I’m getting out of this is a sense of panic setting in on the Republican side. Romney was expecting a “bounce” out of the convention, which wasn’t an unreasonable expectation. However, not only did he not get a bounce, the “memorable moment” of the convention was Eastwood talking to an empty chair, not “Romney’s triumphant acceptance speech.” The gaffes afterwards, along with Obama’s convention bounce, didn’t do Romney much good, but even worse from their standpoint, the increase in Obama’s polls might mean the loss of the House and failing to gain the Senate.

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

%d bloggers like this: