Database Mining: The New Ward Heeler

The Republican Party has led in database development for the last 20 years, mostly with the work of former direct mailer Richard Viguerie, with his Moral Majority and Reagan contacts. I remember reading about it in industry journals at the time.

What Obama's campaign has done is made this kind of database scientific. There is no contact that is not followed up on through any of the following means: text message, email, phone, facebook, or twitter. This has been the Democrat's strategic advantage since he entered the race. The way his campaign has stayed on top of technology throughout has been impressive.

When everything is said and done after this campaign, everyone will point out the massive GOTV effort by the Democrats will have provided the edge. But this edge, of people walking their states, would not have been possible without the social networking and database contacts.

I probably received, in the last 2 months, 8 entreaties to phone bank or canvass in battleground states near me EVERY DAY. I had to look to do this in 2004.

FiveThirtyEight.com: Regressions for Politics

Number two on my list (previous post) of technological innovations to political discourse and campaigning this year is regression modeling of polls. The first one that I saw doing something like this, though far more simplistically is realclearpolitics.com (RCP). Basically what they did is took an average of all the polls, without assigning any kind of weighting. This was good to give us a nice and easy quick look at where the polls stood for the election, and washing out, for the most part, the effects of left- or right-lean of polls.

I would check RCP during the primary season occasionally, just to get the sense of where things stood, but they often didn't get the right trends. Around the middle of the primary season, I came across the website fivethirtyeight.com.  At first, I was very apprehensive about the model. My initial reaction was that there would be a propagation of errors that basically rendered the results useless. But the genius of the regression model, wasn't just the polling but the way these polls were weighted, both with lean and with recency.

If you'd like to check out the FiveThirtyEight FAQ, please do so; I will not repeat work that is already excellently explained even if you're not mathematically inclined. I think many of us who were watching this campaign intently, and liked the numbers aspect, really came on board around the time of the North Carolina and Indiana primaries. It was at that point that I put 538 on my bookmarks and checked it daily. You will also notice that I now use the 538 widget on my right rail. 

A note about FiveThirtyEight.com is that the statistician in question is Nate Silver, of the baseball stats site, BaseballProspectus.com. Most of you know that I also have a baseball-related blog, Sabermetrati.blogspot.com, and am a big fan of Nate Silver's work on BP, which I reference regularly. I did not realize that it was the same Nate Silver until around early June, and it definitely lended more credence to his fine work on FiveThirtyEight.

My favorite part of 538 is the win percentage. I have been following that number since Obama officially won the nomination. It now stands at 94% chance of Obama winning the election, with a peak about a week ago of 98%.

Tuesday will prove the accuracy of Nate Silver's model; it should be interesting.

Brave New World on November 4th?

The time is finally upon us. After nearly two years of campaigning we are about to elect a new president. This election has kept me so wrapped up in all the technology that I have not even had a chance to add my voice to it. Here are some of the amazing technologies that will forever be useful in future  campaigns:

• Social Media Networking
• Regression modeling of Polls
• Get Out The Vote (GOTV) database mining
• Voting Machine Fraud Blogging
• Trash Emailing
• YouTube Moments
• Mobile Contact

While some of these items are completely non-partisan in nature and merely helped to inform us of campaign status (Poll regression modeling, Voting Machine Fraud blogging), the others were utilized to better advantage in getting out the message for the candidates. Who won this battle? Let's take a closer look.

Social Media Networking

The Obama campaign was on FaceBook, MySpace, Twitter, and LinkedIn before any of the other candidates during the long primary. I was not on the Obama bandwagon early, but I was impressed that I was being contacted in these areas long before anyone else. Any of us on FaceBook saw how many people were joining the Obama groups steadily over the course of the last two years. How many Obama buttons, Obama Lightsabers, etc. have we received during this time--too many to count?

On LinkedIn, Senator Obama asked my advice on topics facing his campaign and topics facing the country. I didn't fall for it: I knew he didn't send this personally nor do I think he read all of the comments. But I did send in my response when I thought I had something to say about a topic, and I received an automated response--that's better than when I was looking for a job and I would almost never get even the most cursory of automated responses ("Thank you for your interest, we will be contacting you if your resume meets our requirements.").

Between all of these social media items, this might constitute, as Mary Butler Twittered in my feed, his new communications channel after he's elected (IF he's elected). An unfiltered feed to the huge network he's built up and one that can get his message about his agenda out before the Limbaughs and Hannities of the world can lie about.

Are we witnessing the beginning of a whole new way of communicating in the Internet age between our government and the electorate?

It Happens Every Fall...

It is that time of the year where baseball is foremost in this blogger's mind. Yes, I am following the election, to the point of "election fatigue" and I have many things to say about technology and politics. In fact, I will be covering the action over at my favorite site since the primaries, fivethirtyeight.com. But that will come a little slower in this coming month, particularly with the Cubs in the playoffs...

In any case, I hope you hop over to Sabermetrati to keep up with all of the sabermetrically-inclined baseball news. A sneek peak: it could be a Red Sox vs. Cubs All Time All Futility World Series!

Question: Why Are Republicans Graded on a Curve?

Why are Republicans graded on a curve? Everyone in the Mainstream Media has said, "Oh, well McCain's not a good public speaker" and then said the same about Sarah Palin, basically the idea that she is inexperienced and will not do well.

Yet, when these tepid speeches are completed, why do the Media go into paroxysms about how much better they did than anyone thought? Particularly if you're a Republican, and you don't believe in quotas, or "grading on a curve", than why are McCain and Palin accorded such kudos for speeches that pale in comparison to even the worst Democratic speaker last week?

Just a question...

Standing in the Shadow of the Birthplace of Democracy

BOSTON - To take this picture, I stood at the spot where the Boston Massacre sparked a nascent movement for liberty, sovereignty, and freedom from colonial rule.

As I stood there, I imagined what it must have been like to be standing the exact same spot in 1776 with the rest of the assembled masses as the first reading of the Declaration of Independence in public. That was the technology of the day: public oratory and pamphleteering, the olden day version of YouTube and Blogging (sans the instantaneous global reach).

After Senator Obama's speach last Thursday night, I'd say oratory is still big in the ever-more United States of America. After walking the Freedom Trail, I felt a part of our revolutionary history.

To see more pictures from the Freedom Trail taken by The Wife and I, follow this thread to Flickr. My particular favorite is the Boston Massacre Monument, which is in the Boston Commons, the oldest Public Park in the USA.

For a Fenway Park story, go to http://sabermetrati.blogspot.com.

Trash Emailing = eTrashMail

I'm sure many of you have come across one of these "trash emails" trashing Barack Obama:

• Obama's Proposed Tax Plan
• Wake Up, America!
• Equitable Distribution

I recently received the first one about how Obama's tax plan is supposed to work. It was sent to me and my friends by a friend making fun of it. He in turn received it from what appears to be a very long thread. This thread is started by a VP at Bear Sterns.

His name was clear, his office number was there, and his title was clear. I will not reprint any of it, though, because I called him and asked him about it. Whether he sent it willfully as a show of support for John McCain, or as he told me, as an "I can't believe what people are saying about Barack Obama, look at this..." I don't think it appropriate to punish him further. He told me how many people have called or emailed him. His supervisor isn't happy with the notoriety, either.

This just goes to show the new playing field unfolding in the campaign arena: no longer does the negative campaigning come in the form of a negative ad, but it is a full-court press of emails (spam, actually!), YouTube videos, and blog posts. But the method in question today is that of the trash-talking email, or eTrashMail.

The eTrashMail format is one where blatant lies seem to be used but with the appearance that they are coming from an unquestionable source. For instance, in the one above, the source about taxes was coming from a VP at Bear-Stearns (yes, I know they are not exactly sporting a spotless reputation these days...).

eTrashMail can only mean that there will be only one winner this election season: the advertisers on Snopes.com! If you want to see who is the clear eTrashMail winner (meaning who's attacking the most), see the truth about Barack Obama and the same for John McCain. Obviously, the right wing smear machine is working overtime...