I sent this email to a group of my friends that live in NYC. If you live in the area and want to help organize, let me know at firstname.lastname@example.org
If you’re like me you’re shocked about what happened on election day. I can’t believe our country decided to put that orange-skinned, pussy-grabbing, bankrupt con artist that’s likely an agent of the Russian government into the Oval Office.
But here we are.
As bad as it is now, he’s not in office yet. And as unpredictable as he is, we have no idea what to expect he’ll do when he gets there (see these two back-to-back tweets as he does a real-time A/B test of governing styles), but it likely won’t be good. One of his top lieutenants already proposed bringing back the House Un-American Activities Committee (a black stain on the history of American Civil Liberties), and if he implements his campaign proposals to remove 11 million immigrants, ban muslims, punish women for having abortions, reinstate waterboarding, and change our libel and slander laws – he’ll be violating the first, fourth, fifth, eighth, and 14th amendments.
Not to mention he’s planning to rip up the watershed Paris Accords (makes sense as Climate Change is a Chinese hoax…) in a year that has seen every indicator of Global Warming reach dizzying new heights.
While we’re on the subject of existential threats, it’s becoming clear where the suspiciously pro-Russia policies of the Trump campaign came from, as Russian diplomats had been in contact with the Trump campaign throughout. This at a time that NATO has put three hundred thousand ground troops on high alert because of a feared confrontation with Russia.
I don’t know about you, but I’m probably going to be a wreck on inauguration day (January 20th). Instead of just watching, let’s do something. And that something we should do is party together, raising money for organizations that are going to fight these abhorrences tooth and nail.
Here’s what I’m thinking:
- We rent out a space
- We invite all our friends
- We have a great time
- Some great groups get some needed cash to keep the fight going
Those who can make you believe absurdities, can make you commit atrocities
I owe many people an apology today. I was extremely confident that HRC had this election in the bag and presumptuously advertised this confidence over the past weeks, dismissing any thought that she would lose. It wasn’t an act, and it has made it all the more devastating to me now that she has in fact lost.
Because of my work with Gradient, which does statistical modeling in a business setting, over this cycle a lot of people have asked me for my interpretation of the various forecasting models. When discussing it with them, I was bullish, overconfident, and as it turns out, terribly wrong. I feel terrible for giving people this false impression of security and making the result any more jarring and devastating than it already is.
What was I wrong about? Well, mostly everything – but two very large things stand out: polling bias and the correlation of polling errors. In general there are two types of statistical error: bias and variance. Variance is when you’re dancing around the right result – any one measurement is off but on average the errors cancel out; bias is when the errors don’t cancel. Polling bias (even state polls) in presidential elections has been estimated over many cycles, and has typically been small (about 1%). What polling bias means in concrete terms is that many more people voted for Trump than the polls captured; there was a social movement happening in front of our eyes but that did not show up in the data. I trusted the data and did not foresee the possibility that the polling bias would be so large across the board in swing states.
That leads to the next point. State results are obviously correlated – blue and red states tend to vote together. This means too that polls of states should be correlated. So outcomes and the measurements of those outcomes should be correlated – but should errors be correlated? I had no reason to think so. For example, polls had HRC ahead in Michigan and Wisconsin; I thought that all the correlation between the two would be captured by the correlated polling results across the two states. I did not think that a polling error in one state meant that a polling error in the same direction in the other state was more likely. It is obvious now that this was the case.
This election is going to prompt a rethink across the entire polling and data analysis industry – myself very much included, even though politics is not my professional remit. But that’s small potatoes compared to the vastly more consequential implications of this election: climate change; respect for women, immigrants, and muslims; the supreme court; our security and trade relationships around the world; the nuclear codes, and so on.
As for what happens next, I hope you agree with me that it’s critical that we stay engaged with our country’s politics as opposed to recoiling in horror. Quite literally, I think our country needs us and people like us to fight tooth and nail to preserve our vision of what America is and what makes it great.