How the Big Red Machine became the big data machine: Delacourt

As someone who likes playing with and analyzing data, found Delacourt’s recounting of how the Liberals became the most data savvy political party interesting:

The Console, with its maps and myriad graphs and numbers, was the most vivid evidence of how far the Liberal party had come in its bid to play catch-up in the data war with its Conservative and NDP rivals. Call it Trudeau 2.0. Just as the old Rainmaker Keith Davey brought science to the party of Trudeau’s father in the 1960s and 1970s, the next generation of Trudeau Liberalism would get seized with data, science and evidence in a big way, too.

And in the grand tradition of Davey, Allan Gregg and all the other political pollsters and marketers who went before them, this new squad of strategists set about dividing Canada’s electoral map into target ridings, ranked according to their chances of winning in them. In a 21st-century-style campaign, though, the distinctions would be far more sophisticated than simply “winnable” and “unwinnable” ridings. Trudeau’s Liberals divided the nation’s 338 electoral districts into six types, named for metals and compounds: platinum, gold, silver, bronze, steel and wood.

Platinum ridings were sure bets: mostly the few dozen that the Liberals had managed to keep in the electoral catastrophe of 2011. Gold ridings were not quite that solid, but they were the ones in which the party strategists felt pretty certain about their prospects. Silver ridings were the ones the Liberals would need to gain to win the election, while bronze ridings, the longer shots, would push them into majority government territory. Steel ridings were ones they might win in a subsequent election, and wood ridings were the ones where the Liberals probably could never win a seat, in rural Alberta for instance.

The Console kept close track of voter outreach efforts on the ground, right down to the number of doorsteps visited by volunteers and what kind of information they had gathered from those visits — family size, composition, political interests, even the estimated age of the residents. By consulting the Console, campaigners could even figure out which time of day was best for canvassing in specific neighbourhoods or which voters required another visit to seal the deal.

When the Liberal team unveiled the Console to Trudeau, he was blown away. He told his team that it was his new favourite thing. He wanted regular briefings on the contents of the program: where it showed the Liberal party ahead, and where fortunes were flagging and volunteers needed to do more door-knocking. Actually, he wondered, why couldn’t he be given access to the Console himself, so that he could consult it on his home computer or on his phone while on the road?

And that, Trudeau would say later, was the last he ever saw of the Console. “My job was to bring it back, not on the analysis side, but on the connection side — on getting volunteers to go out, drawing people in, getting people to sign up,” Trudeau said. Clearly he was doing something right on that score — Liberal membership numbers had climbed from about 60,000 to 300,000 within Trudeau’s first 18 months as leader.

Volunteers for the party would learn — often to their peril — that the leader was fiercely serious about turning his crowd appeal into useful data. Trudeau wasn’t known for displays of temper, but the easiest way to provoke him was to fall down on the job of collecting data from the crowds at campaign stops. Few things made Trudeau angrier, for instance, than to see Liberal volunteers surrounding him at events instead of gathering up contact information. “That was what I demanded. If they wanted a visit from the leader they had to arrange that or else I’d be really upset,” Trudeau said.

Source: How the Big Red Machine became the big data machine | Toronto Star

Charts: No, the Y-Axis Doesn’t Always Need to Start at Zero | Re/code

Having spent more than a year on finding the right charts for my book, Multiculturalism in Canada: Evidence and Anecdote, I liked this little video on when to use the 0 and when not (also applies to the x-axis, where for median income data, starting at 0 made no sense):

If you write things on the Internet, angry email is inevitable. If you make charts on the Internet, angry email about those charts is inevitable. Especially if your charts sometimes use a y-axis that starts at a number other than zero. You see, an old book called “How to Lie With Statistics” has convinced people that truncated axes are a devilish tool of deception.

The truth is that you certainly can use truncated axes to deceive. But you can also use them to illuminate. In fact, you often have to mess with the y-axis in order to craft a useful image — especially because data sometimes reaches into negative territory and sometimes goes nowhere near zero. The right principle is that charts ought to show appropriate context. Sometimes that context includes zero, but sometimes it doesn’t. It’s long past time to say no to y-axis fundamentalism.

Source: Charts: No, the Y-Axis Doesn’t Always Need to Start at Zero | Re/code

Long-form census could be reinstated for 2016, experts say

An early test  of the incoming Liberal government, one that looks like it could be done:

The return of the long form, promised by Justin Trudeau during the election campaign, would yield vastly more reliable data and cost less than running another national household survey, the former heads of the agency say.

“It should be possible. I am certainly very hopeful. But [the decision] needs to be done very soon. It’s an enormous logistical operation,” said Ivan Fellegi, chief statistician from 1985 to 2008.

It’s “no problem” to reintroduce the long form in time for the 2016 census, said Munir Sheikh, head of the agency from 2008 to 2010. The questions needn’t change, he said – just the instructions at the top. “All they need to do is put on the front page that this is mandatory.”

The other step is for “cabinet to approve it as a census, which they can do at any time – it would take a matter of seconds.”

Researchers are already pressing for action. “Undoing these mistakes cannot wait; the time for action is now as Statistics Canada is on the cusp of launching the 2016 census,” says a letter signed this week by 61 academics and directors of research centres, including Statscan’s former assistant director Alain Bélanger.

Issuing an immediate order in council “is the only way to implement the long form in time for the census six months from now,” they said. “This must be one of the first moves made ​​by the Liberal government of Mr. Trudeau. It would mark a clear break with the previous government and ensure that future social policies can be made on scientific grounds rather than ideological dogmatism.”

….The Liberal platform pledges to “immediately” restore the mandatory long form – and make Statistics Canada “fully independent.”

Mr. Sheikh, who resigned over the controversy in 2010, said having the agency operate at arm’s length to the government is an even more crucial step. “I would say that is more important than restoring the long-form census, because that really was the cause of the problem, that the government can interfere with Statscan on issues like this.If you have an independent agency, the census in the future wouldn’t be the cabinet or minister’s problem, it would be the chief statistician’s problem.”

Mr. Sheikh said “anyone who uses data” will benefit from the return of the census. The biggest beneficiaries would be governments at all levels, “which have to base their policies on reliable data. And then of course researchers, who use this data to determine social outcomes, the condition of households in terms of income, poverty, unemployment, the state of housing, transportation needs, the needs of ethnic minorities, language, the employment equity act. Any kind of social and economic policy issues you can think of really are related to the census.”

As well, “the census provides an anchor to all other surveys, will have much more reliable data to check all other survey results against that.”

Both former chief statisticians said the switch could save money by reducing printing costs and expenditures associated with the labour required to administer and analyze the separate household survey. The NHS was sent to about 4.5 million Canadian households while the 2006 long-form census was sent to 2.5 million dwellings. Running any census is a massive undertaking that typically takes years to plan. The total projected budget for the 2016 census – which had been planned as a mandatory short form and voluntary NHS – is $701.8-million.

Statistics Canada wouldn’t comment on whether it’s possible to make the changes in time for the 2016 census. “It’s a policy matter, and we can’t comment,” said spokesman Peter Frayne.

Other experts say it can be done. “It is inherently easier to return to a well-tested methodology” such as the traditional census, said Ian McKinnon, chair of the National Statistics Council. “If any statistical agency in the world can do it, Statistics Canada can.”

Reinstating the census “soon, both sends a signal of change of policy, and interest in basing policy on evidence – evidence-based decision-making, which I think is very healthy,” said Charles Beach, professor emeritus at Queen’s University and head of the Canadian Economics Association. Moreover, “doing something that is both cost effective and more useful, it’s an economic no-brainer.”

Source: Long-form census could be reinstated for 2016, experts say – The Globe and Mail

The Data Behind Radicalization

Findings of a recent study of 1,500 individuals radicalized in the US since WW II:

Compared to violent domestic terrorists on the Far Left and Far Right, Islamists stand out. They’re more likely to be young (between 18 and 28 years old), unmarried and unassimilated into American society. They are also more likely to be actively recruited to an extremist group.

But in other important ways, Islamist extremists in the U.S. as a whole — violent and nonviolent — are not so different from other extremists. People in the three groups were equally likely to have become radicalized while serving time in prison — complicating the narrative that Muslim prisoners are unusually likely to commit to extremism from behind bars — and to be composed of individuals who have psychological issues, are loners, or have recently experienced “a loss of social standing.”

“Social networks are incredibly important to radicalization, but that’s not unique to Islamists at all,” [researcher Patrick] James said. “There’s almost always a facilitator — a personal relationship with a friend or family member who’s already made that leap.”

The Data Behind Radicalization « The Dish.