When Algorithms Discriminate – The New York Times

Given that people have biases, not surprising that the algorithms created reflect some of these biases:

Algorithms, which are a series of instructions written by programmers, are often described as a black box; it is hard to know why websites produce certain results. Often, algorithms and online results simply reflect people’s attitudes and behavior. Machine learning algorithms learn and evolve based on what people do online. The autocomplete feature on Google and Bing is an example. A recent Google search for “Are transgender,” for instance, suggested, “Are transgenders going to hell.”

“Even if they are not designed with the intent of discriminating against those groups, if they reproduce social preferences even in a completely rational way, they also reproduce those forms of discrimination,” said David Oppenheimer, who teaches discrimination law at the University of California, Berkeley.

But there are laws that prohibit discrimination against certain groups, despite any biases people might have. Take the example of Google ads for high-paying jobs showing up for men and not women. Targeting ads is legal. Discriminating on the basis of gender is not.

The Carnegie Mellon researchers who did that study built a tool to simulate Google users that started with no search history and then visited employment websites. Later, on a third-party news site, Google showed an ad for a career coaching service advertising “$200k+” executive positions 1,852 times to men and 318 times to women.

The reason for the difference is unclear. It could have been that the advertiser requested that the ads be targeted toward men, or that the algorithm determined that men were more likely to click on the ads.

Google declined to say how the ad showed up, but said in a statement, “Advertisers can choose to target the audience they want to reach, and we have policies that guide the type of interest-based ads that are allowed.”

Anupam Datta, one of the researchers, said, “Given the big gender pay gap we’ve had between males and females, this type of targeting helps to perpetuate it.”

It would be impossible for humans to oversee every decision an algorithm makes. But companies can regularly run simulations to test the results of their algorithms. Mr. Datta suggested that algorithms “be designed from scratch to be aware of values and not discriminate.”

“The question of determining which kinds of biases we don’t want to tolerate is a policy one,” said Deirdre Mulligan, who studies these issues at the University of California, Berkeley School of Information. “It requires a lot of care and thinking about the ways we compose these technical systems.”

Silicon Valley, however, is known for pushing out new products without necessarily considering the societal or ethical implications. “There’s a huge rush to innovate,” Ms. Mulligan said, “a desire to release early and often — and then do cleanup.”

When Algorithms Discriminate – The New York Times.

Register your imam, senators say – Globe Editorial

Globe has it right:

Now that the federal gun registry is no more, Canada is suffering from a large, gaping registry deficit. But be of good cheer, because salvation is at hand! The Senate committee on national security and defence, deftly leaping into the vacuum, has a plan to make Canada a safer place. It is calling for the creation of a Muslim imam registry.

The committee’s majority, all of them Conservatives, think it’s time to get the state in the business of deciding who is allowed to preach and teach which religion, and implicitly what they get to say while preaching and teaching. But just for Muslims.

In true Canadian fashion, the senators want The Department of Imam Approval and Oversight, or whatever a future body doing this important work might be called, to be a joint federal-provincial partnership. The idea is to “investigate the options that are available for the training and certification of imams in Canada.” The timing of the senators’ report, during the holy month of Ramadan, is particularly ideal.

More sweepingly, the committee recommends a protocol with CSIS “to require mandatory screening of citizens involved in public outreach.” On the other hand, Canadians “who are participating in the public discourse” should be “protected from vexatious litigation” – presumably, libel and slander actions by Muslims.

The certification of acceptable, or at least tolerable, Muslim religious teachers would presumably be accompanied by permits. Would clerics have to wear a cresent symbol on their lapel? Would police be empowered to demand a permit from anyone who appeared to be wearing certain types of headgear – defined of course by regulation?

Earlier this year, in Shawinigan, Que., in the same patriotic spirit as the Senate committee’s report, local authorities denied a minor zoning variance, to prevent Muslims from building a mosque in an industrial park. François Legault, Leader of the opposition Coalition Avenir Québec, called for the regulation of mosques in the province, with municipalities empowered to deny operating permits to mosques whose imams have engaged in “consistent denigration of Quebec values,” whatever that means. And now a group of federal Senators in Ottawa are picking up on the idea. Shame.

Register your imam, senators say – The Globe and Mail.

Canada’s public service and the new global normal of change: Lynch

Former Clerk of the Privy Council Kevin Lynch on the role and challenges for the public service:

The public service plays a core role in our Westminster system of government. It is nonpartisan, it is permanent, serving governments past, present and future, of any political party, with equal loyalty and effectiveness, and its appointments are merit-based. It offers evidence-based policy advice to the government of the day, it administers the policies, programs and regulations approved by Parliament on a nonpartisan basis, and it provides the essential services of government. Given its roles, responsibilities, and accountabilities, a Westminster public service should not be mistaken for an administrative service, nor should it be confused with an American civil service, which is institutionally designed to be partisan and non-permanent at all senior levels.

These same global trends are impacting Canadian public services, both federally and provincially. Demographics—our public services are aging, and recruiting, training and retaining the next generation of public servants, and developing its leaders are a key challenge. The competition for exceptional talent is intensifying, and the public service will be able to attract such talent only if the work environment within government offers the ability to make a difference, help shape policy options and choices, be innovative in service delivery, and do great science. Globalization—a public servant today needs a worldview not a parochial one, an understanding that something happening anywhere in the world can have impacts here in Canada. And technology—innovations in ICT, social media, cloud computing, data analytics and adaptive learning have enormous potential to reshape both the “back office” of government operations and the “citizen-facing” service delivery and interaction functions.

The public service is under stress, both responding to these demographic, globalization and technology pressures and dealing with a challenging governance environment. At a time when Canada faces many longer-term policy issues, there seems to be little demand for public service policy advice. At a time when the private sector is shifting to distributed leadership and entrepreneurship models and risk management, the governance model of the federal government is moving towards ever greater centralization and risk aversion. At a time when attracting and retaining superb talent to the federal public service is facing stiff competition from the private sector here and abroad, there is ambiguity from the government itself about the importance of government and governance to the economy and society in these transforming global times—hardly motivating to prospective public servants. As leading experts on the public service such as Donald Savoie have stressed, the apparent antipathy of the government today toward the public service may have deleterious long term impacts on the public service as an institution.

http://ipolitics.ca/2015/07/09/canadas-public-service-and-the-new-global-normal-of-change/ (paywall)

Catching up: Stories that caught my interest

While I have not been blogging over the past month, I have been following events and these stories and reports caught my eye.

From a general perspective, the Environics Institute latest Focus Canada annual survey showed continued strong support for immigration and multiculturalism, including some notable increases in support (e.g., general support for multiculturalism, reduced fear immigrants not adapting to Canadian values, that immigrants can be as good citizens as Canadian-born) along with increased recognition of discrimination and the need for policies and programs to address it.

Jeffrey Simpson in the Globe reminded us of just how successful the Canadian model of citizenship, immigration and multiculturalism has been.

Citizenship

The Canadian government launched its first revocation proceeding, selecting Hiva Alizadeh as the test case given that he is a dual national of Canada and Iran, was tried and convicted in a Canadian court where he pleaded guilty (avoiding many of the issues raised during C-24 hearings regarding due process in foreign courts).

The remaining provisions of the changes to the Canadian Citizenship Act came into force on June 11, provoking the usual stories about how some were affected by the date chosen (no matter which date was picked, there would always be some affected by the transition. The release of ATIP documents on the Citizenship Act consultations revealed that ethnic groups were particularly concerned about longer residency requirements and increased fees, with some concerned about revocation, and many questioned why advertising was focussed on revocation provisions rather than the changes they were concerned about.

Minister Alexander’s Canada Day message repeated the historic naturalization rate of over 85 percent, despite his department knowing that the recent rate is lower. His conflating of niqab-wearing women with terrorists and his highly selective citing of Liberal government restrictions on immigration and related discriminatory practices were savaged by some commentators.

CIC has yet to provide an explanation for the significant drop (over 30 percent) in the number of citizenship applications in 2013 and 2014 (Full 2014 Citizenship Statistics: Declining Applications).

The Australian government, despite a vigorous internal debate on citizenship revocation, appears committed to a fairly draconian approach, applying to both single and dual nationals and the children of those convicted.

Multiculturalism

The usual Multiculturalism Day messages by political parties, with the Government (Ministers Kenney and Uppal) emphasizing “peaceful pluralism and ordered liberty,” sport and “the values of freedom, democracy and the rule of law” (no mention of human rights), the NDP Multiculturalism Critic emphasizing “tolerance, understanding and equality” and the Liberal Party leader emphasizing “acceptance, fundamental freedoms, and mutual respect.”

The Government reversed a new policy requiring “pat-downs” of turbans, following protests by Canadian Sikhs (likely reflecting their political importance), leaving Minister for State for Multiculturalism Uppal to explain why an exemption for one form of religious headgear (the turban) and not another (the niqab). While there is a difference between covering one’s hair and covering one’s face, ironic that this decision took place in the same month as families of the Air India bombing commemorated the 30th anniversary, the largest terrorist attack in Canadian history with some families noting that some temples have pictures of the Sikh mastermind behind the bombing.

A thoughtful discussion of the challenges health care professionals face in dealing with accommodation requests for different groups, and the processes used to decide what can be accommodated and what not.

Declining support for immigration and multiculturalism post 9/11 and 7/7 in Britain was significant (56 percent in 2015 believe multiculturalism makes Britain worse compared to 32 percent in 2001).

Meanwhile, French Prime Minister Walls notes that Islam is “here to stay in France” while highlighting unacceptable behaviour (antisemitism and hate speech). In addition, despite the formal separation of church and state in France, some have initiated programs to have a more open approach to discussing religion in schools.

In a significant discrimination case, the US Supreme Court ruled that the actual results of policies and programs trumped the intent of these policies, providing a basis for challenging systemic racism and discrimination in future cases.

Canadian antisemitic incidents are reported as rising given B’nai Brith reports (which contrast with Statistics Canada police-reported hate crimes report which show a decline).

An interesting opinion piece that tries to assess the boundary between criticism of Israeli policies and antisemitism provided some nuance to debate on either side of the issue. As Israeli governments provide more support to the Israeli Rabinate, a divide may be emerging between American Jews and Israel.

A good discussion on some of the issues around providing Holocaust education to German Muslims, how it gets tied to the general Israel-Palestine issue, and the efforts by the German government to develop programs to reduce radical Islam by establishing centres for the study of Islam. Meanwhile, the Netherlands postpones the release of a report showing antisemitism among Dutch Muslim youth.

An account of how “trying white food” is part of the experience of children of immigrants, which complements the increased interest by “white people” in ethnic food, highlights one aspect of integration.

Google quickly learns the limits of its image recognition software when its software labels Blacks as gorillas, but quickly deletes the gorilla label as an interim step to ensuring better image recognition. Appears that software too can be subject to implicit bias and should be made to take the Implicit Association Test (IAT).

New Canadian Media held its first workshop for integration and settlement agencies on how to engage the mainstream media in ethnic community issues.

An amusing yet relevant discussion on when multiculturalism advertising can become offensive, using examples from the 1970s (particularly McDonalds and advertising targeted to Black Americans) and some tips to avoid crossing the line.

Following months of wedge and identity politics around Canadian Muslims (the most recent being the Bill tabled just before the House rose banning the niqab at citizenship ceremonies) and the threat of Islamic-inspired extremism, the PM makes a more positive gesture in hosting an Iftar dinner at 24 Sussex.

President Obama delivers one of his best, and arguably one of the best ever, speeches on racism in America and the need for action in his eulogy at the Charleston funeral for those gunned down by a white extremist. Worth taking the time to view in its entirety:

https://www.youtube.com/watch?v=RK7tYOVd0Hs

Nell Painter, recapping some of her insights of her book The History of White People, notes that “whiteness” is often defined by what it is not (“blackness”) and that we need to move beyond such binary expressions of identity.

Extremism

A reminder that right wing extremism has been a greater threat in North America than Islamic-inspired extremism provides again a note of nuance to current security and related debates.

A Canadian government-funded study demonstrated that there are various paths to radicalization, showing that despite rhetoric, the Government is sponsoring sociological research.

An interesting counterpoint to ISIS/ISIL’s destruction of non-Islamic (and non-Sunni) monuments can be seen in Israel considering restoring the historic Islamic site of Khirbat al-Minya, the ruins of an Umayyad palace complex on the northern shore of the Sea of Galilee.

Immigration

As been mentioned before, and as apparent in the analysis I did for my forthcoming book (Multiculturalism in Canada: Evidence and Anecdote), immigration is becoming increasingly dispersed beyond the larger urban centres, given housing costs and economic opportunities.

An ATIP request indicates profiling and bias in CIC’s review of potential marriage fraud, although the guide has subsequently been revised, with examples highlighting the extensive documentation required.

Following the Toronto police carding debate, and likely other but less high-profile debates elsewhere in Ontario, the Ontario government decides to develop and implement a province-wide policy.

The Quebec government provided fewer resources to organizations delivering integration courses as part of overall austerity measures.

Other immigration stories of interest included accusations of racial profiling of Roma travellers and the effective ending of the live-in-caregiver program and the impact on childcare needs,

Other

Rick Salutin wrote a good piece looking at the history and definitions of “barbaric cultural practices” providing perspective on the current government fetish to use the term for political marketing purposes.

Daniel Savoie had his usual biting commentary of some of the weaknesses of current governments and their apparent inability to deliver programs and policies effectively.

The issue of Saudi financing of Islamic religious schools in Canada was reported on, with little indication that this funding was influencing the curriculum and approach (largely appeared to be for buildings and other infrastructure).

As part of Canada Day reporting, CBC interviewed foreign academics on their views on how Canada was perceived abroad, highlighting their assessment that it had worsened, not surprising given their more centrist and left-wing perspective. The cut to the Canadian Studies Abroad program in 2012 was again lamented.

Sadly, but not surprisingly, the Government does not make any changes to the mandatory Census questions that would improve the quality of the data, and continues with the voluntary NHS approach.

Will be back to my regular posting schedule on Monday.