Back to news

September 26, 2018 | Local, Security

Artificial intelligence at border could infringe on human rights: report

By

Using artificial intelligence at Canada's official points of entry can lead to serious human rights violations, according to a new report.

Released Wednesday by the University of Toronto's International Human Rights Program (IHRP) and the Citizen Lab at the Munk School of Global Affairs and Public Policy, the report says the use of artificial intelligence (AI) at regular points of entry is “quite risky” without appropriate government oversight.

“We know that, in other contexts, AI is not neutral,” report author Petra Molnar told iPolitics. “It's basically like a recipe. If your recipe is biased, then the result that is going to come out of the algorithm is also going to be biased.”

What these technologies could do, according to the report, is decide whether a marriage is genuine, an application is complete, or whether someone entering the country is deemed “a risk” to public safety. If the government doesn't provide more oversight, such decisions could rely on appearance, religion, or travel patterns as “proxies” for more relevant data normally gathered by immigration officials.

This could compromise some quintessential human rights for immigrants and refugees at the border, including the right to equality and to be protected from discrimination under the law.

The report says AI machines could be taught algorithms for how to assess “red flags,” “risks,” and “frauds” based on pre-existing biases in some of the immigration and refugee system's current regulations. For example, the report said the Designated Country of Origin list, which classifies which countries are “safe” for refugee claimants, uses an “incomplete” definition of safety that does not take into account specific risks for minority groups, such as women or members of the LGBTQ community.

The use of AI technologies could mean cases are likely to be determined only based on these types of guidelines and might not include the discretion and empathy employed by immigration officials when reviewing the details of a refugee claim.

“Depending on how an algorithm is designed, it may result in indirect discrimination,” the report found. “The complexity of human migration is not easily reducible to an algorithm.”

If someone is triaged or flagged for early deportation, it could also affect their ability to apply for a visa, appeal a negative immigration ruling, or continue to move between borders.

AI technologies also bring up procedural-rights issues, such as how a potential immigrant or refugee claimant would challenge the outcome of his case at the border.

“When you introduce AI, if you don't agree with the decision, where do you appeal? And what kind of appeal are you crafting?” Molnar said. “These are all new questions we have to ask ourselves.”

The report found that the government has been experimenting with artificial intelligence since 2014. Immigration, Refugees and Citizenship Canada confirmed to the report's authors in June it was already using an automated response to “triage,” or separate, simple claims from complicated ones that need further review.

This summer, the government sent out an RFI (a preliminary procurement document) seeking an “Artificial Intelligence Solution” to provide legal support for migrants entering at formal points of entry.

These investments fit into the federal government's $125-million Pan-Canadian Artificial Intelligence Strategy to “develop global thought leadership on the economic, ethical, policy and legal implications” of AI research throughout the country.

Molnar said she heard from government officials that their use of AI is “preliminary” at best. What the government is considering, she continued, is using AI technologies only for preliminary screening.

After AI technologies have reviewed a case, Molnar said immigration officers should still be asked to review the decision and make any appropriate changes.

Molnar said it's still too soon to tell what AI could look like at the borders, but noted the technological changes could be vast.

“It can be as simple as an Excel sheet, all the way to totally autonomous robots in other sectors,” she continued. “In immigration, how this could manifest ... could include a triage system where a traveller might be designated a high risk or low risk, or streamed for high risk and low risk.”

To solve these possible human-rights infringements, the report suggests installing an independent, arms-length government-oversight body to “engage in all aspects of oversight,” before the government continues to develop these technologies.

This recommendation, Molnar said, is in line with the Treasury Board of Canada Secretariat's review into responsible use of AI throughout government offices. Among other recommendations, the board suggests more transparency from government offices about when AI technologies will be used during a discretionary decision-making process. The report notes this suggestion “is promising, from a human-rights perspective,” but the document is non-binding and is still subject to change.

Until the review body is created, the report suggests government freeze “all efforts to procure, develop or adopt” any new automated-decision-system technology before a government oversight process is in place.

https://ipolitics.ca/2018/09/26/artificial-intelligence-at-border-could-infringe-on-human-rights-report/

On the same subject

  • A year-end Q&A with Defence Minister Harjit Sajjan

    December 31, 2018 | Local, Aerospace, Naval, Land, C4ISR, Security

    A year-end Q&A with Defence Minister Harjit Sajjan

    By Charlie Pinkerton Federal Defence Minister Harjit Sajjan spoke with iPolitics for a year-end interview. Here's what he had to say. Q: During your time as Canada's defence minister, what are you most proud of? A: The thing I'm most proud of is that our defence policy is focused on looking after our people. I've always said our Number 1 asset is our people; if we look after them, everything else will start to fall into place. I'll give you an example of this: putting the tax-free allowance in the defence policy; if you're deployed on an operation internationally, it's tax-free. That gives families back home tremendous flexibility with what they can do. That's one of the things I'm proud of. We also include families as part of our defence policy. We're seeing tangible results. We've done some work, we've got more work to do. As you can see, this is what I'm focused on. Those procurement projects — ships, jets — are absolutely important, right? But the thing is, if we don't look after our people, those ships and jets don't mean anything. And that's probably what I'm most proud of: turning into a reality our focus in the defence policy, which is to our people. Q: What do you regret during your tenure as defence minister? A: Sometimes things can't move as fast as you want. I wouldn't call it a regret, but you want to see progress as fast as possible, and sometimes you end up pushing so hard, like with procurement: Why aren't we moving faster? We have these questions, and we're reminded that we need to hire enough people to move on these files. And so it's a reminder — it's not a regret — to never put your people in a position to over-extend themselves. You need to have a holistic Canadian Armed Forces that will look after itself. This whole conversation of more teeth, less tail — I hate that. In reality, making sure your pension cheques are given on time is just as important. Q: Is there something you really want to accomplish during the time remaining in your mandate? A: It goes back to my first point: making sure we have enough momentum that we're able to start executing all the things that we want, and having the right number of people to be able to move our projects forward. Also, making it a reality that, from the time somebody joins the military, we're focusing on resilience and that they know the country has their backs. For example, with the Transition Group, we've ensured that no future government can ever take that focus away from the people ever again. Q: Whether you or someone else takes over in a year's time, what will be the most pressing issue he or she faces? A: For me, a Number 1 priority will be making sure the environment inside the Canadian Armed Forces is one that's inclusive, that's harassment-free, and I know it seems very idealistic to say this, but any other goal is unacceptable, because it leaves leeway for things, because when you create that environment, you'll be able to get the best potential out of your people at the same time. That's the challenge we're working on. General (Jonathan) Vance is aggressively dealing with this, and Operation Honour is showing results. To me, it's a challenge, and a challenge that has to be met, regardless of who's in this position. Q: Is there something you wanted to accomplish that was pushed aside by larger or more pressing priorities? A: There's one thing I was really looking forward to doing, which is learn French. I sort of underestimated the time required of the job. However, I am still committed to learning French. I do what I can in my own time, and I'll learn it when I leave politics, because I think it's important for all Canadians to be able to speak both official languages. Q: You're up for re-election. You've been defence minister for three years, which is a relatively long time. Aside from Peter MacKay, who held the job for about six years, you've had one of the longest tenures of the past 20 years. If re-elected, will you seek re-appointment? A: I got into politics because I wanted to represent the neighbourhood I grew up in of Vancouver South, and I was very privileged to have that honour. When it comes to the next election, my job is going to be to make sure I connect with my community in my riding. That's the Number 1 job that I'm fighting for: to become the member of Parliament for Vancouver South. If the prime minister thinks again that my skills are needed, regardless of portfolio, I'd be honoured and privileged to serve. Q: Considering you got into politics to represent Vancouver South, is there something that being defence minister prevented you from doing, and that, given another term, you'd like to take on? A: In Vancouver South, my focus has been a lot on the youth, and I've done a lot of things in the riding, but I always feel like I wish I could do more. I want people to know that I — a person who grew up in that riding — can do some interesting things, and reach this portfolio, and that every single (constituent) can reach the highest levels. So that's the one thing I wish I had a little bit more time to do. But at the end of the day, if I still had that time, I would still have that regret, because I want to make sure we inspire the next generation, because I see so much potential in them. https://ipolitics.ca/2018/12/31/a-year-end-qa-with-defence-minister-harjit-sajjan/

  • Government uses procurement to help small businesses grow and create jobs

    December 18, 2017 | Local, Aerospace, Naval, Land, C4ISR, Security

    Government uses procurement to help small businesses grow and create jobs

    Innovative Solutions Canada is a $100-million program to fuel innovation and create middle-class jobs December 14, 2017 – Ottawa As the single-largest purchaser of Canadian goods and services, the Government of Canada will use procurement to help Canadian small businesses innovate and create employment opportunities for Canadians. The Honourable Navdeep Bains, Minister of Innovation, Science and Economic Development, together with the Honourable Bardish Chagger, Leader of the Government in the House of Commons and Minister of Small Business and Tourism, today announced the $100-million Innovative Solutions Canada program that invites Canadian small businesses to develop novel solutions to challenges proposed by federal departments and agencies. Whether the challenge is developing a way to make armour more resistant to chemicals or improving wireless connectivity in connected vehicles, the federal department or agency will ask small businesses to innovate and propose a solution. The government will work with the winning business and act as its first customer, helping the companies take their idea to market and advance the next generation of solutions that can become viable commercial products. Twenty federal departments and agencies will participate in the new program and identify problems spanning the military, economic and environmental sectors. Innovative Solutions Canada is a key component of the Government of Canada's Innovation and Skills Plan, a multi-year strategy to create well-paying jobs for the middle class. Quotes “Our government's new Innovative Solutions Canada program is a big winner on several fronts. We're being proactive and transforming our challenges into opportunities—opportunities for innovation, economic growth and small business success that will result in a vibrant innovation economy and more middle-class jobs for Canadians.” – The Honourable Navdeep Bains, Minister of Innovation, Science and Economic Development “We believe innovative Canadian small businesses are well positioned to help the government solve some of its more persistent challenges. Through Innovative Solutions Canada, we are asking entrepreneurs to develop new products and services that will help to solve these challenges, while also enabling these entrepreneurs as they work to expand to new markets and sell to new customers around the world. The benefits from this program are clear: the Government of Canada will be able to acquire new products and services that will improve our work, while hard-working small business owners will be able to grow their businesses and create more well-paying middle-class jobs.” – The Honourable Bardish Chagger, Minister of Small Business and Tourism “Our community of early-stage investors, incubators and accelerators provides much-needed coaching, connections and capital to Canada's early-stage companies seeking to grow and scale up. Many times, their ‘first customer' serves as critical validation that allows these companies to penetrate their markets locally and globally. The Innovative Solutions Canada program announced today will help Canadian companies gain early customer traction while also allowing Canadians to benefit from the adoption of homegrown innovative solutions.” ‑ Sandi Gilbert, Chair of the Board, National Angel Capital Organization (NACO Canada) Quick Facts Program funding will come from the 20 departments and agencies participating in Innovative Solutions Canada. Each department will set aside 1 percent of its research and development expenditures for this initiative. Innovative Solutions Canada is modelled on the U.S. Small Business Innovation Research program and is an essential component of the Government of Canada's efforts to help small businesses. Innovative Solutions Canada will encourage submissions from businesses owned and led by women, Indigenous peoples, youth and other traditionally under-represented groups. https://www.canada.ca/en/innovation-science-economic-development/news/2017/12/government_uses_procurementtohelpsmallbusinessesgrowandcreatejob.html

  • ANALYSIS | We are witnessing a turning point in the global order, says Canada's top soldier | CBC News

    January 3, 2023 | Local, Aerospace, Naval, Land, C4ISR, Security, Other Defence

    ANALYSIS | We are witnessing a turning point in the global order, says Canada's top soldier | CBC News

    It might be a stretch to describe Gen. Wayne Eyre as a modern Cassandra. Still, over the latter half of 2022, Canada's top military commander delivered — in public and before House of Commons committees — increasingly stark warnings about the future geopolitical landscape, where the war between Russia and Ukraine could go and the intentions of other disruptive international actors, such as China.

All news