Versions of this presentation were given in March 2019 at the International Studies Association 2019 and the PREA Ethics and Humanitarian Research Conference. It briefly presents the techniques and technologies used to understand people affected by humanitarian emergencies. It then introduces ongoing work to demonstrate the feasibility of deploying Natural Language Processing in order to scale up the use of qualitative data in emergencies. Finally, I discusses the ethical implications of this work, and what rules, principles, and other ethical guidance is needed before AI can be used in humanitarian response.
A key contemporary trend emerging in big data science is the Quantified Self (QS) - individuals engaged in the deliberate self-tracking of any kind of biological, physical, behavioral, or transactional information as n=1 individuals or in groups. This is giving rise to interesting pools of individual data, group data, and big data which can be interlinked to create a new era of highly-targeted value-specific consumer applications. There are significant opportunities in big data to develop models to support QS data collection, integration, analysis, and use for personal lifestyle and consumption management. There are also opportunities to provide leadership in designing consumer-friendly standards and etiquette regarding the use of personal and collective data. Next-generation QS big data applications and services could include tools for rendering QS data meaningful in behavior change, establishing baselines and variability in objective metrics, applying new kinds of pattern recognition techniques, and aggregating multiple self-tracking data streams from wearable electronics, biosensors, mobile phones, genomic data, and cloud-based services. Potential limitations regarding QS activity need to be considered including consumer non-adoption, data privacy and sharing concerns, the digital divide, ease-of-use, and social acceptance.
Join Dr. David Buckeridge, in partnership with the Office of the Chief Public Health Officer (CPHO) and the National Collaborating Centres for Public Health, to learn more about approaches to establishing and assuring the components for developing a data system, along with consideration of overarching factors such as options for coordinating and leading the development and operation of a coordinated network of systems to inform a bold vision for a renewed public health system in Canada.
A key contemporary trend emerging in big data science is the Quantified Self (QS) - individuals engaged in the deliberate self-tracking of any kind of biological, physical, behavioral, or transactional information as n=1 individuals or in groups. This is giving rise to interesting pools of individual data, group data, and big data which can be interlinked to create a new era of highly-targeted value-specific consumer applications. There are significant opportunities in big data to develop models to support QS data collection, integration, analysis, and use for personal lifestyle and consumption management. There are also opportunities to provide leadership in designing consumer-friendly standards and etiquette regarding the use of personal and collective data. Next-generation QS big data applications and services could include tools for rendering QS data meaningful in behavior change, establishing baselines and variability in objective metrics, applying new kinds of pattern recognition techniques, and aggregating multiple self-tracking data streams from wearable electronics, biosensors, mobile phones, genomic data, and cloud-based services. Potential limitations regarding QS activity need to be considered including consumer non-adoption, data privacy and sharing concerns, the digital divide, ease-of-use, and social acceptance.
Join Dr. David Buckeridge, in partnership with the Office of the Chief Public Health Officer (CPHO) and the National Collaborating Centres for Public Health, to learn more about approaches to establishing and assuring the components for developing a data system, along with consideration of overarching factors such as options for coordinating and leading the development and operation of a coordinated network of systems to inform a bold vision for a renewed public health system in Canada.
Breakout 3. AI for Sustainable Development and Human Rights: Inclusion, Diver...Saurabh Mishra
This group reviewed data and measurements indicating the positive potential of AI to serve Sustainable Development Goals (SDG’s). Alongside these optimistic inquiries, this group also investigated the risks of AI in areas such as privacy, vulnerable populations, human rights, workplace and organizational policy. The socio-political consequences of AI raise many complex questions which require continued rigorous examination.
During the COVID-19 Global Pandemic, there were multiple lessons provided to the world. In this talk, I set the stage for the discussion, highlight the issues we faced (and still face), I speak to an effort that contributed to help address one of those issues, then speak to future challenges and our responsibilities going forward.
This is a brief a brief review of current multi-disciplinary and collaborative projects at Kno.e.sis led by Prof. Amit Sheth. They cover research in big social data, IoT, semantic web, semantic sensor web, health informatics, personalized digital health, social data for social good, smart city, crisis informatics, digital data for material genome initiative, etc. Dec 2015 edition.
The challenges of the Digital Age creates a sea of opportunities for technologists. Developing software transforms the economic, political, cultural, and social reality of countries.
On the one hand, a larger part of the population does not know the downside of IT, which does not decrease our great responsibility. On the other hand, technologists do not always know how to make ethical decisions in day-to-day systems development. There is also a long discussion about the role of technology in the sustainability of the planet: after all, when IT is good or bad?
This lecture is an introduction to ethics and sustainability aimed at technologists who want to learn how to position themselves as professionals in the face of so many challenges and opportunities of the 21st century.
On 4 October 2016, as part of the GDPR Workshop series, the Brussels Privacy Hub hosted a workshop on implementation of the EU GDPR and Privacy Impact Assessment. Trilateral delivered a joint presentation by Rowena Rodrigues and Julia Muraszkewicz, exploring some of the challenges associated to DPIAs and EPIAs. The presentation was based upon two of Trilateral’s research projects: SATORI and iTRACK.
Digital Divide, Social Exclusion, and inclusion policy and new harmsJames Stewart
A lecture on understanding concept of digital divide, sstatistica data on nternet use, theories of the digitial excluson, new hards, and policy responses and inituatives
Lecture on ethical issues taught as part of Heriot-Watt's course on Conversational Agents (2021). Topics covered:
- General Research Ethics with Human Subjects
- Bias and fairness in Machine Learning
- Specific Issues for ConvAI
Mining Human Behavior for Health PromotionOresti Banos
The monitoring of human lifestyles has gained much attention in the recent years. This work presents a novel approach to combine multiple context-awareness technologies for the automatic analysis of people’s conduct in a comprehensive and holistic manner. Activity recognition, emotion recognition, location detection, and social analysis techniques are integrated with ontological mechanisms as part of a framework to identify human behavior. Key architectural components, methods and evidences are described in this paper to illustrate the interest of the proposed approach.
Transforming Social Big Data into Timely Decisions and Actions for Crisis Mi...Amit Sheth
Keynote @ Exploitation of Social Media for Emergency Relief and Preparedness (SMERP)
Co-located with: The Web Conference 2018 (formerly WWW)
Lyon, France. 23 April 2018
Abstract:
Crises are imposing massive costs to economies worldwide. Natural disasters caused record $306 billion in damage to the U.S. in 2017! Real-time gathering of relevant data through ubiquitous presence of mobile technologies and the ability to disseminate them through social media has forever changed how disaster and health crisis monitoring and response are now carried out. Both tradition crisis response organization as well as temporary, informal, self-organized and community-based organizations have come to increasingly rely on social media. Furthermore, ability to collect, repurpose and reuse data from past events is helping with preparedness and planning for future events.
In this talk, I will review our extensive experience on (a) interactions with variety of stakeholders involved in emergency response at city, county, country and international levels, (b) research on real-time social media analysis spanning spatio-temporal-thematic; people-content-network; linguistic-sentiment-emotion-intent analysis dimensions, (c) development and use of crisis response specific tools (location identification, demand-supply match) and the comprehensive Twitris semantic social intelligence system (which is also commercialized as Cognovi Labs), and (d) a variety of real-world evaluations and real-time uses (e.g., supplying data for Google Crisis map during Uttarakhand Floods, rescue during Kashmir Floods, neighborhood image map during Chennai Floods, providing information to FEMA during Oklahoma tornados), spread of disease and epidemiology (e.g., Zika spread), metro-level multi-agency disaster preparedness exercise, etc.
https://www.cse.iitk.ac.in/users/kripa/smerp2018/SMERP-at-Web2018-keynote.pdf
ZGB - The Role of Generative AI in Government transformation.pdfSaeed Al Dhaheri
This keynote was presented during the the 7th edition of the UAE Hackathon 2024. It highlights the role of AI and Generative AI in addressing government transformation to achieve zero government bureaucracy
Jennifer Schaus and Associates hosts a complimentary webinar series on The FAR in 2024. Join the webinars on Wednesdays and Fridays at noon, eastern.
Recordings are on YouTube and the company website.
https://www.youtube.com/@jenniferschaus/videos
More Related Content
Similar to Establishing Global Rules for the Ethical Use of Artificial Intelligence in Humanitarian Emergencies
Breakout 3. AI for Sustainable Development and Human Rights: Inclusion, Diver...Saurabh Mishra
This group reviewed data and measurements indicating the positive potential of AI to serve Sustainable Development Goals (SDG’s). Alongside these optimistic inquiries, this group also investigated the risks of AI in areas such as privacy, vulnerable populations, human rights, workplace and organizational policy. The socio-political consequences of AI raise many complex questions which require continued rigorous examination.
During the COVID-19 Global Pandemic, there were multiple lessons provided to the world. In this talk, I set the stage for the discussion, highlight the issues we faced (and still face), I speak to an effort that contributed to help address one of those issues, then speak to future challenges and our responsibilities going forward.
This is a brief a brief review of current multi-disciplinary and collaborative projects at Kno.e.sis led by Prof. Amit Sheth. They cover research in big social data, IoT, semantic web, semantic sensor web, health informatics, personalized digital health, social data for social good, smart city, crisis informatics, digital data for material genome initiative, etc. Dec 2015 edition.
The challenges of the Digital Age creates a sea of opportunities for technologists. Developing software transforms the economic, political, cultural, and social reality of countries.
On the one hand, a larger part of the population does not know the downside of IT, which does not decrease our great responsibility. On the other hand, technologists do not always know how to make ethical decisions in day-to-day systems development. There is also a long discussion about the role of technology in the sustainability of the planet: after all, when IT is good or bad?
This lecture is an introduction to ethics and sustainability aimed at technologists who want to learn how to position themselves as professionals in the face of so many challenges and opportunities of the 21st century.
On 4 October 2016, as part of the GDPR Workshop series, the Brussels Privacy Hub hosted a workshop on implementation of the EU GDPR and Privacy Impact Assessment. Trilateral delivered a joint presentation by Rowena Rodrigues and Julia Muraszkewicz, exploring some of the challenges associated to DPIAs and EPIAs. The presentation was based upon two of Trilateral’s research projects: SATORI and iTRACK.
Digital Divide, Social Exclusion, and inclusion policy and new harmsJames Stewart
A lecture on understanding concept of digital divide, sstatistica data on nternet use, theories of the digitial excluson, new hards, and policy responses and inituatives
Lecture on ethical issues taught as part of Heriot-Watt's course on Conversational Agents (2021). Topics covered:
- General Research Ethics with Human Subjects
- Bias and fairness in Machine Learning
- Specific Issues for ConvAI
Mining Human Behavior for Health PromotionOresti Banos
The monitoring of human lifestyles has gained much attention in the recent years. This work presents a novel approach to combine multiple context-awareness technologies for the automatic analysis of people’s conduct in a comprehensive and holistic manner. Activity recognition, emotion recognition, location detection, and social analysis techniques are integrated with ontological mechanisms as part of a framework to identify human behavior. Key architectural components, methods and evidences are described in this paper to illustrate the interest of the proposed approach.
Transforming Social Big Data into Timely Decisions and Actions for Crisis Mi...Amit Sheth
Keynote @ Exploitation of Social Media for Emergency Relief and Preparedness (SMERP)
Co-located with: The Web Conference 2018 (formerly WWW)
Lyon, France. 23 April 2018
Abstract:
Crises are imposing massive costs to economies worldwide. Natural disasters caused record $306 billion in damage to the U.S. in 2017! Real-time gathering of relevant data through ubiquitous presence of mobile technologies and the ability to disseminate them through social media has forever changed how disaster and health crisis monitoring and response are now carried out. Both tradition crisis response organization as well as temporary, informal, self-organized and community-based organizations have come to increasingly rely on social media. Furthermore, ability to collect, repurpose and reuse data from past events is helping with preparedness and planning for future events.
In this talk, I will review our extensive experience on (a) interactions with variety of stakeholders involved in emergency response at city, county, country and international levels, (b) research on real-time social media analysis spanning spatio-temporal-thematic; people-content-network; linguistic-sentiment-emotion-intent analysis dimensions, (c) development and use of crisis response specific tools (location identification, demand-supply match) and the comprehensive Twitris semantic social intelligence system (which is also commercialized as Cognovi Labs), and (d) a variety of real-world evaluations and real-time uses (e.g., supplying data for Google Crisis map during Uttarakhand Floods, rescue during Kashmir Floods, neighborhood image map during Chennai Floods, providing information to FEMA during Oklahoma tornados), spread of disease and epidemiology (e.g., Zika spread), metro-level multi-agency disaster preparedness exercise, etc.
https://www.cse.iitk.ac.in/users/kripa/smerp2018/SMERP-at-Web2018-keynote.pdf
ZGB - The Role of Generative AI in Government transformation.pdfSaeed Al Dhaheri
This keynote was presented during the the 7th edition of the UAE Hackathon 2024. It highlights the role of AI and Generative AI in addressing government transformation to achieve zero government bureaucracy
Jennifer Schaus and Associates hosts a complimentary webinar series on The FAR in 2024. Join the webinars on Wednesdays and Fridays at noon, eastern.
Recordings are on YouTube and the company website.
https://www.youtube.com/@jenniferschaus/videos
This session provides a comprehensive overview of the latest updates to the Uniform Administrative Requirements, Cost Principles, and Audit Requirements for Federal Awards (commonly known as the Uniform Guidance) outlined in the 2 CFR 200.
With a focus on the 2024 revisions issued by the Office of Management and Budget (OMB), participants will gain insight into the key changes affecting federal grant recipients. The session will delve into critical regulatory updates, providing attendees with the knowledge and tools necessary to navigate and comply with the evolving landscape of federal grant management.
Learning Objectives:
- Understand the rationale behind the 2024 updates to the Uniform Guidance outlined in 2 CFR 200, and their implications for federal grant recipients.
- Identify the key changes and revisions introduced by the Office of Management and Budget (OMB) in the 2024 edition of 2 CFR 200.
- Gain proficiency in applying the updated regulations to ensure compliance with federal grant requirements and avoid potential audit findings.
- Develop strategies for effectively implementing the new guidelines within the grant management processes of their respective organizations, fostering efficiency and accountability in federal grant administration.
Monitoring Health for the SDGs - Global Health Statistics 2024 - WHOChristina Parmionova
The 2024 World Health Statistics edition reviews more than 50 health-related indicators from the Sustainable Development Goals and WHO’s Thirteenth General Programme of Work. It also highlights the findings from the Global health estimates 2021, notably the impact of the COVID-19 pandemic on life expectancy and healthy life expectancy.
Understanding the Challenges of Street ChildrenSERUDS INDIA
By raising awareness, providing support, advocating for change, and offering assistance to children in need, individuals can play a crucial role in improving the lives of street children and helping them realize their full potential
Donate Us
https://serudsindia.org/how-individuals-can-support-street-children-in-india/
#donatefororphan, #donateforhomelesschildren, #childeducation, #ngochildeducation, #donateforeducation, #donationforchildeducation, #sponsorforpoorchild, #sponsororphanage #sponsororphanchild, #donation, #education, #charity, #educationforchild, #seruds, #kurnool, #joyhome
Donate to charity during this holiday seasonSERUDS INDIA
For people who have money and are philanthropic, there are infinite opportunities to gift a needy person or child a Merry Christmas. Even if you are living on a shoestring budget, you will be surprised at how much you can do.
Donate Us
https://serudsindia.org/how-to-donate-to-charity-during-this-holiday-season/
#charityforchildren, #donateforchildren, #donateclothesforchildren, #donatebooksforchildren, #donatetoysforchildren, #sponsorforchildren, #sponsorclothesforchildren, #sponsorbooksforchildren, #sponsortoysforchildren, #seruds, #kurnool
Jennifer Schaus and Associates hosts a complimentary webinar series on The FAR in 2024. Join the webinars on Wednesdays and Fridays at noon, eastern.
Recordings are on YouTube and the company website.
https://www.youtube.com/@jenniferschaus/videos
2017 Omnibus Rules on Appointments and Other Human Resource Actions, As Amended
Establishing Global Rules for the Ethical Use of Artificial Intelligence in Humanitarian Emergencies
1. Avoiding Catastrophe: Establishing
Global Rules for the Ethical Use of
Artificial Intelligence in
Humanitarian Emergencies
Tino Kreutzer | @tinokreutzer | kreutzer@yorku.ca
Dahdaleh Institute for Global Health Research | York University | PhD Candidate
Harvard Humanitarian Initiative | Affiliated Staff
NetHope | Advisor
2. This presentation
1. Techniques and
technologies used for
understanding affected
populations in
humanitarian
emergencies
2. Natural Language
Processing for
qualitative data
3. Humanitarian and AI
principles for ethical use
of data and technology
3. From paper to mobile data collection
to call centers
0
20
40
60
80
2014-
07
2015-
01
2016-
01
2017-
01
2018-
01
2019-
01
SurveysubmissionstoOCHAandHHIKoBoToolboxservers
(inmillion)
7. In the morning it can take a long time because I usually go to the well
close to our house. But then the person who has the key to the lock may
not be there so I need to wait a long time. Then I may need to come back
in the afternoon. So quite often we go to the river which even though it’s
very far and we know that water can make us sick. Our ward chief has a
water pump and the quality is very good, but he charges us a lot.
X
How long is the walk to the chief?
Oh, not far, only 10 minutes.
8. Primary data collection to understand and
involve affected populations
Quantitative
Surveys using mobile data
collection, call centers, etc.
? A
B
Qualitative
Focus group discussions,
qualitative interviews,
feedback hotlines, etc.
Transcription,
translation
Analysis
Best insights,
but hard to scale due to
cost and lack of staff
Less detailed,
but fast and easy to scale
?
10. Understanding
affected populations with NLP
Quantitative & Qualitative
Population surveys, key informant
interviews, focus group discussions,
qualitative interviews,
feedback hotlines, etc.
? Quality controlTranscription,
translation
Analysis
11. In the morning it can take a long time because I usually go to the well
close to our house. But then the person who has the key to the lock may
not be there so I need to wait a long time. Then I may need to come back
in the afternoon. So quite often we go to the river which even though it’s
very far and we know that water can make us sick. Our ward chief has a
water pump and the quality is very good, but he charges us a lot.
water_sources
well
river
pump
water_issues
long wait time
long distance
access fees
bad water quality
water_source_distance
close
NLP example for response analysis
On a typical day, where do you usually get your water from, and are there other
alternatives? Are there any issues with these sources?
water_source_primary
well
13. What could go wrong with bringing AI
to humanitarian emergencies???
intelligent machines can restrict the
choices of individuals and groups, lower
living standards, disrupt the organization
of labor and the job market, influence
politics, clash with fundamental rights,
exacerbate social and economic
inequalities, and affect ecosystems, the
climate and the environment
Montreal Declaration 2018
“
14. Ethical risks of deploying
“experimental technologies”
in humanitarian response
• False sense of accuracy
• Increased remote management and
‘bunkerization’
• Risks to respondents and field staff due to
collected data
• Testing and experimentation with the most
vulnerable populations
• Exclusion of people without access to cell phones
• Exploitative data mining
• Technology can’t solve real social problems
• Uncritical involvement of large technology
companies
17. International
initiatives
• United Nations:
• UN Convention on Certain Conventional Weapons
• International Telecommunication Union
• G7: Charlevoix Common Vision for the Future of Artificial
Intelligence
• EU: European AI Alliance
• Nordic-Baltic Region: declaration of collaboration on AI
• UAE and India: Memorandum of Understanding to establish a
partnership
• International Study Group of Artificial Intelligence, led by
France and Canada
18. Countries with
national AI strategies
• Mostly focused on investing
in AI
• No national policies or
regulations yet
19.
20. Data Protection &
Humanitarian Principles
• IHL, Human Rights Law
• 1965 Humanitarian Principles: humanity, impartiality, neutrality, and
independence
• 1994 Code of Conduct for the International Red Cross and Red Crescent
Movement and NGOs in Disaster Relief
• 1998 Humanitarian Charter
• “people are not put at risk as a result of the way that humanitarian
actors record and share information”
• Protection Principles
• “minimise any negative effects of humanitarian action,” such as
rendering “civilians more vulnerable to attack”
• 2014 Core Humanitarian Standard
• requires organizations to “safeguard any personal information
collected from communities and people affected by crisis that
could put them at risk.”
• 2014 Core Humanitarian Standard
• “clear and comprehensive policies on data protection” should be
“aligned with international standards and local data protection
laws.”
• 2018 Professional Standards in Protection Work (ICRC)
21. Data
protection
guidelines
Title Year Authors
Mapping and Comparing Responsible Data Approaches 2016 Berens, Mans, Verhulst
The Signal Code: A Human Rights Approach to Information During Crisis 2017 HHI / Signal
Professional Standards for Protection Work (3rd ed.) 2018 ICRC
ICRC Rules on Personal Data Protection 2017 ICRC
Handbook on Data Protection in Humanitarian Action 2017 ICRC
Data preparedness: connecting data, decision-making and humanitarian
response 2016 Raymond and Al Achkar
Information and Data Management Training toolkit Protection Cluster
Data Protection Starter Kit 2017 Terre des Hommes / CartONG
Responsible Data Principles 2018 The Engine Room
Big Data for Development and Humanitarian Action: Towards
Responsible Governance 2016 UN Global Pulse
Policy on the Protection of Personal Data of Persons of Concern to
UNHCR 2015 UNHCR
Conducting Mobile Surveys Responsibly: A Field Book for WFP Staff, May
2017 2017 WFP
Data Protection, Privacy and Security for Humanitarian & Development
Programs 2017 WVI
Compromised Connections: Overcoming Privacy Challenges of the Mobile
Internet 2016 Internews
The Humanitarian Metadata Problem - Doing No Harm in the Digital Era 2018 Privacy International and ICRC
ICT4Refugees: A report on the emerging landscape of digital responses to
the refugee crisis 2016 Mason and Buchman
Technologies for monitoring in insecure environments 2016 Dette, Steets, Sagmeister
Building data responsibility into humanitarian action 2016 Raymond et al.
22.
23. A Growing list
of ethical AI
guidelines
• 2017 Asilomar Principles
• 2018 Google AI Principles
• 2018 Microsoft: Principles, Policies and Laws
for the Responsible Use of AI
• Partnership on AI: Tenets
General principles
• Association for Computing Machinery
• Institute of Electrical and Electronics
Engineers (IEEE)
• Microsoft
• 2018 Montreal Declaration
Detailed guidance
26. IEEE Global Initiative on Ethics of Autonomous and Intelligent Systems
Goal: “provide pragmatic and directional insights and recommendations, serving as a key reference for the
work of technologists, educators and policymakers in the coming years.”
27. Montreal AI
declaration
principles
applicable to
humanitarian
response
(examples)
3.1 Personal spaces in which people are not subjected to
surveillance or digital evaluation must be protected from the
intrusion of AIS and data acquisition and archiving systems (DAAS).
5.1 AIS processes that make decisions affecting a person’s life,
quality of life, or reputation must be intelligible to their creators.
5.2 The decisions made by AIS affecting a person’s life, quality
of life, or reputation should always be justifiable in a language that
is understood by the people who use them or who are subjected to
the consequences of their use. […]
6.1 AIS must be designed and trained so as not to create,
reinforce, or reproduce discrimination based on — among other
things — social, sexual, ethnic, cultural, or religious differences.
9.2 In all areas where a decision that affects a person’s life,
quality of life, or reputation must be made, where time and
circumstance permit, the final decision must be taken by a human
being and that decision should be free and informed
28. Proposed
Humanitarian
AI impact risk
assessment
framework
Impact
level
Impact on affected people or
communities
Example
I Little to no impact; errors cause
no harm
Transcription and classification of
survey responses
II Moderate impact; errors can
cause minimal to moderate harm
Automatic analysis and routing of
feedback/complaints received
III High impact, errors can cause
moderate to high harm
Automated decision-making that
would decide whether an affected
person or their household should
receive particular assistance
IV Very high impact; errors can cause
serious to catastrophic harm
Donor-level decisions on attributing
funding for particular sectors or
emergencies
inspired by Karlin and Corriveau (2018)
29. Humanitarian AI ethics principles
• AI is different from other “experimental” technologies.
Risks are greater.
• Imagine all the ways how things could go wrong.
• Algorithmic decision-making in humanitarian response
should require new ethical assessment framework
• There are many principles. Apply them. Teach them to your
technology partners.
• Follow existing standards and guidance on data protection,
data privacy, role of private vendors
30. Our road
ahead…
Partnerships, research, ethical safeguards
•Speech recognition for Yemeni Arabic
•Manually transcribe and translate sample responses to serve as
text training data
•Collect speech recordings from volunteers as audio training
data
•Response classification
•Quality control for quantitative surveys
•Question-specific analysis models
•Validation and iterative improvements
Pilot
•Release of all language models, classification algorithms, and
software API
•Provide documentation on how to create own classification
models
Roll out
In my presentation, I will first talk about the techniques and technologies used to understand people affected by humanitarian emergencies
Second, I will introduce my ongoing work to demonstrate the feasibility of deploying Natural Language Processing in order to scale up the use of qualitative data in emergencies
Finally, I will go into the ethical implications of this work, and what we are doing to guide our project and other organizations planning to use AI in humanitarian response
Why am I interested in this? Why am I at an ethics conference?
For the last ten years I have helped UN organizations and NGOs move from paper-based to mobile electronic data collection. In CAR, DRC, West Africa during Ebola, Nepal after the earthquake.
I’ve also led representative population surveys with more than 40,000 respondents in conflict and post-conflict zones
Since 2013 I’ve been managing the development of KoBoToolbox, a free and open source data collection tool, which is now used very widely in all humanitarian emergencies.
In my research, I’m now addressing some of the many limitations I have witnessed—both technical and human—that prevent us from better understanding people in complex emergencies.
An effective response to international humanitarian emergencies requires us to understand the needs and preferences of the affected population.
…
This is usually done through quantitative surveys by interviewing a sample of the people affected, in face to face interviews …
https://www.youtube.com/watch?v=2dB034oSs-c
MSF OCB
..but also, increasingly, through remotely conducted phone surveys.
(Phone surveys are increasing due to the fact that more people have access to cell phones and network coverage; but also, because a rising number of attacks on aid workers in conflicts makes it increasingly dangerous for field staff to deploy. )
Quantitative surveys, such as for rapid needs assessments, require local survey staff to translate complex responses into categorical or numeric data.
Time pressure to conduct and analyze interviews usually means that these assessments rarely include any open-ended questions.
This means that while people might give our enumerators a lot of valuable information for a particular question, there is often no space and time for it in our questionnaires.
Quantitative surveys, such as for rapid needs assessments, require local survey staff to translate complex responses into categorical or numeric data.
More profound insights continue to require the use of qualitative methods. But they require a lot of time and resources before analysis is available.
For example, ten unstructured interviews of 30 minutes each may take 40 hours to transcribe, while manual coding—even with the help of software like Nvivo—requires an additional 20 hours.
This makes these methods hard to conduct at scale in a deteriorating complex emergency.
While we all agree in the importance of qualitative methods to understand affected people, they are often considered a luxury, especially during the initial response phase.
Natural language processing provides radical new opportunities to help us close the wide gap between qualitative and quantitative methods
NLP refers to a group of Artificial Intelligence tasks for processing and analyzing spoken or written language.
Such capabilities are advancing through commercial applications from Google, Amazon, and others, as well as open source alternatives.
For example, the technology to transcribe human speech into English and some other languages is already extremely advanced. But many of the languages spoken by affected people in humanitarian emergencies present few commercial incentives to be added to proprietary tools.
Our goal is to systematically transcribe, translate, and categorize interview responses to improve the efficiency and effectiveness of humanitarian response.
This will be a lot of work:
For our pilot in Yemen, this requires creating an entirely new transcription model for Yemeni Arabic and identifying the best NLP methods to analyze different kinds of responses.
The greatest potential benefit of this project is for affected people to be better understood during formal assessments
More qualitative interactions can make organizations more accountable as feedback and complaints are gathered more widely.
Here are some examples of how NLP techniques can be used to parse long form qualitative responses.
The complexity depends on the question being asked and the types of data that need to be coded
Languages that we are focusing on are, for example, Yemeni Arabic, Rohingya, Kanuri in Northern Nigeria (also spoken in parts of Cameroon, Chad, Niger, Nigeria and Sudan).
(We are not necessarily talking about small languages: Yemen has 28 million; Kanuri has about 5 million native speakers.)
Even worse, the vast majority of these languages lack large-scale electronic audio and text databases that can be used to train open source tools as well.
READ quote
The Montreal Declaration was developed jointly with many leading AI researchers.
There has been considerable amount of research into the challenges of deploying new technologies and the use of big data in humanitarian emergencies.
Here is just a short sample from the last three years.
BUT AI IS DIFFERENT: These cautions should still apply, but we are now talking about a completely new set of risks for affected people:
One of the biggest challenges with developing AI is to avoid or minimize biases, which can have grave long-term consequences.
Biases may come from engineers’ own prejudices, but oftentimes it is the training data that leads to the worst biases in automated systems.
Biased decision making in AI is hard to measure and control.
Mitigation is challenging, so the emphasis should be on building systems with the goal of reducing existing biases and inequities.
Some of the consequences of these biases are already playing out in the real world. For example:
Biased algorithms were found to exacerbate racial inequalities in the justice sector in the US
Face recognition quality is nearly perfect… unless you are a women, and especially if you are a dark-skinned woman
The fatal Uber crash in Arizona last year shows why this matters in the future: Autonomous cars rely on identifying people, and If you have dark skin you may be less likely to be ”seen” by the car.
Finnemore and Sikkink have created the very useful concept of the ‘Life cycle’ of norms
So far, we are still at the beginning stage of Norm Emergence
I expect the coming
In the last two years we have seen increasing activity at IOs and between nation states to create common policies.
For example, the ITU is leading efforts to study and manage the impacts of AI.
The UN Convention on Certain Conventional Weapons has a forum to discuss legal issues around the creation of autonomous weapons
European Union: There is a European AI Alliance that has established an overarching approach to AI and an agreement to cooperate among European countries.
Charlevoix Common Vision for the Future of Artificial Intelligence: Leaders of the G7 agreed to a shared set of commitments for AI in Charlevoix, Canada
Nordic-Baltic Region: Ministers from the Nordic-Baltic region issued a declaration of collaboration on AI.
AI Agreement Between UAE and India: The UAE Minister for AI and Invest India signed a Memorandum of Understanding to establish a partnership.
International Study Group of Artificial Intelligence: France and Canada are developing a task force to make recommendations on the scope and implementation of the international study group.
Government policies on artificial intelligence have largely focused on making its development a national priority for economic competitiveness, framing it as a national security issue, and providing increased research funding.
For most countries, there are no policies on AI to date.
Such concerns about the ethical implications of AI tools have only recently been recognized as research priorities
In many emergencies, humanitarian organizations often need to work without explicit laws and policies.
Instead, we rely on a tapestry of ethical codes and principles, which are re-analyzed and expanded whenever new challenges arrive.
IHL, Principles, Code of Conduct don't mention rights or responsibilities around information
1998 Charter and Protection Principles for the first time mentioning risks from recording and sharing information
2014 CHS expresses this as a right and makes organizations responsible for safeguarding personal information
WHAT are Sphere's int'l standards and local data protection laws referring to?
No specific guidance on data protection / security/ privacy in Sphere. No other sector wide Standards.
Use ICRC Professional Standards in Protection Work as minimum standards?
Many different guidelines developed, many in parallel
…
Handbook on Data Protection in Humanitarian Action
Public concern around AI has quickly expanded from autonomous weapons and existential risks for humanity to wide-ranging implications for society, the future of labor, and so on
This has resulted in many policy initiatives.
There are several general principles
..as well as principles that backed up by detailed guidance on their implementation
Asilomar: endorsed by more than 3,800 AI researchers and practitioners
Released on March 25th
Goal: “provide pragmatic and directional insights and recommendations, serving as a key reference for the work of technologists, educators and policymakers in the coming years.”
10 principles, 62 detailed rules
How to safeguard against mistakes or manipulation of automated analysis that could lead to wrong decisions?
I believe, engineers and humanitarian organizations planning to deploy AI in humanitarian response should be keenly aware of the particularly complex ethical playing field.
This means understanding the exact ways in which the technology will be used, the type of training data needed, realistic plans to update the models, and ways to measure machine bias.
Humanitarian organizations should also analyze all the potentially harmful consequences that new AI technologies might bring with them.
Organizations should follow the most stringent guidance documents available, such as the ICRC Data Protection Handbook