Download to read offline
Uploaded byFundação Fernando Henrique Cardoso
Ameaças e oportunidades das novas tecnologias para o desenvolvimento e a democracia - Lindsay Gorman
The document discusses the future of internet applications and the increasing significance of data as a valuable resource, emphasizing the role of AI in global technological advancements and potential human rights implications, particularly in places like Xinjiang, China. It outlines the challenges posed by AI, including bias, privacy concerns, and ethical governance, while highlighting the global export of surveillance technologies and the need for regulatory frameworks. Recommendations are made to foster ethical standards and address the ramifications of tech-enabled human rights abuses.
More Related Content
Similar to Ameaças e oportunidades das novas tecnologias para o desenvolvimento e a democracia - Lindsay Gorman
More from Fundação Fernando Henrique Cardoso
Ameaças e oportunidades das novas tecnologias para o desenvolvimento e a democracia - Lindsay Gorman
- 1. The Future ofInternet Applications: connected devices, smart cities, autonomous vehicles, big data Lindsay Gorman The Alliance for Securing Democracy, The German Marshall Fund of the United States
- 2.
- 3.
- 4. We are seeingthe same thing with data 175 zettabytes of connected data by 2025
- 5. The new oil? •Advances in AI make data increasingly valuable Source: The Economist (May 06, 2017). “Regulating the internet giants: the world’s most valuable resource is no longer oil but data,” https://www.economist.com/leaders/2017/05/06/the-worlds-most-valuable-resource-is-no-longer-oil-but-data.
- 6. What is AI?From Recipes to Learning
- 7. Classifiers: A MachineLearning Task Source: Stanford CS231n: Convolutional Neural Neworks for Visual Pattern Recognition
- 8.
- 9. AI for good…butalso for ill “Artificial intelligence is the future, not only for Russia, but for all humankind. It comes with colossal opportunities, but also threats that are difficult to predict. Whoever becomes the leader in this sphere will become the ruler of the world.” - Vladimir Putin “AI is a vital driving force for a new round of technological revolution and industrial transformation, and accelerating AI development is a strategic issue to decide whether we can grasp opportunities.” - Xi Jinping
- 10. Human rights tragedyin Xinjiang Source: The New York Times (April 04, 2019). “How China Turned a City into a Prison,” https://www.nytimes.com/interactive/2019/04/04/world/asia/xinjiang-china-surveillance-prison.html.
- 11. Red flags fordetention in Xinjiang Source: Foreign Policy (September 13, 2018). “48 Ways to Get Sent to a Chinese Concentration Camp,” https://foreignpolicy.com/2018/09/13/48- ways-to-get-sent-to-a-chinese-concentration-camp/.
- 12. Completely enabled byAI and citizen data Source: The Washington Post (January 07, 2018). “China’s Watchful Eye,” https://www.washingtonpost.com/news/world/wp/2018/01/07/feature/in-china-facial-recognition-is-sharp-end-of-a-drive-for-total- surveillance/?noredirect=on.
- 13. Facial recognition-based 24-hrtracking Source: ZDNet (February 14, 2019). “Chinese company leaves Muslim-tracking facial recognition database exposed online,” https://www.zdnet.com/article/chinese-company-leaves-muslim-tracking-facial-recognition-database-exposed-online/.
- 14. …And more • DNAsurveillance • Online activity monitoring • Speech recognition speech monitoring • Human Rights Watch: A police app collects information on citizens to determine “threats” Source: Human Rights Watch (May 02, 2019). “How Mass Surveillance in Xinjiang, China,” https://www.hrw.org/video-photos/interactive/2019/05/02/china-how-mass-surveillance- works-xinjiang.
- 15. Aided by Westerntech firms and investments Source: Hong Kong Free Press (February 27, 2019). “‘Social credit’ scoring: How China’s Communist Party is incentivising repression,” https://www.hongkongfp.com/2019/02/27/social-credit-scoring-chinas-communist- party-incentivising-repression/. Source: Bloomberg (May 30, 2018). “Biggest AI Startup Boosts Fundraising to $1.2 Billion,” https://www.bloomberg.com/news/articles/2018-05-31/world- s-biggest-ai-startup-raises-1-2-billion-in-mere-months.
- 16. Surveillance State OutsideXinjiang ~200 million surveillance cameras in China Located a BBC reporter in just 7 minutes. (2017) “Breed-ready” status Source: Victor Gevers (March 09, 2019). Twitter https://twitter.com/0xDUDE/status/1104528181846032385
- 17. Made in China,Exported to the World • 18 countries are using Chinese-made intelligent monitoring systems • 36 (including Brazil) have received training in topics like “public opinion guidance” Source: New York Times (April 24, 2019). “Made in China, Exported to the World: The Surveillance State,” https://www.nytimes.com/2019/04/24/technology/ecuador- surveillance-cameras-police-government.html
- 18. Geopolitical power andideology
- 19. Authoritarian AI advantages •Privacy concerns • Transparency and accountability • Civil-military fusion
- 20. AI’s Governance andEthical Challenges • Bias and fairness • Transparency and accountability (the black box problem) • Privacy • Machine decision-making and accountability in critical areas
- 21. AI’s Challenges: Re-entrenchingBias • Systems are only as good as their input data – facial recognition performs with 99% accuracy on lighter-skinned males. It misidentifies women of color 30-35% of the time. • Amazon recruiting algorithm biased towards male candidates • Gendering of virtual personal assistants
- 22. AI’s Ethical Challenges:Bias In 2015… Google’s solution? Remove the gorilla category
- 23. AI’s Governance Challenges:The Black Box Source: DARPA XAI, cited in Forbes: https://www.forbes.com/sites/jasonbloomberg/2018/09/16/dont-trust-artificial-intelligence- time-to-open-the-ai-black-box/#71e9f2c13b4a.
- 24. AI’s Governance Challenges:Privacy • Data exploitation • Identification and tracking • Anonymity in the public square • Prediction • Profiling Source: Adapted from AI And the Future of Privacy: https://towardsdatascience.com/ai-and-the-future-of-privacy-3d5f6552a7c4
- 25. AI’s Ethical Challenges:Critical Decisions
- 26. Democracies also relyon objective reality Source: Business Insider (April 17, 2018). “A viral video that appeared to show Obama calling Trump a 'dips---' shows a disturbing new trend called 'deepfakes',” https://www.businessinsider.com/obama-deepfake-video- insulting-trump-2018-4.
- 27. Information operations weaponizemedia In 2016, 32 of 33 major American news outlets cited Russian troll accounts at least once in their coverage.
- 28. Synthetic text +data for microtargeting = human-out-of-the-loop influence operations
- 29. What can wedo? 1) Invest in the solution 2) Strong moral and ethical frameworks around emerging technologies 3) Condemn tech-enabled human rights abuses (not enable them) 4) Be a bit more conscious about partnerships and investments
- 30. Regulating AI? It startswith data.
- 31. The General DataProtection Regulation • Consent • Right to No Profiling • Right to be forgotten • Right to know when data has been hacked (breach notification within 72 hours of businesses becoming aware) • Data Portability • And more…
- 32. Regulating AI? Underconsideration • Opt-in consent to data use • Data broker registration (Vermont, DMVs) • Ability to opt-out of targeted ads • Limits to auto-replay and autorecommenders • Algorithmic transparency to counter bias & censorship • Breaking up big tech
- 33. Source: Getty Images.“Who Brought Down the Berlin Wall?,” https://foreignpolicy.com/2009/11/05/who-brought-down-the-berlin-wall/.
Editor's Notes
- #5 10 to the 21st power. A data-producing interaction once every 18 seconds.
- #6 --data is not finite and it doenst disappear—not a perfect analogy, but it speaks to geopolitical value. And its not just democracie that are realizing it.
- #10 Technolgoies are fundamentally neutral. Myriad AI for good applications. Unforutnatley, authoritarisn reimges who would suppress freedom, undermine openness and human rights hae taken an interest as well.
- #12 Why do we talk about this at a tech conference in the context of authoritarian uses of tech?
- #13 Facial recognition, genetic surveillance. HRW app.
- #16 ThermoFisher;
- #18 Huawei and city surveillance in Ecuador, the Phillipines, . Huawei is leading the charge here with smart and “safe” city surveillance technology. The problem is that with it comes the authoritarian worldview. I’d be remiss if I didn’t mention here in Berlin that the government will take up whether to allow Huawei in its 5G networoks. Because this really isn’t about whats cheaper. It’s about the future of our values. Today, 18 countries — including Zimbabwe, Uzbekistan, Pakistan, Kenya, the United Arab Emirates and Germany — are using Chinese-made intelligent monitoring systems, and 36 have received training in topics like “public opinion guidance,” which is typically a euphemism for censorship, according to an October report from Freedom House, a pro-democracy research group.
- #22 One 2018 study conducted by Joy Buolamwini of the M.I.T. Media Lab found that the technology is correct 99 percent of the time with photos of white men. But the software misidentified the gender as often as 35 percent of the time when viewing an image of a darker-skinned woman. In January, researchers with M.I.T. Media Lab reported that facial-recognition software developed by Amazon and marketed to local and federal law enforcement also fell short on basic accuracy tests, including correctly identifying a person’s gender. Specifically, Amazon’s Rekognition system was perfect in predicting the gender of lighter-skinned men, the researchers said, but misidentified the gender of darker-skinned women in roughly 30 percent of their tests.
- #23 One 2018 study conducted by Joy Buolamwini of the M.I.T. Media Lab found that the technology is correct 99 percent of the time with photos of white men. But the software misidentified the gender as often as 35 percent of the time when viewing an image of a darker-skinned woman. In January, researchers with M.I.T. Media Lab reported that facial-recognition software developed by Amazon and marketed to local and federal law enforcement also fell short on basic accuracy tests, including correctly identifying a person’s gender. Specifically, Amazon’s Rekognition system was perfect in predicting the gender of lighter-skinned men, the researchers said, but misidentified the gender of darker-skinned women in roughly 30 percent of their tests.
- #24 One 2018 study conducted by Joy Buolamwini of the M.I.T. Media Lab found that the technology is correct 99 percent of the time with photos of white men. But the software misidentified the gender as often as 35 percent of the time when viewing an image of a darker-skinned woman. In January, researchers with M.I.T. Media Lab reported that facial-recognition software developed by Amazon and marketed to local and federal law enforcement also fell short on basic accuracy tests, including correctly identifying a person’s gender. Specifically, Amazon’s Rekognition system was perfect in predicting the gender of lighter-skinned men, the researchers said, but misidentified the gender of darker-skinned women in roughly 30 percent of their tests.
- #25 Identification and Tracking AI can be utilized to identify, track and monitor individuals across multiple devices, whether they are at work, at home, or at a public location. This means that even if your personal data is anonymized once it becomes a part of a large data set, an AI can de-anonymize this data based on inferences from other devices. This blurs the distinction between personal and non-personal data, which has to be maintained under present legislation.
- #26 One 2018 study conducted by Joy Buolamwini of the M.I.T. Media Lab found that the technology is correct 99 percent of the time with photos of white men. But the software misidentified the gender as often as 35 percent of the time when viewing an image of a darker-skinned woman. In January, researchers with M.I.T. Media Lab reported that facial-recognition software developed by Amazon and marketed to local and federal law enforcement also fell short on basic accuracy tests, including correctly identifying a person’s gender. Specifically, Amazon’s Rekognition system was perfect in predicting the gender of lighter-skinned men, the researchers said, but misidentified the gender of darker-skinned women in roughly 30 percent of their tests.
- #27 In 2016, 32 of 33 major American news outlets cited Russian troll accounts at least once in their coverage.
- #31 EIF 25 May 2018.
- #32 Last year, Brazil passed the LGDP, which goes into inforce in February of 2020