Dystopian AI.
Is human-machine
coexistence already here?
Alexandra Petrus, IWD19 Greece - March, 2019
Photo by Franck V. on Unsplash
@AlxPetrus
/in/alexandrapetrus/
alexandra@bucharest.ai
Alexandra Petrus
Products | Strategy | New Tech | AI
● GOLDILOCKS RULE OF AI
● AI & SOCIETY IN CHINA
● ADVERSE USE OF AI
● DEVELOPING ECONOMIES
Goldilocks rule of AI
Too optimistic
Sentient AI killer robots coming soon
Too pessimistic
AI cannot do everything, so an AI winter is coming
Just right
AI can’t do everything, but will transform industries
AI & Society in China
WHAT’S AN AI-FIRST COMPANY?
Unified data warehouse2
Strategic data acquisition 1
New roles (MLE) & division
of labor
4
Pervasive automation 3
CHINA, AN AI-FIRST NATION?
Unified data warehouse2
STATE OWNED: Strategic
data acquisition
1
New roles & division of
labor at government level
(eg: AI strategy; AI National
Team etc)
4
Pervasive automation 3
Facial recognition in
vast surveillance
systems
Match
criminal
suspects
*DB of 10k
takes 0.1sec
to identify
faces
Image credits: businessinsider.com & Thomas Peter / Reuters
SOCIAL CREDIT SCORES & SYSTEM
● Name & shame jaywalkers out of massive crowds
● Force people to download apps that can access all
photos of their smartphone
● Social credit system to rank citizens based on behaviour
*rewards and punishments
On the left, Jingwang
prompting users to delete
"dangerous content" on their
phone.
On the right, the app's
access.
Jingwang Weishi/Open
Technology Fund
Image credits: businessinsider.com
Image credits: Gilles Sabrie for the New York Times
The debt map is accessed via a mini-program on WeChat. Photo: Weibo
Video credits: businessinsider.com & Xinhua news agency
ADVERSE USE OF AI
● Deep Fakes eg: ppl doing
things they never did
● Undermining of democracy
and privacy with
oppressive surveillance
● Generating fake
comments, content
DEVELOPING ECONOMIES
● Algorithmic governance
● Focus on the strength vertical industry eg: Greece - tourism
● Public - private partnerships to accelerate development
● Invest in education: Keep Learning!
● Leadership matters
DEVELOPING ECONOMIES
Question: Do you agree with a data driven
society?
DEVELOPING ECONOMIES
Question: Could an algorithmic governance be
implemented in Europe?
“If you train a learning algorithm and every single picture you
show it is a picture of a cat, then it thinks every single thing in
the world is a cat, because it’s never seen anything that’s not a
cat before. And I think in a similar way, if you show Executives
a sequence of success stories but no failure stories, then it
creates an impression that AI can do anything, and that’s just
not true.”
Andrew Ng - Google Brain CoFounder, ex-Baidu Chief AI
Scientist, Coursera, Deeplearning.ai

Dystopian AI. Is human-machine coexistence already here?

  • 1.
    Dystopian AI. Is human-machine coexistencealready here? Alexandra Petrus, IWD19 Greece - March, 2019 Photo by Franck V. on Unsplash
  • 2.
  • 3.
    ● GOLDILOCKS RULEOF AI ● AI & SOCIETY IN CHINA ● ADVERSE USE OF AI ● DEVELOPING ECONOMIES
  • 4.
    Goldilocks rule ofAI Too optimistic Sentient AI killer robots coming soon Too pessimistic AI cannot do everything, so an AI winter is coming Just right AI can’t do everything, but will transform industries
  • 5.
    AI & Societyin China
  • 6.
    WHAT’S AN AI-FIRSTCOMPANY? Unified data warehouse2 Strategic data acquisition 1 New roles (MLE) & division of labor 4 Pervasive automation 3
  • 7.
    CHINA, AN AI-FIRSTNATION? Unified data warehouse2 STATE OWNED: Strategic data acquisition 1 New roles & division of labor at government level (eg: AI strategy; AI National Team etc) 4 Pervasive automation 3
  • 8.
    Facial recognition in vastsurveillance systems
  • 9.
    Match criminal suspects *DB of 10k takes0.1sec to identify faces Image credits: businessinsider.com & Thomas Peter / Reuters
  • 10.
    SOCIAL CREDIT SCORES& SYSTEM ● Name & shame jaywalkers out of massive crowds ● Force people to download apps that can access all photos of their smartphone ● Social credit system to rank citizens based on behaviour *rewards and punishments
  • 11.
    On the left,Jingwang prompting users to delete "dangerous content" on their phone. On the right, the app's access. Jingwang Weishi/Open Technology Fund Image credits: businessinsider.com
  • 12.
    Image credits: GillesSabrie for the New York Times
  • 13.
    The debt mapis accessed via a mini-program on WeChat. Photo: Weibo
  • 14.
  • 15.
    ADVERSE USE OFAI ● Deep Fakes eg: ppl doing things they never did ● Undermining of democracy and privacy with oppressive surveillance ● Generating fake comments, content
  • 16.
    DEVELOPING ECONOMIES ● Algorithmicgovernance ● Focus on the strength vertical industry eg: Greece - tourism ● Public - private partnerships to accelerate development ● Invest in education: Keep Learning! ● Leadership matters
  • 17.
    DEVELOPING ECONOMIES Question: Doyou agree with a data driven society?
  • 18.
    DEVELOPING ECONOMIES Question: Couldan algorithmic governance be implemented in Europe?
  • 19.
    “If you traina learning algorithm and every single picture you show it is a picture of a cat, then it thinks every single thing in the world is a cat, because it’s never seen anything that’s not a cat before. And I think in a similar way, if you show Executives a sequence of success stories but no failure stories, then it creates an impression that AI can do anything, and that’s just not true.” Andrew Ng - Google Brain CoFounder, ex-Baidu Chief AI Scientist, Coursera, Deeplearning.ai

Editor's Notes

  • #5  The Goldilocks principle is named by analogy to the children's story The Three Bears, in which a little girl named Goldilocks tastes three different bowls of porridge and finds that she prefers porridge that is neither too hot nor too cold, but has just the right temperature. Since then it’s applied to a wide range of disciplines. We need a Goldilocks Rule for AI: - Too optimistic: Deep learning gives us a clear path to AGI! - Too pessimistic: DL has limitations, thus here's the AI winter! - Just right: DL can’t do everything, but will improve countless lives & create massive economic growth.
  • #7 Internet-first companies had 3 main things in common: A/B testing; short iteration time and decision making being pushed down to engineers and PMs or other roles.
  • #8 Tech companies are required to share data w/ gov upon request. In 16 cities across China there are facial recognition projects running w/ 99.8% accuracy.
  • #9 *tracking 1.4B citizens & building predictive software to aggregate data about people - w/o their knowledge - and flag those they consider threatening. People in the country are split over how they feel about this modern surveillance state. While some have pointed out the violation of consumers' and citizens' rights, others say they feel safe because of the government's "Big Brother"-esque surveillance.
  • #10 actor wears facial recognition eyewear in a promotional video by LLVision Technology, the Chinese tech company that developed the glasses. Thomas Peter/Reuters
  • #11 *tracking 1.4B citizens
  • #12 *tracking 1.4B citizens
  • #13 *tracking 1.4B citizens
  • #14 Radius of 500m. Debtors’ kids cannot go to private schools. Straight out of dystopian movies? "The goal is algorithmic governance."
  • #15 China is reversing the commonly held vision of technology as a great democratizer, bringing people more freedom and connecting them to the world. In China, it has brought control.
  • #16 & you also have the Adversarial attacks (someone sets deliberately to fool your system)
  • #17 every nation hence has an opportunity to figure out how it can effectively use AI to help its citizens. Our lifelong model of limited learning periods doesn’t seem to be suitable to our modern context in a rapidly changing world.
  • #18 Are we letting slip side impacts that will change our life control & ownership as is?
  • #19 SFO could become the 1st us city to ban its agencies from using facial recognition tech (as of feb 2019) Arguments: Bias potential & identifying ppl of diff skin tones. Texas & Illinois req anyone recording biometric data to give ppl notice & obtain their consent. Europe has GDPR. Microsoft’s CEO warned this year at Davos that the use of facial recog tech could become ‘a race to the bottom’ w/o government oversight. Just because we can it doesn’t mean we should it.