La (ir)ragionevole efficacia dei dati

Terlizzi, 9 Marzo 2016
La (ir)ragionevole efﬁcacia dei dati
Cataldo Musto
09.03.2016

Who I am
2Cataldo Musto - La (ir)ragionevole efﬁcacia dei dati - FuoriCorso@Melkweg (Terlizzi) - 9 Marzo 2016

Who I am

Inspired by
(2009 !)

Knowledge Pyramid

Knowledge Pyramid
X

Knowledge Pyramid
the problem
X Big Data!

Moore’s Law

Moore’s Law (for data)

Moore’s Law (for data)
(Hint)

What is “Big Data” ?
One minute on the Web

One year

16
can be considered as novel data silos
Web and Social Media
Cataldo Musto - La (ir)ragionevole efﬁcacia dei dati - FuoriCorso@Melkweg (Terlizzi) - 9 Marzo 2016

17
information about preferences

18
information about connections

19
information about people feelings

20
Big Players have knowledge
(Francis Bacon, around 1600)
Scientia
Potentia Est
…and knowledge is power!

21
Web and Social Networks
changed the way people produce information.

22
changed the way people acquire information.

23

24
Dunbar’s Number
Average number of active connection during the life: 150
How many Facebook friends you have?

25
Dunbar’s Number
“Six Degrees Separation” Theory

26
Dunbar’s Number
“Six Degrees Separation” Theory
On Facebook: 4.74 (in 2011)

Not only Social Media!

Obstacleor
Opportunity?
Question
Big Data
Cataldo Musto - La (ir)ragionevole efﬁcacia dei dati - FuoriCorso@Melkweg (Terlizzi) - 9 Marzo 2016 28

Big Data as Obstacle
“Big” does not always mean better!

(Source: Adrian C.Ott,The 24-hour customer)
we can handle 126bits of
information/day
we deal with 393bits of
information/day
ratio: more than 3x
Big Data as Obstacle

67% of the people checks the
phone even if no alert was received
29% of the people says: “I can’t
imagine living without my phone”(2012)

Information Overload
… in digital life

… in real life

Paradox of Choice (Barry Schwartz)

37
Big Data as Opportunity

38
Key Concept: Information Asymmetry
“Information asymmetry deals with the study of decisions in
transactions where one party has more or better information
than the other. This creates an imbalance of power in
transactions”
J.Stiglitz
Nobel Prize 2001

“A team of scientists, engineers and technicians from Google, all volunteers, is
cooperating with UNICEF to cross all this data to other elements, ranging from
weather conditions to travel ﬂows, and as a result identify and view any new
outbreaks.”
Key Concept: Information Asymmetry

preventing crimes in London
signiﬁcant reductions in thefts (-33%), violent crime (-21%)
and violations of private property (-12%).

Mapping Data
for common good
(Not a new idea) Map of cholera in London, 1854
red = cholera cases
blue = water

To aggregate rough people-based data in order to
analyze complex phenomena.

Use Case: Italian Hate Maps
44

Violence against women Disability
Racism Anti-semitism
45

Given the maps and given the output of the linguistic
analysis of intolerant Tweets (co-occurrences between terms,
time lapse, etc.), the psychologists team deﬁned some
guidelines to tackle and prevent intolerant behaviors.
These guidelines have been freely distributed to public
administration on early 2015.
46

Use Case: Smart Cities
Urban Informatics
47

Use Case: Smart Cities
Smart Parking
Smart lighting
Trafﬁc Congestion
Smart Buildings
Applications
(Amsterdam)
48

Big Data can be used
to automatically learn the
semantics of textual content
Use Case: Semantics

?
“I love turkey. It’s my choice for these holidays!
Use Case: Semantics
Computers cannot understand the real meaning of terms!

51
Distributional Semantics
“meaning
is its use”
L.Wittgenstein
(Austrian philosopher)
Use Case: Semantics

52
Example
Use Case: Semantics
What is Serengeti?
Pass me a Serengeti!
I like Serengeti
Football and Serengeti, what a perfect Saturday!

53
Example
Use Case: Semantics
What is Peroni?
Pass me a Peroni!
I like Peroni
Football and Peroni, what a perfect Saturday!

54
Example
Use Case: Semantics
Pass me a Peroni!
I like Peroni
Football and Peroni, what a perfect Saturday!

55
Example
Use Case: Semantics
What is Serengeti?
I like Serengeti

56
Example
Use Case: Semantics
A famous beer from Tanzania
I like Serengeti

by analyzing large corpora of
textual data it is possible to
infer information about the
usage (about the meaning) of
the terms
Insight
similar meaning
co-occurrence co-occurrence
co-occurrence co-occurrence
(*) Firth, J.R.A synopsis of linguistic theory
1930-1955. In Studies in Linguistic Analysis, pp.
1-32, 1957.
57
Distributional Semantics
Use Case: Semantics

58
Use Case: Artiﬁcial Intelligence
“Artiﬁcial Intelligence is the ability of a computer to perform functions and
typical reasoning of the human mind.”

(Very basic) application - Face Recognition

(Basic) application - Statistical Machine Translation

(Very challenging) application - Google Self-Driving Car

62
Common Problem: training is very difﬁcult

63
Thanks to Big Data, AI algorithms can learn!
?Faces
Dog

64
Overall sentiment: :-(
Use Case: Brand Analysis

65
Use Case: Brand Analysis

Use Case: Recommender Systems

“People who bought…”
on Amazon
“Discover”
on Spotify

Success Stories: Netﬂix
72

Success Stories: Netﬂix
73

The Dark Side of Big Data
75

What about the privacy?
76

Smart Cities-related privacy issues
77

The “Target” case

79

80

Some Stories - The Filter Bubble
Eli Parisier
“How the New Personalized Web Is Changing
What We Read and How We Think” (TED Talk)
81

Some Stories - The Filter Bubble
Who controls the gatekeepers?
82

Some Stories - Facebook Emotional Contagion
83

Some Stories - Facebook Emotional Contagion
84

Ethical Issues
How to balance the right to
privacy with public access to information?
85

Ethical Issues
What is the role of government in Big Data revolution?
e.g. How to deal with workers losing their jobs?
86

Theory of control - NSA
87

Theory of control
Project of a prison, designed by Jeremy Bentham in 1871
Internet like a Panopticon?
88

Take-Home Messages
Big data are wonderful and terrible. At the same time.

Take-Home Messages
Luddites is not the solution.

Take-Home Messages
Luddites is not the solution.
Control and Awareness, it is.

Cataldo Musto, PhD
cataldo.musto@uniba.it
@cataldomusto
http://www.di.uniba.it/~swap
Grazie!

La (ir)ragionevole efficacia dei dati

Recommended

Recommended

More Related Content

Viewers also liked

Viewers also liked (10)

Similar to La (ir)ragionevole efficacia dei dati

Similar to La (ir)ragionevole efficacia dei dati (6)

More from Cataldo Musto

More from Cataldo Musto (20)

La (ir)ragionevole efficacia dei dati