This document discusses big data, data visualization, and analytics. It provides examples of how companies like Google, Facebook, Netflix, and Twitter use big data and data visualization. It also discusses data mining, machine learning, educational technologies, and how data science can be used in education. Tools mentioned include Hadoop, R Studio, and Tableau. Overall, the document aims to introduce concepts around big data and how data is being used across different industries.

1. Let
your
data
free
Empowering
others
to
use
the
data
you
store

2. Big
Data
and
Data
Visualiza5on
as
seen
at
Google,
Facebook,
Ne=lix,
Yahoo
and
TwiCer.
The
future
of
Educa5onal
Technologies
is
here

8. My
big
data
journey
Happy
New
Year!

9. Why
Big
Data?
• Spi<ng
out
a
log
that
my
monkey
ate
a
banana
is
interes@ng
• Charts
and
plots
of
it,
cool
• But
tell
me
why?
And
predict
the
next?
Supercool

20. Data
stored
on
your
iPhone

22. We
live
in
the
age
of
data

23. Your
next
job
will
depend
on
data

24. Your
life
will
depend
on
data

26. Big
Data
Data
Mining
Analy5cs
Visualiza5on

27. Anyone
using
Big
Data?

29. Google
Big
Data

31. Big
Data
Machine
Learning
• Machine
learning
is
about
finding
paJerns
in
the
data
• Machine
learning
is
about
finding
meaningful
informa@on

33. TwiCer
Big
Data

35. "Data
visualiza@on
is
the
last
mile
between
computers
and
our
brains."
—@Edd

38. Ne=lix
Big
Data

43. Facebook
Big
Data

51. My
toolbox
• Data
manipula@on:
iPython,
Vim
• Visualiza@ons:
Gephi,
Tableau
• Sta@s@cal
Toolkit:
R
Studio
• Version
Control:
git

58. I
dream
of
this

63. What
does
this
mean?
• Student
#1,192,187
• Student
#11,192,173
• Student
#2,160,143
• Student
#12,164,151
• Student
#3,183,180
• Student
#13,184,165
• Student
#4,136,100
• Student
#14,189,184
• Student
#5,162,180
• Student
#15,183,170
• Student
#6,165,159
• Student
#16,181,176
• Student
#7,181,162
• Student
#17,188,163
• Student
#8,188,
• Student
#18,191,185
• Student
#9,150,146
• Student
#19,190,175
• Student
#10,163,159
• Student
#20,184,171

64. Learning
about
Visualizing
Data

67. Uses
of
Big
Data
in
EDU
• When
online
learning
systems
use
data
to
change
in
response
to
student
performance,
they
become
adap$ve
learning
environments

68. But
we
work
for
a
school!

72. Anyone
BI?

73. Educa@onal
data
mining
(EDM)
• EDM
are
methods
in
sta@s@cs,
machine
learning,
and
data
mining
to
analyze
data
• Data
that
is
collected
during
teaching
and
learning

76. Learning
analy@cs
• Learning
analy@cs
applies
sociology,
psychology,
sta@s@cs,
computer
science
concepts
to
data
• Learning
analy@cs
creates
applica@ons
that
directly
influence
educa@onal
prac@ce

79. What
is
big
data?

82. Hadoop
• Open-source framework for running applications on large
clusters built of commodity hardware
• Distributed storage and OS
• Way bigger than traditional databases
• Petabytes vs gigabytes
82

88. Yahoo

94. Learning
about
Data
Mining

96. What
is
data
mining?
It's
all
about
discovery:
• Grouping
similar
data
• Iden@fying
interes@ng/unique
data
• Detec@ng
rela@onships
• Discovering
previously
unknown
paJerns

97. Examples
of
Machine
Learning
• SPAM
detec@on
• Handwri@ng
• Google
Streetview
• Speech
recogni@on
• Neilix
recommenda@on
• Robo@c
naviga@on

98. Reasons
for
Analy@cs
• Predict
the
future
• Understand
Risk
and
Complexity
• Embrace
complexity
• Iden@fy
the
unusual
• Think
beJer

100. Visualiza5ons

120. Dashboards

122. Big
Data
and
You

130. Example
Big
Data
Use
Cases
Data
High-­‐frequency
Lower-­‐frequency
Source
opera@ons
opera@ons
Write/index
all
trades,
Show
consolidated
risk
Capital
markets
store
@ck
data
across
traders
Call
ini@a@on
request
Real-­‐@me
authoriza@on
Fraud
detec@on/analysis
Inbound
HTTP
Visitor
logging,
analysis,
Traffic
paJern
analy@cs
requests
aler@ng
Rank
scores:
Online
game
• Defined
intervals
Leaderboard
lookups
• Player
“bests”
Real-­‐@me
ad
trading
Match
form
factor,
Report
ad
performance
systems
placement
criteria,
bid/ask
from
exhaust
stream
Mobile
device
Loca@on
updates,
QoS,
Analy@cs
on
transac@ons
loca@on
sensor
transac@ons

132. The
best
examples

139. Example
machine
learning

142. Examples
in
the
news

146. What
is
a
data
scien@st?
• Person
who
understands
data-­‐driven
world
• Person
who
can
make
sense
of
big
data
• Person
who
has
tools,
skills
and
mindset
to
see
data
as
the
new
"oil"
fueling
a
company
• Person
who
programs
• Person
who
analyses
data
• Person
who
visualizes
data

150. Big
data,
Analy5cs
and
Visualiza5on