Big databigideasit4bc
Upcoming SlideShare
Loading in...5
×
 

Big databigideasit4bc

on

  • 251 views

Presentation IT4BC 2012

Presentation IT4BC 2012

Statistics

Views

Total Views
251
Views on SlideShare
244
Embed Views
7

Actions

Likes
0
Downloads
3
Comments
0

1 Embed 7

http://www.linkedin.com 7

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

Big databigideasit4bc Big databigideasit4bc Presentation Transcript

  • Let  your  data  free   Empowering  others  to  use  the  data  you  store  
  • Big  Data  and  Data  Visualiza5on  as  seen  at  Google,  Facebook,  Ne=lix,   Yahoo  and  TwiCer.     The  future  of  Educa5onal   Technologies  is  here  
  • My  big  data  journey   Happy  New  Year!  
  • Why  Big  Data?  •  Spi<ng  out  a  log  that  my  monkey  ate  a   banana  is  interes@ng  •  Charts  and  plots  of  it,  cool  •  But  tell  me  why?  And  predict  the  next?   Supercool  
  • Data  stored  on  your  iPhone  
  • We  live  in  the  age  of  data  
  • Your  next  job  will  depend  on  data  
  • Your  life  will  depend  on  data  
  • Big  Data    Data  Mining   Analy5cs  Visualiza5on  
  • Anyone  using  Big  Data?  
  • Google  Big  Data  
  • Big  Data  Machine  Learning  •  Machine  learning  is  about  finding  paJerns  in   the  data  •  Machine  learning  is  about  finding  meaningful   informa@on  
  • TwiCer  Big  Data  
  • "Data  visualiza@on  is  the  last  mile  between  computers  and  our  brains."   —@Edd    
  • Ne=lix  Big  Data  
  • Facebook  Big  Data  
  • My  toolbox  •  Data  manipula@on:  iPython,  Vim  •  Visualiza@ons:  Gephi,  Tableau  •  Sta@s@cal  Toolkit:  R  Studio  •  Version  Control:  git  
  • I  dream  of  this  
  • What  does  this  mean?  •  Student  #1,192,187   •  Student  #11,192,173  •  Student  #2,160,143   •  Student  #12,164,151  •  Student  #3,183,180   •  Student  #13,184,165  •  Student  #4,136,100   •  Student  #14,189,184  •  Student  #5,162,180   •  Student  #15,183,170  •  Student  #6,165,159   •  Student  #16,181,176  •  Student  #7,181,162   •  Student  #17,188,163  •  Student  #8,188,   •  Student  #18,191,185  •  Student  #9,150,146   •  Student  #19,190,175  •  Student  #10,163,159   •  Student  #20,184,171  
  • Learning  about  Visualizing  Data  
  • Uses  of  Big  Data  in  EDU  •  When  online  learning  systems  use  data  to   change  in  response  to  student  performance,   they  become  adap$ve  learning  environments  
  • But  we  work  for  a  school!  
  • Anyone  BI?  
  • Educa@onal  data  mining  (EDM)    •  EDM  are  methods  in  sta@s@cs,  machine   learning,  and  data  mining  to  analyze  data  •  Data  that  is  collected  during  teaching  and   learning  
  • Learning  analy@cs  •  Learning  analy@cs  applies  sociology,   psychology,  sta@s@cs,  computer  science   concepts  to  data  •  Learning  analy@cs  creates  applica@ons  that   directly  influence  educa@onal  prac@ce  
  • What  is  big  data?  
  • Hadoop•  Open-source framework for running applications on large clusters built of commodity hardware•  Distributed storage and OS•  Way bigger than traditional databases•  Petabytes vs gigabytes 82
  • Yahoo  
  • Learning  about  Data  Mining  
  • What  is  data  mining?  Its  all  about  discovery:  •  Grouping  similar  data  •  Iden@fying  interes@ng/unique  data  •  Detec@ng  rela@onships  •  Discovering  previously  unknown  paJerns  
  • Examples  of  Machine  Learning  •  SPAM  detec@on  •  Handwri@ng  •  Google  Streetview  •  Speech  recogni@on  •  Neilix  recommenda@on  •  Robo@c  naviga@on  
  • Reasons  for  Analy@cs  •  Predict  the  future  •  Understand  Risk  and  Complexity  •  Embrace  complexity  •  Iden@fy  the  unusual  •  Think  beJer  
  • Visualiza5ons  
  • Dashboards  
  • Big  Data  and  You  
  • Example  Big  Data  Use  Cases   Data   High-­‐frequency   Lower-­‐frequency   Source   opera@ons   opera@ons   Write/index  all  trades,   Show  consolidated  risk   Capital  markets   store  @ck  data   across  traders   Call  ini@a@on  request   Real-­‐@me  authoriza@on   Fraud  detec@on/analysis   Inbound  HTTP   Visitor  logging,  analysis,   Traffic  paJern  analy@cs   requests   aler@ng   Rank  scores:   Online  game   • Defined  intervals   Leaderboard  lookups   • Player  “bests”   Real-­‐@me  ad  trading   Match  form  factor,   Report  ad  performance   systems   placement  criteria,  bid/ask   from  exhaust  stream   Mobile  device   Loca@on  updates,  QoS,   Analy@cs  on  transac@ons   loca@on  sensor   transac@ons  
  • The  best  examples  
  • Example  machine  learning  
  • Examples  in  the  news  
  • What  is  a  data  scien@st?  •  Person  who  understands  data-­‐driven  world  •  Person  who  can  make  sense  of  big  data  •  Person  who  has  tools,  skills  and  mindset  to   see  data  as  the  new  "oil"  fueling  a  company  •  Person  who  programs  •  Person  who  analyses  data  •  Person  who  visualizes  data    
  • Big  data,  Analy5cs  and  Visualiza5on