Big databigideasit4bc
Upcoming SlideShare
Loading in...5
×
 

Big databigideasit4bc

on

  • 244 views

Presentation IT4BC 2012

Presentation IT4BC 2012

Statistics

Views

Total Views
244
Slideshare-icon Views on SlideShare
237
Embed Views
7

Actions

Likes
0
Downloads
3
Comments
0

1 Embed 7

http://www.linkedin.com 7

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    Big databigideasit4bc Big databigideasit4bc Presentation Transcript

    • Let  your  data  free   Empowering  others  to  use  the  data  you  store  
    • Big  Data  and  Data  Visualiza5on  as  seen  at  Google,  Facebook,  Ne=lix,   Yahoo  and  TwiCer.     The  future  of  Educa5onal   Technologies  is  here  
    • My  big  data  journey   Happy  New  Year!  
    • Why  Big  Data?  •  Spi<ng  out  a  log  that  my  monkey  ate  a   banana  is  interes@ng  •  Charts  and  plots  of  it,  cool  •  But  tell  me  why?  And  predict  the  next?   Supercool  
    • Data  stored  on  your  iPhone  
    • We  live  in  the  age  of  data  
    • Your  next  job  will  depend  on  data  
    • Your  life  will  depend  on  data  
    • Big  Data    Data  Mining   Analy5cs  Visualiza5on  
    • Anyone  using  Big  Data?  
    • Google  Big  Data  
    • Big  Data  Machine  Learning  •  Machine  learning  is  about  finding  paJerns  in   the  data  •  Machine  learning  is  about  finding  meaningful   informa@on  
    • TwiCer  Big  Data  
    • "Data  visualiza@on  is  the  last  mile  between  computers  and  our  brains."   —@Edd    
    • Ne=lix  Big  Data  
    • Facebook  Big  Data  
    • My  toolbox  •  Data  manipula@on:  iPython,  Vim  •  Visualiza@ons:  Gephi,  Tableau  •  Sta@s@cal  Toolkit:  R  Studio  •  Version  Control:  git  
    • I  dream  of  this  
    • What  does  this  mean?  •  Student  #1,192,187   •  Student  #11,192,173  •  Student  #2,160,143   •  Student  #12,164,151  •  Student  #3,183,180   •  Student  #13,184,165  •  Student  #4,136,100   •  Student  #14,189,184  •  Student  #5,162,180   •  Student  #15,183,170  •  Student  #6,165,159   •  Student  #16,181,176  •  Student  #7,181,162   •  Student  #17,188,163  •  Student  #8,188,   •  Student  #18,191,185  •  Student  #9,150,146   •  Student  #19,190,175  •  Student  #10,163,159   •  Student  #20,184,171  
    • Learning  about  Visualizing  Data  
    • Uses  of  Big  Data  in  EDU  •  When  online  learning  systems  use  data  to   change  in  response  to  student  performance,   they  become  adap$ve  learning  environments  
    • But  we  work  for  a  school!  
    • Anyone  BI?  
    • Educa@onal  data  mining  (EDM)    •  EDM  are  methods  in  sta@s@cs,  machine   learning,  and  data  mining  to  analyze  data  •  Data  that  is  collected  during  teaching  and   learning  
    • Learning  analy@cs  •  Learning  analy@cs  applies  sociology,   psychology,  sta@s@cs,  computer  science   concepts  to  data  •  Learning  analy@cs  creates  applica@ons  that   directly  influence  educa@onal  prac@ce  
    • What  is  big  data?  
    • Hadoop•  Open-source framework for running applications on large clusters built of commodity hardware•  Distributed storage and OS•  Way bigger than traditional databases•  Petabytes vs gigabytes 82
    • Yahoo  
    • Learning  about  Data  Mining  
    • What  is  data  mining?  Its  all  about  discovery:  •  Grouping  similar  data  •  Iden@fying  interes@ng/unique  data  •  Detec@ng  rela@onships  •  Discovering  previously  unknown  paJerns  
    • Examples  of  Machine  Learning  •  SPAM  detec@on  •  Handwri@ng  •  Google  Streetview  •  Speech  recogni@on  •  Neilix  recommenda@on  •  Robo@c  naviga@on  
    • Reasons  for  Analy@cs  •  Predict  the  future  •  Understand  Risk  and  Complexity  •  Embrace  complexity  •  Iden@fy  the  unusual  •  Think  beJer  
    • Visualiza5ons  
    • Dashboards  
    • Big  Data  and  You  
    • Example  Big  Data  Use  Cases   Data   High-­‐frequency   Lower-­‐frequency   Source   opera@ons   opera@ons   Write/index  all  trades,   Show  consolidated  risk   Capital  markets   store  @ck  data   across  traders   Call  ini@a@on  request   Real-­‐@me  authoriza@on   Fraud  detec@on/analysis   Inbound  HTTP   Visitor  logging,  analysis,   Traffic  paJern  analy@cs   requests   aler@ng   Rank  scores:   Online  game   • Defined  intervals   Leaderboard  lookups   • Player  “bests”   Real-­‐@me  ad  trading   Match  form  factor,   Report  ad  performance   systems   placement  criteria,  bid/ask   from  exhaust  stream   Mobile  device   Loca@on  updates,  QoS,   Analy@cs  on  transac@ons   loca@on  sensor   transac@ons  
    • The  best  examples  
    • Example  machine  learning  
    • Examples  in  the  news  
    • What  is  a  data  scien@st?  •  Person  who  understands  data-­‐driven  world  •  Person  who  can  make  sense  of  big  data  •  Person  who  has  tools,  skills  and  mindset  to   see  data  as  the  new  "oil"  fueling  a  company  •  Person  who  programs  •  Person  who  analyses  data  •  Person  who  visualizes  data    
    • Big  data,  Analy5cs  and  Visualiza5on