0
Let	  your	  data	  free	     Empowering	  others	  to	  use	  the	  data	  you	  store	  
Big	  Data	  and	  Data	  Visualiza5on	  as	  seen	  at	  Google,	  Facebook,	  Ne=lix,	              Yahoo	  and	  TwiCer...
My	  big	  data	  journey	               Happy	  New	  Year!	  
Why	  Big	  Data?	  •  Spi<ng	  out	  a	  log	  that	  my	  monkey	  ate	  a	     banana	  is	  interes@ng	  •  Charts	  a...
Data	  stored	  on	  your	  iPhone	  
We	  live	  in	  the	  age	  of	  data	  
Your	  next	  job	  will	  depend	  on	  data	  
Your	  life	  will	  depend	  on	  data	  
Big	  Data	  	  Data	  Mining	       Analy5cs	  Visualiza5on	  
Anyone	  using	  Big	  Data?	  
Google	  Big	  Data	  
Big	  Data	  Machine	  Learning	  •  Machine	  learning	  is	  about	  finding	  paJerns	  in	     the	  data	  •  Machine	...
TwiCer	  Big	  Data	  
"Data	  visualiza@on	  is	  the	  last	  mile	  between	  computers	  and	  our	  brains."	                   —@Edd	      ...
Ne=lix	  Big	  Data	  
Facebook	  Big	  Data	  
My	  toolbox	  •    Data	  manipula@on:	  iPython,	  Vim	  •    Visualiza@ons:	  Gephi,	  Tableau	  •    Sta@s@cal	  Toolk...
I	  dream	  of	  this	  
What	  does	  this	  mean?	  •    Student	  #1,192,187	      •    Student	  #11,192,173	  •    Student	  #2,160,143	      ...
Learning	  about	  Visualizing	  Data	  
Uses	  of	  Big	  Data	  in	  EDU	  •  When	  online	  learning	  systems	  use	  data	  to	     change	  in	  response	  ...
But	  we	  work	  for	  a	  school!	  
Anyone	  BI?	  
Educa@onal	  data	  mining	  (EDM)	  	  •  EDM	  are	  methods	  in	  sta@s@cs,	  machine	     learning,	  and	  data	  mi...
Learning	  analy@cs	  •  Learning	  analy@cs	  applies	  sociology,	     psychology,	  sta@s@cs,	  computer	  science	    ...
What	  is	  big	  data?	  
Hadoop•  Open-source framework for running applications on large   clusters built of commodity hardware•  Distributed stor...
Yahoo	  
Learning	  about	  Data	  Mining	  
What	  is	  data	  mining?	  Its	  all	  about	  discovery:	  •  Grouping	  similar	  data	  •  Iden@fying	  interes@ng/un...
Examples	  of	  Machine	  Learning	  •    SPAM	  detec@on	  •    Handwri@ng	  •    Google	  Streetview	  •    Speech	  rec...
Reasons	  for	  Analy@cs	  •    Predict	  the	  future	  •    Understand	  Risk	  and	  Complexity	  •    Embrace	  comple...
Visualiza5ons	  
Dashboards	  
Big	  Data	  and	  You	  
Example	  Big	  Data	  Use	  Cases	                Data	                        High-­‐frequency	                   Lower-...
The	  best	  examples	  
Example	  machine	  learning	  
Examples	  in	  the	  news	  
What	  is	  a	  data	  scien@st?	  •  Person	  who	  understands	  data-­‐driven	  world	  •  Person	  who	  can	  make	  ...
Big	  data,	  Analy5cs	  and	  Visualiza5on	  
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Big databigideasit4bc
Upcoming SlideShare
Loading in...5
×

Big databigideasit4bc

111

Published on

Presentation IT4BC 2012

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
111
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
4
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Transcript of "Big databigideasit4bc"

  1. 1. Let  your  data  free   Empowering  others  to  use  the  data  you  store  
  2. 2. Big  Data  and  Data  Visualiza5on  as  seen  at  Google,  Facebook,  Ne=lix,   Yahoo  and  TwiCer.     The  future  of  Educa5onal   Technologies  is  here  
  3. 3. My  big  data  journey   Happy  New  Year!  
  4. 4. Why  Big  Data?  •  Spi<ng  out  a  log  that  my  monkey  ate  a   banana  is  interes@ng  •  Charts  and  plots  of  it,  cool  •  But  tell  me  why?  And  predict  the  next?   Supercool  
  5. 5. Data  stored  on  your  iPhone  
  6. 6. We  live  in  the  age  of  data  
  7. 7. Your  next  job  will  depend  on  data  
  8. 8. Your  life  will  depend  on  data  
  9. 9. Big  Data    Data  Mining   Analy5cs  Visualiza5on  
  10. 10. Anyone  using  Big  Data?  
  11. 11. Google  Big  Data  
  12. 12. Big  Data  Machine  Learning  •  Machine  learning  is  about  finding  paJerns  in   the  data  •  Machine  learning  is  about  finding  meaningful   informa@on  
  13. 13. TwiCer  Big  Data  
  14. 14. "Data  visualiza@on  is  the  last  mile  between  computers  and  our  brains."   —@Edd    
  15. 15. Ne=lix  Big  Data  
  16. 16. Facebook  Big  Data  
  17. 17. My  toolbox  •  Data  manipula@on:  iPython,  Vim  •  Visualiza@ons:  Gephi,  Tableau  •  Sta@s@cal  Toolkit:  R  Studio  •  Version  Control:  git  
  18. 18. I  dream  of  this  
  19. 19. What  does  this  mean?  •  Student  #1,192,187   •  Student  #11,192,173  •  Student  #2,160,143   •  Student  #12,164,151  •  Student  #3,183,180   •  Student  #13,184,165  •  Student  #4,136,100   •  Student  #14,189,184  •  Student  #5,162,180   •  Student  #15,183,170  •  Student  #6,165,159   •  Student  #16,181,176  •  Student  #7,181,162   •  Student  #17,188,163  •  Student  #8,188,   •  Student  #18,191,185  •  Student  #9,150,146   •  Student  #19,190,175  •  Student  #10,163,159   •  Student  #20,184,171  
  20. 20. Learning  about  Visualizing  Data  
  21. 21. Uses  of  Big  Data  in  EDU  •  When  online  learning  systems  use  data  to   change  in  response  to  student  performance,   they  become  adap$ve  learning  environments  
  22. 22. But  we  work  for  a  school!  
  23. 23. Anyone  BI?  
  24. 24. Educa@onal  data  mining  (EDM)    •  EDM  are  methods  in  sta@s@cs,  machine   learning,  and  data  mining  to  analyze  data  •  Data  that  is  collected  during  teaching  and   learning  
  25. 25. Learning  analy@cs  •  Learning  analy@cs  applies  sociology,   psychology,  sta@s@cs,  computer  science   concepts  to  data  •  Learning  analy@cs  creates  applica@ons  that   directly  influence  educa@onal  prac@ce  
  26. 26. What  is  big  data?  
  27. 27. Hadoop•  Open-source framework for running applications on large clusters built of commodity hardware•  Distributed storage and OS•  Way bigger than traditional databases•  Petabytes vs gigabytes 82
  28. 28. Yahoo  
  29. 29. Learning  about  Data  Mining  
  30. 30. What  is  data  mining?  Its  all  about  discovery:  •  Grouping  similar  data  •  Iden@fying  interes@ng/unique  data  •  Detec@ng  rela@onships  •  Discovering  previously  unknown  paJerns  
  31. 31. Examples  of  Machine  Learning  •  SPAM  detec@on  •  Handwri@ng  •  Google  Streetview  •  Speech  recogni@on  •  Neilix  recommenda@on  •  Robo@c  naviga@on  
  32. 32. Reasons  for  Analy@cs  •  Predict  the  future  •  Understand  Risk  and  Complexity  •  Embrace  complexity  •  Iden@fy  the  unusual  •  Think  beJer  
  33. 33. Visualiza5ons  
  34. 34. Dashboards  
  35. 35. Big  Data  and  You  
  36. 36. Example  Big  Data  Use  Cases   Data   High-­‐frequency   Lower-­‐frequency   Source   opera@ons   opera@ons   Write/index  all  trades,   Show  consolidated  risk   Capital  markets   store  @ck  data   across  traders   Call  ini@a@on  request   Real-­‐@me  authoriza@on   Fraud  detec@on/analysis   Inbound  HTTP   Visitor  logging,  analysis,   Traffic  paJern  analy@cs   requests   aler@ng   Rank  scores:   Online  game   • Defined  intervals   Leaderboard  lookups   • Player  “bests”   Real-­‐@me  ad  trading   Match  form  factor,   Report  ad  performance   systems   placement  criteria,  bid/ask   from  exhaust  stream   Mobile  device   Loca@on  updates,  QoS,   Analy@cs  on  transac@ons   loca@on  sensor   transac@ons  
  37. 37. The  best  examples  
  38. 38. Example  machine  learning  
  39. 39. Examples  in  the  news  
  40. 40. What  is  a  data  scien@st?  •  Person  who  understands  data-­‐driven  world  •  Person  who  can  make  sense  of  big  data  •  Person  who  has  tools,  skills  and  mindset  to   see  data  as  the  new  "oil"  fueling  a  company  •  Person  who  programs  •  Person  who  analyses  data  •  Person  who  visualizes  data    
  41. 41. Big  data,  Analy5cs  and  Visualiza5on  
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×