Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013
Upcoming SlideShare
Loading in...5
×
 

Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013

on

  • 175 views

The power of visualizing time-series data derived from remote sensing products can not be overestimated. Visualization can give scientists, policy makers, journalists and others immediate insights ...

The power of visualizing time-series data derived from remote sensing products can not be overestimated. Visualization can give scientists, policy makers, journalists and others immediate insights into how the landscape and environment is changing over time and can lead to quicker understanding and action.

Statistics

Views

Total Views
175
Views on SlideShare
175
Embed Views
0

Actions

Likes
0
Downloads
2
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013 Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013 Presentation Transcript

  • Big data meets scalable visualizations JAVIER DE LA TORRE
  • Big data meets scalable visualizations Javier de la Torre - @jatorre 2
  • Big data awesomeness!!!! picture  on  big  data  awesomeness 3
  • 4
  • 5
  • 6
  • Big data without data visualization = #fail
  • Maps are the most popular type of data visualization Everything happens somewhere ! Where are your clients? IP=location ! So everything can be analyzed and visualized on maps
  • Ugly map! Everybody wants to see data on maps, But making good maps is very hard!
  • Making maps is hard because… Tools are not there yet. They are for GIS experts ! Handling 100 points is easy, 1Million is hard ! Data chages! Is not about printing maps online!
  • Demo  on  meteorites 11
  • Wall Street Journal US election maps
  • Big data analysis and reporting tool - UNEP Carbon calculator
  • Narrative maps / Story telling - The Hobbit filming Locations map
  • Narrative maps / Story telling - The Rolling Stones tour maps
  • German elections real time maps
  • Visualizing NYC Open Data
  • Animated geotemporal maps. Everything happens somewhere and at some time. Navy of WWI map
  • Visual analysis - Economic impact of the Mobile World Congress 2012 in Barcelona
  • All meteorites fallen on earth
  • Animated city traffic maps
  • Mobile ready.
  • 23
  • Big data analysis of deforestation How we can track deforestation on real time Global Forest Watch
  • http://en.wikipedia.org/wiki/Bakun_Dam
  • Most people don’t need Big Data technologies You just need to start collecting and analyzing data. Don’t focus on technology, probably your database can already do it ! You are not Facebook, don’t be cheat But when you can’t…. when it really explodes…
  • Connect PostgreSQL to almost anything Foreign Data wrappers Oracle Hadoop MySQL MongoDB CouchDB Redis …. Twitter Email S3
  • CartoDB Hadoop HBase 49
  • CartoDB and Torque Geo-temporal visualizations
  • WITH%hgrid% %%%%%AS%(SELECT%Cdb_rectanglegrid(Cdb_xyz_extent(8,%12,%5),% %%%%%%%%%%%%%%%%Cdb_xyz_resolution(5)%*%4,% %%%%%%%%%%%%%%%%%%%%%%%%%%%Cdb_xyz_resolution(5)%*%4)%AS%cell)% SELECT%x,% %%%%%%%y,% %%%%%%%Array_agg(c)%vals,% %%%%%%%Array_agg(d)%dates% FROM%%%(SELECT%St_xmax(hgrid.cell)%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%x,% %%%%%%%%%%%%%%%St_ymax(hgrid.cell)%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%y,% %%%%%%%%%%%%%%%Count(i.cartodb_id)%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%c,% %%%%%%%%%%%%%%%Floor((%Date_part('epoch',%built)%Q%Q10418716800%)%/%32837875)%d% %%%%%%%%FROM%%%hgrid,% %%%%%%%%%%%%%%%us_po_offices%i% %%%%%%%%WHERE%%St_intersects(i.the_geom_webmercator,%hgrid.cell)% %%%%%%%%GROUP%%BY%hgrid.cell,% %%%%%%%%%%%%%%%%%%Floor((%Date_part('epoch',%built)%Q%Q10418716800%)%/%32837875)% %%%%%%%)%f% GROUP%%BY%x,% %%%%%%%%%%y
  • { %%rows:%[ %%{ %%%%x:%0, %%%%y:%0, %%%%vals:%[2], %%%%dates:%[457] %%}, %%{ %%%%x:%1, %%%%y:%0, %%%%vals:%[1,1,4], %%%%dates:%[2,3,4] %%%%} %%] }
  • Raw Datacube 1000 300 100 70 10 3 1 2 3mb 1.2 Payload sizes 70mb 1.5 300mb
  • Think on the value of location on your data, and use it! Is very likely you have geospatial data already ! Complete the big data cycle: Don't forget data visualization ! Find the stories inside the data and show them!
  • Thanks!! Javier de la Torre - @jatorre 56