Advanced Visualization
Bijilash Babu
Technical Architect
Technology Development Centre
NeST Software
bijilash.babu@nestgroup.net
Session on Emerging trends in
Business Intelligence
20 July 2012: Zenith Hall
Bhavani, Technopark, Trivandrum
Roadmap
• Big Data
• Dimensionality
• Current trends
• Ordinary analytics
• Applied mathematics
• Advanced Technology
20-Jul-12 NeST Controlled
2
Big Data, It’s Visualization
• Gartner’s definition of big data refers to high-volume, high-velocity and high-
variety information assets that demand cost-effective, innovative forms of
information processing for enhanced insight and decision making.
• Big Data is the convergence of three v’s: volume, velocity and variety .
• Internet of things (with different sensors), CRM, social media, etc..
• Improved use of Big Data could add X to the economy and create N jobs.
• Volume of data keeps creeping, Decision makers would struggle..
• Data visualisation is the key for better perception of the underlying facts.
20-Jul-12 NeST Controlled/Confidential
3
When big wasn’t that big
20-Jul-12 NeST Controlled/Confidential
4
• Line graph
• Stack graph
• Categories Stack graph
Track rises and falls over time
• Scatterplot
• Matrix chart
• Network Diagram
See relationships among data points
• Bar chart
• Block histogram
• Bubble chart
Compare a set of values
• Pie Chart
• Tree Map
• Analyze a text
• Word tree
• Wordle
See parts of a whole
• Mapping
See the world
Better Representation
9876546765 987-654-6765
20-Jul-12 NeST Controlled/Confidential
5
Source: www.cia.gov
Timeline
20-Jul-12 NeST Controlled/Confidential
6
Source: The Economist
Better Representation
20-Jul-12 NeST Controlled/Confidential
7
Source: The New York Times
The volcano
20-Jul-12 NeST Controlled/Confidential
8
Create your own visual
20-Jul-12 NeST Controlled/Confidential
9
Source: www.wordle.net
George K. Thiruvathukal,
Associate Editor in Chief
Computing in Science & Engineering
Tag Cloud, NSF proposals
Create your own visual
20-Jul-12 NeST Controlled/Confidential
10
Created in R with word-cloud package. Data from country population. Note that the proportional sizes of China
and India were reduced in half. Source: wikipedia.org
What’s up..
• Need to bring in better methods for extracting a smaller
set of relevant data.
• In fact, Big Data isn’t just about numbers or volume, but
the trends – how they change over time.
• Visualization is an invaluable tool in identifying trends
within massive data sets.
• Spotting anomalies as well as outliers.
20-Jul-12 NeST Controlled/Confidential
11
Going around Big Data
• With the exponential growth in data acquisition and
generation.
• High-resolution sensors, automated accumulation...
• More disk space and more CPU cycles!
• But, there are couple of walls around the CPU,
• and GPUs come into picture!
20-Jul-12 NeST Controlled/Confidential
12
Calling in Maths
• Scientific data analysis techniques
• Numerical Linear Algebra
• SVD - The prize, compression
• PCA/ NLPCA – to reduce the dimensionality, feature extraction
Latent Semantic Indexing (LSI)
• SVM - classification, regression, and anomaly detection.
• SOM - neural network algorithm based on unsupervised learning
20-Jul-12 NeST Controlled/Confidential
13
Log plots
• Response to skewness towards large values; i.e., cases in which one or a
few points are much larger than the bulk of the data.
• To show percent change or multiplicative factors.
• Base of ten is useful when the data range over several orders of magnitude,
a base of two is useful when the data have a smaller range
20-Jul-12 NeST Controlled/Confidential
14
Source: Forbes
20-Jul-12 NeST Controlled/Confidential
15
Better Mixing
20-Jul-12 NeST Controlled/Confidential
16
+ = ?
Visual data Mining
20-Jul-12 NeST Controlled/Confidential
17
Source: S.J. Simoff et al. (Eds.): Visual Data Mining, LNCS 4404
Advanced technology
20-Jul-12 NeST Controlled/Confidential
18
Hans Rosling...
20-Jul-12 NeST Controlled/Confidential
19
...What’s next?
Thank you!!!
20-Jul-12 NeST Controlled/Confidential
20

Advanced Visualizations, Bijilash Babu

  • 1.
    Advanced Visualization Bijilash Babu TechnicalArchitect Technology Development Centre NeST Software bijilash.babu@nestgroup.net Session on Emerging trends in Business Intelligence 20 July 2012: Zenith Hall Bhavani, Technopark, Trivandrum
  • 2.
    Roadmap • Big Data •Dimensionality • Current trends • Ordinary analytics • Applied mathematics • Advanced Technology 20-Jul-12 NeST Controlled 2
  • 3.
    Big Data, It’sVisualization • Gartner’s definition of big data refers to high-volume, high-velocity and high- variety information assets that demand cost-effective, innovative forms of information processing for enhanced insight and decision making. • Big Data is the convergence of three v’s: volume, velocity and variety . • Internet of things (with different sensors), CRM, social media, etc.. • Improved use of Big Data could add X to the economy and create N jobs. • Volume of data keeps creeping, Decision makers would struggle.. • Data visualisation is the key for better perception of the underlying facts. 20-Jul-12 NeST Controlled/Confidential 3
  • 4.
    When big wasn’tthat big 20-Jul-12 NeST Controlled/Confidential 4 • Line graph • Stack graph • Categories Stack graph Track rises and falls over time • Scatterplot • Matrix chart • Network Diagram See relationships among data points • Bar chart • Block histogram • Bubble chart Compare a set of values • Pie Chart • Tree Map • Analyze a text • Word tree • Wordle See parts of a whole • Mapping See the world
  • 5.
    Better Representation 9876546765 987-654-6765 20-Jul-12NeST Controlled/Confidential 5 Source: www.cia.gov
  • 6.
  • 7.
    Better Representation 20-Jul-12 NeSTControlled/Confidential 7 Source: The New York Times
  • 8.
    The volcano 20-Jul-12 NeSTControlled/Confidential 8
  • 9.
    Create your ownvisual 20-Jul-12 NeST Controlled/Confidential 9 Source: www.wordle.net George K. Thiruvathukal, Associate Editor in Chief Computing in Science & Engineering Tag Cloud, NSF proposals
  • 10.
    Create your ownvisual 20-Jul-12 NeST Controlled/Confidential 10 Created in R with word-cloud package. Data from country population. Note that the proportional sizes of China and India were reduced in half. Source: wikipedia.org
  • 11.
    What’s up.. • Needto bring in better methods for extracting a smaller set of relevant data. • In fact, Big Data isn’t just about numbers or volume, but the trends – how they change over time. • Visualization is an invaluable tool in identifying trends within massive data sets. • Spotting anomalies as well as outliers. 20-Jul-12 NeST Controlled/Confidential 11
  • 12.
    Going around BigData • With the exponential growth in data acquisition and generation. • High-resolution sensors, automated accumulation... • More disk space and more CPU cycles! • But, there are couple of walls around the CPU, • and GPUs come into picture! 20-Jul-12 NeST Controlled/Confidential 12
  • 13.
    Calling in Maths •Scientific data analysis techniques • Numerical Linear Algebra • SVD - The prize, compression • PCA/ NLPCA – to reduce the dimensionality, feature extraction Latent Semantic Indexing (LSI) • SVM - classification, regression, and anomaly detection. • SOM - neural network algorithm based on unsupervised learning 20-Jul-12 NeST Controlled/Confidential 13
  • 14.
    Log plots • Responseto skewness towards large values; i.e., cases in which one or a few points are much larger than the bulk of the data. • To show percent change or multiplicative factors. • Base of ten is useful when the data range over several orders of magnitude, a base of two is useful when the data have a smaller range 20-Jul-12 NeST Controlled/Confidential 14 Source: Forbes
  • 15.
  • 16.
    Better Mixing 20-Jul-12 NeSTControlled/Confidential 16 + = ?
  • 17.
    Visual data Mining 20-Jul-12NeST Controlled/Confidential 17 Source: S.J. Simoff et al. (Eds.): Visual Data Mining, LNCS 4404
  • 18.
    Advanced technology 20-Jul-12 NeSTControlled/Confidential 18
  • 19.
    Hans Rosling... 20-Jul-12 NeSTControlled/Confidential 19 ...What’s next?
  • 20.
    Thank you!!! 20-Jul-12 NeSTControlled/Confidential 20