Copyright © 2012, SAS Institute Inc. All rights reserv ed.
HIGH PERFORMANCE ANALYTICS
THE FUTURE OF ANALYTICS IS HERE
Copyright © 2012, SAS Institute Inc. All rights reserv ed.
Data
Analytics
Platforms
Key Dimensions GOING BIG
3Copyright © 2011, SAS Institute Inc. All rights reserved.
Finding treasures in unstructured data
like social media or survey tools
that could uncover insights
about consumer sentiment
Mine transaction databases
for data of spending patterns
that indicate a stolen card..
Leveraging historical data
to drive better insight into
decision-making
for the future
Analyze massive
amounts of data in
order to accurately
identify areas likely to
produce the most
profitable results
FORECASTING
DATA MINING
TEXT ANALYTICS
OPTIMIZATION
STATISTICS
ADVANCED ANALYTICS
INFORMATION
MANAGEMENT
Copyright © 2011, SAS Institute Inc. All rights reserved.
Copyright © 2012, SAS Institute Inc. All rights reserv ed.
THE ANALYTICS LIFECYCLE
IDENTIFY /
FORMULATE
PROBLEM
DATA
PREPARATION
DATA
EXPLORATION
TRANSFORM
& SELECT
BUILD
MODEL
VALIDATE
MODEL
DEPLOY
MODEL
EVALUATE /
MONITOR
RESULTS
Domain Expert
Makes Decisions
Evaluates Processes and ROI
MANAGER
Model Validation
Model Deployment
Model Monitoring
Data Preparation
IT SYSTEMS /
MANAGEMENT
Data Exploration
Data Visualization
Report Creation
ANALYST
Exploratory Analysis
Descriptive Segmentation
Predictive Modeling
DATA MINER /
STATISTICIAN
Copyright © 2012, SAS Institute Inc. All rights reserv ed.
India has become the ultimate lab
for digital identification
technology. No country has ever
tried to collect this much
information in this short a period
of time
- Tarun
Wadhwa
Data
UID Registrations as of
June 2013
Copyright © 2012, SAS Institute Inc. All rights reserv ed.
Copyright © 2012, SAS Institute Inc. All rights reserv ed.
$- $20,000 $40,000 $60,000 $80,000 $100,000
Vertica
Teradata
Greenplum
Oracle
Microsoft PDW
Hadoop
Today 2009
$-
$2
$4
$6
$8
$10
$12
$14
$16
$18
$20
2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012
COST PER GIGABYTECOST PER TERABYTE
COST OF STORAGE, MEMORY, COMPUTING
In 2000 a GB of Disk $17 today < $0.07
In 2000 a GB of Ram $1800 today < $1
In 2009 a TB of RDBMS was $70K today < $ 20K
Trends in Platforms
Copyright © 2012, SAS Institute Inc. All rights reserv ed.
Copyright © 2012, SAS Institute Inc. All rights reserv ed.
DATA VISUALIZATION
Copyright © 2012, SAS Institute Inc. All rights reserv ed.
MINARD’S VISUAL DEPICTION
Copyright © 2012, SAS Institute Inc. All rights reserv ed.
PATH VISUAL ANALYTICS
“Visual Analytics is the science
of analytical reasoning
supported by interactive visual
interfaces.” -- Cook 2005
Copyright © 2012, SAS Institute Inc. All rights reserv ed.
WHAT IS SAS
VISUAL ANALYTICS
APPROACHABLE ANALYTICS BUILT RIGHT IN.
• Easy Analytics: Find Fast Answers to Your Toughest Questions.
• Any skill level – Ask toughest questions, answer with compelling visualizations
without having to learn new skills or engage IT
• Don't Just See It – Understand It with "what does it mean" pop-ups, explained in
everyday business terms that all users can understand
• Create calculated measures can and add to any visualization.
• Easy-to-use capabilities that take the complexity out of forecasting –
• Forecasts can be generated on the fly with most appropriate forecasting algorithm for specific
data is automatically selected.
• View can be saved as report packages to share with other advanced data
exploration users in Web reports, images or SAS mobile apps.
Next, what SAS VA can do for you…
Copyright © 2012, SAS Institute Inc. All rights reserv ed.
DEMO
• http://data.gov.in/ -- Production 2001-2010
•
• http://agmarknet.nic.in/ -- Onion pricing
•
• http://www.dogr.res.in/ ( Production data for 2011-12
and 2012-13)

Big Data Analytics in Government

  • 1.
    Copyright © 2012,SAS Institute Inc. All rights reserv ed. HIGH PERFORMANCE ANALYTICS THE FUTURE OF ANALYTICS IS HERE
  • 2.
    Copyright © 2012,SAS Institute Inc. All rights reserv ed. Data Analytics Platforms Key Dimensions GOING BIG
  • 3.
    3Copyright © 2011,SAS Institute Inc. All rights reserved. Finding treasures in unstructured data like social media or survey tools that could uncover insights about consumer sentiment Mine transaction databases for data of spending patterns that indicate a stolen card.. Leveraging historical data to drive better insight into decision-making for the future Analyze massive amounts of data in order to accurately identify areas likely to produce the most profitable results FORECASTING DATA MINING TEXT ANALYTICS OPTIMIZATION STATISTICS ADVANCED ANALYTICS INFORMATION MANAGEMENT Copyright © 2011, SAS Institute Inc. All rights reserved.
  • 4.
    Copyright © 2012,SAS Institute Inc. All rights reserv ed. THE ANALYTICS LIFECYCLE IDENTIFY / FORMULATE PROBLEM DATA PREPARATION DATA EXPLORATION TRANSFORM & SELECT BUILD MODEL VALIDATE MODEL DEPLOY MODEL EVALUATE / MONITOR RESULTS Domain Expert Makes Decisions Evaluates Processes and ROI MANAGER Model Validation Model Deployment Model Monitoring Data Preparation IT SYSTEMS / MANAGEMENT Data Exploration Data Visualization Report Creation ANALYST Exploratory Analysis Descriptive Segmentation Predictive Modeling DATA MINER / STATISTICIAN
  • 5.
    Copyright © 2012,SAS Institute Inc. All rights reserv ed. India has become the ultimate lab for digital identification technology. No country has ever tried to collect this much information in this short a period of time - Tarun Wadhwa Data UID Registrations as of June 2013
  • 6.
    Copyright © 2012,SAS Institute Inc. All rights reserv ed.
  • 7.
    Copyright © 2012,SAS Institute Inc. All rights reserv ed. $- $20,000 $40,000 $60,000 $80,000 $100,000 Vertica Teradata Greenplum Oracle Microsoft PDW Hadoop Today 2009 $- $2 $4 $6 $8 $10 $12 $14 $16 $18 $20 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 COST PER GIGABYTECOST PER TERABYTE COST OF STORAGE, MEMORY, COMPUTING In 2000 a GB of Disk $17 today < $0.07 In 2000 a GB of Ram $1800 today < $1 In 2009 a TB of RDBMS was $70K today < $ 20K Trends in Platforms
  • 8.
    Copyright © 2012,SAS Institute Inc. All rights reserv ed.
  • 9.
    Copyright © 2012,SAS Institute Inc. All rights reserv ed. DATA VISUALIZATION
  • 10.
    Copyright © 2012,SAS Institute Inc. All rights reserv ed. MINARD’S VISUAL DEPICTION
  • 11.
    Copyright © 2012,SAS Institute Inc. All rights reserv ed. PATH VISUAL ANALYTICS “Visual Analytics is the science of analytical reasoning supported by interactive visual interfaces.” -- Cook 2005
  • 12.
    Copyright © 2012,SAS Institute Inc. All rights reserv ed. WHAT IS SAS VISUAL ANALYTICS APPROACHABLE ANALYTICS BUILT RIGHT IN. • Easy Analytics: Find Fast Answers to Your Toughest Questions. • Any skill level – Ask toughest questions, answer with compelling visualizations without having to learn new skills or engage IT • Don't Just See It – Understand It with "what does it mean" pop-ups, explained in everyday business terms that all users can understand • Create calculated measures can and add to any visualization. • Easy-to-use capabilities that take the complexity out of forecasting – • Forecasts can be generated on the fly with most appropriate forecasting algorithm for specific data is automatically selected. • View can be saved as report packages to share with other advanced data exploration users in Web reports, images or SAS mobile apps. Next, what SAS VA can do for you…
  • 13.
    Copyright © 2012,SAS Institute Inc. All rights reserv ed. DEMO • http://data.gov.in/ -- Production 2001-2010 • • http://agmarknet.nic.in/ -- Onion pricing • • http://www.dogr.res.in/ ( Production data for 2011-12 and 2012-13)

Editor's Notes

  • #4 1.0 Fundamental set or types of Analytics – which are core to our business and our analytical applications2.0 Customers use a combination of analytical techniques – for example data mining and text mining.3.0 On the front-end Data Management is important because end users spend lot of time and effort in preparing data for analytics.4.0 On the downstream-end, sharing of analytical insights through easy-to-use visualization/BI tools is important. 5.0 Integrated set of components
  • #9 Use all the entire suite together? Adding our highly optimized advanced analytics to the process can help you generate answers to questions you never thought you could ask. (Note: at this point you should tie back to the “so what if you could” story you started before.Our suite allows an organization to move to “now you can”!With solid Information Management principals in place, each gear can independently make the decision circle move…but they can and should all be put together too.
  • #12 1977 TukeyExploratory Data Analysis1996 ShneidernamInformation Visualization Seeking Mantra1996 Fayyad KDD Pipeline 2009 KeimVisual Analytics Mantra1977 Tukey - Exploratory Data Analysis “practitioners are encouraged to visually examine their data with the assistance of summarizations and descriptive statistics “Shneidernam -Information Visualization Seeking Mantra Overview first, zoom and filter, then details on demand 1996 Fayyad - Knowledge Discovery in Databases (KDD) pipeline Selection  Preprocessing  Transformation  Data mining  Interpretation 2005 Cook defines Visual Analytics - “Visual Analytics is the science of analytical reasoning supported by interactive visual interfaces.” 2009 Keim – Visual Analytics Mantra