SlideShare a Scribd company logo
1 of 10
Digging Up the Gold in your
Godowns
- A Big-Data primer for the busy Managers
What is Big-Data Anyway?
Well, conceptually a data set so large that your regular databases
can’t handle it is referred to as ‘Big-Data’.
Just how large is large ? Typically more than a few Petabytes.
( 1 Petabytes (PB) == 1000 Terabytes == 1000,000 GigaBytes == I billion
Megabytes)
A dataset of couple of Petabytes size currently is referred to as
‘Big Data’
And you will not necessarily need a big Infrastructure to tackle it!
What Big Data Infrastructure?
You can buy big machines…become bankrupt on the way and file
for Chapter 11!
else you buy commodity machines and put up a ‘Big-Data’
infra……
Open-source Non-open Source
Apache Hadoop,
HDFS , Hive, Pig, Flume, Splunk etc .
Wrappers like
Scoobi, Scalding, Apache Scrunch
can boost your productivity
Commercially supported
platforms like
• Cloudera,
• Horton Works,
• MapR
Where do you begin?
Have a look at the Big-Grid of Big-Data! below… What you want to do
may be within these four areas depending on your org’s domain….
Social Analytics Decision Support
Performance Optimization
(conventional BI/PA)
Data Exploration
Standardized Measurement Adhoc/Hypothetical/Scenario-driven
Transactional/Structured
Data
Non-Transactional/
Un-structured Data
In the Trenches- Performance Optimization
Done usually with business intelligence tools that provide
Canned queries and multi-dimensional analytics that provide
answers in real-time on structured/cleansed/formatted
data.
Standardized dashboards to view data that help in everyday
decision making for managers on the go.
You need to quantify abstract terms like
• Exposure
• Customer Engagement
• Virality
• Digital Presence
• Influencers
• Followers
• Customer Relationship Nodes/Graphs
And derive cognizant metrics specific to your organization.
In the Trenches- - Social Analytics
This has to do with using your current data to correlate significant content
/patterns and extrapolate findings to improve customer cross-sell,
engagements, conversion-rates, deliver targeted advertisements all with the
purpose of increasing the revenues per customer or adding more customers.
Also it can be employed to detect real-time fraud such as credit-card frauds,
system-attacks etc.
In the Trenches- - Data Exploration
This involves nerdy data scientists and statisticians crunching piles of un-
structured data running Adhoc queries , scenarios-based data-jungle
escapades ,integrate real-time feeds into the data that may involve social
processing like sentiment analysis, opinion scores and integrate the overall
feedback into the organization’s day-to-day strategies and decisions. This
involves utilization of lot of human cognition & perceptive faculties.
In the Trenches- - Decision Support
The Technology Landscape
Social
Analytics
Decision
Support
Performance
Optimization
(conventional
BI/PA)
Data
Exploration
Oracle BI, IBM Cognos,
Microstrategy, Tibco
SpotFire,
Attensity, Klout, SimplyMeasured,
, HootSuite
NodeXL,HP Autonomy, Radian6
SalesPRISM, Terracotta In-
Genius, Medio, SAS Text Miner
Repustate, R, AlchemyAPI,
Saplo, Wingify and other domain
specific tools.
Big Data Capability – Concept to Execution
Setting up Big Data
Policies/Governance
Model
Setting up
Infra/Capa
bilities
Devising Big
Data
Strategies
Setting up Pilot
Projects & Begin
learning on the
way

More Related Content

What's hot

How is smart data cooked?
How is smart data cooked?How is smart data cooked?
How is smart data cooked?Ontotext
 
DMTI Spatial Location Hub Analytics: big data, analytics, visualization
DMTI Spatial Location Hub Analytics: big data, analytics, visualizationDMTI Spatial Location Hub Analytics: big data, analytics, visualization
DMTI Spatial Location Hub Analytics: big data, analytics, visualizationDMTI Spatial
 
Building a Data Driven Organization
Building a Data Driven OrganizationBuilding a Data Driven Organization
Building a Data Driven OrganizationIT Weekend
 
Introduction to Data Mining, Business Intelligence and Data Science
Introduction to Data Mining, Business Intelligence and Data ScienceIntroduction to Data Mining, Business Intelligence and Data Science
Introduction to Data Mining, Business Intelligence and Data ScienceIMC Institute
 
Presentation Big Data
Presentation Big DataPresentation Big Data
Presentation Big DataRené Kuipers
 
Big data? No. Big Decisions are What You Want
Big data? No. Big Decisions are What You WantBig data? No. Big Decisions are What You Want
Big data? No. Big Decisions are What You WantStuart Miniman
 
Satyam open analytics nyc
Satyam open analytics nycSatyam open analytics nyc
Satyam open analytics nycOpen Analytics
 
World of data @ praxis 2013 v2
World of data   @ praxis 2013  v2World of data   @ praxis 2013  v2
World of data @ praxis 2013 v2Prithwis Mukerjee
 
BIG DATA & DATA ANALYTICS
BIG  DATA & DATA  ANALYTICSBIG  DATA & DATA  ANALYTICS
BIG DATA & DATA ANALYTICSNAGARAJAGIDDE
 
Big data peresintaion
Big data peresintaion Big data peresintaion
Big data peresintaion ahmed alshikh
 
Data Skills for Digital Era-مهارت های داده ای
Data Skills for Digital Era-مهارت های داده ایData Skills for Digital Era-مهارت های داده ای
Data Skills for Digital Era-مهارت های داده ایHosseinieh Ershad Public Library
 
Infographic: Big Data Exploration
Infographic: Big Data ExplorationInfographic: Big Data Exploration
Infographic: Big Data ExplorationIBM Analytics
 

What's hot (20)

Thilga
ThilgaThilga
Thilga
 
How is smart data cooked?
How is smart data cooked?How is smart data cooked?
How is smart data cooked?
 
DMTI Spatial Location Hub Analytics: big data, analytics, visualization
DMTI Spatial Location Hub Analytics: big data, analytics, visualizationDMTI Spatial Location Hub Analytics: big data, analytics, visualization
DMTI Spatial Location Hub Analytics: big data, analytics, visualization
 
Introduction to BigData
Introduction to BigData Introduction to BigData
Introduction to BigData
 
Building a Data Driven Organization
Building a Data Driven OrganizationBuilding a Data Driven Organization
Building a Data Driven Organization
 
What is Big Data ?
What is Big Data ?What is Big Data ?
What is Big Data ?
 
Introduction to Data Mining, Business Intelligence and Data Science
Introduction to Data Mining, Business Intelligence and Data ScienceIntroduction to Data Mining, Business Intelligence and Data Science
Introduction to Data Mining, Business Intelligence and Data Science
 
Presentation Big Data
Presentation Big DataPresentation Big Data
Presentation Big Data
 
Big data? No. Big Decisions are What You Want
Big data? No. Big Decisions are What You WantBig data? No. Big Decisions are What You Want
Big data? No. Big Decisions are What You Want
 
Satyam open analytics nyc
Satyam open analytics nycSatyam open analytics nyc
Satyam open analytics nyc
 
World of data @ praxis 2013 v2
World of data   @ praxis 2013  v2World of data   @ praxis 2013  v2
World of data @ praxis 2013 v2
 
DataScava
DataScavaDataScava
DataScava
 
Big Data
Big DataBig Data
Big Data
 
Big Data
Big DataBig Data
Big Data
 
BIG DATA & DATA ANALYTICS
BIG  DATA & DATA  ANALYTICSBIG  DATA & DATA  ANALYTICS
BIG DATA & DATA ANALYTICS
 
Big data peresintaion
Big data peresintaion Big data peresintaion
Big data peresintaion
 
Data Skills for Digital Era-مهارت های داده ای
Data Skills for Digital Era-مهارت های داده ایData Skills for Digital Era-مهارت های داده ای
Data Skills for Digital Era-مهارت های داده ای
 
Big data analysis
Big data analysisBig data analysis
Big data analysis
 
Big data
Big dataBig data
Big data
 
Infographic: Big Data Exploration
Infographic: Big Data ExplorationInfographic: Big Data Exploration
Infographic: Big Data Exploration
 

Viewers also liked

Rocking mongo db on the cloud
Rocking mongo db on the cloudRocking mongo db on the cloud
Rocking mongo db on the cloudMongoDB
 
Buildr In Action @devoxx france 2012
Buildr In Action @devoxx france 2012Buildr In Action @devoxx france 2012
Buildr In Action @devoxx france 2012alexismidon
 
Why I Believe MongoDB is The Dog's Bollocks
Why I Believe MongoDB is The Dog's BollocksWhy I Believe MongoDB is The Dog's Bollocks
Why I Believe MongoDB is The Dog's BollocksMark Smalley
 
Mongo db bangalore
Mongo db bangaloreMongo db bangalore
Mongo db bangaloreMongoDB
 
Mongo db 2.6_security_architecture
Mongo db 2.6_security_architectureMongo db 2.6_security_architecture
Mongo db 2.6_security_architectureMat Keep
 
Munching the mongo
Munching the mongoMunching the mongo
Munching the mongoVulcanMinds
 

Viewers also liked (6)

Rocking mongo db on the cloud
Rocking mongo db on the cloudRocking mongo db on the cloud
Rocking mongo db on the cloud
 
Buildr In Action @devoxx france 2012
Buildr In Action @devoxx france 2012Buildr In Action @devoxx france 2012
Buildr In Action @devoxx france 2012
 
Why I Believe MongoDB is The Dog's Bollocks
Why I Believe MongoDB is The Dog's BollocksWhy I Believe MongoDB is The Dog's Bollocks
Why I Believe MongoDB is The Dog's Bollocks
 
Mongo db bangalore
Mongo db bangaloreMongo db bangalore
Mongo db bangalore
 
Mongo db 2.6_security_architecture
Mongo db 2.6_security_architectureMongo db 2.6_security_architecture
Mongo db 2.6_security_architecture
 
Munching the mongo
Munching the mongoMunching the mongo
Munching the mongo
 

Similar to Dig up the gold in your godowns

Big data and data mining
Big data and data miningBig data and data mining
Big data and data miningEmran Hossain
 
March Towards Big Data - Big Data Implementation, Migration, Ingestion, Manag...
March Towards Big Data - Big Data Implementation, Migration, Ingestion, Manag...March Towards Big Data - Big Data Implementation, Migration, Ingestion, Manag...
March Towards Big Data - Big Data Implementation, Migration, Ingestion, Manag...Experfy
 
Top Big data Analytics tools: Emerging trends and Best practices
Top Big data Analytics tools: Emerging trends and Best practicesTop Big data Analytics tools: Emerging trends and Best practices
Top Big data Analytics tools: Emerging trends and Best practicesSpringPeople
 
Architecting for Big Data: Trends, Tips, and Deployment Options
Architecting for Big Data: Trends, Tips, and Deployment OptionsArchitecting for Big Data: Trends, Tips, and Deployment Options
Architecting for Big Data: Trends, Tips, and Deployment OptionsCaserta
 
Big-Data-Seminar-6-Aug-2014-Koenig
Big-Data-Seminar-6-Aug-2014-KoenigBig-Data-Seminar-6-Aug-2014-Koenig
Big-Data-Seminar-6-Aug-2014-KoenigManish Chopra
 
What_BigData_means_to_your_organization
What_BigData_means_to_your_organizationWhat_BigData_means_to_your_organization
What_BigData_means_to_your_organizationAttila Barta
 
Guide to big data analytics
Guide to big data analyticsGuide to big data analytics
Guide to big data analyticsGahya Pandian
 
Big Data - Everything you need to know
Big Data - Everything you need to knowBig Data - Everything you need to know
Big Data - Everything you need to knowV2Soft
 
Snowball Group Whitepaper - Spotlight on Big Data
Snowball Group Whitepaper - Spotlight on Big DataSnowball Group Whitepaper - Spotlight on Big Data
Snowball Group Whitepaper - Spotlight on Big DataSnowball Group
 
Big data and Marketing by Edward Chenard
Big data and Marketing by Edward ChenardBig data and Marketing by Edward Chenard
Big data and Marketing by Edward ChenardEdward Chenard
 
#MarketingShake - Edward Chenard - Descubrí el poder del Big Data para Transf...
#MarketingShake - Edward Chenard - Descubrí el poder del Big Data para Transf...#MarketingShake - Edward Chenard - Descubrí el poder del Big Data para Transf...
#MarketingShake - Edward Chenard - Descubrí el poder del Big Data para Transf...amdia
 
Lecture 1.13 & 1.14 &1.15_Business Profiles in Big Data.pptx
Lecture 1.13 & 1.14 &1.15_Business Profiles in Big Data.pptxLecture 1.13 & 1.14 &1.15_Business Profiles in Big Data.pptx
Lecture 1.13 & 1.14 &1.15_Business Profiles in Big Data.pptxRATISHKUMAR32
 
Importance of Big data for your Business
Importance of Big data for your BusinessImportance of Big data for your Business
Importance of Big data for your Businessazuyo.com
 
Level Seven - Expedient Big Data presentation
Level Seven - Expedient Big Data presentationLevel Seven - Expedient Big Data presentation
Level Seven - Expedient Big Data presentationDoug Denton
 

Similar to Dig up the gold in your godowns (20)

Big data and data mining
Big data and data miningBig data and data mining
Big data and data mining
 
March Towards Big Data - Big Data Implementation, Migration, Ingestion, Manag...
March Towards Big Data - Big Data Implementation, Migration, Ingestion, Manag...March Towards Big Data - Big Data Implementation, Migration, Ingestion, Manag...
March Towards Big Data - Big Data Implementation, Migration, Ingestion, Manag...
 
What is big data
What is big dataWhat is big data
What is big data
 
Big Data at a Glance
Big Data at a GlanceBig Data at a Glance
Big Data at a Glance
 
Presentation on Big Data
Presentation on Big DataPresentation on Big Data
Presentation on Big Data
 
Top Big data Analytics tools: Emerging trends and Best practices
Top Big data Analytics tools: Emerging trends and Best practicesTop Big data Analytics tools: Emerging trends and Best practices
Top Big data Analytics tools: Emerging trends and Best practices
 
Architecting for Big Data: Trends, Tips, and Deployment Options
Architecting for Big Data: Trends, Tips, and Deployment OptionsArchitecting for Big Data: Trends, Tips, and Deployment Options
Architecting for Big Data: Trends, Tips, and Deployment Options
 
Big-Data-Seminar-6-Aug-2014-Koenig
Big-Data-Seminar-6-Aug-2014-KoenigBig-Data-Seminar-6-Aug-2014-Koenig
Big-Data-Seminar-6-Aug-2014-Koenig
 
Unlocking big data
Unlocking big dataUnlocking big data
Unlocking big data
 
What_BigData_means_to_your_organization
What_BigData_means_to_your_organizationWhat_BigData_means_to_your_organization
What_BigData_means_to_your_organization
 
Big data basics
Big data basicsBig data basics
Big data basics
 
Guide to big data analytics
Guide to big data analyticsGuide to big data analytics
Guide to big data analytics
 
Big Data - Everything you need to know
Big Data - Everything you need to knowBig Data - Everything you need to know
Big Data - Everything you need to know
 
Snowball Group Whitepaper - Spotlight on Big Data
Snowball Group Whitepaper - Spotlight on Big DataSnowball Group Whitepaper - Spotlight on Big Data
Snowball Group Whitepaper - Spotlight on Big Data
 
Big data analytics - hadoop
Big data analytics - hadoopBig data analytics - hadoop
Big data analytics - hadoop
 
Big data and Marketing by Edward Chenard
Big data and Marketing by Edward ChenardBig data and Marketing by Edward Chenard
Big data and Marketing by Edward Chenard
 
#MarketingShake - Edward Chenard - Descubrí el poder del Big Data para Transf...
#MarketingShake - Edward Chenard - Descubrí el poder del Big Data para Transf...#MarketingShake - Edward Chenard - Descubrí el poder del Big Data para Transf...
#MarketingShake - Edward Chenard - Descubrí el poder del Big Data para Transf...
 
Lecture 1.13 & 1.14 &1.15_Business Profiles in Big Data.pptx
Lecture 1.13 & 1.14 &1.15_Business Profiles in Big Data.pptxLecture 1.13 & 1.14 &1.15_Business Profiles in Big Data.pptx
Lecture 1.13 & 1.14 &1.15_Business Profiles in Big Data.pptx
 
Importance of Big data for your Business
Importance of Big data for your BusinessImportance of Big data for your Business
Importance of Big data for your Business
 
Level Seven - Expedient Big Data presentation
Level Seven - Expedient Big Data presentationLevel Seven - Expedient Big Data presentation
Level Seven - Expedient Big Data presentation
 

More from VulcanMinds

Mongo DB in Health Care Part 1
Mongo DB in Health Care Part 1Mongo DB in Health Care Part 1
Mongo DB in Health Care Part 1VulcanMinds
 
Designing a play framework application
Designing a play framework applicationDesigning a play framework application
Designing a play framework applicationVulcanMinds
 
Scala xml power play part 1
Scala   xml power play part 1Scala   xml power play part 1
Scala xml power play part 1VulcanMinds
 
Scala case of case classes
Scala   case of case classesScala   case of case classes
Scala case of case classesVulcanMinds
 
Tupple ware in scala
Tupple ware in scalaTupple ware in scala
Tupple ware in scalaVulcanMinds
 
Scala elegant and exotic part 1
Scala  elegant and exotic part 1Scala  elegant and exotic part 1
Scala elegant and exotic part 1VulcanMinds
 
Data choreography in mongo
Data choreography in mongoData choreography in mongo
Data choreography in mongoVulcanMinds
 

More from VulcanMinds (7)

Mongo DB in Health Care Part 1
Mongo DB in Health Care Part 1Mongo DB in Health Care Part 1
Mongo DB in Health Care Part 1
 
Designing a play framework application
Designing a play framework applicationDesigning a play framework application
Designing a play framework application
 
Scala xml power play part 1
Scala   xml power play part 1Scala   xml power play part 1
Scala xml power play part 1
 
Scala case of case classes
Scala   case of case classesScala   case of case classes
Scala case of case classes
 
Tupple ware in scala
Tupple ware in scalaTupple ware in scala
Tupple ware in scala
 
Scala elegant and exotic part 1
Scala  elegant and exotic part 1Scala  elegant and exotic part 1
Scala elegant and exotic part 1
 
Data choreography in mongo
Data choreography in mongoData choreography in mongo
Data choreography in mongo
 

Dig up the gold in your godowns

  • 1. Digging Up the Gold in your Godowns - A Big-Data primer for the busy Managers
  • 2. What is Big-Data Anyway? Well, conceptually a data set so large that your regular databases can’t handle it is referred to as ‘Big-Data’. Just how large is large ? Typically more than a few Petabytes. ( 1 Petabytes (PB) == 1000 Terabytes == 1000,000 GigaBytes == I billion Megabytes) A dataset of couple of Petabytes size currently is referred to as ‘Big Data’ And you will not necessarily need a big Infrastructure to tackle it!
  • 3. What Big Data Infrastructure? You can buy big machines…become bankrupt on the way and file for Chapter 11! else you buy commodity machines and put up a ‘Big-Data’ infra…… Open-source Non-open Source Apache Hadoop, HDFS , Hive, Pig, Flume, Splunk etc . Wrappers like Scoobi, Scalding, Apache Scrunch can boost your productivity Commercially supported platforms like • Cloudera, • Horton Works, • MapR
  • 4. Where do you begin? Have a look at the Big-Grid of Big-Data! below… What you want to do may be within these four areas depending on your org’s domain…. Social Analytics Decision Support Performance Optimization (conventional BI/PA) Data Exploration Standardized Measurement Adhoc/Hypothetical/Scenario-driven Transactional/Structured Data Non-Transactional/ Un-structured Data
  • 5. In the Trenches- Performance Optimization Done usually with business intelligence tools that provide Canned queries and multi-dimensional analytics that provide answers in real-time on structured/cleansed/formatted data. Standardized dashboards to view data that help in everyday decision making for managers on the go.
  • 6. You need to quantify abstract terms like • Exposure • Customer Engagement • Virality • Digital Presence • Influencers • Followers • Customer Relationship Nodes/Graphs And derive cognizant metrics specific to your organization. In the Trenches- - Social Analytics
  • 7. This has to do with using your current data to correlate significant content /patterns and extrapolate findings to improve customer cross-sell, engagements, conversion-rates, deliver targeted advertisements all with the purpose of increasing the revenues per customer or adding more customers. Also it can be employed to detect real-time fraud such as credit-card frauds, system-attacks etc. In the Trenches- - Data Exploration
  • 8. This involves nerdy data scientists and statisticians crunching piles of un- structured data running Adhoc queries , scenarios-based data-jungle escapades ,integrate real-time feeds into the data that may involve social processing like sentiment analysis, opinion scores and integrate the overall feedback into the organization’s day-to-day strategies and decisions. This involves utilization of lot of human cognition & perceptive faculties. In the Trenches- - Decision Support
  • 9. The Technology Landscape Social Analytics Decision Support Performance Optimization (conventional BI/PA) Data Exploration Oracle BI, IBM Cognos, Microstrategy, Tibco SpotFire, Attensity, Klout, SimplyMeasured, , HootSuite NodeXL,HP Autonomy, Radian6 SalesPRISM, Terracotta In- Genius, Medio, SAS Text Miner Repustate, R, AlchemyAPI, Saplo, Wingify and other domain specific tools.
  • 10. Big Data Capability – Concept to Execution Setting up Big Data Policies/Governance Model Setting up Infra/Capa bilities Devising Big Data Strategies Setting up Pilot Projects & Begin learning on the way