SlideShare a Scribd company logo
1 of 48
© 2014 John Sing – All Rights Reserved
Big Data’s Journey to Value
Making Data Actionable
Opening video
John Sing, Executive IT Architect
© 2015 John Sing – All Rights Reserved
University of South Florida - Spring 2015
2
John Sing
 32 years of experience in enterprise servers, storage, and software
– 2015: IBM Product Manager – Spectrum Scale Storage
– 2014: Director of Technology, 4cube – Infrastructure for Tomorrow
– 2009 – 2013: IBM Executive IT Consultant: IT Strategy and Planning, Enterprise
Large Scale Storage, Internet Scale Workloads and Data Center Design, Big Data
Analytics, HA/DR/BC
– 2002-2008: IBM IT Data Center Strategy, Large Scale Systems, Business
Continuity, HA/DR/BC, IBM Storage
– 1998-2001: IBM Storage Subsystems Group – Worldwide Marketing, Technical
Support, Product Planner, Product Manager
– Before that:
• IBM Hong Kong, IBM China, IBM USA
 john@johnsing.us
 Follow me on Twitter: http://twitter.com/john_sing
 Follow me on Slideshare.net:
– http://www.slideshare.net/johnsing1
 Blog:
– http://johnsing.technology
 LinkedIn:
– http://www.linkedin.com/in/johnsing
© 2015 John Sing – All Rights Reserved
University of South Florida - Spring 2015
3
Big Data’s Journey to Value
Data + Analytics = Information
Insight
Desired Outcomes
Information + Context =
Insight + Actions =
© 2015 John Sing – All Rights Reserved
University of South Florida - Spring 2015
4
You know how
much data
there is…
© 2015 John Sing – All Rights Reserved
University of South Florida - Spring 2015
5
You know how to analyze Big Data Goal: Analyze *all*
the data real time
Original source: Wikibon.org, “Big Data”, http://wikibon.org/blog/ten-%E2%80%9Cbig-data%E2%80%9D-realities-and-what-they-mean-to-you/
Very large
Loosely
structured
Often
incomplete
Sampling not
strategically
competitive
© 2015 John Sing – All Rights Reserved
University of South Florida - Spring 2015
6
Time
ComputingPowerGrowth
Traditional business
“sensemaking” capability
Available data
for
observation
ContextEnterprise
Amnesia
What “Big Data” solves:
Chart by: Jeff Jonas/Las Vegas/IBM, Chief Scientist, Context Computing: http://jeffjonas.typepad.com/
© 2015 John Sing – All Rights Reserved
University of South Florida - Spring 2015
7
Enterprise Amnesia, definition
A defect in memory, resulting in missed
opportunity, wasted resources, lower
revenues, unnecessary fraud losses, and
other bad news.
© 2015 John Sing – All Rights Reserved
University of South Florida - Spring 2015
8
Time
ComputingPowerGrowth
Traditional business
“sensemaking” capability
Available data
for
observation
ContextEnterprise
Amnesia
Enterprise Amnesia examples…..
Chart by: Jeff Jonas/Las Vegas/IBM, Chief Scientist, Context Computing: http://jeffjonas.typepad.com/
© 2015 John Sing – All Rights Reserved
University of South Florida - Spring 2015
9
Time
ComputingPowerGrowth
Data + Analytics = “Information”
Traditional business
“sensemaking”
Available
Observation
Space
Context Big Data
acquisition
= New, Useful
InformationAdd: Analytics
What comes after “Information”?
© 2015 John Sing – All Rights Reserved
University of South Florida - Spring 2015
10
Big Data’s Journey to Value
Data + Analytics = Information
Insight
Desired Outcomes
Information + Context =
Insight + Actions =
© 2015 John Sing – All Rights Reserved
University of South Florida - Spring 2015
11
Context
More about Jeff Jonas, IBM Chief Scientist, Context Computing: http://bit.ly/1g3z9ZQ
Jeff Jonas, IBM
Chief Scientist
Context Computing
© 2015 John Sing – All Rights Reserved
University of South Florida - Spring 2015
12
Here’s more
from IBM’s
Jeff Jonas
about “Context”:
Tubechop: http://www.tubechop.com/watch/5634618
© 2015 John Sing – All Rights Reserved
University of South Florida - Spring 2015
13
No Context
scrila34@msn.com
© 2015 John Sing – All Rights Reserved
University of South Florida - Spring 2015
14
Context, definition
Better understanding something by taking
into account the things around it.
© 2015 John Sing – All Rights Reserved
University of South Florida - Spring 2015
15
Information in Context … = Insights
Top 200
Customer
Job
Applicant
Identity
Thief
Criminal
Investigation
scrila34@msn.com
© 2015 John Sing – All Rights Reserved
University of South Florida - Spring 2015
16
The Puzzle Metaphor: what we mean by “Context”
 Imagine an ever-growing pile of puzzle pieces of varying sizes, shapes and colors
 What it represents is unknown – there is no picture on hand
 Is it one puzzle, 15 puzzles, or 1,500 different puzzles?
 Some pieces are duplicates, missing, incomplete, low quality,
or have been misinterpreted
 Some pieces may even be professionally fabricated lies
 Until you take the pieces to the table and attempt assembly,
you don’t know what you are dealing with
© 2015 John Sing – All Rights Reserved
University of South Florida - Spring 2015
17
Here’s a “context” example…….. “Puzzling”
270 pieces
90%
200 pieces
66%
150 pieces
50%
6 pieces
2%
(pure noise)
30 pieces
10%
(duplicates)
© 2015 John Sing – All Rights Reserved
University of South Florida - Spring 2015
18
© 2015 John Sing – All Rights Reserved
University of South Florida - Spring 2015
19
© 2015 John Sing – All Rights Reserved
University of South Florida - Spring 2015
20
First Discovery
© 2015 John Sing – All Rights Reserved
University of South Florida - Spring 2015
21
More Data Finds Data
© 2015 John Sing – All Rights Reserved
University of South Florida - Spring 2015
22
Duplicates in Front Of Your Eyes
© 2015 John Sing – All Rights Reserved
University of South Florida - Spring 2015
23
First Duplicate Found Here
© 2015 John Sing – All Rights Reserved
University of South Florida - Spring 2015
24
© 2015 John Sing – All Rights Reserved
University of South Florida - Spring 2015
25
© 2015 John Sing – All Rights Reserved
University of South Florida - Spring 2015
26
Incremental Context – Incremental Discovery
6:40pm START
22min “Hey, this one is a duplicate!”
35min “I think some pieces are missing.”
37min “Looks like a bunch of hillbillies on a porch.”
44min “Hillbillies, playing guitars, sitting on a porch,
near a barber sign … and a banjo!”
© 2015 John Sing – All Rights Reserved
University of South Florida - Spring 2015
27
150 pieces
50%
© 2015 John Sing – All Rights Reserved
University of South Florida - Spring 2015
28
Incremental Context – Incremental Discovery
47min “We should take the sky and grass off the table.”
2hr “Let’s switch sides, and see if we can make sense
of this from different perspectives.”
2hr10m “Wait, there are three … no, four puzzles.”
2hr17m “We need a bigger table.”
2hr18m “I think you threw in a few random pieces.”
© 2015 John Sing – All Rights Reserved
University of South Florida - Spring 2015
29
© 2015 John Sing – All Rights Reserved
University of South Florida - Spring 2015
30
© 2015 John Sing – All Rights Reserved
University of South Florida - Spring 2015
31
Context Accumulates….. Into “Insights”
 With each new observation … one of three assertions are made:
– 1) Un-associated;
– 2) placed near like neighbors; or
– 3) connected
 New observations sometimes reverse earlier assertions
 Some observations produce new discovery
 As the working space expands, computational effort increases
 Given sufficient observations, there can come a tipping point. Thereafter,
confidence improves while computational effort decreases!
© 2015 John Sing – All Rights Reserved
University of South Florida - Spring 2015
32
What
Can you
See in
Context
now?
© 2015 John Sing – All Rights Reserved
University of South Florida - Spring 2015
33
Big Data [in context] = Insights.
More data: better the predictions
– Lower false positives
– Lower false negatives
More data: bad data … good
– Suddenly glad your data was not perfect
More data: less compute
© 2015 John Sing – All Rights Reserved
University of South Florida - Spring 2015
34
Big Data’s Journey to Value
Data + Analytics = Information
Insight
Desired Outcomes
Information + Context =
Insight + Actions =
© 2015 John Sing – All Rights Reserved
University of South Florida - Spring 2015
35
Now that I create Insights..…. how do I take Action?
Chart in public domain: IEEE Massive File Storage presentation, author: Bill Kramer, NCSA: http://storageconference.org/2010/Presentations/MSST/1.Kramer.pdf:
© 2015 John Sing – All Rights Reserved
University of South Florida - Spring 2015
36
Answer: build actionable systems that use the insights
Chart in public domain: IEEE Massive File Storage presentation, author: Bill Kramer, NCSA: http://storageconference.org/2010/Presentations/MSST/1.Kramer.pdf:
n d
Actionable
Systems
© 2015 John Sing – All Rights Reserved
University of South Florida - Spring 2015
37
Projected traffic Insights
•10 minute-ahead volume forecast (blue) vs. actual
value (black)
•10 minute-ahead speed forecast (blue) vs. actual
value (black).
Black line: actions via signals = desired outcome
Stockholm: http://www.youtube.com/watch?v=rfMylzF4lv8
 Actionable traffic signals
Blue line: analytics prediction 10 minutes in advance
© 2015 John Sing – All Rights Reserved
University of South Florida - Spring 2015
38
Insights based on crime  actions: where to deploy of officers
 Blue CRUSH predictive analysis for officer deployment & risk management generated easy-to-read crime maps every four hours
 Richmond, VA: Violent crime decreased in the first year by 32%, another 40% thereafter,
moving Richmond from #5 on the list of the most dangerous US cities to #99
Memphis Blue CRUSH MapMemphis Blue CRUSH Map
Police videos: http://www.youtube.com/watch?v=8SJQtn4RO7I
Play
video
https://www.youtube.com/watch?v=_xsffIAHY3I
© 2015 John Sing – All Rights Reserved
University of South Florida - Spring 2015
39
Local Applications: Big Data’s Journey to Value
Data + Analytics = Information
Insight
Desired Outcomes
Information + Context =
Insight + Actions =
© 2015 John Sing – All Rights Reserved
University of South Florida - Spring 2015
40
Local examples
© 2015 John Sing – All Rights Reserved
University of South Florida - Spring 2015
41
Local examples
© 2015 John Sing – All Rights Reserved
University of South Florida - Spring 2015
42
Local examples
© 2015 John Sing – All Rights Reserved
University of South Florida - Spring 2015
43
Quiz: in following Futuristic video
see if you can identify:
Data + Analytics = Information
Information + Context = Insight
Insight + Actions = Desired Outcomes
© 2015 John Sing – All Rights Reserved
University of South Florida - Spring 2015
44
 Cognitive
Video
The Future – Creating Actionable Big Data
© 2015 John Sing – All Rights Reserved
University of South Florida - Spring 2015
45
Final Quiz: Big Data’s Journey to Value
Data + Analytics = Information
Insight
Desired Outcomes
Information + Context =
Insight + Actions =
© 2015 John Sing – All Rights Reserved
University of South Florida - Spring 2015
46
Thank You
Merci
Grazie
ObrigadoDanke
Japanese
Hebrew
English
French
Russian
German
Italian
Brazilian Portuguese
Arabic
Traditional Chinese
Simplified
Chinese
Hindi
Tamil Korean
Thai
TesekkurlerTurkish
© 2015 John Sing – All Rights Reserved
University of South Florida - Spring 2015
47
© 2015 John Sing – All Rights Reserved
University of South Florida - Spring 2015
48
Does Corning understand
“Actionable” data?
Predicting the future …..
https://www.youtube.com/watch?v=PfgmlVxLC9w

More Related Content

Viewers also liked

Founding a Hadoop Data Science Lab
Founding a Hadoop Data Science LabFounding a Hadoop Data Science Lab
Founding a Hadoop Data Science LabAndre Langevin
 
Building Your Big Data Analytics Strategy- Impetus Webinar
Building Your Big Data Analytics Strategy- Impetus WebinarBuilding Your Big Data Analytics Strategy- Impetus Webinar
Building Your Big Data Analytics Strategy- Impetus WebinarImpetus Technologies
 
The Analytics CoE: Positioning your Business Analytics Program for Success
The Analytics CoE: Positioning your Business Analytics Program for SuccessThe Analytics CoE: Positioning your Business Analytics Program for Success
The Analytics CoE: Positioning your Business Analytics Program for SuccessCartegraph
 
Enterprise Analytics Strategy: Taking Business Analytics to the User
Enterprise Analytics Strategy: Taking Business Analytics to the UserEnterprise Analytics Strategy: Taking Business Analytics to the User
Enterprise Analytics Strategy: Taking Business Analytics to the UserRubén Mancha
 
The Data Driven Enterprise - Roadmap to Big Data & Analytics Success
The Data Driven Enterprise - Roadmap to Big Data & Analytics SuccessThe Data Driven Enterprise - Roadmap to Big Data & Analytics Success
The Data Driven Enterprise - Roadmap to Big Data & Analytics SuccessBigInsights
 
Building an Analytics CoE (Center of Excellence)
Building an Analytics CoE (Center of Excellence)Building an Analytics CoE (Center of Excellence)
Building an Analytics CoE (Center of Excellence)Rahul Saxena
 
Building Big Data Analytics Center Of Excellence
Building Big Data Analytics Center Of Excellence Building Big Data Analytics Center Of Excellence
Building Big Data Analytics Center Of Excellence Dr. Mohan K. Bavirisetty
 
Big Data Analytics Strategy and Roadmap
Big Data Analytics Strategy and RoadmapBig Data Analytics Strategy and Roadmap
Big Data Analytics Strategy and RoadmapSrinath Perera
 
Digital Transformation: Big Data and Data Science Learning Path
Digital Transformation: Big Data and Data Science Learning PathDigital Transformation: Big Data and Data Science Learning Path
Digital Transformation: Big Data and Data Science Learning PathChulalongkorn University
 
Creating a Next-Generation Big Data Architecture
Creating a Next-Generation Big Data ArchitectureCreating a Next-Generation Big Data Architecture
Creating a Next-Generation Big Data ArchitecturePerficient, Inc.
 
Big Data Analytics: Reference Architectures and Case Studies by Serhiy Haziye...
Big Data Analytics: Reference Architectures and Case Studies by Serhiy Haziye...Big Data Analytics: Reference Architectures and Case Studies by Serhiy Haziye...
Big Data Analytics: Reference Architectures and Case Studies by Serhiy Haziye...SoftServe
 
Big Data & Analytics Architecture
Big Data & Analytics ArchitectureBig Data & Analytics Architecture
Big Data & Analytics ArchitectureArvind Sathi
 
Big Data: Architectures and Approaches
Big Data: Architectures and ApproachesBig Data: Architectures and Approaches
Big Data: Architectures and ApproachesThoughtworks
 
Enterpriseanalytics superweek 2016 presentation
Enterpriseanalytics superweek 2016 presentationEnterpriseanalytics superweek 2016 presentation
Enterpriseanalytics superweek 2016 presentationIIH Nordic A/S
 

Viewers also liked (16)

Founding a Hadoop Data Science Lab
Founding a Hadoop Data Science LabFounding a Hadoop Data Science Lab
Founding a Hadoop Data Science Lab
 
Building Your Big Data Analytics Strategy- Impetus Webinar
Building Your Big Data Analytics Strategy- Impetus WebinarBuilding Your Big Data Analytics Strategy- Impetus Webinar
Building Your Big Data Analytics Strategy- Impetus Webinar
 
The Analytics CoE: Positioning your Business Analytics Program for Success
The Analytics CoE: Positioning your Business Analytics Program for SuccessThe Analytics CoE: Positioning your Business Analytics Program for Success
The Analytics CoE: Positioning your Business Analytics Program for Success
 
Big data analytics
Big data analyticsBig data analytics
Big data analytics
 
Enterprise Analytics Strategy: Taking Business Analytics to the User
Enterprise Analytics Strategy: Taking Business Analytics to the UserEnterprise Analytics Strategy: Taking Business Analytics to the User
Enterprise Analytics Strategy: Taking Business Analytics to the User
 
The Data Driven Enterprise - Roadmap to Big Data & Analytics Success
The Data Driven Enterprise - Roadmap to Big Data & Analytics SuccessThe Data Driven Enterprise - Roadmap to Big Data & Analytics Success
The Data Driven Enterprise - Roadmap to Big Data & Analytics Success
 
Building an Analytics CoE (Center of Excellence)
Building an Analytics CoE (Center of Excellence)Building an Analytics CoE (Center of Excellence)
Building an Analytics CoE (Center of Excellence)
 
Building Big Data Analytics Center Of Excellence
Building Big Data Analytics Center Of Excellence Building Big Data Analytics Center Of Excellence
Building Big Data Analytics Center Of Excellence
 
Big Data Analytics Strategy and Roadmap
Big Data Analytics Strategy and RoadmapBig Data Analytics Strategy and Roadmap
Big Data Analytics Strategy and Roadmap
 
Digital Transformation: Big Data and Data Science Learning Path
Digital Transformation: Big Data and Data Science Learning PathDigital Transformation: Big Data and Data Science Learning Path
Digital Transformation: Big Data and Data Science Learning Path
 
Creating a Next-Generation Big Data Architecture
Creating a Next-Generation Big Data ArchitectureCreating a Next-Generation Big Data Architecture
Creating a Next-Generation Big Data Architecture
 
Big Data Analytics: Reference Architectures and Case Studies by Serhiy Haziye...
Big Data Analytics: Reference Architectures and Case Studies by Serhiy Haziye...Big Data Analytics: Reference Architectures and Case Studies by Serhiy Haziye...
Big Data Analytics: Reference Architectures and Case Studies by Serhiy Haziye...
 
Big Data Architectural Patterns
Big Data Architectural PatternsBig Data Architectural Patterns
Big Data Architectural Patterns
 
Big Data & Analytics Architecture
Big Data & Analytics ArchitectureBig Data & Analytics Architecture
Big Data & Analytics Architecture
 
Big Data: Architectures and Approaches
Big Data: Architectures and ApproachesBig Data: Architectures and Approaches
Big Data: Architectures and Approaches
 
Enterpriseanalytics superweek 2016 presentation
Enterpriseanalytics superweek 2016 presentationEnterpriseanalytics superweek 2016 presentation
Enterpriseanalytics superweek 2016 presentation
 

More from John Sing

Welcome to 2015's Digital Enterprise IT Infrastructure
Welcome to 2015's Digital Enterprise IT Infrastructure   Welcome to 2015's Digital Enterprise IT Infrastructure
Welcome to 2015's Digital Enterprise IT Infrastructure John Sing
 
5 Disruptive Technologies Changing Healthcare - October 2014
5 Disruptive Technologies Changing Healthcare - October 20145 Disruptive Technologies Changing Healthcare - October 2014
5 Disruptive Technologies Changing Healthcare - October 2014John Sing
 
Resume john sing_2015_01_29_executive_it_architect_pre-sales_engineer
Resume john sing_2015_01_29_executive_it_architect_pre-sales_engineerResume john sing_2015_01_29_executive_it_architect_pre-sales_engineer
Resume john sing_2015_01_29_executive_it_architect_pre-sales_engineerJohn Sing
 
2015 IT Roadmap_Driving_Business_Success_v31
2015 IT Roadmap_Driving_Business_Success_v312015 IT Roadmap_Driving_Business_Success_v31
2015 IT Roadmap_Driving_Business_Success_v31John Sing
 
C cloud organizational_impacts_big_data_on-prem_vs_off-premise_john_sing
C cloud organizational_impacts_big_data_on-prem_vs_off-premise_john_singC cloud organizational_impacts_big_data_on-prem_vs_off-premise_john_sing
C cloud organizational_impacts_big_data_on-prem_vs_off-premise_john_singJohn Sing
 
Tutorial on the McKinsey/Harvard "Customer Decision Journey" by John Sing
Tutorial on the McKinsey/Harvard "Customer Decision Journey" by John SingTutorial on the McKinsey/Harvard "Customer Decision Journey" by John Sing
Tutorial on the McKinsey/Harvard "Customer Decision Journey" by John SingJohn Sing
 
Cloud_Big_Data_Analytics_Mobile_Social_modern_internet_scale_business_models_...
Cloud_Big_Data_Analytics_Mobile_Social_modern_internet_scale_business_models_...Cloud_Big_Data_Analytics_Mobile_Social_modern_internet_scale_business_models_...
Cloud_Big_Data_Analytics_Mobile_Social_modern_internet_scale_business_models_...John Sing
 
Hadoop_Its_Not_Just_Internal_Storage_V14
Hadoop_Its_Not_Just_Internal_Storage_V14Hadoop_Its_Not_Just_Internal_Storage_V14
Hadoop_Its_Not_Just_Internal_Storage_V14John Sing
 
To_Infinity_and_Beyond_2012_Big_Data_Internet_Scale_Update_November_2012_v2_J...
To_Infinity_and_Beyond_2012_Big_Data_Internet_Scale_Update_November_2012_v2_J...To_Infinity_and_Beyond_2012_Big_Data_Internet_Scale_Update_November_2012_v2_J...
To_Infinity_and_Beyond_2012_Big_Data_Internet_Scale_Update_November_2012_v2_J...John Sing
 
To_Infinity_and_Beyond_Internet_Scale_Workloads_Data_Center_Design_v6
To_Infinity_and_Beyond_Internet_Scale_Workloads_Data_Center_Design_v6To_Infinity_and_Beyond_Internet_Scale_Workloads_Data_Center_Design_v6
To_Infinity_and_Beyond_Internet_Scale_Workloads_Data_Center_Design_v6John Sing
 

More from John Sing (10)

Welcome to 2015's Digital Enterprise IT Infrastructure
Welcome to 2015's Digital Enterprise IT Infrastructure   Welcome to 2015's Digital Enterprise IT Infrastructure
Welcome to 2015's Digital Enterprise IT Infrastructure
 
5 Disruptive Technologies Changing Healthcare - October 2014
5 Disruptive Technologies Changing Healthcare - October 20145 Disruptive Technologies Changing Healthcare - October 2014
5 Disruptive Technologies Changing Healthcare - October 2014
 
Resume john sing_2015_01_29_executive_it_architect_pre-sales_engineer
Resume john sing_2015_01_29_executive_it_architect_pre-sales_engineerResume john sing_2015_01_29_executive_it_architect_pre-sales_engineer
Resume john sing_2015_01_29_executive_it_architect_pre-sales_engineer
 
2015 IT Roadmap_Driving_Business_Success_v31
2015 IT Roadmap_Driving_Business_Success_v312015 IT Roadmap_Driving_Business_Success_v31
2015 IT Roadmap_Driving_Business_Success_v31
 
C cloud organizational_impacts_big_data_on-prem_vs_off-premise_john_sing
C cloud organizational_impacts_big_data_on-prem_vs_off-premise_john_singC cloud organizational_impacts_big_data_on-prem_vs_off-premise_john_sing
C cloud organizational_impacts_big_data_on-prem_vs_off-premise_john_sing
 
Tutorial on the McKinsey/Harvard "Customer Decision Journey" by John Sing
Tutorial on the McKinsey/Harvard "Customer Decision Journey" by John SingTutorial on the McKinsey/Harvard "Customer Decision Journey" by John Sing
Tutorial on the McKinsey/Harvard "Customer Decision Journey" by John Sing
 
Cloud_Big_Data_Analytics_Mobile_Social_modern_internet_scale_business_models_...
Cloud_Big_Data_Analytics_Mobile_Social_modern_internet_scale_business_models_...Cloud_Big_Data_Analytics_Mobile_Social_modern_internet_scale_business_models_...
Cloud_Big_Data_Analytics_Mobile_Social_modern_internet_scale_business_models_...
 
Hadoop_Its_Not_Just_Internal_Storage_V14
Hadoop_Its_Not_Just_Internal_Storage_V14Hadoop_Its_Not_Just_Internal_Storage_V14
Hadoop_Its_Not_Just_Internal_Storage_V14
 
To_Infinity_and_Beyond_2012_Big_Data_Internet_Scale_Update_November_2012_v2_J...
To_Infinity_and_Beyond_2012_Big_Data_Internet_Scale_Update_November_2012_v2_J...To_Infinity_and_Beyond_2012_Big_Data_Internet_Scale_Update_November_2012_v2_J...
To_Infinity_and_Beyond_2012_Big_Data_Internet_Scale_Update_November_2012_v2_J...
 
To_Infinity_and_Beyond_Internet_Scale_Workloads_Data_Center_Design_v6
To_Infinity_and_Beyond_Internet_Scale_Workloads_Data_Center_Design_v6To_Infinity_and_Beyond_Internet_Scale_Workloads_Data_Center_Design_v6
To_Infinity_and_Beyond_Internet_Scale_Workloads_Data_Center_Design_v6
 

Recently uploaded

Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfEnterprise Knowledge
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...Neo4j
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Servicegiselly40
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...apidays
 
Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessAdvantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessPixlogix Infotech
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUK Journal
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)wesley chun
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreternaman860154
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...Martijn de Jong
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processorsdebabhi2
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024The Digital Insurer
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking MenDelhi Call girls
 

Recently uploaded (20)

Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessAdvantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your Business
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 

Big data journey_to_value_v5_john_sing

  • 1. © 2014 John Sing – All Rights Reserved Big Data’s Journey to Value Making Data Actionable Opening video John Sing, Executive IT Architect
  • 2. © 2015 John Sing – All Rights Reserved University of South Florida - Spring 2015 2 John Sing  32 years of experience in enterprise servers, storage, and software – 2015: IBM Product Manager – Spectrum Scale Storage – 2014: Director of Technology, 4cube – Infrastructure for Tomorrow – 2009 – 2013: IBM Executive IT Consultant: IT Strategy and Planning, Enterprise Large Scale Storage, Internet Scale Workloads and Data Center Design, Big Data Analytics, HA/DR/BC – 2002-2008: IBM IT Data Center Strategy, Large Scale Systems, Business Continuity, HA/DR/BC, IBM Storage – 1998-2001: IBM Storage Subsystems Group – Worldwide Marketing, Technical Support, Product Planner, Product Manager – Before that: • IBM Hong Kong, IBM China, IBM USA  john@johnsing.us  Follow me on Twitter: http://twitter.com/john_sing  Follow me on Slideshare.net: – http://www.slideshare.net/johnsing1  Blog: – http://johnsing.technology  LinkedIn: – http://www.linkedin.com/in/johnsing
  • 3. © 2015 John Sing – All Rights Reserved University of South Florida - Spring 2015 3 Big Data’s Journey to Value Data + Analytics = Information Insight Desired Outcomes Information + Context = Insight + Actions =
  • 4. © 2015 John Sing – All Rights Reserved University of South Florida - Spring 2015 4 You know how much data there is…
  • 5. © 2015 John Sing – All Rights Reserved University of South Florida - Spring 2015 5 You know how to analyze Big Data Goal: Analyze *all* the data real time Original source: Wikibon.org, “Big Data”, http://wikibon.org/blog/ten-%E2%80%9Cbig-data%E2%80%9D-realities-and-what-they-mean-to-you/ Very large Loosely structured Often incomplete Sampling not strategically competitive
  • 6. © 2015 John Sing – All Rights Reserved University of South Florida - Spring 2015 6 Time ComputingPowerGrowth Traditional business “sensemaking” capability Available data for observation ContextEnterprise Amnesia What “Big Data” solves: Chart by: Jeff Jonas/Las Vegas/IBM, Chief Scientist, Context Computing: http://jeffjonas.typepad.com/
  • 7. © 2015 John Sing – All Rights Reserved University of South Florida - Spring 2015 7 Enterprise Amnesia, definition A defect in memory, resulting in missed opportunity, wasted resources, lower revenues, unnecessary fraud losses, and other bad news.
  • 8. © 2015 John Sing – All Rights Reserved University of South Florida - Spring 2015 8 Time ComputingPowerGrowth Traditional business “sensemaking” capability Available data for observation ContextEnterprise Amnesia Enterprise Amnesia examples….. Chart by: Jeff Jonas/Las Vegas/IBM, Chief Scientist, Context Computing: http://jeffjonas.typepad.com/
  • 9. © 2015 John Sing – All Rights Reserved University of South Florida - Spring 2015 9 Time ComputingPowerGrowth Data + Analytics = “Information” Traditional business “sensemaking” Available Observation Space Context Big Data acquisition = New, Useful InformationAdd: Analytics What comes after “Information”?
  • 10. © 2015 John Sing – All Rights Reserved University of South Florida - Spring 2015 10 Big Data’s Journey to Value Data + Analytics = Information Insight Desired Outcomes Information + Context = Insight + Actions =
  • 11. © 2015 John Sing – All Rights Reserved University of South Florida - Spring 2015 11 Context More about Jeff Jonas, IBM Chief Scientist, Context Computing: http://bit.ly/1g3z9ZQ Jeff Jonas, IBM Chief Scientist Context Computing
  • 12. © 2015 John Sing – All Rights Reserved University of South Florida - Spring 2015 12 Here’s more from IBM’s Jeff Jonas about “Context”: Tubechop: http://www.tubechop.com/watch/5634618
  • 13. © 2015 John Sing – All Rights Reserved University of South Florida - Spring 2015 13 No Context scrila34@msn.com
  • 14. © 2015 John Sing – All Rights Reserved University of South Florida - Spring 2015 14 Context, definition Better understanding something by taking into account the things around it.
  • 15. © 2015 John Sing – All Rights Reserved University of South Florida - Spring 2015 15 Information in Context … = Insights Top 200 Customer Job Applicant Identity Thief Criminal Investigation scrila34@msn.com
  • 16. © 2015 John Sing – All Rights Reserved University of South Florida - Spring 2015 16 The Puzzle Metaphor: what we mean by “Context”  Imagine an ever-growing pile of puzzle pieces of varying sizes, shapes and colors  What it represents is unknown – there is no picture on hand  Is it one puzzle, 15 puzzles, or 1,500 different puzzles?  Some pieces are duplicates, missing, incomplete, low quality, or have been misinterpreted  Some pieces may even be professionally fabricated lies  Until you take the pieces to the table and attempt assembly, you don’t know what you are dealing with
  • 17. © 2015 John Sing – All Rights Reserved University of South Florida - Spring 2015 17 Here’s a “context” example…….. “Puzzling” 270 pieces 90% 200 pieces 66% 150 pieces 50% 6 pieces 2% (pure noise) 30 pieces 10% (duplicates)
  • 18. © 2015 John Sing – All Rights Reserved University of South Florida - Spring 2015 18
  • 19. © 2015 John Sing – All Rights Reserved University of South Florida - Spring 2015 19
  • 20. © 2015 John Sing – All Rights Reserved University of South Florida - Spring 2015 20 First Discovery
  • 21. © 2015 John Sing – All Rights Reserved University of South Florida - Spring 2015 21 More Data Finds Data
  • 22. © 2015 John Sing – All Rights Reserved University of South Florida - Spring 2015 22 Duplicates in Front Of Your Eyes
  • 23. © 2015 John Sing – All Rights Reserved University of South Florida - Spring 2015 23 First Duplicate Found Here
  • 24. © 2015 John Sing – All Rights Reserved University of South Florida - Spring 2015 24
  • 25. © 2015 John Sing – All Rights Reserved University of South Florida - Spring 2015 25
  • 26. © 2015 John Sing – All Rights Reserved University of South Florida - Spring 2015 26 Incremental Context – Incremental Discovery 6:40pm START 22min “Hey, this one is a duplicate!” 35min “I think some pieces are missing.” 37min “Looks like a bunch of hillbillies on a porch.” 44min “Hillbillies, playing guitars, sitting on a porch, near a barber sign … and a banjo!”
  • 27. © 2015 John Sing – All Rights Reserved University of South Florida - Spring 2015 27 150 pieces 50%
  • 28. © 2015 John Sing – All Rights Reserved University of South Florida - Spring 2015 28 Incremental Context – Incremental Discovery 47min “We should take the sky and grass off the table.” 2hr “Let’s switch sides, and see if we can make sense of this from different perspectives.” 2hr10m “Wait, there are three … no, four puzzles.” 2hr17m “We need a bigger table.” 2hr18m “I think you threw in a few random pieces.”
  • 29. © 2015 John Sing – All Rights Reserved University of South Florida - Spring 2015 29
  • 30. © 2015 John Sing – All Rights Reserved University of South Florida - Spring 2015 30
  • 31. © 2015 John Sing – All Rights Reserved University of South Florida - Spring 2015 31 Context Accumulates….. Into “Insights”  With each new observation … one of three assertions are made: – 1) Un-associated; – 2) placed near like neighbors; or – 3) connected  New observations sometimes reverse earlier assertions  Some observations produce new discovery  As the working space expands, computational effort increases  Given sufficient observations, there can come a tipping point. Thereafter, confidence improves while computational effort decreases!
  • 32. © 2015 John Sing – All Rights Reserved University of South Florida - Spring 2015 32 What Can you See in Context now?
  • 33. © 2015 John Sing – All Rights Reserved University of South Florida - Spring 2015 33 Big Data [in context] = Insights. More data: better the predictions – Lower false positives – Lower false negatives More data: bad data … good – Suddenly glad your data was not perfect More data: less compute
  • 34. © 2015 John Sing – All Rights Reserved University of South Florida - Spring 2015 34 Big Data’s Journey to Value Data + Analytics = Information Insight Desired Outcomes Information + Context = Insight + Actions =
  • 35. © 2015 John Sing – All Rights Reserved University of South Florida - Spring 2015 35 Now that I create Insights..…. how do I take Action? Chart in public domain: IEEE Massive File Storage presentation, author: Bill Kramer, NCSA: http://storageconference.org/2010/Presentations/MSST/1.Kramer.pdf:
  • 36. © 2015 John Sing – All Rights Reserved University of South Florida - Spring 2015 36 Answer: build actionable systems that use the insights Chart in public domain: IEEE Massive File Storage presentation, author: Bill Kramer, NCSA: http://storageconference.org/2010/Presentations/MSST/1.Kramer.pdf: n d Actionable Systems
  • 37. © 2015 John Sing – All Rights Reserved University of South Florida - Spring 2015 37 Projected traffic Insights •10 minute-ahead volume forecast (blue) vs. actual value (black) •10 minute-ahead speed forecast (blue) vs. actual value (black). Black line: actions via signals = desired outcome Stockholm: http://www.youtube.com/watch?v=rfMylzF4lv8  Actionable traffic signals Blue line: analytics prediction 10 minutes in advance
  • 38. © 2015 John Sing – All Rights Reserved University of South Florida - Spring 2015 38 Insights based on crime  actions: where to deploy of officers  Blue CRUSH predictive analysis for officer deployment & risk management generated easy-to-read crime maps every four hours  Richmond, VA: Violent crime decreased in the first year by 32%, another 40% thereafter, moving Richmond from #5 on the list of the most dangerous US cities to #99 Memphis Blue CRUSH MapMemphis Blue CRUSH Map Police videos: http://www.youtube.com/watch?v=8SJQtn4RO7I Play video https://www.youtube.com/watch?v=_xsffIAHY3I
  • 39. © 2015 John Sing – All Rights Reserved University of South Florida - Spring 2015 39 Local Applications: Big Data’s Journey to Value Data + Analytics = Information Insight Desired Outcomes Information + Context = Insight + Actions =
  • 40. © 2015 John Sing – All Rights Reserved University of South Florida - Spring 2015 40 Local examples
  • 41. © 2015 John Sing – All Rights Reserved University of South Florida - Spring 2015 41 Local examples
  • 42. © 2015 John Sing – All Rights Reserved University of South Florida - Spring 2015 42 Local examples
  • 43. © 2015 John Sing – All Rights Reserved University of South Florida - Spring 2015 43 Quiz: in following Futuristic video see if you can identify: Data + Analytics = Information Information + Context = Insight Insight + Actions = Desired Outcomes
  • 44. © 2015 John Sing – All Rights Reserved University of South Florida - Spring 2015 44  Cognitive Video The Future – Creating Actionable Big Data
  • 45. © 2015 John Sing – All Rights Reserved University of South Florida - Spring 2015 45 Final Quiz: Big Data’s Journey to Value Data + Analytics = Information Insight Desired Outcomes Information + Context = Insight + Actions =
  • 46. © 2015 John Sing – All Rights Reserved University of South Florida - Spring 2015 46 Thank You Merci Grazie ObrigadoDanke Japanese Hebrew English French Russian German Italian Brazilian Portuguese Arabic Traditional Chinese Simplified Chinese Hindi Tamil Korean Thai TesekkurlerTurkish
  • 47. © 2015 John Sing – All Rights Reserved University of South Florida - Spring 2015 47
  • 48. © 2015 John Sing – All Rights Reserved University of South Florida - Spring 2015 48 Does Corning understand “Actionable” data? Predicting the future ….. https://www.youtube.com/watch?v=PfgmlVxLC9w

Editor's Notes

  1. Jeff Jonas video about Enterprise Amnesia: https://www.youtube.com/watch?v=52VWaf0XxNY
  2. Jeff Jonas video about Enterprise Amnesia: https://www.youtube.com/watch?v=52VWaf0XxNY
  3. Jeff Jonas video about Enterprise Amnesia: https://www.youtube.com/watch?v=52VWaf0XxNY
  4. Other good Jeff Jonas videos include: https://www.youtube.com/watch?v=yHA1h8gZwls
  5. BACKUP Another great example of using predictive technology is in the City of Richmond. Richmond, Virginia had a significant problem with violent crime. In fact, in one year, they were listed as the 9th most dangerous large city in the US. And this was not a one time problem. The following year, Richmond increased it’s rank to #5! The city had no interest in becoming the #1 most dangerous city and wanted to do something different… and do it quickly! IBM helped the City of Richmond to analyze its crime data and provide enhanced predictions on the times and locations with the highest probability of crimes. The City was able to align its resources to the areas that were most likely to experience crimes As a result, violent crime decreased in the first year by 32%. And this also wasn’t a 1-time decrease. The following year, violent crime fell another 40% moving Richmond from #5 on the list of the most dangerous US cities to #99. Most cities can’t afford to keep adding new resources. Our goal is to use our resources more effectively in fighting crime and keeping our cities safe. On our smarter planet, technology can help us do that.
  6. Thank you!