SlideShare a Scribd company logo
1 of 33
Download to read offline
© Cloudera, Inc. All rights reserved.
BEST PRACTICES FOR MANAGING AND SHARING
DATA IN A CONNECTED WORLD
Sanjay Kumar
General Manager, Telecommunications & Media, Cloudera
Michael Ger
General Manager, Manufacturing & Automotive, Cloudera
March 21st, 2019
© Cloudera, Inc. All rights reserved. 2© Cloudera, Inc. All rights reserved.
AGENDA
Connected World
Connected Communities
Data-Driven Business Models
Establishing Trust
Architecture for Success
Q & A
© Cloudera, Inc. All rights reserved. 3© Cloudera, Inc. All rights reserved.
Connected Vehicle Data
10X by
2020*
Annual Connected Vehicle Data
to Grow Almost 10X By 2020*
* Source: Cowen and Company, Gartner
DATA EXPLOSION
And Autonomous Vehicles Will
Increase this by a further 25X**
Autonomous Vehicle Data
** Source: Cowen and Company, Datameer
TERABYTES
per vehicle,
per day
© Cloudera, Inc. All rights reserved. 4© Cloudera, Inc. All rights reserved.
THE TRILLION DOLLAR QUESTION
How to Monetize the Connected Vehicle?
Sources of Future Growth (McKinsey)
67% Growth
45% Growth
• Lower Margin
• Capital Intensive
New Connected Services:
A $1.5 Trillion Opportunity
4900% Growth
• Higher Margin
• Less Capital Intensive
© Cloudera, Inc. All rights reserved. 5© Cloudera, Inc. All rights reserved.
• Evolving to Cross-Industry Connected Ecosystems
• Powered by Connected Communities
DATA IS TRANSFORMING INDUSTRIES
© Cloudera, Inc. All rights reserved. 6© Cloudera, Inc. All rights reserved.
CONNECTED VEHICLE IS LEADING THE TRANSFORMATION
Monetizing the Connected Vehicle
Insurance
Retailers
Cities
Dynamic transportation &
infrastructure mgt. and
establishing merchant
community hub
Data-driven policy
decision-making without
data liability
Dynamic interactions
with close proximity
target audiences
Home
& Work
Improve consumer quality
of life via car/home/work
integration (i.e. security,
climate, home supply mgt.)
Dealer
Service
Energy
Real-time grid capacity
management based on
vehicle movements
Real-time service for
lifetime relationship with
Customer
Cars
Telco
© Cloudera, Inc. All rights reserved. 7© Cloudera, Inc. All rights reserved.
Multi-Party
• Across Value Chains
‐ Suppliers, OEMS, Consumers
• Across Lines of Business
• Across Geographies
Connected By Data
• Public and Private
• Historic and Real-Time
• Cloud and On-Premise
Membership By Need
• Business Insight Communities
• Commerce Communities
• Supply Chain Communities
• Etc.
“A group of parties that come together to share data responsibly
for value- driven insights for each party”
WHAT IS A CONNECTED COMMUNITY?
© Cloudera, Inc. All rights reserved. 8© Cloudera, Inc. All rights reserved.
WHAT AN AUTOMOTIVE CONNECTED COMMUNITY CAN LOOK LIKE
ASK
QUESTIONS
DELIVER
INSIGHTS
End-Users
Secured views of
data and insights
Connected
Cars & Devices SuppliersOEMs
Connected Communities
Data
Providers
•Control who can
see what data
•Control what
data can be
combined
CitiesInsurance Homes EnergyRetailers
Dealers
Researchers Government Gas Stations
© Cloudera, Inc. All rights reserved. 9© Cloudera, Inc. All rights reserved.
Monetization of
Data
Connected Car: New revenues by monetized
customer profile and location data
Smart City: New revenues by monetized
customer profile and location data
Real-Time Operational
Models
Connected Car: Cost savings from predictive
maintenance
Smart City: Cost savings from predictive
maintenance
New Models for
Commerce and Trade
Connected Car: New revenue from location-
aware E-commerce
Smart City: New revenue from location-aware
E-commerce
Supply Chain
Data Exchange
Connected Supply Chain: Improves supply chain
efficiencies through sharing of real-time and
historical data
OPPORTUNITIES TO CREATE BUSINESS VALUE ACROSS
CONNECTED COMMUNITIES
© Cloudera, Inc. All rights reserved. 10© Cloudera, Inc. All rights reserved.
MONETIZATION OF DATA
Combining Customer Profile and Locations
Insight as
a Service
ASK QUESTION
DELIVER INSIGHT
Insights to driver, consumer
and resident demographics
for target marketing
INSIGHTS PROVIDED
Demographics of drivers close
to retail locations for target
marketing
Citizens demographic
movement patterns for auto,
life and corporate insurance
Retailers
Automotive
OEM
Insurance
Provider
Smart City
Community
Per City
NewYork
Chicago
SanFrancisco
Smart City
Consumer
Registration
Consumer
”Opt-In”
© Cloudera, Inc. All rights reserved. 11© Cloudera, Inc. All rights reserved.
REAL-TIME OPERATIONAL MODELS
Cost Savings from Predictive Maintenance
Insight as
a Service
Connected Car
Community
Per Country
Germany
UnitedStates
China
ASK QUESTION
DELIVER INSIGHT
Fleet failure predictions and
maintenance alerts for just-
in -time servicing
INSIGHTS PROVIDED
Connected Cars
Maintain just-in-time
inventory levels in
distribution centers based on
real-time maintenance needs
Fleet
Operators
Car Dealers
Vehicle telematics alerts to
dealers for real-time dynamic
servicing
Suppliers
© Cloudera, Inc. All rights reserved. 12© Cloudera, Inc. All rights reserved.
NEW MODELS FOR COMMERCE AND TRADE
Location-Based Commerce
Data
Exchange
Connected Car
Community
Per Country
Germany
UnitedStates
China
Vehicle patterns in local
marketplace for target
marketing & promotions
INSIGHTS PROVIDED
Connected Cars
In-car bidding among close
proximity gasoline stations,
automated payment upon
receipt
In car e-purchasing
experience of goods for
pickup at retailer drive-thru
Consumer
”Opt-In”
Retailers
Gas Stations
Smart Cities
© Cloudera, Inc. All rights reserved. 13© Cloudera, Inc. All rights reserved.
CONNECTED SUPPLY CHAINS
Reduce Costs via Sharing of Real-Time and Historical Supply Chain Data
Insight as
a Service
Connected
Supply Chains
Per Country
Germany
UnitedStates
China
ASK QUESTION
DELIVER INSIGHT
Supplier shipment and
capacity information to
optimize production levels
INSIGHTS PROVIDED
OEM production and demand
information to minimize
disruptions and inventory
Connected Trucks
Connected
Inventory
Suppliers
Auto OEM
© Cloudera, Inc. All rights reserved. 14© Cloudera, Inc. All rights reserved.
COMMUNITY DATA VALUE
Increases with Data Participants and Volume
LOWEST VALUE
Community Data Volume
HIGHEST VALUE
Learning
• Many Community Participants
• Large Community Data Volume
Contextual Understanding
MID-LEVEL VALUE
Contextual Understanding
• Limited Community Participants
• Large Community Data Volume
Learning
• Limited Community Participants
Contextual Understanding
• Limited Community Data Volume
Learning
MID-LEVEL VALUE
• Many Community Participants
• Limited Community Data Volume
Contextual Understanding
Learning
#Community
Participants
© Cloudera, Inc. All rights reserved. 15© Cloudera, Inc. All rights reserved.
COMMUNITY DATA VALUE
Value Curves Vary By Connected Communities
LOWEST VALUE
Community Data Volume
HIGHEST VALUE
Learning
• Many Community Participants
• Large Community Data Volume
Contextual Understanding
MID-LEVEL VALUE
Contextual Understanding
• Limited Community Participants
• Large Community Data Volume
Learning
• Limited Community Participants
Contextual Understanding
• Limited Community Data Volume
Learning
MID-LEVEL VALUE
• Many Community Participants
• Limited Community Data Volume
Contextual Understanding
Learning
#Community
Participants
© Cloudera, Inc. All rights reserved. 16© Cloudera, Inc. All rights reserved.
Insight/Benefit Provided
EXAMPLE: VEHICLE COLLISION AND REPAIR CYCLE
OEM
City
Data Provided
• Vehicle position
• Airbag deployment status
• Recent vehicle speed
OEM
City
End-Users
Secured views of
data and insights
ASK QUESTION
DELIVER INSIGHT
Data Providers
• Control who can see
what data
• Control what data can
be combined
Connected Communities
• Emergency dispatch
information
Body
Shop
Body
Shop
• Repair quote
• Repair service opportunity
• Participation in Autobody
Exchange
• Leverage historical data for
quoting, inventory mgt.
• Repair part opportunity
• Data monetization across
ecosystem
• Awareness of accidents and
high-danger locations
• Safer cities
• Cost-effective execution
Insurance Insurance• Authorization for repair • Awareness of accident
• At-risk drivers
• More accurate risk profiles
• Fraud avoidance
• Competition-based repair
© Cloudera, Inc. All rights reserved. 17© Cloudera, Inc. All rights reserved.
AGGREGATED DATA FOR MACHINE LEARNING AND AI INSIGHTS
• Events per location, demographic,
vehicle type, etc.
• Performance versus other cities?
City
• Accident analysis by location, site
condition, safety outcomes
• Performance vs. other OEMs
OEM
• Accident insights per location,
vehicle, vehicle type
• At-risk drivers, more accurate risk
profiles
• Fraud avoidance
Insurance
• Historical insights for quoting,
inventory and staffing mgt.
Body
Shop
Multiple Vehicle
Event Lifecycles
Multiple Vehicle
Event Lifecycles
© Cloudera, Inc. All rights reserved. 18© Cloudera, Inc. All rights reserved.
EXTENDED ECOSYSTEM FOR MACHINE LEARNING AND AI INSIGHTS
Multiple Vehicle
Event Lifecycles
Multiple Vehicle
Event Lifecycles
• Data driving policies and
investments in infrastructure,
education, PR, benefits and
compensation
State &
Federal
Govts.
• Location, season and accident type
specific product and service offers
Commerce
• Staff scheduling and resource
planning, other hospital
treatments and outcomes
Hospitals
• Accident statistics (accidents
probability per location type, car
type, time of day, consumer
demographic, etc.)
Other
Cities
© Cloudera, Inc. All rights reserved. 19© Cloudera, Inc. All rights reserved.
VALUE OF CONNECTED COMMUNITY APPROACH
BENEFIT
Rapidly evolving industry
business models
• Flexible model for participants and users
• Risk mitigation – rapidly respond to
business opportunities
• Manage all types of data (structured,
unstructured, real-time and historical)
• Relevant data defined by community
Constantly evolving
data needs
Trust within
Community
• Participant control drives data confidence
within community
• Essential to becoming global marketplace
© Cloudera, Inc. All rights reserved. 20© Cloudera, Inc. All rights reserved.
SO, YOU WANT TO CREATE A CONNECTED COMMUNITY?
© Cloudera, Inc. All rights reserved. 21© Cloudera, Inc. All rights reserved.
Can I trust this
data?
Who owns this
data?
Where has data
come from?
Where has
data gone to?
Is this the best
version of the
data?
How has data
changed?
SHARED DATA…. SCARY QUESTIONS
© Cloudera, Inc. All rights reserved. 22© Cloudera, Inc. All rights reserved.
ESTABLISHING TRUST – WHAT’S REQUIRED?
End-Users
Secured views of
data and insights
ASK QUESTION
DELIVER INSIGHT
Data Providers
• Control who can see
what data
• Control what data can
be combined
Connected Communities
✓ Data access across systems
• Each data provider shares specific data assets and
defines specific data sharing rules
✓ Controlling who sees what data
• Each data provider precisely defines which end-users
can see their data throughout the data lifecycle
✓ Data audit across the ecosystem
• Each data provider can track data usage across the data
lifecycle, including the data’s origin, where it is used,
and how it changes over time
© Cloudera, Inc. All rights reserved. 23© Cloudera, Inc. All rights reserved.
HOW IT WORKS…..
Connected Vehicle Community
CLUSTER
MANGEMENT
• Cluster registration and visibility across
on-premise, Cloud and Hybrid
deployments
OEM 1 OEM 2 Government Researcher Retailer Home
USER & SECURITY
MANAGEMENT
• User authentication synched with
enterprise identity systems
• Centralize data security roles, privileges
and policies across clusters
Role 1
• Privilege 1
• Privilege 2
• Privilege N
Role 2
• Privilege 3
• Privilege 4
• Privilege N
Role 3
• Privilege 5
• Privilege 6
• Privilege N
Role 4
• Privilege 7
• Privilege 8
• Privilege N
Centralized Management of Core Functions
HORTONWORKS DATAPLANE SERVICE
• Track Data Lineage across data lifecycle
• Track Data Audit across data lifecycle
• Complimentary with BlockChain
DATA LIFECYCLE
MANAGEMENT Ingest Transform Edit Export
BLOCKCHAIN
GATE
BLOCKCHAIN
GATE
© Cloudera, Inc. All rights reserved. 24
© Cloudera, Inc. All rights reserved. 25
Single View of All Data Sources
© Cloudera, Inc. All rights reserved. 26
Asset Collections
© Cloudera, Inc. All rights reserved. 27
Tables
Asset Collection Details
© Cloudera, Inc. All rights reserved. 28
Tagging of Sensitive
Information
Customer Emergency Event Data
© Cloudera, Inc. All rights reserved. 29
Adding Security Policies
Table and Field
Level Controls
POLICIES USERS
© Cloudera, Inc. All rights reserved. 30
Data Lineage (For Table)
Customer Emergency
Contact Information
Vehicle Event
Data
Accident Detail
(For Use by City
Emergency Dispatch)
Aggregated Detail
(For Use by Various
Research Entities)
© Cloudera, Inc. All rights reserved. 31
Event Time
Audit Trail
Event Type
© Cloudera, Inc. All rights reserved. 32© Cloudera, Inc. All rights reserved.
IN CONCLUSION
Connected Communities Will Drive
the Value of the Connected World
New Data-Driven Business Models
Trust in Data is Paramount
Technologies Have Emerged to
Make this Possible
© Cloudera, Inc. All rights reserved.
THANK YOU

More Related Content

What's hot

What's hot (19)

Use-case Analysis to Mitigate Value at Risk in Telecom
Use-case Analysis to Mitigate Value at Risk in TelecomUse-case Analysis to Mitigate Value at Risk in Telecom
Use-case Analysis to Mitigate Value at Risk in Telecom
 
IBM Rational Software Conference 2009 Day 2 Keynote: Steve Mills
IBM Rational Software Conference 2009 Day 2 Keynote: Steve MillsIBM Rational Software Conference 2009 Day 2 Keynote: Steve Mills
IBM Rational Software Conference 2009 Day 2 Keynote: Steve Mills
 
Software AG's Cumulocity IoT - Cloud based IoT Integration
Software AG's Cumulocity IoT - Cloud based IoT IntegrationSoftware AG's Cumulocity IoT - Cloud based IoT Integration
Software AG's Cumulocity IoT - Cloud based IoT Integration
 
GDPR: 20 Million Reasons to Get Ready - Part 2: Living Compliance
GDPR: 20 Million Reasons to Get Ready - Part 2: Living ComplianceGDPR: 20 Million Reasons to Get Ready - Part 2: Living Compliance
GDPR: 20 Million Reasons to Get Ready - Part 2: Living Compliance
 
Big Data Techcon 2014
Big Data Techcon 2014Big Data Techcon 2014
Big Data Techcon 2014
 
The IoT-CSX Transformation
The IoT-CSX TransformationThe IoT-CSX Transformation
The IoT-CSX Transformation
 
Proactive Services Through Insights and IoT by M. Capone
Proactive Services Through Insights and IoT by M. CaponeProactive Services Through Insights and IoT by M. Capone
Proactive Services Through Insights and IoT by M. Capone
 
Internet of Things Microservices
Internet of Things MicroservicesInternet of Things Microservices
Internet of Things Microservices
 
Meghdoot noida cloud data center
Meghdoot noida cloud data centerMeghdoot noida cloud data center
Meghdoot noida cloud data center
 
The Automotive Journey Into the Cloud
The Automotive Journey Into the CloudThe Automotive Journey Into the Cloud
The Automotive Journey Into the Cloud
 
Traversing the Digital Vortex, Lux Rao, Director & Leader, Digital Transforma...
Traversing the Digital Vortex, Lux Rao, Director & Leader, Digital Transforma...Traversing the Digital Vortex, Lux Rao, Director & Leader, Digital Transforma...
Traversing the Digital Vortex, Lux Rao, Director & Leader, Digital Transforma...
 
Manufacturing with Internet of Things
Manufacturing with Internet of ThingsManufacturing with Internet of Things
Manufacturing with Internet of Things
 
Infrastructure as a Service (IaaS)
Infrastructure as a Service (IaaS)Infrastructure as a Service (IaaS)
Infrastructure as a Service (IaaS)
 
Msc Presentation
Msc PresentationMsc Presentation
Msc Presentation
 
IBM vision for aviation
IBM vision for aviationIBM vision for aviation
IBM vision for aviation
 
Dell Digital Transformation Through AI and Data Analytics Webinar
Dell Digital Transformation Through AI and  Data Analytics WebinarDell Digital Transformation Through AI and  Data Analytics Webinar
Dell Digital Transformation Through AI and Data Analytics Webinar
 
New Era in Insurance - Cloud Computing
New Era in Insurance - Cloud ComputingNew Era in Insurance - Cloud Computing
New Era in Insurance - Cloud Computing
 
The digital transformation of CPG and manufacturing
The digital transformation of CPG and manufacturingThe digital transformation of CPG and manufacturing
The digital transformation of CPG and manufacturing
 
Webinar - IoT - Business Transformation Launchpad
Webinar - IoT - Business Transformation LaunchpadWebinar - IoT - Business Transformation Launchpad
Webinar - IoT - Business Transformation Launchpad
 

Similar to Best Practices for Managing and Sharing Data in a Connected World

Arynga webinar: monetize connected car
Arynga webinar: monetize connected carArynga webinar: monetize connected car
Arynga webinar: monetize connected car
Arynga
 
citimonitizingconnectedcar-140114145514-phpapp02
citimonitizingconnectedcar-140114145514-phpapp02citimonitizingconnectedcar-140114145514-phpapp02
citimonitizingconnectedcar-140114145514-phpapp02
Fumihiko Kondo
 
Sept2015Connected Car short
Sept2015Connected Car shortSept2015Connected Car short
Sept2015Connected Car short
Laurent Gibert
 

Similar to Best Practices for Managing and Sharing Data in a Connected World (20)

MONETIZING THE CONNECTED CAR, Citi 2013 Connected Car Symposium
MONETIZING  THE CONNECTED CAR, Citi 2013 Connected Car SymposiumMONETIZING  THE CONNECTED CAR, Citi 2013 Connected Car Symposium
MONETIZING THE CONNECTED CAR, Citi 2013 Connected Car Symposium
 
Enabling the Connected Car Revolution

Enabling the Connected Car Revolution
Enabling the Connected Car Revolution

Enabling the Connected Car Revolution

 
Arynga webinar: monetize connected car
Arynga webinar: monetize connected carArynga webinar: monetize connected car
Arynga webinar: monetize connected car
 
Air Mercedes
Air MercedesAir Mercedes
Air Mercedes
 
SAP Leonardo Smart Mobility SEMICON
SAP Leonardo Smart Mobility SEMICONSAP Leonardo Smart Mobility SEMICON
SAP Leonardo Smart Mobility SEMICON
 
AICAS Automotive Insurance
AICAS Automotive InsuranceAICAS Automotive Insurance
AICAS Automotive Insurance
 
Automotive Aftermarket Trends 2023
Automotive Aftermarket Trends 2023Automotive Aftermarket Trends 2023
Automotive Aftermarket Trends 2023
 
Elite EXTRA Routing and Tracking for Deliveries System Overview
Elite EXTRA Routing and Tracking for Deliveries System OverviewElite EXTRA Routing and Tracking for Deliveries System Overview
Elite EXTRA Routing and Tracking for Deliveries System Overview
 
Swiss Re - Insurer Innovation Award 2022
Swiss Re - Insurer Innovation Award 2022Swiss Re - Insurer Innovation Award 2022
Swiss Re - Insurer Innovation Award 2022
 
citimonitizingconnectedcar-140114145514-phpapp02
citimonitizingconnectedcar-140114145514-phpapp02citimonitizingconnectedcar-140114145514-phpapp02
citimonitizingconnectedcar-140114145514-phpapp02
 
Connected Car Investment Thesis
Connected Car Investment ThesisConnected Car Investment Thesis
Connected Car Investment Thesis
 
Engineering Services Forum - Tech Mahindra & Sensedriver
Engineering Services Forum -  Tech Mahindra & SensedriverEngineering Services Forum -  Tech Mahindra & Sensedriver
Engineering Services Forum - Tech Mahindra & Sensedriver
 
Connected Vehicle Business Proposal - Pitkraft
Connected Vehicle Business Proposal - PitkraftConnected Vehicle Business Proposal - Pitkraft
Connected Vehicle Business Proposal - Pitkraft
 
Connected and Self-Driving Vehicles Spark Industry Convergence
Connected and Self-Driving Vehicles Spark Industry ConvergenceConnected and Self-Driving Vehicles Spark Industry Convergence
Connected and Self-Driving Vehicles Spark Industry Convergence
 
Sept2015Connected Car short
Sept2015Connected Car shortSept2015Connected Car short
Sept2015Connected Car short
 
Insights into Action – recent examples leveraging big data in the automotive ...
Insights into Action – recent examples leveraging big data in the automotive ...Insights into Action – recent examples leveraging big data in the automotive ...
Insights into Action – recent examples leveraging big data in the automotive ...
 
Innovations in Digital Consumerism for the Automotive Industry
Innovations in Digital Consumerism for the Automotive IndustryInnovations in Digital Consumerism for the Automotive Industry
Innovations in Digital Consumerism for the Automotive Industry
 
Connected Car - A New Ecosystem
Connected Car - A New EcosystemConnected Car - A New Ecosystem
Connected Car - A New Ecosystem
 
Deloitte consulting case competition.
Deloitte consulting case competition.Deloitte consulting case competition.
Deloitte consulting case competition.
 
Roadzen - InsurTech Innovation Award 2022
Roadzen - InsurTech Innovation Award 2022Roadzen - InsurTech Innovation Award 2022
Roadzen - InsurTech Innovation Award 2022
 

More from DataWorks Summit

HBase Global Indexing to support large-scale data ingestion at Uber
HBase Global Indexing to support large-scale data ingestion at UberHBase Global Indexing to support large-scale data ingestion at Uber
HBase Global Indexing to support large-scale data ingestion at Uber
DataWorks Summit
 
Security Framework for Multitenant Architecture
Security Framework for Multitenant ArchitectureSecurity Framework for Multitenant Architecture
Security Framework for Multitenant Architecture
DataWorks Summit
 
Computer Vision: Coming to a Store Near You
Computer Vision: Coming to a Store Near YouComputer Vision: Coming to a Store Near You
Computer Vision: Coming to a Store Near You
DataWorks Summit
 

More from DataWorks Summit (20)

Data Science Crash Course
Data Science Crash CourseData Science Crash Course
Data Science Crash Course
 
Floating on a RAFT: HBase Durability with Apache Ratis
Floating on a RAFT: HBase Durability with Apache RatisFloating on a RAFT: HBase Durability with Apache Ratis
Floating on a RAFT: HBase Durability with Apache Ratis
 
Tracking Crime as It Occurs with Apache Phoenix, Apache HBase and Apache NiFi
Tracking Crime as It Occurs with Apache Phoenix, Apache HBase and Apache NiFiTracking Crime as It Occurs with Apache Phoenix, Apache HBase and Apache NiFi
Tracking Crime as It Occurs with Apache Phoenix, Apache HBase and Apache NiFi
 
HBase Tales From the Trenches - Short stories about most common HBase operati...
HBase Tales From the Trenches - Short stories about most common HBase operati...HBase Tales From the Trenches - Short stories about most common HBase operati...
HBase Tales From the Trenches - Short stories about most common HBase operati...
 
Optimizing Geospatial Operations with Server-side Programming in HBase and Ac...
Optimizing Geospatial Operations with Server-side Programming in HBase and Ac...Optimizing Geospatial Operations with Server-side Programming in HBase and Ac...
Optimizing Geospatial Operations with Server-side Programming in HBase and Ac...
 
Managing the Dewey Decimal System
Managing the Dewey Decimal SystemManaging the Dewey Decimal System
Managing the Dewey Decimal System
 
Practical NoSQL: Accumulo's dirlist Example
Practical NoSQL: Accumulo's dirlist ExamplePractical NoSQL: Accumulo's dirlist Example
Practical NoSQL: Accumulo's dirlist Example
 
HBase Global Indexing to support large-scale data ingestion at Uber
HBase Global Indexing to support large-scale data ingestion at UberHBase Global Indexing to support large-scale data ingestion at Uber
HBase Global Indexing to support large-scale data ingestion at Uber
 
Scaling Cloud-Scale Translytics Workloads with Omid and Phoenix
Scaling Cloud-Scale Translytics Workloads with Omid and PhoenixScaling Cloud-Scale Translytics Workloads with Omid and Phoenix
Scaling Cloud-Scale Translytics Workloads with Omid and Phoenix
 
Building the High Speed Cybersecurity Data Pipeline Using Apache NiFi
Building the High Speed Cybersecurity Data Pipeline Using Apache NiFiBuilding the High Speed Cybersecurity Data Pipeline Using Apache NiFi
Building the High Speed Cybersecurity Data Pipeline Using Apache NiFi
 
Supporting Apache HBase : Troubleshooting and Supportability Improvements
Supporting Apache HBase : Troubleshooting and Supportability ImprovementsSupporting Apache HBase : Troubleshooting and Supportability Improvements
Supporting Apache HBase : Troubleshooting and Supportability Improvements
 
Security Framework for Multitenant Architecture
Security Framework for Multitenant ArchitectureSecurity Framework for Multitenant Architecture
Security Framework for Multitenant Architecture
 
Presto: Optimizing Performance of SQL-on-Anything Engine
Presto: Optimizing Performance of SQL-on-Anything EnginePresto: Optimizing Performance of SQL-on-Anything Engine
Presto: Optimizing Performance of SQL-on-Anything Engine
 
Introducing MlFlow: An Open Source Platform for the Machine Learning Lifecycl...
Introducing MlFlow: An Open Source Platform for the Machine Learning Lifecycl...Introducing MlFlow: An Open Source Platform for the Machine Learning Lifecycl...
Introducing MlFlow: An Open Source Platform for the Machine Learning Lifecycl...
 
Extending Twitter's Data Platform to Google Cloud
Extending Twitter's Data Platform to Google CloudExtending Twitter's Data Platform to Google Cloud
Extending Twitter's Data Platform to Google Cloud
 
Event-Driven Messaging and Actions using Apache Flink and Apache NiFi
Event-Driven Messaging and Actions using Apache Flink and Apache NiFiEvent-Driven Messaging and Actions using Apache Flink and Apache NiFi
Event-Driven Messaging and Actions using Apache Flink and Apache NiFi
 
Securing Data in Hybrid on-premise and Cloud Environments using Apache Ranger
Securing Data in Hybrid on-premise and Cloud Environments using Apache RangerSecuring Data in Hybrid on-premise and Cloud Environments using Apache Ranger
Securing Data in Hybrid on-premise and Cloud Environments using Apache Ranger
 
Big Data Meets NVM: Accelerating Big Data Processing with Non-Volatile Memory...
Big Data Meets NVM: Accelerating Big Data Processing with Non-Volatile Memory...Big Data Meets NVM: Accelerating Big Data Processing with Non-Volatile Memory...
Big Data Meets NVM: Accelerating Big Data Processing with Non-Volatile Memory...
 
Computer Vision: Coming to a Store Near You
Computer Vision: Coming to a Store Near YouComputer Vision: Coming to a Store Near You
Computer Vision: Coming to a Store Near You
 
Big Data Genomics: Clustering Billions of DNA Sequences with Apache Spark
Big Data Genomics: Clustering Billions of DNA Sequences with Apache SparkBig Data Genomics: Clustering Billions of DNA Sequences with Apache Spark
Big Data Genomics: Clustering Billions of DNA Sequences with Apache Spark
 

Recently uploaded

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
WSO2
 

Recently uploaded (20)

MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
A Beginners Guide to Building a RAG App Using Open Source Milvus
A Beginners Guide to Building a RAG App Using Open Source MilvusA Beginners Guide to Building a RAG App Using Open Source Milvus
A Beginners Guide to Building a RAG App Using Open Source Milvus
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Ransomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdfRansomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdf
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 

Best Practices for Managing and Sharing Data in a Connected World

  • 1. © Cloudera, Inc. All rights reserved. BEST PRACTICES FOR MANAGING AND SHARING DATA IN A CONNECTED WORLD Sanjay Kumar General Manager, Telecommunications & Media, Cloudera Michael Ger General Manager, Manufacturing & Automotive, Cloudera March 21st, 2019
  • 2. © Cloudera, Inc. All rights reserved. 2© Cloudera, Inc. All rights reserved. AGENDA Connected World Connected Communities Data-Driven Business Models Establishing Trust Architecture for Success Q & A
  • 3. © Cloudera, Inc. All rights reserved. 3© Cloudera, Inc. All rights reserved. Connected Vehicle Data 10X by 2020* Annual Connected Vehicle Data to Grow Almost 10X By 2020* * Source: Cowen and Company, Gartner DATA EXPLOSION And Autonomous Vehicles Will Increase this by a further 25X** Autonomous Vehicle Data ** Source: Cowen and Company, Datameer TERABYTES per vehicle, per day
  • 4. © Cloudera, Inc. All rights reserved. 4© Cloudera, Inc. All rights reserved. THE TRILLION DOLLAR QUESTION How to Monetize the Connected Vehicle? Sources of Future Growth (McKinsey) 67% Growth 45% Growth • Lower Margin • Capital Intensive New Connected Services: A $1.5 Trillion Opportunity 4900% Growth • Higher Margin • Less Capital Intensive
  • 5. © Cloudera, Inc. All rights reserved. 5© Cloudera, Inc. All rights reserved. • Evolving to Cross-Industry Connected Ecosystems • Powered by Connected Communities DATA IS TRANSFORMING INDUSTRIES
  • 6. © Cloudera, Inc. All rights reserved. 6© Cloudera, Inc. All rights reserved. CONNECTED VEHICLE IS LEADING THE TRANSFORMATION Monetizing the Connected Vehicle Insurance Retailers Cities Dynamic transportation & infrastructure mgt. and establishing merchant community hub Data-driven policy decision-making without data liability Dynamic interactions with close proximity target audiences Home & Work Improve consumer quality of life via car/home/work integration (i.e. security, climate, home supply mgt.) Dealer Service Energy Real-time grid capacity management based on vehicle movements Real-time service for lifetime relationship with Customer Cars Telco
  • 7. © Cloudera, Inc. All rights reserved. 7© Cloudera, Inc. All rights reserved. Multi-Party • Across Value Chains ‐ Suppliers, OEMS, Consumers • Across Lines of Business • Across Geographies Connected By Data • Public and Private • Historic and Real-Time • Cloud and On-Premise Membership By Need • Business Insight Communities • Commerce Communities • Supply Chain Communities • Etc. “A group of parties that come together to share data responsibly for value- driven insights for each party” WHAT IS A CONNECTED COMMUNITY?
  • 8. © Cloudera, Inc. All rights reserved. 8© Cloudera, Inc. All rights reserved. WHAT AN AUTOMOTIVE CONNECTED COMMUNITY CAN LOOK LIKE ASK QUESTIONS DELIVER INSIGHTS End-Users Secured views of data and insights Connected Cars & Devices SuppliersOEMs Connected Communities Data Providers •Control who can see what data •Control what data can be combined CitiesInsurance Homes EnergyRetailers Dealers Researchers Government Gas Stations
  • 9. © Cloudera, Inc. All rights reserved. 9© Cloudera, Inc. All rights reserved. Monetization of Data Connected Car: New revenues by monetized customer profile and location data Smart City: New revenues by monetized customer profile and location data Real-Time Operational Models Connected Car: Cost savings from predictive maintenance Smart City: Cost savings from predictive maintenance New Models for Commerce and Trade Connected Car: New revenue from location- aware E-commerce Smart City: New revenue from location-aware E-commerce Supply Chain Data Exchange Connected Supply Chain: Improves supply chain efficiencies through sharing of real-time and historical data OPPORTUNITIES TO CREATE BUSINESS VALUE ACROSS CONNECTED COMMUNITIES
  • 10. © Cloudera, Inc. All rights reserved. 10© Cloudera, Inc. All rights reserved. MONETIZATION OF DATA Combining Customer Profile and Locations Insight as a Service ASK QUESTION DELIVER INSIGHT Insights to driver, consumer and resident demographics for target marketing INSIGHTS PROVIDED Demographics of drivers close to retail locations for target marketing Citizens demographic movement patterns for auto, life and corporate insurance Retailers Automotive OEM Insurance Provider Smart City Community Per City NewYork Chicago SanFrancisco Smart City Consumer Registration Consumer ”Opt-In”
  • 11. © Cloudera, Inc. All rights reserved. 11© Cloudera, Inc. All rights reserved. REAL-TIME OPERATIONAL MODELS Cost Savings from Predictive Maintenance Insight as a Service Connected Car Community Per Country Germany UnitedStates China ASK QUESTION DELIVER INSIGHT Fleet failure predictions and maintenance alerts for just- in -time servicing INSIGHTS PROVIDED Connected Cars Maintain just-in-time inventory levels in distribution centers based on real-time maintenance needs Fleet Operators Car Dealers Vehicle telematics alerts to dealers for real-time dynamic servicing Suppliers
  • 12. © Cloudera, Inc. All rights reserved. 12© Cloudera, Inc. All rights reserved. NEW MODELS FOR COMMERCE AND TRADE Location-Based Commerce Data Exchange Connected Car Community Per Country Germany UnitedStates China Vehicle patterns in local marketplace for target marketing & promotions INSIGHTS PROVIDED Connected Cars In-car bidding among close proximity gasoline stations, automated payment upon receipt In car e-purchasing experience of goods for pickup at retailer drive-thru Consumer ”Opt-In” Retailers Gas Stations Smart Cities
  • 13. © Cloudera, Inc. All rights reserved. 13© Cloudera, Inc. All rights reserved. CONNECTED SUPPLY CHAINS Reduce Costs via Sharing of Real-Time and Historical Supply Chain Data Insight as a Service Connected Supply Chains Per Country Germany UnitedStates China ASK QUESTION DELIVER INSIGHT Supplier shipment and capacity information to optimize production levels INSIGHTS PROVIDED OEM production and demand information to minimize disruptions and inventory Connected Trucks Connected Inventory Suppliers Auto OEM
  • 14. © Cloudera, Inc. All rights reserved. 14© Cloudera, Inc. All rights reserved. COMMUNITY DATA VALUE Increases with Data Participants and Volume LOWEST VALUE Community Data Volume HIGHEST VALUE Learning • Many Community Participants • Large Community Data Volume Contextual Understanding MID-LEVEL VALUE Contextual Understanding • Limited Community Participants • Large Community Data Volume Learning • Limited Community Participants Contextual Understanding • Limited Community Data Volume Learning MID-LEVEL VALUE • Many Community Participants • Limited Community Data Volume Contextual Understanding Learning #Community Participants
  • 15. © Cloudera, Inc. All rights reserved. 15© Cloudera, Inc. All rights reserved. COMMUNITY DATA VALUE Value Curves Vary By Connected Communities LOWEST VALUE Community Data Volume HIGHEST VALUE Learning • Many Community Participants • Large Community Data Volume Contextual Understanding MID-LEVEL VALUE Contextual Understanding • Limited Community Participants • Large Community Data Volume Learning • Limited Community Participants Contextual Understanding • Limited Community Data Volume Learning MID-LEVEL VALUE • Many Community Participants • Limited Community Data Volume Contextual Understanding Learning #Community Participants
  • 16. © Cloudera, Inc. All rights reserved. 16© Cloudera, Inc. All rights reserved. Insight/Benefit Provided EXAMPLE: VEHICLE COLLISION AND REPAIR CYCLE OEM City Data Provided • Vehicle position • Airbag deployment status • Recent vehicle speed OEM City End-Users Secured views of data and insights ASK QUESTION DELIVER INSIGHT Data Providers • Control who can see what data • Control what data can be combined Connected Communities • Emergency dispatch information Body Shop Body Shop • Repair quote • Repair service opportunity • Participation in Autobody Exchange • Leverage historical data for quoting, inventory mgt. • Repair part opportunity • Data monetization across ecosystem • Awareness of accidents and high-danger locations • Safer cities • Cost-effective execution Insurance Insurance• Authorization for repair • Awareness of accident • At-risk drivers • More accurate risk profiles • Fraud avoidance • Competition-based repair
  • 17. © Cloudera, Inc. All rights reserved. 17© Cloudera, Inc. All rights reserved. AGGREGATED DATA FOR MACHINE LEARNING AND AI INSIGHTS • Events per location, demographic, vehicle type, etc. • Performance versus other cities? City • Accident analysis by location, site condition, safety outcomes • Performance vs. other OEMs OEM • Accident insights per location, vehicle, vehicle type • At-risk drivers, more accurate risk profiles • Fraud avoidance Insurance • Historical insights for quoting, inventory and staffing mgt. Body Shop Multiple Vehicle Event Lifecycles Multiple Vehicle Event Lifecycles
  • 18. © Cloudera, Inc. All rights reserved. 18© Cloudera, Inc. All rights reserved. EXTENDED ECOSYSTEM FOR MACHINE LEARNING AND AI INSIGHTS Multiple Vehicle Event Lifecycles Multiple Vehicle Event Lifecycles • Data driving policies and investments in infrastructure, education, PR, benefits and compensation State & Federal Govts. • Location, season and accident type specific product and service offers Commerce • Staff scheduling and resource planning, other hospital treatments and outcomes Hospitals • Accident statistics (accidents probability per location type, car type, time of day, consumer demographic, etc.) Other Cities
  • 19. © Cloudera, Inc. All rights reserved. 19© Cloudera, Inc. All rights reserved. VALUE OF CONNECTED COMMUNITY APPROACH BENEFIT Rapidly evolving industry business models • Flexible model for participants and users • Risk mitigation – rapidly respond to business opportunities • Manage all types of data (structured, unstructured, real-time and historical) • Relevant data defined by community Constantly evolving data needs Trust within Community • Participant control drives data confidence within community • Essential to becoming global marketplace
  • 20. © Cloudera, Inc. All rights reserved. 20© Cloudera, Inc. All rights reserved. SO, YOU WANT TO CREATE A CONNECTED COMMUNITY?
  • 21. © Cloudera, Inc. All rights reserved. 21© Cloudera, Inc. All rights reserved. Can I trust this data? Who owns this data? Where has data come from? Where has data gone to? Is this the best version of the data? How has data changed? SHARED DATA…. SCARY QUESTIONS
  • 22. © Cloudera, Inc. All rights reserved. 22© Cloudera, Inc. All rights reserved. ESTABLISHING TRUST – WHAT’S REQUIRED? End-Users Secured views of data and insights ASK QUESTION DELIVER INSIGHT Data Providers • Control who can see what data • Control what data can be combined Connected Communities ✓ Data access across systems • Each data provider shares specific data assets and defines specific data sharing rules ✓ Controlling who sees what data • Each data provider precisely defines which end-users can see their data throughout the data lifecycle ✓ Data audit across the ecosystem • Each data provider can track data usage across the data lifecycle, including the data’s origin, where it is used, and how it changes over time
  • 23. © Cloudera, Inc. All rights reserved. 23© Cloudera, Inc. All rights reserved. HOW IT WORKS….. Connected Vehicle Community CLUSTER MANGEMENT • Cluster registration and visibility across on-premise, Cloud and Hybrid deployments OEM 1 OEM 2 Government Researcher Retailer Home USER & SECURITY MANAGEMENT • User authentication synched with enterprise identity systems • Centralize data security roles, privileges and policies across clusters Role 1 • Privilege 1 • Privilege 2 • Privilege N Role 2 • Privilege 3 • Privilege 4 • Privilege N Role 3 • Privilege 5 • Privilege 6 • Privilege N Role 4 • Privilege 7 • Privilege 8 • Privilege N Centralized Management of Core Functions HORTONWORKS DATAPLANE SERVICE • Track Data Lineage across data lifecycle • Track Data Audit across data lifecycle • Complimentary with BlockChain DATA LIFECYCLE MANAGEMENT Ingest Transform Edit Export BLOCKCHAIN GATE BLOCKCHAIN GATE
  • 24. © Cloudera, Inc. All rights reserved. 24
  • 25. © Cloudera, Inc. All rights reserved. 25 Single View of All Data Sources
  • 26. © Cloudera, Inc. All rights reserved. 26 Asset Collections
  • 27. © Cloudera, Inc. All rights reserved. 27 Tables Asset Collection Details
  • 28. © Cloudera, Inc. All rights reserved. 28 Tagging of Sensitive Information Customer Emergency Event Data
  • 29. © Cloudera, Inc. All rights reserved. 29 Adding Security Policies Table and Field Level Controls POLICIES USERS
  • 30. © Cloudera, Inc. All rights reserved. 30 Data Lineage (For Table) Customer Emergency Contact Information Vehicle Event Data Accident Detail (For Use by City Emergency Dispatch) Aggregated Detail (For Use by Various Research Entities)
  • 31. © Cloudera, Inc. All rights reserved. 31 Event Time Audit Trail Event Type
  • 32. © Cloudera, Inc. All rights reserved. 32© Cloudera, Inc. All rights reserved. IN CONCLUSION Connected Communities Will Drive the Value of the Connected World New Data-Driven Business Models Trust in Data is Paramount Technologies Have Emerged to Make this Possible
  • 33. © Cloudera, Inc. All rights reserved. THANK YOU