Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Connected Car: Delivering Real-Time Insights Using Hadoop

132 views

Published on

The sensors in connected cars can generate up to 130 terabytes of data per year per car. This includes data from electronic control units such as RPMs, speed, fuel efficiency, and temperatures, as well as location, safety, voice and video data. Some of these sources stream in real time, while others are regularly delivered in batches. With Arcadia Enterprise, you can visualize the real-streams and perform deep discovery on historical data seamlessly on the same modern business intelligence platform.

Published in: Data & Analytics
  • Be the first to comment

  • Be the first to like this

Connected Car: Delivering Real-Time Insights Using Hadoop

  1. 1. 1© Cloudera, Inc. All rights reserved. Connected Car: Delivering Real- Time Insights using Hadoop Vijay Raja & Jonathan Cooper-Ellis Cloudera
  2. 2. 2© Cloudera, Inc. All rights reserved. By 2020, there will be 250 Million connected vehicles on the road globally – Gartner & Connected Vehicle Trade Association Vehicles currently on the road have 60 – 100 sensors onboard. This number is projected to increase to 200+ by the year 2020. The Connected Car Paradigm 75% of new cars shipped in 2020 will have internet connectivity - Business Intelligence - Sources: Gartner, Strategy&, Mems Journal
  3. 3. 3© Cloudera, Inc. All rights reserved. Connected Cars - Key Segments/ Use Cases Mobility Management Functions that enable drivers to reach a destination quickly & effectively Vehicle Management Functions that reduce overall costs and improve comfort Well-Being Functions that improve drivers comfort and ability to drive Autonomous driving Operation of the vehicle without a human driver at the controls Safety Functions that warn drivers of external hazards Entertainment Functions involving entertainment of driver and passengers Source: Strategy&, 2015 Vehicle condition & performance, service reminders, remote mgmt., telematics etc. Real-time traffic information displays, parking lot or garage assistance etc. Collision avoidance, hazard warning signals and emergency call functions Self-parking cars, self driving mode, motorway assistance etc. Fatigue detection & alerting and other forms of individual assistance Smartphone interfaces, streaming videos & access to social networks
  4. 4. 4© Cloudera, Inc. All rights reserved. Data from Connected Cars Significant Data Volumes • 25 GB per hour per car • 130 TB per year per car 130TB 25GB per hour per car, per year Diverse Data Types • Data from ECUs • RPM, Speed, Fuel Efficiency, Temp, Pressure, Braking… • Location Data • Safety Data • V2V and V2I • Video Data Variety • Streaming (Real-Time) • Batch • Multiple Formats Data Sources • ECU (Electronic Control Units) • Vehicle Plug-ins • Head units • Cameras
  5. 5. 5© Cloudera, Inc. All rights reserved. Cloudera Enterprise – The Data & Analytics Platform for IoT Internal Systems External Sources Data Center Cloud Customer (CRM), Manufacturing, Dealer Data • Data Ingest • Data Storage • Data Processing • Machine Learning • Real-time Analytics BI Solutions Real-Time AppsSearch EDWDiscove r Machine Learning OPERATIONS Cloudera Manager Cloudera Director DATA MANAGEMENT Cloudera Navigator Encrypt and KeyTrustee Optimizer BATCH Sqoop REAL-TIME Kafka, Flume PROCESS, ANALYZE, SERVE UNIFIED SERVICES RESOURCE MANAGEMENT YARN SECURITY Sentry, RecordService FILESYSTEM HDFS RELATIONAL Kudu NoSQL HBase STORE INTEGRATE BATCH Spark, Hive, Pig MapReduce STREAM Spark SQL Impala SEARCH Solr SDK Partners
  6. 6. 6© Cloudera, Inc. All rights reserved. Connected Car – Demo Architecture OPERATIONS Cloudera Manager Cloudera Director DATA MANAGEMENT Cloudera Navigator Encrypt and KeyTrustee Optimizer BATCH Sqoop REAL-TIME Kafka, Flume PROCESS, ANALYZE, SERVE UNIFIED SERVICES RESOURCE MANAGEMENT YARN SECURITY Sentry, RecordService FILESYSTEM HDFS RELATIONAL Kudu NoSQL HBase STORE INTEGRATE BATCH Spark, Hive, Pig MapReduce STREAM Spark SQL Impala SEARCH Solr SDK Partners Cloudera Enterprise Data Hub MQTT - Kafka Bridge Connected Car Simulator Data Ingest & Pipeline Enterprise Data Hub BI & Visualization Streaming Data: • Time • VIN • Location • Mileage • Speed • Acceleration • Brakes applied? • Turn signal on? • Lane departed? • Collision detected? • Hazard detected? StreamSets Data Collector
  7. 7. 7© Cloudera, Inc. All rights reserved. Connected Car – Demo Architecture Cloudera Enterprise Data Hub MQTT - Kafka Bridge Connected Car Simulator Data Ingest & Pipeline Enterprise Data Hub BI & Visualization Streaming Data: • Time • VIN • Location • Mileage • Acceleration • Speed • Brakes applied? • Turn signal on? • Lane departed? • Collision detected? • Hazard detected? Data Storage Layer Search #2 #1 Pub-Sub Messaging System Real-Time Processing Engine StreamSets Data Collector
  8. 8. 8© Cloudera, Inc. All rights reserved. Demo Architecture Data Generator Spark Streaming Impala Kafka Kafka • Time • VIN • Miles • xAccel • yAccel • zAccel • Speed • Brakes • LaneDeparture • Signal • CollisionDetected • HazardDetected • Latitude • Longitude Kudu
  9. 9. 9© Cloudera, Inc. All rights reserved. Key Use Cases Highlighted Predictive Maintenance Public Services Understand traffic patterns, public safety hazards and provide recommendations accordingly Usage Based Insurance Provide specific Insurance coverage based on specific driving habits & risk profiles OEMs Insurance Public Services Provide specific service recommendations based on vehicle usage and driving habits
  10. 10. 11© Cloudera, Inc. All rights reserved. Thank You
  11. 11. 12© Cloudera, Inc. All rights reserved. Connected Car Use cases - Examples Predictive Maintenance Customer 360 Usage Based Insurance Fleet Management Public Services Vehicle Performance Usage & Feature Analytics Maintenance recommendations & analytics based on specific vehicle usage Insurance coverage based on specific driving habits & risk Targeted and personalized offers for customers based vehicle condition & driving habits Understand traffic patterns and public safety hazards What features in the vehicle are most used, what are least? Fleet performance and maintenance recommendations based on usage Provide a real-time view of vehicle health & performance

×