Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
WIFI SSID:Spark+AISummit | Password: UnifiedDataAnalytics
Tomasz Magdanski, Shobhit Gupta
Asurion
Powering Asurion’s Connected
Home Platform with Spark
Structured Streaming, Delta ...
About Asurion
3#UnifiedDataAnalytics #SparkAISummit
About Connected Home
4#UnifiedDataAnalytics #SparkAISummit
Opportunity
• 13.5B internet connected devices
• 2/3 of consume...
Delivering Insights In Connected Home Value Chain
Providing descriptive, predictive, diagnostic, prescriptive
and sales an...
Challenges for Connected Home
6#UnifiedDataAnalytics #SparkAISummit
• Vendors, devices, apps, protocols and hubs
fragmenta...
7
Development challenges
● Faster the better
● Chaos is new Data Structure
● Multiple Use Case - Same Data
● Aggregation on ...
Solution
● Divide and Conquer
○ Multiple Streams
○ Structured Streaming Joins
● Golden words aren’t repeated
○ Read once w...
Solution contd.
● Aggregations are the key
○ In memory
○ Timestamped
○ Windowed
● Yes, Many of them at same place!
10
10,000 ft View
11
Tomasz Magdanski, Shobhit Gupta
Asurion
Demo Time
#UnifiedDataAnalytics #SparkAISummit
Learnings
● Time to market
○ Buy vs Build
● Scale & Adoption
○ No-SQL has a SQL
○ Δ > λ
13
DON’T FORGET TO RATE
AND REVIEW THE SESSIONS
SEARCH SPARK + AI SUMMIT
Upcoming SlideShare
Loading in …5
×

of

Powering Asurion's Connected Home Platform with Spark Structured Streaming, Delta Lake, and MLflow Slide 1 Powering Asurion's Connected Home Platform with Spark Structured Streaming, Delta Lake, and MLflow Slide 2 Powering Asurion's Connected Home Platform with Spark Structured Streaming, Delta Lake, and MLflow Slide 3 Powering Asurion's Connected Home Platform with Spark Structured Streaming, Delta Lake, and MLflow Slide 4 Powering Asurion's Connected Home Platform with Spark Structured Streaming, Delta Lake, and MLflow Slide 5 Powering Asurion's Connected Home Platform with Spark Structured Streaming, Delta Lake, and MLflow Slide 6 Powering Asurion's Connected Home Platform with Spark Structured Streaming, Delta Lake, and MLflow Slide 7 Powering Asurion's Connected Home Platform with Spark Structured Streaming, Delta Lake, and MLflow Slide 8 Powering Asurion's Connected Home Platform with Spark Structured Streaming, Delta Lake, and MLflow Slide 9 Powering Asurion's Connected Home Platform with Spark Structured Streaming, Delta Lake, and MLflow Slide 10 Powering Asurion's Connected Home Platform with Spark Structured Streaming, Delta Lake, and MLflow Slide 11 Powering Asurion's Connected Home Platform with Spark Structured Streaming, Delta Lake, and MLflow Slide 12 Powering Asurion's Connected Home Platform with Spark Structured Streaming, Delta Lake, and MLflow Slide 13 Powering Asurion's Connected Home Platform with Spark Structured Streaming, Delta Lake, and MLflow Slide 14
Upcoming SlideShare
What to Upload to SlideShare
Next
Download to read offline and view in fullscreen.

2 Likes

Share

Download to read offline

Powering Asurion's Connected Home Platform with Spark Structured Streaming, Delta Lake, and MLflow

Download to read offline

Asurion’s Connected Home simplifies the complexities of operation, setup, and management of connected devices and services.

Leveraging latest advancements in Machine Learning, Big Data, and Real-Time processing capabilities, we have built a platform capable of keeping the connected world connected and continually learning.

Solving this technical challenge requires running multiple continuous applications capable of transactional data storage, multi-level aggregations, joins, execution of ML models with data privacy and security at its core.

Asurion Connected Home platform achieves this goal by using Spark Structured Streaming, Delta Lake and MLflow on Databricks.

Powering Asurion's Connected Home Platform with Spark Structured Streaming, Delta Lake, and MLflow

  1. 1. WIFI SSID:Spark+AISummit | Password: UnifiedDataAnalytics
  2. 2. Tomasz Magdanski, Shobhit Gupta Asurion Powering Asurion’s Connected Home Platform with Spark Structured Streaming, Delta Lake and MlFlow #UnifiedDataAnalytics #SparkAISummit
  3. 3. About Asurion 3#UnifiedDataAnalytics #SparkAISummit
  4. 4. About Connected Home 4#UnifiedDataAnalytics #SparkAISummit Opportunity • 13.5B internet connected devices • 2/3 of consumers agrees that connected devices have the potential to make their lives easier (91% for 18-24 year old's) Market Evolution • Proliferation of services and devices • Everyone is moving to connected home • This is the future
  5. 5. Delivering Insights In Connected Home Value Chain Providing descriptive, predictive, diagnostic, prescriptive and sales analytics across the ecosystem 5#UnifiedDataAnalytics #SparkAISummit Internet of Things Providers Over the Top Providers Internet Service Providers Support Agents and Techs Retail and online sales and services SMART HOME DEVICES SUPPLIERS RETAILERS CONSUMERS ASURION SMART SUPPORT CONTROL DEVICES CYBER SECURITY INTERNET AND GATEWAY Source: Statista Digital Market Outlook 2017; adapted by K-talyst 2018 and Asurion PLATFORM
  6. 6. Challenges for Connected Home 6#UnifiedDataAnalytics #SparkAISummit • Vendors, devices, apps, protocols and hubs fragmentation • Equipment compatibility • Purchase information overload • Security • Monitoring and control • Network quality issues • Complex setup • Time to market • Scale an adoption
  7. 7. 7
  8. 8. Development challenges ● Faster the better ● Chaos is new Data Structure ● Multiple Use Case - Same Data ● Aggregation on top of Classification ● In conjunction with ML models 8#UnifiedDataAnalytics #SparkAISummit
  9. 9. Solution ● Divide and Conquer ○ Multiple Streams ○ Structured Streaming Joins ● Golden words aren’t repeated ○ Read once write many times ○ ‘Delta’ isn’t just a Lake! 9
  10. 10. Solution contd. ● Aggregations are the key ○ In memory ○ Timestamped ○ Windowed ● Yes, Many of them at same place! 10
  11. 11. 10,000 ft View 11
  12. 12. Tomasz Magdanski, Shobhit Gupta Asurion Demo Time #UnifiedDataAnalytics #SparkAISummit
  13. 13. Learnings ● Time to market ○ Buy vs Build ● Scale & Adoption ○ No-SQL has a SQL ○ Δ > λ 13
  14. 14. DON’T FORGET TO RATE AND REVIEW THE SESSIONS SEARCH SPARK + AI SUMMIT
  • slachiewicz

    Nov. 15, 2019
  • tushar_kale

    Nov. 10, 2019

Asurion’s Connected Home simplifies the complexities of operation, setup, and management of connected devices and services. Leveraging latest advancements in Machine Learning, Big Data, and Real-Time processing capabilities, we have built a platform capable of keeping the connected world connected and continually learning. Solving this technical challenge requires running multiple continuous applications capable of transactional data storage, multi-level aggregations, joins, execution of ML models with data privacy and security at its core. Asurion Connected Home platform achieves this goal by using Spark Structured Streaming, Delta Lake and MLflow on Databricks.

Views

Total views

938

On Slideshare

0

From embeds

0

Number of embeds

8

Actions

Downloads

20

Shares

0

Comments

0

Likes

2

×