Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Stephen Galsworthy, Toon
Saving energy with
Apache Spark and Toon
#EUds10 #ToonTalks
31 October 2017
Data management
Solar solution
Network
Mobility
Control by demand
Heat pump
Services
Storage
The beating heart
of your sma...
#EUds10 #ToonTalks
Boiler adapter
Z-Wave
Meter adaptor
Gas sensor
Electricity sensor
Philips Hue
Z-Wave
Toon data sources
...
#EUds10 #ToonTalks
Scale of Toon data
100 MB data
per user
collected per
month
350,000 thermostats
installed
300 types of
...
#EUds10 #ToonTalks
Data Privacy
Data from all Toons is collected and stored
anonymously. Data is tagged with an anonymous ...
#EUds10 #ToonTalks
Toon Innovators
Innovators agree to share their data for research
and product development.
In return th...
#EUds10 #ToonTalks
Data Collection setup
data
collector
data
storage
Processed
data
Data science
platform
#EUds10 #ToonTalks
Apache Airflow
Data Science platform
For managing Spark
clusters and notebooks
For scheduling complex
w...
#EUds10 #ToonTalks
Concept testing
(3 employees)
Initial tests
(10-50 users)
Development
(600 users)
Commercial
launch
(30...
#EUds10 #ToonTalks
Data driven services
#EUds10 #ToonTalks
Energy Waste Checker
We don’t always notice how much energy we’re
wasting.
Toon can now expose the ener...
#EUds10 #ToonTalks
Toon detects inefficient appliances and behaviours
#EUds10 #ToonTalks
Electricity data Appliance signals
An underlying concept: Load disaggregation
#EUds10 #ToonTalks
Run on 10s electricity meter data
1
Disaggregation algorithms
Dryer Dishwasher
Washing machine x2
Power...
#EUds10 #ToonTalks
Determine appliance ‘fingerprint’
#EUds10 #ToonTalks
Efficiency classification
#EUds10 #ToonTalks
Personalised advice for the end user
“It looks like your
washing machine uses
more energy than an
effic...
#EUds10 #ToonTalks
Another example: Heating and Insulation advice
1. Analyse how much gas is used for
heating the home
2. ...
#EUds10 #ToonTalks
Scale of Toon data
35,000,000 washing machine cycles
detected per year
100,000 washing
machine cycles
d...
#EUds10 #ToonTalks
What else is on its way?
Boiler Monitoring
Toon will keep an eye on your boiler 24 hours per day.
It’ll...
#EUds10 #ToonTalks
Stephen Galsworthy
Head of Data Science
+31 (0) 20 462 1680 

stephen.galsworthy@quby.com
Saving Energy with Apache Spark and Toon with Stephen Galsworthy
Saving Energy with Apache Spark and Toon with Stephen Galsworthy
Upcoming SlideShare
Loading in …5
×

of

Saving Energy with Apache Spark and Toon with Stephen Galsworthy Slide 1 Saving Energy with Apache Spark and Toon with Stephen Galsworthy Slide 2 Saving Energy with Apache Spark and Toon with Stephen Galsworthy Slide 3 Saving Energy with Apache Spark and Toon with Stephen Galsworthy Slide 4 Saving Energy with Apache Spark and Toon with Stephen Galsworthy Slide 5 Saving Energy with Apache Spark and Toon with Stephen Galsworthy Slide 6 Saving Energy with Apache Spark and Toon with Stephen Galsworthy Slide 7 Saving Energy with Apache Spark and Toon with Stephen Galsworthy Slide 8 Saving Energy with Apache Spark and Toon with Stephen Galsworthy Slide 9 Saving Energy with Apache Spark and Toon with Stephen Galsworthy Slide 10 Saving Energy with Apache Spark and Toon with Stephen Galsworthy Slide 11 Saving Energy with Apache Spark and Toon with Stephen Galsworthy Slide 12 Saving Energy with Apache Spark and Toon with Stephen Galsworthy Slide 13 Saving Energy with Apache Spark and Toon with Stephen Galsworthy Slide 14 Saving Energy with Apache Spark and Toon with Stephen Galsworthy Slide 15 Saving Energy with Apache Spark and Toon with Stephen Galsworthy Slide 16 Saving Energy with Apache Spark and Toon with Stephen Galsworthy Slide 17 Saving Energy with Apache Spark and Toon with Stephen Galsworthy Slide 18 Saving Energy with Apache Spark and Toon with Stephen Galsworthy Slide 19 Saving Energy with Apache Spark and Toon with Stephen Galsworthy Slide 20 Saving Energy with Apache Spark and Toon with Stephen Galsworthy Slide 21 Saving Energy with Apache Spark and Toon with Stephen Galsworthy Slide 22 Saving Energy with Apache Spark and Toon with Stephen Galsworthy Slide 23 Saving Energy with Apache Spark and Toon with Stephen Galsworthy Slide 24
Upcoming SlideShare
Fire in the Sky: An Introduction to Monitoring Apache Spark in the Cloud with Michael McCune
Next
Download to read offline and view in fullscreen.

0 Likes

Share

Download to read offline

Saving Energy with Apache Spark and Toon with Stephen Galsworthy

Download to read offline

Toon, a leading European smart thermostat and energy display, enables users to control and monitor gas and electricity consumption in their homes. Using the energy data we collect from over 400,000 homes we have developed a new Energy Waste Checker app to give actionable advice to end users to ensure that they do not needlessly waste energy. We identify inefficient electrical appliances and suboptimal uses of central heating and hot water by applying disaggregation algorithms to the raw sensor data. In this talk Stephen will describe our how our novel disaggregation algorithms are implemented in Spark and will show how Toon uses cloud-based big data processing to offer data driven services to hundreds of thousands of users.

  • Be the first to like this

Saving Energy with Apache Spark and Toon with Stephen Galsworthy

  1. 1. Stephen Galsworthy, Toon Saving energy with Apache Spark and Toon #EUds10 #ToonTalks
  2. 2. 31 October 2017
  3. 3. Data management Solar solution Network Mobility Control by demand Heat pump Services Storage The beating heart of your smart life Smart Platforms & Energy Services
  4. 4. #EUds10 #ToonTalks Boiler adapter Z-Wave Meter adaptor Gas sensor Electricity sensor Philips Hue Z-Wave Toon data sources Central heating system Solar panels
  5. 5. #EUds10 #ToonTalks Scale of Toon data 100 MB data per user collected per month 350,000 thermostats installed 300 types of sensor and user interaction data
  6. 6. #EUds10 #ToonTalks Data Privacy Data from all Toons is collected and stored anonymously. Data is tagged with an anonymous ID, generated locally on Toon. The end user maintains control over this key and we only use data in a non-anonymous way when a customer explicitly opts-in.
  7. 7. #EUds10 #ToonTalks Toon Innovators Innovators agree to share their data for research and product development. In return they they are first in line to try out our new services!
  8. 8. #EUds10 #ToonTalks Data Collection setup data collector data storage Processed data Data science platform
  9. 9. #EUds10 #ToonTalks Apache Airflow Data Science platform For managing Spark clusters and notebooks For scheduling complex workflows For production grade algorithms and R&D For machine learning on distributed data
  10. 10. #EUds10 #ToonTalks Concept testing (3 employees) Initial tests (10-50 users) Development (600 users) Commercial launch (300,000+users) Manual Our journey
  11. 11. #EUds10 #ToonTalks Data driven services
  12. 12. #EUds10 #ToonTalks Energy Waste Checker We don’t always notice how much energy we’re wasting. Toon can now expose the energy guzzlers in your home.
  13. 13. #EUds10 #ToonTalks Toon detects inefficient appliances and behaviours
  14. 14. #EUds10 #ToonTalks Electricity data Appliance signals An underlying concept: Load disaggregation
  15. 15. #EUds10 #ToonTalks Run on 10s electricity meter data 1 Disaggregation algorithms Dryer Dishwasher Washing machine x2 Power (Wh)
  16. 16. #EUds10 #ToonTalks Determine appliance ‘fingerprint’
  17. 17. #EUds10 #ToonTalks Efficiency classification
  18. 18. #EUds10 #ToonTalks Personalised advice for the end user “It looks like your washing machine uses more energy than an efficient one”
  19. 19. #EUds10 #ToonTalks Another example: Heating and Insulation advice 1. Analyse how much gas is used for heating the home 2. Analyse the cooling down rate of the home overnight from temperature data 3. Benchmark with comparable homes 4. Personalised insulation advice for the customer Insulation It looks like your home losesenergy more quickly than efficient homes
  20. 20. #EUds10 #ToonTalks Scale of Toon data 35,000,000 washing machine cycles detected per year 100,000 washing machine cycles detected per day
  21. 21. #EUds10 #ToonTalks What else is on its way? Boiler Monitoring Toon will keep an eye on your boiler 24 hours per day. It’ll tell you if it’s still working correctly and when the next maintenance is due. Monthly Energy Insights A personalised overview of energy usage for all Toon users.
  22. 22. #EUds10 #ToonTalks Stephen Galsworthy Head of Data Science +31 (0) 20 462 1680 
 stephen.galsworthy@quby.com

Toon, a leading European smart thermostat and energy display, enables users to control and monitor gas and electricity consumption in their homes. Using the energy data we collect from over 400,000 homes we have developed a new Energy Waste Checker app to give actionable advice to end users to ensure that they do not needlessly waste energy. We identify inefficient electrical appliances and suboptimal uses of central heating and hot water by applying disaggregation algorithms to the raw sensor data. In this talk Stephen will describe our how our novel disaggregation algorithms are implemented in Spark and will show how Toon uses cloud-based big data processing to offer data driven services to hundreds of thousands of users.

Views

Total views

761

On Slideshare

0

From embeds

0

Number of embeds

44

Actions

Downloads

32

Shares

0

Comments

0

Likes

0

×