At CLEVER°FRANKE, we focus on experimenting at the intersection of design and development, challenging ourselves with emerging technologies, acquiring knowledge, developing new techniques and nurturing our curiosity.
This prototype was an exploration into a better way to visually represent streams of energy and their consumption in the home. Our prototype uses image recognition to find appliances and with Augmented Reality, visually map streams of energy and display information on their consumption and the costs associated with their use.
Customer Service Analytics - Make Sense of All Your Data.pptx
ENARGY; A CLEVER°FRANKE Experiment
1. Exploring data and energy
expenditure in the home
through radical prototyping
ROLE
Concept / UI / UX / Visual Design / Front End Development
YEAR
2017
A CLEVER°FRANKE EXPERIMENT
3. INTRODUCTION
At CLEVER°FRANKE, we focus on experimenting
at the intersection of design and development,
challenging ourselves with emerging
technologies, acquiring knowledge, developing
new techniques and nurturing our curiosity.
4. RESEARCH QUESTION
How can energy consumption and data use
in the home be presented in an engaging
way?
6. BRAINSTORM SESSION
To better understand the challenge,
we had a brainstorm session, mapping the
possibilities and discovering interesting
connections with other topics.
7. CONCEPT PHASE
Taking our insights from the session, we
developed simple ideas to expand on the
concept directions, enabling us to select
the best idea.
10. CONCEPT
Our insights from the process and research
phase led to the concept of an Augmented
Reality prototype, able to recognize devices
and appliances that consume gas, water,
electricity, and use data. The app visualizes
household expenditure through a new,
engaging interface.
11. KEY CONCEPTS
A compelling interface
readily provides beautifully
visualized insights into
energy and data use of home
devices and appliances.
LAMP
LAMP
TV
TV
HEATER
TV
MACBOOK
METER CABINET
CV - 10 watt
CV - 10 watt
2000watt
TV - 1600 watt
CV - 1600 watt
30 watt
30 watt
HEATER
HEATER
TV 2
LAMP
12. KEY CONCEPTS
Intelligent layering
traces energy and data
streams of each device
visually and granularly.
GROUP 2
META INFO
HEATER
€1,32 Per uur
230 V - 2000 W 50 Hz
€0,80 Per uur
190 V - 1800 W 50 Hz
NOW
AVG. MONTH
4 % OF HOUSEHOLD
14. MINIMUM VIABLE CONCEPT
To ensure the feasibility of the
prototype, we took the decision to
begin with the core features of the
app, to prove the concept and
added value of the solution.
FACTORY SPECS
OBJECT RECOGNITION
BASIC FREE APP
15. The prototype recognizes devices using machine
learning and visualizes energy and data streams
running through the home. Color specifies the
nature of the source while the weight of the
stream indicates expenditure relative to
the entire home.
Pointing at a device calls up information on its
energy consumption. A smart sensor allows
detailed, historical data visualizations while
standard devices display manufacturer averages.
Visualizing this information allows users to
understand their expenditure in an immersive,
engaging fashion, enabling them to manage
their consumption with minimum effort.
DESIGN CHALLENGE
gas
water
data
electricity
16. The prototype app uses Apple’s ARKit to
superimpose virtual objects on the real world
in Augmented Reality. Further expansion with
Apple's machine learning library CoreML,
could enable object recognition.
On Android devices, ARCore could be
implimented for the Augmented Reality
functionality, and Google's machine
learning platform TensorFlow Mobile
for object recognition capabilities.
The app uses React Native, which enabled us
to quickly build and validate the application.
TECH CHALLENGE