1
A New Era of Thinking
The Cognitive Building
– When the building understands people
Kim Escherich | @kescherich
Executive Innovation Architect
IBM Global Business Services
Christian Gaardboe Carlsen
Head of Property Excellence
ISS Facility Services A/S
• The Cognitive Building
Kim Escherich, IBM
• Leveraging the customer journey
by applying technology and IoT
Christian Gaardboe Carlsen, ISS
3
Why?
How much does happiness affect productivity?
Source: 2014 study by University of Warwick, UK, and IZA Bonn, Germany via The Stoddard Review 2016
Do offices enable employee productivity?
5
Source: The Leesman Index 2016 via The Stoddard Review
7
The Cognitive Building
Learn Behaviour
Predictive control down to desk level
Understand energy flow and building
occupancy
Consider comfort preferences of users
Collect context such as weather and
meetings
Too data points even for advanced
analytics
Building Management Evolution
Visualize KPI
Good for ratings
Allows identifying general
issues
Bad for identifying energy
waste
Automated Buildings
(1980 – 2000)
Analyze Energy Consumers
Understand consumption of
rooms and central assets
Only primary datapoints are
analyzed
Smart Buildings
(2000 – 2015)
Cognitive Buildings
(> 2015)
IoT & DevOps Platforms New Ecosystems BIM & Digital Twin
Human-computer interfaces Analytics & AI Innovation & Design Thinking
LEVEL 1
FACILITIES
CENTRIC
LEVEL2
ASSET
CENTRIC
LEVEL 3
PEOPLE
CENTRIC
CUSTOMER NEEDS
Power,water,
air, data
Signage,
security,assets,
services,
processes
Ambient
intelligence,
productivity,
happiness
The Cognitive Building
Composable buildings
Navigate a campus
via Watson speech
Understand energy flow
and diagnose anomalies
with cognitive analytics
Manage and find
your assets in 3D
Electricity
with IoT Meter
Occupancy
with PIR
Vibration Data
with IoT Sensors
Easily monitor and
maintain assets
before they fail
Understand temperature,
comfort and occupancyin
buildings and data centers
Desk Comfort
Sensors
Cognitive analytics
for deep insights
to unlock new
cost savings.
Customizable IoT
platform that provides
simple integration and
high scalability
Plug-and-play
instrumentation
with IoT devices
Rapid modelling
with laser scanner
Learning
Apache SparkdashDB with R
Vision
Visual Recognition
Speech
Text to SpeechSpeech to Text
Language
Natural Language
Classifier
Dialog
Integration
Watson IoTP Presence Insight
INTEGRATE
INTERACT
REASON
LEARN
Reason
Predictive AnalyticsIoT RT Insights
Room BookingInsights for TwitterInsights for Weather
TririgaMaximo
Security
Proximity
with BLE
Alchemy API
Connected Building Use Cases and Opportunities
DIGITAL ASSET LIFECYCLE
The	manual	input	of	data	into	
a	maintenance	system	for	
thousands	of	assets	is	a	
costly,	error	prone	process.
SEMANTIC INSIGHTS
Analyzing thousands	of	IoT	
devices	cannot	provide	
meaningful	insights	without	a	
semantic	method.
FLUID SPACES
The	lack	of	real-time	
occupancy	information	within	
a	building	inhibits	effective	
energy	and	space	
performance.
MY COGNITIVE CAMPUS
Increase	productivity	of	
teams	by	providing	a	
comfortable	environment	
and	easy	navigation.
MY ARTEFACT
Maintaining	the	perfect	
environment	for	art	galleries	
and	museums	is	critical.
REAL TIME ASSET LOCATION
Finding	assets	and	their	
relevant	data	is	challenging,		
in	particular	when	you	are	in	
the	field.
SELF-LEARNING ENERGY
DIAGNOSER
Energy	consumption	has	
many	influences	and	it	is	hard	
to	detect	and	diagnose	
abnormal	consumption.
COGNITIVE ASSET HEALTH
Predictive	and	preventive	
maintenance	are	immanent	
to	reduce	operation	costs,	
but,	lack	the	required	
sensors.
SCALABLE IOT	PLATFORM
Cognitive	Buildings	require	a	
highly	scalable	platform	for	
data	integration	and	analysis.
COGNITIVE CONCIERGE
Guiding	people	to	their	
rooms	and	answering	their	
questions	is	an	central	
element	of	hospitality.
• Multi-modal transportation services
• Alerts before leaving home
• "Please be aware that we are serving fish in the
restaurant" (and you are allergic)
• Remember your umbrella
• Car sharing with colleauges
• Pre-book work area (and you might decide to
work from home)
• Various work-from-home-services
• Walking around guidance
• Pay for your parking in-app (guest)
• Issue mobile parking ticket
• Provide alternative parking
• Find me a parking spot (before arriving)
• Find my car
Weather integration | Transport/city integration | Cognitive HR
analytics | IoT integration | Tririga integration | MobileFirst
GETTING
HERE
MobileFirst | IoT integration (outdoor/camera) |
Tririga integration | Maps 3D | Cognitive advisory
services
• Access control
• The concierge knows you and can notify
• The building knows you and can advise/notify
• Alternative authentication means, e.g. combination
of smartphone and biometrics, face recognition,
smart watch + pincode/fingerprint etc.
• Information services - app based
• Counting, crowd and pattern analytics
• Video survelliance
• Anormaly video analytics (security)
ENTERING
ARRIVING
Biometrics | IoT integration | Sensoring | MobileFirst | Tririga
integration | Video analytics | Video content management
• Get alerts and notifications on building app
(smartphone or iWatch)
• Get around - office maps 2D/3D
• Order hot drinks
• Order light meal
• Check delivery situation on beverage machines
• Manage postal services via app and notifications
• Understand building usage and environment
• Align internal climate with outside
• Space management
MobileFirst | 2D/3Dmaps | IoT Platform | Legacy Integration |
Tririga Integration | Video analytics | Big data analytics
BEING
HERE
• Locate my colleauges
• Who is in my working area today
• Status on infrastructure
• Find me an empty seat based on personal profile
• Optimise usage of office space
• Crowd and usage analytics
Indoor localization | IoT platform | Tririga integration | Cognitive
Analytics | Big data analytics
WORKING
HERE
• Get todays menu at the restaurant
• How long is the queue right now?
• When is it optimal for me to eat?
• Nutritional information compared to
personal health profile
• Order guest tickets
• Order takeaway based on prefernces
Content management | IoT integration | Video
surveillance | Partner integration | Cognitive
DRINKING
AND
EATING
• Physical meeting room displays
• Reserve meeting room
• Arrange spontaneous meeting (lets
meet in 4 minutes in the cafe)
• Conference support app
• Booked but unused meeting rooms
• Meeting rom outages / defects
Tririga Integration | MobileFirst | Localisation
services | Problem detection | Bookings
MEETING
WITH
OTHERS
• Checking out
• Evaluating the day
• Find my car, bicycle or the path
to the train station
• Heating the car
• Notifying the spouse
LEAVING
IoT Integration | Partner integration | IoT
integration | MobileFirst
COGNITIVE BUILDING TOUCHPOINTS
Copyright © KONE Corporation
KONE ELEVATORS
15
http://machineconversations.kone.com/
WHIRLPOOL
MUSE PLAYING AT ORANGE
Christian Gaardboe Carlsen
Title: Head of Property Excellence
ISS indlæg på – VEJEN TIL DET BYGBARE PROJEKT
Leveraging the customer journey
by applying technology and IoT
How can the digital
transformation
support the
workplace
experience?
Connecting People with Buildings:
• Data Connectivity
– Real-time & Historical
• Data Insight
– Analysis & WO triggers
• Data Prediction
– Usage and workplace optimization
Humidity
Air
Quality
Temperature
Proximity
Light
Noise
Availability
Automated
Engagement
Opportunities for
Digitalization
Service
Delivery
User
engagement
Digitalizing the Workplace and Service Experience
WO
triggered
by usage
Predictive
maintenance
Touch
points
# of visitors
in the toilets
# of people
in the building
Technical
Equiptment
”Refill me”
User touch points
throughout a day in
the buidling e.g
ISS Concierge APP
PURPOSE
COST PURPOSE
Workplace
analysis
Building
usage
Space
Management
Green
Building
Occupancy
(room and tables)
Benchmarking
Energy usage
Based on usage
And weather
Benchmarking
Map and analyse
workplace experience
and efficiency
Digitalizing the Workplace and
Service Experience
23
Space Utilization Footfall Counting Restroom Utilization
Recycle Monitoring Predictive Maintenance Lite Surveillance Climate Monitoring
Snow Metering
Current Smart Building Use Cases
IOT Sensor Output Examples
Comments
• The installation drawing to the left shows the
sensor placement for floor 1
• Currently focus on toilet utilization, work desk
utilization, and meeting room utilization.
• Future addition of comfort sensors in open areas
and small meeting rooms and full coverage of hot
desks.
We are taking
our own medicine:
Sensors
installed
everywhere
At the ISS HQ
What is the
technology
behind
Back-endSolution
IoTconnectiontoFMS
Let’s go
fix it!
Database
Trigger rules
Adjust
HVAC
Climate data
Sensor data
Database
Room 3.1 temp.
28C°
< 24C° = alarm
24C°-26C° = OK
> 26C° = alarm
Work Order
Generation
Too
warm
room
3.1
ProcessExample
BMS data
Mobile data
Back-end solution
Back-end solution for an IoT connection to FMS
High level technical solution
29
Smart BMS Gateaway
Live dashboard
Watson Analytics
IBM Bluemix
Publisher Subscriber
MQTT messages
Workorders
Request
Preventive
Proactive
Reactive
Project
BMS
Energy
Indoor climate
Occupancy
ISS Dashboard – Predictive Maintenance
To be situation
Monitoring (live dashboards):
Asset health
Alarms
Control (historical data analysis):
Energy Consumption
Uptime
Optimization (triggers):
Reduce asset break down and increase asset life time
with correct service
Reduce unnecessary service deliveries
Proactive service and repair before asset breakdown
Automatic service registration in FMS (TRIRIGA)
31
What's
going on?
What
happened?
Lets fix it!
Using Cognitive buildings to improve user satisfaction
by predicting capacity needs…
Challenge Predictive
resourcing
User
communication
Technology innovations
Something for the future – internal building navigation
§ A potential solution to support way finding
navigation at large sites
§ For new employees or visitors who are unaware of
a sites layout
§ Visiting or site based FM delivery staff carrying out
service tasks
§ Future design would allow a user to raise a task
directly from the 360° Visualization
§ Link IWMS data to specific assets in the map so
that service teams can access historical data from
one view, rather than switching systems
ISS HQ
- combined with the power of cognitive
buildings
Productivity
and user
satisfaction
Service
delivery
Building
usage
36

The Cognitive Building

  • 1.
    1 A New Eraof Thinking The Cognitive Building – When the building understands people Kim Escherich | @kescherich Executive Innovation Architect IBM Global Business Services Christian Gaardboe Carlsen Head of Property Excellence ISS Facility Services A/S
  • 2.
    • The CognitiveBuilding Kim Escherich, IBM • Leveraging the customer journey by applying technology and IoT Christian Gaardboe Carlsen, ISS
  • 3.
  • 4.
    How much doeshappiness affect productivity? Source: 2014 study by University of Warwick, UK, and IZA Bonn, Germany via The Stoddard Review 2016
  • 5.
    Do offices enableemployee productivity? 5 Source: The Leesman Index 2016 via The Stoddard Review
  • 7.
  • 8.
    Learn Behaviour Predictive controldown to desk level Understand energy flow and building occupancy Consider comfort preferences of users Collect context such as weather and meetings Too data points even for advanced analytics Building Management Evolution Visualize KPI Good for ratings Allows identifying general issues Bad for identifying energy waste Automated Buildings (1980 – 2000) Analyze Energy Consumers Understand consumption of rooms and central assets Only primary datapoints are analyzed Smart Buildings (2000 – 2015) Cognitive Buildings (> 2015)
  • 9.
    IoT & DevOpsPlatforms New Ecosystems BIM & Digital Twin Human-computer interfaces Analytics & AI Innovation & Design Thinking
  • 10.
    LEVEL 1 FACILITIES CENTRIC LEVEL2 ASSET CENTRIC LEVEL 3 PEOPLE CENTRIC CUSTOMERNEEDS Power,water, air, data Signage, security,assets, services, processes Ambient intelligence, productivity, happiness The Cognitive Building
  • 11.
    Composable buildings Navigate acampus via Watson speech Understand energy flow and diagnose anomalies with cognitive analytics Manage and find your assets in 3D Electricity with IoT Meter Occupancy with PIR Vibration Data with IoT Sensors Easily monitor and maintain assets before they fail Understand temperature, comfort and occupancyin buildings and data centers Desk Comfort Sensors Cognitive analytics for deep insights to unlock new cost savings. Customizable IoT platform that provides simple integration and high scalability Plug-and-play instrumentation with IoT devices Rapid modelling with laser scanner Learning Apache SparkdashDB with R Vision Visual Recognition Speech Text to SpeechSpeech to Text Language Natural Language Classifier Dialog Integration Watson IoTP Presence Insight INTEGRATE INTERACT REASON LEARN Reason Predictive AnalyticsIoT RT Insights Room BookingInsights for TwitterInsights for Weather TririgaMaximo Security Proximity with BLE Alchemy API
  • 12.
    Connected Building UseCases and Opportunities DIGITAL ASSET LIFECYCLE The manual input of data into a maintenance system for thousands of assets is a costly, error prone process. SEMANTIC INSIGHTS Analyzing thousands of IoT devices cannot provide meaningful insights without a semantic method. FLUID SPACES The lack of real-time occupancy information within a building inhibits effective energy and space performance. MY COGNITIVE CAMPUS Increase productivity of teams by providing a comfortable environment and easy navigation. MY ARTEFACT Maintaining the perfect environment for art galleries and museums is critical. REAL TIME ASSET LOCATION Finding assets and their relevant data is challenging, in particular when you are in the field. SELF-LEARNING ENERGY DIAGNOSER Energy consumption has many influences and it is hard to detect and diagnose abnormal consumption. COGNITIVE ASSET HEALTH Predictive and preventive maintenance are immanent to reduce operation costs, but, lack the required sensors. SCALABLE IOT PLATFORM Cognitive Buildings require a highly scalable platform for data integration and analysis. COGNITIVE CONCIERGE Guiding people to their rooms and answering their questions is an central element of hospitality.
  • 13.
    • Multi-modal transportationservices • Alerts before leaving home • "Please be aware that we are serving fish in the restaurant" (and you are allergic) • Remember your umbrella • Car sharing with colleauges • Pre-book work area (and you might decide to work from home) • Various work-from-home-services • Walking around guidance • Pay for your parking in-app (guest) • Issue mobile parking ticket • Provide alternative parking • Find me a parking spot (before arriving) • Find my car Weather integration | Transport/city integration | Cognitive HR analytics | IoT integration | Tririga integration | MobileFirst GETTING HERE MobileFirst | IoT integration (outdoor/camera) | Tririga integration | Maps 3D | Cognitive advisory services • Access control • The concierge knows you and can notify • The building knows you and can advise/notify • Alternative authentication means, e.g. combination of smartphone and biometrics, face recognition, smart watch + pincode/fingerprint etc. • Information services - app based • Counting, crowd and pattern analytics • Video survelliance • Anormaly video analytics (security) ENTERING ARRIVING Biometrics | IoT integration | Sensoring | MobileFirst | Tririga integration | Video analytics | Video content management • Get alerts and notifications on building app (smartphone or iWatch) • Get around - office maps 2D/3D • Order hot drinks • Order light meal • Check delivery situation on beverage machines • Manage postal services via app and notifications • Understand building usage and environment • Align internal climate with outside • Space management MobileFirst | 2D/3Dmaps | IoT Platform | Legacy Integration | Tririga Integration | Video analytics | Big data analytics BEING HERE • Locate my colleauges • Who is in my working area today • Status on infrastructure • Find me an empty seat based on personal profile • Optimise usage of office space • Crowd and usage analytics Indoor localization | IoT platform | Tririga integration | Cognitive Analytics | Big data analytics WORKING HERE • Get todays menu at the restaurant • How long is the queue right now? • When is it optimal for me to eat? • Nutritional information compared to personal health profile • Order guest tickets • Order takeaway based on prefernces Content management | IoT integration | Video surveillance | Partner integration | Cognitive DRINKING AND EATING • Physical meeting room displays • Reserve meeting room • Arrange spontaneous meeting (lets meet in 4 minutes in the cafe) • Conference support app • Booked but unused meeting rooms • Meeting rom outages / defects Tririga Integration | MobileFirst | Localisation services | Problem detection | Bookings MEETING WITH OTHERS • Checking out • Evaluating the day • Find my car, bicycle or the path to the train station • Heating the car • Notifying the spouse LEAVING IoT Integration | Partner integration | IoT integration | MobileFirst COGNITIVE BUILDING TOUCHPOINTS
  • 14.
    Copyright © KONECorporation KONE ELEVATORS
  • 15.
  • 16.
  • 17.
  • 18.
    Christian Gaardboe Carlsen Title:Head of Property Excellence ISS indlæg på – VEJEN TIL DET BYGBARE PROJEKT Leveraging the customer journey by applying technology and IoT
  • 19.
    How can thedigital transformation support the workplace experience?
  • 20.
    Connecting People withBuildings: • Data Connectivity – Real-time & Historical • Data Insight – Analysis & WO triggers • Data Prediction – Usage and workplace optimization Humidity Air Quality Temperature Proximity Light Noise Availability Automated Engagement Opportunities for Digitalization
  • 22.
    Service Delivery User engagement Digitalizing the Workplaceand Service Experience WO triggered by usage Predictive maintenance Touch points # of visitors in the toilets # of people in the building Technical Equiptment ”Refill me” User touch points throughout a day in the buidling e.g ISS Concierge APP PURPOSE COST PURPOSE Workplace analysis Building usage Space Management Green Building Occupancy (room and tables) Benchmarking Energy usage Based on usage And weather Benchmarking Map and analyse workplace experience and efficiency
  • 23.
    Digitalizing the Workplaceand Service Experience 23
  • 24.
    Space Utilization FootfallCounting Restroom Utilization Recycle Monitoring Predictive Maintenance Lite Surveillance Climate Monitoring Snow Metering Current Smart Building Use Cases
  • 26.
    IOT Sensor OutputExamples Comments • The installation drawing to the left shows the sensor placement for floor 1 • Currently focus on toilet utilization, work desk utilization, and meeting room utilization. • Future addition of comfort sensors in open areas and small meeting rooms and full coverage of hot desks.
  • 27.
    We are taking ourown medicine: Sensors installed everywhere At the ISS HQ What is the technology behind
  • 28.
    Back-endSolution IoTconnectiontoFMS Let’s go fix it! Database Triggerrules Adjust HVAC Climate data Sensor data Database Room 3.1 temp. 28C° < 24C° = alarm 24C°-26C° = OK > 26C° = alarm Work Order Generation Too warm room 3.1 ProcessExample BMS data Mobile data Back-end solution Back-end solution for an IoT connection to FMS
  • 29.
    High level technicalsolution 29 Smart BMS Gateaway Live dashboard Watson Analytics IBM Bluemix Publisher Subscriber MQTT messages Workorders Request Preventive Proactive Reactive Project BMS Energy Indoor climate Occupancy
  • 30.
    ISS Dashboard –Predictive Maintenance
  • 31.
    To be situation Monitoring(live dashboards): Asset health Alarms Control (historical data analysis): Energy Consumption Uptime Optimization (triggers): Reduce asset break down and increase asset life time with correct service Reduce unnecessary service deliveries Proactive service and repair before asset breakdown Automatic service registration in FMS (TRIRIGA) 31 What's going on? What happened? Lets fix it!
  • 32.
    Using Cognitive buildingsto improve user satisfaction by predicting capacity needs… Challenge Predictive resourcing User communication
  • 33.
    Technology innovations Something forthe future – internal building navigation § A potential solution to support way finding navigation at large sites § For new employees or visitors who are unaware of a sites layout § Visiting or site based FM delivery staff carrying out service tasks § Future design would allow a user to raise a task directly from the 360° Visualization § Link IWMS data to specific assets in the map so that service teams can access historical data from one view, rather than switching systems ISS HQ
  • 34.
    - combined withthe power of cognitive buildings
  • 35.
  • 36.