SlideShare a Scribd company logo
1 of 93
2 December 2005
eSPACE
Conceptual Foundations for End-User Authoring of
Cross-Device and Internet of Things Applications
Audrey Sanctorum
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 2June 11, 2020
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 3June 11, 2020
Multi-Device World
Sequential interaction Simultaneous interaction
Smart Devices Things
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 4June 11, 2020
Research Fields
Cross-Device
Interaction (XDI)
Distributed User
Interfaces (DUI)
Internet of Things (IoT)
Improves interaction
across smart devices
Improves interaction
across things
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 5June 11, 2020
Problems
Fragmented Control – Lack of Uniformity – Limited Functionality & Customisation
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 6June 11, 2020
Problems
Fragmented Control – Lack of Uniformity – Limited Functionality & Customisation
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 7June 11, 2020
Problems
Fragmented Control – Lack of Uniformity – Limited Functionality & Customisation
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 8June 11, 2020
Problems
Fragmented Control – Lack of Uniformity – Limited Functionality & Customisation
End
Users
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 9June 11, 2020
Problem Statement
XDI/DUI IoT
EUD
As new smart technologies emerge in large
numbers, it is not only difficult for developers to
keep up with these evolving technologies, but
even more for end users.
This is caused by the end user’s lack of a flexible,
unified and extensible solution for controlling all
smart technologies (in one place) that can cope
with their individual and evolving needs.
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 10June 11, 2020
Main Research Question
How can we enable end users to have a better
control over their smart technologies by using
appropriate abstractions to hide the complex
technical details when creating and modifying
unified cross-device and IoT user interfaces
specifically made to control these smart
technologies?
XDI/DUI IoT
EUD
X
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 11June 11, 2020
Research Questions
RQ1 What are the main requirements for the end-user authoring of
unified cross-device and IoT user interfaces?
RQ2 What are the necessary concepts and methods to address
the requirements resulting from answering RQ1?
RQ3 Which metaphors or abstractions should be used on top of
our conceptual foundation to allow end users to visualise and
create their unified cross-device and IoT interactions?
RQ4 How can we design a unified cross-device and IoT EUD
authoring tool given the requirements from RQ1, the conceptual
foundations from RQ2 and the guidelines including the appropriate
metaphors found in RQ3?
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 12June 11, 2020
Research Question 1
What are the main requirements for the
end-user authoring of unified cross-device
and IoT user interfaces?
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 13June 11, 2020
Metaphor Classification
Metaphor Systems
Timeline A CAPpella, AppsGate
Rules AppsGate, Atooma, CMT, E-Free, E-Wired, E-Wizard, Ghiani et al.(2015), HomeRules,
iCAP, IFTTT, ImAtHome, Keep Doing It, SmartFit, T4Tags 2.0, TARE, Tasker,
TouchCompozr
Pipeline AppsGate, E-Wired, Versatile
Jigsaw Puzzle ACCORD, Puzzle, Zipato
Join-the-dots Platform Composition
Drag-and-drop DashMash, DireWolf, DireWolf 3.0.0, SmartComposition
Copy/paste Jelly, MashupEditor, XDBrowser 2.0
None EPIDOSITE, Ghiani et al.(2012), Improv, InterPlay, Paterno and Zichitella, WebSplitter
Pering et al.
(2009-2010)
Humble et al.
(2003)
Danado and Paternò
(2014/2017)
Desolda et al.
(2017) Maués (2013) https://ifttt.com
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 14June 11, 2020
R1 Provide an overview of the smart technologies, environments and applications
R2 Interaction support
R2.1 Support for interaction across multiple smart technologies
R2.2 Support for creation, customisation and distribution of cross-device and IoT UIs
R3 Support for sharing and integration of apps in a central smart apps repository
R4 Extensibility
R4.1 Offer extensibility at the level of communication protocols, devices and user interfaces
R4.2 Enable the integration of third-party applications
R5 Support for end-user development
Requirements
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 15June 11, 2020
R1 Provide an overview of the smart technologies, environments and applications
R2 Interaction support
R2.1 Support for interaction across multiple smart technologies
R2.2 Support for creation, customisation and distribution of cross-device and IoT UIs
R3 Support for sharing and integration of apps in a central smart apps repository
R4 Extensibility
R4.1 Offer extensibility at the level of communication protocols, devices and user interfaces
R4.2 Enable the integration of third-party applications
R5 Support for end-user development
Requirements
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 16June 11, 2020
Use Case Scenario
Lucas
Leaving home application
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 17June 11, 2020
Lucas
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 18June 11, 2020
Lucas
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 19June 11, 2020
Lucas Lucy
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 20June 11, 2020
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 21June 11, 2020
R3 Shareability
R3.1 Support for sharing and integration of apps in a central smart apps repository
R3.2 Enable sharing of applications, user interfaces or parts of a UI with specific users
R5 Reusability
R5.1 Support for reuse and combination of different user interfaces
R5.2 Support for reuse and combination of different functionality
R6 Portability
R6.1 Offer platform independence
R6.2 Support for adaptation of applications and user interfaces to users and devices
R7 Support for end-user development
Updated Requirements
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 22June 11, 2020
R3 Shareability
R3.1 Support for sharing and integration of apps in a central smart apps repository
R3.2 Enable sharing of applications, user interfaces or parts of a UI with specific users
R5 Reusability
R5.1 Support for reuse and combination of different user interfaces
R5.2 Support for reuse and combination of different functionality
R6 Portability
R6.1 Offer platform independence
R6.2 Support for adaptation of applications and user interfaces to users and devices
R7 Support for end-user development
Updated Requirements
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 23June 11, 2020
R3 Shareability
R3.1 Support for sharing and integration of apps in a central smart apps repository
R3.2 Enable sharing of applications, user interfaces or parts of a UI with specific users
R5 Reusability
R5.1 Support for reuse and combination of different user interfaces
R5.2 Support for reuse and combination of different functionality
R6 Portability
R6.1 Offer platform independence
R6.2 Support for adaptation of applications and user interfaces to users and devices
R7 Support for end-user development
Updated Requirements
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 24June 11, 2020
Research Question 2
What are the necessary concepts and
methods to address the requirements
resulting from answering RQ1?
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 25June 11, 2020
Model-based Approach
Define important concepts of
XD & IoT applications
Can be reused by
other developers
Allow flexibility and
extensibility
Increase communication
and controlBenefits
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 26June 11, 2020
Updated Requirements
R2 Interaction support
R2.3 Offer fine granularity UI distribution
R4 Extensibility
R4.3 Offer extensibility of adaptive behaviour and distribution configurations
R6 Portability
R6.2 Support for context awareness
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 27June 11, 2020
Final
Requirements
R1 Provide an overview of the smart technologies, environments and applications
R2 Interaction support
R2.1 Support for interaction across multiple smart technologies
R2.2 Support for creation, customisation and distribution of cross-device and IoT UIs
R2.3 Offer fine granularity UI distribution
R3 Shareability
R3.1 Support for sharing and integration of apps in a central smart apps repository
R3.2 Enable sharing of applications, user interfaces or parts of a UI with specific users
R4 Extensibility
R4.1 Offer extensibility at the level of communication protocols, devices and UIs
R4.2 Enable the integration of third-party applications
R4.3 Offer extensibility of adaptive behaviour and distribution configurations
R5 Reusability
R5.1 Support for reuse and combination of different user interfaces
R5.2 Support for reuse and combination of different functionality
R6 Portability
R6.1 Offer platform independence
R6.2 Support for context awareness
R7 Support for end-user development
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 28June 11, 2020
eSPACE Reference
Framework
Motion
detector AC
Notifier AC
Scratching
notifier AC
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 29June 11, 2020
eSPACE Reference
Framework
Video Frame
UIe
Record
Button UIe
Video UIe
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 30June 11, 2020
eSPACE Reference
Framework
Toggle AC
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 31June 11, 2020
eSPACE Reference
Framework
Toggle AC
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 32June 11, 2020
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 33June 11, 2020
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 34June 11, 2020
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 35June 11, 2020
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 36June 11, 2020
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 37June 11, 2020
Compliance of
eSPACE Model
with
Requirements
R1 Provide an overview of the smart technologies, environments and applications
R2 Interaction support
R2.1 Support for interaction across multiple smart technologies
R2.2 Support for creation, customisation and distribution of cross-device and IoT UIs
R2.3 Offer fine granularity UI distribution
R3 Shareability
R3.1 Support for sharing and integration of apps in a central smart apps repository
R3.2 Enable sharing of applications, user interfaces or parts of a UI with specific users
R4 Extensibility
R4.1 Offer extensibility at the level of communication protocols, devices and UIs
R4.2 Enable the integration of third-party applications
R4.3 Offer extensibility of adaptive behaviour and distribution configurations
R5 Reusability
R5.1 Support for reuse and combination of different user interfaces
R5.2 Support for reuse and combination of different functionality
R6 Portability
R6.1 Offer platform independence
R6.2 Support for context awareness
R7 Support for end-user development
Legend
Not fulfilling requirement
Partially fulfilling requirement
Completely fulfilling requirement
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 38June 11, 2020
Implementation
Roels (2019)
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 39June 11, 2020
Implementation
Roels (2019)
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 40June 11, 2020
Research Question 3
Which metaphors or abstractions should be
used on top of our conceptual foundation to
allow end users to visualise and create their
unified cross-device and IoT interactions?
A-FrameOrganicMaterial-Based Victorian Mediterranean
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 41June 11, 2020
Elicitation Study
Why?
Get mental models of people when
dealing with XDI and IoT interactions
Derive design guidelinesFind right abstractions/metaphors
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 42June 11, 2020
Elicitation Study: Methology
30 Participants (12 females) 15 technical 15 non-technical
15 sessions with 2 participants
XDI and IoT presentation
Scenario drawing
Interview and questionnaire
Comparison of drawing
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 43June 11, 2020
Drawings
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 44June 11, 2020
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 45June 11, 2020
Design Guidelines
G1 Use Pipeline Metaphor to Represent Interactions
G2 Use Different Arrow Types for Different Interaction Types
G3 Provide a Realistic Graphical Device Representation
G4 Provide a Graphical Representation of Users
G5 Represent Sequential Interactions from Left to Right and Group Concurrent Interactions
G6 Provide Textual as well as Graphical Representations for Conditional Statements
G7 Support UI Design
G8 Use of Symbols and Annotations
=>
A-FrameOrganicMaterial-Based Victorian Mediterranean Mediterranean
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 46June 11, 2020
Guideline 1: Use Pipeline Metaphor to Represent Interactions
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 47June 11, 2020
Guideline 3: Provide a Realistic Graphical Device Representation
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 48June 11, 2020
Guideline 5: Represent Sequential Interactions from Left to Right
and Group Concurrent Interactions
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 49June 11, 2020
Guideline 7: Support UI Design
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 50June 11, 2020
Design Guidelines
G1 Use Pipeline Metaphor to Represent Interactions
G2 Use Different Arrow Types for Different Interaction Types
G3 Provide a Realistic Graphical Device Representation
G4 Provide a Graphical Representation of Users
G5 Represent Sequential Interactions from Left to Right and Group Concurrent Interactions
G6 Provide Textual as well as Graphical Representations for Conditional Statements
G7 Support UI Design
G8 Use of Symbols and Annotations
=>
A-FrameOrganicMaterial-Based Victorian Mediterranean Mediterranean
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 51June 11, 2020
Research Question 4
How can we design a unified cross-device and
IoT EUD authoring tool given the requirements
from RQ1, the conceptual foundations from RQ2
and the guidelines including the appropriate
metaphors found in RQ3?
+ + =>
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 52June 11, 2020
eSPACE Authoring Tool Architecture
RSL Link Server
=>
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 53June 11, 2020
Home View
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 54June 11, 2020
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 55June 11, 2020
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 56June 11, 2020
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 57June 11, 2020
UI Design View
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 58June 11, 2020
Interaction View
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 59June 11, 2020
Interaction View
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 60June 11, 2020
Interaction View
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 61June 11, 2020
Interaction View
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 62June 11, 2020
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 63June 11, 2020
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 64June 11, 2020
Rules View
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 65June 11, 2020
Home View
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 66June 11, 2020
eSPACE Authoring Tool Architecture
RSL Link Server
=>
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 67June 11, 2020
Example Application
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 68June 11, 2020
UI Distribution
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 69June 11, 2020
Compliance to Guidelines
G1 Use Pipeline Metaphor to Represent Interactions
G2 Use Different Arrow Types for Different Interaction Types
G3 Provide a Realistic Graphical Device Representation
G4 Provide a Graphical Representation of Users
G5 Represent Sequential Interactions from Left to Right and Group Concurrent Interactions
G6 Provide Textual as well as Graphical Representations for Conditional Statements
G7 Support UI Design
G8 Use of Symbols and Annotations
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 70June 11, 2020
Compliance of
Related Work
with Guidelines
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 71June 11, 2020
Compliance of
eSPACE Tool
with
Requirements
R1 Provide an overview of the smart technologies, environments and applications
R2 Interaction support
R2.1 Support for interaction across multiple smart technologies
R2.2 Support for creation, customisation and distribution of cross-device and IoT UIs
R2.3 Offer fine granularity UI distribution
R3 Shareability
R3.1 Support for sharing and integration of apps in a central smart apps repository
R3.2 Enable sharing of applications, user interfaces or parts of a UI with specific users
R4 Extensibility
R4.1 Offer extensibility at the level of communication protocols, devices and UIs
R4.2 Enable the integration of third-party applications
R4.3 Offer extensibility of adaptive behaviour and distribution configurations
R5 Reusability
R5.1 Support for reuse and combination of different user interfaces
R5.2 Support for reuse and combination of different functionality
R6 Portability
R6.1 Offer platform independence
R6.2 Support for context awareness
R7 Support for end-user development
Legend
Not fulfilling requirement
Partially fulfilling requirement
Completely fulfilling requirement
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 72June 11, 2020
Initial Evaluation
8 Participants (5 females)
Scenario App Creation
Reading Tutorial
Simple Controller App
Grocery List App
Morning Routine
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 73June 11, 2020
Use Cases
Simple Controller App Grocery List App Morning Routine
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 74June 11, 2020
Initial Evaluation
8 Participants (5 females)
Scenario App Creation
Questionnaire and Interview
Reading Tutorial
Simple Controller App
Grocery List App
Morning Routine
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 75June 11, 2020
Microsoft Reaction Cards
40 Words
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 76June 11, 2020
Summary Evaluation Results
Organised Useful Easy to Use
Interaction view preferred by 4
Future work Add in-tool follow along tutorial
Improve terminology in dropdowns
Add help buttons
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 77June 11, 2020
Simple Controller App
P1
P4
P3
P7
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 78June 11, 2020
Morning Routine App
P8
P7
P4P6
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 79June 11, 2020
Conclusions
RQ1 What are the main requirements for the end-user authoring of
unified cross-device and IoT user interfaces?
RQ2 What are the necessary concepts and methods to address
the requirements resulting from answering RQ1?
RQ3 Which metaphors or abstractions should be used on top of
our conceptual foundation to allow end users to visualise and
create their unified cross-device and IoT interactions?
RQ4 How can we design a unified cross-device and IoT EUD
authoring tool given the requirements from RQ1, the conceptual
foundations from RQ2 and the guidelines including the appropriate
metaphors found in RQ3?
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 80June 11, 2020
Contributions
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 81June 11, 2020
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 82June 11, 2020
Conclusions
RQ1 What are the main requirements for the end-user authoring of
unified cross-device and IoT user interfaces?
RQ2 What are the necessary concepts and methods to address
the requirements resulting from answering RQ1?
RQ3 Which metaphors or abstractions should be used on top of
our conceptual foundation to allow end users to visualise and
create their unified cross-device and IoT interactions?
RQ4 How can we design a unified cross-device and IoT EUD
authoring tool given the requirements from RQ1, the conceptual
foundations from RQ2 and the guidelines including the appropriate
metaphors found in RQ3?
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 83June 11, 2020
Contributions
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 84June 11, 2020
eSPACE Reference Framework eSPACE Conceptual Model
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 85June 11, 2020
Conclusions
RQ1 What are the main requirements for the end-user authoring of
unified cross-device and IoT user interfaces?
RQ2 What are the necessary concepts and methods to address
the requirements resulting from answering RQ1?
RQ3 Which metaphors or abstractions should be used on top of
our conceptual foundation to allow end users to visualise and
create their unified cross-device and IoT interactions?
RQ4 How can we design a unified cross-device and IoT EUD
authoring tool given the requirements from RQ1, the conceptual
foundations from RQ2 and the guidelines including the appropriate
metaphors found in RQ3?
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 86June 11, 2020
Contributions
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 87June 11, 2020
Design Guidelines
Guideline 1 (G1) Use Pipeline Metaphor to Represent Interactions
Guideline 2 (G2) Use Different Arrow Types for Different Interaction Types
Guideline 3 (G3) Provide a Realistic Graphical Device Representation
Guideline 4 (G4) Provide a Graphical Representation of Users
Guideline 5 (G5) Represent Sequential Interactions from Left to Right and
Group Concurrent Interactions
Guideline 6 (G6) Provide Textual as well as Graphical Representations for
Conditional Statements
Guideline 7 (G7) Support UI Design
Guideline 8 (G8) Use of Symbols and Annotations
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 88June 11, 2020
Conclusions
RQ1 What are the main requirements for the end-user authoring of
unified cross-device and IoT user interfaces?
RQ2 What are the necessary concepts and methods to address
the requirements resulting from answering RQ1?
RQ3 Which metaphors or abstractions should be used on top of
our conceptual foundation to allow end users to visualise and
create their unified cross-device and IoT interactions?
RQ4 How can we design a unified cross-device and IoT EUD
authoring tool given the requirements from RQ1, the conceptual
foundations from RQ2 and the guidelines including the appropriate
metaphors found in RQ3?
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 89June 11, 2020
Contributions
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 90June 11, 2020
Conclusions
RQ1 What are the main requirements for the end-user authoring of
unified cross-device and IoT user interfaces?
RQ2 What are the necessary concepts and methods to address
the requirements resulting from answering RQ1?
RQ3 Which metaphors or abstractions should be used on top of
our conceptual foundation to allow end users to visualise and
create their unified cross-device and IoT interactions?
RQ4 How can we design a unified cross-device and IoT EUD
authoring tool given the requirements from RQ1, the conceptual
foundations from RQ2 and the guidelines including the appropriate
metaphors found in RQ3?
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 91June 11, 2020
eSPACE
Authoring
Tool
Rules View
Interaction View
App View
Home View
UI Design
View
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 92June 11, 2020
Future Work
Improve usability of eSPACE User studies
Integrate remaining requirements
Integrate different modalities
Explore human-AI interaction Improve user-defined apps
Improve sharing, extensibility & portability
Support for voice and gesture interaction
+
Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 93June 11, 2020
Contributions

More Related Content

What's hot

IRJET- Cloud based Chat Bot using IoT and Arduino
IRJET- Cloud based Chat Bot using IoT and ArduinoIRJET- Cloud based Chat Bot using IoT and Arduino
IRJET- Cloud based Chat Bot using IoT and ArduinoIRJET Journal
 
An brief introduction to android operating system
An brief introduction to android operating systemAn brief introduction to android operating system
An brief introduction to android operating systemAlexander Decker
 
android presentation by akbar
android presentation by akbarandroid presentation by akbar
android presentation by akbarAkbar Md
 
The MRAA and UPM Eclipse IoT Projects | Eclipse IoT Day Santa Clara 2019
The MRAA and UPM Eclipse IoT Projects | Eclipse IoT Day Santa Clara 2019The MRAA and UPM Eclipse IoT Projects | Eclipse IoT Day Santa Clara 2019
The MRAA and UPM Eclipse IoT Projects | Eclipse IoT Day Santa Clara 2019Eclipse IoT
 
Turn your product into a revenue machine with the new Qt Digital Advertising ...
Turn your product into a revenue machine with the new Qt Digital Advertising ...Turn your product into a revenue machine with the new Qt Digital Advertising ...
Turn your product into a revenue machine with the new Qt Digital Advertising ...Qt
 

What's hot (9)

IRJET- Cloud based Chat Bot using IoT and Arduino
IRJET- Cloud based Chat Bot using IoT and ArduinoIRJET- Cloud based Chat Bot using IoT and Arduino
IRJET- Cloud based Chat Bot using IoT and Arduino
 
An brief introduction to android operating system
An brief introduction to android operating systemAn brief introduction to android operating system
An brief introduction to android operating system
 
android presentation by akbar
android presentation by akbarandroid presentation by akbar
android presentation by akbar
 
SensActions-Report
SensActions-ReportSensActions-Report
SensActions-Report
 
Poster Vicon
Poster ViconPoster Vicon
Poster Vicon
 
The MRAA and UPM Eclipse IoT Projects | Eclipse IoT Day Santa Clara 2019
The MRAA and UPM Eclipse IoT Projects | Eclipse IoT Day Santa Clara 2019The MRAA and UPM Eclipse IoT Projects | Eclipse IoT Day Santa Clara 2019
The MRAA and UPM Eclipse IoT Projects | Eclipse IoT Day Santa Clara 2019
 
IRJET- Smart Mirror
IRJET- Smart MirrorIRJET- Smart Mirror
IRJET- Smart Mirror
 
Resume
ResumeResume
Resume
 
Turn your product into a revenue machine with the new Qt Digital Advertising ...
Turn your product into a revenue machine with the new Qt Digital Advertising ...Turn your product into a revenue machine with the new Qt Digital Advertising ...
Turn your product into a revenue machine with the new Qt Digital Advertising ...
 

Similar to eSPACE - Conceptual Foundations for End-User Authoring of Cross-Device and Internet of Things Applications

IRJET - Survey Paper on Tools Used to Enhance User's Experience with Cons...
IRJET -  	  Survey Paper on Tools Used to Enhance User's Experience with Cons...IRJET -  	  Survey Paper on Tools Used to Enhance User's Experience with Cons...
IRJET - Survey Paper on Tools Used to Enhance User's Experience with Cons...IRJET Journal
 
12th International Conference on Ubiquitous Computing (UBIC 2021)
12th International Conference on Ubiquitous Computing (UBIC 2021) 12th International Conference on Ubiquitous Computing (UBIC 2021)
12th International Conference on Ubiquitous Computing (UBIC 2021) ijasuc
 
A REVIEW PAPER ON “IOT” & FUTURE RESEARCH IN INTERNET APPLICATIONS
A REVIEW PAPER ON “IOT” & FUTURE RESEARCH IN INTERNET APPLICATIONSA REVIEW PAPER ON “IOT” & FUTURE RESEARCH IN INTERNET APPLICATIONS
A REVIEW PAPER ON “IOT” & FUTURE RESEARCH IN INTERNET APPLICATIONSIRJET Journal
 
Fi ware short overview - zaragoza
Fi ware short overview - zaragoza Fi ware short overview - zaragoza
Fi ware short overview - zaragoza Jose Jimenez
 
ITU-T Study Group 20 Introduction
ITU-T Study Group 20 IntroductionITU-T Study Group 20 Introduction
ITU-T Study Group 20 IntroductionITU
 
Smart Cities, IoT, SDN, 5G Networks, Cloud Computing… Managing Complexity wit...
Smart Cities, IoT, SDN, 5G Networks, Cloud Computing… Managing Complexity wit...Smart Cities, IoT, SDN, 5G Networks, Cloud Computing… Managing Complexity wit...
Smart Cities, IoT, SDN, 5G Networks, Cloud Computing… Managing Complexity wit...Bristol Is Open
 
INTRODUCTION TO INTERNET OF THINGS
INTRODUCTION TO INTERNET OF THINGSINTRODUCTION TO INTERNET OF THINGS
INTRODUCTION TO INTERNET OF THINGSVikram Nandini
 
FIWARE Overview of Generic Enablers
FIWARE Overview of Generic EnablersFIWARE Overview of Generic Enablers
FIWARE Overview of Generic EnablersMiguel González
 
IRJET - Notice Board using LED Matrix Display
IRJET - Notice Board using LED Matrix DisplayIRJET - Notice Board using LED Matrix Display
IRJET - Notice Board using LED Matrix DisplayIRJET Journal
 
1rst ARCADIA project newsletter
1rst ARCADIA project newsletter1rst ARCADIA project newsletter
1rst ARCADIA project newsletterEU ARCADIA PROJECT
 
[Middleware 2015] Cassowary: Middleware Platform for Context-Aware Smart Buil...
[Middleware 2015] Cassowary: Middleware Platform for Context-Aware Smart Buil...[Middleware 2015] Cassowary: Middleware Platform for Context-Aware Smart Buil...
[Middleware 2015] Cassowary: Middleware Platform for Context-Aware Smart Buil...Pradeeban Kathiravelu, Ph.D.
 
11 th International Conference on Parallel, Distributed Computing Technologi...
11 th International Conference on Parallel, Distributed Computing  Technologi...11 th International Conference on Parallel, Distributed Computing  Technologi...
11 th International Conference on Parallel, Distributed Computing Technologi...IJCSEA Journal
 
IRJET- The Usability of HCI in Smart Home
IRJET- The Usability of HCI in Smart HomeIRJET- The Usability of HCI in Smart Home
IRJET- The Usability of HCI in Smart HomeIRJET Journal
 
Reference Knowledge Models for Smart Application
Reference Knowledge Models for Smart ApplicationReference Knowledge Models for Smart Application
Reference Knowledge Models for Smart ApplicationMaxime Lefrançois
 
Mobile Accessibility Breakfast Briefing - Oct 2020
Mobile Accessibility Breakfast Briefing - Oct 2020Mobile Accessibility Breakfast Briefing - Oct 2020
Mobile Accessibility Breakfast Briefing - Oct 2020User Vision
 
11 th International Conference on Parallel, Distributed Computing Technologi...
11 th International Conference on Parallel, Distributed Computing  Technologi...11 th International Conference on Parallel, Distributed Computing  Technologi...
11 th International Conference on Parallel, Distributed Computing Technologi...IJCSEA Journal
 
why-choose-.net-for-your-next-iot-project.pdf
why-choose-.net-for-your-next-iot-project.pdfwhy-choose-.net-for-your-next-iot-project.pdf
why-choose-.net-for-your-next-iot-project.pdfPixelQA
 
Call for Papers - International Journal of Ubiquitous Computing (IJU)
Call for Papers - International Journal of Ubiquitous Computing (IJU)Call for Papers - International Journal of Ubiquitous Computing (IJU)
Call for Papers - International Journal of Ubiquitous Computing (IJU)ijujournal
 

Similar to eSPACE - Conceptual Foundations for End-User Authoring of Cross-Device and Internet of Things Applications (20)

IRJET - Survey Paper on Tools Used to Enhance User's Experience with Cons...
IRJET -  	  Survey Paper on Tools Used to Enhance User's Experience with Cons...IRJET -  	  Survey Paper on Tools Used to Enhance User's Experience with Cons...
IRJET - Survey Paper on Tools Used to Enhance User's Experience with Cons...
 
12th International Conference on Ubiquitous Computing (UBIC 2021)
12th International Conference on Ubiquitous Computing (UBIC 2021) 12th International Conference on Ubiquitous Computing (UBIC 2021)
12th International Conference on Ubiquitous Computing (UBIC 2021)
 
A REVIEW PAPER ON “IOT” & FUTURE RESEARCH IN INTERNET APPLICATIONS
A REVIEW PAPER ON “IOT” & FUTURE RESEARCH IN INTERNET APPLICATIONSA REVIEW PAPER ON “IOT” & FUTURE RESEARCH IN INTERNET APPLICATIONS
A REVIEW PAPER ON “IOT” & FUTURE RESEARCH IN INTERNET APPLICATIONS
 
Windows for IOT
Windows for IOTWindows for IOT
Windows for IOT
 
Fi ware short overview - zaragoza
Fi ware short overview - zaragoza Fi ware short overview - zaragoza
Fi ware short overview - zaragoza
 
ITU-T Study Group 20 Introduction
ITU-T Study Group 20 IntroductionITU-T Study Group 20 Introduction
ITU-T Study Group 20 Introduction
 
Smart Cities, IoT, SDN, 5G Networks, Cloud Computing… Managing Complexity wit...
Smart Cities, IoT, SDN, 5G Networks, Cloud Computing… Managing Complexity wit...Smart Cities, IoT, SDN, 5G Networks, Cloud Computing… Managing Complexity wit...
Smart Cities, IoT, SDN, 5G Networks, Cloud Computing… Managing Complexity wit...
 
INTRODUCTION TO INTERNET OF THINGS
INTRODUCTION TO INTERNET OF THINGSINTRODUCTION TO INTERNET OF THINGS
INTRODUCTION TO INTERNET OF THINGS
 
FIWARE Generic Enablers introduction
FIWARE Generic Enablers introductionFIWARE Generic Enablers introduction
FIWARE Generic Enablers introduction
 
FIWARE Overview of Generic Enablers
FIWARE Overview of Generic EnablersFIWARE Overview of Generic Enablers
FIWARE Overview of Generic Enablers
 
IRJET - Notice Board using LED Matrix Display
IRJET - Notice Board using LED Matrix DisplayIRJET - Notice Board using LED Matrix Display
IRJET - Notice Board using LED Matrix Display
 
1rst ARCADIA project newsletter
1rst ARCADIA project newsletter1rst ARCADIA project newsletter
1rst ARCADIA project newsletter
 
[Middleware 2015] Cassowary: Middleware Platform for Context-Aware Smart Buil...
[Middleware 2015] Cassowary: Middleware Platform for Context-Aware Smart Buil...[Middleware 2015] Cassowary: Middleware Platform for Context-Aware Smart Buil...
[Middleware 2015] Cassowary: Middleware Platform for Context-Aware Smart Buil...
 
11 th International Conference on Parallel, Distributed Computing Technologi...
11 th International Conference on Parallel, Distributed Computing  Technologi...11 th International Conference on Parallel, Distributed Computing  Technologi...
11 th International Conference on Parallel, Distributed Computing Technologi...
 
IRJET- The Usability of HCI in Smart Home
IRJET- The Usability of HCI in Smart HomeIRJET- The Usability of HCI in Smart Home
IRJET- The Usability of HCI in Smart Home
 
Reference Knowledge Models for Smart Application
Reference Knowledge Models for Smart ApplicationReference Knowledge Models for Smart Application
Reference Knowledge Models for Smart Application
 
Mobile Accessibility Breakfast Briefing - Oct 2020
Mobile Accessibility Breakfast Briefing - Oct 2020Mobile Accessibility Breakfast Briefing - Oct 2020
Mobile Accessibility Breakfast Briefing - Oct 2020
 
11 th International Conference on Parallel, Distributed Computing Technologi...
11 th International Conference on Parallel, Distributed Computing  Technologi...11 th International Conference on Parallel, Distributed Computing  Technologi...
11 th International Conference on Parallel, Distributed Computing Technologi...
 
why-choose-.net-for-your-next-iot-project.pdf
why-choose-.net-for-your-next-iot-project.pdfwhy-choose-.net-for-your-next-iot-project.pdf
why-choose-.net-for-your-next-iot-project.pdf
 
Call for Papers - International Journal of Ubiquitous Computing (IJU)
Call for Papers - International Journal of Ubiquitous Computing (IJU)Call for Papers - International Journal of Ubiquitous Computing (IJU)
Call for Papers - International Journal of Ubiquitous Computing (IJU)
 

Recently uploaded

Introduction to FIDO Authentication and Passkeys.pptx
Introduction to FIDO Authentication and Passkeys.pptxIntroduction to FIDO Authentication and Passkeys.pptx
Introduction to FIDO Authentication and Passkeys.pptxFIDO Alliance
 
The Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightThe Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightSafe Software
 
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)Samir Dash
 
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...panagenda
 
Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)
Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)
Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)Paige Cruz
 
Six Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal OntologySix Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal Ontologyjohnbeverley2021
 
How we scaled to 80K users by doing nothing!.pdf
How we scaled to 80K users by doing nothing!.pdfHow we scaled to 80K users by doing nothing!.pdf
How we scaled to 80K users by doing nothing!.pdfSrushith Repakula
 
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...TrustArc
 
Event-Driven Architecture Masterclass: Challenges in Stream Processing
Event-Driven Architecture Masterclass: Challenges in Stream ProcessingEvent-Driven Architecture Masterclass: Challenges in Stream Processing
Event-Driven Architecture Masterclass: Challenges in Stream ProcessingScyllaDB
 
State of the Smart Building Startup Landscape 2024!
State of the Smart Building Startup Landscape 2024!State of the Smart Building Startup Landscape 2024!
State of the Smart Building Startup Landscape 2024!Memoori
 
Top 10 CodeIgniter Development Companies
Top 10 CodeIgniter Development CompaniesTop 10 CodeIgniter Development Companies
Top 10 CodeIgniter Development CompaniesTopCSSGallery
 
Continuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
Continuing Bonds Through AI: A Hermeneutic Reflection on ThanabotsContinuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
Continuing Bonds Through AI: A Hermeneutic Reflection on ThanabotsLeah Henrickson
 
CORS (Kitworks Team Study 양다윗 발표자료 240510)
CORS (Kitworks Team Study 양다윗 발표자료 240510)CORS (Kitworks Team Study 양다윗 발표자료 240510)
CORS (Kitworks Team Study 양다윗 발표자료 240510)Wonjun Hwang
 
TEST BANK For, Information Technology Project Management 9th Edition Kathy Sc...
TEST BANK For, Information Technology Project Management 9th Edition Kathy Sc...TEST BANK For, Information Technology Project Management 9th Edition Kathy Sc...
TEST BANK For, Information Technology Project Management 9th Edition Kathy Sc...marcuskenyatta275
 
WebRTC and SIP not just audio and video @ OpenSIPS 2024
WebRTC and SIP not just audio and video @ OpenSIPS 2024WebRTC and SIP not just audio and video @ OpenSIPS 2024
WebRTC and SIP not just audio and video @ OpenSIPS 2024Lorenzo Miniero
 
Intro to Passkeys and the State of Passwordless.pptx
Intro to Passkeys and the State of Passwordless.pptxIntro to Passkeys and the State of Passwordless.pptx
Intro to Passkeys and the State of Passwordless.pptxFIDO Alliance
 
Introduction to use of FHIR Documents in ABDM
Introduction to use of FHIR Documents in ABDMIntroduction to use of FHIR Documents in ABDM
Introduction to use of FHIR Documents in ABDMKumar Satyam
 
Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...
Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...
Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...ScyllaDB
 
ADP Passwordless Journey Case Study.pptx
ADP Passwordless Journey Case Study.pptxADP Passwordless Journey Case Study.pptx
ADP Passwordless Journey Case Study.pptxFIDO Alliance
 
Generative AI Use Cases and Applications.pdf
Generative AI Use Cases and Applications.pdfGenerative AI Use Cases and Applications.pdf
Generative AI Use Cases and Applications.pdfalexjohnson7307
 

Recently uploaded (20)

Introduction to FIDO Authentication and Passkeys.pptx
Introduction to FIDO Authentication and Passkeys.pptxIntroduction to FIDO Authentication and Passkeys.pptx
Introduction to FIDO Authentication and Passkeys.pptx
 
The Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightThe Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and Insight
 
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
 
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
 
Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)
Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)
Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)
 
Six Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal OntologySix Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal Ontology
 
How we scaled to 80K users by doing nothing!.pdf
How we scaled to 80K users by doing nothing!.pdfHow we scaled to 80K users by doing nothing!.pdf
How we scaled to 80K users by doing nothing!.pdf
 
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
 
Event-Driven Architecture Masterclass: Challenges in Stream Processing
Event-Driven Architecture Masterclass: Challenges in Stream ProcessingEvent-Driven Architecture Masterclass: Challenges in Stream Processing
Event-Driven Architecture Masterclass: Challenges in Stream Processing
 
State of the Smart Building Startup Landscape 2024!
State of the Smart Building Startup Landscape 2024!State of the Smart Building Startup Landscape 2024!
State of the Smart Building Startup Landscape 2024!
 
Top 10 CodeIgniter Development Companies
Top 10 CodeIgniter Development CompaniesTop 10 CodeIgniter Development Companies
Top 10 CodeIgniter Development Companies
 
Continuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
Continuing Bonds Through AI: A Hermeneutic Reflection on ThanabotsContinuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
Continuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
 
CORS (Kitworks Team Study 양다윗 발표자료 240510)
CORS (Kitworks Team Study 양다윗 발표자료 240510)CORS (Kitworks Team Study 양다윗 발표자료 240510)
CORS (Kitworks Team Study 양다윗 발표자료 240510)
 
TEST BANK For, Information Technology Project Management 9th Edition Kathy Sc...
TEST BANK For, Information Technology Project Management 9th Edition Kathy Sc...TEST BANK For, Information Technology Project Management 9th Edition Kathy Sc...
TEST BANK For, Information Technology Project Management 9th Edition Kathy Sc...
 
WebRTC and SIP not just audio and video @ OpenSIPS 2024
WebRTC and SIP not just audio and video @ OpenSIPS 2024WebRTC and SIP not just audio and video @ OpenSIPS 2024
WebRTC and SIP not just audio and video @ OpenSIPS 2024
 
Intro to Passkeys and the State of Passwordless.pptx
Intro to Passkeys and the State of Passwordless.pptxIntro to Passkeys and the State of Passwordless.pptx
Intro to Passkeys and the State of Passwordless.pptx
 
Introduction to use of FHIR Documents in ABDM
Introduction to use of FHIR Documents in ABDMIntroduction to use of FHIR Documents in ABDM
Introduction to use of FHIR Documents in ABDM
 
Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...
Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...
Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...
 
ADP Passwordless Journey Case Study.pptx
ADP Passwordless Journey Case Study.pptxADP Passwordless Journey Case Study.pptx
ADP Passwordless Journey Case Study.pptx
 
Generative AI Use Cases and Applications.pdf
Generative AI Use Cases and Applications.pdfGenerative AI Use Cases and Applications.pdf
Generative AI Use Cases and Applications.pdf
 

eSPACE - Conceptual Foundations for End-User Authoring of Cross-Device and Internet of Things Applications

  • 1. 2 December 2005 eSPACE Conceptual Foundations for End-User Authoring of Cross-Device and Internet of Things Applications Audrey Sanctorum
  • 2. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 2June 11, 2020
  • 3. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 3June 11, 2020 Multi-Device World Sequential interaction Simultaneous interaction Smart Devices Things
  • 4. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 4June 11, 2020 Research Fields Cross-Device Interaction (XDI) Distributed User Interfaces (DUI) Internet of Things (IoT) Improves interaction across smart devices Improves interaction across things
  • 5. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 5June 11, 2020 Problems Fragmented Control – Lack of Uniformity – Limited Functionality & Customisation
  • 6. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 6June 11, 2020 Problems Fragmented Control – Lack of Uniformity – Limited Functionality & Customisation
  • 7. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 7June 11, 2020 Problems Fragmented Control – Lack of Uniformity – Limited Functionality & Customisation
  • 8. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 8June 11, 2020 Problems Fragmented Control – Lack of Uniformity – Limited Functionality & Customisation End Users
  • 9. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 9June 11, 2020 Problem Statement XDI/DUI IoT EUD As new smart technologies emerge in large numbers, it is not only difficult for developers to keep up with these evolving technologies, but even more for end users. This is caused by the end user’s lack of a flexible, unified and extensible solution for controlling all smart technologies (in one place) that can cope with their individual and evolving needs.
  • 10. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 10June 11, 2020 Main Research Question How can we enable end users to have a better control over their smart technologies by using appropriate abstractions to hide the complex technical details when creating and modifying unified cross-device and IoT user interfaces specifically made to control these smart technologies? XDI/DUI IoT EUD X
  • 11. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 11June 11, 2020 Research Questions RQ1 What are the main requirements for the end-user authoring of unified cross-device and IoT user interfaces? RQ2 What are the necessary concepts and methods to address the requirements resulting from answering RQ1? RQ3 Which metaphors or abstractions should be used on top of our conceptual foundation to allow end users to visualise and create their unified cross-device and IoT interactions? RQ4 How can we design a unified cross-device and IoT EUD authoring tool given the requirements from RQ1, the conceptual foundations from RQ2 and the guidelines including the appropriate metaphors found in RQ3?
  • 12. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 12June 11, 2020 Research Question 1 What are the main requirements for the end-user authoring of unified cross-device and IoT user interfaces?
  • 13. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 13June 11, 2020 Metaphor Classification Metaphor Systems Timeline A CAPpella, AppsGate Rules AppsGate, Atooma, CMT, E-Free, E-Wired, E-Wizard, Ghiani et al.(2015), HomeRules, iCAP, IFTTT, ImAtHome, Keep Doing It, SmartFit, T4Tags 2.0, TARE, Tasker, TouchCompozr Pipeline AppsGate, E-Wired, Versatile Jigsaw Puzzle ACCORD, Puzzle, Zipato Join-the-dots Platform Composition Drag-and-drop DashMash, DireWolf, DireWolf 3.0.0, SmartComposition Copy/paste Jelly, MashupEditor, XDBrowser 2.0 None EPIDOSITE, Ghiani et al.(2012), Improv, InterPlay, Paterno and Zichitella, WebSplitter Pering et al. (2009-2010) Humble et al. (2003) Danado and Paternò (2014/2017) Desolda et al. (2017) Maués (2013) https://ifttt.com
  • 14. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 14June 11, 2020 R1 Provide an overview of the smart technologies, environments and applications R2 Interaction support R2.1 Support for interaction across multiple smart technologies R2.2 Support for creation, customisation and distribution of cross-device and IoT UIs R3 Support for sharing and integration of apps in a central smart apps repository R4 Extensibility R4.1 Offer extensibility at the level of communication protocols, devices and user interfaces R4.2 Enable the integration of third-party applications R5 Support for end-user development Requirements
  • 15. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 15June 11, 2020 R1 Provide an overview of the smart technologies, environments and applications R2 Interaction support R2.1 Support for interaction across multiple smart technologies R2.2 Support for creation, customisation and distribution of cross-device and IoT UIs R3 Support for sharing and integration of apps in a central smart apps repository R4 Extensibility R4.1 Offer extensibility at the level of communication protocols, devices and user interfaces R4.2 Enable the integration of third-party applications R5 Support for end-user development Requirements
  • 16. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 16June 11, 2020 Use Case Scenario Lucas Leaving home application
  • 17. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 17June 11, 2020 Lucas
  • 18. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 18June 11, 2020 Lucas
  • 19. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 19June 11, 2020 Lucas Lucy
  • 20. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 20June 11, 2020
  • 21. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 21June 11, 2020 R3 Shareability R3.1 Support for sharing and integration of apps in a central smart apps repository R3.2 Enable sharing of applications, user interfaces or parts of a UI with specific users R5 Reusability R5.1 Support for reuse and combination of different user interfaces R5.2 Support for reuse and combination of different functionality R6 Portability R6.1 Offer platform independence R6.2 Support for adaptation of applications and user interfaces to users and devices R7 Support for end-user development Updated Requirements
  • 22. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 22June 11, 2020 R3 Shareability R3.1 Support for sharing and integration of apps in a central smart apps repository R3.2 Enable sharing of applications, user interfaces or parts of a UI with specific users R5 Reusability R5.1 Support for reuse and combination of different user interfaces R5.2 Support for reuse and combination of different functionality R6 Portability R6.1 Offer platform independence R6.2 Support for adaptation of applications and user interfaces to users and devices R7 Support for end-user development Updated Requirements
  • 23. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 23June 11, 2020 R3 Shareability R3.1 Support for sharing and integration of apps in a central smart apps repository R3.2 Enable sharing of applications, user interfaces or parts of a UI with specific users R5 Reusability R5.1 Support for reuse and combination of different user interfaces R5.2 Support for reuse and combination of different functionality R6 Portability R6.1 Offer platform independence R6.2 Support for adaptation of applications and user interfaces to users and devices R7 Support for end-user development Updated Requirements
  • 24. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 24June 11, 2020 Research Question 2 What are the necessary concepts and methods to address the requirements resulting from answering RQ1?
  • 25. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 25June 11, 2020 Model-based Approach Define important concepts of XD & IoT applications Can be reused by other developers Allow flexibility and extensibility Increase communication and controlBenefits
  • 26. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 26June 11, 2020 Updated Requirements R2 Interaction support R2.3 Offer fine granularity UI distribution R4 Extensibility R4.3 Offer extensibility of adaptive behaviour and distribution configurations R6 Portability R6.2 Support for context awareness
  • 27. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 27June 11, 2020 Final Requirements R1 Provide an overview of the smart technologies, environments and applications R2 Interaction support R2.1 Support for interaction across multiple smart technologies R2.2 Support for creation, customisation and distribution of cross-device and IoT UIs R2.3 Offer fine granularity UI distribution R3 Shareability R3.1 Support for sharing and integration of apps in a central smart apps repository R3.2 Enable sharing of applications, user interfaces or parts of a UI with specific users R4 Extensibility R4.1 Offer extensibility at the level of communication protocols, devices and UIs R4.2 Enable the integration of third-party applications R4.3 Offer extensibility of adaptive behaviour and distribution configurations R5 Reusability R5.1 Support for reuse and combination of different user interfaces R5.2 Support for reuse and combination of different functionality R6 Portability R6.1 Offer platform independence R6.2 Support for context awareness R7 Support for end-user development
  • 28. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 28June 11, 2020 eSPACE Reference Framework Motion detector AC Notifier AC Scratching notifier AC
  • 29. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 29June 11, 2020 eSPACE Reference Framework Video Frame UIe Record Button UIe Video UIe
  • 30. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 30June 11, 2020 eSPACE Reference Framework Toggle AC
  • 31. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 31June 11, 2020 eSPACE Reference Framework Toggle AC
  • 32. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 32June 11, 2020
  • 33. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 33June 11, 2020
  • 34. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 34June 11, 2020
  • 35. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 35June 11, 2020
  • 36. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 36June 11, 2020
  • 37. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 37June 11, 2020 Compliance of eSPACE Model with Requirements R1 Provide an overview of the smart technologies, environments and applications R2 Interaction support R2.1 Support for interaction across multiple smart technologies R2.2 Support for creation, customisation and distribution of cross-device and IoT UIs R2.3 Offer fine granularity UI distribution R3 Shareability R3.1 Support for sharing and integration of apps in a central smart apps repository R3.2 Enable sharing of applications, user interfaces or parts of a UI with specific users R4 Extensibility R4.1 Offer extensibility at the level of communication protocols, devices and UIs R4.2 Enable the integration of third-party applications R4.3 Offer extensibility of adaptive behaviour and distribution configurations R5 Reusability R5.1 Support for reuse and combination of different user interfaces R5.2 Support for reuse and combination of different functionality R6 Portability R6.1 Offer platform independence R6.2 Support for context awareness R7 Support for end-user development Legend Not fulfilling requirement Partially fulfilling requirement Completely fulfilling requirement
  • 38. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 38June 11, 2020 Implementation Roels (2019)
  • 39. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 39June 11, 2020 Implementation Roels (2019)
  • 40. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 40June 11, 2020 Research Question 3 Which metaphors or abstractions should be used on top of our conceptual foundation to allow end users to visualise and create their unified cross-device and IoT interactions? A-FrameOrganicMaterial-Based Victorian Mediterranean
  • 41. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 41June 11, 2020 Elicitation Study Why? Get mental models of people when dealing with XDI and IoT interactions Derive design guidelinesFind right abstractions/metaphors
  • 42. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 42June 11, 2020 Elicitation Study: Methology 30 Participants (12 females) 15 technical 15 non-technical 15 sessions with 2 participants XDI and IoT presentation Scenario drawing Interview and questionnaire Comparison of drawing
  • 43. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 43June 11, 2020 Drawings
  • 44. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 44June 11, 2020
  • 45. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 45June 11, 2020 Design Guidelines G1 Use Pipeline Metaphor to Represent Interactions G2 Use Different Arrow Types for Different Interaction Types G3 Provide a Realistic Graphical Device Representation G4 Provide a Graphical Representation of Users G5 Represent Sequential Interactions from Left to Right and Group Concurrent Interactions G6 Provide Textual as well as Graphical Representations for Conditional Statements G7 Support UI Design G8 Use of Symbols and Annotations => A-FrameOrganicMaterial-Based Victorian Mediterranean Mediterranean
  • 46. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 46June 11, 2020 Guideline 1: Use Pipeline Metaphor to Represent Interactions
  • 47. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 47June 11, 2020 Guideline 3: Provide a Realistic Graphical Device Representation
  • 48. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 48June 11, 2020 Guideline 5: Represent Sequential Interactions from Left to Right and Group Concurrent Interactions
  • 49. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 49June 11, 2020 Guideline 7: Support UI Design
  • 50. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 50June 11, 2020 Design Guidelines G1 Use Pipeline Metaphor to Represent Interactions G2 Use Different Arrow Types for Different Interaction Types G3 Provide a Realistic Graphical Device Representation G4 Provide a Graphical Representation of Users G5 Represent Sequential Interactions from Left to Right and Group Concurrent Interactions G6 Provide Textual as well as Graphical Representations for Conditional Statements G7 Support UI Design G8 Use of Symbols and Annotations => A-FrameOrganicMaterial-Based Victorian Mediterranean Mediterranean
  • 51. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 51June 11, 2020 Research Question 4 How can we design a unified cross-device and IoT EUD authoring tool given the requirements from RQ1, the conceptual foundations from RQ2 and the guidelines including the appropriate metaphors found in RQ3? + + =>
  • 52. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 52June 11, 2020 eSPACE Authoring Tool Architecture RSL Link Server =>
  • 53. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 53June 11, 2020 Home View
  • 54. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 54June 11, 2020
  • 55. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 55June 11, 2020
  • 56. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 56June 11, 2020
  • 57. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 57June 11, 2020 UI Design View
  • 58. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 58June 11, 2020 Interaction View
  • 59. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 59June 11, 2020 Interaction View
  • 60. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 60June 11, 2020 Interaction View
  • 61. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 61June 11, 2020 Interaction View
  • 62. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 62June 11, 2020
  • 63. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 63June 11, 2020
  • 64. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 64June 11, 2020 Rules View
  • 65. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 65June 11, 2020 Home View
  • 66. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 66June 11, 2020 eSPACE Authoring Tool Architecture RSL Link Server =>
  • 67. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 67June 11, 2020 Example Application
  • 68. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 68June 11, 2020 UI Distribution
  • 69. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 69June 11, 2020 Compliance to Guidelines G1 Use Pipeline Metaphor to Represent Interactions G2 Use Different Arrow Types for Different Interaction Types G3 Provide a Realistic Graphical Device Representation G4 Provide a Graphical Representation of Users G5 Represent Sequential Interactions from Left to Right and Group Concurrent Interactions G6 Provide Textual as well as Graphical Representations for Conditional Statements G7 Support UI Design G8 Use of Symbols and Annotations
  • 70. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 70June 11, 2020 Compliance of Related Work with Guidelines
  • 71. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 71June 11, 2020 Compliance of eSPACE Tool with Requirements R1 Provide an overview of the smart technologies, environments and applications R2 Interaction support R2.1 Support for interaction across multiple smart technologies R2.2 Support for creation, customisation and distribution of cross-device and IoT UIs R2.3 Offer fine granularity UI distribution R3 Shareability R3.1 Support for sharing and integration of apps in a central smart apps repository R3.2 Enable sharing of applications, user interfaces or parts of a UI with specific users R4 Extensibility R4.1 Offer extensibility at the level of communication protocols, devices and UIs R4.2 Enable the integration of third-party applications R4.3 Offer extensibility of adaptive behaviour and distribution configurations R5 Reusability R5.1 Support for reuse and combination of different user interfaces R5.2 Support for reuse and combination of different functionality R6 Portability R6.1 Offer platform independence R6.2 Support for context awareness R7 Support for end-user development Legend Not fulfilling requirement Partially fulfilling requirement Completely fulfilling requirement
  • 72. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 72June 11, 2020 Initial Evaluation 8 Participants (5 females) Scenario App Creation Reading Tutorial Simple Controller App Grocery List App Morning Routine
  • 73. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 73June 11, 2020 Use Cases Simple Controller App Grocery List App Morning Routine
  • 74. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 74June 11, 2020 Initial Evaluation 8 Participants (5 females) Scenario App Creation Questionnaire and Interview Reading Tutorial Simple Controller App Grocery List App Morning Routine
  • 75. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 75June 11, 2020 Microsoft Reaction Cards 40 Words
  • 76. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 76June 11, 2020 Summary Evaluation Results Organised Useful Easy to Use Interaction view preferred by 4 Future work Add in-tool follow along tutorial Improve terminology in dropdowns Add help buttons
  • 77. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 77June 11, 2020 Simple Controller App P1 P4 P3 P7
  • 78. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 78June 11, 2020 Morning Routine App P8 P7 P4P6
  • 79. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 79June 11, 2020 Conclusions RQ1 What are the main requirements for the end-user authoring of unified cross-device and IoT user interfaces? RQ2 What are the necessary concepts and methods to address the requirements resulting from answering RQ1? RQ3 Which metaphors or abstractions should be used on top of our conceptual foundation to allow end users to visualise and create their unified cross-device and IoT interactions? RQ4 How can we design a unified cross-device and IoT EUD authoring tool given the requirements from RQ1, the conceptual foundations from RQ2 and the guidelines including the appropriate metaphors found in RQ3?
  • 80. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 80June 11, 2020 Contributions
  • 81. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 81June 11, 2020
  • 82. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 82June 11, 2020 Conclusions RQ1 What are the main requirements for the end-user authoring of unified cross-device and IoT user interfaces? RQ2 What are the necessary concepts and methods to address the requirements resulting from answering RQ1? RQ3 Which metaphors or abstractions should be used on top of our conceptual foundation to allow end users to visualise and create their unified cross-device and IoT interactions? RQ4 How can we design a unified cross-device and IoT EUD authoring tool given the requirements from RQ1, the conceptual foundations from RQ2 and the guidelines including the appropriate metaphors found in RQ3?
  • 83. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 83June 11, 2020 Contributions
  • 84. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 84June 11, 2020 eSPACE Reference Framework eSPACE Conceptual Model
  • 85. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 85June 11, 2020 Conclusions RQ1 What are the main requirements for the end-user authoring of unified cross-device and IoT user interfaces? RQ2 What are the necessary concepts and methods to address the requirements resulting from answering RQ1? RQ3 Which metaphors or abstractions should be used on top of our conceptual foundation to allow end users to visualise and create their unified cross-device and IoT interactions? RQ4 How can we design a unified cross-device and IoT EUD authoring tool given the requirements from RQ1, the conceptual foundations from RQ2 and the guidelines including the appropriate metaphors found in RQ3?
  • 86. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 86June 11, 2020 Contributions
  • 87. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 87June 11, 2020 Design Guidelines Guideline 1 (G1) Use Pipeline Metaphor to Represent Interactions Guideline 2 (G2) Use Different Arrow Types for Different Interaction Types Guideline 3 (G3) Provide a Realistic Graphical Device Representation Guideline 4 (G4) Provide a Graphical Representation of Users Guideline 5 (G5) Represent Sequential Interactions from Left to Right and Group Concurrent Interactions Guideline 6 (G6) Provide Textual as well as Graphical Representations for Conditional Statements Guideline 7 (G7) Support UI Design Guideline 8 (G8) Use of Symbols and Annotations
  • 88. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 88June 11, 2020 Conclusions RQ1 What are the main requirements for the end-user authoring of unified cross-device and IoT user interfaces? RQ2 What are the necessary concepts and methods to address the requirements resulting from answering RQ1? RQ3 Which metaphors or abstractions should be used on top of our conceptual foundation to allow end users to visualise and create their unified cross-device and IoT interactions? RQ4 How can we design a unified cross-device and IoT EUD authoring tool given the requirements from RQ1, the conceptual foundations from RQ2 and the guidelines including the appropriate metaphors found in RQ3?
  • 89. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 89June 11, 2020 Contributions
  • 90. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 90June 11, 2020 Conclusions RQ1 What are the main requirements for the end-user authoring of unified cross-device and IoT user interfaces? RQ2 What are the necessary concepts and methods to address the requirements resulting from answering RQ1? RQ3 Which metaphors or abstractions should be used on top of our conceptual foundation to allow end users to visualise and create their unified cross-device and IoT interactions? RQ4 How can we design a unified cross-device and IoT EUD authoring tool given the requirements from RQ1, the conceptual foundations from RQ2 and the guidelines including the appropriate metaphors found in RQ3?
  • 91. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 91June 11, 2020 eSPACE Authoring Tool Rules View Interaction View App View Home View UI Design View
  • 92. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 92June 11, 2020 Future Work Improve usability of eSPACE User studies Integrate remaining requirements Integrate different modalities Explore human-AI interaction Improve user-defined apps Improve sharing, extensibility & portability Support for voice and gesture interaction +
  • 93. Audrey Sanctorum - Department of Computer Science - asanctor@vub.be 93June 11, 2020 Contributions