AI-week1-Introduction lecture notes .ppt

1. MAS 963 - Ambient Intelligence
Pattie Maes
Pattie@media.mit.edu
TA: David Bouchard
Davidb@media.mit.edu

2. Ambient Intelligence: Vision
 Ambient Intelligence envisions a world where people
are surrounded by intelligent and intuitive interfaces
embedded in the everyday objects & physical
environments around them. These interfaces
recognize and respond to the presence and
behaviors of an individual in a personalized and
relevant way.

3.  Ubiquitous Computing
 Intelligent Interfaces
 Context-aware Computing
Merging of different bodies of work

4. Example Scenarios (1)
 Ambient semantics (H. Liu)
“enriching your every day experience”
 Book tells you about friends/famous people that read/loved
it
 Book tells you about particularly interesting passages
 Touching 2 books makes their connections appear

5. Example Scenarios (2)
 Objects with memory
 Objects that act as medium for messaging
 Objects that can tell you their relevant stories/history
 Eg. Readwear/writewear

6. Example Scenarios (3)
 Augmented physical environments
 Walking around town, system points out buildings/places of
particular interest to a user (based on user’s interests)
 Books on a bookshelf can “speak out” to you (or posters in
infinite corridor)

7. Vision (continued)
 Ambient Intelligence Technology is:
 “Invisible” (Weiser):
 Use/functions are immediately apparent
 Ubiquitous:
 Available anywhere, integrated in physical environment
& objects around us
 Intelligent:
 Relevant to user & context-aware
 Unobtrusive
 Providing meaning (vs. knowledge vs. information)

8. Vision (continued)
 Radically rethink the human-computer interactive
experience:
 Integrate digital world (information & services) and physical
world (physical objects/environment)
 Make interfaces more responsive and proactive (objects &
environment monitor user and (proactively) present
information & services relevant to user’s current
needs/interests)

9. Challenges
 Augment objects/environments with sensing,
computing & networking capability
 Sense & model the user’s behavior (offline/online)
 Infer the user’s current interests/intentions
 Design (proactive) interfaces that offer value without
being obnoxious, while being highly relevant
 Integrate these interfaces in user’s physical
environment in seamless, natural way:
 On the body: cell phones, wearables
 In the environment: architecture, ether, objects

10. Goals for this Course
 Provide an overview of this new vision for HCI
 Read and discuss the most relevant articles in related areas:
Smart Environments, Smart Networked Objects, Augmented
Reality, Mixed Reality, Ubiquitous Computing, Pervasive
Computing, Tangible Computing, Ambient Interfaces, Intelligent
Interfaces, Context-based Systems, Personalization,
Awareness systems, Wearable Computing, Smart materials.
 Focus on understanding enabling technologies and studying
applications and experiments. To a lesser extend address the
social-cultural impact.
 Come up with new ideas, start innovative projects in this area

11. How does this class differ from related
Media Lab classes?
 Hiroshi Ishii’s “Tangible Interfaces”
 Giving physical form to digital information so that it
becomes more easily manipulable and perceivable
 Joe Paradiso’s “Sensor Technologies for Interactive
Environments”
 Focus on sensor technologies (& performance/events)
 Ted Selker’s “, Context-Aware Computing”
 Focus on context-aware systems in general (desktop as
well as ubiquitous systems)

12. Requirements for the students
 Students are required to participate extensively in
literature research and class discussions
 Read required readings ahead of class & prepare ½ page of
questions & interesting points for discussion
 Review & present at least one topic in class
 Write 2 short “scenarios” papers (by 2/15 & 2/22)
 Suggest additional papers to read
 Suggest experiments & technologies to look at
 Students are required to design and implement an
original project in this area and describe their
project in a 3-page paper as well as make 2
presentation to the class
 4/19 update & class discussion
 5/17 final presentation & report

13. Schedule
 Feb 8 Class #1 Introduction to Ambient Intelligence
(focus on Media Lab work)
- Pattie Maes
FORMS DUE
 Feb 15 Class #2 Future visions of HCI
- Pattie Maes
APPLICATION SCENARIOS PAPER DUE
 Feb 22 Class #3 Common Sense & Intelligent Interfaces
- Henry Lieberman, Hugo Liu & Push Singh
VISION SCENARIOS PAPER DUE
 Mar 1 Class #4 Location Based & Context-Aware Systems
- Pattie Maes & students

14. Schedule (continued)
 Mar 8 Class #5 Ubiquitous Computing
- Pattie Maes & students
PROJECT PROPOSAL DUE
 Mar 15 Class #6 User Modeling, Personalization &
Recommender Systems
Discussion of project proposals
- Pattie Maes & students
 Mar 22 Class #7 Tangible & Ambient Interfaces
- Pattie Maes & students
 Mar 29 No Class (Spring Vacation)
Yellow means requirements for students

15. Schedule (continued)
 Apr 5 Class #8 Augmented Reality/Mixed Realities
- Pattie Maes & students
 Apr 12 Class #9 The meaning of Things
- Invited Speaker Judith Donath
Urban perspective
- Invited speaker Federico
 Apr 19 Class #10 Intelligent Environments
- Pattie Maes & students
Project update discussion
PROJECT UPDATE DUE (1 page)
 Apr 26 Class #11 Embedded Intelligence/Smart Objects
- Pattie Maes & students

16. Schedule (continued)
 May 3 Class #12 Pervasive Computing & Wearables
- Pattie Maes & students
 May 10 Class #13 Awareness systems
- Pattie Maes & students
 May 17 Class #14 PROJECT PRESENTATION &
FINAL PROJECT REPORT DUE
Yellow means requirements for students

17. Reading List
 Intro to Ambient Intelligence:
 Ambient Intelligence, Fraunhofer Institute
http://www.iuk.fhg.de/embedded_systems_eng.html
 Ambient Intelligence in Home Lab, Philips Research
http://www.research.philips.com/Assets/Downloadablefile/ambientintelligence-2456.pdf
 Scenarios for Ambient Intelligence in 2010
 Ambient Intelligence, Weber et al editors
 (Concept videos)

18. Reading List (continued)
 Location-based & Context-aware systems:
 Special issue on Context-Aware Computing, IEEE Pervasive
Computing, 2002 ***
 Context-based city & museum tour guides (Abowd,
Cheverst, Reinhard, Petrelli) ***
 “Ubiquitous Systems in Interactive Museums” , Fleck et. Al.
IEEE Pervasive Computing ***
 Reminder systems (Rhodes, Pentland & Devaul,
Lamming...) ***
 “Virtual Graffiti" systems (Geonotes, HangingMessages,
Ether Threads) ***

19. Reading List (continued)
 Interfaces with Common Sense, Intelligent
Interfaces:
 Beating some Common Sense into Interactive Applications,
Lieberman et. Al. http://web.media.mit.edu/~lieber/Lieberary/Common-
Sense/Common-Sense-Intro.html
 Selected readings on Interfaces with Common Sense
(Lieberman)
 Selected readings from IUI Proceedings

20. Reading List (continued)
 Ubiquitous Computing:
 papers by M. Weiser
http://www.ubiq.com/hypertext/weiser/UIST94_4up.ps.
http://www.ubiq.com/hypertext/weiser/ACMInteractions2.html
http://www.ubiq.com/hypertext/weiser/UbiCompHotTopics.html
 "Open House", Weiser M., 1996 ***
 "Designing Calm Technology", M. Weiser and J. Seely
Brown http://www.ubiq.com/hypertext/weiser/acmfuture2endnote.htm ***
 “The Human Experience”, Abowd, IEEE Pervasive
Computing ***
 “Slow Technology”, Hallnas & Redstrom,
http://civ.idc.cs.chalmers.se/projects/slowtech/papers/slowtech.pdf ***
 "Ambient Agoras" project, www.AmbientAgoras.org,
Fraunhofer Institute ***
 Selected papers from proceedings of Ubicomp 2001, 2002,
2003 ***

21. Reading List (continued)
 User Modeling, Personalization & Recommender
Systems:
 Recommender Systems by Ungar
http://www.cis.upenn.edu/~ungar/CF/
 Empirical Analysis of Predictive Algorithms for
Collaborative Filtering
http://www.research.microsoft.com/users/breese/cfalgs.html
 Recommender Systems by Resnick & Varian
http://www.acm.org/pubs/cacm/MAR97/resnick.html
 (work by Intille et al)

22. Reading List
 Tangible Interfaces:
 "Tangible Bits", Ishii H., CHI97
http://tangible.media.mit.edu/papers/Tangible_Bits_CHI97/Tangible_Bits_CHI97.pdf
 other papers by Ishii et. al.
 Ambient Interfaces:
 “Ambient Interfaces: Design Challenges and
Recommendations”, Fraunhofer Institute http://www.uni-
weimar.de/~gross/publ/hcii03_gross_amb_int.pdf
 papers by H. Ishii

23. Reading List (continued)
 The Meaning of Things:
 "The meaning of Things", Csikszentmihalyi
 "The Cultural Biography of Things", I. Kopytov
 "Culture and Consumption", "Mc Gracken, G
 "The Social Life of Things" Apadurai, A.
 e-lens and the digital city
 TBD

24. Reading List (continued)
 Augmented Reality/Mixed Realities :
 Augmented Reality: A New Way of Seeing, Steven
K. Feiner, 2002
 Introduction to Augmented Reality by J. Vallino
http://www.cs.rochester.edu:80/u/vallino/research/AR/introduction.html
 Presence Journal special issue on AR, 1997
 CACM Special issue on AR, 1993, Vol 36, #7
 Animated & Electronic Paper Experiments (e.g.
Wellner)

25. Reading List (continued)
 Intelligent Environments :
 Concept Homes
http://www.research.philips.com/Assets/Downloadablefile/ambientintelligence-2456.pdf
 Selected papers from “Intelligent Environments”, P. Froege
 Papers on Georgia Tech “Aware Home”
http://www.cc.gatech.edu/fce/ahri/projects/index.html
 Papers on MIT Media Lab Smart Room experiments
http://vismod.www.media.mit.edu/vismod/demos/smartroom/
 Papers of MIT AI-lab Smart Room experiments
http://oxygen.lcs.mit.edu/ and http://www.ai.mit.edu/projects/aire/
 Papers on Stanford iRoom http://iwork.stanford.edu
 Papers on MIT’s House-N

26. Reading List (continued)
 Embedded Intelligence/Smart Objects :
 Tutorial on RFID technology
 Objects with embedded sensors, computation, &
networking
 Sensor & Actuator Networks, Special Issue of IEEE
Pervasive Computing, Oct 2003
 Mobility, Service Discovery, Auto Configuration and Ad-Hoc
Networking
 Disappearing Hardware, R. Want et. Al. IEEE Pervasive
Computing

27. Reading List (continued)
 Pervasive Computing and Wearables :
 Pervasive Computing Handbook, U. Hansmann
 Me++, W. Mitchell
 Papers from IEEE pervasive computing journal
 Wearable Computing Papers, MIT, CMU, UNC, Sony CSL
 Proceedings of the wearables conferences

28. To Do’s
 By tomorrow: return class form
 By next week (2/15):
 Check out class website
 Read required 2 readings and prepare ½
page questions & comments, email to
pattie@ by 10am on Wed and put on wiki
 Write application scenarios paper (1 or 2
pages)

29. Required Readings
 That’s what friends are for: Ambient Intelligence and the Information
Society of 2010 by Ducatel et.al.
http://www.itas.fzk.de/e-
society/preprints/esociety/Ducatel%20et%20al.pdf
 Social, Economic and ethical Implications of Ambient Intelligence and
Ubiquitous Computing by Bohn et.al.
http://www.vs.inf.ethz.ch/publ/papers/socialambient.pdf
 Optional: Philips Password magazine, special issue on Ambient
Intelligence
http://www.research.philips.com/password/archive/23/downloads/pass
word23.pdf

30. Application Scenarios Paper
Envision novel applications of some of the
following platforms:
- Invisible Media gaze direction platform
- Reachmedia RFID wristband
- Augmented Mirror
- Moving Portraits
- I/O textiles
- Ambient glasses & EMG
- Dtouch printable visual markers

31. Practical Information
 Contact pattie@media.mit.edu, x3-7442,
room E15-315 or davidb@media.mit.edu with
any questions
 Website:
http://courses.media.mit.edu/2006spring/mas
963/
 Mailing list ambient-class@media.mit.edu
will be set up in next 2 days