Multimodal Man-Machine Interaction By: Rajesh P. Barnwal School of Information Technology Indian Institute of Technology, Kharagpur Sociology Language Design Engineering Ethnography Psychology Human Factors Computer Science
Text based module for the user unable to use English
Multimodal Framework of Bharati Text Analyzer Speech Recognizer Visual Language Manager Speech to text converter Hindi/ Bengali to English Language Translator Keywords Extractor Information Visualization Text to Speech Converter English to Hindi/ Bengali Language Translator Content Receiver Search Engine Internet Strings of text Strings of text Query Strings HTML page Query Strings Text Speech WIMP WIMP : Window, Icon, Menu, Pointing Device (Picture adapted from NID (IITKgp) Website) Next
As per prediction in Microsoft’s HCI Vision 2020 report, in future,
Physical objects like wall, floor, furniture will be able to interact in distributed manner with the human beings in very natural way
As per an article appeared on 3 rd September 2010 in an online magazine “Network World”
Future computer can be interacted using brainwaves in combination of other modality like gesture and can be accessible at anywhere even by just using movements of human body parts in air – Pranav Mistry , MIT Media Lab.
ACM SIGCHI Curricula for Human-Computer Interaction . http://old.sigchi.org/cdg/cdg2.html#2_1 [Online accessed on 28 th September 2010].
Alan Dix, Janet Finlay, Gregory D. Abowd, Russel Beale (2004). Human Computer Interaction . Pearson Education (Singapore) Pte. Ltd., ISBN 81-297-0409-9.
Being Human: Human Computer Interaction in the Year 2020 . http://research.microsoft.com/ en-us/um/cambridge/projects/hci2020/downloads/Being Human_A3.pdf [Online accessed on 22 nd September 2010].
Bharati: Internet for all . http://www.nid.iitkgp.ernet.in/Bharati/ [Online accessed on 26 th September 2010].
Fakhreddine Karray, Milad Alemzadeh, Jamil Abou Saleh and Mo Nours Arab. Human-Computer Interaction: Overview on State of the Art , International Journal on Smart Sensing and Intelligent Systems, Vol. 1, No. 1, March 2008, pp 137-159.
Human–computer interaction - Wikipedia, the free encyclopedia . http://en.wikipedia.org/wiki/ Human–computer_interaction [Online accessed on 1st September 2010].
Jiagen Jin, Wenfeng Li. A Survey of The Information Fusion in MMHCI , 2010 International Conference on Machine Vision and Human-machine Interface, April 24-25, 2010, pp.509-513.
Jon Brodkin, The future of human-computer interaction. Article appeared in Network World Online Magazine on September 03, 2010, http://www.networkworld.com/news /2010/090210-human-computer-interaction.html [Online accessed on 29 th September 2010].
Mark T. Maybury and Wolfgang Wahlster (Eds.), Readings in Intelligent User Interfaces . Morgan Kaufmann Publishers, 1998 [ Ref. in Multimodal Human-Computer Interaction: a constructive and empirical study . Academic Dissertation by Roope Raisamo, University of Tampere, 1999].
Multimodal Human Computer Interaction: Toward a Proactive Computer . http://itr.beckman.uiuc.edu/index.html [Online accessed on 22 nd September 2010].
S.K. Card, T.P. Moran and A. Newell (1983). The Psychology of Human-Computer Interaction . Lawrence Erlbaum Associates, ISBN 0-89859-859-1.