Download as PDF, PPTX
More Related Content
Hicss17 asakawa
- 1. Cognitive Assistant for TheReal-world Accessibility Chieko Asakawa IBM Fellow, IBM Research IBM Distinguished Service Professor, Carnegie Mellon University
- 2. © 2011 IBMCorporation2 Cognitive Ability of Visually Impaired People 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% 0.8 1.0 1.2 1.4 1.6 1.8 2.0 2.2 2.4 2.6 2.8 3.0 3.2 3.4 3.6 音声速度(倍速) 再生率(%) A B C D E F G RecallRate(%) Speech speed X X X X X X X X X X X X X X X
- 3.
- 4.
- 5. Braille Digitalization Paper BrailleTypewriter Comparison: Braille and Printed Japanese Dictionary Digital Braille System
- 6. Home Page Reader 6© 2016 IBM Corporation nThe first practical voice browsers in the world nBecame a product in 1997 and translated into 11 languages IBM Home Page Reader (1999) Japanese, Italian, French, German, Spanish, English (U.S., U.K.) “Home Page Reader is my small window to the world. I can read, write, and access information. I can do everything to participate in society.” — comment from a user, 1997
- 7.
- 8.
- 9. Exponential Increase ofAccessible Information (Conceptual Chart) © 2016 IBM Corporation Paper Braille Digital Braille Voice Web access 1980 20001990 2010 Amountof accessibleinformation 9
- 10.
- 11. Uber Self-driving CarPilot 11 © 2016 IBM Corporation
- 12. Walk by myselfFinding discount signsFinding restaurantsShopping The Second Challenge: Real World Accessibility © 2016 IBM Corporation12
- 13. Cognitive Assistant 13 Augment missingor weakened abilities by the power of cognitive computing. © 2016 IBM Corporation
- 14. “甦るヒーローライブラリー第3集 光速エスパー”, TCエンタテインメントより Chika 14© 2016 IBM Corporation
- 15.
- 16. Foundation of CognitiveAssistant © 2016 IBM Corporation16 Localization Radio-wave Vision Dead reckoning Recognition Objects People Environment Knowledge Personal Social media Encyclopedic Interaction Speech Gesture Sonification
- 17. Localization Quasi-zenith satellites for Japan 2018 http://qzss.go.jp/technical/technology/tech01_orbit.html Accurateindoor localization BLE Beacons + Dead reckoning WIFI
- 18. Recognition of Environment Vision-basedEnvironment Recognition Infrared Depth Sensor on smartphones Google Tango https://youtu.be/Qe10ExwzCqk
- 19. Recognition of Things WatsonVision API coffee espresso wine glass glasses pottery dish
- 20. Oil filter Chicken soup Pensharpener Spice bottle Cristmas socks Cheetos Beer bottle Diet coke Photos for learning taken by blind subjects Incorrect results Before leaning Correct results After learning Personal Object Recognition Honorable mention at CHI2017
- 21. © 2016 IBM Corporation Knowledge – Importanceof Open data Detailed pedestrian maps Crowd prediction Restaurant Shops Items Temporal changes 21 Accessibility information
- 22. Interaction © 2016 IBM Corporation Approaching to humanaccuracy http://blogs.microsoft.com/next/2016/10/18/historic-achievement- microsoft-researchers-reach-human-parity-conversational-speech- recognition/#sm.0019gj85a12umd89ys32kew39p8d6 Autonomous Bus with Voice Dialog https://www-03.ibm.com/press/jp/ja/pressrelease/50250.wss
- 23.
- 24. Cognitive Assisting Robot ManuelaVeloso is leading the CoBot project. On November 18, 2014, the CoBot robots jointly reached 1,000km of autonomous localization and navigation.
- 25. © 2016 IBM Corporation Sep 2016 -August 2019 Awarded Amount: $1million Investigator: • Kris Kitani, Computer Vision, Robotics Institute, CMU • Manuela Veloso, Robotics, Robotics Institute, CMU Advisor: • Chieko Asakawa, IBM Fellow, Robotics Institute, CMU National Robotics Initiative A Cognitive Navigation Assistant for the Blind 25 Implementation of a navigation assistant that uses a collection of sensing modalities and algorithms to guide a blind person through the knowledge landscape of an unfamiliar environment.
- 26. World Robot Summit © 2016 IBM Corporation Industryrobots Services robots Disaster response robots 26 Japanese government is planning a robot competition event in 2020, the same year, Olympics and Paralympics will be held in Tokyo. http://www.nedo.go.jp/robot/about.html http://www.miraikan.jst.go.jp/exhibition/future/robot/robotworld.html#sl ide1 https://www- robotics.jpl.nasa.gov/tasks/taskImage.cfm?TaskID=236&t daID=700043&Image=501
- 27. 18th century, themathematician Euler authored a leading textbook on mathematics after he became blind. Captions for TV programs were invented for deaf people, but are now widely used in sports bars and to help immigrants, etc. Based on Self-standing wheelchair. 2011, voice dialog technologies for smartphones TelephoneKeyboard Voice recognition Voice dialog TV Captions Voice synthesis and OCR Modern Mathematics Autonomic vehicles Segway “Blind driving challenges” Early use of keyboards was a to help people with hand-and-motor disabilities in writing First consumer product was a reading assistant for the blind in the 1970s. 1876, Alexander Graham Bell invented the phone after teaching hearing impaired people. Innovations Flourish From Accessibility Needs Smart Machines 27 17th century, Dom Perignon. Champagne © 2016 IBM Corporation
- 28. 1960s Talking Typewriter 1960s TalkingTypewriter 1975 1403 Braille Printer 1984 Talking 3270 Terminal 1990 VoiceType™ 2008 Social Accessibility 1998 ViaVoice® 2000 Accessibility Center 1997 Home Page Reader 1988 ScreenReader/DOS 2004 aDesigner 2007 Eclipse Accessibility Tools Framework 2009 Rich Internet Accessibility Technologies 1914 First IBMer with disabilities IBM History of Accessibility 28 © 2016 IBM Corporation 2012 Brazil Accessible Vocational Training Project 2011 Senior Workforce Project 1984 Talking 3270 Terminal
- 29. © 2016 IBM Corporation 2010 20302020 Amountof Accessiblerealworldinformation (conceptualnumber) Future: Real-worldAccessibility – Exponential Growth Cognitive Assistant Lab @ CMU Smartphone accessibility Standardization?Core technology development Mobile Cognitive ? Apple Siri Microsoft Seeing AI project Google Tango Phone Tokyo Nihonbashi Demo Watson Vision API Adoption?Early days 2016 Dec. Tokyo Olympics Paralympics