Innovation and Inspiration through Cognitive Computing: IBM Watson

1. 1 Innovation and Inspiration through Cognitive Computing: IBM Watson Swami Chandrasekaran Executive Architect IBM Watson swamchan@us.ibm.com @swamichandra Applied Artificial Intelligence Conference,San Francisco - May’2016

2. ©IBM 2016 Applied Artificial Intelligence Conference 2 Please Note IBM’s statements regarding its plans, directions, and intent are subject to change or withdrawal without notice at IBM’s sole discretion. Information regarding potential future products is intended to outline our general product direction and it should not be relied on in making a purchasing decision. The information mentioned regarding potential future products is not a commitment, promise, or legal obligation to deliver any material, code or functionality. Information about potential future products may not be incorporated into any contract. The development, release, and timing of any future features or functionality described for our products remains at our sole discretion. Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput or performance that any user will experience will vary depending upon many factors, including considerations such as the amount of multiprogramming in the user’s job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve results similar to those stated here. 5/25/16

3. ©IBM 2016 Applied Artificial Intelligence Conference 3 Hi, I’m Swami Chandrasekaran @swamichandra Chief Technologist in IBM Watson – Cognitive Solutions

4. ©IBM 2016 Applied Artificial Intelligence Conference 4 Chapter 1 The Inquisitive Mind

5. ©IBM 2016 Applied Artificial Intelligence Conference 5 Expertise matters more today than ever before.

6. ©IBM 2016 Applied Artificial Intelligence Conference 6 What will an inquisitive mind want to know from text? 5/25/16 Frankly, sophisticated audiences are not a problem. Dumb audiences are a problem. But I think audiences are getting more sophisticated — that’s just a product of time. In the ’50s, audiences accepted a level of artifice that the audiences in 1966 would chuckle at. And the audiences of 1978 would chuckle at what the audience of 1966 said was okay, too. The trick is to try to be way ahead of that curve, so they’re not chuckling at your movies 20 years down the line. With Pulp Fiction, people were like, “Wow, I have never seen a movie like that before. A movie can do that?” I don’t think that’s the case anymore. I’m not talking ridiculously over anyone’s head anymore. I think people watched Django and Inglourious Basterds and thought they were really out there, but they got it …. Brian DePalma used to talk about that all the time, about all the s–t he had to deal with, at every single junket. And suddenly they’re all blaming each other for the apocalypse, but the apocalypse is the Civil War. But that wasn’t what I was necessarily thinking about on page 72 in my bedroom when I was writing it. Gracias !! Key Entities / Concepts & Relationships expressed Expand on the key Concepts & Concept Associations Explore information from an extracted Knowledge Graph Sentiment & Sentiment Targets Deeper understanding on author’s personality Language identification Ask questions & interact in natural language Resonance, Emotion and Tone of the text http://www.ew.com/article/2015/12/31/quentin-tarantino-hateful-eight-interview

7. ©IBM 2016 Applied Artificial Intelligence Conference 7 Entities Detected Concepts Detected

8. ©IBM 2016 Applied Artificial Intelligence Conference 8 Emotion & Tone Sentiment Taxonomy

9. ©IBM 2016 Applied Artificial Intelligence Conference 9 Knowledge Graph Important Keywords

10. ©IBM 2016 Applied Artificial Intelligence Conference 10 Tarantino & Federer – As seen by a human being

11. ©IBM 2016 Applied Artificial Intelligence Conference 11 Tarantino & Federer – As seen by Watson’s Visual Recognition 5/25/16 Multi class detection Facial Recognition Custom classes

12. ©IBM 2016 Applied Artificial Intelligence Conference 12 12© 2014 International BusinessMachines Corporation Cognitive is the new competitive advantage. © 2014 International Business Machines Corporation

13. ©IBM 2016 Applied Artificial Intelligence Conference 13 Chapter 2 Cognitive Computing

14. ©IBM 2016 Applied Artificial Intelligence Conference 14 Cognitive systems democratize innovation by scaling knowledge. S ensors Data Anal y ti cs Inform ati on Cogni ti ve Ingesti on, Integrati on, Governance

15. ©IBM 2016 Applied Artificial Intelligence Conference 15 Cognitive systems amplify human cognition.

16. ©IBM 2016 Applied Artificial Intelligence Conference 16 And the cognitive systems are not programmed. They learn their behavior through training.

17. ©IBM 2016 Applied Artificial Intelligence Conference 17 Examples include: Analyst reports tweets Wire tap transcripts Battlefield docs E-mails Texts Forensic reports Newspapers Blogs Wiki Court rulings International crime database Stolen vehicle data Missing persons data Data, information, and expertise create the foundation. Cognitive systems rely on collections of data and information

18. ©IBM 2016 Applied Artificial Intelligence Conference 18 Dissecting Cognitive Systems 5/25/16 Cognitive Systems Vision Language Speech Data & Insights Cognitive Systems Unstructured Data K n o w l e d g e Entity Extraction Sentiment Analysis Emotion Analysis Concept Tagging Author Extraction Entity Resolution Psychographic Analysis Dialog Text to Speech ML Annotations Relation Extraction Knowledge Graph Face Detection Image Classification Passage Ranking Feed Detection Tradeoff Analysis Pareto Analysis Information Theory Domain Lexicons Feature Weighting Machine Learning Neural Nets Entity Resolution Syllable Analysis Voice Synthesis Graph Computing Scale out Ingestion Machine Translation Image Tagging Language Identification Multi-class Detect Diarization Language Models NL Classification Analytics Descriptive Classification Clustering Reasoning Knowledge Graph

19. ©IBM 2016 Applied Artificial Intelligence Conference 19 Three capabilities differentiate cognitive systems from traditional programmed computing systems… Reasoning They reason. They understand underlying ideas and concepts. They form hypothesis. They infer and extract concepts. Learning They never stop learning getting more valuable with time. Advancing with each new piece of information, interaction, and outcome. They develop “expertise”. Understanding Cognitive systems understand like humans do. …. allowing them to interact with humans.

20. ©IBM 2016 Applied Artificial Intelligence Conference 20 Retrieve and Rank Entity Extraction Sentiment Analysis Emotion Analysis Keyword Extraction Concept Tagging Taxonomy Classification Author Extraction Language Detection Text Extraction Microformats Parsing Feed Detection Linked Data Support Concept Expansion Concept Insights Dialog Document Conversion Language Translation Natural Language Classifier Personality insights Relationship Extraction Retrieve and Rank Tone Analyzer Emotive Speech to Text Text to Speech Face Detection Image Link Extraction Image Tagging Text Detection Visual Insights Visual Recognition AlchemyData News Tradeoff Analytics 50 underlying technologies Natural Language Classifier Tone Analyzer …and then leverage Watson APIs to apply cognitive capabilities. http://www.bluemix.com

21. ©IBM 2016 Applied Artificial Intelligence Conference 21 Chapter 3 Actions speak louder

22. Watson is creating a new partnership between people and computers that enhances, scales, and accelerates human expertise Tabulating Systems Era 1900 Programmable Systems Era 1950 Cognitive Systems Era 2011

23. ©IBM 2016 Applied Artificial Intelligence Conference 23 CogniToys Capabilities • Conversational with a personality! • Age appropriate content based on child’s previous interactions with the toy Story telling Story creation Fun commands to discover during play • Proprietary educational framework that fuses educational content into the toys play pattern • Parent Panel that gives parents real-time feedback on a childs learning based on toy-child interaction PLAY AND LEARN - BACKED BY IBM WATSON CogniToys are the next generation of internet connected smart toys that learn and grow with your child. www.cognitoys.com

24. ©IBM 2016 Applied Artificial Intelligence Conference 24 Various adoption patterns working across structured and unstructured data with NLP, Vision, Speech and Machine Learning ENGAGE DISCOVEREXPLORE DECIDE EMBED Express intents, ask questions for greater insight Natural language dialogue Build Bots for various channels 360-degree info apps at the point of impact Platform API’s to further enhance cognitive processing Find external information in real time When finding the question is as important as finding the answer Find rationale for given responses Scaling to millions of documents Ingest and analyze domain sources, info models Evidence-based decisions with greater confidence Build your application using callable Watson Service APIs Can be combined with the 100s of other available API’s on Bluemix Transform customer experiences Search, consolidate & analyze enterprise data Accelerate Research into Insight Evaluate possible options & choose the best one Enrich apps with Cognitive, NLP, Vision & Machine Learning capabilities

25. ©IBM 2016 Applied Artificial Intelligence Conference 25 Some of the key needs we are seeing from customers … • Help me see beyond the hype • Help get me started quickly & right away a.k.a speed to market • Breadth of capabilities across Language, Vision, Speech, Insights, Analytics • My data is my crown jewel • Help me with the data – acquisition, cleansing, mungingand ingestion • I don’t have data scientists … yet • Ability to train / adapt the models with my own data • Abstract the hard science away from me • Ability to use my own language models • API’s. API’s. API’s • Platform can scale & is secure • What do you have for my industry? 5/25/16

27. ©IBM 2016 Applied Artificial Intelligence Conference 28 Watson at work in the world. 5/25/16 "Woodside to tap into IBM's Watson” - CIO "IBM’s Watson Now Powers AI For Under Armour” - TechCrunch "SoftBank's Pepper robot is getting an intelligence boost from IBM's Watson"- The Verge "Medtronic, IBM team up on diabetes app to predict possibly dangerous events hours earlier."- The Washington Post "IBM’s Watson Helped Pick Kia’s Super Bowl ‘Influencers’” - Wall Street Journal "How Can I Help You? IBM's Watson Powers Hilton's Robotic Concierge" - Fast Company "IBM and Apple can put Watson's A.I. insights inside Apple Watch"- ComputerWorld "Thomson Reuters to deploy IBM Watson technology” - InfoTechLead "IBM's Watson Lands A Job With KPMG.” -InformationWeek "The North Face Uses IBM's Watson to Make Online Shopping Smarter" -The Street

28. ©IBM 2016 Applied Artificial Intelligence Conference 29 Other examples of cognitive applications …. • Self-Service Student Advisor • Financial Advisor • Population Health Management • Technical Support Services System • Tumor Detection • Life Sciences Exploration • Retail Shopping Assistant • Product and service quality • Drug efficacy • Fraud detection • Oncology Advisor • Digital Marketing development & execution • Clinical Trails Matching • Demand Generation Insights • Customer satisfaction and survey analysis • Claims analysis, payment validation and loss review • Cognitive Service Maintenance

29. ©IBM 2016 Applied Artificial Intelligence Conference 30 More Food for thought …. • Contact Center Insights • Muti-channel Virtual Agents • Cognitive Commerce • Cognitive Robotics Process Automation • Concierge to address guest needs and enquiries • Emotional analysis from text, vision and speech • Audience / visitor insights from their reviews and social posts • Analysis & Insight from customer conversations • Trending Topics & affiliated topics • Cognitive Location based decisions for entertainment venues • Virtual Agents leveraging Bots • HR / Workforce Optimization • Discovery with evidence-based, relevant pathways 5/25/16

30. ©IBM 2016 Applied Artificial Intelligence Conference 31 Speaking of food and cocktail that was promised …. 5/25/16 https://www.ibmchefwatson.com/recipe/03ade0cdfa4a22ecc0c4a37393f51e7e

31. © 2016 IBM Corporation 324/11/16 facebook.com/ibmwatson ibmwatson.com @ibmwatson What will you do with Cognitive Computing? Improve your processes and operations Enable new kinds of engagement Create better products Leverage expertise Enable new business models Data Watson