SlideShare a Scribd company logo
1 of 34
Download to read offline
CASE STUDY:
How to Improve the Customer Experience
with AI & Humans
NTT Communications
Customer Services
Toshiyuki ARAI
Chatbot, Chatbot, Chatbot...
* including for the customers / employees
10+ Chatbots*
within 2 years
Today’s Contents
● Case
● Key Findings
● Learning from projects
● Next Steps
Case
Case:
One of In-bound Sales Contact Centers
210K
inquiries
per month
600
agents
6M
PV per month
Problem
◆ Contact Center Operation Perspective
○ Customer support for outside business hours
○ More complex services need longer handling time
◆ Management Perspective
○ Operational cost reduction
○ Operational efficiency
○ Establish self-service channel
 
Solution
Drive Customers
to Web Self-Service Support
Website sample
http://www.ntt.com/personal/services/mobile/one.html
User query sample (1/3)
Customer:
How much does it cost when
I telephone using 050plus in
Singapore ?
User query sample (2/3)
Chatbot:
Are you looking for the
information regarding the
usage fee when you place a
call overseas?
User query sample (3/3)
Chatbot:
Are you looking for the usage
fee when you place a call
overseas ?
Customer:
How much does it cost when
I telephone using 050plus in
Singapore ?Singapore(シンガポール) -> overseas(海外)
telephone(電話する) -> place a call(発信する)
How much does it cost (いくら)-> usage fee(料金)
Results
24-hour
Service
Availability
Customer
Interactions
4 times
Reduction in
Customer
Support Tickets*
63%
* Live Chat agent
Key Findings
Key Findings
Findability
Improved learnings (FAQ Quality)
Necessary human in the loop
Findability
Sample Q:
“Application Error is occurred. Error code is {XXXX}. What should I do ?”
Before After
I met the
Error !
I met the
Error !
Navigate the customer to chose the context of the question
Which code
is displayed ?
code is
1000 !
Improved Learnings (FAQ Quality)
Detect lack of content based on customer queries
Semantic
Classification
Detect lack of
content
Create / Modify
FAQ content
Necessary Human in the loop
Analyze why the customers want to chat with
Chat logs
w/ Live agent
Extract customer
questions
Analysis of cause
Learning from projects
* including for the customers / employees
10+ Chatbots*
within 2 years
Learning from projects
Practice over Theory*
*Joi Ito, Whiplash ,2016
Learning from projects
Practice over Theory*
Projects, Peers, Passion, Play**
*Joi Ito, Whiplash ,2016
**Mitchel Resnick, “GIVE P’S A CHANCE: PROJECTS, PEERS, PASSION, PLAY”,2014
Projects, Peers, Passion, Play
Projects
Passion
Play
Peers
AI Festival
Next Steps
What to do from here
● Analysis Multi-Channel logs (Customer Journey logs)
● Text Summarization / Knowledge Extraction
● Human in the loop Optimization
Summary
● Web Self-Service Support case
● Necessary human in the loop
● Learning from projects
● AI & Humans to improve Customer Journey
Thank you !
About
NTT Group
Regional
communication
Application
integration
Mobile
communication
Managed
ICT Service
Long distance
& international
communication,
ICT Solutions
*In FY2016
➢ Operating Revenues : JPY 1,283.0B
<Global Deployment>
<NTT Com Group Employees>
➢ Offices in 41 countries/regions, 112 cities
➢ Global Network Service in 196 countries/regions
➢ Global Tier-1 IP backbone provider, one of the largest in Asia
➢ Over 140*2
data centers worldwide
<Results for FY2016>
*1 As of the end of March 2017 *2 Including plans
➢ Operating Income : JPY 132.5B
✓ Japan : Approx. 11,900
✓ Outside Japan : Approx. 9,650
➢ Total : Approx. 21,550
NTT Communications
Organization Structure
Board of
Directors
Audit &
Supervisory
Board
President
Audit &
Supervisory
Board
Members
Office of
Audit &
Supervisory
Board
Members
■ First Sales Division
■ Second Sales Division
■ Third Sales Division
■ Fourth Sales Division
■ West Japan Sales Division
■ ICT Consulting Division
■ Global Business
■ Voice and Video
■ Network Services
■ Cloud Services
■ Applications and Content
■ Solution Services
■ Managed Services
■ Customer Services
■ Service Infrastructure
■ Systems
■ Corporate Planning
■ Finance
■ Human Resources
■ General Affairs
■ Legal Affairs and Internal
Auditing
■ Procurements
■ Technology Development
■ Information Security
Sales
Services
Operation
OH/ Back Office
Customer Services division
Main operations:
Operations Support Readiness, Fulfillment and Assurance
Missions:
No1 in Customer Satisfaction and Securing global competitiveness
Services
Customer
Delivery Assurance
Facility
/
Construction
Quality
Management
Tools
Development
Sales
Front
Operation
Sales
Support
EOF

More Related Content

Similar to 2017 12-03 case study- how to improve the customer experience with ai &amp; humans

kintone Overview for JAIT
kintone Overview for JAITkintone Overview for JAIT
kintone Overview for JAITKen Aoyama
 
Your Next App Might Just Be a Bot: Building Conversational Bots with Python
Your Next App Might Just Be a Bot: Building Conversational Bots with PythonYour Next App Might Just Be a Bot: Building Conversational Bots with Python
Your Next App Might Just Be a Bot: Building Conversational Bots with PythonDavid Asamu
 
Design and Development of E-Commerce Web Application for Cooperative Store
Design and Development of E-Commerce Web Application for Cooperative StoreDesign and Development of E-Commerce Web Application for Cooperative Store
Design and Development of E-Commerce Web Application for Cooperative StoreIRJET Journal
 
Customer Centric Innovation in a World of Shiny Objects
Customer Centric Innovation in a World of Shiny ObjectsCustomer Centric Innovation in a World of Shiny Objects
Customer Centric Innovation in a World of Shiny ObjectsJoAnna Cheshire
 
Case study ING
Case study INGCase study ING
Case study INGITpreneurs
 
Internet infrastruture development in the asia pacific
Internet infrastruture development in the asia pacificInternet infrastruture development in the asia pacific
Internet infrastruture development in the asia pacificAPNIC
 
Prompto - Android App Marketing Plan
Prompto - Android App Marketing PlanPrompto - Android App Marketing Plan
Prompto - Android App Marketing PlanNeel Kapoor
 
ING's Customer-Centric Data Journey from Community Idea to Private Cloud Depl...
ING's Customer-Centric Data Journey from Community Idea to Private Cloud Depl...ING's Customer-Centric Data Journey from Community Idea to Private Cloud Depl...
ING's Customer-Centric Data Journey from Community Idea to Private Cloud Depl...DataWorks Summit/Hadoop Summit
 
Piti Prasertsuksean-CV 201501
Piti Prasertsuksean-CV 201501Piti Prasertsuksean-CV 201501
Piti Prasertsuksean-CV 201501petemail2k
 
I576670.pdf
I576670.pdfI576670.pdf
I576670.pdfaijbm
 
The Path To Effective IT Chargeback
The Path To Effective IT ChargebackThe Path To Effective IT Chargeback
The Path To Effective IT ChargebackPete Hidalgo
 
Financial Results for the First Half of the Fiscal Year Ending March 2017
Financial Results for the First Half of the Fiscal Year Ending March 2017Financial Results for the First Half of the Fiscal Year Ending March 2017
Financial Results for the First Half of the Fiscal Year Ending March 2017KDDI
 
Stephen Cannoo Comprehensive CV Feb 2015 ver1.1
Stephen Cannoo Comprehensive CV Feb 2015 ver1.1Stephen Cannoo Comprehensive CV Feb 2015 ver1.1
Stephen Cannoo Comprehensive CV Feb 2015 ver1.1Stephen Cannoo
 

Similar to 2017 12-03 case study- how to improve the customer experience with ai &amp; humans (20)

kintone Overview for JAIT
kintone Overview for JAITkintone Overview for JAIT
kintone Overview for JAIT
 
Abhishek_New CV
Abhishek_New CVAbhishek_New CV
Abhishek_New CV
 
Your Next App Might Just Be a Bot: Building Conversational Bots with Python
Your Next App Might Just Be a Bot: Building Conversational Bots with PythonYour Next App Might Just Be a Bot: Building Conversational Bots with Python
Your Next App Might Just Be a Bot: Building Conversational Bots with Python
 
Design and Development of E-Commerce Web Application for Cooperative Store
Design and Development of E-Commerce Web Application for Cooperative StoreDesign and Development of E-Commerce Web Application for Cooperative Store
Design and Development of E-Commerce Web Application for Cooperative Store
 
Customer Centric Innovation in a World of Shiny Objects
Customer Centric Innovation in a World of Shiny ObjectsCustomer Centric Innovation in a World of Shiny Objects
Customer Centric Innovation in a World of Shiny Objects
 
Case study ING
Case study INGCase study ING
Case study ING
 
Internet infrastruture development in the asia pacific
Internet infrastruture development in the asia pacificInternet infrastruture development in the asia pacific
Internet infrastruture development in the asia pacific
 
CV of Presantha Pillay
CV of Presantha PillayCV of Presantha Pillay
CV of Presantha Pillay
 
Prompto - Android App Marketing Plan
Prompto - Android App Marketing PlanPrompto - Android App Marketing Plan
Prompto - Android App Marketing Plan
 
ING's Customer-Centric Data Journey from Community Idea to Private Cloud Depl...
ING's Customer-Centric Data Journey from Community Idea to Private Cloud Depl...ING's Customer-Centric Data Journey from Community Idea to Private Cloud Depl...
ING's Customer-Centric Data Journey from Community Idea to Private Cloud Depl...
 
Thai startup eco_20130609
Thai startup eco_20130609Thai startup eco_20130609
Thai startup eco_20130609
 
Piti Prasertsuksean-CV 201501
Piti Prasertsuksean-CV 201501Piti Prasertsuksean-CV 201501
Piti Prasertsuksean-CV 201501
 
Swati
SwatiSwati
Swati
 
AppDays_WeatherPro
AppDays_WeatherProAppDays_WeatherPro
AppDays_WeatherPro
 
Soumyansu Sarkar CV
Soumyansu Sarkar CVSoumyansu Sarkar CV
Soumyansu Sarkar CV
 
I576670.pdf
I576670.pdfI576670.pdf
I576670.pdf
 
The Path To Effective IT Chargeback
The Path To Effective IT ChargebackThe Path To Effective IT Chargeback
The Path To Effective IT Chargeback
 
Financial Results for the First Half of the Fiscal Year Ending March 2017
Financial Results for the First Half of the Fiscal Year Ending March 2017Financial Results for the First Half of the Fiscal Year Ending March 2017
Financial Results for the First Half of the Fiscal Year Ending March 2017
 
3D Recruitment
3D Recruitment3D Recruitment
3D Recruitment
 
Stephen Cannoo Comprehensive CV Feb 2015 ver1.1
Stephen Cannoo Comprehensive CV Feb 2015 ver1.1Stephen Cannoo Comprehensive CV Feb 2015 ver1.1
Stephen Cannoo Comprehensive CV Feb 2015 ver1.1
 

Recently uploaded

Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Allon Mureinik
 
Pigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Scott Keck-Warren
 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...HostedbyConfluent
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machinePadma Pradeep
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 3652toLead Limited
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationRidwan Fadjar
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesSinan KOZAK
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slidespraypatel2
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreternaman860154
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
Artificial intelligence in the post-deep learning era
Artificial intelligence in the post-deep learning eraArtificial intelligence in the post-deep learning era
Artificial intelligence in the post-deep learning eraDeakin University
 
Next-generation AAM aircraft unveiled by Supernal, S-A2
Next-generation AAM aircraft unveiled by Supernal, S-A2Next-generation AAM aircraft unveiled by Supernal, S-A2
Next-generation AAM aircraft unveiled by Supernal, S-A2Hyundai Motor Group
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsMemoori
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticscarlostorres15106
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j
 

Recently uploaded (20)

E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptxE-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)
 
Pigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping Elbows
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024
 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machine
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 Presentation
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen Frames
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
The transition to renewables in India.pdf
The transition to renewables in India.pdfThe transition to renewables in India.pdf
The transition to renewables in India.pdf
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
Artificial intelligence in the post-deep learning era
Artificial intelligence in the post-deep learning eraArtificial intelligence in the post-deep learning era
Artificial intelligence in the post-deep learning era
 
Next-generation AAM aircraft unveiled by Supernal, S-A2
Next-generation AAM aircraft unveiled by Supernal, S-A2Next-generation AAM aircraft unveiled by Supernal, S-A2
Next-generation AAM aircraft unveiled by Supernal, S-A2
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial Buildings
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
 

2017 12-03 case study- how to improve the customer experience with ai &amp; humans