SlideShare a Scribd company logo
Customer feedback approach
triple j mobile app
Turning customer feedback…
…into actionable insights
Background
• No existing framework for customer
feedback
• Rusted on user base, no new product
released for 7+ years
• Change in product approach
• ‘Release early, release often’ meant
stripping the product of many of its
features, we needed to take the audience
on a journey with us
Users You
Our workflow
1.
Define your
sources
CRM (HelpScout)
Staff & stakeholders
Social channels
App stores
2.
Collate and
categorise
Type
Theme
Code
3.
Respond to
feedback
Reply templates
‘No promises’
Tag & sort
4.
Interpret
and share
Reporting
Stakeholder
management
5.
Repeat
the process
Reasonable response
times and achievable
cadence
Don’t burn out!
Categorisation
• Accurate categorisation is central
to turning feedback into actionable
insights as it helps to identify
patterns
• Depending on the volume of
feedback you may not need three
layers, ‘Type’ and ‘Code’ may be
enough
• ‘Theme and ‘Code’ types will be
specific to your product, however
some general ‘Category’ types that
we found useful were:
§ Usability issue
§ Feature request
§ Bug
§ User education issue
§ Generic positive
§ Generic negative
Type
Broad, a small number of
categories makes it easier to
group
Theme
Product specific, useful for
breaking down a large volume
into manageable buckets
Code
Granular level, likely how it
directly impacts the user
Feedback examples
Feedback Type Theme Code
“I'm on the Gold Coast. I want to change my station to
Queensland time. How can I do that?”
Feature
request
Time
delayed
streams
Wants ability to listen in
their own timezone
“The old app was great as it had a history of recently played
tracks. It was the best thing about the app. I can’t seem to do
this any more with the current one - great shame.”
Usability
issue
Recently
played
Can't find recently played
tracks
“Not to keen on the new app, I cannot see why you would
change it. How is it better?”
Generic
negative
Generic
negative
Generic negative
“Every time I listen from my Samsung it cuts out every few
minutes and I have to keep pressing play. This doesn't happen
with Spotify or any other app I use.”
Bug
Live
stream
Android live stream
drops out
What else we capture
Date
Helps to pinpoint whether a defect or
feature request is tied to a specific
release or known technical issue
Source
Useful for stakeholder management
(is the feedback via public or private
channels)
Device, OS, version
Aids in identifying bugs isolated to
certain groups of users
Status
Awaiting response, active, closed
Interpreting feedback
• This will be entirely product specific, but some of the ways we’ve used it are:
Bug identification and
resolution
Following a large volume of feedback specific to Android users we noticed a drop
in avg session time (verified via GA360) isolated to a recent release.
Subsequently identified a problem causing live stream to cut out after ~2 mins.
Also used feedback to source users for testing/debug of the fix
Feature requests and
backlog grooming
Time delayed streams were already on our roadmap, but it didn’t come up as a
recurring feature request until we started adding new users to the app following
our soft launch/migration. Old app users never had time delayed streams so it
wasn’t something they expected, new users felt it was an obvious feature
(exacerbated by daylight savings)
Stakeholder
management
“I saw a negative review in the App Store!” - visualising feedback sources (private
and direct vs posted through public channels) has been a great way to ease
stakeholder anxieties and manage expectations around roadmap prioritisation
Keeping in contact
• Tag your messages in the CRM system so you’re able to follow up with users
who experienced a bug or requested a feature once an update that resolve
their issue is released
Tools
Google Docs
Sheets to consolidate feedback, Slides for
linked charts that dynamically update as
new feedback is added, easily shared with
stakeholders
CRM service
Help Scout, Zen Desk
App Figures
Store reviews
Further reading
www.intercom.com/blog/how-to-analyze-
customer-feedback-and-make-it-actionable

More Related Content

Similar to How we turned customer feedback into actionable insights for product management

Prototype model
Prototype modelPrototype model
Prototype model
Sanjida Sultana
 
Requirement analysis with use case
Requirement analysis with use caseRequirement analysis with use case
Requirement analysis with use case
Rapeepan Thawornwanchai
 
SWE481 – Software Engineering Capstone 1 Page 2SWE.docx
SWE481 – Software Engineering Capstone 1     Page  2SWE.docxSWE481 – Software Engineering Capstone 1     Page  2SWE.docx
SWE481 – Software Engineering Capstone 1 Page 2SWE.docx
mattinsonjanel
 
Quick win ways to mitigate feature creep
Quick win ways to mitigate feature creepQuick win ways to mitigate feature creep
Quick win ways to mitigate feature creep
Enov8
 
Prototyping (presentation)
Prototyping (presentation)Prototyping (presentation)
Prototyping (presentation)
Choudhry Tahir Masood
 
Customer engagement platform
Customer engagement platformCustomer engagement platform
Customer engagement platform
Bhavdip Bhalodia
 
Usability for everyone : Google I/O Extended 2018
Usability for everyone : Google I/O Extended 2018Usability for everyone : Google I/O Extended 2018
Usability for everyone : Google I/O Extended 2018
Jagriti Pande
 
SYST15892 Interactive User Interface Design Phase IV Usa.pdf
SYST15892  Interactive User Interface Design Phase IV  Usa.pdfSYST15892  Interactive User Interface Design Phase IV  Usa.pdf
SYST15892 Interactive User Interface Design Phase IV Usa.pdf
acsmadurai
 
Problems with water fall model ppt
Problems with water fall model pptProblems with water fall model ppt
Problems with water fall model ppt
soni singh
 
Requirements
RequirementsRequirements
Requirements
Sohail Khan
 
Option 2015- Getting Started with Optimizely for Mobile
Option 2015- Getting Started with Optimizely for MobileOption 2015- Getting Started with Optimizely for Mobile
Option 2015- Getting Started with Optimizely for Mobile
Optimizely
 
Building an app from scratch
Building an app from scratchBuilding an app from scratch
Building an app from scratch
Netset Software Solutions
 
Hang preso 4
Hang preso 4Hang preso 4
Hang preso 4
VarunDas24
 
Rocket jones 4 stage process
Rocket jones 4 stage processRocket jones 4 stage process
Rocket jones 4 stage process
Zachary Ostin
 
SE-Lecture-4.pptx
SE-Lecture-4.pptxSE-Lecture-4.pptx
SE-Lecture-4.pptx
vishal choudhary
 
Latest_Portfolio_Anxiao_chen
Latest_Portfolio_Anxiao_chenLatest_Portfolio_Anxiao_chen
Latest_Portfolio_Anxiao_chen
Anxiao Chen
 
Gaining the app visibility that matters
Gaining the app visibility that mattersGaining the app visibility that matters
Gaining the app visibility that matters
Prajyot Mainkar
 
InMobi inDecode - Gaining App Visibility That Matters
InMobi inDecode - Gaining App Visibility That MattersInMobi inDecode - Gaining App Visibility That Matters
InMobi inDecode - Gaining App Visibility That Matters
InMobi
 
Designing Voice Applications - Create For Voice
Designing Voice Applications - Create For VoiceDesigning Voice Applications - Create For Voice
Designing Voice Applications - Create For Voice
Kasia Ryniak
 
How to do usability testing and eye tracking
How to do usability testing and eye trackingHow to do usability testing and eye tracking
How to do usability testing and eye tracking
Objective Experience
 

Similar to How we turned customer feedback into actionable insights for product management (20)

Prototype model
Prototype modelPrototype model
Prototype model
 
Requirement analysis with use case
Requirement analysis with use caseRequirement analysis with use case
Requirement analysis with use case
 
SWE481 – Software Engineering Capstone 1 Page 2SWE.docx
SWE481 – Software Engineering Capstone 1     Page  2SWE.docxSWE481 – Software Engineering Capstone 1     Page  2SWE.docx
SWE481 – Software Engineering Capstone 1 Page 2SWE.docx
 
Quick win ways to mitigate feature creep
Quick win ways to mitigate feature creepQuick win ways to mitigate feature creep
Quick win ways to mitigate feature creep
 
Prototyping (presentation)
Prototyping (presentation)Prototyping (presentation)
Prototyping (presentation)
 
Customer engagement platform
Customer engagement platformCustomer engagement platform
Customer engagement platform
 
Usability for everyone : Google I/O Extended 2018
Usability for everyone : Google I/O Extended 2018Usability for everyone : Google I/O Extended 2018
Usability for everyone : Google I/O Extended 2018
 
SYST15892 Interactive User Interface Design Phase IV Usa.pdf
SYST15892  Interactive User Interface Design Phase IV  Usa.pdfSYST15892  Interactive User Interface Design Phase IV  Usa.pdf
SYST15892 Interactive User Interface Design Phase IV Usa.pdf
 
Problems with water fall model ppt
Problems with water fall model pptProblems with water fall model ppt
Problems with water fall model ppt
 
Requirements
RequirementsRequirements
Requirements
 
Option 2015- Getting Started with Optimizely for Mobile
Option 2015- Getting Started with Optimizely for MobileOption 2015- Getting Started with Optimizely for Mobile
Option 2015- Getting Started with Optimizely for Mobile
 
Building an app from scratch
Building an app from scratchBuilding an app from scratch
Building an app from scratch
 
Hang preso 4
Hang preso 4Hang preso 4
Hang preso 4
 
Rocket jones 4 stage process
Rocket jones 4 stage processRocket jones 4 stage process
Rocket jones 4 stage process
 
SE-Lecture-4.pptx
SE-Lecture-4.pptxSE-Lecture-4.pptx
SE-Lecture-4.pptx
 
Latest_Portfolio_Anxiao_chen
Latest_Portfolio_Anxiao_chenLatest_Portfolio_Anxiao_chen
Latest_Portfolio_Anxiao_chen
 
Gaining the app visibility that matters
Gaining the app visibility that mattersGaining the app visibility that matters
Gaining the app visibility that matters
 
InMobi inDecode - Gaining App Visibility That Matters
InMobi inDecode - Gaining App Visibility That MattersInMobi inDecode - Gaining App Visibility That Matters
InMobi inDecode - Gaining App Visibility That Matters
 
Designing Voice Applications - Create For Voice
Designing Voice Applications - Create For VoiceDesigning Voice Applications - Create For Voice
Designing Voice Applications - Create For Voice
 
How to do usability testing and eye tracking
How to do usability testing and eye trackingHow to do usability testing and eye tracking
How to do usability testing and eye tracking
 

Recently uploaded

5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides
DanBrown980551
 
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
saastr
 
Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)
Jakub Marek
 
Building Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and MilvusBuilding Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and Milvus
Zilliz
 
SAP S/4 HANA sourcing and procurement to Public cloud
SAP S/4 HANA sourcing and procurement to Public cloudSAP S/4 HANA sourcing and procurement to Public cloud
SAP S/4 HANA sourcing and procurement to Public cloud
maazsz111
 
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy SurveyTrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc
 
AWS Cloud Cost Optimization Presentation.pptx
AWS Cloud Cost Optimization Presentation.pptxAWS Cloud Cost Optimization Presentation.pptx
AWS Cloud Cost Optimization Presentation.pptx
HarisZaheer8
 
Generating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and MilvusGenerating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and Milvus
Zilliz
 
Choosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptxChoosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptx
Brandon Minnick, MBA
 
Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |
AstuteBusiness
 
Fueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte WebinarFueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte Webinar
Zilliz
 
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdfMonitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Tosin Akinosho
 
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success StoryDriving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Safe Software
 
Nordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptxNordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptx
MichaelKnudsen27
 
Trusted Execution Environment for Decentralized Process Mining
Trusted Execution Environment for Decentralized Process MiningTrusted Execution Environment for Decentralized Process Mining
Trusted Execution Environment for Decentralized Process Mining
LucaBarbaro3
 
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-EfficiencyFreshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
ScyllaDB
 
System Design Case Study: Building a Scalable E-Commerce Platform - Hiike
System Design Case Study: Building a Scalable E-Commerce Platform - HiikeSystem Design Case Study: Building a Scalable E-Commerce Platform - Hiike
System Design Case Study: Building a Scalable E-Commerce Platform - Hiike
Hiike
 
Serial Arm Control in Real Time Presentation
Serial Arm Control in Real Time PresentationSerial Arm Control in Real Time Presentation
Serial Arm Control in Real Time Presentation
tolgahangng
 
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing InstancesEnergy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Alpen-Adria-Universität
 
Best 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERPBest 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERP
Pixlogix Infotech
 

Recently uploaded (20)

5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides
 
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
 
Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)
 
Building Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and MilvusBuilding Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and Milvus
 
SAP S/4 HANA sourcing and procurement to Public cloud
SAP S/4 HANA sourcing and procurement to Public cloudSAP S/4 HANA sourcing and procurement to Public cloud
SAP S/4 HANA sourcing and procurement to Public cloud
 
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy SurveyTrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy Survey
 
AWS Cloud Cost Optimization Presentation.pptx
AWS Cloud Cost Optimization Presentation.pptxAWS Cloud Cost Optimization Presentation.pptx
AWS Cloud Cost Optimization Presentation.pptx
 
Generating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and MilvusGenerating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and Milvus
 
Choosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptxChoosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptx
 
Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |
 
Fueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte WebinarFueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte Webinar
 
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdfMonitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdf
 
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success StoryDriving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
 
Nordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptxNordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptx
 
Trusted Execution Environment for Decentralized Process Mining
Trusted Execution Environment for Decentralized Process MiningTrusted Execution Environment for Decentralized Process Mining
Trusted Execution Environment for Decentralized Process Mining
 
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-EfficiencyFreshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
 
System Design Case Study: Building a Scalable E-Commerce Platform - Hiike
System Design Case Study: Building a Scalable E-Commerce Platform - HiikeSystem Design Case Study: Building a Scalable E-Commerce Platform - Hiike
System Design Case Study: Building a Scalable E-Commerce Platform - Hiike
 
Serial Arm Control in Real Time Presentation
Serial Arm Control in Real Time PresentationSerial Arm Control in Real Time Presentation
Serial Arm Control in Real Time Presentation
 
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing InstancesEnergy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
 
Best 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERPBest 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERP
 

How we turned customer feedback into actionable insights for product management

  • 3. Background • No existing framework for customer feedback • Rusted on user base, no new product released for 7+ years • Change in product approach • ‘Release early, release often’ meant stripping the product of many of its features, we needed to take the audience on a journey with us
  • 5. Our workflow 1. Define your sources CRM (HelpScout) Staff & stakeholders Social channels App stores 2. Collate and categorise Type Theme Code 3. Respond to feedback Reply templates ‘No promises’ Tag & sort 4. Interpret and share Reporting Stakeholder management 5. Repeat the process Reasonable response times and achievable cadence Don’t burn out!
  • 6. Categorisation • Accurate categorisation is central to turning feedback into actionable insights as it helps to identify patterns • Depending on the volume of feedback you may not need three layers, ‘Type’ and ‘Code’ may be enough • ‘Theme and ‘Code’ types will be specific to your product, however some general ‘Category’ types that we found useful were: § Usability issue § Feature request § Bug § User education issue § Generic positive § Generic negative Type Broad, a small number of categories makes it easier to group Theme Product specific, useful for breaking down a large volume into manageable buckets Code Granular level, likely how it directly impacts the user
  • 7. Feedback examples Feedback Type Theme Code “I'm on the Gold Coast. I want to change my station to Queensland time. How can I do that?” Feature request Time delayed streams Wants ability to listen in their own timezone “The old app was great as it had a history of recently played tracks. It was the best thing about the app. I can’t seem to do this any more with the current one - great shame.” Usability issue Recently played Can't find recently played tracks “Not to keen on the new app, I cannot see why you would change it. How is it better?” Generic negative Generic negative Generic negative “Every time I listen from my Samsung it cuts out every few minutes and I have to keep pressing play. This doesn't happen with Spotify or any other app I use.” Bug Live stream Android live stream drops out
  • 8. What else we capture Date Helps to pinpoint whether a defect or feature request is tied to a specific release or known technical issue Source Useful for stakeholder management (is the feedback via public or private channels) Device, OS, version Aids in identifying bugs isolated to certain groups of users Status Awaiting response, active, closed
  • 9. Interpreting feedback • This will be entirely product specific, but some of the ways we’ve used it are: Bug identification and resolution Following a large volume of feedback specific to Android users we noticed a drop in avg session time (verified via GA360) isolated to a recent release. Subsequently identified a problem causing live stream to cut out after ~2 mins. Also used feedback to source users for testing/debug of the fix Feature requests and backlog grooming Time delayed streams were already on our roadmap, but it didn’t come up as a recurring feature request until we started adding new users to the app following our soft launch/migration. Old app users never had time delayed streams so it wasn’t something they expected, new users felt it was an obvious feature (exacerbated by daylight savings) Stakeholder management “I saw a negative review in the App Store!” - visualising feedback sources (private and direct vs posted through public channels) has been a great way to ease stakeholder anxieties and manage expectations around roadmap prioritisation
  • 10. Keeping in contact • Tag your messages in the CRM system so you’re able to follow up with users who experienced a bug or requested a feature once an update that resolve their issue is released
  • 11. Tools Google Docs Sheets to consolidate feedback, Slides for linked charts that dynamically update as new feedback is added, easily shared with stakeholders CRM service Help Scout, Zen Desk App Figures Store reviews Further reading www.intercom.com/blog/how-to-analyze- customer-feedback-and-make-it-actionable