SlideShare a Scribd company logo

Exploring the future of verbatim coding with ChatGPT

Presented by Tim Brandwood and Damien Gouriet. Codeit have been involved in Verbatim Coding and Machine Learning for the last 7 years. In this presentation, they share their research on the use of Generative AI for coding market research verbatim responses, and their experiments using Generative AI to automate the coding process. They also discuss the strengths and limitations of this as a coding tool, the role of human oversight in the process, and the potential for customized machine learning models working alongside it. The highlights the importance of human expertise and the use of GPT as a labour-saving tool rather than a complete replacement for humans in the market research process. Access the presentation recording via NewMR.org/Play-Again.

1 of 14
Download to read offline
Exploring the future of verbatim
coding with ChatGPT
NewMR Webinar June 2023
Tim Brandwood & Damien Gouriet
Digital Taxonomy
Founded
in 2016
Verbatim
Coding Software
Efficiency through
cutting-edge tech
WHO WE ARE….
THE PURPOSE OF CODING
Open-ended Comments
I like the orange taste,
but it’s too sweet
The sweetness is a bit much
I think the orange colour is
too pale and artificial looking
I don’t like the bits of
orange in it
I don’t like the idea of
artificial sweeteners
Analysable Quantitative Measures
Taste (871) 87%
Too Sweet (632) 63%
Tastes Artificial (421) 42%
Doesn’t taste like real orange (237) 24%
Appearance (423) 42%
Colour – too light/pale (302) 30%
Colour – too artificial looking (150) 15%
Colour – too dark (100) 10%
Colour – other comments (40) 4%
Ingredients (408) 41%
Artificial Sweeteners (300) 30%
Real Orange (150) 15%
Orange bits (50) 5%
Packaging (387) 39%
Bottle too big (223) 22%
Difficult to hold (150) 15%
Label hard to read (87) 8%
Dislike bottle shape (60) 6%
Requires: Accuracy and Precision
Extracting Themes
Complete Coding:
Generates rich, human-like themes
Performs extremely well:
CAN CHATGPT DO CODING THEN?
Quantifying Themes
“Chat” interactivity allows you to ask follow-up questions,
and dig deeper
Complete Coding:
Incomplete coverage
Struggles to accurately and precisely quantify themes. Issues include:
Miscoding
Repeatability
20% verbatims coded
80% accuracy
PEOPLE STILL NEED TO BE
INVOLVED IN THE PROCESS
Go further, quicker …but you still need to pedal!
ChatGPT is an electric bike for your mind.
-Richard Bowman (https://prompt.mba)
CODEFRAME
BUILDER
Ad

Recommended

Using Generative AI to bring Qualitative Capabilities to Quantitative Surveys
Using Generative AI to bring Qualitative Capabilities to Quantitative SurveysUsing Generative AI to bring Qualitative Capabilities to Quantitative Surveys
Using Generative AI to bring Qualitative Capabilities to Quantitative SurveysRay Poynter
 
Using Generative AI to Assess the Quality of Open-Ended Responses in Surveys
Using Generative AI to Assess the Quality of Open-Ended Responses in SurveysUsing Generative AI to Assess the Quality of Open-Ended Responses in Surveys
Using Generative AI to Assess the Quality of Open-Ended Responses in SurveysRay Poynter
 
Tech for tech’s sake? Learnings from experiments with AI in consumer research
Tech for tech’s sake? Learnings from experiments with AI in consumer researchTech for tech’s sake? Learnings from experiments with AI in consumer research
Tech for tech’s sake? Learnings from experiments with AI in consumer researchRay Poynter
 
AI Restart 2023: David Bureš, Lukáš Kostka, Vojtěch Fiala - Jak mění AI práci...
AI Restart 2023: David Bureš, Lukáš Kostka, Vojtěch Fiala - Jak mění AI práci...AI Restart 2023: David Bureš, Lukáš Kostka, Vojtěch Fiala - Jak mění AI práci...
AI Restart 2023: David Bureš, Lukáš Kostka, Vojtěch Fiala - Jak mění AI práci...Taste
 
Harnessing the Capabilities of ChatGPT for Enterprise Success Use Cases and S...
Harnessing the Capabilities of ChatGPT for Enterprise Success Use Cases and S...Harnessing the Capabilities of ChatGPT for Enterprise Success Use Cases and S...
Harnessing the Capabilities of ChatGPT for Enterprise Success Use Cases and S...StephenAmell4
 
BBL2_ChatGPT working smarter.pdf
BBL2_ChatGPT working smarter.pdfBBL2_ChatGPT working smarter.pdf
BBL2_ChatGPT working smarter.pdfG20LandInitiative
 
AI Restart 2023: Marek Šimkovský - AI vám přidá práci. Alespoň dnes.
AI Restart 2023: Marek Šimkovský - AI vám přidá práci. Alespoň dnes.AI Restart 2023: Marek Šimkovský - AI vám přidá práci. Alespoň dnes.
AI Restart 2023: Marek Šimkovský - AI vám přidá práci. Alespoň dnes.Taste
 

More Related Content

What's hot

Unlocking the Power of ChatGPT and AI in Testing - NextSteps, presented by Ap...
Unlocking the Power of ChatGPT and AI in Testing - NextSteps, presented by Ap...Unlocking the Power of ChatGPT and AI in Testing - NextSteps, presented by Ap...
Unlocking the Power of ChatGPT and AI in Testing - NextSteps, presented by Ap...Applitools
 
AI Restart 2023: Daniel Nytra - AI + e-shop + e-mailing
AI Restart 2023: Daniel Nytra - AI + e-shop + e-mailingAI Restart 2023: Daniel Nytra - AI + e-shop + e-mailing
AI Restart 2023: Daniel Nytra - AI + e-shop + e-mailingTaste
 
ChatGPT For Business Use
ChatGPT For Business UseChatGPT For Business Use
ChatGPT For Business UseSanjay Willie
 
Revolutionary-ChatGPT
Revolutionary-ChatGPTRevolutionary-ChatGPT
Revolutionary-ChatGPT9 series
 
ChatGPT Mastery and the chatGPT Handbook.pdf
ChatGPT Mastery and the chatGPT Handbook.pdfChatGPT Mastery and the chatGPT Handbook.pdf
ChatGPT Mastery and the chatGPT Handbook.pdfJirotgak Gotau
 
ChatGPT y la IA en la Biblioteca: desvelando prompts para una potencial E-vol...
ChatGPT y la IA en la Biblioteca: desvelando prompts para una potencial E-vol...ChatGPT y la IA en la Biblioteca: desvelando prompts para una potencial E-vol...
ChatGPT y la IA en la Biblioteca: desvelando prompts para una potencial E-vol...Fernando Gabriel Gutiérrez
 
Hegazi_ChatGPT_Book.pdf
Hegazi_ChatGPT_Book.pdfHegazi_ChatGPT_Book.pdf
Hegazi_ChatGPT_Book.pdfAmirHegazi1
 
Prompting is an art / Sztuka promptowania
Prompting is an art / Sztuka promptowaniaPrompting is an art / Sztuka promptowania
Prompting is an art / Sztuka promptowaniaMichal Jaskolski
 
How ChatGPT and AI-assisted coding changes software engineering profoundly
How ChatGPT and AI-assisted coding changes software engineering profoundlyHow ChatGPT and AI-assisted coding changes software engineering profoundly
How ChatGPT and AI-assisted coding changes software engineering profoundlyPekka Abrahamsson / Tampere University
 
arbar https://www.slideshare.net/Solutionman/charles-caldwell-improve-your-li...
arbar https://www.slideshare.net/Solutionman/charles-caldwell-improve-your-li...arbar https://www.slideshare.net/Solutionman/charles-caldwell-improve-your-li...
arbar https://www.slideshare.net/Solutionman/charles-caldwell-improve-your-li...SOLTUIONSpeople, THINKubators, THINKathons
 
AI Restart 2023: Petr Koubský - AI rychle a stručně
AI Restart 2023: Petr Koubský - AI rychle a stručněAI Restart 2023: Petr Koubský - AI rychle a stručně
AI Restart 2023: Petr Koubský - AI rychle a stručněTaste
 
Using Generative AI in the Classroom .pptx
Using Generative AI in the Classroom .pptxUsing Generative AI in the Classroom .pptx
Using Generative AI in the Classroom .pptxJonathanDietz3
 
200109-Open AI Chat GPT-4-3.pptx
200109-Open AI Chat GPT-4-3.pptx200109-Open AI Chat GPT-4-3.pptx
200109-Open AI Chat GPT-4-3.pptxandre241421
 
ChatGPT-Revolutionizing Communication.pdf
ChatGPT-Revolutionizing Communication.pdfChatGPT-Revolutionizing Communication.pdf
ChatGPT-Revolutionizing Communication.pdfRahul Ghorpade
 
ChatGPT and OpenAI.pdf
ChatGPT and OpenAI.pdfChatGPT and OpenAI.pdf
ChatGPT and OpenAI.pdfSonal Tiwari
 

What's hot (20)

Unlocking the Power of ChatGPT and AI in Testing - NextSteps, presented by Ap...
Unlocking the Power of ChatGPT and AI in Testing - NextSteps, presented by Ap...Unlocking the Power of ChatGPT and AI in Testing - NextSteps, presented by Ap...
Unlocking the Power of ChatGPT and AI in Testing - NextSteps, presented by Ap...
 
AI Restart 2023: Daniel Nytra - AI + e-shop + e-mailing
AI Restart 2023: Daniel Nytra - AI + e-shop + e-mailingAI Restart 2023: Daniel Nytra - AI + e-shop + e-mailing
AI Restart 2023: Daniel Nytra - AI + e-shop + e-mailing
 
ChatGPT For Business Use
ChatGPT For Business UseChatGPT For Business Use
ChatGPT For Business Use
 
Chat GPT
Chat GPTChat GPT
Chat GPT
 
CHATGPT.pptx
CHATGPT.pptxCHATGPT.pptx
CHATGPT.pptx
 
Revolutionary-ChatGPT
Revolutionary-ChatGPTRevolutionary-ChatGPT
Revolutionary-ChatGPT
 
ChatGPT Mastery and the chatGPT Handbook.pdf
ChatGPT Mastery and the chatGPT Handbook.pdfChatGPT Mastery and the chatGPT Handbook.pdf
ChatGPT Mastery and the chatGPT Handbook.pdf
 
ChatGPT y la IA en la Biblioteca: desvelando prompts para una potencial E-vol...
ChatGPT y la IA en la Biblioteca: desvelando prompts para una potencial E-vol...ChatGPT y la IA en la Biblioteca: desvelando prompts para una potencial E-vol...
ChatGPT y la IA en la Biblioteca: desvelando prompts para una potencial E-vol...
 
ChatGPT General Meeting
ChatGPT General MeetingChatGPT General Meeting
ChatGPT General Meeting
 
Hegazi_ChatGPT_Book.pdf
Hegazi_ChatGPT_Book.pdfHegazi_ChatGPT_Book.pdf
Hegazi_ChatGPT_Book.pdf
 
Prompting is an art / Sztuka promptowania
Prompting is an art / Sztuka promptowaniaPrompting is an art / Sztuka promptowania
Prompting is an art / Sztuka promptowania
 
How ChatGPT and AI-assisted coding changes software engineering profoundly
How ChatGPT and AI-assisted coding changes software engineering profoundlyHow ChatGPT and AI-assisted coding changes software engineering profoundly
How ChatGPT and AI-assisted coding changes software engineering profoundly
 
chat-GPT-Information.pdf
chat-GPT-Information.pdfchat-GPT-Information.pdf
chat-GPT-Information.pdf
 
arbar https://www.slideshare.net/Solutionman/charles-caldwell-improve-your-li...
arbar https://www.slideshare.net/Solutionman/charles-caldwell-improve-your-li...arbar https://www.slideshare.net/Solutionman/charles-caldwell-improve-your-li...
arbar https://www.slideshare.net/Solutionman/charles-caldwell-improve-your-li...
 
AI Restart 2023: Petr Koubský - AI rychle a stručně
AI Restart 2023: Petr Koubský - AI rychle a stručněAI Restart 2023: Petr Koubský - AI rychle a stručně
AI Restart 2023: Petr Koubský - AI rychle a stručně
 
Using Generative AI in the Classroom .pptx
Using Generative AI in the Classroom .pptxUsing Generative AI in the Classroom .pptx
Using Generative AI in the Classroom .pptx
 
200109-Open AI Chat GPT-4-3.pptx
200109-Open AI Chat GPT-4-3.pptx200109-Open AI Chat GPT-4-3.pptx
200109-Open AI Chat GPT-4-3.pptx
 
ChatGPT-Revolutionizing Communication.pdf
ChatGPT-Revolutionizing Communication.pdfChatGPT-Revolutionizing Communication.pdf
ChatGPT-Revolutionizing Communication.pdf
 
Chat Gpt
Chat GptChat Gpt
Chat Gpt
 
ChatGPT and OpenAI.pdf
ChatGPT and OpenAI.pdfChatGPT and OpenAI.pdf
ChatGPT and OpenAI.pdf
 

More from Ray Poynter

Sudden Death of Beliefs
Sudden Death of BeliefsSudden Death of Beliefs
Sudden Death of BeliefsRay Poynter
 
Uncovering Consumers’ Hidden Narratives
Uncovering Consumers’ Hidden NarrativesUncovering Consumers’ Hidden Narratives
Uncovering Consumers’ Hidden NarrativesRay Poynter
 
Narrative Exploration of New Categories at Mondelēz
Narrative Exploration of New Categories at MondelēzNarrative Exploration of New Categories at Mondelēz
Narrative Exploration of New Categories at MondelēzRay Poynter
 
The Future in Focus
The Future in FocusThe Future in Focus
The Future in FocusRay Poynter
 
The Future in Focus
The Future in FocusThe Future in Focus
The Future in FocusRay Poynter
 
The State of Insights – September 2023
The State of Insights – September 2023The State of Insights – September 2023
The State of Insights – September 2023Ray Poynter
 
Research Thinking in the age of AI
Research Thinking in the age of AIResearch Thinking in the age of AI
Research Thinking in the age of AIRay Poynter
 
How might AI impact Research and Insights over the next two years?
How might AI impact Research and Insights over the next two years?How might AI impact Research and Insights over the next two years?
How might AI impact Research and Insights over the next two years?Ray Poynter
 
From Words to Wisdom: Unleashing the Potential of Language Models for Human-C...
From Words to Wisdom: Unleashing the Potential of Language Models for Human-C...From Words to Wisdom: Unleashing the Potential of Language Models for Human-C...
From Words to Wisdom: Unleashing the Potential of Language Models for Human-C...Ray Poynter
 
ChatGPT for Social Media Listening: practical application with YouScan’s Insi...
ChatGPT for Social Media Listening: practical application with YouScan’s Insi...ChatGPT for Social Media Listening: practical application with YouScan’s Insi...
ChatGPT for Social Media Listening: practical application with YouScan’s Insi...Ray Poynter
 
Curious Humans: the lost key to impactful insights
Curious Humans: the lost key to impactful insightsCurious Humans: the lost key to impactful insights
Curious Humans: the lost key to impactful insightsRay Poynter
 
Research Thinking – Your career Superpower!
Research Thinking – Your career Superpower!Research Thinking – Your career Superpower!
Research Thinking – Your career Superpower!Ray Poynter
 
Insights & Market Research in 2027 – Scenario Thinking
Insights & Market Research in 2027 – Scenario ThinkingInsights & Market Research in 2027 – Scenario Thinking
Insights & Market Research in 2027 – Scenario ThinkingRay Poynter
 
Using Psychographic Techniques to Uncover the Hidden Personalities in Your Su...
Using Psychographic Techniques to Uncover the Hidden Personalities in Your Su...Using Psychographic Techniques to Uncover the Hidden Personalities in Your Su...
Using Psychographic Techniques to Uncover the Hidden Personalities in Your Su...Ray Poynter
 
Why Surveys Need To Become Conversational
Why Surveys Need To Become ConversationalWhy Surveys Need To Become Conversational
Why Surveys Need To Become ConversationalRay Poynter
 
How to Become an Irreplaceable Quant Researcher
How to Become an Irreplaceable Quant ResearcherHow to Become an Irreplaceable Quant Researcher
How to Become an Irreplaceable Quant ResearcherRay Poynter
 
NewMR Webinar - How to use AI to capture insights from social media data.pdf
NewMR Webinar - How to use AI to capture insights from social media data.pdfNewMR Webinar - How to use AI to capture insights from social media data.pdf
NewMR Webinar - How to use AI to capture insights from social media data.pdfRay Poynter
 
How to use Excel for Market Research and Insight - Part 1
How to use Excel for Market Research and Insight - Part 1How to use Excel for Market Research and Insight - Part 1
How to use Excel for Market Research and Insight - Part 1Ray Poynter
 
Automated Semiotic Analysis: Hero, Heretic or Helper?
Automated Semiotic Analysis: Hero, Heretic or Helper?Automated Semiotic Analysis: Hero, Heretic or Helper?
Automated Semiotic Analysis: Hero, Heretic or Helper?Ray Poynter
 
Hannah Rogers - Qual Research - NewMR 2022.pdf
Hannah Rogers - Qual Research - NewMR 2022.pdfHannah Rogers - Qual Research - NewMR 2022.pdf
Hannah Rogers - Qual Research - NewMR 2022.pdfRay Poynter
 

More from Ray Poynter (20)

Sudden Death of Beliefs
Sudden Death of BeliefsSudden Death of Beliefs
Sudden Death of Beliefs
 
Uncovering Consumers’ Hidden Narratives
Uncovering Consumers’ Hidden NarrativesUncovering Consumers’ Hidden Narratives
Uncovering Consumers’ Hidden Narratives
 
Narrative Exploration of New Categories at Mondelēz
Narrative Exploration of New Categories at MondelēzNarrative Exploration of New Categories at Mondelēz
Narrative Exploration of New Categories at Mondelēz
 
The Future in Focus
The Future in FocusThe Future in Focus
The Future in Focus
 
The Future in Focus
The Future in FocusThe Future in Focus
The Future in Focus
 
The State of Insights – September 2023
The State of Insights – September 2023The State of Insights – September 2023
The State of Insights – September 2023
 
Research Thinking in the age of AI
Research Thinking in the age of AIResearch Thinking in the age of AI
Research Thinking in the age of AI
 
How might AI impact Research and Insights over the next two years?
How might AI impact Research and Insights over the next two years?How might AI impact Research and Insights over the next two years?
How might AI impact Research and Insights over the next two years?
 
From Words to Wisdom: Unleashing the Potential of Language Models for Human-C...
From Words to Wisdom: Unleashing the Potential of Language Models for Human-C...From Words to Wisdom: Unleashing the Potential of Language Models for Human-C...
From Words to Wisdom: Unleashing the Potential of Language Models for Human-C...
 
ChatGPT for Social Media Listening: practical application with YouScan’s Insi...
ChatGPT for Social Media Listening: practical application with YouScan’s Insi...ChatGPT for Social Media Listening: practical application with YouScan’s Insi...
ChatGPT for Social Media Listening: practical application with YouScan’s Insi...
 
Curious Humans: the lost key to impactful insights
Curious Humans: the lost key to impactful insightsCurious Humans: the lost key to impactful insights
Curious Humans: the lost key to impactful insights
 
Research Thinking – Your career Superpower!
Research Thinking – Your career Superpower!Research Thinking – Your career Superpower!
Research Thinking – Your career Superpower!
 
Insights & Market Research in 2027 – Scenario Thinking
Insights & Market Research in 2027 – Scenario ThinkingInsights & Market Research in 2027 – Scenario Thinking
Insights & Market Research in 2027 – Scenario Thinking
 
Using Psychographic Techniques to Uncover the Hidden Personalities in Your Su...
Using Psychographic Techniques to Uncover the Hidden Personalities in Your Su...Using Psychographic Techniques to Uncover the Hidden Personalities in Your Su...
Using Psychographic Techniques to Uncover the Hidden Personalities in Your Su...
 
Why Surveys Need To Become Conversational
Why Surveys Need To Become ConversationalWhy Surveys Need To Become Conversational
Why Surveys Need To Become Conversational
 
How to Become an Irreplaceable Quant Researcher
How to Become an Irreplaceable Quant ResearcherHow to Become an Irreplaceable Quant Researcher
How to Become an Irreplaceable Quant Researcher
 
NewMR Webinar - How to use AI to capture insights from social media data.pdf
NewMR Webinar - How to use AI to capture insights from social media data.pdfNewMR Webinar - How to use AI to capture insights from social media data.pdf
NewMR Webinar - How to use AI to capture insights from social media data.pdf
 
How to use Excel for Market Research and Insight - Part 1
How to use Excel for Market Research and Insight - Part 1How to use Excel for Market Research and Insight - Part 1
How to use Excel for Market Research and Insight - Part 1
 
Automated Semiotic Analysis: Hero, Heretic or Helper?
Automated Semiotic Analysis: Hero, Heretic or Helper?Automated Semiotic Analysis: Hero, Heretic or Helper?
Automated Semiotic Analysis: Hero, Heretic or Helper?
 
Hannah Rogers - Qual Research - NewMR 2022.pdf
Hannah Rogers - Qual Research - NewMR 2022.pdfHannah Rogers - Qual Research - NewMR 2022.pdf
Hannah Rogers - Qual Research - NewMR 2022.pdf
 

Recently uploaded

2.15.24 Making Whiteness -- Baldwin.pptx
2.15.24 Making Whiteness -- Baldwin.pptx2.15.24 Making Whiteness -- Baldwin.pptx
2.15.24 Making Whiteness -- Baldwin.pptxMaryPotorti1
 
Overview of Databases and Data Modelling-2.pdf
Overview of Databases and Data Modelling-2.pdfOverview of Databases and Data Modelling-2.pdf
Overview of Databases and Data Modelling-2.pdfChristalin Nelson
 
catch-up-friday-ARALING PNLIPUNAN SOCIAL JUSTICE AND HUMAN RIGHTS
catch-up-friday-ARALING PNLIPUNAN SOCIAL JUSTICE AND HUMAN RIGHTScatch-up-friday-ARALING PNLIPUNAN SOCIAL JUSTICE AND HUMAN RIGHTS
catch-up-friday-ARALING PNLIPUNAN SOCIAL JUSTICE AND HUMAN RIGHTSCarlaNicolas7
 
Shapley Tech Talk - SHAP and Shapley Discussion
Shapley Tech Talk - SHAP and Shapley DiscussionShapley Tech Talk - SHAP and Shapley Discussion
Shapley Tech Talk - SHAP and Shapley DiscussionTushar Tank
 
LIPIDS UNIT ONE BIOMOLECULE PRESENTATION
LIPIDS UNIT ONE BIOMOLECULE PRESENTATIONLIPIDS UNIT ONE BIOMOLECULE PRESENTATION
LIPIDS UNIT ONE BIOMOLECULE PRESENTATIONSayali Powar
 
ICSE English Literature Class X Handwritten Notes
ICSE English Literature Class X Handwritten NotesICSE English Literature Class X Handwritten Notes
ICSE English Literature Class X Handwritten NotesGauri S
 
Data Modeling - Entity Relationship Diagrams-1.pdf
Data Modeling - Entity Relationship Diagrams-1.pdfData Modeling - Entity Relationship Diagrams-1.pdf
Data Modeling - Entity Relationship Diagrams-1.pdfChristalin Nelson
 
50 ĐỀ THI THỬ TỐT NGHIỆP THPT TIẾNG ANH 2024 CÓ GIẢI CHI TIẾT - GIỚI HẠN KHO...
50 ĐỀ THI THỬ TỐT NGHIỆP THPT TIẾNG ANH 2024 CÓ GIẢI CHI TIẾT - GIỚI HẠN KHO...50 ĐỀ THI THỬ TỐT NGHIỆP THPT TIẾNG ANH 2024 CÓ GIẢI CHI TIẾT - GIỚI HẠN KHO...
50 ĐỀ THI THỬ TỐT NGHIỆP THPT TIẾNG ANH 2024 CÓ GIẢI CHI TIẾT - GIỚI HẠN KHO...Nguyen Thanh Tu Collection
 
Evaluation and management of patients with Dyspepsia.pptx
Evaluation and management of patients with Dyspepsia.pptxEvaluation and management of patients with Dyspepsia.pptx
Evaluation and management of patients with Dyspepsia.pptxgarvitnanecha
 
Intuition behind Monte Carlo Markov Chains
Intuition behind Monte Carlo Markov ChainsIntuition behind Monte Carlo Markov Chains
Intuition behind Monte Carlo Markov ChainsTushar Tank
 
mean stack mean stack mean stack mean stack
mean stack mean stack  mean stack  mean stackmean stack mean stack  mean stack  mean stack
mean stack mean stack mean stack mean stackNuttavutThongjor1
 
2.22.24 Black Nationalism and the Nation of Islam.pptx
2.22.24 Black Nationalism and the Nation of Islam.pptx2.22.24 Black Nationalism and the Nation of Islam.pptx
2.22.24 Black Nationalism and the Nation of Islam.pptxMaryPotorti1
 
CapTechTalks Webinar Feb 2024 Darrell Burrell.pptx
CapTechTalks Webinar Feb 2024 Darrell Burrell.pptxCapTechTalks Webinar Feb 2024 Darrell Burrell.pptx
CapTechTalks Webinar Feb 2024 Darrell Burrell.pptxCapitolTechU
 
Introduction of General Pharmacology PPT.pptx
Introduction of General Pharmacology PPT.pptxIntroduction of General Pharmacology PPT.pptx
Introduction of General Pharmacology PPT.pptxRenuka N Sunagad
 
EDL 290F Week 1 - Meet Me at the Start Line.pdf
EDL 290F Week 1 - Meet Me at the Start Line.pdfEDL 290F Week 1 - Meet Me at the Start Line.pdf
EDL 290F Week 1 - Meet Me at the Start Line.pdfElizabeth Walsh
 
UniSC Moreton Bay Library self-guided tour
UniSC Moreton Bay Library self-guided tourUniSC Moreton Bay Library self-guided tour
UniSC Moreton Bay Library self-guided tourUSC_Library
 
IR introduction Introduction, Principle & Theory
IR introduction Introduction, Principle & TheoryIR introduction Introduction, Principle & Theory
IR introduction Introduction, Principle & Theorynivedithag131
 

Recently uploaded (20)

2.15.24 Making Whiteness -- Baldwin.pptx
2.15.24 Making Whiteness -- Baldwin.pptx2.15.24 Making Whiteness -- Baldwin.pptx
2.15.24 Making Whiteness -- Baldwin.pptx
 
Overview of Databases and Data Modelling-2.pdf
Overview of Databases and Data Modelling-2.pdfOverview of Databases and Data Modelling-2.pdf
Overview of Databases and Data Modelling-2.pdf
 
catch-up-friday-ARALING PNLIPUNAN SOCIAL JUSTICE AND HUMAN RIGHTS
catch-up-friday-ARALING PNLIPUNAN SOCIAL JUSTICE AND HUMAN RIGHTScatch-up-friday-ARALING PNLIPUNAN SOCIAL JUSTICE AND HUMAN RIGHTS
catch-up-friday-ARALING PNLIPUNAN SOCIAL JUSTICE AND HUMAN RIGHTS
 
Shapley Tech Talk - SHAP and Shapley Discussion
Shapley Tech Talk - SHAP and Shapley DiscussionShapley Tech Talk - SHAP and Shapley Discussion
Shapley Tech Talk - SHAP and Shapley Discussion
 
LIPIDS UNIT ONE BIOMOLECULE PRESENTATION
LIPIDS UNIT ONE BIOMOLECULE PRESENTATIONLIPIDS UNIT ONE BIOMOLECULE PRESENTATION
LIPIDS UNIT ONE BIOMOLECULE PRESENTATION
 
first section physiology laboratory.pptx
first section physiology laboratory.pptxfirst section physiology laboratory.pptx
first section physiology laboratory.pptx
 
ICSE English Literature Class X Handwritten Notes
ICSE English Literature Class X Handwritten NotesICSE English Literature Class X Handwritten Notes
ICSE English Literature Class X Handwritten Notes
 
Data Modeling - Entity Relationship Diagrams-1.pdf
Data Modeling - Entity Relationship Diagrams-1.pdfData Modeling - Entity Relationship Diagrams-1.pdf
Data Modeling - Entity Relationship Diagrams-1.pdf
 
50 ĐỀ THI THỬ TỐT NGHIỆP THPT TIẾNG ANH 2024 CÓ GIẢI CHI TIẾT - GIỚI HẠN KHO...
50 ĐỀ THI THỬ TỐT NGHIỆP THPT TIẾNG ANH 2024 CÓ GIẢI CHI TIẾT - GIỚI HẠN KHO...50 ĐỀ THI THỬ TỐT NGHIỆP THPT TIẾNG ANH 2024 CÓ GIẢI CHI TIẾT - GIỚI HẠN KHO...
50 ĐỀ THI THỬ TỐT NGHIỆP THPT TIẾNG ANH 2024 CÓ GIẢI CHI TIẾT - GIỚI HẠN KHO...
 
Capter 5 Climate of Ethiopia and the Horn GeES 1011.pdf
Capter 5 Climate of Ethiopia and the Horn GeES 1011.pdfCapter 5 Climate of Ethiopia and the Horn GeES 1011.pdf
Capter 5 Climate of Ethiopia and the Horn GeES 1011.pdf
 
Evaluation and management of patients with Dyspepsia.pptx
Evaluation and management of patients with Dyspepsia.pptxEvaluation and management of patients with Dyspepsia.pptx
Evaluation and management of patients with Dyspepsia.pptx
 
Intuition behind Monte Carlo Markov Chains
Intuition behind Monte Carlo Markov ChainsIntuition behind Monte Carlo Markov Chains
Intuition behind Monte Carlo Markov Chains
 
mean stack mean stack mean stack mean stack
mean stack mean stack  mean stack  mean stackmean stack mean stack  mean stack  mean stack
mean stack mean stack mean stack mean stack
 
Lipids as Biopolymer
Lipids as Biopolymer Lipids as Biopolymer
Lipids as Biopolymer
 
2.22.24 Black Nationalism and the Nation of Islam.pptx
2.22.24 Black Nationalism and the Nation of Islam.pptx2.22.24 Black Nationalism and the Nation of Islam.pptx
2.22.24 Black Nationalism and the Nation of Islam.pptx
 
CapTechTalks Webinar Feb 2024 Darrell Burrell.pptx
CapTechTalks Webinar Feb 2024 Darrell Burrell.pptxCapTechTalks Webinar Feb 2024 Darrell Burrell.pptx
CapTechTalks Webinar Feb 2024 Darrell Burrell.pptx
 
Introduction of General Pharmacology PPT.pptx
Introduction of General Pharmacology PPT.pptxIntroduction of General Pharmacology PPT.pptx
Introduction of General Pharmacology PPT.pptx
 
EDL 290F Week 1 - Meet Me at the Start Line.pdf
EDL 290F Week 1 - Meet Me at the Start Line.pdfEDL 290F Week 1 - Meet Me at the Start Line.pdf
EDL 290F Week 1 - Meet Me at the Start Line.pdf
 
UniSC Moreton Bay Library self-guided tour
UniSC Moreton Bay Library self-guided tourUniSC Moreton Bay Library self-guided tour
UniSC Moreton Bay Library self-guided tour
 
IR introduction Introduction, Principle & Theory
IR introduction Introduction, Principle & TheoryIR introduction Introduction, Principle & Theory
IR introduction Introduction, Principle & Theory
 

Exploring the future of verbatim coding with ChatGPT

  • 1. Exploring the future of verbatim coding with ChatGPT NewMR Webinar June 2023 Tim Brandwood & Damien Gouriet Digital Taxonomy
  • 2. Founded in 2016 Verbatim Coding Software Efficiency through cutting-edge tech WHO WE ARE….
  • 3. THE PURPOSE OF CODING Open-ended Comments I like the orange taste, but it’s too sweet The sweetness is a bit much I think the orange colour is too pale and artificial looking I don’t like the bits of orange in it I don’t like the idea of artificial sweeteners Analysable Quantitative Measures Taste (871) 87% Too Sweet (632) 63% Tastes Artificial (421) 42% Doesn’t taste like real orange (237) 24% Appearance (423) 42% Colour – too light/pale (302) 30% Colour – too artificial looking (150) 15% Colour – too dark (100) 10% Colour – other comments (40) 4% Ingredients (408) 41% Artificial Sweeteners (300) 30% Real Orange (150) 15% Orange bits (50) 5% Packaging (387) 39% Bottle too big (223) 22% Difficult to hold (150) 15% Label hard to read (87) 8% Dislike bottle shape (60) 6% Requires: Accuracy and Precision
  • 4. Extracting Themes Complete Coding: Generates rich, human-like themes Performs extremely well: CAN CHATGPT DO CODING THEN? Quantifying Themes “Chat” interactivity allows you to ask follow-up questions, and dig deeper Complete Coding: Incomplete coverage Struggles to accurately and precisely quantify themes. Issues include: Miscoding Repeatability 20% verbatims coded 80% accuracy
  • 5. PEOPLE STILL NEED TO BE INVOLVED IN THE PROCESS Go further, quicker …but you still need to pedal! ChatGPT is an electric bike for your mind. -Richard Bowman (https://prompt.mba)
  • 10. CUSTOM MACHINE LEARNING Autocoding Accuracy ChatGPT 20% 80% Custom ML Model 60% 90% Still has a role to play in the coding Use Case
  • 11. GPT4, Claude, Bard etc… Interactivity Fine-Tuning LLMs FUTURE DEVELOPMENTS 4
  • 12. ChatGPT is a big step forward – but only truly useful for coding up to a point Human oversight and quality tools needed Custom ML models outperform ChatGPT CONCLUSION Together these developments point towards better, more enriched research
  • 13. Q & A Ray Poynter NewMR Tim Brandwood Digital Taxonomy Damien Gouriet Digital Taxonomy