CAQDAS 2014 Pecha Kucha - Stuart Shulman

Stuart Shulman
Stuart ShulmanCEO at Texifter
What have CAT & DiscoverText done
for qualitative methodology?
Stuart Shulman, Texifter
2014 Conference: Past, Present and Future
25 years of CAQDAS
Stuart Shulman – Texifter
Pronounced “Tech-Sifter”
Stuart Shulman – Texifter
Circa 1999
Stuart Shulman – Texifter
May 2001
Council for Excellence in Government
June 2002
National Defense University
Computer Science & NSF Influences:
Measure Everything!
Stuart Shulman – Texifter
How fast?
How reliable?
How accurate?
Stuart Shulman – Texifter
Stuart Shulman – Texifter
Stuart Shulman – Texifter
Inter-Rater Reliability is Key
Understanding the landscape of human interpretation better
prepares us to face the challenge of machine classification
Stuart Shulman – Texifter
Adjudicate Boundary Cases
Stuart Shulman – Texifter
“CoderRank for Enhanced
Machine Learning” is Patent Pending
Stuart Shulman – Texifter
Stuart Shulman – Texifter
Stuart Shulman – Texifter
Labeling, Tagging, or Annotation
Improves Machine Learning Over Time
Stuart Shulman – Texifter
Iterate Human Coding & Machine-Learning
Stuart Shulman – Texifter
Word Sense Disambiguation (Relevance)
Stuart Shulman – Texifter
Stuart Shulman – Texifter
Stuart Shulman – Texifter
Naturally Occurring Clusters of Free Text
Can Be Discovered Automatically
Stuart Shulman – Texifter
Purist
A Spectrum of Methods Approaches
deep immersion
closeness to data
antipathy to numbers
credible interpretation
in-depth analysis
contextual
subjective
experimental
mixed method
adaptive hybrid
flexible approach
interdisciplinary quantitative
focus on error
measurement critical
validity and reliability
replication & objectivity
generalization
hypotheses
PositivistPluralist
• Free and open source software options
• Web-based (crowd source) collaborative tools
• Measurement innovation
• Free and premium social data collection
• Random sampling and keystroke coding
• Advanced search and filtering
• Deduplication and clustering algorithms
• Custom machine learning classifiers
• Word sense disambiguation
• CoderRank for enhanced machine learning
Stuart Shulman – Texifter
What have CAT & DiscoverText done
for qualitative methodology?
Stuart Shulman – Texifter
Dr. Stuart W. Shulman
Founder & CEO, Texifter, LLC
Research Associate Professor, UMass Amherst
Director, Qualitative Data Analysis Program (QDAP)
Editor Emeritus, Journal of Information Technology & Politics
Contact Information
stu@texifter.com
http://people.umass.edu/stu/
@stuartwshulman
Thanks for Listening!
1 of 21

Recommended

Fairtrade quiz by
Fairtrade quizFairtrade quiz
Fairtrade quizAoife Nic An Bhaird
222 views6 slides
Swparkmission2011 101215110635-phpapp01, by
Swparkmission2011 101215110635-phpapp01,Swparkmission2011 101215110635-phpapp01,
Swparkmission2011 101215110635-phpapp01,Satita Kanongdech
359 views37 slides
Double page Process by
Double page ProcessDouble page Process
Double page Processcourtneyhughes
174 views8 slides
My lx business_executive_program_v4 by
My lx business_executive_program_v4My lx business_executive_program_v4
My lx business_executive_program_v4alayonruth
190 views9 slides
Narciso.it il bello degli uomini by
Narciso.it il bello degli uominiNarciso.it il bello degli uomini
Narciso.it il bello degli uominiciorci
247 views8 slides
And credit by
And creditAnd credit
And creditLarry Vermont
212 views4 slides

More Related Content

Viewers also liked

Vacunasoptimas by
VacunasoptimasVacunasoptimas
VacunasoptimasAlejandro Cisneros Solano
247 views9 slides
A camel-story by
A camel-storyA camel-story
A camel-storyFaisal Nazir
204 views8 slides
Scan textos tp 1 by
Scan textos tp 1Scan textos tp 1
Scan textos tp 1Gustavo Gabriel Salina
341 views13 slides
How to treat_herpes by
How to treat_herpesHow to treat_herpes
How to treat_herpesDaddy DeVinney
295 views23 slides
CodersTrust key note presentation by
CodersTrust key note presentationCodersTrust key note presentation
CodersTrust key note presentationFerdinand Kjærulff
914 views14 slides
將知識轉化為 Cash by
將知識轉化為 Cash將知識轉化為 Cash
將知識轉化為 Cashshiehrm
255 views7 slides

More from Stuart Shulman

Fear and loathing on the social campaign trail by
Fear and loathing on the social campaign trailFear and loathing on the social campaign trail
Fear and loathing on the social campaign trailStuart Shulman
476 views88 slides
Fear and Loathing on the Social Campaign Trail by
Fear and Loathing on the Social Campaign TrailFear and Loathing on the Social Campaign Trail
Fear and Loathing on the Social Campaign TrailStuart Shulman
128 views88 slides
Text Analytics: From Colored Pens and Crumbly Papers to Custom Machine Classi... by
Text Analytics: From Colored Pens and Crumbly Papers to Custom Machine Classi...Text Analytics: From Colored Pens and Crumbly Papers to Custom Machine Classi...
Text Analytics: From Colored Pens and Crumbly Papers to Custom Machine Classi...Stuart Shulman
170 views80 slides
Texifter Presentation at Boston New Technology’s #BNT77 Startup Showcase! by
Texifter Presentation at Boston New Technology’s #BNT77 Startup Showcase!Texifter Presentation at Boston New Technology’s #BNT77 Startup Showcase!
Texifter Presentation at Boston New Technology’s #BNT77 Startup Showcase!Stuart Shulman
217 views13 slides
CoderRank: Creating Gold Standards by
CoderRank: Creating Gold StandardsCoderRank: Creating Gold Standards
CoderRank: Creating Gold StandardsStuart Shulman
245 views22 slides
Text Analytics for Social Data Using DiscoverText & Sifter by
 Text Analytics for Social Data Using DiscoverText & Sifter Text Analytics for Social Data Using DiscoverText & Sifter
Text Analytics for Social Data Using DiscoverText & SifterStuart Shulman
809 views60 slides

More from Stuart Shulman(17)

Fear and loathing on the social campaign trail by Stuart Shulman
Fear and loathing on the social campaign trailFear and loathing on the social campaign trail
Fear and loathing on the social campaign trail
Stuart Shulman476 views
Fear and Loathing on the Social Campaign Trail by Stuart Shulman
Fear and Loathing on the Social Campaign TrailFear and Loathing on the Social Campaign Trail
Fear and Loathing on the Social Campaign Trail
Stuart Shulman128 views
Text Analytics: From Colored Pens and Crumbly Papers to Custom Machine Classi... by Stuart Shulman
Text Analytics: From Colored Pens and Crumbly Papers to Custom Machine Classi...Text Analytics: From Colored Pens and Crumbly Papers to Custom Machine Classi...
Text Analytics: From Colored Pens and Crumbly Papers to Custom Machine Classi...
Stuart Shulman170 views
Texifter Presentation at Boston New Technology’s #BNT77 Startup Showcase! by Stuart Shulman
Texifter Presentation at Boston New Technology’s #BNT77 Startup Showcase!Texifter Presentation at Boston New Technology’s #BNT77 Startup Showcase!
Texifter Presentation at Boston New Technology’s #BNT77 Startup Showcase!
Stuart Shulman217 views
CoderRank: Creating Gold Standards by Stuart Shulman
CoderRank: Creating Gold StandardsCoderRank: Creating Gold Standards
CoderRank: Creating Gold Standards
Stuart Shulman245 views
Text Analytics for Social Data Using DiscoverText & Sifter by Stuart Shulman
 Text Analytics for Social Data Using DiscoverText & Sifter Text Analytics for Social Data Using DiscoverText & Sifter
Text Analytics for Social Data Using DiscoverText & Sifter
Stuart Shulman809 views
Text Analytics for Social Data Using DiscoverText & Sifter by Stuart Shulman
Text Analytics for Social Data Using DiscoverText & SifterText Analytics for Social Data Using DiscoverText & Sifter
Text Analytics for Social Data Using DiscoverText & Sifter
Stuart Shulman336 views
Sifting Social Data: Word Sense Disambiguation Using Machine Learning by Stuart Shulman
Sifting Social Data: Word Sense Disambiguation Using Machine LearningSifting Social Data: Word Sense Disambiguation Using Machine Learning
Sifting Social Data: Word Sense Disambiguation Using Machine Learning
Stuart Shulman1.5K views
Measuring reliability and validity in human coding and machine classification by Stuart Shulman
Measuring reliability and validity in human coding and machine classificationMeasuring reliability and validity in human coding and machine classification
Measuring reliability and validity in human coding and machine classification
Stuart Shulman844 views
Technology for Citizen Voices by Stuart Shulman
Technology for Citizen VoicesTechnology for Citizen Voices
Technology for Citizen Voices
Stuart Shulman591 views
DiscoverText: Tools for Text by Stuart Shulman
DiscoverText: Tools for TextDiscoverText: Tools for Text
DiscoverText: Tools for Text
Stuart Shulman1.6K views
Citizen Voices in a Networked Age of #BigData by Stuart Shulman
Citizen Voices in a Networked Age of #BigDataCitizen Voices in a Networked Age of #BigData
Citizen Voices in a Networked Age of #BigData
Stuart Shulman916 views
DiscoverText Product Overview by Stuart Shulman
DiscoverText Product OverviewDiscoverText Product Overview
DiscoverText Product Overview
Stuart Shulman399 views
Importing bulk outlook email into DiscoverText - the .pst file upload by Stuart Shulman
Importing bulk outlook email into DiscoverText - the .pst file uploadImporting bulk outlook email into DiscoverText - the .pst file upload
Importing bulk outlook email into DiscoverText - the .pst file upload
Stuart Shulman377 views
Future of text analysis forrester briefing by Stuart Shulman
Future of text analysis   forrester briefingFuture of text analysis   forrester briefing
Future of text analysis forrester briefing
Stuart Shulman459 views

Recently uploaded

TrustArc Webinar - Managing Online Tracking Technology Vendors_ A Checklist f... by
TrustArc Webinar - Managing Online Tracking Technology Vendors_ A Checklist f...TrustArc Webinar - Managing Online Tracking Technology Vendors_ A Checklist f...
TrustArc Webinar - Managing Online Tracking Technology Vendors_ A Checklist f...TrustArc
77 views29 slides
Hypervisor Agnostic DRS in CloudStack - Brief overview & demo - Vishesh Jinda... by
Hypervisor Agnostic DRS in CloudStack - Brief overview & demo - Vishesh Jinda...Hypervisor Agnostic DRS in CloudStack - Brief overview & demo - Vishesh Jinda...
Hypervisor Agnostic DRS in CloudStack - Brief overview & demo - Vishesh Jinda...ShapeBlue
63 views13 slides
Why and How CloudStack at weSystems - Stephan Bienek - weSystems by
Why and How CloudStack at weSystems - Stephan Bienek - weSystemsWhy and How CloudStack at weSystems - Stephan Bienek - weSystems
Why and How CloudStack at weSystems - Stephan Bienek - weSystemsShapeBlue
111 views13 slides
Mitigating Common CloudStack Instance Deployment Failures - Jithin Raju - Sha... by
Mitigating Common CloudStack Instance Deployment Failures - Jithin Raju - Sha...Mitigating Common CloudStack Instance Deployment Failures - Jithin Raju - Sha...
Mitigating Common CloudStack Instance Deployment Failures - Jithin Raju - Sha...ShapeBlue
74 views18 slides
20231123_Camunda Meetup Vienna.pdf by
20231123_Camunda Meetup Vienna.pdf20231123_Camunda Meetup Vienna.pdf
20231123_Camunda Meetup Vienna.pdfPhactum Softwareentwicklung GmbH
46 views73 slides
Transitioning from VMware vCloud to Apache CloudStack: A Path to Profitabilit... by
Transitioning from VMware vCloud to Apache CloudStack: A Path to Profitabilit...Transitioning from VMware vCloud to Apache CloudStack: A Path to Profitabilit...
Transitioning from VMware vCloud to Apache CloudStack: A Path to Profitabilit...ShapeBlue
57 views25 slides

Recently uploaded(20)

TrustArc Webinar - Managing Online Tracking Technology Vendors_ A Checklist f... by TrustArc
TrustArc Webinar - Managing Online Tracking Technology Vendors_ A Checklist f...TrustArc Webinar - Managing Online Tracking Technology Vendors_ A Checklist f...
TrustArc Webinar - Managing Online Tracking Technology Vendors_ A Checklist f...
TrustArc77 views
Hypervisor Agnostic DRS in CloudStack - Brief overview & demo - Vishesh Jinda... by ShapeBlue
Hypervisor Agnostic DRS in CloudStack - Brief overview & demo - Vishesh Jinda...Hypervisor Agnostic DRS in CloudStack - Brief overview & demo - Vishesh Jinda...
Hypervisor Agnostic DRS in CloudStack - Brief overview & demo - Vishesh Jinda...
ShapeBlue63 views
Why and How CloudStack at weSystems - Stephan Bienek - weSystems by ShapeBlue
Why and How CloudStack at weSystems - Stephan Bienek - weSystemsWhy and How CloudStack at weSystems - Stephan Bienek - weSystems
Why and How CloudStack at weSystems - Stephan Bienek - weSystems
ShapeBlue111 views
Mitigating Common CloudStack Instance Deployment Failures - Jithin Raju - Sha... by ShapeBlue
Mitigating Common CloudStack Instance Deployment Failures - Jithin Raju - Sha...Mitigating Common CloudStack Instance Deployment Failures - Jithin Raju - Sha...
Mitigating Common CloudStack Instance Deployment Failures - Jithin Raju - Sha...
ShapeBlue74 views
Transitioning from VMware vCloud to Apache CloudStack: A Path to Profitabilit... by ShapeBlue
Transitioning from VMware vCloud to Apache CloudStack: A Path to Profitabilit...Transitioning from VMware vCloud to Apache CloudStack: A Path to Profitabilit...
Transitioning from VMware vCloud to Apache CloudStack: A Path to Profitabilit...
ShapeBlue57 views
Data Integrity for Banking and Financial Services by Precisely
Data Integrity for Banking and Financial ServicesData Integrity for Banking and Financial Services
Data Integrity for Banking and Financial Services
Precisely56 views
Setting Up Your First CloudStack Environment with Beginners Challenges - MD R... by ShapeBlue
Setting Up Your First CloudStack Environment with Beginners Challenges - MD R...Setting Up Your First CloudStack Environment with Beginners Challenges - MD R...
Setting Up Your First CloudStack Environment with Beginners Challenges - MD R...
ShapeBlue54 views
PharoJS - Zürich Smalltalk Group Meetup November 2023 by Noury Bouraqadi
PharoJS - Zürich Smalltalk Group Meetup November 2023PharoJS - Zürich Smalltalk Group Meetup November 2023
PharoJS - Zürich Smalltalk Group Meetup November 2023
Noury Bouraqadi141 views
ESPC 2023 - Protect and Govern your Sensitive Data with Microsoft Purview in ... by Jasper Oosterveld
ESPC 2023 - Protect and Govern your Sensitive Data with Microsoft Purview in ...ESPC 2023 - Protect and Govern your Sensitive Data with Microsoft Purview in ...
ESPC 2023 - Protect and Govern your Sensitive Data with Microsoft Purview in ...
Elevating Privacy and Security in CloudStack - Boris Stoyanov - ShapeBlue by ShapeBlue
Elevating Privacy and Security in CloudStack - Boris Stoyanov - ShapeBlueElevating Privacy and Security in CloudStack - Boris Stoyanov - ShapeBlue
Elevating Privacy and Security in CloudStack - Boris Stoyanov - ShapeBlue
ShapeBlue96 views
Backroll, News and Demo - Pierre Charton, Matthias Dhellin, Ousmane Diarra - ... by ShapeBlue
Backroll, News and Demo - Pierre Charton, Matthias Dhellin, Ousmane Diarra - ...Backroll, News and Demo - Pierre Charton, Matthias Dhellin, Ousmane Diarra - ...
Backroll, News and Demo - Pierre Charton, Matthias Dhellin, Ousmane Diarra - ...
ShapeBlue83 views
State of the Union - Rohit Yadav - Apache CloudStack by ShapeBlue
State of the Union - Rohit Yadav - Apache CloudStackState of the Union - Rohit Yadav - Apache CloudStack
State of the Union - Rohit Yadav - Apache CloudStack
ShapeBlue145 views
DRBD Deep Dive - Philipp Reisner - LINBIT by ShapeBlue
DRBD Deep Dive - Philipp Reisner - LINBITDRBD Deep Dive - Philipp Reisner - LINBIT
DRBD Deep Dive - Philipp Reisner - LINBIT
ShapeBlue62 views
Don’t Make A Human Do A Robot’s Job! : 6 Reasons Why AI Will Save Us & Not De... by Moses Kemibaro
Don’t Make A Human Do A Robot’s Job! : 6 Reasons Why AI Will Save Us & Not De...Don’t Make A Human Do A Robot’s Job! : 6 Reasons Why AI Will Save Us & Not De...
Don’t Make A Human Do A Robot’s Job! : 6 Reasons Why AI Will Save Us & Not De...
Moses Kemibaro29 views
GDG Cloud Southlake 28 Brad Taylor and Shawn Augenstein Old Problems in the N... by James Anderson
GDG Cloud Southlake 28 Brad Taylor and Shawn Augenstein Old Problems in the N...GDG Cloud Southlake 28 Brad Taylor and Shawn Augenstein Old Problems in the N...
GDG Cloud Southlake 28 Brad Taylor and Shawn Augenstein Old Problems in the N...
James Anderson133 views
Business Analyst Series 2023 - Week 3 Session 5 by DianaGray10
Business Analyst Series 2023 -  Week 3 Session 5Business Analyst Series 2023 -  Week 3 Session 5
Business Analyst Series 2023 - Week 3 Session 5
DianaGray10369 views
Automating a World-Class Technology Conference; Behind the Scenes of CiscoLive by Network Automation Forum
Automating a World-Class Technology Conference; Behind the Scenes of CiscoLiveAutomating a World-Class Technology Conference; Behind the Scenes of CiscoLive
Automating a World-Class Technology Conference; Behind the Scenes of CiscoLive

CAQDAS 2014 Pecha Kucha - Stuart Shulman

  • 1. What have CAT & DiscoverText done for qualitative methodology? Stuart Shulman, Texifter 2014 Conference: Past, Present and Future 25 years of CAQDAS
  • 2. Stuart Shulman – Texifter Pronounced “Tech-Sifter”
  • 3. Stuart Shulman – Texifter Circa 1999
  • 4. Stuart Shulman – Texifter May 2001 Council for Excellence in Government June 2002 National Defense University
  • 5. Computer Science & NSF Influences: Measure Everything! Stuart Shulman – Texifter How fast? How reliable? How accurate?
  • 8. Stuart Shulman – Texifter Inter-Rater Reliability is Key Understanding the landscape of human interpretation better prepares us to face the challenge of machine classification
  • 9. Stuart Shulman – Texifter Adjudicate Boundary Cases
  • 10. Stuart Shulman – Texifter “CoderRank for Enhanced Machine Learning” is Patent Pending
  • 11. Stuart Shulman – Texifter
  • 12. Stuart Shulman – Texifter
  • 13. Stuart Shulman – Texifter Labeling, Tagging, or Annotation Improves Machine Learning Over Time
  • 14. Stuart Shulman – Texifter Iterate Human Coding & Machine-Learning
  • 15. Stuart Shulman – Texifter Word Sense Disambiguation (Relevance)
  • 16. Stuart Shulman – Texifter
  • 17. Stuart Shulman – Texifter
  • 18. Stuart Shulman – Texifter Naturally Occurring Clusters of Free Text Can Be Discovered Automatically
  • 19. Stuart Shulman – Texifter Purist A Spectrum of Methods Approaches deep immersion closeness to data antipathy to numbers credible interpretation in-depth analysis contextual subjective experimental mixed method adaptive hybrid flexible approach interdisciplinary quantitative focus on error measurement critical validity and reliability replication & objectivity generalization hypotheses PositivistPluralist
  • 20. • Free and open source software options • Web-based (crowd source) collaborative tools • Measurement innovation • Free and premium social data collection • Random sampling and keystroke coding • Advanced search and filtering • Deduplication and clustering algorithms • Custom machine learning classifiers • Word sense disambiguation • CoderRank for enhanced machine learning Stuart Shulman – Texifter What have CAT & DiscoverText done for qualitative methodology?
  • 21. Stuart Shulman – Texifter Dr. Stuart W. Shulman Founder & CEO, Texifter, LLC Research Associate Professor, UMass Amherst Director, Qualitative Data Analysis Program (QDAP) Editor Emeritus, Journal of Information Technology & Politics Contact Information stu@texifter.com http://people.umass.edu/stu/ @stuartwshulman Thanks for Listening!