SlideShare a Scribd company logo
CoderRank: Creating Gold Standards
Dr. Stuart W. Shulman
Founder & CEO, Texifter
@stuartwshulman
“…a wealth of information creates a poverty of attention.”
- Herbert Simon, 1971
Text Classification
A 2500 year-old problem
Plato argued it would be frustrating. It still is.
Grimmer & Stewart “Text as Data” Political Analysis (2013)
Volume is a problem for scholars
Coders are expensive
Groups struggle to accurately label text at scale
Validation of both humans and machines is “essential”
Some models are easier to validate than others
All models are wrong
Automated models enhance/amplify, but don’t replace humans
There is no one right way to do this
“Validate, validate, validate”
“What should be avoided then, is the blind use
of any method without a validation step.”
Free, Open-Source, Web-based Text Analytics Toolkit
Original Software Kernel: Tools for Measurement
Avoid Tennis Elbow
Items load to the screen and the coder hits the keystroke
Keystroke Human Coding
Human coding can be distributed to individuals, groups & crowds
Computer Science & National Science Foundation:
Measure Everything
How fast?
How reliable?
How accurate?
Annotator Speed
Redacted
Interrater Reliability: A Critical Measurement
Adjudication
CoderRank for enhanced machine-learning is our key innovation
Patent issued March 1, 2016
CoderRank for Enhanced Machine-learning
CoderRank is to text analytics what PageRank was to search.
Just as Google said not all web pages are created equal,
Texifter argues that not all humans are created equal. When
training machines, it is best to rely most on the humans most
likely to create a valid observation. We proposed a unique
way to rank humans on trust and knowledge vectors.
ActiveLearning engines and human coding tools combine…
what humans do best… with what computers do best.
Humans and machines learning together
It is always good to keep humans “in-the-loop”
Word sense disambiguation (relevance)
Word sense disambiguation (relevance)
Word sense disambiguation (relevance)
Word sense disambiguation (relevance)
Human coding converts into machine classifiers
Accumulated human coding becomes training data via machine-learning
Crowdsourcing accelerates the insight generation
Distribute coding for synchronous & asynchronous collaboration
Thank-you for listening!
@stuartwshulman
stu@texifter.com

More Related Content

What's hot

TestIstanbul 2018 Openning Speech: Artificial Intelligence vs Human Mind
TestIstanbul 2018 Openning Speech: Artificial Intelligence vs Human MindTestIstanbul 2018 Openning Speech: Artificial Intelligence vs Human Mind
TestIstanbul 2018 Openning Speech: Artificial Intelligence vs Human Mind
Turkish Testing Board
 
Research about artificial intelligence (A.I)
Research about artificial intelligence (A.I)Research about artificial intelligence (A.I)
Research about artificial intelligence (A.I)
Alị Ŕỉźvị
 
Artificial intelligence (ai)
Artificial intelligence (ai)Artificial intelligence (ai)
Artificial intelligence (ai)
bijaya kc
 
What Is Machine Learning? | What Is Machine Learning And How Does It Work? | ...
What Is Machine Learning? | What Is Machine Learning And How Does It Work? | ...What Is Machine Learning? | What Is Machine Learning And How Does It Work? | ...
What Is Machine Learning? | What Is Machine Learning And How Does It Work? | ...
Simplilearn
 
Machine Learning for Non-technical People
Machine Learning for Non-technical PeopleMachine Learning for Non-technical People
Machine Learning for Non-technical People
indico data
 
Will artificial intelligence(ai) replace human
Will artificial intelligence(ai) replace humanWill artificial intelligence(ai) replace human
Will artificial intelligence(ai) replace human
Nafiz Islam
 
ARTIFICIAL INTELLIGENCE AND MACHINE LEARNING
ARTIFICIAL INTELLIGENCE AND MACHINE LEARNING ARTIFICIAL INTELLIGENCE AND MACHINE LEARNING
ARTIFICIAL INTELLIGENCE AND MACHINE LEARNING
Goodbuzz Inc.
 
ARTIFICIAL INTELLIGENCE BASIC PPT
ARTIFICIAL INTELLIGENCE BASIC PPTARTIFICIAL INTELLIGENCE BASIC PPT
ARTIFICIAL INTELLIGENCE BASIC PPT
RohitYemul1
 
AI and Machine Learning Demystified by Carol Smith at Midwest UX 2017
AI and Machine Learning Demystified by Carol Smith at Midwest UX 2017AI and Machine Learning Demystified by Carol Smith at Midwest UX 2017
AI and Machine Learning Demystified by Carol Smith at Midwest UX 2017
Carol Smith
 
Artificial intelligence - A human revolution
Artificial intelligence - A human revolutionArtificial intelligence - A human revolution
Artificial intelligence - A human revolution
Accenture BeLux
 
Artificial Intelligence Overview PowerPoint Presentation Slides
Artificial Intelligence Overview PowerPoint Presentation Slides Artificial Intelligence Overview PowerPoint Presentation Slides
Artificial Intelligence Overview PowerPoint Presentation Slides
SlideTeam
 
AI, Machine Learning and Deep Learning - The Overview
AI, Machine Learning and Deep Learning - The OverviewAI, Machine Learning and Deep Learning - The Overview
AI, Machine Learning and Deep Learning - The Overview
Spotle.ai
 
Steve Mills - Your Cognitive Future
Steve Mills - Your Cognitive FutureSteve Mills - Your Cognitive Future
Steve Mills - Your Cognitive Future
SogetiLabs
 
We are Building Dystopia using AI & ML
We are Building Dystopia using AI & MLWe are Building Dystopia using AI & ML
We are Building Dystopia using AI & ML
Viral Parmar
 
The Ethics of AI
The Ethics of AIThe Ethics of AI
The Ethics of AI
Mark S. Steed
 
What is AI ( Arificial Intelligence)?
What is AI ( Arificial Intelligence)?What is AI ( Arificial Intelligence)?
What is AI ( Arificial Intelligence)?
MyAssignmenthelp.com
 
AI & Business - Opportunities & Dangers
AI & Business - Opportunities & DangersAI & Business - Opportunities & Dangers
AI & Business - Opportunities & Dangers
willmurphy
 
International Journal of Artificial Intelligence & Applications (IJAIA)
International Journal of Artificial Intelligence & Applications (IJAIA)International Journal of Artificial Intelligence & Applications (IJAIA)
International Journal of Artificial Intelligence & Applications (IJAIA)
gerogepatton
 
From Turing To Humanoid Robots - Ramón López de Mántaras
From Turing To Humanoid Robots - Ramón López de MántarasFrom Turing To Humanoid Robots - Ramón López de Mántaras
From Turing To Humanoid Robots - Ramón López de Mántaras
Machine Learning Valencia
 
Cognitive Computing and the future of Artificial Intelligence
Cognitive Computing and the future of Artificial IntelligenceCognitive Computing and the future of Artificial Intelligence
Cognitive Computing and the future of Artificial Intelligence
Varun Singh
 

What's hot (20)

TestIstanbul 2018 Openning Speech: Artificial Intelligence vs Human Mind
TestIstanbul 2018 Openning Speech: Artificial Intelligence vs Human MindTestIstanbul 2018 Openning Speech: Artificial Intelligence vs Human Mind
TestIstanbul 2018 Openning Speech: Artificial Intelligence vs Human Mind
 
Research about artificial intelligence (A.I)
Research about artificial intelligence (A.I)Research about artificial intelligence (A.I)
Research about artificial intelligence (A.I)
 
Artificial intelligence (ai)
Artificial intelligence (ai)Artificial intelligence (ai)
Artificial intelligence (ai)
 
What Is Machine Learning? | What Is Machine Learning And How Does It Work? | ...
What Is Machine Learning? | What Is Machine Learning And How Does It Work? | ...What Is Machine Learning? | What Is Machine Learning And How Does It Work? | ...
What Is Machine Learning? | What Is Machine Learning And How Does It Work? | ...
 
Machine Learning for Non-technical People
Machine Learning for Non-technical PeopleMachine Learning for Non-technical People
Machine Learning for Non-technical People
 
Will artificial intelligence(ai) replace human
Will artificial intelligence(ai) replace humanWill artificial intelligence(ai) replace human
Will artificial intelligence(ai) replace human
 
ARTIFICIAL INTELLIGENCE AND MACHINE LEARNING
ARTIFICIAL INTELLIGENCE AND MACHINE LEARNING ARTIFICIAL INTELLIGENCE AND MACHINE LEARNING
ARTIFICIAL INTELLIGENCE AND MACHINE LEARNING
 
ARTIFICIAL INTELLIGENCE BASIC PPT
ARTIFICIAL INTELLIGENCE BASIC PPTARTIFICIAL INTELLIGENCE BASIC PPT
ARTIFICIAL INTELLIGENCE BASIC PPT
 
AI and Machine Learning Demystified by Carol Smith at Midwest UX 2017
AI and Machine Learning Demystified by Carol Smith at Midwest UX 2017AI and Machine Learning Demystified by Carol Smith at Midwest UX 2017
AI and Machine Learning Demystified by Carol Smith at Midwest UX 2017
 
Artificial intelligence - A human revolution
Artificial intelligence - A human revolutionArtificial intelligence - A human revolution
Artificial intelligence - A human revolution
 
Artificial Intelligence Overview PowerPoint Presentation Slides
Artificial Intelligence Overview PowerPoint Presentation Slides Artificial Intelligence Overview PowerPoint Presentation Slides
Artificial Intelligence Overview PowerPoint Presentation Slides
 
AI, Machine Learning and Deep Learning - The Overview
AI, Machine Learning and Deep Learning - The OverviewAI, Machine Learning and Deep Learning - The Overview
AI, Machine Learning and Deep Learning - The Overview
 
Steve Mills - Your Cognitive Future
Steve Mills - Your Cognitive FutureSteve Mills - Your Cognitive Future
Steve Mills - Your Cognitive Future
 
We are Building Dystopia using AI & ML
We are Building Dystopia using AI & MLWe are Building Dystopia using AI & ML
We are Building Dystopia using AI & ML
 
The Ethics of AI
The Ethics of AIThe Ethics of AI
The Ethics of AI
 
What is AI ( Arificial Intelligence)?
What is AI ( Arificial Intelligence)?What is AI ( Arificial Intelligence)?
What is AI ( Arificial Intelligence)?
 
AI & Business - Opportunities & Dangers
AI & Business - Opportunities & DangersAI & Business - Opportunities & Dangers
AI & Business - Opportunities & Dangers
 
International Journal of Artificial Intelligence & Applications (IJAIA)
International Journal of Artificial Intelligence & Applications (IJAIA)International Journal of Artificial Intelligence & Applications (IJAIA)
International Journal of Artificial Intelligence & Applications (IJAIA)
 
From Turing To Humanoid Robots - Ramón López de Mántaras
From Turing To Humanoid Robots - Ramón López de MántarasFrom Turing To Humanoid Robots - Ramón López de Mántaras
From Turing To Humanoid Robots - Ramón López de Mántaras
 
Cognitive Computing and the future of Artificial Intelligence
Cognitive Computing and the future of Artificial IntelligenceCognitive Computing and the future of Artificial Intelligence
Cognitive Computing and the future of Artificial Intelligence
 

Viewers also liked

Exposicion
ExposicionExposicion
Exposicion
nenilareyes
 
Collecting and Coding Twitter Data in DiscoverText
Collecting and Coding Twitter Data in DiscoverTextCollecting and Coding Twitter Data in DiscoverText
Collecting and Coding Twitter Data in DiscoverText
Jill Hopke
 
Users are your greates asset june 2014
Users are your greates asset june 2014Users are your greates asset june 2014
Users are your greates asset june 2014
Silka Sietsma
 
Daycare paper draft 1
Daycare paper draft 1Daycare paper draft 1
Daycare paper draft 1
Clbrydges
 
概要设计说明
概要设计说明概要设计说明
概要设计说明Jacken
 
Bikram final summar tranning
Bikram final summar tranningBikram final summar tranning
Bikram final summar tranning
bikram99tiwary
 
DiscoverText Product Overview
DiscoverText Product OverviewDiscoverText Product Overview
DiscoverText Product Overview
Stuart Shulman
 
Supermarket Dietitian Recommended Reading List
Supermarket Dietitian Recommended Reading ListSupermarket Dietitian Recommended Reading List
Supermarket Dietitian Recommended Reading List
Barbara Ruhs, MS, RD, LDN
 
Country Report
Country ReportCountry Report
Country Report
Christina Sinaga
 
Autism
AutismAutism
Communication strategy for NonProfits Sept 15, 2011
Communication strategy for NonProfits Sept 15, 2011Communication strategy for NonProfits Sept 15, 2011
Communication strategy for NonProfits Sept 15, 2011
ktramble
 
How network management system work
How network management system workHow network management system work
How network management system work
s1180075
 
Perfecting The Supermarket Food Demo
Perfecting The Supermarket Food DemoPerfecting The Supermarket Food Demo
Perfecting The Supermarket Food Demo
Barbara Ruhs, MS, RD, LDN
 
Creating a college support team
Creating a college support teamCreating a college support team
Creating a college support team
Atty Garfinkel
 
Let’s make learning fun2!
Let’s make learning fun2!Let’s make learning fun2!
Let’s make learning fun2!
tburnshu
 
Creating a college support team
Creating a college support teamCreating a college support team
Creating a college support team
Atty Garfinkel
 
Final thessaloniki.ppt
Final thessaloniki.pptFinal thessaloniki.ppt
Final thessaloniki.ppt
yuklan
 
Seed folks powerpoint 2
Seed folks powerpoint 2Seed folks powerpoint 2
Seed folks powerpoint 2
michaelac44
 
Vaccines fast
Vaccines fastVaccines fast

Viewers also liked (20)

Exposicion
ExposicionExposicion
Exposicion
 
Collecting and Coding Twitter Data in DiscoverText
Collecting and Coding Twitter Data in DiscoverTextCollecting and Coding Twitter Data in DiscoverText
Collecting and Coding Twitter Data in DiscoverText
 
Users are your greates asset june 2014
Users are your greates asset june 2014Users are your greates asset june 2014
Users are your greates asset june 2014
 
Daycare paper draft 1
Daycare paper draft 1Daycare paper draft 1
Daycare paper draft 1
 
概要设计说明
概要设计说明概要设计说明
概要设计说明
 
Bikram final summar tranning
Bikram final summar tranningBikram final summar tranning
Bikram final summar tranning
 
DiscoverText Product Overview
DiscoverText Product OverviewDiscoverText Product Overview
DiscoverText Product Overview
 
Supermarket Dietitian Recommended Reading List
Supermarket Dietitian Recommended Reading ListSupermarket Dietitian Recommended Reading List
Supermarket Dietitian Recommended Reading List
 
Country Report
Country ReportCountry Report
Country Report
 
Autism
AutismAutism
Autism
 
Communication strategy for NonProfits Sept 15, 2011
Communication strategy for NonProfits Sept 15, 2011Communication strategy for NonProfits Sept 15, 2011
Communication strategy for NonProfits Sept 15, 2011
 
How network management system work
How network management system workHow network management system work
How network management system work
 
Perfecting The Supermarket Food Demo
Perfecting The Supermarket Food DemoPerfecting The Supermarket Food Demo
Perfecting The Supermarket Food Demo
 
Creating a college support team
Creating a college support teamCreating a college support team
Creating a college support team
 
Let’s make learning fun2!
Let’s make learning fun2!Let’s make learning fun2!
Let’s make learning fun2!
 
Creating a college support team
Creating a college support teamCreating a college support team
Creating a college support team
 
Final thessaloniki.ppt
Final thessaloniki.pptFinal thessaloniki.ppt
Final thessaloniki.ppt
 
Paracetamol
ParacetamolParacetamol
Paracetamol
 
Seed folks powerpoint 2
Seed folks powerpoint 2Seed folks powerpoint 2
Seed folks powerpoint 2
 
Vaccines fast
Vaccines fastVaccines fast
Vaccines fast
 

Similar to CoderRank: Creating Gold Standards

Text Analytics: From Colored Pens and Crumbly Papers to Custom Machine Classi...
Text Analytics: From Colored Pens and Crumbly Papers to Custom Machine Classi...Text Analytics: From Colored Pens and Crumbly Papers to Custom Machine Classi...
Text Analytics: From Colored Pens and Crumbly Papers to Custom Machine Classi...
Stuart Shulman
 
Human and machines learning together
Human and machines learning together Human and machines learning together
Human and machines learning together
Stuart Shulman
 
Sifting Social Data: Word Sense Disambiguation Using Machine Learning
Sifting Social Data: Word Sense Disambiguation Using Machine LearningSifting Social Data: Word Sense Disambiguation Using Machine Learning
Sifting Social Data: Word Sense Disambiguation Using Machine Learning
Stuart Shulman
 
Summit slide loop ny
Summit slide loop nySummit slide loop ny
Summit slide loop ny
Stuart Shulman
 
BB_54028_20160212 SVTLS AI_FINAL_shown
BB_54028_20160212 SVTLS AI_FINAL_shownBB_54028_20160212 SVTLS AI_FINAL_shown
BB_54028_20160212 SVTLS AI_FINAL_shown
Mark Holman
 
Copy of getting into ai event slides (PDF)
Copy of getting into ai   event slides (PDF)Copy of getting into ai   event slides (PDF)
Copy of getting into ai event slides (PDF)
Matthew Miller
 
Machine Learning: Understanding the Invisible Force Changing Our World
Machine Learning: Understanding the Invisible Force Changing Our WorldMachine Learning: Understanding the Invisible Force Changing Our World
Machine Learning: Understanding the Invisible Force Changing Our World
Ken Tabor
 
AI and the Professions: Past, Present and Future
AI and the Professions: Past, Present and FutureAI and the Professions: Past, Present and Future
AI and the Professions: Past, Present and Future
Warren E. Agin
 
Salesforce - AI for CRM
Salesforce - AI for CRMSalesforce - AI for CRM
Salesforce - AI for CRM
Ambachtelijke Marketing
 
AI for CRM e-book
AI for CRM e-bookAI for CRM e-book
AI for CRM e-book
Leonardo Maia
 
Human, AI collaboration, Accenture
Human, AI collaboration, AccentureHuman, AI collaboration, Accenture
Human, AI collaboration, Accenture
Luigi Galluppi
 
Scholarly Publishing in an AI World
Scholarly Publishing in an AI WorldScholarly Publishing in an AI World
Scholarly Publishing in an AI World
Juliet Kaplan
 
Présentation de Bruno Schroder au 20e #mforum (07/12/2016)
Présentation de Bruno Schroder au 20e #mforum (07/12/2016)Présentation de Bruno Schroder au 20e #mforum (07/12/2016)
Présentation de Bruno Schroder au 20e #mforum (07/12/2016)
Agence du Numérique (AdN)
 
Ai titech-virach-20191026
Ai titech-virach-20191026Ai titech-virach-20191026
Webinar on AI in IoT applications KCG Connect Alumni Digital Series by Rajkumar
Webinar on AI in IoT applications KCG Connect Alumni Digital Series by RajkumarWebinar on AI in IoT applications KCG Connect Alumni Digital Series by Rajkumar
Webinar on AI in IoT applications KCG Connect Alumni Digital Series by Rajkumar
Rajkumar R
 
OA Introduction to AI from Object Automation
OA Introduction to AI from Object Automation OA Introduction to AI from Object Automation
OA Introduction to AI from Object Automation
Object Automation
 
When AI becomes a data-driven machine, and digital is everywhere!
When AI becomes a data-driven machine, and digital is everywhere!When AI becomes a data-driven machine, and digital is everywhere!
When AI becomes a data-driven machine, and digital is everywhere!
Thammasat University, Musashino University
 
Principles of Artificial Intelligence & Machine Learning
Principles of Artificial Intelligence & Machine LearningPrinciples of Artificial Intelligence & Machine Learning
Principles of Artificial Intelligence & Machine Learning
Jerry Lu
 
Qual, Mixed, Machine and Everything in Between
Qual, Mixed, Machine and Everything in BetweenQual, Mixed, Machine and Everything in Between
Qual, Mixed, Machine and Everything in Between
Stuart Shulman
 
Workshop_Presentation.pptx
Workshop_Presentation.pptxWorkshop_Presentation.pptx
Workshop_Presentation.pptx
RUDRAPRASADSABAR
 

Similar to CoderRank: Creating Gold Standards (20)

Text Analytics: From Colored Pens and Crumbly Papers to Custom Machine Classi...
Text Analytics: From Colored Pens and Crumbly Papers to Custom Machine Classi...Text Analytics: From Colored Pens and Crumbly Papers to Custom Machine Classi...
Text Analytics: From Colored Pens and Crumbly Papers to Custom Machine Classi...
 
Human and machines learning together
Human and machines learning together Human and machines learning together
Human and machines learning together
 
Sifting Social Data: Word Sense Disambiguation Using Machine Learning
Sifting Social Data: Word Sense Disambiguation Using Machine LearningSifting Social Data: Word Sense Disambiguation Using Machine Learning
Sifting Social Data: Word Sense Disambiguation Using Machine Learning
 
Summit slide loop ny
Summit slide loop nySummit slide loop ny
Summit slide loop ny
 
BB_54028_20160212 SVTLS AI_FINAL_shown
BB_54028_20160212 SVTLS AI_FINAL_shownBB_54028_20160212 SVTLS AI_FINAL_shown
BB_54028_20160212 SVTLS AI_FINAL_shown
 
Copy of getting into ai event slides (PDF)
Copy of getting into ai   event slides (PDF)Copy of getting into ai   event slides (PDF)
Copy of getting into ai event slides (PDF)
 
Machine Learning: Understanding the Invisible Force Changing Our World
Machine Learning: Understanding the Invisible Force Changing Our WorldMachine Learning: Understanding the Invisible Force Changing Our World
Machine Learning: Understanding the Invisible Force Changing Our World
 
AI and the Professions: Past, Present and Future
AI and the Professions: Past, Present and FutureAI and the Professions: Past, Present and Future
AI and the Professions: Past, Present and Future
 
Salesforce - AI for CRM
Salesforce - AI for CRMSalesforce - AI for CRM
Salesforce - AI for CRM
 
AI for CRM e-book
AI for CRM e-bookAI for CRM e-book
AI for CRM e-book
 
Human, AI collaboration, Accenture
Human, AI collaboration, AccentureHuman, AI collaboration, Accenture
Human, AI collaboration, Accenture
 
Scholarly Publishing in an AI World
Scholarly Publishing in an AI WorldScholarly Publishing in an AI World
Scholarly Publishing in an AI World
 
Présentation de Bruno Schroder au 20e #mforum (07/12/2016)
Présentation de Bruno Schroder au 20e #mforum (07/12/2016)Présentation de Bruno Schroder au 20e #mforum (07/12/2016)
Présentation de Bruno Schroder au 20e #mforum (07/12/2016)
 
Ai titech-virach-20191026
Ai titech-virach-20191026Ai titech-virach-20191026
Ai titech-virach-20191026
 
Webinar on AI in IoT applications KCG Connect Alumni Digital Series by Rajkumar
Webinar on AI in IoT applications KCG Connect Alumni Digital Series by RajkumarWebinar on AI in IoT applications KCG Connect Alumni Digital Series by Rajkumar
Webinar on AI in IoT applications KCG Connect Alumni Digital Series by Rajkumar
 
OA Introduction to AI from Object Automation
OA Introduction to AI from Object Automation OA Introduction to AI from Object Automation
OA Introduction to AI from Object Automation
 
When AI becomes a data-driven machine, and digital is everywhere!
When AI becomes a data-driven machine, and digital is everywhere!When AI becomes a data-driven machine, and digital is everywhere!
When AI becomes a data-driven machine, and digital is everywhere!
 
Principles of Artificial Intelligence & Machine Learning
Principles of Artificial Intelligence & Machine LearningPrinciples of Artificial Intelligence & Machine Learning
Principles of Artificial Intelligence & Machine Learning
 
Qual, Mixed, Machine and Everything in Between
Qual, Mixed, Machine and Everything in BetweenQual, Mixed, Machine and Everything in Between
Qual, Mixed, Machine and Everything in Between
 
Workshop_Presentation.pptx
Workshop_Presentation.pptxWorkshop_Presentation.pptx
Workshop_Presentation.pptx
 

More from Stuart Shulman

Fear and loathing on the social campaign trail
Fear and loathing on the social campaign trailFear and loathing on the social campaign trail
Fear and loathing on the social campaign trail
Stuart Shulman
 
Fear and Loathing on the Social Campaign Trail
Fear and Loathing on the Social Campaign TrailFear and Loathing on the Social Campaign Trail
Fear and Loathing on the Social Campaign Trail
Stuart Shulman
 
Texifter Presentation at Boston New Technology’s #BNT77 Startup Showcase!
Texifter Presentation at Boston New Technology’s #BNT77 Startup Showcase!Texifter Presentation at Boston New Technology’s #BNT77 Startup Showcase!
Texifter Presentation at Boston New Technology’s #BNT77 Startup Showcase!
Stuart Shulman
 
Text Analytics for Social Data Using DiscoverText & Sifter
 Text Analytics for Social Data Using DiscoverText & Sifter Text Analytics for Social Data Using DiscoverText & Sifter
Text Analytics for Social Data Using DiscoverText & SifterStuart Shulman
 
Text Analytics for Social Data Using DiscoverText & Sifter
Text Analytics for Social Data Using DiscoverText & SifterText Analytics for Social Data Using DiscoverText & Sifter
Text Analytics for Social Data Using DiscoverText & Sifter
Stuart Shulman
 
Twitter for Research
Twitter for ResearchTwitter for Research
Twitter for Research
Stuart Shulman
 
CAQDAS 2014 Pecha Kucha - Stuart Shulman
CAQDAS 2014 Pecha Kucha - Stuart ShulmanCAQDAS 2014 Pecha Kucha - Stuart Shulman
CAQDAS 2014 Pecha Kucha - Stuart Shulman
Stuart Shulman
 
Measuring reliability and validity in human coding and machine classification
Measuring reliability and validity in human coding and machine classificationMeasuring reliability and validity in human coding and machine classification
Measuring reliability and validity in human coding and machine classification
Stuart Shulman
 
Technology for Citizen Voices
Technology for Citizen VoicesTechnology for Citizen Voices
Technology for Citizen Voices
Stuart Shulman
 
DiscoverText: Tools for Text
DiscoverText: Tools for TextDiscoverText: Tools for Text
DiscoverText: Tools for Text
Stuart Shulman
 
Citizen Voices in a Networked Age of #BigData
Citizen Voices in a Networked Age of #BigDataCitizen Voices in a Networked Age of #BigData
Citizen Voices in a Networked Age of #BigData
Stuart Shulman
 
Importing bulk outlook email into DiscoverText - the .pst file upload
Importing bulk outlook email into DiscoverText - the .pst file uploadImporting bulk outlook email into DiscoverText - the .pst file upload
Importing bulk outlook email into DiscoverText - the .pst file upload
Stuart Shulman
 
Texifter
TexifterTexifter
Texifter
Stuart Shulman
 
Future of text analysis forrester briefing
Future of text analysis   forrester briefingFuture of text analysis   forrester briefing
Future of text analysis forrester briefing
Stuart Shulman
 

More from Stuart Shulman (14)

Fear and loathing on the social campaign trail
Fear and loathing on the social campaign trailFear and loathing on the social campaign trail
Fear and loathing on the social campaign trail
 
Fear and Loathing on the Social Campaign Trail
Fear and Loathing on the Social Campaign TrailFear and Loathing on the Social Campaign Trail
Fear and Loathing on the Social Campaign Trail
 
Texifter Presentation at Boston New Technology’s #BNT77 Startup Showcase!
Texifter Presentation at Boston New Technology’s #BNT77 Startup Showcase!Texifter Presentation at Boston New Technology’s #BNT77 Startup Showcase!
Texifter Presentation at Boston New Technology’s #BNT77 Startup Showcase!
 
Text Analytics for Social Data Using DiscoverText & Sifter
 Text Analytics for Social Data Using DiscoverText & Sifter Text Analytics for Social Data Using DiscoverText & Sifter
Text Analytics for Social Data Using DiscoverText & Sifter
 
Text Analytics for Social Data Using DiscoverText & Sifter
Text Analytics for Social Data Using DiscoverText & SifterText Analytics for Social Data Using DiscoverText & Sifter
Text Analytics for Social Data Using DiscoverText & Sifter
 
Twitter for Research
Twitter for ResearchTwitter for Research
Twitter for Research
 
CAQDAS 2014 Pecha Kucha - Stuart Shulman
CAQDAS 2014 Pecha Kucha - Stuart ShulmanCAQDAS 2014 Pecha Kucha - Stuart Shulman
CAQDAS 2014 Pecha Kucha - Stuart Shulman
 
Measuring reliability and validity in human coding and machine classification
Measuring reliability and validity in human coding and machine classificationMeasuring reliability and validity in human coding and machine classification
Measuring reliability and validity in human coding and machine classification
 
Technology for Citizen Voices
Technology for Citizen VoicesTechnology for Citizen Voices
Technology for Citizen Voices
 
DiscoverText: Tools for Text
DiscoverText: Tools for TextDiscoverText: Tools for Text
DiscoverText: Tools for Text
 
Citizen Voices in a Networked Age of #BigData
Citizen Voices in a Networked Age of #BigDataCitizen Voices in a Networked Age of #BigData
Citizen Voices in a Networked Age of #BigData
 
Importing bulk outlook email into DiscoverText - the .pst file upload
Importing bulk outlook email into DiscoverText - the .pst file uploadImporting bulk outlook email into DiscoverText - the .pst file upload
Importing bulk outlook email into DiscoverText - the .pst file upload
 
Texifter
TexifterTexifter
Texifter
 
Future of text analysis forrester briefing
Future of text analysis   forrester briefingFuture of text analysis   forrester briefing
Future of text analysis forrester briefing
 

Recently uploaded

Enterprise Resource Planning System in Telangana
Enterprise Resource Planning System in TelanganaEnterprise Resource Planning System in Telangana
Enterprise Resource Planning System in Telangana
NYGGS Automation Suite
 
AI Fusion Buddy Review: Brand New, Groundbreaking Gemini-Powered AI App
AI Fusion Buddy Review: Brand New, Groundbreaking Gemini-Powered AI AppAI Fusion Buddy Review: Brand New, Groundbreaking Gemini-Powered AI App
AI Fusion Buddy Review: Brand New, Groundbreaking Gemini-Powered AI App
Google
 
Fundamentals of Programming and Language Processors
Fundamentals of Programming and Language ProcessorsFundamentals of Programming and Language Processors
Fundamentals of Programming and Language Processors
Rakesh Kumar R
 
UI5con 2024 - Boost Your Development Experience with UI5 Tooling Extensions
UI5con 2024 - Boost Your Development Experience with UI5 Tooling ExtensionsUI5con 2024 - Boost Your Development Experience with UI5 Tooling Extensions
UI5con 2024 - Boost Your Development Experience with UI5 Tooling Extensions
Peter Muessig
 
socradar-q1-2024-aviation-industry-report.pdf
socradar-q1-2024-aviation-industry-report.pdfsocradar-q1-2024-aviation-industry-report.pdf
socradar-q1-2024-aviation-industry-report.pdf
SOCRadar
 
Utilocate provides Smarter, Better, Faster, Safer Locate Ticket Management
Utilocate provides Smarter, Better, Faster, Safer Locate Ticket ManagementUtilocate provides Smarter, Better, Faster, Safer Locate Ticket Management
Utilocate provides Smarter, Better, Faster, Safer Locate Ticket Management
Utilocate
 
GreenCode-A-VSCode-Plugin--Dario-Jurisic
GreenCode-A-VSCode-Plugin--Dario-JurisicGreenCode-A-VSCode-Plugin--Dario-Jurisic
GreenCode-A-VSCode-Plugin--Dario-Jurisic
Green Software Development
 
原版定制美国纽约州立大学奥尔巴尼分校毕业证学位证书原版一模一样
原版定制美国纽约州立大学奥尔巴尼分校毕业证学位证书原版一模一样原版定制美国纽约州立大学奥尔巴尼分校毕业证学位证书原版一模一样
原版定制美国纽约州立大学奥尔巴尼分校毕业证学位证书原版一模一样
mz5nrf0n
 
Neo4j - Product Vision and Knowledge Graphs - GraphSummit Paris
Neo4j - Product Vision and Knowledge Graphs - GraphSummit ParisNeo4j - Product Vision and Knowledge Graphs - GraphSummit Paris
Neo4j - Product Vision and Knowledge Graphs - GraphSummit Paris
Neo4j
 
A Study of Variable-Role-based Feature Enrichment in Neural Models of Code
A Study of Variable-Role-based Feature Enrichment in Neural Models of CodeA Study of Variable-Role-based Feature Enrichment in Neural Models of Code
A Study of Variable-Role-based Feature Enrichment in Neural Models of Code
Aftab Hussain
 
DDS-Security 1.2 - What's New? Stronger security for long-running systems
DDS-Security 1.2 - What's New? Stronger security for long-running systemsDDS-Security 1.2 - What's New? Stronger security for long-running systems
DDS-Security 1.2 - What's New? Stronger security for long-running systems
Gerardo Pardo-Castellote
 
openEuler Case Study - The Journey to Supply Chain Security
openEuler Case Study - The Journey to Supply Chain SecurityopenEuler Case Study - The Journey to Supply Chain Security
openEuler Case Study - The Journey to Supply Chain Security
Shane Coughlan
 
Vitthal Shirke Java Microservices Resume.pdf
Vitthal Shirke Java Microservices Resume.pdfVitthal Shirke Java Microservices Resume.pdf
Vitthal Shirke Java Microservices Resume.pdf
Vitthal Shirke
 
APIs for Browser Automation (MoT Meetup 2024)
APIs for Browser Automation (MoT Meetup 2024)APIs for Browser Automation (MoT Meetup 2024)
APIs for Browser Automation (MoT Meetup 2024)
Boni García
 
Orion Context Broker introduction 20240604
Orion Context Broker introduction 20240604Orion Context Broker introduction 20240604
Orion Context Broker introduction 20240604
Fermin Galan
 
Why Mobile App Regression Testing is Critical for Sustained Success_ A Detail...
Why Mobile App Regression Testing is Critical for Sustained Success_ A Detail...Why Mobile App Regression Testing is Critical for Sustained Success_ A Detail...
Why Mobile App Regression Testing is Critical for Sustained Success_ A Detail...
kalichargn70th171
 
Oracle Database 19c New Features for DBAs and Developers.pptx
Oracle Database 19c New Features for DBAs and Developers.pptxOracle Database 19c New Features for DBAs and Developers.pptx
Oracle Database 19c New Features for DBAs and Developers.pptx
Remote DBA Services
 
Graspan: A Big Data System for Big Code Analysis
Graspan: A Big Data System for Big Code AnalysisGraspan: A Big Data System for Big Code Analysis
Graspan: A Big Data System for Big Code Analysis
Aftab Hussain
 
OpenMetadata Community Meeting - 5th June 2024
OpenMetadata Community Meeting - 5th June 2024OpenMetadata Community Meeting - 5th June 2024
OpenMetadata Community Meeting - 5th June 2024
OpenMetadata
 
What is Augmented Reality Image Tracking
What is Augmented Reality Image TrackingWhat is Augmented Reality Image Tracking
What is Augmented Reality Image Tracking
pavan998932
 

Recently uploaded (20)

Enterprise Resource Planning System in Telangana
Enterprise Resource Planning System in TelanganaEnterprise Resource Planning System in Telangana
Enterprise Resource Planning System in Telangana
 
AI Fusion Buddy Review: Brand New, Groundbreaking Gemini-Powered AI App
AI Fusion Buddy Review: Brand New, Groundbreaking Gemini-Powered AI AppAI Fusion Buddy Review: Brand New, Groundbreaking Gemini-Powered AI App
AI Fusion Buddy Review: Brand New, Groundbreaking Gemini-Powered AI App
 
Fundamentals of Programming and Language Processors
Fundamentals of Programming and Language ProcessorsFundamentals of Programming and Language Processors
Fundamentals of Programming and Language Processors
 
UI5con 2024 - Boost Your Development Experience with UI5 Tooling Extensions
UI5con 2024 - Boost Your Development Experience with UI5 Tooling ExtensionsUI5con 2024 - Boost Your Development Experience with UI5 Tooling Extensions
UI5con 2024 - Boost Your Development Experience with UI5 Tooling Extensions
 
socradar-q1-2024-aviation-industry-report.pdf
socradar-q1-2024-aviation-industry-report.pdfsocradar-q1-2024-aviation-industry-report.pdf
socradar-q1-2024-aviation-industry-report.pdf
 
Utilocate provides Smarter, Better, Faster, Safer Locate Ticket Management
Utilocate provides Smarter, Better, Faster, Safer Locate Ticket ManagementUtilocate provides Smarter, Better, Faster, Safer Locate Ticket Management
Utilocate provides Smarter, Better, Faster, Safer Locate Ticket Management
 
GreenCode-A-VSCode-Plugin--Dario-Jurisic
GreenCode-A-VSCode-Plugin--Dario-JurisicGreenCode-A-VSCode-Plugin--Dario-Jurisic
GreenCode-A-VSCode-Plugin--Dario-Jurisic
 
原版定制美国纽约州立大学奥尔巴尼分校毕业证学位证书原版一模一样
原版定制美国纽约州立大学奥尔巴尼分校毕业证学位证书原版一模一样原版定制美国纽约州立大学奥尔巴尼分校毕业证学位证书原版一模一样
原版定制美国纽约州立大学奥尔巴尼分校毕业证学位证书原版一模一样
 
Neo4j - Product Vision and Knowledge Graphs - GraphSummit Paris
Neo4j - Product Vision and Knowledge Graphs - GraphSummit ParisNeo4j - Product Vision and Knowledge Graphs - GraphSummit Paris
Neo4j - Product Vision and Knowledge Graphs - GraphSummit Paris
 
A Study of Variable-Role-based Feature Enrichment in Neural Models of Code
A Study of Variable-Role-based Feature Enrichment in Neural Models of CodeA Study of Variable-Role-based Feature Enrichment in Neural Models of Code
A Study of Variable-Role-based Feature Enrichment in Neural Models of Code
 
DDS-Security 1.2 - What's New? Stronger security for long-running systems
DDS-Security 1.2 - What's New? Stronger security for long-running systemsDDS-Security 1.2 - What's New? Stronger security for long-running systems
DDS-Security 1.2 - What's New? Stronger security for long-running systems
 
openEuler Case Study - The Journey to Supply Chain Security
openEuler Case Study - The Journey to Supply Chain SecurityopenEuler Case Study - The Journey to Supply Chain Security
openEuler Case Study - The Journey to Supply Chain Security
 
Vitthal Shirke Java Microservices Resume.pdf
Vitthal Shirke Java Microservices Resume.pdfVitthal Shirke Java Microservices Resume.pdf
Vitthal Shirke Java Microservices Resume.pdf
 
APIs for Browser Automation (MoT Meetup 2024)
APIs for Browser Automation (MoT Meetup 2024)APIs for Browser Automation (MoT Meetup 2024)
APIs for Browser Automation (MoT Meetup 2024)
 
Orion Context Broker introduction 20240604
Orion Context Broker introduction 20240604Orion Context Broker introduction 20240604
Orion Context Broker introduction 20240604
 
Why Mobile App Regression Testing is Critical for Sustained Success_ A Detail...
Why Mobile App Regression Testing is Critical for Sustained Success_ A Detail...Why Mobile App Regression Testing is Critical for Sustained Success_ A Detail...
Why Mobile App Regression Testing is Critical for Sustained Success_ A Detail...
 
Oracle Database 19c New Features for DBAs and Developers.pptx
Oracle Database 19c New Features for DBAs and Developers.pptxOracle Database 19c New Features for DBAs and Developers.pptx
Oracle Database 19c New Features for DBAs and Developers.pptx
 
Graspan: A Big Data System for Big Code Analysis
Graspan: A Big Data System for Big Code AnalysisGraspan: A Big Data System for Big Code Analysis
Graspan: A Big Data System for Big Code Analysis
 
OpenMetadata Community Meeting - 5th June 2024
OpenMetadata Community Meeting - 5th June 2024OpenMetadata Community Meeting - 5th June 2024
OpenMetadata Community Meeting - 5th June 2024
 
What is Augmented Reality Image Tracking
What is Augmented Reality Image TrackingWhat is Augmented Reality Image Tracking
What is Augmented Reality Image Tracking
 

CoderRank: Creating Gold Standards