SlideShare a Scribd company logo
© 2020 Minitab, LLC.
© 2020 Minitab, LLC.
Mikhail has been prototyping new machine
learning algorithms and modeling automation
for 20 years, and he has been a major
contributor to developing technological
improvements to the most important
algorithms in Machine Learning: CART®️
Decision Trees, MARS®️ Non-linear
Regression, TreeNet®️ gradient boosting, and
Random Forests®️. He holds master’s
degrees both in rocket science from Kharkov
State Polytechnic University in Ukraine and
statistical computing from the University of
Central Florida.
Meet the Presenter:
Mikhail Golovnya
Minitab Senior Advisory Data Scientist
© 2020 Minitab, LLC.
The Challenge of Text Mining
► Data sets often have a character variable that
contains a possibly long text (user feedback,
comments, etc.)
► Such a variable will usually have as many distinct
values as there are records in the dataset – thus, it
cannot be used directly for modeling
► Core objective of Text Mining:
Find ways to extract numeric measures from a
text variable that can be used in quantitative
modeling
3
Wine Review
Excellent wine!
HIGHLY
Recomended
LOVE IT;
AWESOME!
Too bitter, fordettable
Love this wine
Had better wine
before
© 2020 Minitab, LLC.
Simple Text Statistics
► The following simple numeric summaries of the raw text itself can be extracted and used in quantitative
analysis as derived numeric variables
▪ Total count of words
▪ Total count of characters
▪ Average word length (in characters)
▪ Count of stop-words (commonly occurring words)
▪ Count of numeric words (series of digits)
▪ Count of words written in all upper-case
4
© 2020 Minitab, LLC.
Simple Stats
5
Wine Review
Excellent wine! HIGHLY Recomended
LOVE IT; AWESOME.
Too bitter, forgettable
Love this wine
Had beter wine before
© 2020 Minitab, LLC.
6
© 2020 Minitab, LLC.
Text Cleaning Steps
► Raw text stats summarize the original text in its raw form
► The following steps (cleaning up) are normally employed to prepare a raw text variable for further
analysis
▪ Converting all characters to lower case only
▪ Removing all punctuation
▪ Removing all stop-words
▪ Correct spelling errors
▪ Removing infrequent words
► More advanced analyses (semantic extraction, etc.) might omit some of the above steps
7
© 2020 Minitab, LLC.
Cleaning Up Process
8
Wine Review
Excellent wine! Highly Recomended
Love it; awesome.
Too bitter, forgettable
Love this wine
Had beter wine before
Wine Review
excellent wine highly recommended
love awesome
bitter forgettable
love wine
better wine
© 2020 Minitab, LLC.
Summary Statistics
► The following summary statistics can now be computed and visualized for a
“beautified” text variable
▪ Total word count for each word that “survived the beautification process”
▪ Inverse Document Frequency (IDF) for each word
𝐼𝐷𝐹 = log
𝑁
𝐷𝐹
here N – number of observations
DF – number of documents where a given word occurs
A word present in all observations has IDF=0
A word present in only one observation has the largest
possible IDF
▪ Bar chart of the most frequently occurring words and their IDFs
▪ Word-cloud image of the most frequently occurring words
9
© 2020 Minitab, LLC.
Summary Statistics
10
© 2020 Minitab, LLC.
Word Counts
11
© 2020 Minitab, LLC.
Word IDFs
12
© 2020 Minitab, LLC.
Extracting Sentiment Values
► Sentiment value is a number that summarizes writer’s overall
attitude based on the linguistic analysis of the text
▪ Positive sentiment reflects positive attitude
▪ Negative sentiment reflects negative attitude
13
© 2020 Minitab, LLC.
Creating a Bag of Words
► For each word create a new variable that reports how many times the word
occurs in the text field
► To avoid explosion of new variables, the user might want to exclude
infrequent words
14
© 2020 Minitab, LLC.
Extracting Singular Vectors
15
© 2020 Minitab, LLC.
Summary
► Reporting stage (text_summary.py)
▪ Word frequencies and IDFs
▪ Bar charts and word cloud
► Extracting stage (text_convert.py)
▪ Created original raw text statistics variables
▪ Cleaning up stage
▪ Created sentiment value variable
▪ Created bag of words variables
▪ Created singular vector variables
► We have solved the original text mining challenge:
all these numeric variables summarize the original text variable and can be
used in predictive modeling algorithms along with the rest of the predictors!
16
© 2020 Minitab, LLC.
Reporting Stage
► LET K1 = "reviews.csv“ – input data set
► LET K2 = "Review“ – text variable
► LET K3 = 1 – word count limit
► PYSC "text_summary.py“ – reporting script
17
© 2020 Minitab, LLC.
Extracting Stage
► LET K1 = "reviews.csv“ – input data set
► LET K2 = "Review“ – text variable
► LET K3 = 1 – word count limit
► LET K5 = 5 – number of singular vectors
► LET K6 = "reviews_bow.csv“ – bag of words dataset
► LET K7 = "reviews_svd.csv“ – singular vector dataset
► LET K8 = "reviews_lds.csv“ – word loadings
► PYSC "text_convert.py“ – extracting script
18
© 2020 Minitab, LLC.
Our Approach: More Than Business Analytics… Solutions Analytics
Software
Services
Training
Learn first-hand by attending public
trainings or customized trainings
according to your requirements.
Statistical
Consulting
Personalized help with statistical
challenges from collecting the right data
to interpreting analysis more.
Support
Assistance with installation,
implementation, version updates
and license management.
Master statistics and
Minitab anywhere
with online training
Machine learning and
predictive analytics
software
Start, track, manage
and execute
improvement projects
with real-time
dashboards
Powerful statistical
software everyone
can use
Data Analysis Predictive Modeling Visual Business Tools Project Oversight
Visual tools to
process and product
excellence
Online Training
Solutions analytics is our integrated approach to providing software and services that enable organizations to
make better decisions that drive business excellence.
© 2020 Minitab, LLC.
Upcoming Webinar Wednesdays
Continue learning and working efficiently with our free webinar series:
• A TEDx Coach’s Secrets To Developing Innovative Leaders
and Ensuring They Thrive at Your Organization – July 15
info.minitab.com/resources/webinars/webinar-wednesdays
Minitab Training is now virtual!
Learn more at minitab.com/training
© 2020 Minitab, LLC.
Thank You!
From all of us at

More Related Content

What's hot

Parametrage magasin wm sap s4 hana
Parametrage magasin wm sap s4 hanaParametrage magasin wm sap s4 hana
Parametrage magasin wm sap s4 hana
Loic Rakotoarivony
 
SAP PPM 6.0 powered by HANA
SAP PPM 6.0 powered by HANASAP PPM 6.0 powered by HANA
SAP PPM 6.0 powered by HANA
Espedia Consulting
 
アジャイルRCA
アジャイルRCAアジャイルRCA
アジャイルRCA
atsushi nagata
 
OpenSIM 筋骨格シミュレーション 基本の解析マニュアル
OpenSIM 筋骨格シミュレーション 基本の解析マニュアルOpenSIM 筋骨格シミュレーション 基本の解析マニュアル
OpenSIM 筋骨格シミュレーション 基本の解析マニュアル
Yuki Koike
 
Sap audit _ Basic
Sap audit _ BasicSap audit _ Basic
Sap audit _ Basic
CA Priyadarshan Behera
 
Upgrade to sap ecc 6 from short overview
Upgrade to sap ecc 6 from short overviewUpgrade to sap ecc 6 from short overview
Upgrade to sap ecc 6 from short overview
H.C. Chen
 
KubeEdgeを触ってみた
KubeEdgeを触ってみたKubeEdgeを触ってみた
KubeEdgeを触ってみた
Tomoyuki Tanigaki
 
チーム開発にSwiftLintを導入してみた・詳細版
チーム開発にSwiftLintを導入してみた・詳細版チーム開発にSwiftLintを導入してみた・詳細版
チーム開発にSwiftLintを導入してみた・詳細版
Ikada Kaori
 
[DL Hacks]Model-Agnostic Meta-Learning for Fast Adaptation of Deep Network
[DL Hacks]Model-Agnostic Meta-Learning for Fast Adaptation of Deep Network[DL Hacks]Model-Agnostic Meta-Learning for Fast Adaptation of Deep Network
[DL Hacks]Model-Agnostic Meta-Learning for Fast Adaptation of Deep Network
Deep Learning JP
 
Report Painter in SAP: Introduction
Report Painter in SAP: IntroductionReport Painter in SAP: Introduction
Report Painter in SAP: Introduction
Jonathan Eemans
 
SAP S4hana EWM Training
SAP S4hana EWM TrainingSAP S4hana EWM Training
SAP S4hana EWM Training
ShabaKhan11
 
これからはじめる Power Platform
これからはじめる Power Platformこれからはじめる Power Platform
これからはじめる Power Platform
Rie Okuda
 
Wireshark入門 (2014版)
Wireshark入門 (2014版)Wireshark入門 (2014版)
Wireshark入門 (2014版)
彰 村地
 
モダナイゼーションがもたらす未来
モダナイゼーションがもたらす未来モダナイゼーションがもたらす未来
モダナイゼーションがもたらす未来
Hiromasa Oka
 
JIRAを使ったフツウのPJ実践
JIRAを使ったフツウのPJ実践JIRAを使ったフツウのPJ実践
Document Imaging - SAP Content Server and the Accounting Department
Document Imaging - SAP Content Server and the Accounting Department Document Imaging - SAP Content Server and the Accounting Department
Document Imaging - SAP Content Server and the Accounting Department
Verbella CMG
 
OpenMPI入門
OpenMPI入門OpenMPI入門
OpenMPI入門
Yusuke Matsushita
 
SAP AC020 - Investment Management
SAP AC020 - Investment ManagementSAP AC020 - Investment Management
SAP AC020 - Investment Management
Vannak9
 
QGISの活用例を見てみよう
QGISの活用例を見てみようQGISの活用例を見てみよう
QGISの活用例を見てみよう
Kazutaka ishizaki
 
Zabbix監視運用業務の自動化事例
Zabbix監視運用業務の自動化事例Zabbix監視運用業務の自動化事例
Zabbix監視運用業務の自動化事例
OSSラボ株式会社
 

What's hot (20)

Parametrage magasin wm sap s4 hana
Parametrage magasin wm sap s4 hanaParametrage magasin wm sap s4 hana
Parametrage magasin wm sap s4 hana
 
SAP PPM 6.0 powered by HANA
SAP PPM 6.0 powered by HANASAP PPM 6.0 powered by HANA
SAP PPM 6.0 powered by HANA
 
アジャイルRCA
アジャイルRCAアジャイルRCA
アジャイルRCA
 
OpenSIM 筋骨格シミュレーション 基本の解析マニュアル
OpenSIM 筋骨格シミュレーション 基本の解析マニュアルOpenSIM 筋骨格シミュレーション 基本の解析マニュアル
OpenSIM 筋骨格シミュレーション 基本の解析マニュアル
 
Sap audit _ Basic
Sap audit _ BasicSap audit _ Basic
Sap audit _ Basic
 
Upgrade to sap ecc 6 from short overview
Upgrade to sap ecc 6 from short overviewUpgrade to sap ecc 6 from short overview
Upgrade to sap ecc 6 from short overview
 
KubeEdgeを触ってみた
KubeEdgeを触ってみたKubeEdgeを触ってみた
KubeEdgeを触ってみた
 
チーム開発にSwiftLintを導入してみた・詳細版
チーム開発にSwiftLintを導入してみた・詳細版チーム開発にSwiftLintを導入してみた・詳細版
チーム開発にSwiftLintを導入してみた・詳細版
 
[DL Hacks]Model-Agnostic Meta-Learning for Fast Adaptation of Deep Network
[DL Hacks]Model-Agnostic Meta-Learning for Fast Adaptation of Deep Network[DL Hacks]Model-Agnostic Meta-Learning for Fast Adaptation of Deep Network
[DL Hacks]Model-Agnostic Meta-Learning for Fast Adaptation of Deep Network
 
Report Painter in SAP: Introduction
Report Painter in SAP: IntroductionReport Painter in SAP: Introduction
Report Painter in SAP: Introduction
 
SAP S4hana EWM Training
SAP S4hana EWM TrainingSAP S4hana EWM Training
SAP S4hana EWM Training
 
これからはじめる Power Platform
これからはじめる Power Platformこれからはじめる Power Platform
これからはじめる Power Platform
 
Wireshark入門 (2014版)
Wireshark入門 (2014版)Wireshark入門 (2014版)
Wireshark入門 (2014版)
 
モダナイゼーションがもたらす未来
モダナイゼーションがもたらす未来モダナイゼーションがもたらす未来
モダナイゼーションがもたらす未来
 
JIRAを使ったフツウのPJ実践
JIRAを使ったフツウのPJ実践JIRAを使ったフツウのPJ実践
JIRAを使ったフツウのPJ実践
 
Document Imaging - SAP Content Server and the Accounting Department
Document Imaging - SAP Content Server and the Accounting Department Document Imaging - SAP Content Server and the Accounting Department
Document Imaging - SAP Content Server and the Accounting Department
 
OpenMPI入門
OpenMPI入門OpenMPI入門
OpenMPI入門
 
SAP AC020 - Investment Management
SAP AC020 - Investment ManagementSAP AC020 - Investment Management
SAP AC020 - Investment Management
 
QGISの活用例を見てみよう
QGISの活用例を見てみようQGISの活用例を見てみよう
QGISの活用例を見てみよう
 
Zabbix監視運用業務の自動化事例
Zabbix監視運用業務の自動化事例Zabbix監視運用業務の自動化事例
Zabbix監視運用業務の自動化事例
 

Similar to Performing at your best turning words into numbers and numbers into data driven insights with Minitab, Python and Text Mining

Boost Your Data Expertise with the Latest Release of Minitab Statistical Soft...
Boost Your Data Expertise with the Latest Release of Minitab Statistical Soft...Boost Your Data Expertise with the Latest Release of Minitab Statistical Soft...
Boost Your Data Expertise with the Latest Release of Minitab Statistical Soft...
Minitab, LLC
 
Tips & Tricks for CART (Classification and Regression Trees) in Minitab Stati...
Tips & Tricks for CART (Classification and Regression Trees) in Minitab Stati...Tips & Tricks for CART (Classification and Regression Trees) in Minitab Stati...
Tips & Tricks for CART (Classification and Regression Trees) in Minitab Stati...
Minitab, LLC
 
Boost Your Data Expertise - What's New in Minitab 19.2020.1
Boost Your Data Expertise -  What's New in Minitab 19.2020.1Boost Your Data Expertise -  What's New in Minitab 19.2020.1
Boost Your Data Expertise - What's New in Minitab 19.2020.1
Minitab, LLC
 
Maximize Efficiency with Minitab Workspace and Minitab Statistical Software -...
Maximize Efficiency with Minitab Workspace and Minitab Statistical Software -...Maximize Efficiency with Minitab Workspace and Minitab Statistical Software -...
Maximize Efficiency with Minitab Workspace and Minitab Statistical Software -...
Minitab, LLC
 
Machine Learning with Classification & Regression Trees - APAC
Machine Learning with Classification & Regression Trees - APAC Machine Learning with Classification & Regression Trees - APAC
Machine Learning with Classification & Regression Trees - APAC
Minitab, LLC
 
Production model lifecycle management 2016 09
Production model lifecycle management 2016 09Production model lifecycle management 2016 09
Production model lifecycle management 2016 09
Greg Makowski
 
Machinelearning: The next step in manufacturing performance
Machinelearning: The next step in manufacturing performance Machinelearning: The next step in manufacturing performance
Machinelearning: The next step in manufacturing performance
Blackberry&Cross
 
Watson Analytics for HSE - Copy
Watson Analytics for HSE - CopyWatson Analytics for HSE - Copy
Watson Analytics for HSE - Copy
Alexei Cherenkov
 
Meet-Minitab-Connect-Oct-28-2020-Webinar-Slides.pdf
Meet-Minitab-Connect-Oct-28-2020-Webinar-Slides.pdfMeet-Minitab-Connect-Oct-28-2020-Webinar-Slides.pdf
Meet-Minitab-Connect-Oct-28-2020-Webinar-Slides.pdf
KaHina28
 
Discover the Hidden Gems in Webtrends Analytics
Discover the Hidden Gems in Webtrends AnalyticsDiscover the Hidden Gems in Webtrends Analytics
Discover the Hidden Gems in Webtrends Analytics
Webtrends
 
Discover the Hidden Gems in Webtrends Analytics
Discover the Hidden Gems in Webtrends AnalyticsDiscover the Hidden Gems in Webtrends Analytics
Discover the Hidden Gems in Webtrends Analytics
Webtrends
 
Visualizations that make an impact - see what s new in minitab statistical s...
Visualizations that make an impact  - see what s new in minitab statistical s...Visualizations that make an impact  - see what s new in minitab statistical s...
Visualizations that make an impact - see what s new in minitab statistical s...
Minitab, LLC
 
Innovation World 2008
Innovation World 2008Innovation World 2008
Innovation World 2008
Roman Stanek
 
Preparing for AI - Measurefest
Preparing for AI - MeasurefestPreparing for AI - Measurefest
Preparing for AI - Measurefest
Guido X Jansen
 
Rohit Nagpal_Resume
Rohit Nagpal_ResumeRohit Nagpal_Resume
Rohit Nagpal_Resume
rohitnagpal92
 
Role of Data in Digital Transformation
Role of Data in Digital TransformationRole of Data in Digital Transformation
Role of Data in Digital Transformation
VMware Tanzu
 
WMBT Team Pitch: Sustainability Management Platform
WMBT Team Pitch: Sustainability Management PlatformWMBT Team Pitch: Sustainability Management Platform
WMBT Team Pitch: Sustainability Management Platform
Kirill Zimin
 
Discover Minitab Workspace - The Ultimate Visual Toolkit to Elevate Your Work...
Discover Minitab Workspace - The Ultimate Visual Toolkit to Elevate Your Work...Discover Minitab Workspace - The Ultimate Visual Toolkit to Elevate Your Work...
Discover Minitab Workspace - The Ultimate Visual Toolkit to Elevate Your Work...
Minitab, LLC
 
23.pdf
23.pdf23.pdf
23.pdf
JeanJaggu
 
Business analytics and it's tools and competitive advantage
Business analytics and it's tools and competitive advantage Business analytics and it's tools and competitive advantage
Business analytics and it's tools and competitive advantage
reshmamajji123
 

Similar to Performing at your best turning words into numbers and numbers into data driven insights with Minitab, Python and Text Mining (20)

Boost Your Data Expertise with the Latest Release of Minitab Statistical Soft...
Boost Your Data Expertise with the Latest Release of Minitab Statistical Soft...Boost Your Data Expertise with the Latest Release of Minitab Statistical Soft...
Boost Your Data Expertise with the Latest Release of Minitab Statistical Soft...
 
Tips & Tricks for CART (Classification and Regression Trees) in Minitab Stati...
Tips & Tricks for CART (Classification and Regression Trees) in Minitab Stati...Tips & Tricks for CART (Classification and Regression Trees) in Minitab Stati...
Tips & Tricks for CART (Classification and Regression Trees) in Minitab Stati...
 
Boost Your Data Expertise - What's New in Minitab 19.2020.1
Boost Your Data Expertise -  What's New in Minitab 19.2020.1Boost Your Data Expertise -  What's New in Minitab 19.2020.1
Boost Your Data Expertise - What's New in Minitab 19.2020.1
 
Maximize Efficiency with Minitab Workspace and Minitab Statistical Software -...
Maximize Efficiency with Minitab Workspace and Minitab Statistical Software -...Maximize Efficiency with Minitab Workspace and Minitab Statistical Software -...
Maximize Efficiency with Minitab Workspace and Minitab Statistical Software -...
 
Machine Learning with Classification & Regression Trees - APAC
Machine Learning with Classification & Regression Trees - APAC Machine Learning with Classification & Regression Trees - APAC
Machine Learning with Classification & Regression Trees - APAC
 
Production model lifecycle management 2016 09
Production model lifecycle management 2016 09Production model lifecycle management 2016 09
Production model lifecycle management 2016 09
 
Machinelearning: The next step in manufacturing performance
Machinelearning: The next step in manufacturing performance Machinelearning: The next step in manufacturing performance
Machinelearning: The next step in manufacturing performance
 
Watson Analytics for HSE - Copy
Watson Analytics for HSE - CopyWatson Analytics for HSE - Copy
Watson Analytics for HSE - Copy
 
Meet-Minitab-Connect-Oct-28-2020-Webinar-Slides.pdf
Meet-Minitab-Connect-Oct-28-2020-Webinar-Slides.pdfMeet-Minitab-Connect-Oct-28-2020-Webinar-Slides.pdf
Meet-Minitab-Connect-Oct-28-2020-Webinar-Slides.pdf
 
Discover the Hidden Gems in Webtrends Analytics
Discover the Hidden Gems in Webtrends AnalyticsDiscover the Hidden Gems in Webtrends Analytics
Discover the Hidden Gems in Webtrends Analytics
 
Discover the Hidden Gems in Webtrends Analytics
Discover the Hidden Gems in Webtrends AnalyticsDiscover the Hidden Gems in Webtrends Analytics
Discover the Hidden Gems in Webtrends Analytics
 
Visualizations that make an impact - see what s new in minitab statistical s...
Visualizations that make an impact  - see what s new in minitab statistical s...Visualizations that make an impact  - see what s new in minitab statistical s...
Visualizations that make an impact - see what s new in minitab statistical s...
 
Innovation World 2008
Innovation World 2008Innovation World 2008
Innovation World 2008
 
Preparing for AI - Measurefest
Preparing for AI - MeasurefestPreparing for AI - Measurefest
Preparing for AI - Measurefest
 
Rohit Nagpal_Resume
Rohit Nagpal_ResumeRohit Nagpal_Resume
Rohit Nagpal_Resume
 
Role of Data in Digital Transformation
Role of Data in Digital TransformationRole of Data in Digital Transformation
Role of Data in Digital Transformation
 
WMBT Team Pitch: Sustainability Management Platform
WMBT Team Pitch: Sustainability Management PlatformWMBT Team Pitch: Sustainability Management Platform
WMBT Team Pitch: Sustainability Management Platform
 
Discover Minitab Workspace - The Ultimate Visual Toolkit to Elevate Your Work...
Discover Minitab Workspace - The Ultimate Visual Toolkit to Elevate Your Work...Discover Minitab Workspace - The Ultimate Visual Toolkit to Elevate Your Work...
Discover Minitab Workspace - The Ultimate Visual Toolkit to Elevate Your Work...
 
23.pdf
23.pdf23.pdf
23.pdf
 
Business analytics and it's tools and competitive advantage
Business analytics and it's tools and competitive advantage Business analytics and it's tools and competitive advantage
Business analytics and it's tools and competitive advantage
 

More from Minitab, LLC

L'art de la visualisation pour une meilleure compréhension des données
L'art de la visualisation pour une meilleure compréhension des donnéesL'art de la visualisation pour une meilleure compréhension des données
L'art de la visualisation pour une meilleure compréhension des données
Minitab, LLC
 
Pilotez le développement de vos produits et de vos procédés avec Minitab et M...
Pilotez le développement de vos produits et de vos procédés avec Minitab et M...Pilotez le développement de vos produits et de vos procédés avec Minitab et M...
Pilotez le développement de vos produits et de vos procédés avec Minitab et M...
Minitab, LLC
 
Introducing Graph Builder: Visualizations Built to Move You Forward
Introducing Graph Builder: Visualizations Built to Move You ForwardIntroducing Graph Builder: Visualizations Built to Move You Forward
Introducing Graph Builder: Visualizations Built to Move You Forward
Minitab, LLC
 
Les solutions Minitab pour développer vos produits selon les réglementations ...
Les solutions Minitab pour développer vos produits selon les réglementations ...Les solutions Minitab pour développer vos produits selon les réglementations ...
Les solutions Minitab pour développer vos produits selon les réglementations ...
Minitab, LLC
 
Minitab webinar presentation See the unknown with monte carlo simulation
Minitab webinar presentation See the unknown with monte carlo simulationMinitab webinar presentation See the unknown with monte carlo simulation
Minitab webinar presentation See the unknown with monte carlo simulation
Minitab, LLC
 
Concrétisez votre transformation digitale avec Minitab et Minitab Connect
Concrétisez votre transformation digitale avec Minitab et Minitab ConnectConcrétisez votre transformation digitale avec Minitab et Minitab Connect
Concrétisez votre transformation digitale avec Minitab et Minitab Connect
Minitab, LLC
 
En route vers l'excellence avec les solutions Minitab
En route vers l'excellence avec les solutions MinitabEn route vers l'excellence avec les solutions Minitab
En route vers l'excellence avec les solutions Minitab
Minitab, LLC
 
Meet Minitab Engage Your End-to-End Improvement Solution From Idea Generation...
Meet Minitab Engage Your End-to-End Improvement Solution From Idea Generation...Meet Minitab Engage Your End-to-End Improvement Solution From Idea Generation...
Meet Minitab Engage Your End-to-End Improvement Solution From Idea Generation...
Minitab, LLC
 
La puissance du machine learning et des algorithmes cart au service des métiers
La puissance du machine learning et des algorithmes cart au service des métiersLa puissance du machine learning et des algorithmes cart au service des métiers
La puissance du machine learning et des algorithmes cart au service des métiers
Minitab, LLC
 
Strukturierte problemloesung mit datenunterstuetzung
Strukturierte problemloesung mit datenunterstuetzungStrukturierte problemloesung mit datenunterstuetzung
Strukturierte problemloesung mit datenunterstuetzung
Minitab, LLC
 
Visualizaciones que crean impacto: Vea las novedades de Minitab Statistical ...
Visualizaciones que crean impacto:  Vea las novedades de Minitab Statistical ...Visualizaciones que crean impacto:  Vea las novedades de Minitab Statistical ...
Visualizaciones que crean impacto: Vea las novedades de Minitab Statistical ...
Minitab, LLC
 
Powerful Statistical Tools in the Pharmaceutical and Medical Devices Industry...
Powerful Statistical Tools in the Pharmaceutical and Medical Devices Industry...Powerful Statistical Tools in the Pharmaceutical and Medical Devices Industry...
Powerful Statistical Tools in the Pharmaceutical and Medical Devices Industry...
Minitab, LLC
 
Statistical solutions to help you with 5 FDA medical devices stages
Statistical solutions to help you with 5 FDA medical devices stagesStatistical solutions to help you with 5 FDA medical devices stages
Statistical solutions to help you with 5 FDA medical devices stages
Minitab, LLC
 
Machine Learning with Binary Logistic Regression - APAC
Machine Learning with Binary Logistic Regression - APACMachine Learning with Binary Logistic Regression - APAC
Machine Learning with Binary Logistic Regression - APAC
Minitab, LLC
 
Machine Learning with Multiple Regression - APAC
Machine Learning with Multiple Regression - APACMachine Learning with Multiple Regression - APAC
Machine Learning with Multiple Regression - APAC
Minitab, LLC
 
Unleashing the Power of Python Using the New Minitab/Python Integration Modul...
Unleashing the Power of Python Using the New Minitab/Python Integration Modul...Unleashing the Power of Python Using the New Minitab/Python Integration Modul...
Unleashing the Power of Python Using the New Minitab/Python Integration Modul...
Minitab, LLC
 
Einführung in den Minitab Workspace_Visuelle Toolkit zur Verbesserung Ihrer A...
Einführung in den Minitab Workspace_Visuelle Toolkit zur Verbesserung Ihrer A...Einführung in den Minitab Workspace_Visuelle Toolkit zur Verbesserung Ihrer A...
Einführung in den Minitab Workspace_Visuelle Toolkit zur Verbesserung Ihrer A...
Minitab, LLC
 
Melhore seu conhecimento sobre analise de dados com a versao mais recente do ...
Melhore seu conhecimento sobre analise de dados com a versao mais recente do ...Melhore seu conhecimento sobre analise de dados com a versao mais recente do ...
Melhore seu conhecimento sobre analise de dados com a versao mais recente do ...
Minitab, LLC
 
Pilotez, structurez et cartographiez vos processus avec minitab workspace
Pilotez, structurez et cartographiez vos processus avec minitab workspacePilotez, structurez et cartographiez vos processus avec minitab workspace
Pilotez, structurez et cartographiez vos processus avec minitab workspace
Minitab, LLC
 
Minitab Preview Training: Introduction to t-Tests for Manufacturing
Minitab Preview Training: Introduction to t-Tests for ManufacturingMinitab Preview Training: Introduction to t-Tests for Manufacturing
Minitab Preview Training: Introduction to t-Tests for Manufacturing
Minitab, LLC
 

More from Minitab, LLC (20)

L'art de la visualisation pour une meilleure compréhension des données
L'art de la visualisation pour une meilleure compréhension des donnéesL'art de la visualisation pour une meilleure compréhension des données
L'art de la visualisation pour une meilleure compréhension des données
 
Pilotez le développement de vos produits et de vos procédés avec Minitab et M...
Pilotez le développement de vos produits et de vos procédés avec Minitab et M...Pilotez le développement de vos produits et de vos procédés avec Minitab et M...
Pilotez le développement de vos produits et de vos procédés avec Minitab et M...
 
Introducing Graph Builder: Visualizations Built to Move You Forward
Introducing Graph Builder: Visualizations Built to Move You ForwardIntroducing Graph Builder: Visualizations Built to Move You Forward
Introducing Graph Builder: Visualizations Built to Move You Forward
 
Les solutions Minitab pour développer vos produits selon les réglementations ...
Les solutions Minitab pour développer vos produits selon les réglementations ...Les solutions Minitab pour développer vos produits selon les réglementations ...
Les solutions Minitab pour développer vos produits selon les réglementations ...
 
Minitab webinar presentation See the unknown with monte carlo simulation
Minitab webinar presentation See the unknown with monte carlo simulationMinitab webinar presentation See the unknown with monte carlo simulation
Minitab webinar presentation See the unknown with monte carlo simulation
 
Concrétisez votre transformation digitale avec Minitab et Minitab Connect
Concrétisez votre transformation digitale avec Minitab et Minitab ConnectConcrétisez votre transformation digitale avec Minitab et Minitab Connect
Concrétisez votre transformation digitale avec Minitab et Minitab Connect
 
En route vers l'excellence avec les solutions Minitab
En route vers l'excellence avec les solutions MinitabEn route vers l'excellence avec les solutions Minitab
En route vers l'excellence avec les solutions Minitab
 
Meet Minitab Engage Your End-to-End Improvement Solution From Idea Generation...
Meet Minitab Engage Your End-to-End Improvement Solution From Idea Generation...Meet Minitab Engage Your End-to-End Improvement Solution From Idea Generation...
Meet Minitab Engage Your End-to-End Improvement Solution From Idea Generation...
 
La puissance du machine learning et des algorithmes cart au service des métiers
La puissance du machine learning et des algorithmes cart au service des métiersLa puissance du machine learning et des algorithmes cart au service des métiers
La puissance du machine learning et des algorithmes cart au service des métiers
 
Strukturierte problemloesung mit datenunterstuetzung
Strukturierte problemloesung mit datenunterstuetzungStrukturierte problemloesung mit datenunterstuetzung
Strukturierte problemloesung mit datenunterstuetzung
 
Visualizaciones que crean impacto: Vea las novedades de Minitab Statistical ...
Visualizaciones que crean impacto:  Vea las novedades de Minitab Statistical ...Visualizaciones que crean impacto:  Vea las novedades de Minitab Statistical ...
Visualizaciones que crean impacto: Vea las novedades de Minitab Statistical ...
 
Powerful Statistical Tools in the Pharmaceutical and Medical Devices Industry...
Powerful Statistical Tools in the Pharmaceutical and Medical Devices Industry...Powerful Statistical Tools in the Pharmaceutical and Medical Devices Industry...
Powerful Statistical Tools in the Pharmaceutical and Medical Devices Industry...
 
Statistical solutions to help you with 5 FDA medical devices stages
Statistical solutions to help you with 5 FDA medical devices stagesStatistical solutions to help you with 5 FDA medical devices stages
Statistical solutions to help you with 5 FDA medical devices stages
 
Machine Learning with Binary Logistic Regression - APAC
Machine Learning with Binary Logistic Regression - APACMachine Learning with Binary Logistic Regression - APAC
Machine Learning with Binary Logistic Regression - APAC
 
Machine Learning with Multiple Regression - APAC
Machine Learning with Multiple Regression - APACMachine Learning with Multiple Regression - APAC
Machine Learning with Multiple Regression - APAC
 
Unleashing the Power of Python Using the New Minitab/Python Integration Modul...
Unleashing the Power of Python Using the New Minitab/Python Integration Modul...Unleashing the Power of Python Using the New Minitab/Python Integration Modul...
Unleashing the Power of Python Using the New Minitab/Python Integration Modul...
 
Einführung in den Minitab Workspace_Visuelle Toolkit zur Verbesserung Ihrer A...
Einführung in den Minitab Workspace_Visuelle Toolkit zur Verbesserung Ihrer A...Einführung in den Minitab Workspace_Visuelle Toolkit zur Verbesserung Ihrer A...
Einführung in den Minitab Workspace_Visuelle Toolkit zur Verbesserung Ihrer A...
 
Melhore seu conhecimento sobre analise de dados com a versao mais recente do ...
Melhore seu conhecimento sobre analise de dados com a versao mais recente do ...Melhore seu conhecimento sobre analise de dados com a versao mais recente do ...
Melhore seu conhecimento sobre analise de dados com a versao mais recente do ...
 
Pilotez, structurez et cartographiez vos processus avec minitab workspace
Pilotez, structurez et cartographiez vos processus avec minitab workspacePilotez, structurez et cartographiez vos processus avec minitab workspace
Pilotez, structurez et cartographiez vos processus avec minitab workspace
 
Minitab Preview Training: Introduction to t-Tests for Manufacturing
Minitab Preview Training: Introduction to t-Tests for ManufacturingMinitab Preview Training: Introduction to t-Tests for Manufacturing
Minitab Preview Training: Introduction to t-Tests for Manufacturing
 

Recently uploaded

welcome to presentation on Google Apps
welcome to   presentation on Google Appswelcome to   presentation on Google Apps
welcome to presentation on Google Apps
AsifKarimJim
 
Amazon Music Spelling Correction - SIGIR 2024
Amazon Music Spelling Correction - SIGIR 2024Amazon Music Spelling Correction - SIGIR 2024
Amazon Music Spelling Correction - SIGIR 2024
siddharth1729
 
AI - Your Startup Sidekick (Leveraging AI to Bootstrap a Lean Startup).pdf
AI - Your Startup Sidekick (Leveraging AI to Bootstrap a Lean Startup).pdfAI - Your Startup Sidekick (Leveraging AI to Bootstrap a Lean Startup).pdf
AI - Your Startup Sidekick (Leveraging AI to Bootstrap a Lean Startup).pdf
Daniel Zivkovic
 
ERP Software Solutions Provider in Coimbatore
ERP Software Solutions Provider in CoimbatoreERP Software Solutions Provider in Coimbatore
ERP Software Solutions Provider in Coimbatore
Nextskill Technologies
 
Fantastic Design Patterns and Where to use them No Notes.pdf
Fantastic Design Patterns and Where to use them No Notes.pdfFantastic Design Patterns and Where to use them No Notes.pdf
Fantastic Design Patterns and Where to use them No Notes.pdf
6m9p7qnjj8
 
Predicting Test Results without Execution (FSE 2024)
Predicting Test Results without Execution (FSE 2024)Predicting Test Results without Execution (FSE 2024)
Predicting Test Results without Execution (FSE 2024)
andrehoraa
 
Russian Girls Call Mumbai 🛵🚡9833363713 💃 Choose Best And Top Girl Service And...
Russian Girls Call Mumbai 🛵🚡9833363713 💃 Choose Best And Top Girl Service And...Russian Girls Call Mumbai 🛵🚡9833363713 💃 Choose Best And Top Girl Service And...
Russian Girls Call Mumbai 🛵🚡9833363713 💃 Choose Best And Top Girl Service And...
dream girl
 
UMiami degree offer diploma Transcript
UMiami degree offer diploma TranscriptUMiami degree offer diploma Transcript
UMiami degree offer diploma Transcript
attueb
 
Vip Girls Call ServiCe Hyderabad 0000000000 Pooja Best High Class Hyderabad A...
Vip Girls Call ServiCe Hyderabad 0000000000 Pooja Best High Class Hyderabad A...Vip Girls Call ServiCe Hyderabad 0000000000 Pooja Best High Class Hyderabad A...
Vip Girls Call ServiCe Hyderabad 0000000000 Pooja Best High Class Hyderabad A...
ashiklo9823
 
BATber53 AWS Modernize your applications with purpose-built AWS databases
BATber53 AWS Modernize your applications with purpose-built AWS databasesBATber53 AWS Modernize your applications with purpose-built AWS databases
BATber53 AWS Modernize your applications with purpose-built AWS databases
BATbern
 
To Avoid Mistakes When Using Online Attendance Sheets
To Avoid Mistakes When Using Online Attendance SheetsTo Avoid Mistakes When Using Online Attendance Sheets
To Avoid Mistakes When Using Online Attendance Sheets
Task Tracker
 
How To Fill Timesheet in TaskSprint: Quick Guide 2024
How To Fill Timesheet in TaskSprint: Quick Guide 2024How To Fill Timesheet in TaskSprint: Quick Guide 2024
How To Fill Timesheet in TaskSprint: Quick Guide 2024
TaskSprint | Employee Efficiency Software
 
Russian Girls Call Mumbai 🎈🔥9930687706 🔥💋🎈 Provide Best And Top Girl Service ...
Russian Girls Call Mumbai 🎈🔥9930687706 🔥💋🎈 Provide Best And Top Girl Service ...Russian Girls Call Mumbai 🎈🔥9930687706 🔥💋🎈 Provide Best And Top Girl Service ...
Russian Girls Call Mumbai 🎈🔥9930687706 🔥💋🎈 Provide Best And Top Girl Service ...
shanihomely
 
AWS DevOps-Tutorial CHANAKYA SRIYAN DUKKA.
AWS DevOps-Tutorial CHANAKYA SRIYAN DUKKA.AWS DevOps-Tutorial CHANAKYA SRIYAN DUKKA.
AWS DevOps-Tutorial CHANAKYA SRIYAN DUKKA.
Srinivas Dukka
 
Applitools Autonomous 2.0 Sneak Peek.pdf
Applitools Autonomous 2.0 Sneak Peek.pdfApplitools Autonomous 2.0 Sneak Peek.pdf
Applitools Autonomous 2.0 Sneak Peek.pdf
Applitools
 
Hotel Management Software Development Company
Hotel Management Software Development CompanyHotel Management Software Development Company
Hotel Management Software Development Company
XongoLab Technologies LLP
 
InflectraCON 360: Risk-Based Testing for Mission Critical Systems
InflectraCON 360: Risk-Based Testing for Mission Critical SystemsInflectraCON 360: Risk-Based Testing for Mission Critical Systems
InflectraCON 360: Risk-Based Testing for Mission Critical Systems
Inflectra
 
Maximizing Efficiency and Profitability: Optimizing Data Systems, Enhancing C...
Maximizing Efficiency and Profitability: Optimizing Data Systems, Enhancing C...Maximizing Efficiency and Profitability: Optimizing Data Systems, Enhancing C...
Maximizing Efficiency and Profitability: Optimizing Data Systems, Enhancing C...
OnePlan Solutions
 
Crafting highly scalable and performant Modern Data Platforms
Crafting highly scalable and performant Modern Data PlatformsCrafting highly scalable and performant Modern Data Platforms
Crafting highly scalable and performant Modern Data Platforms
Sameer Paradkar
 
SAP implementation steps PDF - Zyple Software
SAP implementation steps PDF - Zyple SoftwareSAP implementation steps PDF - Zyple Software
SAP implementation steps PDF - Zyple Software
Zyple Software
 

Recently uploaded (20)

welcome to presentation on Google Apps
welcome to   presentation on Google Appswelcome to   presentation on Google Apps
welcome to presentation on Google Apps
 
Amazon Music Spelling Correction - SIGIR 2024
Amazon Music Spelling Correction - SIGIR 2024Amazon Music Spelling Correction - SIGIR 2024
Amazon Music Spelling Correction - SIGIR 2024
 
AI - Your Startup Sidekick (Leveraging AI to Bootstrap a Lean Startup).pdf
AI - Your Startup Sidekick (Leveraging AI to Bootstrap a Lean Startup).pdfAI - Your Startup Sidekick (Leveraging AI to Bootstrap a Lean Startup).pdf
AI - Your Startup Sidekick (Leveraging AI to Bootstrap a Lean Startup).pdf
 
ERP Software Solutions Provider in Coimbatore
ERP Software Solutions Provider in CoimbatoreERP Software Solutions Provider in Coimbatore
ERP Software Solutions Provider in Coimbatore
 
Fantastic Design Patterns and Where to use them No Notes.pdf
Fantastic Design Patterns and Where to use them No Notes.pdfFantastic Design Patterns and Where to use them No Notes.pdf
Fantastic Design Patterns and Where to use them No Notes.pdf
 
Predicting Test Results without Execution (FSE 2024)
Predicting Test Results without Execution (FSE 2024)Predicting Test Results without Execution (FSE 2024)
Predicting Test Results without Execution (FSE 2024)
 
Russian Girls Call Mumbai 🛵🚡9833363713 💃 Choose Best And Top Girl Service And...
Russian Girls Call Mumbai 🛵🚡9833363713 💃 Choose Best And Top Girl Service And...Russian Girls Call Mumbai 🛵🚡9833363713 💃 Choose Best And Top Girl Service And...
Russian Girls Call Mumbai 🛵🚡9833363713 💃 Choose Best And Top Girl Service And...
 
UMiami degree offer diploma Transcript
UMiami degree offer diploma TranscriptUMiami degree offer diploma Transcript
UMiami degree offer diploma Transcript
 
Vip Girls Call ServiCe Hyderabad 0000000000 Pooja Best High Class Hyderabad A...
Vip Girls Call ServiCe Hyderabad 0000000000 Pooja Best High Class Hyderabad A...Vip Girls Call ServiCe Hyderabad 0000000000 Pooja Best High Class Hyderabad A...
Vip Girls Call ServiCe Hyderabad 0000000000 Pooja Best High Class Hyderabad A...
 
BATber53 AWS Modernize your applications with purpose-built AWS databases
BATber53 AWS Modernize your applications with purpose-built AWS databasesBATber53 AWS Modernize your applications with purpose-built AWS databases
BATber53 AWS Modernize your applications with purpose-built AWS databases
 
To Avoid Mistakes When Using Online Attendance Sheets
To Avoid Mistakes When Using Online Attendance SheetsTo Avoid Mistakes When Using Online Attendance Sheets
To Avoid Mistakes When Using Online Attendance Sheets
 
How To Fill Timesheet in TaskSprint: Quick Guide 2024
How To Fill Timesheet in TaskSprint: Quick Guide 2024How To Fill Timesheet in TaskSprint: Quick Guide 2024
How To Fill Timesheet in TaskSprint: Quick Guide 2024
 
Russian Girls Call Mumbai 🎈🔥9930687706 🔥💋🎈 Provide Best And Top Girl Service ...
Russian Girls Call Mumbai 🎈🔥9930687706 🔥💋🎈 Provide Best And Top Girl Service ...Russian Girls Call Mumbai 🎈🔥9930687706 🔥💋🎈 Provide Best And Top Girl Service ...
Russian Girls Call Mumbai 🎈🔥9930687706 🔥💋🎈 Provide Best And Top Girl Service ...
 
AWS DevOps-Tutorial CHANAKYA SRIYAN DUKKA.
AWS DevOps-Tutorial CHANAKYA SRIYAN DUKKA.AWS DevOps-Tutorial CHANAKYA SRIYAN DUKKA.
AWS DevOps-Tutorial CHANAKYA SRIYAN DUKKA.
 
Applitools Autonomous 2.0 Sneak Peek.pdf
Applitools Autonomous 2.0 Sneak Peek.pdfApplitools Autonomous 2.0 Sneak Peek.pdf
Applitools Autonomous 2.0 Sneak Peek.pdf
 
Hotel Management Software Development Company
Hotel Management Software Development CompanyHotel Management Software Development Company
Hotel Management Software Development Company
 
InflectraCON 360: Risk-Based Testing for Mission Critical Systems
InflectraCON 360: Risk-Based Testing for Mission Critical SystemsInflectraCON 360: Risk-Based Testing for Mission Critical Systems
InflectraCON 360: Risk-Based Testing for Mission Critical Systems
 
Maximizing Efficiency and Profitability: Optimizing Data Systems, Enhancing C...
Maximizing Efficiency and Profitability: Optimizing Data Systems, Enhancing C...Maximizing Efficiency and Profitability: Optimizing Data Systems, Enhancing C...
Maximizing Efficiency and Profitability: Optimizing Data Systems, Enhancing C...
 
Crafting highly scalable and performant Modern Data Platforms
Crafting highly scalable and performant Modern Data PlatformsCrafting highly scalable and performant Modern Data Platforms
Crafting highly scalable and performant Modern Data Platforms
 
SAP implementation steps PDF - Zyple Software
SAP implementation steps PDF - Zyple SoftwareSAP implementation steps PDF - Zyple Software
SAP implementation steps PDF - Zyple Software
 

Performing at your best turning words into numbers and numbers into data driven insights with Minitab, Python and Text Mining

  • 2. © 2020 Minitab, LLC. Mikhail has been prototyping new machine learning algorithms and modeling automation for 20 years, and he has been a major contributor to developing technological improvements to the most important algorithms in Machine Learning: CART®️ Decision Trees, MARS®️ Non-linear Regression, TreeNet®️ gradient boosting, and Random Forests®️. He holds master’s degrees both in rocket science from Kharkov State Polytechnic University in Ukraine and statistical computing from the University of Central Florida. Meet the Presenter: Mikhail Golovnya Minitab Senior Advisory Data Scientist
  • 3. © 2020 Minitab, LLC. The Challenge of Text Mining ► Data sets often have a character variable that contains a possibly long text (user feedback, comments, etc.) ► Such a variable will usually have as many distinct values as there are records in the dataset – thus, it cannot be used directly for modeling ► Core objective of Text Mining: Find ways to extract numeric measures from a text variable that can be used in quantitative modeling 3 Wine Review Excellent wine! HIGHLY Recomended LOVE IT; AWESOME! Too bitter, fordettable Love this wine Had better wine before
  • 4. © 2020 Minitab, LLC. Simple Text Statistics ► The following simple numeric summaries of the raw text itself can be extracted and used in quantitative analysis as derived numeric variables ▪ Total count of words ▪ Total count of characters ▪ Average word length (in characters) ▪ Count of stop-words (commonly occurring words) ▪ Count of numeric words (series of digits) ▪ Count of words written in all upper-case 4
  • 5. © 2020 Minitab, LLC. Simple Stats 5 Wine Review Excellent wine! HIGHLY Recomended LOVE IT; AWESOME. Too bitter, forgettable Love this wine Had beter wine before
  • 7. © 2020 Minitab, LLC. Text Cleaning Steps ► Raw text stats summarize the original text in its raw form ► The following steps (cleaning up) are normally employed to prepare a raw text variable for further analysis ▪ Converting all characters to lower case only ▪ Removing all punctuation ▪ Removing all stop-words ▪ Correct spelling errors ▪ Removing infrequent words ► More advanced analyses (semantic extraction, etc.) might omit some of the above steps 7
  • 8. © 2020 Minitab, LLC. Cleaning Up Process 8 Wine Review Excellent wine! Highly Recomended Love it; awesome. Too bitter, forgettable Love this wine Had beter wine before Wine Review excellent wine highly recommended love awesome bitter forgettable love wine better wine
  • 9. © 2020 Minitab, LLC. Summary Statistics ► The following summary statistics can now be computed and visualized for a “beautified” text variable ▪ Total word count for each word that “survived the beautification process” ▪ Inverse Document Frequency (IDF) for each word 𝐼𝐷𝐹 = log 𝑁 𝐷𝐹 here N – number of observations DF – number of documents where a given word occurs A word present in all observations has IDF=0 A word present in only one observation has the largest possible IDF ▪ Bar chart of the most frequently occurring words and their IDFs ▪ Word-cloud image of the most frequently occurring words 9
  • 10. © 2020 Minitab, LLC. Summary Statistics 10
  • 11. © 2020 Minitab, LLC. Word Counts 11
  • 12. © 2020 Minitab, LLC. Word IDFs 12
  • 13. © 2020 Minitab, LLC. Extracting Sentiment Values ► Sentiment value is a number that summarizes writer’s overall attitude based on the linguistic analysis of the text ▪ Positive sentiment reflects positive attitude ▪ Negative sentiment reflects negative attitude 13
  • 14. © 2020 Minitab, LLC. Creating a Bag of Words ► For each word create a new variable that reports how many times the word occurs in the text field ► To avoid explosion of new variables, the user might want to exclude infrequent words 14
  • 15. © 2020 Minitab, LLC. Extracting Singular Vectors 15
  • 16. © 2020 Minitab, LLC. Summary ► Reporting stage (text_summary.py) ▪ Word frequencies and IDFs ▪ Bar charts and word cloud ► Extracting stage (text_convert.py) ▪ Created original raw text statistics variables ▪ Cleaning up stage ▪ Created sentiment value variable ▪ Created bag of words variables ▪ Created singular vector variables ► We have solved the original text mining challenge: all these numeric variables summarize the original text variable and can be used in predictive modeling algorithms along with the rest of the predictors! 16
  • 17. © 2020 Minitab, LLC. Reporting Stage ► LET K1 = "reviews.csv“ – input data set ► LET K2 = "Review“ – text variable ► LET K3 = 1 – word count limit ► PYSC "text_summary.py“ – reporting script 17
  • 18. © 2020 Minitab, LLC. Extracting Stage ► LET K1 = "reviews.csv“ – input data set ► LET K2 = "Review“ – text variable ► LET K3 = 1 – word count limit ► LET K5 = 5 – number of singular vectors ► LET K6 = "reviews_bow.csv“ – bag of words dataset ► LET K7 = "reviews_svd.csv“ – singular vector dataset ► LET K8 = "reviews_lds.csv“ – word loadings ► PYSC "text_convert.py“ – extracting script 18
  • 19. © 2020 Minitab, LLC. Our Approach: More Than Business Analytics… Solutions Analytics Software Services Training Learn first-hand by attending public trainings or customized trainings according to your requirements. Statistical Consulting Personalized help with statistical challenges from collecting the right data to interpreting analysis more. Support Assistance with installation, implementation, version updates and license management. Master statistics and Minitab anywhere with online training Machine learning and predictive analytics software Start, track, manage and execute improvement projects with real-time dashboards Powerful statistical software everyone can use Data Analysis Predictive Modeling Visual Business Tools Project Oversight Visual tools to process and product excellence Online Training Solutions analytics is our integrated approach to providing software and services that enable organizations to make better decisions that drive business excellence.
  • 20. © 2020 Minitab, LLC. Upcoming Webinar Wednesdays Continue learning and working efficiently with our free webinar series: • A TEDx Coach’s Secrets To Developing Innovative Leaders and Ensuring They Thrive at Your Organization – July 15 info.minitab.com/resources/webinars/webinar-wednesdays Minitab Training is now virtual! Learn more at minitab.com/training
  • 21. © 2020 Minitab, LLC. Thank You! From all of us at