This is a Context based stemming or semantic stemming. It even goes beyond stemming hence it is named as Personalized derivative. User can even customize the output based on its domain by integrating ontologies .

1. Personalized Terms Derivative
Beyond Stemming
Root
Word 1
Word 2
Word 3
Root
Word 4
Word 5

2. What is PTD?
Semantic approach for Stemming
•Capabilities to include Ontology and Semantic dictionary like wordnet
Extends the meaning of stemming to hypernym and user defined root word
Includes linguistic and morphological stemming provided by Porter-Stemmer and K-
Stem

3. Algorithm Steps
Preprocessing
Word Sense
Disambiguation
Sense Annotation Relationship K-Stem

4. Architecture Flow Diagram
Extract
Sentences
Lemmatized each word in the
Sentences
Named Entity Extraction ,
Tokenization
Annotation
For Each
Sentences
For Each Tokens
If
Term
= N-E
Word Sense Disambiguation
for each word in a sentence
Right sense of each word ,
POS Identification
Tagging
If
POS
=
NN
For Each
Tokens
YES
YES
NO
Find Hypernym/Root word
NO (Till all terms
are processed
once)
Knowledge Data
Sources
Thesaurus
Dictionary,
Ontology
Create
Exclusion
List
K-Stemmer
If Root word
not found
Documents

5. Application Area
Search,
Index
Engine
(Solr, ES)
Personalized
Search
(Dictionary)
WEB
Search
(Google)
Targeted
Stemming
Text
Summarization
(Abstractive)

6. Comparison
Words Porter Stemmer PTD with PTD with
Ontology
Source Link
oncology oncolog oncology medical specialty https://www.ncbi.nlm.ni
h.gov/pmc/articles/PM
C3596793/
mutation mutation organism genetic variation https://www.ncbi.nlm.ni
h.gov/pmc/articles/PM
C3596793/
apoptosis apoptosi cell death cell physiological
processes
https://www.ncbi.nlm.ni
h.gov/pmc/articles/PM
C3596793/
biological biolog biological discipline https://www.ncbi.nlm.ni
h.gov/pmc/articles/PM
C3596793/
immune immun immune pathogeneses https://www.ncbi.nlm.ni
h.gov/pmc/articles/PM
C3596793/
cytarabine cytarabin cytarabine pyrimidine
nucleosides
https://www.ncbi.nlm.ni
h.gov/pmc/articles/PM
C3596793/
metastasis metastasi pathological
process
cancer
progression
https://www.ncbi.nlm.ni
h.gov/pmc/articles/PM
C2927383/

7. Demo
 Demo : http://apis.tekstosesense.com
 Source Code : https://github.com/TekstoSense/word-root-finder
 Home : http://www.tekstosense.com
 Source Code Home : https://github.com/TekstoSense/about-tekstosense