SlideShare a Scribd company logo
1 of 17
Download to read offline
Introduction Proposed Approach Natural Language Processing Complex Networks Results Conclusion Reference
Dynamics of Semantic Networks
of Independence Day Speeches
Prem Sankar C
Vinod Chandra S S
K. Satheesh Kumar
IC4 2018 - The International Conference on Control, Communication and Computing
Dept. of Futures Studies,University of Kerala
Introduction Proposed Approach Natural Language Processing Complex Networks Results Conclusion Reference
Outline
1 Introduction
2 Proposed Approach
3 Natural Language Processing
4 Complex Networks
5 Results
6 Conclusion
7 Reference
IC4 2018 - The International Conference on Control, Communication and Computing
Dept. of Futures Studies,University of Kerala
Introduction Proposed Approach Natural Language Processing Complex Networks Results Conclusion Reference
Introduction
1 Public speeches of governing people can be an ideal source of
information
Indication of current trends
Expected policies and Long-term plans
Pattern shifts in priorities
2 In this work, We proposed a new approach - semantic
linguistic networks for identifying semantic patterns from the
text corpus.
3 It is a combination of linguistic analysis, semantic knowledge
and complex network science concepts.
4 The complex network analysis is relevant to a wide range of
systems where individual units interact with each other.
5 It is a combination of graph theory and computer science.
IC4 2018 - The International Conference on Control, Communication and Computing
Dept. of Futures Studies,University of Kerala
Introduction Proposed Approach Natural Language Processing Complex Networks Results Conclusion Reference
Methodology
1 Preprocessing the text corpus
2 Construct complex networks of key terms.
3 Network Visualization and Analysis
Network Definition
Let G(E, V) be the graph derived from the speech text corpus,
where V denotes set of key terms (nodes), and E indicates the
co-occurrence of these terms in a sentence in the text corpus.
As a case study - we collected the text of Independence day
speeches of Indian Prime Ministers (2004-2014 period) and
and explored the dynamics of semantic relationships in the
networks.
IC4 2018 - The International Conference on Control, Communication and Computing
Dept. of Futures Studies,University of Kerala
Introduction Proposed Approach Natural Language Processing Complex Networks Results Conclusion Reference
Step1 - Data Preprocessing
Tokenization: Every word in the dataset is a treated as a
token
Normalization: All tokens were converted to lowercase
letters.
Removing stop words: Stop words are those which do not
provide any valuable information and in some cases even
reduce the quality of data.
Stemming process:is the process of reducing inflected (or
sometimes derived) words to their word stem, base or root
form.
Eg - helped, helping ... to help
The major key terms are identified after filtering stop words
and stemming process
IC4 2018 - The International Conference on Control, Communication and Computing
Dept. of Futures Studies,University of Kerala
Introduction Proposed Approach Natural Language Processing Complex Networks Results Conclusion Reference
Visualization of Semantic Networks
The visualization shows the dynamical changes of the network over
the years and reveals the hidden patterns.
IC4 2018 - The International Conference on Control, Communication and Computing
Dept. of Futures Studies,University of Kerala
Introduction Proposed Approach Natural Language Processing Complex Networks Results Conclusion Reference
Visualization of Semantic Networks (cont..)
If a set of nodes belongs to the similar community (node color), then the
semantic correlation between them will be relatively high. Modularity
iterative algorithm used for network clustering.
IC4 2018 - The International Conference on Control, Communication and Computing
Dept. of Futures Studies,University of Kerala
Introduction Proposed Approach Natural Language Processing Complex Networks Results Conclusion Reference
Visualization of Semantic Networks (cont..)
The influential keywords are identified using degree centrality
measures and represented with larger node size in the network.
IC4 2018 - The International Conference on Control, Communication and Computing
Dept. of Futures Studies,University of Kerala
Introduction Proposed Approach Natural Language Processing Complex Networks Results Conclusion Reference
Network Structural Properties
The number edges is increased with time
The density of networks increases over time.
IC4 2018 - The International Conference on Control, Communication and Computing
Dept. of Futures Studies,University of Kerala
Introduction Proposed Approach Natural Language Processing Complex Networks Results Conclusion Reference
Number of Edges V/s Years
650
700
750
800
850
900
950
2004 2006 2008 2010 2012 2014
NumberofEdges
Year
The number edges is increased with time
IC4 2018 - The International Conference on Control, Communication and Computing
Dept. of Futures Studies,University of Kerala
Introduction Proposed Approach Natural Language Processing Complex Networks Results Conclusion Reference
Density V/s Years
0.065
0.07
0.075
0.08
0.085
0.09
0.095
2004 2006 2008 2010 2012 2014
NetworkDensity
Year
The density of networks increases over time.
IC4 2018 - The International Conference on Control, Communication and Computing
Dept. of Futures Studies,University of Kerala
Introduction Proposed Approach Natural Language Processing Complex Networks Results Conclusion Reference
Comparison of Networks in 1947 and 2014
In 1947 the ”nation” is attached with work, dream, people, peace and soul.
In 2014 the ”nation” is attached with rural, health, child and economics.
In 1947, we were more into long-term strategic goals and deals with how to face the world as the new nation, but
in 2014 the primary focus is shifted from long-term goals to short terms goals. It mainly deals with how to tackle
with current issues and policies to overcome present bottlenecks.
IC4 2018 - The International Conference on Control, Communication and Computing
Dept. of Futures Studies,University of Kerala
Introduction Proposed Approach Natural Language Processing Complex Networks Results Conclusion Reference
Comparison of semantic connections of term ’Today’
1947 - Peace,service, achievement, fortune, and opportunity.
2014 -Child, Village, bank, rural, household, benefit and school
Indicates main concerns in (today) present scenario.
In 1947, after the independence, the primary focus indicate about the Equal opportunity for all people and
provide service to people and national and achieve peace.
In 2014 the main connections indicate about providing beneficial services like banking to rural villages,
provide education to every child through more schools.
IC4 2018 - The International Conference on Control, Communication and Computing
Dept. of Futures Studies,University of Kerala
Introduction Proposed Approach Natural Language Processing Complex Networks Results Conclusion Reference
Major Observations
The analysis shows the dynamic changes in the network in the local
semantic relationship between the keywords over the years and
reveals the hidden conceptual patterns.
The most frequently mentioned keywords are identified using degree
centrality and represented with larger node size in the network.
Helpful in identifying new key terms and its semantic relationships.
By comparing the networks of continuous years, we can easily detect
the shifts in semantic relationships of keyword e.g., banking.
In 2014, the relationship between rural, village and banking shows
that policy makers are interested to provide the banking service to
the rural villages and later Pradhan Mantri Jan Dhan Jojna -
Prime Minister Scheme focused on opening bank accounts for rural
and poor people was launched.
IC4 2018 - The International Conference on Control, Communication and Computing
Dept. of Futures Studies,University of Kerala
Introduction Proposed Approach Natural Language Processing Complex Networks Results Conclusion Reference
Conclusion
Our analysis shows that the complex network of a public text can
effectively be utilized to visualize the hidden semantic relationship
between different key terms in the corpus.
Semantic Linguistic analysis helps policy makers to identify most
dominant terms or semantic relationship between terms.
Based on the current Indian scenario, the semantic linguistic analysis
helps to shed light on the most influential policies in the years to come.
It also captures new policy terms and their moment of introduction and
traces the change in long-term semantic relationships between the key
policy terms.
We demonstrated a real world application of the complex network
analysis by analyzing and visualizing the text network of Independence
day speeches of Indian Prime Ministers.
IC4 2018 - The International Conference on Control, Communication and Computing
Dept. of Futures Studies,University of Kerala
Introduction Proposed Approach Natural Language Processing Complex Networks Results Conclusion Reference
Reference
M. Newman, Networks: an introduction. Oxford University
Press, 2009
D. Paranyushkin, “Visualization of texts polysingularity using
network analysis,” Prototype Letters, vol. 2, no. 3, pp.
256–278, 2011.
M. E. Newman, “Fast algorithm for detecting community
structure in networks,” Physical review E, vol. 69, no. 6, p.
066133, 2004.
S. Scott and S. Matwin, “Feature engineering for text
classification,” in ICML, vol. 99, 1999, pp. 379–388
IC4 2018 - The International Conference on Control, Communication and Computing
Dept. of Futures Studies,University of Kerala
Introduction Proposed Approach Natural Language Processing Complex Networks Results Conclusion Reference
Thank You. . . .
Acknowledgement
The authors wish to express their gratitude to the Campus
Computing Facility at University of Kerala set up under DST purse
programme for providing their facilities.
Presented By
Prem Sankar C
Research Scholar
Department of Futures Studies
University of Kerala- India
IC4 2018 - The International Conference on Control, Communication and Computing
Dept. of Futures Studies,University of Kerala

More Related Content

What's hot

Named Entity Recognition System for Hindi Language: A Hybrid Approach
Named Entity Recognition System for Hindi Language: A Hybrid ApproachNamed Entity Recognition System for Hindi Language: A Hybrid Approach
Named Entity Recognition System for Hindi Language: A Hybrid ApproachWaqas Tariq
 
A scoring rubric for automatic short answer grading system
A scoring rubric for automatic short answer grading systemA scoring rubric for automatic short answer grading system
A scoring rubric for automatic short answer grading systemTELKOMNIKA JOURNAL
 
A Design and Solving LPP Method for Binary Linear Programming Problem Using D...
A Design and Solving LPP Method for Binary Linear Programming Problem Using D...A Design and Solving LPP Method for Binary Linear Programming Problem Using D...
A Design and Solving LPP Method for Binary Linear Programming Problem Using D...ijistjournal
 
2015-SemEval2015_poster
2015-SemEval2015_poster2015-SemEval2015_poster
2015-SemEval2015_posterhpcosta
 
Ehsan ataei criticalreview call
Ehsan ataei criticalreview callEhsan ataei criticalreview call
Ehsan ataei criticalreview callEhsan Ataei
 
IRJET- Multi-Document Summarization using Fuzzy and Hierarchical Approach
IRJET-  	  Multi-Document Summarization using Fuzzy and Hierarchical ApproachIRJET-  	  Multi-Document Summarization using Fuzzy and Hierarchical Approach
IRJET- Multi-Document Summarization using Fuzzy and Hierarchical ApproachIRJET Journal
 
Loveland 090731 Naep Tech Lit Outreach
Loveland 090731 Naep Tech Lit OutreachLoveland 090731 Naep Tech Lit Outreach
Loveland 090731 Naep Tech Lit OutreachIntro Engineering
 

What's hot (8)

Named Entity Recognition System for Hindi Language: A Hybrid Approach
Named Entity Recognition System for Hindi Language: A Hybrid ApproachNamed Entity Recognition System for Hindi Language: A Hybrid Approach
Named Entity Recognition System for Hindi Language: A Hybrid Approach
 
A scoring rubric for automatic short answer grading system
A scoring rubric for automatic short answer grading systemA scoring rubric for automatic short answer grading system
A scoring rubric for automatic short answer grading system
 
A Design and Solving LPP Method for Binary Linear Programming Problem Using D...
A Design and Solving LPP Method for Binary Linear Programming Problem Using D...A Design and Solving LPP Method for Binary Linear Programming Problem Using D...
A Design and Solving LPP Method for Binary Linear Programming Problem Using D...
 
2015-SemEval2015_poster
2015-SemEval2015_poster2015-SemEval2015_poster
2015-SemEval2015_poster
 
Ehsan ataei criticalreview call
Ehsan ataei criticalreview callEhsan ataei criticalreview call
Ehsan ataei criticalreview call
 
IRJET- Multi-Document Summarization using Fuzzy and Hierarchical Approach
IRJET-  	  Multi-Document Summarization using Fuzzy and Hierarchical ApproachIRJET-  	  Multi-Document Summarization using Fuzzy and Hierarchical Approach
IRJET- Multi-Document Summarization using Fuzzy and Hierarchical Approach
 
full.draft
full.draftfull.draft
full.draft
 
Loveland 090731 Naep Tech Lit Outreach
Loveland 090731 Naep Tech Lit OutreachLoveland 090731 Naep Tech Lit Outreach
Loveland 090731 Naep Tech Lit Outreach
 

Similar to Dynamics of Semantic Networks of Independence Day Speeches

List of Journal after read the abstract.docx
List of Journal after read the abstract.docxList of Journal after read the abstract.docx
List of Journal after read the abstract.docxAdieYadie1
 
Knowledge Graph and Similarity Based Retrieval Method for Query Answering System
Knowledge Graph and Similarity Based Retrieval Method for Query Answering SystemKnowledge Graph and Similarity Based Retrieval Method for Query Answering System
Knowledge Graph and Similarity Based Retrieval Method for Query Answering SystemIRJET Journal
 
A Novel approach for Document Clustering using Concept Extraction
A Novel approach for Document Clustering using Concept ExtractionA Novel approach for Document Clustering using Concept Extraction
A Novel approach for Document Clustering using Concept ExtractionAM Publications
 
IRJET-Semantic Based Document Clustering Using Lexical Chains
IRJET-Semantic Based Document Clustering Using Lexical ChainsIRJET-Semantic Based Document Clustering Using Lexical Chains
IRJET-Semantic Based Document Clustering Using Lexical ChainsIRJET Journal
 
Semantic Based Document Clustering Using Lexical Chains
Semantic Based Document Clustering Using Lexical ChainsSemantic Based Document Clustering Using Lexical Chains
Semantic Based Document Clustering Using Lexical ChainsIRJET Journal
 
2011 04-04 (educon2011) emadrid etovar upm finding oers with social semantic ...
2011 04-04 (educon2011) emadrid etovar upm finding oers with social semantic ...2011 04-04 (educon2011) emadrid etovar upm finding oers with social semantic ...
2011 04-04 (educon2011) emadrid etovar upm finding oers with social semantic ...eMadrid network
 
An in-depth review on News Classification through NLP
An in-depth review on News Classification through NLPAn in-depth review on News Classification through NLP
An in-depth review on News Classification through NLPIRJET Journal
 
Profiling Linked Open Data
Profiling Linked Open DataProfiling Linked Open Data
Profiling Linked Open DataBlerina Spahiu
 
Digital Tools for the Classroom --ISTE Standards Students
Digital Tools for the Classroom --ISTE Standards StudentsDigital Tools for the Classroom --ISTE Standards Students
Digital Tools for the Classroom --ISTE Standards StudentsNAFCareerAcads
 
SENTIMENT ANALYSIS IN MYANMAR LANGUAGE USING CONVOLUTIONAL LSTM NEURAL NETWORK
SENTIMENT ANALYSIS IN MYANMAR LANGUAGE USING CONVOLUTIONAL LSTM NEURAL NETWORKSENTIMENT ANALYSIS IN MYANMAR LANGUAGE USING CONVOLUTIONAL LSTM NEURAL NETWORK
SENTIMENT ANALYSIS IN MYANMAR LANGUAGE USING CONVOLUTIONAL LSTM NEURAL NETWORKijnlc
 
Sentiment Analysis In Myanmar Language Using Convolutional Lstm Neural Network
Sentiment Analysis In Myanmar Language Using Convolutional Lstm Neural NetworkSentiment Analysis In Myanmar Language Using Convolutional Lstm Neural Network
Sentiment Analysis In Myanmar Language Using Convolutional Lstm Neural Networkkevig
 
PATHS state of the art monitoring report
PATHS state of the art monitoring reportPATHS state of the art monitoring report
PATHS state of the art monitoring reportpathsproject
 
Engaging Information Professionals in the Process of Authoritative Interlinki...
Engaging Information Professionals in the Process of Authoritative Interlinki...Engaging Information Professionals in the Process of Authoritative Interlinki...
Engaging Information Professionals in the Process of Authoritative Interlinki...Lucy McKenna
 
Design strategies for mobile language learning effectiveness using hybrid mcd...
Design strategies for mobile language learning effectiveness using hybrid mcd...Design strategies for mobile language learning effectiveness using hybrid mcd...
Design strategies for mobile language learning effectiveness using hybrid mcd...Alexander Decker
 
Visualizing the Maturing Global API Ecosystem
Visualizing the Maturing Global API EcosystemVisualizing the Maturing Global API Ecosystem
Visualizing the Maturing Global API EcosystemSaeidHeshmatisafa1
 
Irjet v4 i73A Survey on Student’s Academic Experiences using Social Media Data53
Irjet v4 i73A Survey on Student’s Academic Experiences using Social Media Data53Irjet v4 i73A Survey on Student’s Academic Experiences using Social Media Data53
Irjet v4 i73A Survey on Student’s Academic Experiences using Social Media Data53IRJET Journal
 

Similar to Dynamics of Semantic Networks of Independence Day Speeches (20)

List of Journal after read the abstract.docx
List of Journal after read the abstract.docxList of Journal after read the abstract.docx
List of Journal after read the abstract.docx
 
Knowledge Graph and Similarity Based Retrieval Method for Query Answering System
Knowledge Graph and Similarity Based Retrieval Method for Query Answering SystemKnowledge Graph and Similarity Based Retrieval Method for Query Answering System
Knowledge Graph and Similarity Based Retrieval Method for Query Answering System
 
A Novel approach for Document Clustering using Concept Extraction
A Novel approach for Document Clustering using Concept ExtractionA Novel approach for Document Clustering using Concept Extraction
A Novel approach for Document Clustering using Concept Extraction
 
QR Cache Poster
QR Cache PosterQR Cache Poster
QR Cache Poster
 
IRJET-Semantic Based Document Clustering Using Lexical Chains
IRJET-Semantic Based Document Clustering Using Lexical ChainsIRJET-Semantic Based Document Clustering Using Lexical Chains
IRJET-Semantic Based Document Clustering Using Lexical Chains
 
Semantic Based Document Clustering Using Lexical Chains
Semantic Based Document Clustering Using Lexical ChainsSemantic Based Document Clustering Using Lexical Chains
Semantic Based Document Clustering Using Lexical Chains
 
M045067275
M045067275M045067275
M045067275
 
2011 04-04 (educon2011) emadrid etovar upm finding oers with social semantic ...
2011 04-04 (educon2011) emadrid etovar upm finding oers with social semantic ...2011 04-04 (educon2011) emadrid etovar upm finding oers with social semantic ...
2011 04-04 (educon2011) emadrid etovar upm finding oers with social semantic ...
 
An in-depth review on News Classification through NLP
An in-depth review on News Classification through NLPAn in-depth review on News Classification through NLP
An in-depth review on News Classification through NLP
 
Profiling Linked Open Data
Profiling Linked Open DataProfiling Linked Open Data
Profiling Linked Open Data
 
US-India Workshop Report
US-India Workshop ReportUS-India Workshop Report
US-India Workshop Report
 
Lookingforwardenglish
LookingforwardenglishLookingforwardenglish
Lookingforwardenglish
 
Digital Tools for the Classroom --ISTE Standards Students
Digital Tools for the Classroom --ISTE Standards StudentsDigital Tools for the Classroom --ISTE Standards Students
Digital Tools for the Classroom --ISTE Standards Students
 
SENTIMENT ANALYSIS IN MYANMAR LANGUAGE USING CONVOLUTIONAL LSTM NEURAL NETWORK
SENTIMENT ANALYSIS IN MYANMAR LANGUAGE USING CONVOLUTIONAL LSTM NEURAL NETWORKSENTIMENT ANALYSIS IN MYANMAR LANGUAGE USING CONVOLUTIONAL LSTM NEURAL NETWORK
SENTIMENT ANALYSIS IN MYANMAR LANGUAGE USING CONVOLUTIONAL LSTM NEURAL NETWORK
 
Sentiment Analysis In Myanmar Language Using Convolutional Lstm Neural Network
Sentiment Analysis In Myanmar Language Using Convolutional Lstm Neural NetworkSentiment Analysis In Myanmar Language Using Convolutional Lstm Neural Network
Sentiment Analysis In Myanmar Language Using Convolutional Lstm Neural Network
 
PATHS state of the art monitoring report
PATHS state of the art monitoring reportPATHS state of the art monitoring report
PATHS state of the art monitoring report
 
Engaging Information Professionals in the Process of Authoritative Interlinki...
Engaging Information Professionals in the Process of Authoritative Interlinki...Engaging Information Professionals in the Process of Authoritative Interlinki...
Engaging Information Professionals in the Process of Authoritative Interlinki...
 
Design strategies for mobile language learning effectiveness using hybrid mcd...
Design strategies for mobile language learning effectiveness using hybrid mcd...Design strategies for mobile language learning effectiveness using hybrid mcd...
Design strategies for mobile language learning effectiveness using hybrid mcd...
 
Visualizing the Maturing Global API Ecosystem
Visualizing the Maturing Global API EcosystemVisualizing the Maturing Global API Ecosystem
Visualizing the Maturing Global API Ecosystem
 
Irjet v4 i73A Survey on Student’s Academic Experiences using Social Media Data53
Irjet v4 i73A Survey on Student’s Academic Experiences using Social Media Data53Irjet v4 i73A Survey on Student’s Academic Experiences using Social Media Data53
Irjet v4 i73A Survey on Student’s Academic Experiences using Social Media Data53
 

More from Premsankar Chakkingal

AI for Educators - Integrating AI in the Classrooms
AI for Educators - Integrating AI in the ClassroomsAI for Educators - Integrating AI in the Classrooms
AI for Educators - Integrating AI in the ClassroomsPremsankar Chakkingal
 
Introduction to Computational Social Science
Introduction to Computational Social ScienceIntroduction to Computational Social Science
Introduction to Computational Social SciencePremsankar Chakkingal
 
Introductory Talk on Social Network Analysis at Facebook Developer Circle Me...
Introductory Talk on Social Network Analysis  at Facebook Developer Circle Me...Introductory Talk on Social Network Analysis  at Facebook Developer Circle Me...
Introductory Talk on Social Network Analysis at Facebook Developer Circle Me...Premsankar Chakkingal
 
Introduction to Agent Based Modeling Using NetLogo
Introduction to Agent Based Modeling Using NetLogoIntroduction to Agent Based Modeling Using NetLogo
Introduction to Agent Based Modeling Using NetLogoPremsankar Chakkingal
 
Introduction to Technology Assessments As tool for Forecasting and evaluation...
Introduction to Technology Assessments As tool for Forecasting and evaluation...Introduction to Technology Assessments As tool for Forecasting and evaluation...
Introduction to Technology Assessments As tool for Forecasting and evaluation...Premsankar Chakkingal
 
INTRODUCTION INFORMATION RETRIEVAL EVALUVATION
 INTRODUCTION INFORMATION RETRIEVAL EVALUVATION INTRODUCTION INFORMATION RETRIEVAL EVALUVATION
INTRODUCTION INFORMATION RETRIEVAL EVALUVATIONPremsankar Chakkingal
 
Negotiated Studies - A semantic social network based expert recommender system
Negotiated Studies - A semantic social network based expert recommender systemNegotiated Studies - A semantic social network based expert recommender system
Negotiated Studies - A semantic social network based expert recommender systemPremsankar Chakkingal
 
Business potential of Energy Auditing in Kerala
Business potential of Energy Auditing in KeralaBusiness potential of Energy Auditing in Kerala
Business potential of Energy Auditing in KeralaPremsankar Chakkingal
 
Negotiated Studies Presentation on Social Network Analysis of Knowledge Networks
Negotiated Studies Presentation on Social Network Analysis of Knowledge NetworksNegotiated Studies Presentation on Social Network Analysis of Knowledge Networks
Negotiated Studies Presentation on Social Network Analysis of Knowledge NetworksPremsankar Chakkingal
 
Introduction to Social Network Analysis
Introduction to Social Network AnalysisIntroduction to Social Network Analysis
Introduction to Social Network AnalysisPremsankar Chakkingal
 

More from Premsankar Chakkingal (14)

AI for Educators - Integrating AI in the Classrooms
AI for Educators - Integrating AI in the ClassroomsAI for Educators - Integrating AI in the Classrooms
AI for Educators - Integrating AI in the Classrooms
 
AI in Creative Space
AI in Creative SpaceAI in Creative Space
AI in Creative Space
 
Introduction to Computational Social Science
Introduction to Computational Social ScienceIntroduction to Computational Social Science
Introduction to Computational Social Science
 
Introductory Talk on Social Network Analysis at Facebook Developer Circle Me...
Introductory Talk on Social Network Analysis  at Facebook Developer Circle Me...Introductory Talk on Social Network Analysis  at Facebook Developer Circle Me...
Introductory Talk on Social Network Analysis at Facebook Developer Circle Me...
 
Introduction to Agent Based Modeling Using NetLogo
Introduction to Agent Based Modeling Using NetLogoIntroduction to Agent Based Modeling Using NetLogo
Introduction to Agent Based Modeling Using NetLogo
 
Introduction to Technology Assessments As tool for Forecasting and evaluation...
Introduction to Technology Assessments As tool for Forecasting and evaluation...Introduction to Technology Assessments As tool for Forecasting and evaluation...
Introduction to Technology Assessments As tool for Forecasting and evaluation...
 
INTRODUCTION INFORMATION RETRIEVAL EVALUVATION
 INTRODUCTION INFORMATION RETRIEVAL EVALUVATION INTRODUCTION INFORMATION RETRIEVAL EVALUVATION
INTRODUCTION INFORMATION RETRIEVAL EVALUVATION
 
Negotiated Studies - A semantic social network based expert recommender system
Negotiated Studies - A semantic social network based expert recommender systemNegotiated Studies - A semantic social network based expert recommender system
Negotiated Studies - A semantic social network based expert recommender system
 
Business potential of Energy Auditing in Kerala
Business potential of Energy Auditing in KeralaBusiness potential of Energy Auditing in Kerala
Business potential of Energy Auditing in Kerala
 
Introduction to Graph Theory
Introduction to Graph TheoryIntroduction to Graph Theory
Introduction to Graph Theory
 
Negotiated Studies Presentation on Social Network Analysis of Knowledge Networks
Negotiated Studies Presentation on Social Network Analysis of Knowledge NetworksNegotiated Studies Presentation on Social Network Analysis of Knowledge Networks
Negotiated Studies Presentation on Social Network Analysis of Knowledge Networks
 
Introduction to Social Network Analysis
Introduction to Social Network AnalysisIntroduction to Social Network Analysis
Introduction to Social Network Analysis
 
Hypothesis Testing for Beginners
Hypothesis Testing for BeginnersHypothesis Testing for Beginners
Hypothesis Testing for Beginners
 
Introduction to Genetic Algorithms
Introduction to Genetic AlgorithmsIntroduction to Genetic Algorithms
Introduction to Genetic Algorithms
 

Recently uploaded

{Pooja: 9892124323 } Call Girl in Mumbai | Jas Kaur Rate 4500 Free Hotel Del...
{Pooja:  9892124323 } Call Girl in Mumbai | Jas Kaur Rate 4500 Free Hotel Del...{Pooja:  9892124323 } Call Girl in Mumbai | Jas Kaur Rate 4500 Free Hotel Del...
{Pooja: 9892124323 } Call Girl in Mumbai | Jas Kaur Rate 4500 Free Hotel Del...Pooja Nehwal
 
Beautiful Sapna Vip Call Girls Hauz Khas 9711199012 Call /Whatsapps
Beautiful Sapna Vip  Call Girls Hauz Khas 9711199012 Call /WhatsappsBeautiful Sapna Vip  Call Girls Hauz Khas 9711199012 Call /Whatsapps
Beautiful Sapna Vip Call Girls Hauz Khas 9711199012 Call /Whatsappssapnasaifi408
 
Schema on read is obsolete. Welcome metaprogramming..pdf
Schema on read is obsolete. Welcome metaprogramming..pdfSchema on read is obsolete. Welcome metaprogramming..pdf
Schema on read is obsolete. Welcome metaprogramming..pdfLars Albertsson
 
VIP Call Girls Service Miyapur Hyderabad Call +91-8250192130
VIP Call Girls Service Miyapur Hyderabad Call +91-8250192130VIP Call Girls Service Miyapur Hyderabad Call +91-8250192130
VIP Call Girls Service Miyapur Hyderabad Call +91-8250192130Suhani Kapoor
 
Data Science Jobs and Salaries Analysis.pptx
Data Science Jobs and Salaries Analysis.pptxData Science Jobs and Salaries Analysis.pptx
Data Science Jobs and Salaries Analysis.pptxFurkanTasci3
 
20240419 - Measurecamp Amsterdam - SAM.pdf
20240419 - Measurecamp Amsterdam - SAM.pdf20240419 - Measurecamp Amsterdam - SAM.pdf
20240419 - Measurecamp Amsterdam - SAM.pdfHuman37
 
(PARI) Call Girls Wanowrie ( 7001035870 ) HI-Fi Pune Escorts Service
(PARI) Call Girls Wanowrie ( 7001035870 ) HI-Fi Pune Escorts Service(PARI) Call Girls Wanowrie ( 7001035870 ) HI-Fi Pune Escorts Service
(PARI) Call Girls Wanowrie ( 7001035870 ) HI-Fi Pune Escorts Serviceranjana rawat
 
VIP Call Girls in Amravati Aarohi 8250192130 Independent Escort Service Amravati
VIP Call Girls in Amravati Aarohi 8250192130 Independent Escort Service AmravatiVIP Call Girls in Amravati Aarohi 8250192130 Independent Escort Service Amravati
VIP Call Girls in Amravati Aarohi 8250192130 Independent Escort Service AmravatiSuhani Kapoor
 
Customer Service Analytics - Make Sense of All Your Data.pptx
Customer Service Analytics - Make Sense of All Your Data.pptxCustomer Service Analytics - Make Sense of All Your Data.pptx
Customer Service Analytics - Make Sense of All Your Data.pptxEmmanuel Dauda
 
EMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM TRACKING WITH GOOGLE ANALYTICS.pptx
EMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM  TRACKING WITH GOOGLE ANALYTICS.pptxEMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM  TRACKING WITH GOOGLE ANALYTICS.pptx
EMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM TRACKING WITH GOOGLE ANALYTICS.pptxthyngster
 
Unveiling Insights: The Role of a Data Analyst
Unveiling Insights: The Role of a Data AnalystUnveiling Insights: The Role of a Data Analyst
Unveiling Insights: The Role of a Data AnalystSamantha Rae Coolbeth
 
Market Analysis in the 5 Largest Economic Countries in Southeast Asia.pdf
Market Analysis in the 5 Largest Economic Countries in Southeast Asia.pdfMarket Analysis in the 5 Largest Economic Countries in Southeast Asia.pdf
Market Analysis in the 5 Largest Economic Countries in Southeast Asia.pdfRachmat Ramadhan H
 
Kantar AI Summit- Under Embargo till Wednesday, 24th April 2024, 4 PM, IST.pdf
Kantar AI Summit- Under Embargo till Wednesday, 24th April 2024, 4 PM, IST.pdfKantar AI Summit- Under Embargo till Wednesday, 24th April 2024, 4 PM, IST.pdf
Kantar AI Summit- Under Embargo till Wednesday, 24th April 2024, 4 PM, IST.pdfSocial Samosa
 
Indian Call Girls in Abu Dhabi O5286O24O8 Call Girls in Abu Dhabi By Independ...
Indian Call Girls in Abu Dhabi O5286O24O8 Call Girls in Abu Dhabi By Independ...Indian Call Girls in Abu Dhabi O5286O24O8 Call Girls in Abu Dhabi By Independ...
Indian Call Girls in Abu Dhabi O5286O24O8 Call Girls in Abu Dhabi By Independ...dajasot375
 
Brighton SEO | April 2024 | Data Storytelling
Brighton SEO | April 2024 | Data StorytellingBrighton SEO | April 2024 | Data Storytelling
Brighton SEO | April 2024 | Data StorytellingNeil Barnes
 
꧁❤ Greater Noida Call Girls Delhi ❤꧂ 9711199171 ☎️ Hard And Sexy Vip Call
꧁❤ Greater Noida Call Girls Delhi ❤꧂ 9711199171 ☎️ Hard And Sexy Vip Call꧁❤ Greater Noida Call Girls Delhi ❤꧂ 9711199171 ☎️ Hard And Sexy Vip Call
꧁❤ Greater Noida Call Girls Delhi ❤꧂ 9711199171 ☎️ Hard And Sexy Vip Callshivangimorya083
 
Data Science Project: Advancements in Fetal Health Classification
Data Science Project: Advancements in Fetal Health ClassificationData Science Project: Advancements in Fetal Health Classification
Data Science Project: Advancements in Fetal Health ClassificationBoston Institute of Analytics
 
Full night 🥵 Call Girls Delhi New Friends Colony {9711199171} Sanya Reddy ✌️o...
Full night 🥵 Call Girls Delhi New Friends Colony {9711199171} Sanya Reddy ✌️o...Full night 🥵 Call Girls Delhi New Friends Colony {9711199171} Sanya Reddy ✌️o...
Full night 🥵 Call Girls Delhi New Friends Colony {9711199171} Sanya Reddy ✌️o...shivangimorya083
 

Recently uploaded (20)

{Pooja: 9892124323 } Call Girl in Mumbai | Jas Kaur Rate 4500 Free Hotel Del...
{Pooja:  9892124323 } Call Girl in Mumbai | Jas Kaur Rate 4500 Free Hotel Del...{Pooja:  9892124323 } Call Girl in Mumbai | Jas Kaur Rate 4500 Free Hotel Del...
{Pooja: 9892124323 } Call Girl in Mumbai | Jas Kaur Rate 4500 Free Hotel Del...
 
Beautiful Sapna Vip Call Girls Hauz Khas 9711199012 Call /Whatsapps
Beautiful Sapna Vip  Call Girls Hauz Khas 9711199012 Call /WhatsappsBeautiful Sapna Vip  Call Girls Hauz Khas 9711199012 Call /Whatsapps
Beautiful Sapna Vip Call Girls Hauz Khas 9711199012 Call /Whatsapps
 
Schema on read is obsolete. Welcome metaprogramming..pdf
Schema on read is obsolete. Welcome metaprogramming..pdfSchema on read is obsolete. Welcome metaprogramming..pdf
Schema on read is obsolete. Welcome metaprogramming..pdf
 
VIP Call Girls Service Miyapur Hyderabad Call +91-8250192130
VIP Call Girls Service Miyapur Hyderabad Call +91-8250192130VIP Call Girls Service Miyapur Hyderabad Call +91-8250192130
VIP Call Girls Service Miyapur Hyderabad Call +91-8250192130
 
Delhi 99530 vip 56974 Genuine Escort Service Call Girls in Kishangarh
Delhi 99530 vip 56974 Genuine Escort Service Call Girls in  KishangarhDelhi 99530 vip 56974 Genuine Escort Service Call Girls in  Kishangarh
Delhi 99530 vip 56974 Genuine Escort Service Call Girls in Kishangarh
 
Data Science Jobs and Salaries Analysis.pptx
Data Science Jobs and Salaries Analysis.pptxData Science Jobs and Salaries Analysis.pptx
Data Science Jobs and Salaries Analysis.pptx
 
20240419 - Measurecamp Amsterdam - SAM.pdf
20240419 - Measurecamp Amsterdam - SAM.pdf20240419 - Measurecamp Amsterdam - SAM.pdf
20240419 - Measurecamp Amsterdam - SAM.pdf
 
(PARI) Call Girls Wanowrie ( 7001035870 ) HI-Fi Pune Escorts Service
(PARI) Call Girls Wanowrie ( 7001035870 ) HI-Fi Pune Escorts Service(PARI) Call Girls Wanowrie ( 7001035870 ) HI-Fi Pune Escorts Service
(PARI) Call Girls Wanowrie ( 7001035870 ) HI-Fi Pune Escorts Service
 
VIP Call Girls in Amravati Aarohi 8250192130 Independent Escort Service Amravati
VIP Call Girls in Amravati Aarohi 8250192130 Independent Escort Service AmravatiVIP Call Girls in Amravati Aarohi 8250192130 Independent Escort Service Amravati
VIP Call Girls in Amravati Aarohi 8250192130 Independent Escort Service Amravati
 
Customer Service Analytics - Make Sense of All Your Data.pptx
Customer Service Analytics - Make Sense of All Your Data.pptxCustomer Service Analytics - Make Sense of All Your Data.pptx
Customer Service Analytics - Make Sense of All Your Data.pptx
 
EMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM TRACKING WITH GOOGLE ANALYTICS.pptx
EMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM  TRACKING WITH GOOGLE ANALYTICS.pptxEMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM  TRACKING WITH GOOGLE ANALYTICS.pptx
EMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM TRACKING WITH GOOGLE ANALYTICS.pptx
 
Unveiling Insights: The Role of a Data Analyst
Unveiling Insights: The Role of a Data AnalystUnveiling Insights: The Role of a Data Analyst
Unveiling Insights: The Role of a Data Analyst
 
꧁❤ Aerocity Call Girls Service Aerocity Delhi ❤꧂ 9999965857 ☎️ Hard And Sexy ...
꧁❤ Aerocity Call Girls Service Aerocity Delhi ❤꧂ 9999965857 ☎️ Hard And Sexy ...꧁❤ Aerocity Call Girls Service Aerocity Delhi ❤꧂ 9999965857 ☎️ Hard And Sexy ...
꧁❤ Aerocity Call Girls Service Aerocity Delhi ❤꧂ 9999965857 ☎️ Hard And Sexy ...
 
Market Analysis in the 5 Largest Economic Countries in Southeast Asia.pdf
Market Analysis in the 5 Largest Economic Countries in Southeast Asia.pdfMarket Analysis in the 5 Largest Economic Countries in Southeast Asia.pdf
Market Analysis in the 5 Largest Economic Countries in Southeast Asia.pdf
 
Kantar AI Summit- Under Embargo till Wednesday, 24th April 2024, 4 PM, IST.pdf
Kantar AI Summit- Under Embargo till Wednesday, 24th April 2024, 4 PM, IST.pdfKantar AI Summit- Under Embargo till Wednesday, 24th April 2024, 4 PM, IST.pdf
Kantar AI Summit- Under Embargo till Wednesday, 24th April 2024, 4 PM, IST.pdf
 
Indian Call Girls in Abu Dhabi O5286O24O8 Call Girls in Abu Dhabi By Independ...
Indian Call Girls in Abu Dhabi O5286O24O8 Call Girls in Abu Dhabi By Independ...Indian Call Girls in Abu Dhabi O5286O24O8 Call Girls in Abu Dhabi By Independ...
Indian Call Girls in Abu Dhabi O5286O24O8 Call Girls in Abu Dhabi By Independ...
 
Brighton SEO | April 2024 | Data Storytelling
Brighton SEO | April 2024 | Data StorytellingBrighton SEO | April 2024 | Data Storytelling
Brighton SEO | April 2024 | Data Storytelling
 
꧁❤ Greater Noida Call Girls Delhi ❤꧂ 9711199171 ☎️ Hard And Sexy Vip Call
꧁❤ Greater Noida Call Girls Delhi ❤꧂ 9711199171 ☎️ Hard And Sexy Vip Call꧁❤ Greater Noida Call Girls Delhi ❤꧂ 9711199171 ☎️ Hard And Sexy Vip Call
꧁❤ Greater Noida Call Girls Delhi ❤꧂ 9711199171 ☎️ Hard And Sexy Vip Call
 
Data Science Project: Advancements in Fetal Health Classification
Data Science Project: Advancements in Fetal Health ClassificationData Science Project: Advancements in Fetal Health Classification
Data Science Project: Advancements in Fetal Health Classification
 
Full night 🥵 Call Girls Delhi New Friends Colony {9711199171} Sanya Reddy ✌️o...
Full night 🥵 Call Girls Delhi New Friends Colony {9711199171} Sanya Reddy ✌️o...Full night 🥵 Call Girls Delhi New Friends Colony {9711199171} Sanya Reddy ✌️o...
Full night 🥵 Call Girls Delhi New Friends Colony {9711199171} Sanya Reddy ✌️o...
 

Dynamics of Semantic Networks of Independence Day Speeches

  • 1. Introduction Proposed Approach Natural Language Processing Complex Networks Results Conclusion Reference Dynamics of Semantic Networks of Independence Day Speeches Prem Sankar C Vinod Chandra S S K. Satheesh Kumar IC4 2018 - The International Conference on Control, Communication and Computing Dept. of Futures Studies,University of Kerala
  • 2. Introduction Proposed Approach Natural Language Processing Complex Networks Results Conclusion Reference Outline 1 Introduction 2 Proposed Approach 3 Natural Language Processing 4 Complex Networks 5 Results 6 Conclusion 7 Reference IC4 2018 - The International Conference on Control, Communication and Computing Dept. of Futures Studies,University of Kerala
  • 3. Introduction Proposed Approach Natural Language Processing Complex Networks Results Conclusion Reference Introduction 1 Public speeches of governing people can be an ideal source of information Indication of current trends Expected policies and Long-term plans Pattern shifts in priorities 2 In this work, We proposed a new approach - semantic linguistic networks for identifying semantic patterns from the text corpus. 3 It is a combination of linguistic analysis, semantic knowledge and complex network science concepts. 4 The complex network analysis is relevant to a wide range of systems where individual units interact with each other. 5 It is a combination of graph theory and computer science. IC4 2018 - The International Conference on Control, Communication and Computing Dept. of Futures Studies,University of Kerala
  • 4. Introduction Proposed Approach Natural Language Processing Complex Networks Results Conclusion Reference Methodology 1 Preprocessing the text corpus 2 Construct complex networks of key terms. 3 Network Visualization and Analysis Network Definition Let G(E, V) be the graph derived from the speech text corpus, where V denotes set of key terms (nodes), and E indicates the co-occurrence of these terms in a sentence in the text corpus. As a case study - we collected the text of Independence day speeches of Indian Prime Ministers (2004-2014 period) and and explored the dynamics of semantic relationships in the networks. IC4 2018 - The International Conference on Control, Communication and Computing Dept. of Futures Studies,University of Kerala
  • 5. Introduction Proposed Approach Natural Language Processing Complex Networks Results Conclusion Reference Step1 - Data Preprocessing Tokenization: Every word in the dataset is a treated as a token Normalization: All tokens were converted to lowercase letters. Removing stop words: Stop words are those which do not provide any valuable information and in some cases even reduce the quality of data. Stemming process:is the process of reducing inflected (or sometimes derived) words to their word stem, base or root form. Eg - helped, helping ... to help The major key terms are identified after filtering stop words and stemming process IC4 2018 - The International Conference on Control, Communication and Computing Dept. of Futures Studies,University of Kerala
  • 6. Introduction Proposed Approach Natural Language Processing Complex Networks Results Conclusion Reference Visualization of Semantic Networks The visualization shows the dynamical changes of the network over the years and reveals the hidden patterns. IC4 2018 - The International Conference on Control, Communication and Computing Dept. of Futures Studies,University of Kerala
  • 7. Introduction Proposed Approach Natural Language Processing Complex Networks Results Conclusion Reference Visualization of Semantic Networks (cont..) If a set of nodes belongs to the similar community (node color), then the semantic correlation between them will be relatively high. Modularity iterative algorithm used for network clustering. IC4 2018 - The International Conference on Control, Communication and Computing Dept. of Futures Studies,University of Kerala
  • 8. Introduction Proposed Approach Natural Language Processing Complex Networks Results Conclusion Reference Visualization of Semantic Networks (cont..) The influential keywords are identified using degree centrality measures and represented with larger node size in the network. IC4 2018 - The International Conference on Control, Communication and Computing Dept. of Futures Studies,University of Kerala
  • 9. Introduction Proposed Approach Natural Language Processing Complex Networks Results Conclusion Reference Network Structural Properties The number edges is increased with time The density of networks increases over time. IC4 2018 - The International Conference on Control, Communication and Computing Dept. of Futures Studies,University of Kerala
  • 10. Introduction Proposed Approach Natural Language Processing Complex Networks Results Conclusion Reference Number of Edges V/s Years 650 700 750 800 850 900 950 2004 2006 2008 2010 2012 2014 NumberofEdges Year The number edges is increased with time IC4 2018 - The International Conference on Control, Communication and Computing Dept. of Futures Studies,University of Kerala
  • 11. Introduction Proposed Approach Natural Language Processing Complex Networks Results Conclusion Reference Density V/s Years 0.065 0.07 0.075 0.08 0.085 0.09 0.095 2004 2006 2008 2010 2012 2014 NetworkDensity Year The density of networks increases over time. IC4 2018 - The International Conference on Control, Communication and Computing Dept. of Futures Studies,University of Kerala
  • 12. Introduction Proposed Approach Natural Language Processing Complex Networks Results Conclusion Reference Comparison of Networks in 1947 and 2014 In 1947 the ”nation” is attached with work, dream, people, peace and soul. In 2014 the ”nation” is attached with rural, health, child and economics. In 1947, we were more into long-term strategic goals and deals with how to face the world as the new nation, but in 2014 the primary focus is shifted from long-term goals to short terms goals. It mainly deals with how to tackle with current issues and policies to overcome present bottlenecks. IC4 2018 - The International Conference on Control, Communication and Computing Dept. of Futures Studies,University of Kerala
  • 13. Introduction Proposed Approach Natural Language Processing Complex Networks Results Conclusion Reference Comparison of semantic connections of term ’Today’ 1947 - Peace,service, achievement, fortune, and opportunity. 2014 -Child, Village, bank, rural, household, benefit and school Indicates main concerns in (today) present scenario. In 1947, after the independence, the primary focus indicate about the Equal opportunity for all people and provide service to people and national and achieve peace. In 2014 the main connections indicate about providing beneficial services like banking to rural villages, provide education to every child through more schools. IC4 2018 - The International Conference on Control, Communication and Computing Dept. of Futures Studies,University of Kerala
  • 14. Introduction Proposed Approach Natural Language Processing Complex Networks Results Conclusion Reference Major Observations The analysis shows the dynamic changes in the network in the local semantic relationship between the keywords over the years and reveals the hidden conceptual patterns. The most frequently mentioned keywords are identified using degree centrality and represented with larger node size in the network. Helpful in identifying new key terms and its semantic relationships. By comparing the networks of continuous years, we can easily detect the shifts in semantic relationships of keyword e.g., banking. In 2014, the relationship between rural, village and banking shows that policy makers are interested to provide the banking service to the rural villages and later Pradhan Mantri Jan Dhan Jojna - Prime Minister Scheme focused on opening bank accounts for rural and poor people was launched. IC4 2018 - The International Conference on Control, Communication and Computing Dept. of Futures Studies,University of Kerala
  • 15. Introduction Proposed Approach Natural Language Processing Complex Networks Results Conclusion Reference Conclusion Our analysis shows that the complex network of a public text can effectively be utilized to visualize the hidden semantic relationship between different key terms in the corpus. Semantic Linguistic analysis helps policy makers to identify most dominant terms or semantic relationship between terms. Based on the current Indian scenario, the semantic linguistic analysis helps to shed light on the most influential policies in the years to come. It also captures new policy terms and their moment of introduction and traces the change in long-term semantic relationships between the key policy terms. We demonstrated a real world application of the complex network analysis by analyzing and visualizing the text network of Independence day speeches of Indian Prime Ministers. IC4 2018 - The International Conference on Control, Communication and Computing Dept. of Futures Studies,University of Kerala
  • 16. Introduction Proposed Approach Natural Language Processing Complex Networks Results Conclusion Reference Reference M. Newman, Networks: an introduction. Oxford University Press, 2009 D. Paranyushkin, “Visualization of texts polysingularity using network analysis,” Prototype Letters, vol. 2, no. 3, pp. 256–278, 2011. M. E. Newman, “Fast algorithm for detecting community structure in networks,” Physical review E, vol. 69, no. 6, p. 066133, 2004. S. Scott and S. Matwin, “Feature engineering for text classification,” in ICML, vol. 99, 1999, pp. 379–388 IC4 2018 - The International Conference on Control, Communication and Computing Dept. of Futures Studies,University of Kerala
  • 17. Introduction Proposed Approach Natural Language Processing Complex Networks Results Conclusion Reference Thank You. . . . Acknowledgement The authors wish to express their gratitude to the Campus Computing Facility at University of Kerala set up under DST purse programme for providing their facilities. Presented By Prem Sankar C Research Scholar Department of Futures Studies University of Kerala- India IC4 2018 - The International Conference on Control, Communication and Computing Dept. of Futures Studies,University of Kerala