SlideShare a Scribd company logo
Bank of America is to sue ABN Amro after it was blocked from buying ABN's US
bank, complicating bids for ABN from Barclays and Royal Bank of Scotland.
Bank of America launched the action after a Dutch court froze its planned
purchase of LaSalle, ruling the deal was illegal without investor approval.
Pakistan have included Mohammad Asif in a 16-man squad for a three-match
series with Sri Lanka in Abu Dhabi this month.
RAW TEXT – collection of news from the site http://news.bbc.co.uk
Bank/NNP of/IN America/NNP is/VBZ to/TO sue/VB ABN/NNP Amro/NNP
after/IN it/PRP was/VBD blocked/VBN from/IN buying/VBG ABN/NNP 's/POS
US/NNP bank/NN ,/, complicating/VBG bids/NNS for/IN ABN/NNP from/IN
Barclays/NNP and/CC Royal/NNP Bank/NNP of/IN Scotland/NNP ./.
Bank/NNP of/IN America/NNP launched/VBD the/DT action/NN after/IN a/DT
Dutch/JJ court/NN froze/VB its/PRP$ planned/JJ purchase/NN of/IN
LaSalle/NNP ,/, ruling/VBG the/DT deal/NN was/VBD illegal/JJ without/IN
investor/NN approval/NN ./.
Pakistan/NNP have/VBP included/VBN Mohammad/NNP Asif/NNP in/IN a/DT
16-man/JJ squad/NN for/IN a/DT three-match/JJ series/NN with/IN Sri/NNP
Lanka/NNP in/IN Abu/NNP Dhabi/NNP this/DT month/NN ./.
TAGGING MODULE – using LPOST (a Perl program that uses a
variant of the Brown/Penn-style tag-sets) or POStagger (a program
designed at Tokyo University)
Bank/NNP America/NNP sue/VB ABN/NNP Amro/NNP blocked/VBN buying/VBG
ABN/NNP 's/POS US/NNP bank/NN ,/, complicating/VBG bids/NNS ABN/NNP
Barclays/NNP Royal/NNP Bank/NNP Scotland/NNP ./.
Bank/NNP America/NNP launched/VBD action/NN Dutch/JJ court/NN froze/VB
planned/JJ purchase/NN LaSalle/NNP ,/, ruling/VBG deal/NN illegal/JJ
investor/NN approval/NN ./.
Pakistan/NNP included/VBN Mohammad/NNP Asif/NNP 16-man/JJ squad/NN
three-match/JJ series/NN Sri/NNP Lanka/NNP Abu/NNP Dhabi/NNP month/NN ./.
STOPWORDS ELIMINATION
MODULE 1
UNIGRAMS –
keep only the important
words from texts
(substantives and verbs) and
group the texts if possible
N-GRAMS –
extract the n-grams (we
used bigrams) from texts
and group the texts if
possible
COLLOCA
TION –
extract the
collocation
from texts
Bank/NNP America/NNP,
America/NNP sue/VB, sue/VB
ABN/NNP …
Bank/NNP America/NNP,
America/NNP launched/VBD,
launched/VBD action/NN …
Pakistan/NNP included/VBN,
included/VBN
Mohammad/NNP,
Mohammad/NNP Asif/NNP …
Verbs sue, block, buy,
complicate
Nouns bank, bid
Verbs launch, rule
Nouns action, court, deal,
purchase, investor,
approval
Verbs include
Nouns squad, series,
month
-
-
-
MODULE 2
Bank/NNP America/NNP sue/VB ABN/NNP Amro/NNP blocked/VBN
buying/VBG ABN/NNP 's/POS US/NNP bank/NN ,/, complicating/VBG bids/NNS
ABN/NNP Barclays/NNP Royal/NNP Bank/NNP Scotland/NNP ./.
Bank/NNP America/NNP launched/VBD action/NN Dutch/JJ court/NN froze/VB
planned/JJ purchase/NN LaSalle/NNP ,/, ruling/VBG deal/NN illegal/JJ
investor/NN approval/NN ./.
Pakistan/NNP included/VBN Mohammad/NNP Asif/NNP 16-man/JJ squad/NN
three-match/JJ series/NN Sri/NNP Lanka/NNP Abu/NNP Dhabi/NNP
month/NN ./.
The words from the text are grouped into lexical chains and after all the
words have been classified, the topic shifts can be identified by
assuming that a high density of chain starts and ends means that the
topic has changed.
MODULE 3
The words from the text are grouped into lexical chains as described in
Module 2 and after that, every word is replaced by the chain that is part
of. Next, every paragraph is assigned to the chain that contains the
majority of the words from that paragraph. If two consecutive
paragraphs are assigned to different chains, it means that a topic
changed occurred.
Bank/NNP America/NNP c1 ABN/NNP Amro/NNP c2 c3 ABN/NNP
's/POS US/NNP c3 ,/, c2 c3 ABN/NNP Barclays/NNP Royal/NNP
Bank/NNP Scotland/NNP ./.
Bank/NNP America/NNP c4 c1 c5 c1 c2 c6 c3 LaSalle/NNP ,/, c1 c3
c1 c3 c3 ./.
Pakistan/NNP c7 Mohammad/NNP Asif/NNP c8 c8 c8 c9 Sri/NNP
Lanka/NNP Abu/NNP Dhabi/NNP c10 ./.
 c3
 c1/c3
 c8
VOTING MODULE
The results obtained from the three modules are combined. After
each paragraph, the outputs of the modules are investigated in order
to find out whether it should be a topic limit or not.
Paragraph 1
Paragraph 2
Paragraph 3
MODULE 1
Paragraph 1
Paragraph 2
Paragraph 3
MODULE 2
Paragraph 1
Paragraph 2
Paragraph 3
MODULE 3
Paragraph 1
Paragraph 2
Paragraph 3
FINAL RESULTS
Raw
text
Voting
Module
Final
result
Tagging
Module
Figure 1. Application architecture
Stopwords
elimination
Module 3Module 2Module 1
Result 3Result 2Result 1
Text
neadnotat
Modul
de votare
Rezultate
finale
Modul de
adnotare
Figura 3. Arhitectura Aplicatiei
Eliminarea
cuvintelor de
stop
Modulul n
Rezultatul n
Modulul 1
Rezultatul 1
Modulul 2
Rezultatul 2

More Related Content

More from University Politehnica Bucharest

Hearthstone helper using optical character recognition techniques for cards d...
Hearthstone helper using optical character recognition techniques for cards d...Hearthstone helper using optical character recognition techniques for cards d...
Hearthstone helper using optical character recognition techniques for cards d...
University Politehnica Bucharest
 
Movie recommender system using the user's psychological profile
Movie recommender system using the user's psychological profileMovie recommender system using the user's psychological profile
Movie recommender system using the user's psychological profile
University Politehnica Bucharest
 
Tracing the paths between concepts in large bio medical corpora
Tracing the paths between concepts in large bio medical corporaTracing the paths between concepts in large bio medical corpora
Tracing the paths between concepts in large bio medical corpora
University Politehnica Bucharest
 
The collection and analysis of public data - Bucharest case study
The collection and analysis of public data - Bucharest case studyThe collection and analysis of public data - Bucharest case study
The collection and analysis of public data - Bucharest case study
University Politehnica Bucharest
 
Archaisms and neologisms identification in texts
Archaisms and neologisms identification in textsArchaisms and neologisms identification in texts
Archaisms and neologisms identification in texts
University Politehnica Bucharest
 
Unsupervised system for automatic grading of bachelor and master thesis
Unsupervised system for automatic grading of bachelor and master thesisUnsupervised system for automatic grading of bachelor and master thesis
Unsupervised system for automatic grading of bachelor and master thesis
University Politehnica Bucharest
 
Tweets topic modelling across different countries prezentarea
Tweets topic modelling across different countries   prezentareaTweets topic modelling across different countries   prezentarea
Tweets topic modelling across different countries prezentarea
University Politehnica Bucharest
 
Sentiment based text segmentation
Sentiment based text segmentationSentiment based text segmentation
Sentiment based text segmentation
University Politehnica Bucharest
 
Creativity detection in texts
Creativity detection in textsCreativity detection in texts
Creativity detection in texts
University Politehnica Bucharest
 
Nlp based heuristics for assessing participants in cscl chats
Nlp based heuristics for assessing participants in cscl chatsNlp based heuristics for assessing participants in cscl chats
Nlp based heuristics for assessing participants in cscl chats
University Politehnica Bucharest
 
Detecting discourse creativity in chat conversations
Detecting discourse creativity in chat conversationsDetecting discourse creativity in chat conversations
Detecting discourse creativity in chat conversations
University Politehnica Bucharest
 
Metaphor detection
Metaphor detectionMetaphor detection
2012 Presidential Elections on Twitter - An Analysis of How the US and French...
2012 Presidential Elections on Twitter - An Analysis of How the US and French...2012 Presidential Elections on Twitter - An Analysis of How the US and French...
2012 Presidential Elections on Twitter - An Analysis of How the US and French...
University Politehnica Bucharest
 
Identifying gender differences in cscl chat conversation
Identifying gender differences in cscl chat conversationIdentifying gender differences in cscl chat conversation
Identifying gender differences in cscl chat conversation
University Politehnica Bucharest
 
Identification and Classification of the Most Important Moments from Students...
Identification and Classification of the Most Important Moments from Students...Identification and Classification of the Most Important Moments from Students...
Identification and Classification of the Most Important Moments from Students...
University Politehnica Bucharest
 
A tool for discourse visualization and analysis
A tool for discourse visualization and analysisA tool for discourse visualization and analysis
A tool for discourse visualization and analysis
University Politehnica Bucharest
 
Repetition and rhythmicity based assessment model for chat conversations pr...
Repetition and rhythmicity based assessment model for chat conversations   pr...Repetition and rhythmicity based assessment model for chat conversations   pr...
Repetition and rhythmicity based assessment model for chat conversations pr...
University Politehnica Bucharest
 
Word sense disambiguation and lexical chains construction using wordnet
Word sense disambiguation and lexical chains construction using wordnetWord sense disambiguation and lexical chains construction using wordnet
Word sense disambiguation and lexical chains construction using wordnet
University Politehnica Bucharest
 
Chat adapted pos tagger for romanian language
Chat adapted pos tagger for romanian languageChat adapted pos tagger for romanian language
Chat adapted pos tagger for romanian language
University Politehnica Bucharest
 
Filling the gaps
Filling the gapsFilling the gaps

More from University Politehnica Bucharest (20)

Hearthstone helper using optical character recognition techniques for cards d...
Hearthstone helper using optical character recognition techniques for cards d...Hearthstone helper using optical character recognition techniques for cards d...
Hearthstone helper using optical character recognition techniques for cards d...
 
Movie recommender system using the user's psychological profile
Movie recommender system using the user's psychological profileMovie recommender system using the user's psychological profile
Movie recommender system using the user's psychological profile
 
Tracing the paths between concepts in large bio medical corpora
Tracing the paths between concepts in large bio medical corporaTracing the paths between concepts in large bio medical corpora
Tracing the paths between concepts in large bio medical corpora
 
The collection and analysis of public data - Bucharest case study
The collection and analysis of public data - Bucharest case studyThe collection and analysis of public data - Bucharest case study
The collection and analysis of public data - Bucharest case study
 
Archaisms and neologisms identification in texts
Archaisms and neologisms identification in textsArchaisms and neologisms identification in texts
Archaisms and neologisms identification in texts
 
Unsupervised system for automatic grading of bachelor and master thesis
Unsupervised system for automatic grading of bachelor and master thesisUnsupervised system for automatic grading of bachelor and master thesis
Unsupervised system for automatic grading of bachelor and master thesis
 
Tweets topic modelling across different countries prezentarea
Tweets topic modelling across different countries   prezentareaTweets topic modelling across different countries   prezentarea
Tweets topic modelling across different countries prezentarea
 
Sentiment based text segmentation
Sentiment based text segmentationSentiment based text segmentation
Sentiment based text segmentation
 
Creativity detection in texts
Creativity detection in textsCreativity detection in texts
Creativity detection in texts
 
Nlp based heuristics for assessing participants in cscl chats
Nlp based heuristics for assessing participants in cscl chatsNlp based heuristics for assessing participants in cscl chats
Nlp based heuristics for assessing participants in cscl chats
 
Detecting discourse creativity in chat conversations
Detecting discourse creativity in chat conversationsDetecting discourse creativity in chat conversations
Detecting discourse creativity in chat conversations
 
Metaphor detection
Metaphor detectionMetaphor detection
Metaphor detection
 
2012 Presidential Elections on Twitter - An Analysis of How the US and French...
2012 Presidential Elections on Twitter - An Analysis of How the US and French...2012 Presidential Elections on Twitter - An Analysis of How the US and French...
2012 Presidential Elections on Twitter - An Analysis of How the US and French...
 
Identifying gender differences in cscl chat conversation
Identifying gender differences in cscl chat conversationIdentifying gender differences in cscl chat conversation
Identifying gender differences in cscl chat conversation
 
Identification and Classification of the Most Important Moments from Students...
Identification and Classification of the Most Important Moments from Students...Identification and Classification of the Most Important Moments from Students...
Identification and Classification of the Most Important Moments from Students...
 
A tool for discourse visualization and analysis
A tool for discourse visualization and analysisA tool for discourse visualization and analysis
A tool for discourse visualization and analysis
 
Repetition and rhythmicity based assessment model for chat conversations pr...
Repetition and rhythmicity based assessment model for chat conversations   pr...Repetition and rhythmicity based assessment model for chat conversations   pr...
Repetition and rhythmicity based assessment model for chat conversations pr...
 
Word sense disambiguation and lexical chains construction using wordnet
Word sense disambiguation and lexical chains construction using wordnetWord sense disambiguation and lexical chains construction using wordnet
Word sense disambiguation and lexical chains construction using wordnet
 
Chat adapted pos tagger for romanian language
Chat adapted pos tagger for romanian languageChat adapted pos tagger for romanian language
Chat adapted pos tagger for romanian language
 
Filling the gaps
Filling the gapsFilling the gaps
Filling the gaps
 

Recently uploaded

Compexometric titration/Chelatorphy titration/chelating titration
Compexometric titration/Chelatorphy titration/chelating titrationCompexometric titration/Chelatorphy titration/chelating titration
Compexometric titration/Chelatorphy titration/chelating titration
Vandana Devesh Sharma
 
Oedema_types_causes_pathophysiology.pptx
Oedema_types_causes_pathophysiology.pptxOedema_types_causes_pathophysiology.pptx
Oedema_types_causes_pathophysiology.pptx
muralinath2
 
Describing and Interpreting an Immersive Learning Case with the Immersion Cub...
Describing and Interpreting an Immersive Learning Case with the Immersion Cub...Describing and Interpreting an Immersive Learning Case with the Immersion Cub...
Describing and Interpreting an Immersive Learning Case with the Immersion Cub...
Leonel Morgado
 
Equivariant neural networks and representation theory
Equivariant neural networks and representation theoryEquivariant neural networks and representation theory
Equivariant neural networks and representation theory
Daniel Tubbenhauer
 
Unlocking the mysteries of reproduction: Exploring fecundity and gonadosomati...
Unlocking the mysteries of reproduction: Exploring fecundity and gonadosomati...Unlocking the mysteries of reproduction: Exploring fecundity and gonadosomati...
Unlocking the mysteries of reproduction: Exploring fecundity and gonadosomati...
AbdullaAlAsif1
 
在线办理(salfor毕业证书)索尔福德大学毕业证毕业完成信一模一样
在线办理(salfor毕业证书)索尔福德大学毕业证毕业完成信一模一样在线办理(salfor毕业证书)索尔福德大学毕业证毕业完成信一模一样
在线办理(salfor毕业证书)索尔福德大学毕业证毕业完成信一模一样
vluwdy49
 
EWOCS-I: The catalog of X-ray sources in Westerlund 1 from the Extended Weste...
EWOCS-I: The catalog of X-ray sources in Westerlund 1 from the Extended Weste...EWOCS-I: The catalog of X-ray sources in Westerlund 1 from the Extended Weste...
EWOCS-I: The catalog of X-ray sources in Westerlund 1 from the Extended Weste...
Sérgio Sacani
 
3D Hybrid PIC simulation of the plasma expansion (ISSS-14)
3D Hybrid PIC simulation of the plasma expansion (ISSS-14)3D Hybrid PIC simulation of the plasma expansion (ISSS-14)
3D Hybrid PIC simulation of the plasma expansion (ISSS-14)
David Osipyan
 
Randomised Optimisation Algorithms in DAPHNE
Randomised Optimisation Algorithms in DAPHNERandomised Optimisation Algorithms in DAPHNE
Randomised Optimisation Algorithms in DAPHNE
University of Maribor
 
The debris of the ‘last major merger’ is dynamically young
The debris of the ‘last major merger’ is dynamically youngThe debris of the ‘last major merger’ is dynamically young
The debris of the ‘last major merger’ is dynamically young
Sérgio Sacani
 
Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...
Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...
Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...
University of Maribor
 
THEMATIC APPERCEPTION TEST(TAT) cognitive abilities, creativity, and critic...
THEMATIC  APPERCEPTION  TEST(TAT) cognitive abilities, creativity, and critic...THEMATIC  APPERCEPTION  TEST(TAT) cognitive abilities, creativity, and critic...
THEMATIC APPERCEPTION TEST(TAT) cognitive abilities, creativity, and critic...
Abdul Wali Khan University Mardan,kP,Pakistan
 
Thornton ESPP slides UK WW Network 4_6_24.pdf
Thornton ESPP slides UK WW Network 4_6_24.pdfThornton ESPP slides UK WW Network 4_6_24.pdf
Thornton ESPP slides UK WW Network 4_6_24.pdf
European Sustainable Phosphorus Platform
 
waterlessdyeingtechnolgyusing carbon dioxide chemicalspdf
waterlessdyeingtechnolgyusing carbon dioxide chemicalspdfwaterlessdyeingtechnolgyusing carbon dioxide chemicalspdf
waterlessdyeingtechnolgyusing carbon dioxide chemicalspdf
LengamoLAppostilic
 
Immersive Learning That Works: Research Grounding and Paths Forward
Immersive Learning That Works: Research Grounding and Paths ForwardImmersive Learning That Works: Research Grounding and Paths Forward
Immersive Learning That Works: Research Grounding and Paths Forward
Leonel Morgado
 
mô tả các thí nghiệm về đánh giá tác động dòng khí hóa sau đốt
mô tả các thí nghiệm về đánh giá tác động dòng khí hóa sau đốtmô tả các thí nghiệm về đánh giá tác động dòng khí hóa sau đốt
mô tả các thí nghiệm về đánh giá tác động dòng khí hóa sau đốt
HongcNguyn6
 
Bob Reedy - Nitrate in Texas Groundwater.pdf
Bob Reedy - Nitrate in Texas Groundwater.pdfBob Reedy - Nitrate in Texas Groundwater.pdf
Bob Reedy - Nitrate in Texas Groundwater.pdf
Texas Alliance of Groundwater Districts
 
NuGOweek 2024 Ghent programme overview flyer
NuGOweek 2024 Ghent programme overview flyerNuGOweek 2024 Ghent programme overview flyer
NuGOweek 2024 Ghent programme overview flyer
pablovgd
 
SAR of Medicinal Chemistry 1st by dk.pdf
SAR of Medicinal Chemistry 1st by dk.pdfSAR of Medicinal Chemistry 1st by dk.pdf
SAR of Medicinal Chemistry 1st by dk.pdf
KrushnaDarade1
 
Eukaryotic Transcription Presentation.pptx
Eukaryotic Transcription Presentation.pptxEukaryotic Transcription Presentation.pptx
Eukaryotic Transcription Presentation.pptx
RitabrataSarkar3
 

Recently uploaded (20)

Compexometric titration/Chelatorphy titration/chelating titration
Compexometric titration/Chelatorphy titration/chelating titrationCompexometric titration/Chelatorphy titration/chelating titration
Compexometric titration/Chelatorphy titration/chelating titration
 
Oedema_types_causes_pathophysiology.pptx
Oedema_types_causes_pathophysiology.pptxOedema_types_causes_pathophysiology.pptx
Oedema_types_causes_pathophysiology.pptx
 
Describing and Interpreting an Immersive Learning Case with the Immersion Cub...
Describing and Interpreting an Immersive Learning Case with the Immersion Cub...Describing and Interpreting an Immersive Learning Case with the Immersion Cub...
Describing and Interpreting an Immersive Learning Case with the Immersion Cub...
 
Equivariant neural networks and representation theory
Equivariant neural networks and representation theoryEquivariant neural networks and representation theory
Equivariant neural networks and representation theory
 
Unlocking the mysteries of reproduction: Exploring fecundity and gonadosomati...
Unlocking the mysteries of reproduction: Exploring fecundity and gonadosomati...Unlocking the mysteries of reproduction: Exploring fecundity and gonadosomati...
Unlocking the mysteries of reproduction: Exploring fecundity and gonadosomati...
 
在线办理(salfor毕业证书)索尔福德大学毕业证毕业完成信一模一样
在线办理(salfor毕业证书)索尔福德大学毕业证毕业完成信一模一样在线办理(salfor毕业证书)索尔福德大学毕业证毕业完成信一模一样
在线办理(salfor毕业证书)索尔福德大学毕业证毕业完成信一模一样
 
EWOCS-I: The catalog of X-ray sources in Westerlund 1 from the Extended Weste...
EWOCS-I: The catalog of X-ray sources in Westerlund 1 from the Extended Weste...EWOCS-I: The catalog of X-ray sources in Westerlund 1 from the Extended Weste...
EWOCS-I: The catalog of X-ray sources in Westerlund 1 from the Extended Weste...
 
3D Hybrid PIC simulation of the plasma expansion (ISSS-14)
3D Hybrid PIC simulation of the plasma expansion (ISSS-14)3D Hybrid PIC simulation of the plasma expansion (ISSS-14)
3D Hybrid PIC simulation of the plasma expansion (ISSS-14)
 
Randomised Optimisation Algorithms in DAPHNE
Randomised Optimisation Algorithms in DAPHNERandomised Optimisation Algorithms in DAPHNE
Randomised Optimisation Algorithms in DAPHNE
 
The debris of the ‘last major merger’ is dynamically young
The debris of the ‘last major merger’ is dynamically youngThe debris of the ‘last major merger’ is dynamically young
The debris of the ‘last major merger’ is dynamically young
 
Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...
Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...
Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...
 
THEMATIC APPERCEPTION TEST(TAT) cognitive abilities, creativity, and critic...
THEMATIC  APPERCEPTION  TEST(TAT) cognitive abilities, creativity, and critic...THEMATIC  APPERCEPTION  TEST(TAT) cognitive abilities, creativity, and critic...
THEMATIC APPERCEPTION TEST(TAT) cognitive abilities, creativity, and critic...
 
Thornton ESPP slides UK WW Network 4_6_24.pdf
Thornton ESPP slides UK WW Network 4_6_24.pdfThornton ESPP slides UK WW Network 4_6_24.pdf
Thornton ESPP slides UK WW Network 4_6_24.pdf
 
waterlessdyeingtechnolgyusing carbon dioxide chemicalspdf
waterlessdyeingtechnolgyusing carbon dioxide chemicalspdfwaterlessdyeingtechnolgyusing carbon dioxide chemicalspdf
waterlessdyeingtechnolgyusing carbon dioxide chemicalspdf
 
Immersive Learning That Works: Research Grounding and Paths Forward
Immersive Learning That Works: Research Grounding and Paths ForwardImmersive Learning That Works: Research Grounding and Paths Forward
Immersive Learning That Works: Research Grounding and Paths Forward
 
mô tả các thí nghiệm về đánh giá tác động dòng khí hóa sau đốt
mô tả các thí nghiệm về đánh giá tác động dòng khí hóa sau đốtmô tả các thí nghiệm về đánh giá tác động dòng khí hóa sau đốt
mô tả các thí nghiệm về đánh giá tác động dòng khí hóa sau đốt
 
Bob Reedy - Nitrate in Texas Groundwater.pdf
Bob Reedy - Nitrate in Texas Groundwater.pdfBob Reedy - Nitrate in Texas Groundwater.pdf
Bob Reedy - Nitrate in Texas Groundwater.pdf
 
NuGOweek 2024 Ghent programme overview flyer
NuGOweek 2024 Ghent programme overview flyerNuGOweek 2024 Ghent programme overview flyer
NuGOweek 2024 Ghent programme overview flyer
 
SAR of Medicinal Chemistry 1st by dk.pdf
SAR of Medicinal Chemistry 1st by dk.pdfSAR of Medicinal Chemistry 1st by dk.pdf
SAR of Medicinal Chemistry 1st by dk.pdf
 
Eukaryotic Transcription Presentation.pptx
Eukaryotic Transcription Presentation.pptxEukaryotic Transcription Presentation.pptx
Eukaryotic Transcription Presentation.pptx
 

Unsupervised Cohesion Based Text Segmentation

  • 1. Bank of America is to sue ABN Amro after it was blocked from buying ABN's US bank, complicating bids for ABN from Barclays and Royal Bank of Scotland. Bank of America launched the action after a Dutch court froze its planned purchase of LaSalle, ruling the deal was illegal without investor approval. Pakistan have included Mohammad Asif in a 16-man squad for a three-match series with Sri Lanka in Abu Dhabi this month. RAW TEXT – collection of news from the site http://news.bbc.co.uk Bank/NNP of/IN America/NNP is/VBZ to/TO sue/VB ABN/NNP Amro/NNP after/IN it/PRP was/VBD blocked/VBN from/IN buying/VBG ABN/NNP 's/POS US/NNP bank/NN ,/, complicating/VBG bids/NNS for/IN ABN/NNP from/IN Barclays/NNP and/CC Royal/NNP Bank/NNP of/IN Scotland/NNP ./. Bank/NNP of/IN America/NNP launched/VBD the/DT action/NN after/IN a/DT Dutch/JJ court/NN froze/VB its/PRP$ planned/JJ purchase/NN of/IN LaSalle/NNP ,/, ruling/VBG the/DT deal/NN was/VBD illegal/JJ without/IN investor/NN approval/NN ./. Pakistan/NNP have/VBP included/VBN Mohammad/NNP Asif/NNP in/IN a/DT 16-man/JJ squad/NN for/IN a/DT three-match/JJ series/NN with/IN Sri/NNP Lanka/NNP in/IN Abu/NNP Dhabi/NNP this/DT month/NN ./. TAGGING MODULE – using LPOST (a Perl program that uses a variant of the Brown/Penn-style tag-sets) or POStagger (a program designed at Tokyo University)
  • 2. Bank/NNP America/NNP sue/VB ABN/NNP Amro/NNP blocked/VBN buying/VBG ABN/NNP 's/POS US/NNP bank/NN ,/, complicating/VBG bids/NNS ABN/NNP Barclays/NNP Royal/NNP Bank/NNP Scotland/NNP ./. Bank/NNP America/NNP launched/VBD action/NN Dutch/JJ court/NN froze/VB planned/JJ purchase/NN LaSalle/NNP ,/, ruling/VBG deal/NN illegal/JJ investor/NN approval/NN ./. Pakistan/NNP included/VBN Mohammad/NNP Asif/NNP 16-man/JJ squad/NN three-match/JJ series/NN Sri/NNP Lanka/NNP Abu/NNP Dhabi/NNP month/NN ./. STOPWORDS ELIMINATION
  • 3. MODULE 1 UNIGRAMS – keep only the important words from texts (substantives and verbs) and group the texts if possible N-GRAMS – extract the n-grams (we used bigrams) from texts and group the texts if possible COLLOCA TION – extract the collocation from texts Bank/NNP America/NNP, America/NNP sue/VB, sue/VB ABN/NNP … Bank/NNP America/NNP, America/NNP launched/VBD, launched/VBD action/NN … Pakistan/NNP included/VBN, included/VBN Mohammad/NNP, Mohammad/NNP Asif/NNP … Verbs sue, block, buy, complicate Nouns bank, bid Verbs launch, rule Nouns action, court, deal, purchase, investor, approval Verbs include Nouns squad, series, month - - -
  • 4. MODULE 2 Bank/NNP America/NNP sue/VB ABN/NNP Amro/NNP blocked/VBN buying/VBG ABN/NNP 's/POS US/NNP bank/NN ,/, complicating/VBG bids/NNS ABN/NNP Barclays/NNP Royal/NNP Bank/NNP Scotland/NNP ./. Bank/NNP America/NNP launched/VBD action/NN Dutch/JJ court/NN froze/VB planned/JJ purchase/NN LaSalle/NNP ,/, ruling/VBG deal/NN illegal/JJ investor/NN approval/NN ./. Pakistan/NNP included/VBN Mohammad/NNP Asif/NNP 16-man/JJ squad/NN three-match/JJ series/NN Sri/NNP Lanka/NNP Abu/NNP Dhabi/NNP month/NN ./. The words from the text are grouped into lexical chains and after all the words have been classified, the topic shifts can be identified by assuming that a high density of chain starts and ends means that the topic has changed.
  • 5. MODULE 3 The words from the text are grouped into lexical chains as described in Module 2 and after that, every word is replaced by the chain that is part of. Next, every paragraph is assigned to the chain that contains the majority of the words from that paragraph. If two consecutive paragraphs are assigned to different chains, it means that a topic changed occurred. Bank/NNP America/NNP c1 ABN/NNP Amro/NNP c2 c3 ABN/NNP 's/POS US/NNP c3 ,/, c2 c3 ABN/NNP Barclays/NNP Royal/NNP Bank/NNP Scotland/NNP ./. Bank/NNP America/NNP c4 c1 c5 c1 c2 c6 c3 LaSalle/NNP ,/, c1 c3 c1 c3 c3 ./. Pakistan/NNP c7 Mohammad/NNP Asif/NNP c8 c8 c8 c9 Sri/NNP Lanka/NNP Abu/NNP Dhabi/NNP c10 ./.  c3  c1/c3  c8
  • 6. VOTING MODULE The results obtained from the three modules are combined. After each paragraph, the outputs of the modules are investigated in order to find out whether it should be a topic limit or not. Paragraph 1 Paragraph 2 Paragraph 3 MODULE 1 Paragraph 1 Paragraph 2 Paragraph 3 MODULE 2 Paragraph 1 Paragraph 2 Paragraph 3 MODULE 3 Paragraph 1 Paragraph 2 Paragraph 3 FINAL RESULTS
  • 7. Raw text Voting Module Final result Tagging Module Figure 1. Application architecture Stopwords elimination Module 3Module 2Module 1 Result 3Result 2Result 1
  • 8. Text neadnotat Modul de votare Rezultate finale Modul de adnotare Figura 3. Arhitectura Aplicatiei Eliminarea cuvintelor de stop Modulul n Rezultatul n Modulul 1 Rezultatul 1 Modulul 2 Rezultatul 2