This document summarizes a project on detailed classification of customer reviews using sentiment analysis. It discusses using the VADER and RoBERTa models to analyze sentiment in customer reviews. The methodology section explains how each model works, with VADER using a lexicon-based approach and RoBERTa being a transformer model. Testing results on positive and negative reviews are presented to compare the polarity scores from each model, finding that RoBERTa scores are more confident due to its deep learning approach. The conclusion discusses how sentiment analysis can be helpful for businesses but also has limitations, and cannot alone determine a company's success.
Sentimental analysis of audio based customer reviews without textual conversionIJECEIAES
The current trends or procedures followed in the customer relation management system (CRM) are based on reviews, mails, and other textual data, gathered in the form of feedback from the customers. Sentiment analysis algorithms are deployed in order to gain polarity results, which can be used to improve customer services. But with evolving technologies, lately reviews or feedbacks are being dominated by audio data. As per literature, the audio contents are being translated to text and sentiments are analyzed using natural processing language techniques. However, these approaches can be time consuming. The proposed work focuses on analyzing the sentiments on the audio data itself without any textual conversion. The basic sentiment analysis polarities are mostly termed as positive, negative, and natural. But the focus is to make use of basic emotions as the base of deciding the polarity. The proposed model uses deep neural network and features such as Mel frequency cepstral coefficients (MFCC), Chroma and Mel Spectrogram on audio-based reviews.
Supervised Sentiment Classification using DTDP algorithmIJSRD
Sentiment analysis is the process widely used in all fields and it uses the statistical machine learning approach for text modeling. The primarily used approach is Bag-of-words (BOW). Though, this technique has some limitations in polarity shift problem. Thus, here we propose a new method called Dual sentiment analysis (DSA) which resolves the polarity shift problem. Proposed method involves two approaches such as dual training and dual prediction (DPDT). First, we propose a data expansion technique by creating a reversed review for training data. Second, dual training and dual prediction algorithm is developed for doing analysis on sentiment data. The dual training algorithm is used for learning a sentiment classifier and the dual prediction algorithm is developed for classifying the review by considering two sides of one review.
Sentimental analysis of audio based customer reviews without textual conversionIJECEIAES
The current trends or procedures followed in the customer relation management system (CRM) are based on reviews, mails, and other textual data, gathered in the form of feedback from the customers. Sentiment analysis algorithms are deployed in order to gain polarity results, which can be used to improve customer services. But with evolving technologies, lately reviews or feedbacks are being dominated by audio data. As per literature, the audio contents are being translated to text and sentiments are analyzed using natural processing language techniques. However, these approaches can be time consuming. The proposed work focuses on analyzing the sentiments on the audio data itself without any textual conversion. The basic sentiment analysis polarities are mostly termed as positive, negative, and natural. But the focus is to make use of basic emotions as the base of deciding the polarity. The proposed model uses deep neural network and features such as Mel frequency cepstral coefficients (MFCC), Chroma and Mel Spectrogram on audio-based reviews.
Supervised Sentiment Classification using DTDP algorithmIJSRD
Sentiment analysis is the process widely used in all fields and it uses the statistical machine learning approach for text modeling. The primarily used approach is Bag-of-words (BOW). Though, this technique has some limitations in polarity shift problem. Thus, here we propose a new method called Dual sentiment analysis (DSA) which resolves the polarity shift problem. Proposed method involves two approaches such as dual training and dual prediction (DPDT). First, we propose a data expansion technique by creating a reversed review for training data. Second, dual training and dual prediction algorithm is developed for doing analysis on sentiment data. The dual training algorithm is used for learning a sentiment classifier and the dual prediction algorithm is developed for classifying the review by considering two sides of one review.
Sentiment Features based Analysis of Online Reviewsiosrjce
IOSR Journal of Computer Engineering (IOSR-JCE) is a double blind peer reviewed International Journal that provides rapid publication (within a month) of articles in all areas of computer engineering and its applications. The journal welcomes publications of high quality papers on theoretical developments and practical applications in computer technology. Original research papers, state-of-the-art reviews, and high quality technical notes are invited for publications.
How Does Customer Feedback Sentiment Analysis Work in Search Marketing?Countants
When it comes to understanding customer feedback, sentiment analysis is emerging as a viable tool for any business. For example, sentiment analysis algorithms are being used to make sense of user feedback in a customer feedback survey with open-ended questions and responses.
With the rapidly increasing growth in the field of internet and web usage, it has become essential to use a certain specific powerful tool, which should be capable to analyze and rank all these available reviews/opinion on the web/Internet. In this paper we have propose a new and effective approach which uses a powerful sentiment analysis procedure which will be based on an ontological adjustment and arrangements. This study also aims to understand pos tag order to get detailed observation for any review or opinion, it also helps in identifying all present positive /Negative sentiments and suggest a proper sentence inclination. For this we have used reviews available on internet regarding Nokia and Stanford parser for the purpose or pos tagging.
Due to the fast growth of World Wide Web the online communication has increased. In recent times the communication focus has shifted to social networking. In order to enhance the text methods of communication such as tweets, blogs and chats, it is necessary to examine the emotion of user by studying the input text. Online reviews are posted by customers for the products and services on offer at a website portal. This has provided impetus to substantial growth of online purchasing making opinion analysis a vital factor for business development. To analyze such text and reviews sentiment analysis is used. Sentiment analysis is a sub domain of Natural Language Processing which acquires writer’s feelings about several products which are placed on the internet through various comments or posts. It is used to find the opinion or response of the user. Opinion may be positive, negative or neutral. In this paper a review on sentiment analysis is done and the challenges and issues involved in the process are discussed. The approaches to sentiment analysis using dictionaries such as SenticNet, SentiFul, SentiWordNet, and WordNet are studied. Dictionary-based approaches are efficient over a domain of study. Although a generalized dictionary like WordNet may be used, the accuracy of the classifier get affected due to issues like negation, synonyms, sarcasm, etc.
w
Sentence level sentiment polarity calculation for customer reviews by conside...eSAT Publishing House
IJRET : International Journal of Research in Engineering and Technology is an international peer reviewed, online journal published by eSAT Publishing House for the enhancement of research in various disciplines of Engineering and Technology. The aim and scope of the journal is to provide an academic medium and an important reference for the advancement and dissemination of research results that support high-level learning, teaching and research in the fields of Engineering and Technology. We bring together Scientists, Academician, Field Engineers, Scholars and Students of related fields of Engineering and Technology
NLP Techniques for Sentiment Anaysis.docxKevinSims18
Natural Language Processing (NLP) is a subfield of artificial intelligence that deals with the interaction between computers and human languages. Sentiment analysis, on the other hand, is a technique used to determine the emotional tone of a piece of text. In this blog post, we will explore various NLP techniques used for sentiment analysis.
GraphRAG is All You need? LLM & Knowledge GraphGuy Korland
Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs.
1. Unifying Large Language Models and Knowledge Graphs: A Roadmap.
https://arxiv.org/abs/2306.08302
2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs:
https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/
Sentiment Features based Analysis of Online Reviewsiosrjce
IOSR Journal of Computer Engineering (IOSR-JCE) is a double blind peer reviewed International Journal that provides rapid publication (within a month) of articles in all areas of computer engineering and its applications. The journal welcomes publications of high quality papers on theoretical developments and practical applications in computer technology. Original research papers, state-of-the-art reviews, and high quality technical notes are invited for publications.
How Does Customer Feedback Sentiment Analysis Work in Search Marketing?Countants
When it comes to understanding customer feedback, sentiment analysis is emerging as a viable tool for any business. For example, sentiment analysis algorithms are being used to make sense of user feedback in a customer feedback survey with open-ended questions and responses.
With the rapidly increasing growth in the field of internet and web usage, it has become essential to use a certain specific powerful tool, which should be capable to analyze and rank all these available reviews/opinion on the web/Internet. In this paper we have propose a new and effective approach which uses a powerful sentiment analysis procedure which will be based on an ontological adjustment and arrangements. This study also aims to understand pos tag order to get detailed observation for any review or opinion, it also helps in identifying all present positive /Negative sentiments and suggest a proper sentence inclination. For this we have used reviews available on internet regarding Nokia and Stanford parser for the purpose or pos tagging.
Due to the fast growth of World Wide Web the online communication has increased. In recent times the communication focus has shifted to social networking. In order to enhance the text methods of communication such as tweets, blogs and chats, it is necessary to examine the emotion of user by studying the input text. Online reviews are posted by customers for the products and services on offer at a website portal. This has provided impetus to substantial growth of online purchasing making opinion analysis a vital factor for business development. To analyze such text and reviews sentiment analysis is used. Sentiment analysis is a sub domain of Natural Language Processing which acquires writer’s feelings about several products which are placed on the internet through various comments or posts. It is used to find the opinion or response of the user. Opinion may be positive, negative or neutral. In this paper a review on sentiment analysis is done and the challenges and issues involved in the process are discussed. The approaches to sentiment analysis using dictionaries such as SenticNet, SentiFul, SentiWordNet, and WordNet are studied. Dictionary-based approaches are efficient over a domain of study. Although a generalized dictionary like WordNet may be used, the accuracy of the classifier get affected due to issues like negation, synonyms, sarcasm, etc.
w
Sentence level sentiment polarity calculation for customer reviews by conside...eSAT Publishing House
IJRET : International Journal of Research in Engineering and Technology is an international peer reviewed, online journal published by eSAT Publishing House for the enhancement of research in various disciplines of Engineering and Technology. The aim and scope of the journal is to provide an academic medium and an important reference for the advancement and dissemination of research results that support high-level learning, teaching and research in the fields of Engineering and Technology. We bring together Scientists, Academician, Field Engineers, Scholars and Students of related fields of Engineering and Technology
NLP Techniques for Sentiment Anaysis.docxKevinSims18
Natural Language Processing (NLP) is a subfield of artificial intelligence that deals with the interaction between computers and human languages. Sentiment analysis, on the other hand, is a technique used to determine the emotional tone of a piece of text. In this blog post, we will explore various NLP techniques used for sentiment analysis.
GraphRAG is All You need? LLM & Knowledge GraphGuy Korland
Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs.
1. Unifying Large Language Models and Knowledge Graphs: A Roadmap.
https://arxiv.org/abs/2306.08302
2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs:
https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Ramesh Iyer
In today's fast-changing business world, Companies that adapt and embrace new ideas often need help to keep up with the competition. However, fostering a culture of innovation takes much work. It takes vision, leadership and willingness to take risks in the right proportion. Sachin Dev Duggal, co-founder of Builder.ai, has perfected the art of this balance, creating a company culture where creativity and growth are nurtured at each stage.
Connector Corner: Automate dynamic content and events by pushing a buttonDianaGray10
Here is something new! In our next Connector Corner webinar, we will demonstrate how you can use a single workflow to:
Create a campaign using Mailchimp with merge tags/fields
Send an interactive Slack channel message (using buttons)
Have the message received by managers and peers along with a test email for review
But there’s more:
In a second workflow supporting the same use case, you’ll see:
Your campaign sent to target colleagues for approval
If the “Approve” button is clicked, a Jira/Zendesk ticket is created for the marketing design team
But—if the “Reject” button is pushed, colleagues will be alerted via Slack message
Join us to learn more about this new, human-in-the-loop capability, brought to you by Integration Service connectors.
And...
Speakers:
Akshay Agnihotri, Product Manager
Charlie Greenberg, Host
Key Trends Shaping the Future of Infrastructure.pdfCheryl Hung
Keynote at DIGIT West Expo, Glasgow on 29 May 2024.
Cheryl Hung, ochery.com
Sr Director, Infrastructure Ecosystem, Arm.
The key trends across hardware, cloud and open-source; exploring how these areas are likely to mature and develop over the short and long-term, and then considering how organisations can position themselves to adapt and thrive.
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
DevOps and Testing slides at DASA ConnectKari Kakkonen
My and Rik Marselis slides at 30.5.2024 DASA Connect conference. We discuss about what is testing, then what is agile testing and finally what is Testing in DevOps. Finally we had lovely workshop with the participants trying to find out different ways to think about quality and testing in different parts of the DevOps infinity loop.
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
91mobiles recently conducted a Smart TV Buyer Insights Survey in which we asked over 3,000 respondents about the TV they own, aspects they look at on a new TV, and their TV buying preferences.
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...UiPathCommunity
💥 Speed, accuracy, and scaling – discover the superpowers of GenAI in action with UiPath Document Understanding and Communications Mining™:
See how to accelerate model training and optimize model performance with active learning
Learn about the latest enhancements to out-of-the-box document processing – with little to no training required
Get an exclusive demo of the new family of UiPath LLMs – GenAI models specialized for processing different types of documents and messages
This is a hands-on session specifically designed for automation developers and AI enthusiasts seeking to enhance their knowledge in leveraging the latest intelligent document processing capabilities offered by UiPath.
Speakers:
👨🏫 Andras Palfi, Senior Product Manager, UiPath
👩🏫 Lenka Dulovicova, Product Program Manager, UiPath
State of ICS and IoT Cyber Threat Landscape Report 2024 previewPrayukth K V
The IoT and OT threat landscape report has been prepared by the Threat Research Team at Sectrio using data from Sectrio, cyber threat intelligence farming facilities spread across over 85 cities around the world. In addition, Sectrio also runs AI-based advanced threat and payload engagement facilities that serve as sinks to attract and engage sophisticated threat actors, and newer malware including new variants and latent threats that are at an earlier stage of development.
The latest edition of the OT/ICS and IoT security Threat Landscape Report 2024 also covers:
State of global ICS asset and network exposure
Sectoral targets and attacks as well as the cost of ransom
Global APT activity, AI usage, actor and tactic profiles, and implications
Rise in volumes of AI-powered cyberattacks
Major cyber events in 2024
Malware and malicious payload trends
Cyberattack types and targets
Vulnerability exploit attempts on CVEs
Attacks on counties – USA
Expansion of bot farms – how, where, and why
In-depth analysis of the cyber threat landscape across North America, South America, Europe, APAC, and the Middle East
Why are attacks on smart factories rising?
Cyber risk predictions
Axis of attacks – Europe
Systemic attacks in the Middle East
Download the full report from here:
https://sectrio.com/resources/ot-threat-landscape-reports/sectrio-releases-ot-ics-and-iot-security-threat-landscape-report-2024/
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Tobias Schneck
As AI technology is pushing into IT I was wondering myself, as an “infrastructure container kubernetes guy”, how get this fancy AI technology get managed from an infrastructure operational view? Is it possible to apply our lovely cloud native principals as well? What benefit’s both technologies could bring to each other?
Let me take this questions and provide you a short journey through existing deployment models and use cases for AI software. On practical examples, we discuss what cloud/on-premise strategy we may need for applying it to our own infrastructure to get it to work from an enterprise perspective. I want to give an overview about infrastructure requirements and technologies, what could be beneficial or limiting your AI use cases in an enterprise environment. An interactive Demo will give you some insides, what approaches I got already working for real.
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Customer review using sentiment analysis.pptx
1. Title of the Project:-
Detailed Classification of Customer Reviews
Using SentimentAnalysis
G.H Raisoni College of Engineering, Nagpur
Department of Information Technology and
Engineering
Project Phase –I
:
2. ABSTRACT
With the rapid of Growth of E-Commerce websites,
there is no doubt that people are drawn to online
shopping more nowadays. As people are drawn to it, so
are the sellers. But sellers can differentiate in quality as
well as quantity.
To make it easier for consumers to decide which product
suits for their demands and needs, customer review on
E-Commerce Websites is a proficient way for consumers
to get what they are looking for
3.
4. INTRODUCTION
Sentiment analysis (or opinion mining) is a natural language
processing (NLP) technique used to determine whether data is
positive, negative, or neutral.
Sentiment analysis is often performed on text data to help
businesses monitor brand and product sentiment in customer
feedback and understand customer needs.
5. • The goal is to automatically recognize and classify opinions expressed in text to determine overall sentiment.
Sentiment analysis is the process of analyzing online writing to determine whether it is positive, negative, or neutral. Simply put,
sentiment analysis helps find the author's attitude towards a topic.
INTRODUCTION
6. Objective
We will be using Concepts likeVader and RoBERTa Model and comparing the results
between these two models.
• Vader Model:
Vader is model that is based on lexicon and rule based matching , sentiment analysis tool
that is specifically aware to sentiments expressed in social platform.
The VADER sentimental analysis uses a dictionary that converts lexical data into sentiment
scores, which measure the intensity of an emotion. By adding the intensity of each word in a
text, one can determine the sentiment score of that text.
• RoBERTa Model:
RoBERTa stands for Robustly Optimized BERT Pre-training Approach.
The goal of this model is to optimize the training of BERT architecture in order to take lesser
time during pre-training.
8. Methodology
VADER Model:
This model for text sentiment is sensitive to both the polarity (positive/negative)
and intensity (strong) of emotion.TheVADER sentimental analysis uses a
dictionary that converts lexical data into sentiment scores, which measure the
intensity of an emotion. By adding the intensity of each word in a text, one can
determine the sentiment score of that text.
9. POSTaggingTable:
• Part-of-speech (POS) is the practice of
categorizing words in a text (corpus) in
accordance with a certain part of
speech, depending on the word's
definition and context, is known as
tagging in natural language processing
11. RoBERTa Model
RoBERTa Model is a model trained of a large corpus of data
Transformer model that accounts for the words but also the
context related to other words.
teaches the computer to anticipate purposefully hidden text inside
examples of unannotated language
RoBERTa outperforms BERT in terms of the masked language
modelling aim and performs better on subsequent tasks.
12. TESTING
Postive reviews and their Polarity Scores
Review – “I am so happy I orderd it”
Here the Comment is I am so happy I orderd it , as we can see the review is about
a satisfied customer who is
happy with this product, hence we can say this is a positive review.
Now if we see the polarity scores that are
Negative (neg) – 0.0
Here there is no negative words or emotion hence the neg score is 0
Positive(pos) – 0.517
The positive score here is good as the words suggest that the review is overall a
positive review.
Compound Score – 0.646
13. TESTING
Review – “This is bad I hated it”
Here the Comment isThis is bad I hated it, as we can see the review is about
unsatisfied customer who is
unhappy with this product, hence we can say this is a negative review.
Now if we see the polarity scores that are
Negative (neg) – 0.658
32
Here there is a customer who is unhappy with the product so the emotion here is
negative, Hence the negative
value will be higher here.
Positive(pos) – 0.0
Here there is no positive words or emotion hence the neg score is 0.
Compound Score – 0.8271
14. CONCLUSION
As we can see in our model the ROBERta has scores that are much
confident than theVADER model as it used deep learning
approach. Due to this approach a difference can be seen between
the two models.
One cannot dismiss the value that sentiment analysis offers to the
industry despite all the obstacles and potential issues that it faces.
Sentiment analysis is destined to become one of the key
determinants of many business decisions in the future because it
bases its findings on elements that are fundamentally
compassionate.
Sentiment analysis’s results are helpful. It cannot be used to
forecast a company’s success or other measures. Sentiment
analysis may occasionally be unnecessary and only serve as a
reporting measure after the harm has already been done.
15. References
1] A. Srithirath and P. Seresangtakul, "A hybrid approach to Lao word segmentation using longest syllable level
matching with named entities recognition," 2013 10th International Conference on Electrical
Engineering/Electronics, Computer, Telecommunications and Information Technology, 2013, pp. 1-5, doi:
10.1109/ECTICon.2013.6559585.
2] R. Jiamthapthaksin, P. Setthawong and N. Ratanasawetwad, "A system for popular Thai slang extraction
from social media content with n-gram based tokenization," 2016 8th International Conference on Knowledge
and SmartTechnology (KST), 2016, pp. 130-135, doi: 10.1109/KST.2016.7440478.
3] I. Olenych, M. Prytula, O. Sinkevych and O. Khamar, "System of Automatic Determination of Ukrainian
Text Tone," 2021 IEEE 12th International Conference on Electronics and Information Technologies (ELIT),
2021, pp. 80-83, doi: 10.1109/ELIT53502.2021.9501124.
4] S. J. Putra, M. N. Gunawan and A. Suryatno, "Tokenization and N-Gram for Indexing Indonesian
Translation of the Quran," 2018 6th International Conference on Information and Communication Technology
(ICoICT), 2018, pp. 158-161, doi:10.1109/ICoICT.2018.8528762.
5] P. Prakrankamanant and E. Chuangsuwanich, "Tokenization-based data augmentation for text classification," 2022
19th International Joint Conference on Computer Science and Software Engineering (JCSSE), 2022, pp. 1-6, doi:
10.1109/JCSSE54890.2022.9836268.
6] Abdul-Mageed, M., M.T. Diab, and M. Korayem. Subjectivity and sentiment analysis of modern standard Arabic.
In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics:shortpapers, 2011.
7] Akkaya, C., J. Wiebe, and R. Mihalcea. Subjectivity word sense disambiguation. In Proceedings of
the 2009 Conference on Empirical Methods in Natural Language Processing (EMNLP-2009), 2009.
8] Alm, C.O. Subjective natural language problems: motivations, applications, characterizations, and
implications. In Proceedings of the 49th Annual Meeting of the Association for Computational
Linguistics:shortpapers (ACL-2011), 2011.