IVACS Symposium 2010
•
1 like•625 views
The document discusses various language corpora developed at the University of Nottingham, including mono-modal corpora focused on specific types of language data as well as multi-modal corpora incorporating multiple data types. It specifically describes the Nottingham eLanguage Corpus containing SMS messages, social media posts, blogs, and other online texts along with associated metadata. The document also introduces the Thrill corpus containing synchronized audio, video, and sensor data from people riding fairground rides aimed at examining language use during different phases of the rides.
Report
Share
Report
Share
![Corpus development at Nottingham ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]](data:image/gif;base64,R0lGODlhAQABAIAAAAAAAP///yH5BAEAAAAALAAAAAABAAEAAAIBRAA7)
Recommended
ICAME 2010
The document discusses the development of corpora at the University of Nottingham, including both mono-modal corpora containing one type of data (text-based) and multi-modal corpora containing multiple data types (text, video, audio). It describes the Nottingham Multi-Modal Corpus and Nottingham Learner Corpora as examples. The Nottingham eLanguage Corpus aims to collect diverse digital language data types from individuals, including SMS, email, social media, web browsing history, and location data. One challenge is modeling how language varies based on dynamic contextual factors. As a case study, the document outlines the Thrill corpus containing synchronized audio, video and sensor data from fairground rides, to examine linguistic patterns across different phases
Description of Process
"On the Description of Process in Digital Scholarship" Paper at the 1st Workshop on Humanities in the SEmantic web (WHiSE 2016) colocated with ESWC 2016, Heraklion, Crete, Sunday 29 May 2016
NJVR: The NanJing Vocabulary Repository
The document describes the NanJing Vocabulary Repository (NJVR), a freely accessible collection of real-world vocabularies created by crawling over 4 billion RDF triples from thousands of domains. NJVR contains RDF descriptions of over 2,900 vocabularies identified from 261 domains as well as statistical data on their usage. It was constructed through crawling, vocabulary identification, and analysis of vocabulary instantiations. The goal is to provide a large test collection for research on topics like vocabulary ranking and matching.
What are the basics of Analysing a corpus? chpt.10 Routledge
This document provides an overview of the basics of analyzing a corpus through various techniques including frequency analysis, normalization, keyword analysis, and concordance analysis. It explains that frequency lists show how often words occur, normalization adjusts for corpus size differences, keyword analysis finds statistically significant words compared to a reference corpus, and concordance analysis displays keywords in context to better understand usage. The document serves as an introduction to basic corpus analysis methods and tools.
Corpus Linguistics :Analytical Tools
Detailed presentation on various analytical tools widely used in Corpus Linguistics for corpora analysis including WORDCRUNCHER, LEXA, CWB , TACT, MICROCONCORD etc.
Corpus linguistics
This document provides an introduction to corpus linguistics, including definitions of key terms and concepts. It discusses the history and development of corpus linguistics from early generational corpora in the 1960s-1990s to current applications. The document outlines different types of corpora as well as software tools used for corpus analysis. Both advantages and limitations of using corpora are presented. Finally, examples of famous corpora and applications to translation studies and research methods in corpus linguistics are briefly mentioned.
Corpus linguistics intro
Corpus linguistics involves the collection and analysis of large bodies of text, known as corpora. It uses empirical methods to discover patterns of language use by examining naturally occurring texts. Key aspects of corpus linguistics include using large, representative text samples; analyzing frequency, collocation, and concordance; and applying findings to fields like lexicography, language teaching, and theoretical linguistics. Corpus analysis tools allow researchers to investigate features of syntax, semantics, and pragmatics that traditional intuition-based methods cannot.
Second Life & Education
1. The document discusses how virtual worlds like Second Life are being used for teaching and learning, providing examples of classrooms, models, simulations, and role-playing scenarios created in Second Life.
2. Some examples of educational uses in Second Life include business law classes at Bradley University, English courses at Ball State University, and medical simulations at Tacoma Community College.
3. The document advocates for using virtual worlds to increase interactivity and engaged learning through techniques like virtual field trips, interactive models, simulations, role-playing, and group work.
Recommended
ICAME 2010
The document discusses the development of corpora at the University of Nottingham, including both mono-modal corpora containing one type of data (text-based) and multi-modal corpora containing multiple data types (text, video, audio). It describes the Nottingham Multi-Modal Corpus and Nottingham Learner Corpora as examples. The Nottingham eLanguage Corpus aims to collect diverse digital language data types from individuals, including SMS, email, social media, web browsing history, and location data. One challenge is modeling how language varies based on dynamic contextual factors. As a case study, the document outlines the Thrill corpus containing synchronized audio, video and sensor data from fairground rides, to examine linguistic patterns across different phases
Description of Process
"On the Description of Process in Digital Scholarship" Paper at the 1st Workshop on Humanities in the SEmantic web (WHiSE 2016) colocated with ESWC 2016, Heraklion, Crete, Sunday 29 May 2016
NJVR: The NanJing Vocabulary Repository
The document describes the NanJing Vocabulary Repository (NJVR), a freely accessible collection of real-world vocabularies created by crawling over 4 billion RDF triples from thousands of domains. NJVR contains RDF descriptions of over 2,900 vocabularies identified from 261 domains as well as statistical data on their usage. It was constructed through crawling, vocabulary identification, and analysis of vocabulary instantiations. The goal is to provide a large test collection for research on topics like vocabulary ranking and matching.
What are the basics of Analysing a corpus? chpt.10 Routledge
This document provides an overview of the basics of analyzing a corpus through various techniques including frequency analysis, normalization, keyword analysis, and concordance analysis. It explains that frequency lists show how often words occur, normalization adjusts for corpus size differences, keyword analysis finds statistically significant words compared to a reference corpus, and concordance analysis displays keywords in context to better understand usage. The document serves as an introduction to basic corpus analysis methods and tools.
Corpus Linguistics :Analytical Tools
Detailed presentation on various analytical tools widely used in Corpus Linguistics for corpora analysis including WORDCRUNCHER, LEXA, CWB , TACT, MICROCONCORD etc.
Corpus linguistics
This document provides an introduction to corpus linguistics, including definitions of key terms and concepts. It discusses the history and development of corpus linguistics from early generational corpora in the 1960s-1990s to current applications. The document outlines different types of corpora as well as software tools used for corpus analysis. Both advantages and limitations of using corpora are presented. Finally, examples of famous corpora and applications to translation studies and research methods in corpus linguistics are briefly mentioned.
Corpus linguistics intro
Corpus linguistics involves the collection and analysis of large bodies of text, known as corpora. It uses empirical methods to discover patterns of language use by examining naturally occurring texts. Key aspects of corpus linguistics include using large, representative text samples; analyzing frequency, collocation, and concordance; and applying findings to fields like lexicography, language teaching, and theoretical linguistics. Corpus analysis tools allow researchers to investigate features of syntax, semantics, and pragmatics that traditional intuition-based methods cannot.
Second Life & Education
1. The document discusses how virtual worlds like Second Life are being used for teaching and learning, providing examples of classrooms, models, simulations, and role-playing scenarios created in Second Life.
2. Some examples of educational uses in Second Life include business law classes at Bradley University, English courses at Ball State University, and medical simulations at Tacoma Community College.
3. The document advocates for using virtual worlds to increase interactivity and engaged learning through techniques like virtual field trips, interactive models, simulations, role-playing, and group work.
IVACS 2010
1. The document discusses considerations for developing multi-modal corpora, including design, size and scope, quality, authenticity, and availability.
2. It describes the aims of the DReSS II project to record novel forms of digital data using computational methods and develop new corpus analysis techniques.
3. Examples of data types that could be included in ubiquitous heterogeneous corpora are discussed, such as SMS, email, web browsing, video calls, to capture a day in a person's digital life.
Recent advances in LVCSR : A benchmark comparison of performances
Large Vocabulary Continuous Speech Recognition (LVCSR), which is characterized by a high variability of the speech, is the most challenging task in automatic speech recognition (ASR). Believing that the evaluation of ASR systems on relevant and common speech corpora is one of the key factors that help accelerating research, we present, in this paper, a benchmark comparison of the performances of the current state-of-the-art LVCSR systems over different speech recognition tasks. Furthermore, we put objectively into evidence the best performing technologies and the best accuracy achieved so far in each task. The benchmarks have shown that the Deep Neural Networks and Convolutional Neural Networks have proven their efficiency on several LVCSR tasks by outperforming the traditional Hidden Markov Models and Guaussian Mixture Models. They have also shown that despite the satisfying performances in some LVCSR tasks, the problem of large-vocabulary speech recognition is far from being solved in some others, where more research efforts are still needed.
Wreck a nice beach: adventures in speech recognition
Introduction to speech recognition and a description of a project to integrate CMU Sphinx into the Opencast Matterhorn lecture capture system, focusing on language model adaptation using Wikipedia as a corpus.
LREC 2010
- Adolphs, S., Carter, R. and Knight, D.
- Second phase multi-modal corpora: Heterogeneous datasets for linguistic analysis.
Acceptance Testing Of A Spoken Language Translation System
This document describes an acceptance test procedure for evaluating a spoken language translation system between Catalan and Spanish. The procedure consisted of two independent tests: (1) an utterance-oriented test to evaluate how speech impacts communication by comparing performance of text vs. speech inputs and outputs, and (2) a task-oriented test to evaluate if users could complete predefined tasks with the system. Twelve subjects participated in the tests, with eight familiar with the technology and four unfamiliar. The results showed that speech-to-speech translation was not fully effective but improving, and there were no significant differences between familiar and unfamiliar users. This evaluation considered performance at both the utterance and task levels.
INTELLIGENT QUERY PROCESSING IN MALAYALAM
The document describes an intelligent query processing system for the Malayalam language. It presents a model for developing such a system, focusing on time inquiries for different transportation modes. The system performs shallow syntactic and semantic analysis of queries. It determines the query type and required result slots. SQL queries are generated to retrieve answers from the database. The system architecture includes morphological analysis, shallow parsing, query frame identification, SQL generation, and answer retrieval. It was evaluated on 70 queries with 87.5% precision.
Statistical Named Entity Recognition for Hungarian – analysis ...
This document describes statistical named entity recognition for Hungarian texts. The authors created a corpus of Hungarian news articles annotated with named entity tags. They used a rich set of 225 linguistic features to train support vector machines, neural networks, and decision trees. Their best model achieved an F-measure of 93.59% for term-level named entity recognition and 90.57% for phrase-level, outperforming prior rule-based systems for Hungarian. Feature selection helped reduce the feature set to 135 while maintaining high performance.
Modeling of Speech Synthesis of Standard Arabic Using an Expert System
This document describes an expert system for speech synthesis of Standard Arabic text. It involves two main stages: 1) creation of a sound database and 2) text-to-speech transformation. The transformation process involves phonetic orthographic transcription of the text and then generating voice signals corresponding to the transcribed phonetic sequence. The expert system uses a knowledge base containing sound data and rewriting rules. It transcribes text using graphemes as basic units and then concatenates sound units from the database to synthesize speech. Tests achieved a 96% success rate in pronouncing sentences correctly. Future work aims to improve prosody and develop fully automatic signal segmentation.
Explanations in Dialogue Systems through Uncertain RDF Knowledge Bases
We implemented a generic dialogue shell that can be configured for and applied to domain-specific dialogue applications. The dialogue system works robustly for a new domain when the application backend can automatically infer previously unknown knowledge (facts) and provide explanations for the inference steps involved. For this purpose, we employ URDF, a query engine for uncertain and potentially inconsistent RDF knowledge bases. URDF supports rule-based, first-order predicate logic as used in OWL-Lite and OWL-DL, with simple and effective top-down reasoning capabilities. This mechanism also generates explanation graphs. These graphs can then be displayed in the GUI of the dialogue shell and help the user understand the underlying reasoning processes. We believe that proper explanations are a main factor for increasing the level of user trust in end-to-end human-computer interaction systems.
cldr_overview
- CLDR (Common Locale Data Repository) is a project hosted by Unicode Consortium to collect and maintain locale data for software localization in XML format. It aims to provide common locale data that is freely available.
- CLDR 1.3 was released in June 2005, containing data for 296 locales including dates/time formats, numbers/currencies, translations, and more. New features included additional timezone translations and currency codes.
- Future releases will focus on enhancing existing data, improving structure/tools, and incorporating vetted data from experts worldwide. The process aims to resolve conflicts and get broad agreement through an open committee approach.
Research Developments and Directions in Speech Recognition and ...
The document discusses research developments and directions in speech recognition and understanding. It outlines significant developments including improvements to infrastructure like hardware, corpora, and evaluation benchmarks. It also discusses advances in knowledge representation like acoustic features and graph representations, as well as models and algorithms like hidden Markov models and discriminative training. The document proposes six potential "grand challenges" for future research, including creating systems robust to everyday audio variability, rapidly developing speech technologies for emerging languages with limited resources, and enabling spoken language comprehension.
Bird05 nltk-intro
This document provides an introduction to natural language processing (NLP). It discusses the importance and challenges of language, provides a brief history of NLP, and introduces the Natural Language Toolkit (NLTK) for practical NLP. The key points covered are: (1) Language is complex and diverse, yet critical for human communication and civilization. (2) Early NLP drew from formal language theory, symbolic logic, and the principle of compositionality to computationally model language. (3) Current challenges include analyzing vast online text and developing more human-like dialogue systems.
Semantic Search Component
Concept and example of a semantic solution implemented with SQL views to cooperate with users on queries over structured data with independence from database schema knowledge and technology.
Towards Modelling Language Innovation Acceptance in Online Social Networks
Language change and innovation is constant in online and offline communication, and has led to new words entering people's lexicon and even entering modern day dictionaries, with recent additions of `e-cig' and `vape'. However the manual work required to identify these `innovations' is both time consuming and subjective. In this work we demonstrate how such innovations in language can be identified across two different OSN's (Online Social Networks) through the operationalisation of known language acceptance models that incorporate relatively simple statistical tests. From grounding our work in language theory, we identified three statistical tests that can be applied - variation in; frequency, form and meaning. Each show different success rates across the two networks (Geo-bound Twitter sample and a sample of Reddit). These tests were also applied to different community levels within the two networks allowing for different innovations to be identified across different community structures over the two networks, for instance: identifying regional variation across Twitter, and variation across groupings of Subreddits, where identified example innovations included `casualidad' and 'cym'.
Knowledge-poor and Knowledge-rich Approaches for Multilingual Terminology Ext...
This document compares a knowledge-poor probabilistic approach and a knowledge-rich rule-based approach for multilingual terminology extraction. It describes the methodology and resources used for each approach. The knowledge-poor approach uses distributional clustering to induce part-of-speech tags and conditional random fields to extract candidate terms from small annotated corpora. The knowledge-rich approach relies on hand-crafted patterns and rules based on part-of-speech tags to identify terms and variants. Both approaches are evaluated on terminology extraction for six languages from comparable corpora in the domains of wind energy and mobile technologies, using reference term lists.
Brislinger, Recker: Keeping data re-usable in the evs
Brislinger, Recker: Keeping data re-usable in the evsGESIS - Leibniz-Institut für Sozialwissenschaften
Alive and kicking! Keeping data re-usable in the European Values Study:
- Data and information flow in the EVS project
- Principles and workflows for managing data and documentation in survey projectsAlive and kicking! Keeping data re-usable in the European Values Study
Alive and kicking! Keeping data re-usable in the European Values Study
Evelyn Brislinger, Astrid Recker
GESIS - Leibniz Institute for the Social Sciences
Repeated cross-national surveys generate huge amounts of cross-linked data and metadata. To enable replication and to make this data re-usable in new research contexts, thorough and standardized documentation of data and project workflow is indispensable. However, in the social sciences, data and documentation often undergo a continuous process of correction, refinement, and further development. These processes need to be documented too, especially to allow data providers to build on these results and experiences in preparation of the next wave.
In this paper, we use the European Values Study (EVS) 1981-2008 to illustrate the challenges to be met in the active curation of extensive amounts of data and documentation created, altered, and re-used across the survey life-cycle. Outlining how these challenges are met by the EVS, we will particularly discuss the following questions: Looking beyond the “standard” documentation of data and survey methods, what supporting contextual information should accompany data to ensure their effective “migration” and use across waves? Especially relevant in a project composed of 125 national surveys covering 49 countries and spanning almost 30 years is the question which preservation metadata is needed to achieve this objective and thus support the long-term accessibility of data and contextual information?
Harmony project - JISC Synthesis meeting 2001
The Harmony collaboration led to a metadata model and query implementation that supports resource discovery over multimedia metadata descriptions. Key aspects include extending Dublin Core for multimedia, modeling complex cases like versioning and alternate formats, and proposing a common approach. The ABC model was implemented to address metadata challenges and allows querying across namespaces. Lessons learned include issues with project scope and coordination across distributed teams.
A Recorded Debating Dataset
This document describes a new English audio and textual dataset of recorded debating speeches produced by professional debaters. The dataset includes 60 speeches on various controversial topics, each provided in 5 formats corresponding to different stages of production: 1) the original audio recording, 2) an automatic transcription from speech recognition, 3) a "cleaned" version of the automatic transcription, 4) a manual transcription serving as a reference, and 5) background information on the topic. The intention is to make the data available for various computational argumentation and debating research purposes such as training speech recognition systems or applying argument mining techniques.
Natural Language Processing, Techniques, Current Trends and Applications in I...
The document discusses natural language processing (NLP) techniques, current trends, and applications in industry. It covers common NLP techniques like morphology, syntax, semantics, and pragmatics. It also discusses word embeddings like Word2Vec and contextual embeddings like BERT. Finally, it discusses applications of NLP in healthcare like analyzing clinical notes and brand monitoring through sentiment analysis of user reviews.
More Related Content
Similar to IVACS Symposium 2010
IVACS 2010
1. The document discusses considerations for developing multi-modal corpora, including design, size and scope, quality, authenticity, and availability.
2. It describes the aims of the DReSS II project to record novel forms of digital data using computational methods and develop new corpus analysis techniques.
3. Examples of data types that could be included in ubiquitous heterogeneous corpora are discussed, such as SMS, email, web browsing, video calls, to capture a day in a person's digital life.
Recent advances in LVCSR : A benchmark comparison of performances
Large Vocabulary Continuous Speech Recognition (LVCSR), which is characterized by a high variability of the speech, is the most challenging task in automatic speech recognition (ASR). Believing that the evaluation of ASR systems on relevant and common speech corpora is one of the key factors that help accelerating research, we present, in this paper, a benchmark comparison of the performances of the current state-of-the-art LVCSR systems over different speech recognition tasks. Furthermore, we put objectively into evidence the best performing technologies and the best accuracy achieved so far in each task. The benchmarks have shown that the Deep Neural Networks and Convolutional Neural Networks have proven their efficiency on several LVCSR tasks by outperforming the traditional Hidden Markov Models and Guaussian Mixture Models. They have also shown that despite the satisfying performances in some LVCSR tasks, the problem of large-vocabulary speech recognition is far from being solved in some others, where more research efforts are still needed.
Wreck a nice beach: adventures in speech recognition
Introduction to speech recognition and a description of a project to integrate CMU Sphinx into the Opencast Matterhorn lecture capture system, focusing on language model adaptation using Wikipedia as a corpus.
LREC 2010
- Adolphs, S., Carter, R. and Knight, D.
- Second phase multi-modal corpora: Heterogeneous datasets for linguistic analysis.
Acceptance Testing Of A Spoken Language Translation System
This document describes an acceptance test procedure for evaluating a spoken language translation system between Catalan and Spanish. The procedure consisted of two independent tests: (1) an utterance-oriented test to evaluate how speech impacts communication by comparing performance of text vs. speech inputs and outputs, and (2) a task-oriented test to evaluate if users could complete predefined tasks with the system. Twelve subjects participated in the tests, with eight familiar with the technology and four unfamiliar. The results showed that speech-to-speech translation was not fully effective but improving, and there were no significant differences between familiar and unfamiliar users. This evaluation considered performance at both the utterance and task levels.
INTELLIGENT QUERY PROCESSING IN MALAYALAM
The document describes an intelligent query processing system for the Malayalam language. It presents a model for developing such a system, focusing on time inquiries for different transportation modes. The system performs shallow syntactic and semantic analysis of queries. It determines the query type and required result slots. SQL queries are generated to retrieve answers from the database. The system architecture includes morphological analysis, shallow parsing, query frame identification, SQL generation, and answer retrieval. It was evaluated on 70 queries with 87.5% precision.
Statistical Named Entity Recognition for Hungarian – analysis ...
This document describes statistical named entity recognition for Hungarian texts. The authors created a corpus of Hungarian news articles annotated with named entity tags. They used a rich set of 225 linguistic features to train support vector machines, neural networks, and decision trees. Their best model achieved an F-measure of 93.59% for term-level named entity recognition and 90.57% for phrase-level, outperforming prior rule-based systems for Hungarian. Feature selection helped reduce the feature set to 135 while maintaining high performance.
Modeling of Speech Synthesis of Standard Arabic Using an Expert System
This document describes an expert system for speech synthesis of Standard Arabic text. It involves two main stages: 1) creation of a sound database and 2) text-to-speech transformation. The transformation process involves phonetic orthographic transcription of the text and then generating voice signals corresponding to the transcribed phonetic sequence. The expert system uses a knowledge base containing sound data and rewriting rules. It transcribes text using graphemes as basic units and then concatenates sound units from the database to synthesize speech. Tests achieved a 96% success rate in pronouncing sentences correctly. Future work aims to improve prosody and develop fully automatic signal segmentation.
Explanations in Dialogue Systems through Uncertain RDF Knowledge Bases
We implemented a generic dialogue shell that can be configured for and applied to domain-specific dialogue applications. The dialogue system works robustly for a new domain when the application backend can automatically infer previously unknown knowledge (facts) and provide explanations for the inference steps involved. For this purpose, we employ URDF, a query engine for uncertain and potentially inconsistent RDF knowledge bases. URDF supports rule-based, first-order predicate logic as used in OWL-Lite and OWL-DL, with simple and effective top-down reasoning capabilities. This mechanism also generates explanation graphs. These graphs can then be displayed in the GUI of the dialogue shell and help the user understand the underlying reasoning processes. We believe that proper explanations are a main factor for increasing the level of user trust in end-to-end human-computer interaction systems.
cldr_overview
- CLDR (Common Locale Data Repository) is a project hosted by Unicode Consortium to collect and maintain locale data for software localization in XML format. It aims to provide common locale data that is freely available.
- CLDR 1.3 was released in June 2005, containing data for 296 locales including dates/time formats, numbers/currencies, translations, and more. New features included additional timezone translations and currency codes.
- Future releases will focus on enhancing existing data, improving structure/tools, and incorporating vetted data from experts worldwide. The process aims to resolve conflicts and get broad agreement through an open committee approach.
Research Developments and Directions in Speech Recognition and ...
The document discusses research developments and directions in speech recognition and understanding. It outlines significant developments including improvements to infrastructure like hardware, corpora, and evaluation benchmarks. It also discusses advances in knowledge representation like acoustic features and graph representations, as well as models and algorithms like hidden Markov models and discriminative training. The document proposes six potential "grand challenges" for future research, including creating systems robust to everyday audio variability, rapidly developing speech technologies for emerging languages with limited resources, and enabling spoken language comprehension.
Bird05 nltk-intro
This document provides an introduction to natural language processing (NLP). It discusses the importance and challenges of language, provides a brief history of NLP, and introduces the Natural Language Toolkit (NLTK) for practical NLP. The key points covered are: (1) Language is complex and diverse, yet critical for human communication and civilization. (2) Early NLP drew from formal language theory, symbolic logic, and the principle of compositionality to computationally model language. (3) Current challenges include analyzing vast online text and developing more human-like dialogue systems.
Semantic Search Component
Concept and example of a semantic solution implemented with SQL views to cooperate with users on queries over structured data with independence from database schema knowledge and technology.
Towards Modelling Language Innovation Acceptance in Online Social Networks
Language change and innovation is constant in online and offline communication, and has led to new words entering people's lexicon and even entering modern day dictionaries, with recent additions of `e-cig' and `vape'. However the manual work required to identify these `innovations' is both time consuming and subjective. In this work we demonstrate how such innovations in language can be identified across two different OSN's (Online Social Networks) through the operationalisation of known language acceptance models that incorporate relatively simple statistical tests. From grounding our work in language theory, we identified three statistical tests that can be applied - variation in; frequency, form and meaning. Each show different success rates across the two networks (Geo-bound Twitter sample and a sample of Reddit). These tests were also applied to different community levels within the two networks allowing for different innovations to be identified across different community structures over the two networks, for instance: identifying regional variation across Twitter, and variation across groupings of Subreddits, where identified example innovations included `casualidad' and 'cym'.
Knowledge-poor and Knowledge-rich Approaches for Multilingual Terminology Ext...
This document compares a knowledge-poor probabilistic approach and a knowledge-rich rule-based approach for multilingual terminology extraction. It describes the methodology and resources used for each approach. The knowledge-poor approach uses distributional clustering to induce part-of-speech tags and conditional random fields to extract candidate terms from small annotated corpora. The knowledge-rich approach relies on hand-crafted patterns and rules based on part-of-speech tags to identify terms and variants. Both approaches are evaluated on terminology extraction for six languages from comparable corpora in the domains of wind energy and mobile technologies, using reference term lists.
Brislinger, Recker: Keeping data re-usable in the evs
Brislinger, Recker: Keeping data re-usable in the evsGESIS - Leibniz-Institut für Sozialwissenschaften
Alive and kicking! Keeping data re-usable in the European Values Study:
- Data and information flow in the EVS project
- Principles and workflows for managing data and documentation in survey projectsAlive and kicking! Keeping data re-usable in the European Values Study
Alive and kicking! Keeping data re-usable in the European Values Study
Evelyn Brislinger, Astrid Recker
GESIS - Leibniz Institute for the Social Sciences
Repeated cross-national surveys generate huge amounts of cross-linked data and metadata. To enable replication and to make this data re-usable in new research contexts, thorough and standardized documentation of data and project workflow is indispensable. However, in the social sciences, data and documentation often undergo a continuous process of correction, refinement, and further development. These processes need to be documented too, especially to allow data providers to build on these results and experiences in preparation of the next wave.
In this paper, we use the European Values Study (EVS) 1981-2008 to illustrate the challenges to be met in the active curation of extensive amounts of data and documentation created, altered, and re-used across the survey life-cycle. Outlining how these challenges are met by the EVS, we will particularly discuss the following questions: Looking beyond the “standard” documentation of data and survey methods, what supporting contextual information should accompany data to ensure their effective “migration” and use across waves? Especially relevant in a project composed of 125 national surveys covering 49 countries and spanning almost 30 years is the question which preservation metadata is needed to achieve this objective and thus support the long-term accessibility of data and contextual information?
Harmony project - JISC Synthesis meeting 2001
The Harmony collaboration led to a metadata model and query implementation that supports resource discovery over multimedia metadata descriptions. Key aspects include extending Dublin Core for multimedia, modeling complex cases like versioning and alternate formats, and proposing a common approach. The ABC model was implemented to address metadata challenges and allows querying across namespaces. Lessons learned include issues with project scope and coordination across distributed teams.
A Recorded Debating Dataset
This document describes a new English audio and textual dataset of recorded debating speeches produced by professional debaters. The dataset includes 60 speeches on various controversial topics, each provided in 5 formats corresponding to different stages of production: 1) the original audio recording, 2) an automatic transcription from speech recognition, 3) a "cleaned" version of the automatic transcription, 4) a manual transcription serving as a reference, and 5) background information on the topic. The intention is to make the data available for various computational argumentation and debating research purposes such as training speech recognition systems or applying argument mining techniques.
Natural Language Processing, Techniques, Current Trends and Applications in I...
The document discusses natural language processing (NLP) techniques, current trends, and applications in industry. It covers common NLP techniques like morphology, syntax, semantics, and pragmatics. It also discusses word embeddings like Word2Vec and contextual embeddings like BERT. Finally, it discusses applications of NLP in healthcare like analyzing clinical notes and brand monitoring through sentiment analysis of user reviews.
Similar to IVACS Symposium 2010 (20)
Recent advances in LVCSR : A benchmark comparison of performances
Recent advances in LVCSR : A benchmark comparison of performances
Wreck a nice beach: adventures in speech recognition
Wreck a nice beach: adventures in speech recognition
Acceptance Testing Of A Spoken Language Translation System
Acceptance Testing Of A Spoken Language Translation System
Statistical Named Entity Recognition for Hungarian – analysis ...
Statistical Named Entity Recognition for Hungarian – analysis ...
Modeling of Speech Synthesis of Standard Arabic Using an Expert System
Modeling of Speech Synthesis of Standard Arabic Using an Expert System
Explanations in Dialogue Systems through Uncertain RDF Knowledge Bases
Explanations in Dialogue Systems through Uncertain RDF Knowledge Bases
Research Developments and Directions in Speech Recognition and ...
Research Developments and Directions in Speech Recognition and ...
Towards Modelling Language Innovation Acceptance in Online Social Networks
Towards Modelling Language Innovation Acceptance in Online Social Networks
Knowledge-poor and Knowledge-rich Approaches for Multilingual Terminology Ext...
Knowledge-poor and Knowledge-rich Approaches for Multilingual Terminology Ext...
Brislinger, Recker: Keeping data re-usable in the evs
Brislinger, Recker: Keeping data re-usable in the evs
Alive and kicking! Keeping data re-usable in the European Values Study
Alive and kicking! Keeping data re-usable in the European Values Study
Natural Language Processing, Techniques, Current Trends and Applications in I...
Natural Language Processing, Techniques, Current Trends and Applications in I...
IVACS Symposium 2010
- 1. Language, Corpora and Context: A ‘Thrilling’ Case Study Dawn Knight The University of Nottingham
- 9. DRS: Digital Replay System (video demo)
- 10. Future developments in DRS- mock-up 1
- 11. Future developments in DRS- mock-up 1
- 16. Phase 1: Frequency based word clouds Phase 2: Frequency based word clouds Phase 3: Frequency based word clouds Phase 4: Frequency based word clouds
- 18. Acknowledgements Research team The Digital Records for e-Social Science Project is funded by the ESRC.
Editor's Notes
- SVENJA
- Click the image to play a 2 minute(ish) Thrill video