This document provides an agenda and overview for the 10th BIR Workshop on Bibliometric-enhanced Information Retrieval held on April 14, 2020 online. The workshop brings together researchers working at the intersection of information retrieval and bibliometrics. The agenda includes a keynote on metrics for assessing scientific impact and sessions on expert finding, citations, learning to rank, and evaluation. The document discusses the interdisciplinary nature of BIR research and provides additional reading and future research opportunities in the field.
From closed to open access: A case study of flipped journalsGESIS
This document presents a case study of journals that have flipped from closed access to open access publishing models. The study analyzed 171 journals that made this transition. It found that while the average journal impact factor initially increased after flipping, the average relative citation of individual articles decreased, consistent with other research. It also found these flipped journals tended to publish fewer articles after the transition. The study aims to better understand how bibliometric indicators of flipped journals change and how quality may influence these effects. Future work will include interviews and examine effects by journal quality.
Highly cited references in PLOS ONE and their in-text usage over timeGESIS
This document analyzes how highly cited references are used over time in the journal PLOS ONE. It finds that:
1) Over half of highly cited references are cited in the Method section. References with longer citation intervals (older at time of citing) are more likely to be cited in the Method section.
2) The proportion of sections changes over time, with newer references more likely to be cited in the Introduction and older references in the Method section.
3) The average number of co-citations in a sentence declines as the citation interval increases, meaning older references tend to be cited alone rather than with other references in a sentence.
4th Joint Workshop on Bibliometric-enhanced Information Retrieval and Natural...GESIS
This document provides information about the 4th Joint Workshop on Bibliometric-enhanced Information Retrieval and Natural Language Processing for Digital Libraries (BIRNDL 2019). The workshop aims to bring together researchers from bibliometrics, information retrieval, text mining, and natural language processing to discuss improving digital library services. The workshop will include keynote talks, paper presentations, and poster sessions. Accepted papers will be published in special issues of the Expert Systems and Scientometrics journals. The workshop addresses connections between bibliometrics and information retrieval that can help improve information seeking in digital libraries.
Bibliometric-enhanced Information Retrieval: Connecting IR with BibliometricsGESIS
Philipp Mayr gave a presentation on bibliometric-enhanced information retrieval (BIR). He discussed how BIR connects information retrieval and bibliometrics by modeling bibliometric concepts and integrating them into IR systems. Some examples of BIR research included document ranking, query expansion, and recommendation based on author keywords, topics, and citation networks. Workshops on BIR have aimed to bring together retrieval and bibliometrics researchers. While some experimental BIR systems exist, few approaches have been implemented in production search engines. Semantic Scholar was presented as one system that has integrated bibliometric concepts into its IR model.
Recent advances in the project EXCITE – Extraction of Citations from PDF Docu...GESIS
Workshop on Open Citations
SEPTEMBER 3-5, 2018 | BOLOGNA, ITALY
Presentation of the EXCITE project
Demo system: https://excite.informatik.uni-stuttgart.de/excite
Searching beyond datasets in the Social SciencesGESIS
1) State of the art search capabilities at GESIS include curated datasets with metadata and additional materials as well as harvested datasets and linking infrastructure between items.
2) Integrated search allows linking of papers and datasets in both directions to help users.
3) However, social scientists often want to reuse specific parts of datasets, like questions on a particular topic, requiring more fine-grained retrievability and linkages within datasets.
Contextualised Browsing in a Digital Library’s Living LabGESIS
Contextualisation has proven to be effective in tailoring
search results towards the users’ information need. While this
is true for a basic query search, the usage of contextual session
information during exploratory search especially on the level of
browsing has so far been underexposed in research. In this paper, we present two approaches that contextualise browsing on the level of structured metadata in a Digital Library (DL), (1) one variant bases on document similarity and (2) one variant utilises implicit session information, such as queries and different document metadata encountered during the session of a users. We evaluate our
approaches in a living lab environment using a DL in the social
sciences and compare our contextualisation approaches against
a non-contextualised approach. For a period of more than three
months we analysed 47,444 unique retrieval sessions that contain search activities on the level of browsing. Our results show that a contextualisation of browsing significantly outperforms our baseline in terms of the position of the first clicked item in the result set.
The mean rank of the first clicked document (measured as mean first relevant - MFR) was 4.52 using a non-contextualised ranking compared to 3.04 when re-ranking the result lists based on similarity to the previously viewed document. Furthermore, we observed that both contextual approaches show a noticeably higher clickthrough rate. A contextualisation based on document similarity leads to almost twice as many document views compared to the non-contextualised ranking.
Opening Scholarly Communication in Social Sciences by Connecting Collaborativ...GESIS
The objective of the OSCOSS research project on "Opening Scholarly Communication in the Social Sciences" is to build a coherent collaboration environment that facilitates scholarly communication workflows of social scientists in the roles of authors, reviewers, editors and readers. This paper presents the implementation of the core of this environment: the integration of the Fidus Writer academic word processor with the Open Journal Systems (OJS) submission and review management system.
Measuring the usefulness of Knowledge Organization Systems in Information Ret...GESIS
This document discusses three case studies that demonstrate the usefulness of knowledge organization systems (KOS) in information retrieval applications. The case studies show that:
1) Controlled vocabulary searches using term mappings between domains improved search effectiveness compared to searches without mappings.
2) Query expansion using recommendations from discipline-specific search term recommendation services led to better search results than using a general recommendation service.
3) Usage of search term recommendations in an interactive IR system was found to positively correlate with successful search outcomes in subsequent search steps.
Analyzing the research output presented at European Networked Knowledge Organ...GESIS
This document analyzes the research output presented at European Networked Knowledge Organization Systems (NKOS) workshops from 2000-2015. The authors compiled a bibliography of 171 papers presented by 218 authors. They analyzed the co-authorship network and found one large component with many authors connected, and smaller components with isolated co-authorships. Authors with the highest centrality, like degree and betweenness, were typically in the large component and helped transfer information in the network. Future work could extend the analysis to include more publications and citation data to better understand topic development over time.
Introduction to the 15th NKOS workshop @TPDL2016GESIS
This document provides information about the 15th European Networked Knowledge Organization Systems (NKOS) Workshop held on September 9, 2016 in Hannover, Germany. It announces that a special issue of the International Journal on Digital Libraries featuring papers from the NKOS workshop has been published. It also provides a link to the workshop proceedings published on CEUR-WS.org. The workshop program is listed, including 6 presentations on topics related to knowledge organization systems, followed by concluding discussions. Information is also provided on the format, next workshop, and contact for the workshop organizers.
Recent applications of Knowledge Organization SystemsGESIS
This document summarizes a special issue of the International Journal on Digital Libraries focusing on recent applications of Knowledge Organization Systems. It includes an editorial introduction and 6 full research papers covering topics like improving interoperability using vocabulary linked data, aligning conceptual structures in controlled vocabularies, composing hierarchical relations, a sharing-oriented design for networked knowledge organization systems, representing gazetteers and period thesauri in space-time, and extending the CRM for documenting standing buildings.
Using co-authorship networks for author name disambiguationGESIS
This document proposes using co-authorship networks to help disambiguate author names and cluster their publications. It aims to address the homonym problem of distinguishing publications from different authors with the same name, especially common names. The method builds a network of authors and publications, then performs clustering based on co-authorship networks. Community detection algorithms are also used to optimize results for common names by analyzing publication similarity within detected communities. Evaluation shows the approach improves precision, recall, and F-score for author name disambiguation compared to without community detection optimization.
This document provides an agenda and overview for the 10th BIR Workshop on Bibliometric-enhanced Information Retrieval held on April 14, 2020 online. The workshop brings together researchers working at the intersection of information retrieval and bibliometrics. The agenda includes a keynote on metrics for assessing scientific impact and sessions on expert finding, citations, learning to rank, and evaluation. The document discusses the interdisciplinary nature of BIR research and provides additional reading and future research opportunities in the field.
From closed to open access: A case study of flipped journalsGESIS
This document presents a case study of journals that have flipped from closed access to open access publishing models. The study analyzed 171 journals that made this transition. It found that while the average journal impact factor initially increased after flipping, the average relative citation of individual articles decreased, consistent with other research. It also found these flipped journals tended to publish fewer articles after the transition. The study aims to better understand how bibliometric indicators of flipped journals change and how quality may influence these effects. Future work will include interviews and examine effects by journal quality.
Highly cited references in PLOS ONE and their in-text usage over timeGESIS
This document analyzes how highly cited references are used over time in the journal PLOS ONE. It finds that:
1) Over half of highly cited references are cited in the Method section. References with longer citation intervals (older at time of citing) are more likely to be cited in the Method section.
2) The proportion of sections changes over time, with newer references more likely to be cited in the Introduction and older references in the Method section.
3) The average number of co-citations in a sentence declines as the citation interval increases, meaning older references tend to be cited alone rather than with other references in a sentence.
4th Joint Workshop on Bibliometric-enhanced Information Retrieval and Natural...GESIS
This document provides information about the 4th Joint Workshop on Bibliometric-enhanced Information Retrieval and Natural Language Processing for Digital Libraries (BIRNDL 2019). The workshop aims to bring together researchers from bibliometrics, information retrieval, text mining, and natural language processing to discuss improving digital library services. The workshop will include keynote talks, paper presentations, and poster sessions. Accepted papers will be published in special issues of the Expert Systems and Scientometrics journals. The workshop addresses connections between bibliometrics and information retrieval that can help improve information seeking in digital libraries.
Bibliometric-enhanced Information Retrieval: Connecting IR with BibliometricsGESIS
Philipp Mayr gave a presentation on bibliometric-enhanced information retrieval (BIR). He discussed how BIR connects information retrieval and bibliometrics by modeling bibliometric concepts and integrating them into IR systems. Some examples of BIR research included document ranking, query expansion, and recommendation based on author keywords, topics, and citation networks. Workshops on BIR have aimed to bring together retrieval and bibliometrics researchers. While some experimental BIR systems exist, few approaches have been implemented in production search engines. Semantic Scholar was presented as one system that has integrated bibliometric concepts into its IR model.
Recent advances in the project EXCITE – Extraction of Citations from PDF Docu...GESIS
Workshop on Open Citations
SEPTEMBER 3-5, 2018 | BOLOGNA, ITALY
Presentation of the EXCITE project
Demo system: https://excite.informatik.uni-stuttgart.de/excite
Searching beyond datasets in the Social SciencesGESIS
1) State of the art search capabilities at GESIS include curated datasets with metadata and additional materials as well as harvested datasets and linking infrastructure between items.
2) Integrated search allows linking of papers and datasets in both directions to help users.
3) However, social scientists often want to reuse specific parts of datasets, like questions on a particular topic, requiring more fine-grained retrievability and linkages within datasets.
Contextualised Browsing in a Digital Library’s Living LabGESIS
Contextualisation has proven to be effective in tailoring
search results towards the users’ information need. While this
is true for a basic query search, the usage of contextual session
information during exploratory search especially on the level of
browsing has so far been underexposed in research. In this paper, we present two approaches that contextualise browsing on the level of structured metadata in a Digital Library (DL), (1) one variant bases on document similarity and (2) one variant utilises implicit session information, such as queries and different document metadata encountered during the session of a users. We evaluate our
approaches in a living lab environment using a DL in the social
sciences and compare our contextualisation approaches against
a non-contextualised approach. For a period of more than three
months we analysed 47,444 unique retrieval sessions that contain search activities on the level of browsing. Our results show that a contextualisation of browsing significantly outperforms our baseline in terms of the position of the first clicked item in the result set.
The mean rank of the first clicked document (measured as mean first relevant - MFR) was 4.52 using a non-contextualised ranking compared to 3.04 when re-ranking the result lists based on similarity to the previously viewed document. Furthermore, we observed that both contextual approaches show a noticeably higher clickthrough rate. A contextualisation based on document similarity leads to almost twice as many document views compared to the non-contextualised ranking.
Opening Scholarly Communication in Social Sciences by Connecting Collaborativ...GESIS
The objective of the OSCOSS research project on "Opening Scholarly Communication in the Social Sciences" is to build a coherent collaboration environment that facilitates scholarly communication workflows of social scientists in the roles of authors, reviewers, editors and readers. This paper presents the implementation of the core of this environment: the integration of the Fidus Writer academic word processor with the Open Journal Systems (OJS) submission and review management system.
Measuring the usefulness of Knowledge Organization Systems in Information Ret...GESIS
This document discusses three case studies that demonstrate the usefulness of knowledge organization systems (KOS) in information retrieval applications. The case studies show that:
1) Controlled vocabulary searches using term mappings between domains improved search effectiveness compared to searches without mappings.
2) Query expansion using recommendations from discipline-specific search term recommendation services led to better search results than using a general recommendation service.
3) Usage of search term recommendations in an interactive IR system was found to positively correlate with successful search outcomes in subsequent search steps.
Analyzing the research output presented at European Networked Knowledge Organ...GESIS
This document analyzes the research output presented at European Networked Knowledge Organization Systems (NKOS) workshops from 2000-2015. The authors compiled a bibliography of 171 papers presented by 218 authors. They analyzed the co-authorship network and found one large component with many authors connected, and smaller components with isolated co-authorships. Authors with the highest centrality, like degree and betweenness, were typically in the large component and helped transfer information in the network. Future work could extend the analysis to include more publications and citation data to better understand topic development over time.
Introduction to the 15th NKOS workshop @TPDL2016GESIS
This document provides information about the 15th European Networked Knowledge Organization Systems (NKOS) Workshop held on September 9, 2016 in Hannover, Germany. It announces that a special issue of the International Journal on Digital Libraries featuring papers from the NKOS workshop has been published. It also provides a link to the workshop proceedings published on CEUR-WS.org. The workshop program is listed, including 6 presentations on topics related to knowledge organization systems, followed by concluding discussions. Information is also provided on the format, next workshop, and contact for the workshop organizers.
Recent applications of Knowledge Organization SystemsGESIS
This document summarizes a special issue of the International Journal on Digital Libraries focusing on recent applications of Knowledge Organization Systems. It includes an editorial introduction and 6 full research papers covering topics like improving interoperability using vocabulary linked data, aligning conceptual structures in controlled vocabularies, composing hierarchical relations, a sharing-oriented design for networked knowledge organization systems, representing gazetteers and period thesauri in space-time, and extending the CRM for documenting standing buildings.
Using co-authorship networks for author name disambiguationGESIS
This document proposes using co-authorship networks to help disambiguate author names and cluster their publications. It aims to address the homonym problem of distinguishing publications from different authors with the same name, especially common names. The method builds a network of authors and publications, then performs clustering based on co-authorship networks. Community detection algorithms are also used to optimize results for common names by analyzing publication similarity within detected communities. Evaluation shows the approach improves precision, recall, and F-score for author name disambiguation compared to without community detection optimization.