Towards Better Media Understanding and Searchability

•

1 like•5,290 views

This document discusses improving media understanding and searchability. It mentions CrowdTruth.org, DIVE+, and CLARIAH, which are projects aimed at using crowdsourcing and linked open data to better analyze and organize media like images, video, and audio. DIVE+ is part of both CLARIAH and Beeldengeluid, and provides a platform for analyzing multimedia content.

Towards Better Media
Understanding and
Searchability
Oana Inel Lora Aroyo
@oana_inel @laroyo

http://diveplus.beeldengeluid.nl
http://www.clariah.nl/
http://crowdtruth.org
http://wm.cs.vu.nl

DIVE+ is an event-centric linked data digital collection browser aimed to provide an integrated and interactive access to multimedia objects from various heterogeneous online collections. It enriches the structured metadata of online collections with linked open data vocabularies with focus on events, people, locations and concepts that are depicted or associated with particular collection objects. DIVE+ is result of a true inter-disciplinary collaboration between computer scientists, humanities scholars, cultural heritage professionals and interaction designers. The tool allows humanities scholars to explore unexpected relations between entities and media objects and to construct and share navigation paths to develop research narratives.

StorySourcing: Telling Stories with Humans & Machines

Lora Aroyo

Dive+@ICTOpen2017

oanainel

Common Challenges, Common Solutions #OKFest 20092012

Merete Sanderhoff

For more information visit our website: http://chip-project.org This is a presentation of a MSc thesis by Ivo Roes, performed within the CHIP project, entitled: Personalized Museum Tour with Real-Time Adaptation on a Mobile Device with Multi-Point Touch Interface The CHIP project is a collaborative effort between the Rijksmuseum Amsterdam, VU University Amsterdam and Eindhoven University of Technology http://chip-project.org

SealincMedia Accurator Demos

Lora Aroyo

Finding relevant multimedia content is notoriously difficult, and the difficulty increases with the size and heterogeneity of the content collection. Linked cultural media collections are heterogeneous by nature and rapidly increase in size, mainly through enormous amounts of user-generated content and metadata that are placed on the Internet on a daily basis. Without mechanisms for keeping any part of these collections easily accessible by any user at any time and any use context, the value of these collections for the community will drop, just like their value as an economic asset. demo: http://2-dot-rma-accurator.appspot.com/#Intro website: http://sealincmedia.wordpress.com/

AGORA Project: Final Review 2012Lora Aroyo

Agora User Committee Meeting 2013

Lora Aroyo

The Agora project is a collaboration between the History and Computer Science departments at the VU University Amsterdam, the Rijksmuseum Amsterdam and the Dutch national audiovisual archive Beeld en Geluid. The aim of Agora is to develop a social platform in which museum objects can be placed into an explicit (art)historic context. Through the (art)historic context, objects from highly diverse museum collections can be related, resulting in a more complete and illustrated description of historical events. End-users will also be allowed to create their own personal narratives which will lead to theoretical reflection on the meaning of digitally mediated public history in contemporary society. Check out our website http://agora.cs.vu.nl/ and our twitter feed @agora_project

Stitch by Stitch: Annotating Fashion at the Rijksmuseum

Lora Aroyo

https://www.rijksmuseum.nl/en/stitch-by-stitch http://annotate.accurator.nl/ Fashion can be found everywhere in museums. Fashion heritage collected over centuries: costumes, accessories, paintings, prints and photographs. But while some clothes and accessories are easily found and identified, others are obscure and require a trained eye to describe. What are we looking at? What kind of sleeve is this? Which materials and techniques have been used? More specific descriptions of the images facilitate better use of digital collections and enable users to wander through them in detail.

Eliciting User Preferences for Personalized Explanations for Video Summaries

oanainel

Presented at UMAP 2020 Abstract: Video summaries or highlights are a compelling alternative for exploring and contextualizing unprecedented amounts of video material. However, the summarization process is commonly automatic, non-transparent and potentially biased towards particular aspects depicted in the original video. Therefore, our aim is to help users like archivists or collection managers to quickly understand which summaries are the most representative for an original video. In this paper, we present empirical results on the utility of different types of visual explanations to achieve transparency for end users on how representative video summaries are, with respect to the original video. We consider four types of video summary explanations, which use in different ways the concepts extracted from the original video subtitles and the video stream, and their prominence. The explanations are generated to meet target user preferences and express different dimensions of transparency: concept prominence, semantic coverage, distance and quantity of coverage. In two user studies we evaluate the utility of the visual explanations for achieving transparency for end users. Our results show that explanations representing all of the dimensions have the highest utility for transparency, and consequently, for understanding the representativeness of video summaries.

LDK2019: Validation methodology for expert-annotated datasets: Events Annota...

oanainel

Event detection is still a difficult task due to the complexity and the ambiguity of such entities. On the one hand, we observe a low inter-annotator agreement among experts when annotating events, disregarding the multitude of existing annotation guidelines and their numerous revisions. On the other hand, event extraction systems have a lower measured performance in terms of F1-score compared to other types of entities such as people or locations. In this paper we study the consistency and completeness of expert-annotated datasets for events and time expressions. We propose a data-agnostic validation methodology of such datasets in terms of consistency and completeness. Furthermore, we combine the power of crowds and machines to correct and extend expert-annotated datasets of events. We show the benefit of using crowd-annotated events to train and evaluate a state-of-the-art event extraction system. Our results show that the crowd-annotated events increase the performance of the system by at least 5.3%.

Harnessing diversity in crowds and machines for better ner performance

oanainel

Over the last years, information extraction tools have gained a great popularity and brought significant performance improvement in extracting meaning from structured or unstructured data. For example, named entity recognition (NER) tools identify types such as people, organizations or places in text. However, despite their high F1 performance, NER tools are still prone to brittleness due to their highly specialized and constrained input and training data. Thus, each tool is able to extract only a subset of the named entities (NE) mentioned in a given text. In order to improve \emph{NE Coverage}, we propose a hybrid approach, where we first aggregate the output of various NER tools and then validate and extend it through crowdsourcing. The results from our experiments show that this approach performs significantly better than the individual state-of-the-art tools (including existing tools that integrate individual outputs already). Furthermore, we show that the crowd is quite effective in (1) identifying mistakes, inconsistencies and ambiguities in currently used ground truth, as well as in (2) a promising approach to gather ground truth annotations for NER that capture a multitude of opinions.

Boosting Named Entity Extraction through Crowdsourcing

oanainel

ESWC - PhD Symposium 2016

oanainel

Harnessing the Power of Machines & Crowds for Event Extraction

oanainel

ESR_factors_affect-clinic significance-Pathysiology.pptx

muralinath2

Circulatory system_ Laplace law. Ohms law.reynaults law,baro-chemo-receptors-...

muralinath2

Multi-source connectivity as the driver of solar wind variability in the heli...

Sérgio Sacani

The ambient solar wind that flls the heliosphere originates from multiple sources in the solar corona and is highly structured. It is often described as high-speed, relatively homogeneous, plasma streams from coronal holes and slow-speed, highly variable, streams whose source regions are under debate. A key goal of ESA/NASA’s Solar Orbiter mission is to identify solar wind sources and understand what drives the complexity seen in the heliosphere. By combining magnetic feld modelling and spectroscopic techniques with high-resolution observations and measurements, we show that the solar wind variability detected in situ by Solar Orbiter in March 2022 is driven by spatio-temporal changes in the magnetic connectivity to multiple sources in the solar atmosphere. The magnetic feld footpoints connected to the spacecraft moved from the boundaries of a coronal hole to one active region (12961) and then across to another region (12957). This is refected in the in situ measurements, which show the transition from fast to highly Alfvénic then to slow solar wind that is disrupted by the arrival of a coronal mass ejection. Our results describe solar wind variability at 0.5 au but are applicable to near-Earth observatories.

insect taxonomy importance systematics and classification

anitaento25

Unveiling the Energy Potential of Marshmallow Deposits.pdf

Erdal Coalmaker

Citrus Greening Disease and its Management

subedisuryaofficial

RNA INTERFERENCE: UNRAVELING GENETIC SILENCING

AADYARAJPANDEY1

Introduction: RNA interference (RNAi) or Post-Transcriptional Gene Silencing (PTGS) is an important biological process for modulating eukaryotic gene expression. It is highly conserved process of posttranscriptional gene silencing by which double stranded RNA (dsRNA) causes sequence-specific degradation of mRNA sequences. dsRNA-induced gene silencing (RNAi) is reported in a wide range of eukaryotes ranging from worms, insects, mammals and plants. This process mediates resistance to both endogenous parasitic and exogenous pathogenic nucleic acids, and regulates the expression of protein-coding genes. What are small ncRNAs? micro RNA (miRNA) short interfering RNA (siRNA) Properties of small non-coding RNA: Involved in silencing mRNA transcripts. Called “small” because they are usually only about 21-24 nucleotides long. Synthesized by first cutting up longer precursor sequences (like the 61nt one that Lee discovered). Silence an mRNA by base pairing with some sequence on the mRNA. Discovery of siRNA? The first small RNA: In 1993 Rosalind Lee (Victor Ambros lab) was studying a non- coding gene in C. elegans, lin-4, that was involved in silencing of another gene, lin-14, at the appropriate time in the development of the worm C. elegans. Two small transcripts of lin-4 (22nt and 61nt) were found to be complementary to a sequence in the 3' UTR of lin-14. Because lin-4 encoded no protein, she deduced that it must be these transcripts that are causing the silencing by RNA-RNA interactions. Types of RNAi ( non coding RNA) MiRNA Length (23-25 nt) Trans acting Binds with target MRNA in mismatch Translation inhibition Si RNA Length 21 nt. Cis acting Bind with target Mrna in perfect complementary sequence Piwi-RNA Length ; 25 to 36 nt. Expressed in Germ Cells Regulates trnasposomes activity MECHANISM OF RNAI: First the double-stranded RNA teams up with a protein complex named Dicer, which cuts the long RNA into short pieces. Then another protein complex called RISC (RNA-induced silencing complex) discards one of the two RNA strands. The RISC-docked, single-stranded RNA then pairs with the homologous mRNA and destroys it. THE RISC COMPLEX: RISC is large(>500kD) RNA multi- protein Binding complex which triggers MRNA degradation in response to MRNA Unwinding of double stranded Si RNA by ATP independent Helicase Active component of RISC is Ago proteins( ENDONUCLEASE) which cleave target MRNA. DICER: endonuclease (RNase Family III) Argonaute: Central Component of the RNA-Induced Silencing Complex (RISC) One strand of the dsRNA produced by Dicer is retained in the RISC complex in association with Argonaute ARGONAUTE PROTEIN : 1.PAZ(PIWI/Argonaute/ Zwille)- Recognition of target MRNA 2.PIWI (p-element induced wimpy Testis)- breaks Phosphodiester bond of mRNA.)RNAse H activity. MiRNA: The Double-stranded RNAs are naturally produced in eukaryotic cells during development, and they have a key role in regulating gene expression .

The ASGCT Annual Meeting was packed with exciting progress in the field advan...

Health Advances

Viewers also liked

Europeana Tech 2011Michiel Hildebrand

WebSci2013 Harnessing Disagreement in CrowdsourcingLora Aroyo

Keynote at SMAP2012: Personalized Access to TV ContentLora Aroyo

CHIP Project: Personalized Museum Tour with Real-Time Adaptation on a Mobile ...

Lora Aroyo

SealincMedia Accurator Demos

Lora Aroyo

AGORA Project: Final Review 2012Lora Aroyo

Agora User Committee Meeting 2013

Lora Aroyo

Stitch by Stitch: Annotating Fashion at the Rijksmuseum

Lora Aroyo

Viewers also liked (8)

Europeana Tech 2011

WebSci2013 Harnessing Disagreement in Crowdsourcing

Keynote at SMAP2012: Personalized Access to TV Content

CHIP Project: Personalized Museum Tour with Real-Time Adaptation on a Mobile ...

SealincMedia Accurator Demos

AGORA Project: Final Review 2012

Agora User Committee Meeting 2013

Stitch by Stitch: Annotating Fashion at the Rijksmuseum

Recently uploaded

ESR_factors_affect-clinic significance-Pathysiology.pptx

muralinath2

Circulatory system_ Laplace law. Ohms law.reynaults law,baro-chemo-receptors-...

muralinath2

Multi-source connectivity as the driver of solar wind variability in the heli...

Sérgio Sacani

insect taxonomy importance systematics and classification

anitaento25

Unveiling the Energy Potential of Marshmallow Deposits.pdf

Erdal Coalmaker

Citrus Greening Disease and its Management

subedisuryaofficial

RNA INTERFERENCE: UNRAVELING GENETIC SILENCING

AADYARAJPANDEY1

The ASGCT Annual Meeting was packed with exciting progress in the field advan...

Health Advances

Seminar of U.V. Spectroscopy by SAMIR PANDA

SAMIR PANDA

Comparative structure of adrenal gland in vertebrates

sachin783648

Hemoglobin metabolism_pathophysiology.pptx

muralinath2

Structures and textures of metamorphic rocks

kumarmathi863

erythropoiesis-I_mechanism& clinical significance.pptx

muralinath2

4. An Overview of Sugarcane White Leaf Disease in Vietnam.pdf

ssuserbfdca9

SCHIZOPHRENIA Disorder/ Brain Disorder.pdf

SELF-EXPLANATORY

(May 29th, 2024) Advancements in Intravital Microscopy- Insights for Preclini...

Scintica Instrumentation

Intravital microscopy (IVM) is a powerful tool utilized to study cellular behavior over time and space in vivo. Much of our understanding of cell biology has been accomplished using various in vitro and ex vivo methods; however, these studies do not necessarily reflect the natural dynamics of biological processes. Unlike traditional cell culture or fixed tissue imaging, IVM allows for the ultra-fast high-resolution imaging of cellular processes over time and space and were studied in its natural environment. Real-time visualization of biological processes in the context of an intact organism helps maintain physiological relevance and provide insights into the progression of disease, response to treatments or developmental processes. In this webinar we give an overview of advanced applications of the IVM system in preclinical research. IVIM technology is a provider of all-in-one intravital microscopy systems and solutions optimized for in vivo imaging of live animal models at sub-micron resolution. The system’s unique features and user-friendly software enables researchers to probe fast dynamic biological processes such as immune cell tracking, cell-cell interaction as well as vascularization and tumor metastasis with exceptional detail. This webinar will also give an overview of IVM being utilized in drug development, offering a view into the intricate interaction between drugs/nanoparticles and tissues in vivo and allows for the evaluation of therapeutic intervention in a variety of tissues and organs. This interdisciplinary collaboration continues to drive the advancements of novel therapeutic strategies.

PRESENTATION ABOUT PRINCIPLE OF COSMATIC EVALUATION

ChetanK57

In silico drugs analogue design: novobiocin analogues.pptx

AlaminAfendy1

NuGOweek 2024 Ghent - programme - final version

pablovgd

Richard's entangled aventures in wonderland

Richard Gill

Since the loophole-free Bell experiments of 2020 and the Nobel prizes in physics of 2022, critics of Bell's work have retreated to the fortress of super-determinism. Now, super-determinism is a derogatory word - it just means "determinism". Palmer, Hance and Hossenfelder argue that quantum mechanics and determinism are not incompatible, using a sophisticated mathematical construction based on a subtle thinning of allowed states and measurements in quantum mechanics, such that what is left appears to make Bell's argument fail, without altering the empirical predictions of quantum mechanics. I think however that it is a smoke screen, and the slogan "lost in math" comes to my mind. I will discuss some other recent disproofs of Bell's theorem using the language of causality based on causal graphs. Causal thinking is also central to law and justice. I will mention surprising connections to my work on serial killer nurse cases, in particular the Dutch case of Lucia de Berk and the current UK case of Lucy Letby.

Recently uploaded (20)

ESR_factors_affect-clinic significance-Pathysiology.pptx

Circulatory system_ Laplace law. Ohms law.reynaults law,baro-chemo-receptors-...

Multi-source connectivity as the driver of solar wind variability in the heli...

insect taxonomy importance systematics and classification

Unveiling the Energy Potential of Marshmallow Deposits.pdf

Citrus Greening Disease and its Management

RNA INTERFERENCE: UNRAVELING GENETIC SILENCING

The ASGCT Annual Meeting was packed with exciting progress in the field advan...

Seminar of U.V. Spectroscopy by SAMIR PANDA

Comparative structure of adrenal gland in vertebrates

Hemoglobin metabolism_pathophysiology.pptx

Structures and textures of metamorphic rocks

erythropoiesis-I_mechanism& clinical significance.pptx

4. An Overview of Sugarcane White Leaf Disease in Vietnam.pdf

SCHIZOPHRENIA Disorder/ Brain Disorder.pdf

(May 29th, 2024) Advancements in Intravital Microscopy- Insights for Preclini...

PRESENTATION ABOUT PRINCIPLE OF COSMATIC EVALUATION

In silico drugs analogue design: novobiocin analogues.pptx

NuGOweek 2024 Ghent - programme - final version

Richard's entangled aventures in wonderland