Presentation at the NYC Media Lab (NYCML2018). There is a growing demand for news videos online, with more consumers preferring to watch the news than read or listen to it. On the publisher side, there is a growing effort to use video summarization technology in order to create easy-to-consume previews (trailers) for different types of broadcast programs. How can we measure the quality of video summaries and their potential to misinform? This workshop will inform participants about automatic video summarization algorithms and how to produce more “representative” video summaries. The research presented is from the FAIRview project and is supported by the Digital News Innovation Fund (DNI Fund), which is part of the Google News Initiative.
Mastering the Art and Science of Video CreationEmma Blogger
Inside this eBook, you will discover the topics about the best way to figure out what type of video you need to create to fulfill all of your current objectives, the best video creation tools available, and how to use them to create stunningly professional videos even if you’ve never made a video in your life, which resources you absolutely must have for your videos and where to get legally licensed resources cheaply, the best video creation methods for creating videos that will sell like crazy and make you more money and so much more!
Media Studies Coursework Evaluation Student Guidealevelmedia
How to address the evaluation for your A-level Media Studies coursework. A guide talking about best practice, methods, questions to consider and advice to help you cover all areas and key concepts in detail
This presentation is from a webinar put on by PRWeb, titled "Using Video and Multimedia in Online News Releases." The purpose of the webinar was to educate attendees on how to leverage the growing popularity of online video in conjunction with press releases in order to garner more website traffic and greater search engine visibility. I hope you enjoy.
50 Interactive Personal Finance Learning Activitiesmilfamln
This 90-minute webinar will feature 50 interactive games and learning activities curated by webinar facilitator Barbara O'Neill that can be used by financial educators to teach financial concepts to clients and students. The webinar will include activities to begin a class or briefing, activities to leverage learners’ creativity and skill sets, activities to develop learners’ critical thinking skills and math skills, activities that provide personalized insights to learners, activities that involve the use of online resources, and activities to close a class or briefing. Questions about this session? Email the MFLN at MilFamLN@gmail.com
Eliciting User Preferences for Personalized Explanations for Video Summariesoanainel
Presented at UMAP 2020
Abstract: Video summaries or highlights are a compelling alternative for exploring and contextualizing unprecedented amounts of video material. However, the summarization process is commonly automatic, non-transparent and potentially biased towards particular aspects depicted in the original video. Therefore, our aim is to help users like archivists or collection managers to quickly understand which summaries are the most representative for an original video. In this paper, we present empirical results on the utility of different types of visual explanations to achieve transparency for end users on how representative video summaries are, with respect to the original video. We consider four types of video summary explanations, which use in different ways the concepts extracted from the original video subtitles and the video stream, and their prominence. The explanations are generated to meet target user preferences and express different dimensions of transparency: concept prominence, semantic coverage, distance and quantity of coverage. In two user studies we evaluate the utility of the visual explanations for achieving transparency for end users. Our results show that explanations representing all of the dimensions have the highest utility for transparency, and consequently, for understanding the representativeness of video summaries.
This presentation was prepared for principals and vice-principals in the Ottawa Catholic School Board. Technology tips with a focus on web 2.0 tools and free Google tools were the main focus.
Internal presentation for Delphic Sage employees on ways to participate in Social Networking online and resources for Social Media. Helpful for anyone looking to get involved in social media as a great resource tool.
Mastering the Art and Science of Video CreationEmma Blogger
Inside this eBook, you will discover the topics about the best way to figure out what type of video you need to create to fulfill all of your current objectives, the best video creation tools available, and how to use them to create stunningly professional videos even if you’ve never made a video in your life, which resources you absolutely must have for your videos and where to get legally licensed resources cheaply, the best video creation methods for creating videos that will sell like crazy and make you more money and so much more!
Media Studies Coursework Evaluation Student Guidealevelmedia
How to address the evaluation for your A-level Media Studies coursework. A guide talking about best practice, methods, questions to consider and advice to help you cover all areas and key concepts in detail
This presentation is from a webinar put on by PRWeb, titled "Using Video and Multimedia in Online News Releases." The purpose of the webinar was to educate attendees on how to leverage the growing popularity of online video in conjunction with press releases in order to garner more website traffic and greater search engine visibility. I hope you enjoy.
50 Interactive Personal Finance Learning Activitiesmilfamln
This 90-minute webinar will feature 50 interactive games and learning activities curated by webinar facilitator Barbara O'Neill that can be used by financial educators to teach financial concepts to clients and students. The webinar will include activities to begin a class or briefing, activities to leverage learners’ creativity and skill sets, activities to develop learners’ critical thinking skills and math skills, activities that provide personalized insights to learners, activities that involve the use of online resources, and activities to close a class or briefing. Questions about this session? Email the MFLN at MilFamLN@gmail.com
Eliciting User Preferences for Personalized Explanations for Video Summariesoanainel
Presented at UMAP 2020
Abstract: Video summaries or highlights are a compelling alternative for exploring and contextualizing unprecedented amounts of video material. However, the summarization process is commonly automatic, non-transparent and potentially biased towards particular aspects depicted in the original video. Therefore, our aim is to help users like archivists or collection managers to quickly understand which summaries are the most representative for an original video. In this paper, we present empirical results on the utility of different types of visual explanations to achieve transparency for end users on how representative video summaries are, with respect to the original video. We consider four types of video summary explanations, which use in different ways the concepts extracted from the original video subtitles and the video stream, and their prominence. The explanations are generated to meet target user preferences and express different dimensions of transparency: concept prominence, semantic coverage, distance and quantity of coverage. In two user studies we evaluate the utility of the visual explanations for achieving transparency for end users. Our results show that explanations representing all of the dimensions have the highest utility for transparency, and consequently, for understanding the representativeness of video summaries.
This presentation was prepared for principals and vice-principals in the Ottawa Catholic School Board. Technology tips with a focus on web 2.0 tools and free Google tools were the main focus.
Internal presentation for Delphic Sage employees on ways to participate in Social Networking online and resources for Social Media. Helpful for anyone looking to get involved in social media as a great resource tool.
The Rijksmuseum Collection as Linked DataLora Aroyo
Presentation at ISWC2018: http://iswc2018.semanticweb.org/sessions/the-rijksmuseum-collection-as-linked-data/ of our paper published originally in the Semantic Web Journal: http://www.semantic-web-journal.net/content/rijksmuseum-collection-linked-data-2
Many museums are currently providing online access to their collections. The state of the art research in the last decade shows that it is beneficial for institutions to provide their datasets as Linked Data in order to achieve easy cross-referencing, interlinking and integration. In this paper, we present the Rijksmuseum linked dataset (accessible at http://datahub.io/dataset/rijksmuseum), along with collection and vocabulary statistics, as well as lessons learned from the process of converting the collection to Linked Data. The version of March 2016 contains over 350,000 objects, including detailed descriptions and high-quality images released under a public domain license.
DH Benelux 2017 Panel: A Pragmatic Approach to Understanding and Utilising Ev...Lora Aroyo
Lora Aroyo, Chiel van den Akker, Marnix van Berchum, Lodewijk
Petram, Gerard Kuys, Tommaso Caselli, Jacco van Ossenbruggen, Victor de Boer, Sabrina Sauer, Berber Hagedoorn
Crowdsourcing ambiguity aware ground truth - collective intelligence 2017Lora Aroyo
The process of gathering ground truth data through human annotation is a major bottleneck in the use of information extraction methods. Crowdsourcing-based approaches are gaining popularity in the attempt to solve the issues related to the volume of data and lack of annotators. Typically these practices use inter-annotator agreement as a measure of quality. However, this assumption often creates issues in practice. Previous experiments we performed found that inter-annotator disagreement is usually never captured, either because the number of annotators is too small to capture the full diversity of opinion, or because the crowd data is aggregated with metrics that enforce consensus, such as majority vote. These practices create artificial data that is neither general nor reflects the ambiguity inherent in the data.
To address these issues, we proposed the method for crowdsourcing ground truth by harnessing inter-annotator disagreement. We present an alternative approach for crowdsourcing ground truth data that, instead of enforcing an agreement between annotators, captures the ambiguity inherent in semantic annotation through the use of disagreement-aware metrics for aggregating crowdsourcing responses. Based on this principle, we have implemented the CrowdTruth framework for machine-human computation, that first introduced the disagreement-aware metrics and built a pipeline to process crowdsourcing data with these metrics.
In this paper, we apply the CrowdTruth methodology to collect data over a set of diverse tasks: medical relation extraction, Twitter event identification, news event extraction and sound interpretation. We prove that capturing disagreement is essential for acquiring a high-quality ground truth. We achieve this by comparing the quality of the data aggregated with CrowdTruth metrics with a majority vote, a method which enforces consensus among annotators. By applying our analysis over a set of diverse tasks we show that, even though ambiguity manifests differently depending on the task, our theory of inter-annotator disagreement as a property of ambiguity is generalizable.
My ESWC 2017 keynote: Disrupting the Semantic Comfort ZoneLora Aroyo
Ambiguity in interpreting signs is not a new idea, yet the vast majority of research in machine interpretation of signals such as speech, language, images, video, audio, etc., tend to ignore ambiguity. This is evidenced by the fact that metrics for quality of machine understanding rely on a ground truth, in which each instance (a sentence, a photo, a sound clip, etc) is assigned a discrete label, or set of labels, and the machine’s prediction for that instance is compared to the label to determine if it is correct. This determination yields the familiar precision, recall, accuracy, and f-measure metrics, but clearly presupposes that this determination can be made. CrowdTruth is a form of collective intelligence based on a vector representation that accommodates diverse interpretation perspectives and encourages human annotators to disagree with each other, in order to expose latent elements such as ambiguity and worker quality. In other words, CrowdTruth assumes that when annotators disagree on how to label an example, it is because the example is ambiguous, the worker isn’t doing the right thing, or the task itself is not clear. In previous work on CrowdTruth, the focus was on how the disagreement signals from low quality workers and from unclear tasks can be isolated. Recently, we observed that disagreement can also signal ambiguity. The basic hypothesis is that, if workers disagree on the correct label for an example, then it will be more difficult for a machine to classify that example. The elaborate data analysis to determine if the source of the disagreement is ambiguity supports our intuition that low clarity signals ambiguity, while high clarity sentences quite obviously express one or more of the target relations. In this talk I will share the experiences and lessons learned on the path to understanding diversity in human interpretation and the ways to capture it as ground truth to enable machines to deal with such diversity.
Data Science with Human in the Loop @Faculty of Science #Leiden UniversityLora Aroyo
Software systems are becoming ever more intelligent and more useful, but the way we interact with these machines too often reveals that they don’t actually understand people. Knowledge Representation and Semantic Web focus on the scientific challenges involved in providing human knowledge in machine-readable form. However, we observe that various types of human knowledge cannot yet be captured by machines, especially when dealing with wide ranges of real-world tasks and contexts. The key scientific challenge is to provide an approach to capturing human knowledge in a way that is scalable and adequate to real-world needs. Human Computation has begun to scientifically study how human intelligence at scale can be used to methodologically improve machine-based knowledge and data management. My research is focusing on understanding human computation for improving how machine-based systems can acquire, capture and harness human knowledge and thus become even more intelligent. In this talk I will show how the CrowdTruth framework (http://crowdtruth.org) facilitates data collection, processing and analytics of human computation knowledge.
Some project links:
- http://controcurator.org/
- http://crowdtruth.org/
- http://diveproject.beeldengeluid.nl/
- http://vu-amsterdam-web-media-group.github.io/linkflows/
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...UiPathCommunity
💥 Speed, accuracy, and scaling – discover the superpowers of GenAI in action with UiPath Document Understanding and Communications Mining™:
See how to accelerate model training and optimize model performance with active learning
Learn about the latest enhancements to out-of-the-box document processing – with little to no training required
Get an exclusive demo of the new family of UiPath LLMs – GenAI models specialized for processing different types of documents and messages
This is a hands-on session specifically designed for automation developers and AI enthusiasts seeking to enhance their knowledge in leveraging the latest intelligent document processing capabilities offered by UiPath.
Speakers:
👨🏫 Andras Palfi, Senior Product Manager, UiPath
👩🏫 Lenka Dulovicova, Product Program Manager, UiPath
Connector Corner: Automate dynamic content and events by pushing a buttonDianaGray10
Here is something new! In our next Connector Corner webinar, we will demonstrate how you can use a single workflow to:
Create a campaign using Mailchimp with merge tags/fields
Send an interactive Slack channel message (using buttons)
Have the message received by managers and peers along with a test email for review
But there’s more:
In a second workflow supporting the same use case, you’ll see:
Your campaign sent to target colleagues for approval
If the “Approve” button is clicked, a Jira/Zendesk ticket is created for the marketing design team
But—if the “Reject” button is pushed, colleagues will be alerted via Slack message
Join us to learn more about this new, human-in-the-loop capability, brought to you by Integration Service connectors.
And...
Speakers:
Akshay Agnihotri, Product Manager
Charlie Greenberg, Host
The Art of the Pitch: WordPress Relationships and SalesLaura Byrne
Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes?
All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.
Let's dive deeper into the world of ODC! Ricardo Alves (OutSystems) will join us to tell all about the new Data Fabric. After that, Sezen de Bruijn (OutSystems) will get into the details on how to best design a sturdy architecture within ODC.
UiPath Test Automation using UiPath Test Suite series, part 4DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 4. In this session, we will cover Test Manager overview along with SAP heatmap.
The UiPath Test Manager overview with SAP heatmap webinar offers a concise yet comprehensive exploration of the role of a Test Manager within SAP environments, coupled with the utilization of heatmaps for effective testing strategies.
Participants will gain insights into the responsibilities, challenges, and best practices associated with test management in SAP projects. Additionally, the webinar delves into the significance of heatmaps as a visual aid for identifying testing priorities, areas of risk, and resource allocation within SAP landscapes. Through this session, attendees can expect to enhance their understanding of test management principles while learning practical approaches to optimize testing processes in SAP environments using heatmap visualization techniques
What will you get from this session?
1. Insights into SAP testing best practices
2. Heatmap utilization for testing
3. Optimization of testing processes
4. Demo
Topics covered:
Execution from the test manager
Orchestrator execution result
Defect reporting
SAP heatmap example with demo
Speaker:
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
Neuro-symbolic is not enough, we need neuro-*semantic*Frank van Harmelen
Neuro-symbolic (NeSy) AI is on the rise. However, simply machine learning on just any symbolic structure is not sufficient to really harvest the gains of NeSy. These will only be gained when the symbolic structures have an actual semantics. I give an operational definition of semantics as “predictable inference”.
All of this illustrated with link prediction over knowledge graphs, but the argument is general.
"Impact of front-end architecture on development cost", Viktor TurskyiFwdays
I have heard many times that architecture is not important for the front-end. Also, many times I have seen how developers implement features on the front-end just following the standard rules for a framework and think that this is enough to successfully launch the project, and then the project fails. How to prevent this and what approach to choose? I have launched dozens of complex projects and during the talk we will analyze which approaches have worked for me and which have not.
2. Agenda for today
3:00 - 3:20: Introduction of Video Summarization Context
3:20 - 3:50: Work in groups to answer the following questions
(discussion document: http://bit.ly/fairview_discussion)
Q1: How to increase the user awareness (e.g. through explanations, visualizations,
interaction, etc) on the following two points:
○ the video summary “representativeness” compared to the original video
○ the (possible) video summary “misinformation potential” compared to the original video
Q2: What are adequate success metrics for video summaries?
○ How to measure the ‘representativeness’?
○ How to measure ‘misinformation potential’?
○ How to evaluate both points?
Answer these questions in the following interaction scenarios:
● while watching the video summary
● when browsing video search results
● when comparing two or more video summaries
● when creating the video summary
● other interaction scenarios
3:50 - 4:00: Summary and conclusions
http://lora-aroyo.org https://www.slideshare.net/laroyo @laroyo
3. video is 64% of Internet traffic
http://lora-aroyo.org https://www.slideshare.net/laroyo @laroyo
4. more Americans prefer to watch their news (46%)
than to read it (35%) or listen to it (17%)
http://www.journalism.org/2016/07/07/pathways-to-news/
http://lora-aroyo.org https://www.slideshare.net/laroyo @laroyo
5. 300h of video uploaded each min on YouTube alone
http://lora-aroyo.org https://www.slideshare.net/laroyo @laroyo
6. in 2020 it would take a person more than 5 million
years to watch the videos uploaded in a month
http://lora-aroyo.org https://www.slideshare.net/laroyo @laroyo
7. at some point it all looks the same
http://lora-aroyo.org https://www.slideshare.net/laroyo @laroyo
8. … tons of videos but difficult to choose what to watch
http://lora-aroyo.org https://www.slideshare.net/laroyo @laroyo
9. how to make videos consumable
in the age of information overload & declining attention span?
16. … e.g. micro-moments in video
for on-demand discovery search
http://lora-aroyo.org https://www.slideshare.net/laroyo @laroyo
17. … e.g. contextualized hyperlinks in video
for direct engagement
http://lora-aroyo.org https://www.slideshare.net/laroyo @laroyo
18. … creating bite size info nuggets (video snacks)
that can quickly be consumed, understood & shared
http://lora-aroyo.org https://www.slideshare.net/laroyo @laroyo
19. Let’s look at an example
http://lora-aroyo.org https://www.slideshare.net/laroyo @laroyo
20. Scenes from HBO Series: Big Little Lies
http://lora-aroyo.org https://www.slideshare.net/laroyo @laroyo
21. Scenes from 1 Episode
http://lora-aroyo.org https://www.slideshare.net/laroyo @laroyo
23. Frames for the selected sceneSelected: 1 Scene
http://lora-aroyo.org https://www.slideshare.net/laroyo @laroyo
24. All Concepts describing the FrameSelected: 1 Frame
http://lora-aroyo.org https://www.slideshare.net/laroyo @laroyo
25. all this results in a lot of
video, image and label data
… that could be organized in lots of different storylines
i.e. video snacks
http://lora-aroyo.org https://www.slideshare.net/laroyo @laroyo
30. … but how are these video stories created?
who selects what to include / exclude?
who chooses the summarization approaches?
what is the impact of different approaches?
http://lora-aroyo.org https://www.slideshare.net/laroyo @laroyo
31. … all these choices can amplify / diminish
a specific aspect or perspective in the original video,
and in this way introduce a bias
that can potentially lead to misinformation
http://lora-aroyo.org https://www.slideshare.net/laroyo @laroyo
32. FAIRView
● how to bring more awareness of all the perspectives,
topics and elements present in the original video
● what are indicators & evaluation criteria on how
these are represented in a video summary
● how to adapt existing summarization algorithms to
produce representative & explainable video
summaries
http://lora-aroyo.org https://www.slideshare.net/laroyo @laroyo
33. FAIRView
● study this problem in the context of news videos
● empower users with tools to evaluate
representativeness of videos
● gain a granular understanding of video content in
terms of perspectives, opinions, stories, etc.
http://lora-aroyo.org https://www.slideshare.net/laroyo @laroyo
34. Work in Groups
3:20 - 3:50: Work in groups to answer the following questions
(discussion document: http://bit.ly/fairview_discussion)
Q1: How to increase the user awareness (e.g. through explanations, visualizations,
interaction, etc) on the following two points:
○ the video summary “representativeness” compared to the original video
○ the (possible) video summary “misinformation potential” compared to the original video
Q2: What are adequate success metrics for video summaries?
○ How to measure the ‘representativeness’?
○ How to measure ‘misinformation potential’?
○ How to evaluate both points?
Answer these questions in the following interaction scenarios:
● while watching the video summary
● when browsing video search results
● when comparing two or more video summaries
● when creating the video summary
● other interaction scenarios
3:50 - 4:00: Summary and conclusions
http://lora-aroyo.org https://www.slideshare.net/laroyo @laroyo