Talk given at ICSC 2010, Fourth IEEE International Conference on Semantic Computing, http://www.ieee-icsc.org/
Slide design by André Fialho.
Slides also available from http://www.cwi.nl/~lynda/talks/2010/ICSC2010-LyndaHardman.pdf
LinkedTV: Television Linked to the Web, June 2013Lynda Hardman
Television Linked to the Web
Our vision of future Television Linked To The Web (LinkedTV) is of a ubiquitously online cloud of Networked Audio-Visual Content decoupled from place, device or source. Accessing audio-visual programming will be “TV” regardless whether it is seen on a TV set, smartphone, tablet or personal computing device, regardless of whether it is coming from a traditional or new media broadcaster, a Web video portal or a user-sourced media platform.
Fish4Knowledge: large scale coral reef fish monitoring using undersea compute...Lynda Hardman
Talk given at the 9th Indo_Pacific Fish Conference, Okinawa, June 27th 2013
fish4knowledge.eu
pdf available from http://www.cwi.nl/~lynda/talks/2013/Fish4Knowledge130627.pdf
More Women in Informatics Research & Education, Oviedo July 2014Lynda Hardman
Why are there too few women in computer science?
What can we do about it?
Best practices based on Informatics Europe booklet
http://www.informatics-europe.org/images/documents/more-women-in-informatics-research-and-education_2013.pdf
LinkedTV: Television Linked to the Web, June 2013Lynda Hardman
Television Linked to the Web
Our vision of future Television Linked To The Web (LinkedTV) is of a ubiquitously online cloud of Networked Audio-Visual Content decoupled from place, device or source. Accessing audio-visual programming will be “TV” regardless whether it is seen on a TV set, smartphone, tablet or personal computing device, regardless of whether it is coming from a traditional or new media broadcaster, a Web video portal or a user-sourced media platform.
Fish4Knowledge: large scale coral reef fish monitoring using undersea compute...Lynda Hardman
Talk given at the 9th Indo_Pacific Fish Conference, Okinawa, June 27th 2013
fish4knowledge.eu
pdf available from http://www.cwi.nl/~lynda/talks/2013/Fish4Knowledge130627.pdf
More Women in Informatics Research & Education, Oviedo July 2014Lynda Hardman
Why are there too few women in computer science?
What can we do about it?
Best practices based on Informatics Europe booklet
http://www.informatics-europe.org/images/documents/more-women-in-informatics-research-and-education_2013.pdf
Automatically creating coherent multimedia presentations based on different types of annotations.
Examples from CeWe photobook and Vox Populi video sequence generation.
Annotation types include discourse, rhetorical, interviewee, film continuity.
How communities curate knowledge & how ontologists can help -Eurecom--2015-01-19jodischneider
Invited talk 2015-01-19 at EURCOM.
Two themes:
How do communities curate knowledge?
and
How can information technology help?
Q: How do communities curate knowledge?
A: Communities curate knowledge by discussing evidence and applying community standards to it.
In Wikipedia, 4 questions are used to evaluate borderline articles:
Notability – Is the topic appropriate for our encyclopedia?
Sources – Is the article well-sourced?
Maintenance – Can we maintain this article?
Bias – Is the article neutral? POV appropriately weighted?
Q: How can information technology help?
A: Information technology can organize evidence based on the criteria communities use.
In Wikipedia, we developed an alternate interface for deletion discussions.
Key Trends Shaping the Future of Infrastructure.pdfCheryl Hung
Keynote at DIGIT West Expo, Glasgow on 29 May 2024.
Cheryl Hung, ochery.com
Sr Director, Infrastructure Ecosystem, Arm.
The key trends across hardware, cloud and open-source; exploring how these areas are likely to mature and develop over the short and long-term, and then considering how organisations can position themselves to adapt and thrive.
Automatically creating coherent multimedia presentations based on different types of annotations.
Examples from CeWe photobook and Vox Populi video sequence generation.
Annotation types include discourse, rhetorical, interviewee, film continuity.
How communities curate knowledge & how ontologists can help -Eurecom--2015-01-19jodischneider
Invited talk 2015-01-19 at EURCOM.
Two themes:
How do communities curate knowledge?
and
How can information technology help?
Q: How do communities curate knowledge?
A: Communities curate knowledge by discussing evidence and applying community standards to it.
In Wikipedia, 4 questions are used to evaluate borderline articles:
Notability – Is the topic appropriate for our encyclopedia?
Sources – Is the article well-sourced?
Maintenance – Can we maintain this article?
Bias – Is the article neutral? POV appropriately weighted?
Q: How can information technology help?
A: Information technology can organize evidence based on the criteria communities use.
In Wikipedia, we developed an alternate interface for deletion discussions.
Key Trends Shaping the Future of Infrastructure.pdfCheryl Hung
Keynote at DIGIT West Expo, Glasgow on 29 May 2024.
Cheryl Hung, ochery.com
Sr Director, Infrastructure Ecosystem, Arm.
The key trends across hardware, cloud and open-source; exploring how these areas are likely to mature and develop over the short and long-term, and then considering how organisations can position themselves to adapt and thrive.
Essentials of Automations: Optimizing FME Workflows with ParametersSafe Software
Are you looking to streamline your workflows and boost your projects’ efficiency? Do you find yourself searching for ways to add flexibility and control over your FME workflows? If so, you’re in the right place.
Join us for an insightful dive into the world of FME parameters, a critical element in optimizing workflow efficiency. This webinar marks the beginning of our three-part “Essentials of Automation” series. This first webinar is designed to equip you with the knowledge and skills to utilize parameters effectively: enhancing the flexibility, maintainability, and user control of your FME projects.
Here’s what you’ll gain:
- Essentials of FME Parameters: Understand the pivotal role of parameters, including Reader/Writer, Transformer, User, and FME Flow categories. Discover how they are the key to unlocking automation and optimization within your workflows.
- Practical Applications in FME Form: Delve into key user parameter types including choice, connections, and file URLs. Allow users to control how a workflow runs, making your workflows more reusable. Learn to import values and deliver the best user experience for your workflows while enhancing accuracy.
- Optimization Strategies in FME Flow: Explore the creation and strategic deployment of parameters in FME Flow, including the use of deployment and geometry parameters, to maximize workflow efficiency.
- Pro Tips for Success: Gain insights on parameterizing connections and leveraging new features like Conditional Visibility for clarity and simplicity.
We’ll wrap up with a glimpse into future webinars, followed by a Q&A session to address your specific questions surrounding this topic.
Don’t miss this opportunity to elevate your FME expertise and drive your projects to new heights of efficiency.
JMeter webinar - integration with InfluxDB and GrafanaRTTS
Watch this recorded webinar about real-time monitoring of application performance. See how to integrate Apache JMeter, the open-source leader in performance testing, with InfluxDB, the open-source time-series database, and Grafana, the open-source analytics and visualization application.
In this webinar, we will review the benefits of leveraging InfluxDB and Grafana when executing load tests and demonstrate how these tools are used to visualize performance metrics.
Length: 30 minutes
Session Overview
-------------------------------------------
During this webinar, we will cover the following topics while demonstrating the integrations of JMeter, InfluxDB and Grafana:
- What out-of-the-box solutions are available for real-time monitoring JMeter tests?
- What are the benefits of integrating InfluxDB and Grafana into the load testing stack?
- Which features are provided by Grafana?
- Demonstration of InfluxDB and Grafana using a practice web application
To view the webinar recording, go to:
https://www.rttsweb.com/jmeter-integration-webinar
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
Let's dive deeper into the world of ODC! Ricardo Alves (OutSystems) will join us to tell all about the new Data Fabric. After that, Sezen de Bruijn (OutSystems) will get into the details on how to best design a sturdy architecture within ODC.
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Ramesh Iyer
In today's fast-changing business world, Companies that adapt and embrace new ideas often need help to keep up with the competition. However, fostering a culture of innovation takes much work. It takes vision, leadership and willingness to take risks in the right proportion. Sachin Dev Duggal, co-founder of Builder.ai, has perfected the art of this balance, creating a company culture where creativity and growth are nurtured at each stage.
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Tobias Schneck
As AI technology is pushing into IT I was wondering myself, as an “infrastructure container kubernetes guy”, how get this fancy AI technology get managed from an infrastructure operational view? Is it possible to apply our lovely cloud native principals as well? What benefit’s both technologies could bring to each other?
Let me take this questions and provide you a short journey through existing deployment models and use cases for AI software. On practical examples, we discuss what cloud/on-premise strategy we may need for applying it to our own infrastructure to get it to work from an enterprise perspective. I want to give an overview about infrastructure requirements and technologies, what could be beneficial or limiting your AI use cases in an enterprise environment. An interactive Demo will give you some insides, what approaches I got already working for real.
Search and Society: Reimagining Information Access for Radical FuturesBhaskar Mitra
The field of Information retrieval (IR) is currently undergoing a transformative shift, at least partly due to the emerging applications of generative AI to information access. In this talk, we will deliberate on the sociotechnical implications of generative AI for information access. We will argue that there is both a critical necessity and an exciting opportunity for the IR community to re-center our research agendas on societal needs while dismantling the artificial separation between the work on fairness, accountability, transparency, and ethics in IR and the rest of IR research. Instead of adopting a reactionary strategy of trying to mitigate potential social harms from emerging technologies, the community should aim to proactively set the research agenda for the kinds of systems we should build inspired by diverse explicitly stated sociotechnical imaginaries. The sociotechnical imaginaries that underpin the design and development of information access technologies needs to be explicitly articulated, and we need to develop theories of change in context of these diverse perspectives. Our guiding future imaginaries must be informed by other academic fields, such as democratic theory and critical theory, and should be co-developed with social science scholars, legal scholars, civil rights and social justice activists, and artists, among others.
Search and Society: Reimagining Information Access for Radical Futures
Using semantics to improve interactive information access
1. Using semantics to improve
interactive information access
Lynda Hardman
http://www.cwi.nl/~lynda
CWI, Interactive Information Access
UvA, Institute for Informatics
http://www.flickr.com/photos/iboy/4528401870/
4. Interactive Information Access
• Users need support for
– the processing of information-bearing content
– in one or more media types
– for their specific task
• We need to be aware that there is more than
the information “expressed'' by the media
asset itself, e.g.
– the intended purpose of the creator
– the context in which the media
asset was created
4
5. We don’t care about the media!
We need to enable
– the processing of information-bearing
content
– of one or more media types
– that can be interpreted by end users
End-users are primarily interested in
– the meaning conveyed by a
combination of media assets
– interacting further with the media
• as part of complex search task
• passing it on to someone else in media
“chain”
5
http://www.flickr.com/photos/benheine/4687572408/
6. How can we get this to work?
We need mechanisms
– for identifying (part of) an
individual media asset
– for associating metadata
with an identified
fragment
– for agreeing on the
meaning of metadata
– that enable larger
meaningful structures to
be composed, identified
and annotated
http://www.flickr.com/photos/jannem/3312115991 6
7. Outline of talk
• Explain information processes in which
media and metadata play a role
– “canonical processes of media production”
• Example systems showing different types of user
interaction enabled by media and metadata
– MultimediaN E-Culture
– VoxPopuli
– EventMedia
7
8. Understanding Multimedia
Applications Workflow
• Identify and define a number of canonical
processes of media production
• Community effort
–2005: Dagstuhl seminar
– 2005: ACM MM Workshop on
Multimedia for Human
Communication
–2008: Multimedia Systems
Journal Special Issue
(core model and companion
system papers)
editors: Frank
Nack, ZeljkoObrenovic and Lynda
8
Hardman
9. CanonicalReduced to the simplest
and most significant form possible,
without loss of generality
21. How can we use Semantics to support
Interactive Information Access?
• Long term goal to find and present information to
end-users
– In a way that is useful to them
• We understand how to design information interfaces
by hand.
– How can metadata help us in giving more flexible access to
media collections?
• We can link media assets to existing linked data, and
use this to improve presentation, e.g. by
– Selecting a sub-set
– Grouping, ordering and linking media assets
– Influencing the presentation
21
22. How can semantics help?
• What can be expressed explicitly?
– the message to be conveyed
– objects that are depicted in a media asset
– domain information (e.g., art, painter)
– human communication roles (discourse)
• What can they be used for?
– disambiguating queries
– grouping similar items for conveying topic breadth
– visualizing items for presentation, e.g. timeline, map
– finding similar items
– …
22
23. Browsing annotated collections of
cultural heritage artefacts
• Users interested in cultural heritage, exploring
artefactsavailable in repository
• Searching across multiple,
linked collections
• Thesaurus structure used
for identifying topics
• Artworks grouped into
different topic structures to
present results
23
26. Use of linked data in E-Culture
• Query construction
– auto-completion uses strings found in “data” and
“concepts”
– suggestions are grouped and ordered using links among
items
• Result set
– uses empirical balance between “closeness” to search
string and non-intuitive path
• Result presentation
– uses grouping of result set to show breadth of results
– uses no particular ordering within each group
26
28. Outline
• Motivation
• Example
• Scenarios
• Technical details
– Annotations
– Editing Process
• Conclusions
28
29. Video Documentaries on the Web
• Traditional video authoring: there is only one
final version, what is shown is the choice of
the author/editor
• Proposed video authoring:
– Annotate the video material semantics
– Show automatically what the user asks to
see, using presentation forms a film editor would
use
29
30. Video material
• Focus on video interviews about controversial
issues
• Interview with America video footage with
interviews and background material about the
opinion of American people after 9-
11www.interviewwithamerica.com
30
31. Example: What do you think of
the war in Afghanistan?
“I am never a fan of military
action, in the big picture I don’t think it is
ever a good thing, but I think there are
circumstances in which I certainly can’t think of
a more effective way to counter this sort of
thing…”
31
http://www.flickr.com/photos/soldiersmediacenter/1183836576
32. What do you think of the war in
Afghanistan?
War has Two billions
never solved dollar bombs
anything on tents
I am not a I cannot think
fan of of a more
military effective
actions solution
32
33. The annotations
• Rhetorical
– Rhetorical Statement
(mostly verbal, but visual also possible)
– Argumentation model: Toulmin model
• Descriptive
– Question asked
– Interviewee (social)
– Filmic next slide
33
34. Filmic annotations
Continuity, e.g.
– lighting conditions
– background sound
– gaze direction of speaker
left, centre, right
– framing continuity
close-up, medium shot, long shot
We need your
metadata!
– camera movement
none, pan left/right, shaking,
tilt up/down, zoom in/out
34
35. Statement encoding
• Statement formally annotated:
– <subject><modifier><predicate>
– E.g. “warbestsolution”
• A thesaurus containing:
– Terms (155)
– Relations between terms:
similar(72), opposite(108), generalization(10), spe
cialization(10)
– E.g. waroppositediplomacy
35
36. Connect statements
• Using the thesaurus, generate related
statements and query the repository
“war best solution”,
“diplomacy best solution”,
“war not solution”
• Create a graph of related statements
– nodes are the statements
(corresponding to video segments)
– edges are either support or contradict
36
37. Semantic Graph
diplomacy best solution
war best solution
= support
war not solution
= contradict
37
38. Toulmin model
Data Claim
Qualifier
Warrant Condition
Concession
Backing
57 Claims, 16 Data, 4
Concessions, 3 Warrants, 1 38
39. Analysis of the Example
Two billions dollar bombs on tents
Claim contradict
Claim I cannot think of a
more effective solution
weaken
Concession I am not a fan
of military actions
Claim support
War has never solved anything
39
40. Facts and features
• Annotations: 1 hour annotated, 15 interviews, 60
interview segments, 120 statements
• Partially tunable: examining the Segment graph gives
feedback on the quality of the annotations and the
thesaurus
S8
S1 S7 S10 = support
S2 S6 S9 = contradict
S4
S3 S5
40
41. Controlling the Bias
• Video documentaries are not neutral account of reality:
the selection and editing of the footage expresses a point
of view
• Editing strategy:
– Balanced
– Pro opinion X
– Against opinion X
• We use:
– Logos (the statements)
– Ethos (based on user profile)
– Film editing (e.g. framing, gaze)
41
43. Conclusions
• Automatic generation of video interviews
augmented with supporting and/or
contradicting material
• The user can determine the subject and the
bias of the presentation
• The documentarist can add material and let
the system generate new documentaries
43
44. Pointers & Acknowledgments
• Demo available at:
http://www.cwi.nl/~media/demo/VoxPopuli/
• VoxPopuliresearch was funded by the Dutch national ToKeN
I2RP and CHIME projects
44
46. EventMedia Interlinking
• Linking Agents with
– Freebase, Dbpedia, MusicBrainz
• Linking Venues with
– Geonames, Dbpedia, Foursquare (via Uberblic)
• Linking Events with
– Last.fm, Upcoming, Eventful
• Linking Categories with
– Facebook, Eventful, Upcoming, Zevents, LinkedIn,Eventbrite, TicketMa
ster
• Linking Users with
– Social Graph API
02/09/2010 -
47. EventMedia 3
• size of different events to depend on no. of participants
(popularity)
• image itself chosen most viewed image on flickr
• use image clustering to find largest numbers of similar images
-> more important -> bigger;
• Looking at event (several hundreds)
• use (real-time) image clustering
to show most different images.
• Metadata from tags to detect poster, ticket, stage, vocal
47
48. What are my messages?
• Metadata associated with media assets can be used for
different stages of interactive access
• Metadata can be created and added by hand, linked
automatically or automatically extracted
• The message itself can be made explicit (more metadata)
• Media content and metadata can be passed around and
among systems
• We need community agreement on how to do this (e.g.
canonical processes)
• Users can be given much richer and more flexible access to
(semantically annotated) media content, but…
• we need to understand why we are generating metadata and
store it in a reusable way 48
48
49. Acknowledgements
Jacco van Frank Nack Raphaël Troncy
Ossenbruggen
Stefano Alia Amin Michiel Andre Fialho
Bocconi Hildebrand
49
50. "I have seen the dark universe yawning
Where the black planets roll without aim,
Where they roll in their horror unheeded,
Without knowledge or luster or name.”
-- H. P. Lovecraft, Nemesis
http://www.flickr.com/photos/turbojoe/421680689/
Editor's Notes
For example, for creating an exhibition about Rembrandt van Rijn.If I want to use semantics for improving interactive information access, then what do I mean by Interactive information access?While user task oriented, we need to remember that a picture is not WYSIWYG…I just discussed the paintings of Rembrandt, and have now planted the idea that there may be a forgery of this painting. Next time you see a picture of this painting you will not just think of a Rembrandt painting, but will start wondering whether there was a forgery…
In some sense we don’t even care about the media.We care about the story or the information conveyed by the media. (the narrative in a broad sense of the word)E.g., in the context of a complex search task; or passing the media along to someone else in the “media chain”
Tools aren't enough - we need them to create houses - butthey don't tell us how to be architects.Similarly, if we want to communicate using media, then we need to firstunderstand what it is we want to communicate and how we are able to communicate it.
After a process of premeditation, however short or long, at some point a media asset is created. Some device or another is used to collect images or sound for a period of time, be it photo or video camera, scanner, sound recorder, heart-rate monitor, MRI etc. A media asset may already exist, and the creation process is the transformation of some exist asset to a new one (e.g. to make the sky look brighter). Images can be created with image editing programs, or generated by transforming one or more existing images. We are not interested in the method of creation per se. If the method is considered as significant, however, then this information should be recorded as part of the annotation.
Dutch project with a number of partners, technical and cultural heritage, including the Rijksmuseum in Amsterdam.Use canonical termsOriginally technology driven. The demo is to demonstrate the possibilities (2006-2008).Currently in progress is a user centric design process to prototype and evaluate an interface that supports topic search for (semi-) expert users (2009)http://eculture.cs.vu.nl/europeana/session/search
[[Some coloured circles would be nice for:]Artworks: Rijksmuseum, Louvre, Tropenmuseum, RMV, Bibliopolis, RKD, ArtchiveGeneral concepts (thesauri): Wordnet – English, Dutch & FrenchDomain-specific thesauri: AAT, ULAN (people)Links were created among these, by researchers in Guus Schreiber’s group (VUA)
Next slide:size of different events to depend on no. of participants (popularity)image itself chosen most viewed image on flickruse image clustering to find largest numbers of similar images -> more important -> bigger;Looking at event (several hundreds)use (real-time) image clustering to show most different images.Metadata from tags to detect poster, ticket, stage, vocal
Work in progressInterface motivates: how to represent image. Need no. of participants.Link to geo-location (facets).Event Categories, events from last.fm
These interactive grouping, story telling at least as important as only searchCheck the slide for details
Independent worlds will make links toattain astate of cosmic harmony among the celestial spheres