MedDMO multimedia analysis tools for countering disinformation

1. This project has received funding from the European Union
DIGITAL-2021-TRUST-01. Contract number: 101083756
meddmo.eu
The MedDMO Multimedia Analysis Toolbox
for countering disinformation
Manos Schinas, Panagiotis Galopoulos, Efthimios Hamilos, Nikos Sarris,
Ioannis Kompatsiaris and Symeon Papadopoulos
Nikos Sarris
Media analysis, veri
fi
cation and retrieval group (MeVer)
Center for Research and Technology Hellas (CERTH)

2. Objects and actions
are automatically
identified and
added as tags
Automatic image
analysis creates
short descriptions
Assets are
automatically
classified to
specific categories,
as disturbing,
NSFW or memes
Multimedia Archive
A platform where you can easily analyse, find and annotate media
Any tag can be
manually added by
users

3. Visual heatmaps
help users quickly
understand the
results
15 image analysis
algorithms help
uncover possible
forgeries
Heatmap overlay
on image helps
users spot
manipulated areas
Image Verification Assistant
Quickly analyse images to identify possible forgeries
Manual annotation
space helps users
discuss findings

4. Temporal video
segmentation
illustrating the
manipulation
probability of every
segment
Top level analysis
for the entire video
Image/video
player window for
detailed viewing
Deepfake detection
Assess the possibility of deepfake manipulation in image or video
Detailed analysis
per video segment

5. Example images
from the most likely
location illustrating
visual similarity
with the query
image
Map illustrating the
most likely location
for the image
Window for
detailed image
viewing
Location estimation
Estimate the most likely location for an image based on visual cues

6. Results include
images with flags
of visual similarity
to the query
window
Window for
selecting part of
image that search
should be based
on
Search by visual similarity
Find images that are visually and semantically similar
Selecting to search
for similar images

7. Results include
images that are
almost (visually)
identical to the
query image
Search by visual similarity
Find images that are visually nearly identical
Selecting to search
for near duplicate
images

8. Results include
video that includes
scenes that are
visually identical to
scenes from the
query video
Search by visual similarity (video)
Find videos that contain common scenes
Selecting to search
for near duplicate
video
Frames from the
retrieved video
Frames from the
query video

9. CONTACT
us
This project has received funding from the European Union
DIGITAL-2021-TRUST-01. Contract number: 101083756
meddmo.eu
Fact-Check by MedDMO
@MEDDMOhub
info@meddmo.eu