Advertisement

More Related Content

Advertisement

NordisPresentation_April23.pptx

  1. Research Centre for Responsible Media Technology and Innovation Project number 309339 Visual Content Verification: Observations from Faktisk Verfiserbar Sohail Ahmed Khan
  2. THE AIM OF THE PROJECT IS TO SOLVE THE MEDIA'S URGENT NEED FOR EXPERTISE TO VERIFY VIDEOS AND PHOTOS FROM THE WAR IN UKRAINE. The secondary aim is to strengthen and further develop this expertise for all Norwegian media, and increase the knowledge and capability to do fact checking journalism.
  3. Workflow The collection and analysis of data gathered from open sources (covert and publicly available sources) to produce actionable intelligence. VERIFICATION WORKFLOW OSINT
  4. Tools
  5. Tools
  6. Telegram: Russian Missiles Heading Towards Finland • This was a video that was published on Telegram in May. • The video is allegedly taken near Leningrad, Oblast. • Claims the movement of missiles to be reaction of Russia towards Finland’s interest in joining NATO.
  7. Telegram: Russian Missiles Heading Towards Finland Original Video
  8. Telegram: Russian Missiles Heading Towards Finland Google Street View Original Video Google Earth Pro
  9. Days with rain in April/May
  10. Exploring the Use of Computational Tools for Fact-Checking: A Journalistic Case Study of Verifying the War in Ukraine Sohail Ahmed Khan, Jan Gunnar Furuly, Henrik Vold, Rano Tahseen, Duc-Tien Dang-Nguyen
  11. Exploring the Use of Computational Tools for Fact-Checking: A Journalistic Case Study of Verifying the War in Ukraine Sohail Ahmed Khan, Jan Gunnar Furuly, Henrik Vold, Rano Tahseen, Duc-Tien Dang-Nguyen
  12. Visual User-Generated Content Verification in Journalism mediaforensics.mediafutures.no Sohail Ahmed Khan, Ghazaal Sheikhi, Andreas Lothe Opdahl, Fazle Rabbi, Sergej Stoppel, Christoph Trattner, Duc-Tien Dang-Nguyen
  13. Visual User-Generated Content Verification in Journalism mediaforensics.mediafutures.no Sohail Ahmed Khan, Ghazaal Sheikhi, Andreas Lothe Opdahl, Fazle Rabbi, Sergej Stoppel, Christoph Trattner, Duc-Tien Dang-Nguyen
  14. • Assists journalists/fact-checkers recognize military equipment within images/videos. • Recognizes 20 different tanks, and artillery vehicles (for now). • Also recognizes destroyed/damaged tanks in most cases. In case of wrong classification, the returned 5 most probable names typically contain the correct answer as well, thus reducing search space for the person using the classifier. • Makes efficient decisions within seconds. • Provides background information about predicted tank, gathered from Wikipedia. • Provides more pictures of the predicted tank allowing the user to compare them with the query image manually. WHY IS IT IMPORTANT?
  15. • Assists journalists/fact-checkers in recognizing the language being spoken in a video. In seconds. • Tells what language is being spoken, transcribes what is being said, and also translates it to English. • This can be useful in verifying videos coming out from warzones, foreign countries having languages other than English/Norwegian. • Reduces the manual effort in translating and recognizing the language in a video. Currently, the journalists have to upload the videos to YouTube and wait for 40-45 minutes to get transcription/translation. • Will be updated to tell what countries/regions where a specific language is spoken widely. WHY IS IT IMPORTANT?
  16. Acknowledgements •Kristoffer Egeberg – Faktisk •Jan Gunnar Furuly - Aftenposten •Henrik Vold - Department of Journalism (IJ) •Rano Tahseen – TV2

Editor's Notes

  1. OSINT involves using publicly available information from social media, websites, and news articles to gather information about an individual or organization, or an event. 
  2. In the middle of May 2021, faktisk was tipped off about a video claiming that Russia is sending vehicles carrying missiles towards its border with Finland in response to Finland initiating the process to join NATO. By analyzing the Russian highway network. The exact place where the video was recorded was found to be about an hour and a quarter drive from Vyborg, 127 kilometers from the Finnish border.
  3. When we geolocate – we find out where the picture is taken. We often use Google Maps, Yandex Maps or Google Earth Pro. What do we know from watching this video? We know it’s a six-lane highway. We can see that in the video on the right. The post states that the video was taken near Leningrad, Oblast. We searched this area in Google Earth Pro and startet looking for highways around Leningrad. Looking around on Google Earth Pro, we found something that seemed promising. We started using Google Street View and looking for elements that could match. We finally managed to find out that this video was taken on E-18 between St. Petersburg and Vyborg. Heading north.
  4. When we geolocate – we find out where the picture is taken. We often use Google Maps, Yandex Maps or Google Earth Pro. What do we know from watching this video? We know it’s a six-lane highway. We can see that in the video on the right. The post states that the video was taken near Leningrad, Oblast. We searched this area in Google Earth Pro and startet looking for highways around Leningrad. Looking around on Google Earth Pro, we found something that seemed promising. We started using Google Street View and looking for elements that could match. We finally managed to find out that this video was taken on E-18 between St. Petersburg and Vyborg. Heading north.
  5. So how do we know if this really is the Iskander missile vehicles? Normally we compare the vehicles with each other and look up different elements.
  6. But finding out whether the video was filmed after the NATO process had begun was another problem? To verify this, historical weather patterns became a useful tool in determining the timing when the video could have been filmed. Based on historical satellite imagery from the Sentinel Hub, had the evidence that there was snow in the area as recently as April 23, 2021.
  7. Since the video doesn’t show any traces of snow, this information became critical in narrowing down the timeline during which the video was filmed.
  8. In the video, the windshield wipers of the car from which the video was filmed were running which suggests that it was raining that day. checked historical weather data from “weather.com” to see what days it was raining in the area. It was not possible to say 100 percent certain that the clip was from May 16. But the combination of historical weather data, and satellite imagery from Sentinel Hub made it likely that the clip was from May rather than from April, the same month during which Finland started the process to join NATO. This verification became the main story throughout on 17 May
  9. We share all the pictues and videos in an Excel-document for all the medias in Norway. So everyone can see what we are working on. But also to show how rough the content is. We have verified a lot of material which shows how brutal this war can be.
  10. … Journalists working at Faktisk.no, and around the world receive images/videos relating to the war in Ukraine typically through social media platforms and online forums. It is understood that the content shared on social media is not always factually correct and might be presented out-of-context. In order to verify if the content is indeed factually correct, journalists use a number of different techniques and computer software.
  11. … Journalists working at Faktisk.no, and around the world receive images/videos relating to the war in Ukraine typically through social media platforms and online forums. It is understood that the content shared on social media is not always factually correct and might be presented out-of-context. In order to verify if the content is indeed factually correct, journalists use a number of different techniques and computer software.
Advertisement