More Related Content
What's hot
What's hot (20)
Similar to CSW2022_01_introduction.pptx.pdf
Similar to CSW2022_01_introduction.pptx.pdf (20)
Recently uploaded
Recently uploaded (16)
CSW2022_01_introduction.pptx.pdf
- 1. Disinformation/Malign Influence Training, Disarm Foundation | 2022 Session01: introduction Disinformation/Malign Influence Training Disarm Foundation | 2022 1 1
- 2. Disinformation/Malign Influence Training, Disarm Foundation | 2022 Questions for class ● Do you want 30 mins or 1 hour lunch break? ● What are your backgrounds? ○ Course will include some information security, data science, psychology, risk analysis, and python coding ● What do you want to get out of this course? 2
- 4. Disinformation/Malign Influence Training, Disarm Foundation | 2022 Your instructors, and the Disarm Foundation Today’s instructors: ● SJ Terp ● Pablo Breuer ● Mike Klein The Disarm Foundation: https://www.disarm.foundation/ 4
- 5. Disinformation/Malign Influence Training, Disarm Foundation | 2022 Disarm Foundation: Frameworks and Training https://www.disarm.foundation/ 5
- 6. Disinformation/Malign Influence Training, Disarm Foundation | 2022 Course outcomes After successfully completing the course, students will be able to: ● Elaborate how information security and cognitive security interact ● Evaluate persuasive technology at different scales ● Evaluate influence operation mechanisms and tracking techniques ● Use tools to investigate account and network-level coordinated inauthentic activities ● Understand ethical behaviour around misinformation and disinformation response and research 6
- 7. Disinformation/Malign Influence Training, Disarm Foundation | 2022 Course structure Understand environment 1: Introduction 2: Information and response 3: Threats Set up project 4: Project setup 5: Data collection Manage components 6: Influence 7: Narratives 8: Behaviours Manage risk 9: Risk assessment 10: Risk measurement Hotwash Module 1: Introduction ● Introductions ● Defining “cognitive security” ● Cognitive Security Exercise: play games 7
- 8. Disinformation/Malign Influence Training, Disarm Foundation | 2022 Course schedule 8 DAY 1: understanding cogsec 9-10:30 Session 1: introduction Exercise: play games 10:30-12 Session 2: information and response Exercise: information & response landscapes 12-1 lunch 1-2:30 Session 3: threats Exercise: threat landscape 2:30-4 Session 4: project setup Exercise: set up your project resources 4-5:30 Session 5: data collection Exercise: gather data for your project DAY 2: managing cogsec 9-10:30 Session 6: influence Exercise: influence analysis 10:30-12 Session 7: narratives Exercise: narrative analysis 12-1 lunch 1-2:30 Session 8: behaviours Exercise: behaviour analysis 2:30-4 Session 9: risk assessment Exercise: purple team 4-5:30 Session 10: risk prioritisation Exercise: hotwash Each session is 55 mins taught, 30 mins exercise
- 10. Disinformation/Malign Influence Training, Disarm Foundation | 2022 Course project Explore an information harm area or incident of your choice: ● Assess information, harms, and response environments ● Organise project ● Gather data ● Identify incident artifacts ● Identify narratives and behaviours ● Suggest counters ● Report out - in a format of your choice 10 Image: https://commons.wikimedia.org/wiki/File:Project_Management_(project_control).png
- 11. Disinformation/Malign Influence Training, Disarm Foundation | 2022 Start thinking about your project Outputs ● Tweets, report, alert? ● Data science, notes, examples? Topics ● Medical ● Disaster ● Elections ● Business ● War Geography ● Region ● Country ● City etc Creators ● Nationstate / criminal / insider / etc Community ● Who is affected? Harms ● Misinformation ● Disinformation ● Conspiracies ● Rumours Channels ● Social media ● URLs ● Offline 11
- 12. Disinformation/Malign Influence Training, Disarm Foundation | 2022 Defining “Cognitive Security” 12
- 13. Disinformation/Malign Influence Training, Disarm Foundation | 2022 Media: Information disorder 13
- 16. Disinformation/Malign Influence Training, Disarm Foundation | 2022 Cognitive Security: both of them “Cognitive Security is the application of artificial intelligence technologies, modeled on human thought processes, to detect security threats.” - XTN MLSec - machine learning in infosec ● ML used in attacks on information systems ● ML used to defend information systems ● Attacking ML systems and algorithms ● “Adversarial AI” “Cognitive Security (COGSEC) refers to practices, methodologies, and efforts made to defend against social engineering attempts‒intentional and unintentional manipulations of and disruptions to cognition and sensemaking” - cogsec.org CogSec - social engineering at scale ● Manipulation of individual beliefs, belonging, etc ● Manipulation of human communities ● “Adversarial cognition” 16
- 17. Disinformation/Malign Influence Training, Disarm Foundation | 2022 Social Engineering: both of them “the use of centralized planning in an attempt to manage social change and regulate the future development and behavior of a society.” ● Mass manipulation etc “the use of deception to manipulate individuals into divulging confidential or personal information that may be used for fraudulent purposes.” ● Phishing etc 17
- 18. Disinformation/Malign Influence Training, Disarm Foundation | 2022 Cognitive Security: Information Security applied to disinformation+ “Cognitive security is the application of information security principles, practices, and tools to misinformation, disinformation, and influence operations. It takes a socio-technical lens to high-volume, high-velocity, and high-variety forms of “something is wrong on the internet”. Cognitive security can be seen as a holistic view of disinformation from a security practitioner’s perspective 18
- 19. Disinformation/Malign Influence Training, Disarm Foundation | 2022 How Cognitive Security and information security fit together 19
- 20. Disinformation/Malign Influence Training, Disarm Foundation | 2022 Information Security vs Cognitive Security: Objects Computers Networks Internet Data Actions People Communities Internet Beliefs Actions 20
- 21. Disinformation/Malign Influence Training, Disarm Foundation | 2022 Hybrids, and other attack types from infosec 21 ● Hybrid: cyber + cognitive + physical ● Cyber supporting cognitive ● Cognitive supporting cyber ● Cyber attack forms adapted to cognitive Image: Verizon DBIR https://www.verizon.com/business/resources/reports/dbir/
- 22. Disinformation/Malign Influence Training, Disarm Foundation | 2022 Your role ● Manage lifecycles ● Manage risk ● Manage teams ● Manage objects ● Manage behaviours ● Manage endpoints ● Manage toolset 22 Image: https://www.wsj.com/articles/SB947800469939459913
- 25. Disinformation/Malign Influence Training, Disarm Foundation | 2022 Cogsec: Lifecycle models 25 Images: WHO Europe, https://www.nist.gov/cyberframework/online-learning/components-framework
- 27. Disinformation/Malign Influence Training, Disarm Foundation | 2022 Infosec: risk management models Image: https://www.risklens.com/infographics/fair-model-on-a-page 27
- 28. Disinformation/Malign Influence Training, Disarm Foundation | 2022 CogSec: Managing risk and resources Manage risks ● Risk management ○ assessment, reduction, remediation ● Frequency: ○ how often? ● Losses: ○ How bad? How big? Who to? ○ Harm categories: physical, psychological, economic, reputational, cultural, political ● Environment ○ Assets, threats, vulnerabilities Manage resources ● Mis/disinformation is everywhere ● Detection, mitigation, response ● You never have enough resources ○ People ○ Technologies ○ Time ○ Attention ○ Connections 28
- 29. Disinformation/Malign Influence Training, Disarm Foundation | 2022 CogSec: Managing the whole system Information Landscape • Information seeking • Information sharing • Information posting • Information sources • Information voids Harms Landscape • Motivations • Sources/ Starting points • Effects • Misinformation narratives • Hateful speech narratives • Crossover narratives • Tactics and Techniques • Artifacts Response Landscape •Monitoring organisations •Countering organisations •Coordination •Existing policies •Technologies •etc 29
- 32. Disinformation/Malign Influence Training, Disarm Foundation | 2022 Cognitive Security Operations Centers 32 Image: DISARM Foundation
- 34. Disinformation/Malign Influence Training, Disarm Foundation | 2022 Infosec model: STIX Image: https://github.com/traut/stixview 34
- 35. Disinformation/Malign Influence Training, Disarm Foundation | 2022 Cogsec: interacting layers of attack/respond Campaigns Incidents Narratives and behaviours Artifacts a t t a c k e r d e f e n d e r 35 Image: DISARM Foundation
- 40. Disinformation/Malign Influence Training, Disarm Foundation | 2022 Infosec model: ATT&CK Image: https://www.mitre.org/capabilities/cybersecurity/overview/cybersecurity-blog/the-attck%E2%84%A2-navigator-a-new-open-source 40
- 41. Disinformation/Malign Influence Training, Disarm Foundation | 2022 Cogsec: DISARM Red 41 Image: DISARM Foundation
- 42. Disinformation/Malign Influence Training, Disarm Foundation | 2022 Infosec model: MITRE DEFEND Image: https://therecord.media/mitre-releases-d3fend-defensive-measures-complimentary-to-its-attck-framework/ 42
- 43. Disinformation/Malign Influence Training, Disarm Foundation | 2022 Cogsec: DISARM Blue 43 Image: DISARM Foundation
- 46. Disinformation/Malign Influence Training, Disarm Foundation | 2022 Typical cogsec toolset Data gathering ● Crowdtangle ● Tineye / Yandex ● Hypothes.is ● Maltego ● Profil3r ● CheckUserNames ● Hootsuite Data storage and sharing ● CSVs ● STIX / TAXII ● Archive.org Information sharing ● MISP ● Ticketing system ● Googledocs ● Spreadsheets Response ● Googledocs & spreadsheets Analysis ● Jupyter notebooks ● Python libraries ● (Pandas) ● Gephi ● AMITT Navigator ● inVid ● BuiltWith
- 48. Disinformation/Malign Influence Training, Disarm Foundation | 2022 Infosec: Security training Image: https://www.firewelltechnologysolutions.com/two-factor-authentication-and-account-security/ 48
- 49. Disinformation/Malign Influence Training, Disarm Foundation | 2022 CogSec: Fake news training Image: https://www.dhs.gov/sites/default/files/publications/19_0717_cisa_the-war-on-pineapple-understanding-foreign-interference-in-5-steps.pdf 49
- 50. Disinformation/Malign Influence Training, Disarm Foundation | 2022 Your first exercise: play games 50
- 51. Disinformation/Malign Influence Training, Disarm Foundation | 2022 Using games to prepare your responses Learning game ● fun experience that teaches you something ● Useful for training large numbers of people simultaneously Red team / Purple team ● test an organisation’s defences by thinking like a bad guy ● Useful for finding system vulnerabilities, and predicting future moves Tabletop exercise ● key people responding to a simulated event ● Useful for creating cohesive teams. Often large scale Simulation ● imitation of processes and environment ● Useful for “what if” automated tests 51
- 53. Disinformation/Malign Influence Training, Disarm Foundation | 2022 Assessing a game: look for… Coverage ● Who is this designed for? ● Public, influencers, media etc ● Techniques covered ● Harms covered ● rumours, misinformation, disinformation, conspiracy theories etc ● Variants, e.g. languages / countries Viewpoint ● Whose point of view are you playing from? ● Do you “break it then fix it”? 53 Outcomes ● What did you learn from the game? ● What are the rewards from the game? Continuation ● Where does it suggest you go or do next? ● Would you recommend it to your friends?
- 54. Disinformation/Malign Influence Training, Disarm Foundation | 2022 A sampling of disinformation games Game Point of view Audience Creator Bad News Game, Harmony Square, Go Viral Creator Public DROG News Hero Media Public NATO stratcom Cranky Uncle Family member Public Monash uni Disinformation Diaries Politician Political staff Alliance of dems Learn2Discern Media Public Ukraine Fakey Fact checker Public Uni of Indiana 54
- 55. Disinformation/Malign Influence Training, Disarm Foundation | 2022 Other disinformation games Online games ● Fake News: the game https://www.rand.org/research/projects/truth-decay/fighting-disinformation/search/items/fake-news- the-game.html ● Checkology misinformation practice (e.g. https://checkology.org/lessons/teacher/163/elements/2471) ● Polititruth https://www.cinqmarsmedia.com/politifact/index.html (Politifact, Tinder-style) ● BBC iReporter https://www.bbc.co.uk/news/resources/idt-8760dd58-84f9-4c98-ade2-590562670096 ● Digital Compass https://www.gamesforchange.org/game/digital-compass/ ● The Republia Times https://www.gamesforchange.org/game/the-republia-times/ ● Interland https://beinternetawesome.withgoogle.com/en_us/interland ● Propaganda Game https://propagandagame.org/ ● Factitious http://factitious.augamestudio.com/#/ ● Hindsight2020 https://www.hindsight2020.eu/ Card games ● Fake News ● Paladone 55
- 56. Disinformation/Malign Influence Training, Disarm Foundation | 2022 Assessing a game: look for… Coverage ● Who is this designed for? ● Public, influencers, media etc ● Techniques covered ● Harms covered ● rumours, misinformation, disinformation, conspiracy theories etc ● Variants, e.g. languages / countries Viewpoint ● Whose point of view are you playing from? ● Do you “break it then fix it”? 56 Outcomes ● What did you learn from the game? ● What are the rewards from the game? Continuation ● Where does it suggest you go or do next? ● Would you recommend it to your friends?
- 57. Disinformation/Malign Influence Training, Disarm Foundation | 2022 Annex: Some disinformation games to choose from 57
- 58. Disinformation/Malign Influence Training, Disarm Foundation | 2022 News Hero https://www.thenewshero.org/ and https://www.facebook.com/thenewshero NATO Stratcom CoE 58
- 59. Disinformation/Malign Influence Training, Disarm Foundation | 2022 Bad News Game https://www.getbadnews.com/#intro DROG and Uni Cambridge Techniques: ● Impersonation ● Emotion ● Polarization ● Conspiracy ● Discredit ● Trolling 59
- 60. Disinformation/Malign Influence Training, Disarm Foundation | 2022 Harmony Square https://www.harmonysquare.game/en DROG/ GEC Techniques: ● Trolling ● Emotion ● Amplification ● Escalation 60
- 61. Disinformation/Malign Influence Training, Disarm Foundation | 2022 Go Viral Game https://www.goviralgame.com/ University of Cambridge, DROG Techniques: ● Emotion ● Fake expert ● Conspiracy 61
- 62. Disinformation/Malign Influence Training, Disarm Foundation | 2022 Disinformation Diaries https://www.allianceofdemocracies.org/initiatives/the -campaign/the-disinformation-diaries/ Ora Tanner, Alliance of Democracies Foundation 62
- 63. Disinformation/Malign Influence Training, Disarm Foundation | 2022 Cranky Uncle https://crankyuncle.com/ John Cook, Monash Uni, Autonomy 63
- 64. Disinformation/Malign Influence Training, Disarm Foundation | 2022 Learn 2 Discern game http://irex.mocotms.com/ml_en/story_html5.html?l ms=1 Ukrainian Takes a while to do, but a lovely game 64
- 67. Disinformation/Malign Influence Training, Disarm Foundation | 2022 Fake It to Make It https://www.fakeittomakeitgame.com/ 67
- 69. Disinformation/Malign Influence Training, Disarm Foundation | 2022 Factitious http://factitious.augamestudio.com/#/ - dead? http://factitious-pandemic.augamestudio.com/#/ Maggie Farley/ Bob Hone, AU Game Lab, Jolt program 69