Supercharging Visualization with Data Mining

Raffael Marty
Raffael MartyGeneralManager Cybersecurity at ConnectWise
Big Data
                                    and
                            Security Intelligence
                                 Bay Area's Big Data Think Tank - December 2012
                                                     Raffael Marty

pixlcloud |   turning data into actionable insight                                copyright (c) 2012
Doushuai's Three Barriers
‘You	 make	 your	 way	 through	 the	 darkness	 of	 abandoned	 grasses	 in	 a	 
       search	 for	 meaning.	 As	 you	 do,	 where	 is	 the	 meaning?'




                                                     47th case of'The Gateless Barrier'
                                                          a collection of Zen koans
Outline


                            security is getting harder
                            we need new approaches
                              viz seems interesting
                              data mining can help

pixlcloud |   turning data into actionable insight             copyright (c) 2012
Some Security Challenges
  ‣security expertise
  ‣understanding data
  ‣communicating security
  ‣everyone is compromised
  ‣constantly changing


pixlcloud |   turning data into actionable insight   copyright (c) 2012
Solution?
 ‣ security expertise                                   ‣ collaboration

 ‣ understanding data                                   ‣ visual exploration, context

 ‣ communicating security                               ‣ visual representations
                     visibility anddata visibility,
 ‣ everyone is compromised ‣ complete
                    understanding
                             machine augmented analysis
 ‣ constantly changing                                  ‣ quick learning cycles
                                                         adaptive solution


pixlcloud |   turning data into actionable insight                                      copyright © 2012
visibility, you mean
                               visualization?


pixlcloud |   turning data into actionable insight   copyright (c) 2012
Why Visualization?
   the data...                                         the stats ...




                                                     http://en.wikipedia.org/wiki/Anscombe%27s_quartet
pixlcloud |   turning data into actionable insight                                           copyright (c) 2012
Can We Do Without Viz?




                                                     http://en.wikipedia.org/wiki/Anscombe%27s_quartet
pixlcloud |   turning data into actionable insight                                         copyright (c) 2012
Why Visualization?
 ‣Highest bandwidth to interact with humans
 ‣Put the human in the loop:
    ‣pattern detection
          we need to enable humans
    ‣remembers context
                to solve problems
    ‣fantastic intuition
    ‣can predict

pixlcloud |   turning data into actionable insight          copyright © 2012
Supercharging Visualization with Data Mining
Supercharging Visualization with Data Mining
Supercharging Visualization with Data Mining
Supercharging Visualization with Data Mining
Supercharging Visualization with Data Mining
Supercharging Visualization with Data Mining
Supercharging Visualization with Data Mining
Supercharging Visualization with Data Mining
Supercharging Visualization with Data Mining
Supercharging Visualization with Data Mining
Supercharging Visualization with Data Mining
Supercharging Visualization with Data Mining
Supercharging Visualization with Data Mining
Supercharging Visualization with Data Mining
Supercharging Visualization with Data Mining
Supercharging Visualization with Data Mining
Supercharging Visualization with Data Mining
Supercharging Visualization with Data Mining
Supercharging Visualization with Data Mining
Supercharging Visualization with Data Mining
1 of 29

Recommended

Web Archivierung - Gründe by
Web Archivierung - GründeWeb Archivierung - Gründe
Web Archivierung - GründeHumoback
751 views15 slides
RSA 2006 - Visual Security Event Analysis by
RSA 2006 - Visual Security Event AnalysisRSA 2006 - Visual Security Event Analysis
RSA 2006 - Visual Security Event AnalysisRaffael Marty
1.8K views43 slides
DAVIX - Data Analysis and Visualization Linux by
DAVIX - Data Analysis and Visualization LinuxDAVIX - Data Analysis and Visualization Linux
DAVIX - Data Analysis and Visualization LinuxRaffael Marty
4.2K views13 slides
Log Visualization - Bellua BCS 2006 by
Log Visualization - Bellua BCS 2006Log Visualization - Bellua BCS 2006
Log Visualization - Bellua BCS 2006Raffael Marty
1.6K views45 slides
Security Visualization - Let's Take A Step Back by
Security Visualization - Let's Take A Step BackSecurity Visualization - Let's Take A Step Back
Security Visualization - Let's Take A Step BackRaffael Marty
3K views43 slides
Cloud - Security - Big Data by
Cloud - Security - Big DataCloud - Security - Big Data
Cloud - Security - Big DataRaffael Marty
2.1K views13 slides

More Related Content

Viewers also liked

Creating Your Own Threat Intel Through Hunting & Visualization by
Creating Your Own Threat Intel Through Hunting & VisualizationCreating Your Own Threat Intel Through Hunting & Visualization
Creating Your Own Threat Intel Through Hunting & VisualizationRaffael Marty
2.7K views25 slides
Security Insights at Scale by
Security Insights at ScaleSecurity Insights at Scale
Security Insights at ScaleRaffael Marty
2.5K views11 slides
サイボウズ・ラボユース成果報告会 by
サイボウズ・ラボユース成果報告会サイボウズ・ラボユース成果報告会
サイボウズ・ラボユース成果報告会slankdev
6K views72 slides
企業向けクラウドサービスの開発・運用 悩みどころのパターンと対策 by
企業向けクラウドサービスの開発・運用 悩みどころのパターンと対策企業向けクラウドサービスの開発・運用 悩みどころのパターンと対策
企業向けクラウドサービスの開発・運用 悩みどころのパターンと対策Ryo Mitoma
3.7K views75 slides
Creating Your Own Threat Intel Through Hunting & Visualization by
Creating Your Own Threat Intel Through Hunting & VisualizationCreating Your Own Threat Intel Through Hunting & Visualization
Creating Your Own Threat Intel Through Hunting & VisualizationRaffael Marty
25.2K views36 slides
サイボウズ・ラボ成果発表会 by
サイボウズ・ラボ成果発表会サイボウズ・ラボ成果発表会
サイボウズ・ラボ成果発表会Komei Kamiya
7K views15 slides

Viewers also liked(8)

Creating Your Own Threat Intel Through Hunting & Visualization by Raffael Marty
Creating Your Own Threat Intel Through Hunting & VisualizationCreating Your Own Threat Intel Through Hunting & Visualization
Creating Your Own Threat Intel Through Hunting & Visualization
Raffael Marty2.7K views
Security Insights at Scale by Raffael Marty
Security Insights at ScaleSecurity Insights at Scale
Security Insights at Scale
Raffael Marty2.5K views
サイボウズ・ラボユース成果報告会 by slankdev
サイボウズ・ラボユース成果報告会サイボウズ・ラボユース成果報告会
サイボウズ・ラボユース成果報告会
slankdev6K views
企業向けクラウドサービスの開発・運用 悩みどころのパターンと対策 by Ryo Mitoma
企業向けクラウドサービスの開発・運用 悩みどころのパターンと対策企業向けクラウドサービスの開発・運用 悩みどころのパターンと対策
企業向けクラウドサービスの開発・運用 悩みどころのパターンと対策
Ryo Mitoma3.7K views
Creating Your Own Threat Intel Through Hunting & Visualization by Raffael Marty
Creating Your Own Threat Intel Through Hunting & VisualizationCreating Your Own Threat Intel Through Hunting & Visualization
Creating Your Own Threat Intel Through Hunting & Visualization
Raffael Marty25.2K views
サイボウズ・ラボ成果発表会 by Komei Kamiya
サイボウズ・ラボ成果発表会サイボウズ・ラボ成果発表会
サイボウズ・ラボ成果発表会
Komei Kamiya7K views
High Performance Networking with DPDK & Multi/Many Core by slankdev
High Performance Networking with DPDK & Multi/Many CoreHigh Performance Networking with DPDK & Multi/Many Core
High Performance Networking with DPDK & Multi/Many Core
slankdev2.9K views
AI & ML in Cyber Security - Welcome Back to 1999 - Security Hasn't Changed by Raffael Marty
AI & ML in Cyber Security - Welcome Back to 1999 - Security Hasn't ChangedAI & ML in Cyber Security - Welcome Back to 1999 - Security Hasn't Changed
AI & ML in Cyber Security - Welcome Back to 1999 - Security Hasn't Changed
Raffael Marty4.5K views

More from Raffael Marty

Exploring the Defender's Advantage by
Exploring the Defender's AdvantageExploring the Defender's Advantage
Exploring the Defender's AdvantageRaffael Marty
137 views36 slides
Extended Detection and Response (XDR) An Overhyped Product Category With Ulti... by
Extended Detection and Response (XDR)An Overhyped Product Category With Ulti...Extended Detection and Response (XDR)An Overhyped Product Category With Ulti...
Extended Detection and Response (XDR) An Overhyped Product Category With Ulti...Raffael Marty
965 views19 slides
How To Drive Value with Security Data by
How To Drive Value with Security DataHow To Drive Value with Security Data
How To Drive Value with Security DataRaffael Marty
3.4K views7 slides
Cyber Security Beyond 2020 – Will We Learn From Our Mistakes? by
Cyber Security Beyond 2020 – Will We Learn From Our Mistakes?Cyber Security Beyond 2020 – Will We Learn From Our Mistakes?
Cyber Security Beyond 2020 – Will We Learn From Our Mistakes?Raffael Marty
6.4K views30 slides
Artificial Intelligence – Time Bomb or The Promised Land? by
Artificial Intelligence – Time Bomb or The Promised Land?Artificial Intelligence – Time Bomb or The Promised Land?
Artificial Intelligence – Time Bomb or The Promised Land?Raffael Marty
1K views20 slides
Understanding the "Intelligence" in AI by
Understanding the "Intelligence" in AIUnderstanding the "Intelligence" in AI
Understanding the "Intelligence" in AIRaffael Marty
942 views12 slides

More from Raffael Marty(20)

Exploring the Defender's Advantage by Raffael Marty
Exploring the Defender's AdvantageExploring the Defender's Advantage
Exploring the Defender's Advantage
Raffael Marty137 views
Extended Detection and Response (XDR) An Overhyped Product Category With Ulti... by Raffael Marty
Extended Detection and Response (XDR)An Overhyped Product Category With Ulti...Extended Detection and Response (XDR)An Overhyped Product Category With Ulti...
Extended Detection and Response (XDR) An Overhyped Product Category With Ulti...
Raffael Marty965 views
How To Drive Value with Security Data by Raffael Marty
How To Drive Value with Security DataHow To Drive Value with Security Data
How To Drive Value with Security Data
Raffael Marty3.4K views
Cyber Security Beyond 2020 – Will We Learn From Our Mistakes? by Raffael Marty
Cyber Security Beyond 2020 – Will We Learn From Our Mistakes?Cyber Security Beyond 2020 – Will We Learn From Our Mistakes?
Cyber Security Beyond 2020 – Will We Learn From Our Mistakes?
Raffael Marty6.4K views
Artificial Intelligence – Time Bomb or The Promised Land? by Raffael Marty
Artificial Intelligence – Time Bomb or The Promised Land?Artificial Intelligence – Time Bomb or The Promised Land?
Artificial Intelligence – Time Bomb or The Promised Land?
Raffael Marty1K views
Understanding the "Intelligence" in AI by Raffael Marty
Understanding the "Intelligence" in AIUnderstanding the "Intelligence" in AI
Understanding the "Intelligence" in AI
Raffael Marty942 views
AI & ML in Cyber Security - Why Algorithms are Dangerous by Raffael Marty
AI & ML in Cyber Security - Why Algorithms are DangerousAI & ML in Cyber Security - Why Algorithms are Dangerous
AI & ML in Cyber Security - Why Algorithms are Dangerous
Raffael Marty7.2K views
AI & ML in Cyber Security - Why Algorithms Are Dangerous by Raffael Marty
AI & ML in Cyber Security - Why Algorithms Are DangerousAI & ML in Cyber Security - Why Algorithms Are Dangerous
AI & ML in Cyber Security - Why Algorithms Are Dangerous
Raffael Marty13.9K views
Delivering Security Insights with Data Analytics and Visualization by Raffael Marty
Delivering Security Insights with Data Analytics and VisualizationDelivering Security Insights with Data Analytics and Visualization
Delivering Security Insights with Data Analytics and Visualization
Raffael Marty3.7K views
Visualization in the Age of Big Data by Raffael Marty
Visualization in the Age of Big DataVisualization in the Age of Big Data
Visualization in the Age of Big Data
Raffael Marty6.9K views
Big Data Visualization by Raffael Marty
Big Data VisualizationBig Data Visualization
Big Data Visualization
Raffael Marty41.5K views
The Heatmap
 - Why is Security Visualization so Hard? by Raffael Marty
The Heatmap
 - Why is Security Visualization so Hard?The Heatmap
 - Why is Security Visualization so Hard?
The Heatmap
 - Why is Security Visualization so Hard?
Raffael Marty2.5K views
Workshop: Big Data Visualization for Security by Raffael Marty
Workshop: Big Data Visualization for SecurityWorkshop: Big Data Visualization for Security
Workshop: Big Data Visualization for Security
Raffael Marty22.1K views
Visualization for Security by Raffael Marty
Visualization for SecurityVisualization for Security
Visualization for Security
Raffael Marty7.7K views
The Heatmap
 - Why is Security Visualization so Hard? by Raffael Marty
The Heatmap
 - Why is Security Visualization so Hard?The Heatmap
 - Why is Security Visualization so Hard?
The Heatmap
 - Why is Security Visualization so Hard?
Raffael Marty8K views
Cyber Security – How Visual Analytics Unlock Insight by Raffael Marty
Cyber Security – How Visual Analytics Unlock InsightCyber Security – How Visual Analytics Unlock Insight
Cyber Security – How Visual Analytics Unlock Insight
Raffael Marty33K views
Event Graphs - EUSecWest 2006 by Raffael Marty
Event Graphs - EUSecWest 2006Event Graphs - EUSecWest 2006
Event Graphs - EUSecWest 2006
Raffael Marty951 views
Insider Threat Visualization - HackInTheBox 2007 by Raffael Marty
Insider Threat Visualization - HackInTheBox 2007Insider Threat Visualization - HackInTheBox 2007
Insider Threat Visualization - HackInTheBox 2007
Raffael Marty2.1K views

Supercharging Visualization with Data Mining

  • 1. Big Data and Security Intelligence Bay Area's Big Data Think Tank - December 2012 Raffael Marty pixlcloud | turning data into actionable insight copyright (c) 2012
  • 2. Doushuai's Three Barriers ‘You make your way through the darkness of abandoned grasses in a search for meaning. As you do, where is the meaning?' 47th case of'The Gateless Barrier' a collection of Zen koans
  • 3. Outline security is getting harder we need new approaches viz seems interesting data mining can help pixlcloud | turning data into actionable insight copyright (c) 2012
  • 4. Some Security Challenges ‣security expertise ‣understanding data ‣communicating security ‣everyone is compromised ‣constantly changing pixlcloud | turning data into actionable insight copyright (c) 2012
  • 5. Solution? ‣ security expertise ‣ collaboration ‣ understanding data ‣ visual exploration, context ‣ communicating security ‣ visual representations visibility anddata visibility, ‣ everyone is compromised ‣ complete understanding machine augmented analysis ‣ constantly changing ‣ quick learning cycles adaptive solution pixlcloud | turning data into actionable insight copyright © 2012
  • 6. visibility, you mean visualization? pixlcloud | turning data into actionable insight copyright (c) 2012
  • 7. Why Visualization? the data... the stats ... http://en.wikipedia.org/wiki/Anscombe%27s_quartet pixlcloud | turning data into actionable insight copyright (c) 2012
  • 8. Can We Do Without Viz? http://en.wikipedia.org/wiki/Anscombe%27s_quartet pixlcloud | turning data into actionable insight copyright (c) 2012
  • 9. Why Visualization? ‣Highest bandwidth to interact with humans ‣Put the human in the loop: ‣pattern detection we need to enable humans ‣remembers context to solve problems ‣fantastic intuition ‣can predict pixlcloud | turning data into actionable insight copyright © 2012