Man vs Machine: Signal Detection Theory and Big Data

834
-1

Published on

Humans are much better than computers at detecting unknown patterns in a visual data set, but, like computers we have our shortcomings.

We need to optimize inputs for humans so they are fast and efficient in detecting patterns, especially with the coming data tsunami.

Published in: Technology, Business
0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
834
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
13
Comments
0
Likes
2
Embeds 0
No embeds

No notes for slide

Man vs Machine: Signal Detection Theory and Big Data

  1. 1. Can Skynet Beat Humans in Signal Detection? Kyle Redinger, Co-Founder @VividCortex
  2. 2. Background Database Performance Management Measure ‘All the Things’ in 1-Second Detail
  3. 3. Your Mandate Manage 300x more data with 1.5x more people.
  4. 4. Signal Detection Theory Humans process up to 500GB of data per second.
  5. 5. Find the Outliers
  6. 6. Signal Detection Easy Hard
  7. 7. Easy Signal Detection % Correct Response Time 1 1000 0.95 900 0.9 800 0.85 700 0.8 600 0.75 500 0.7 400 0.65 300 0.6 200 Set Size Set Size Easy signals are always easy, regardless of set size.
  8. 8. Hard Signal Detection % Correct Response Time 1 1000 0.95 900 0.9 800 0.85 700 0.8 600 0.75 500 0.7 400 0.65 300 0.6 200 Set Size Set Size Hard signals get harder as set size increases.
  9. 9. Signal Detection in Use Upper Control Limit Lowe Control Limit Statistical Process Controls are “Easy”
  10. 10. Signal Detection in Systems 1-Second CPU over 5 Minutes What’s the cause?
  11. 11. Looking at Work In a database, a query is work. But, I have 300 query classes. Crap.
  12. 12. CPU Graph Everything Query Execution Time
  13. 13. Reduce Data CPU Zoom & Remove the Obvious 1/10th of Data Points Query Execution Time
  14. 14. Man vs Machine Man Machine
  15. 15. Man vs Machine Man Machine Non-linear increasing CPU Statistically significant
  16. 16. Man vs Machine Man Machine Non-linear increasing CPU Statistically significant Pattern! Pattern! Pattern! Not model friendly
  17. 17. Shortcomings Elephants in the room?
  18. 18. Shortcomings Humans lose with a known pattern
  19. 19. Key Thoughts Our brains do much better with fewer distractors, so eliminate them! With unknown patterns, humans find signals faster than computers.
  20. 20. Thanks Remember: Less is more. @kyleredinger http://www.flickr.com/photos/danielproulx/3524826318/ http://www.sciencedirect.com/science/article/pii/S0896627301003920 http://www.himandus.net/elefunteria/eday/puzzles/hunt_24.html http://www.federaljack.com/terminator-robots-a-reality/

×