The document discusses the role of sensors and algorithms in data collection and human-computer interaction, illustrating applications through examples such as smartphones and various types of sensors. It emphasizes the importance of evaluating data sources and expanding data portfolios for maximizing application value while cautioning against unintended consequences of big data. Upcoming webinars on topics like AI, natural language processing, and IoT are also highlighted.

1. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Sense and Sensors - From Perception to Personality
Adrian Bowles, PhD
Founder, STORM Insights, Inc.
info@storminsights.com

2. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Sensor…
A device that detects the presence of a signal
and reports/signals data about that signal/event
Sensors are Event-driven
May be Stationary or Mobile

3. Sensors
Algorithms
Data
Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
AlgorithmsSignal Sensors
Insights
Noise

4. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

5. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

6. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

7. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

8. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
How We Imagine & Implement the User Interface Constrains HCI

9. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
How We Imagine & Implement the User Interface Constrains HCI
Batch
Command Line
GUI
Gestures
Input Output
Human
Machine Batch
Streams

10. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
CCTV SmartPhone
Traffic
Counter Fitbit
Data
Complexity
Stationary Mobile
Low
High
Weather
Station
Telematic
Device

11. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
In the news…

12. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

13. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

14. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

15. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

16. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

17. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

18. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

19. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Alex Coppel / Herald Sun/Getty Images
Fernando Alonso Walks Away from a 46G Impact

20. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

21. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Sensors in Your Smartphone (iPhone example)
Type Typical Current Use Potential Use
Accelerometer/motion
Rotate screen, Switch screen to
landscape/portrait
Ambient Light Adjust screen brightness
Barometer Measure altitude
Geo-Location (wifi/cellular) Location/Alerts
3-Axis Gyroscope Rotation rate for games, VR…
Proximity
Turn off screen when phone is by
your head
Touch ID fingerprint Security

22. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

23. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

24. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

25. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

26. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

27. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

28. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
So your phone/app knows your
Location
Acceleration
.
.
.
.
Motivation?
Motivation
reflection
inference
Natural Cognitive Processes
deduction
reasoning
Learning
Perception

29. Narrative Generation
Voice/NLP
Video/Images
Gestures
Emotions
Text/NLP
• Affectiva
• BeyondVerbal
• Emotient Apple!
• Nviso
• Gridspace
• IBM
• Maluuba
• Nuance
• PopupArchive
• Skymind
• Viv Labs
• Wit.ai
• ABBYY
• Altilia
• Cortical.io
• IBM
• Kaypok
• Luminoso
• Maluuba
• Wit.ai
• APX Labs
• BRS Labs
• Clarifai
• Dextro
• Madbits (twitter)
• Mindops
• Skymind
• Teradeep
• Visenze
• Narrative Science
• OnlyBoth
• APX Labs
• EyeSight
• LeapMotion
• Nod
• Intel
Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Analytics/Visualization
• 1010data
• Adatao
• Alpine Data Labs
• Alteryx
• Altilia
• Angoss
• Attivio
• Birst
• Civis Analytics
• ClearStoryData
• Connotate
• Context Relevant
• Dataiku
• Datameer
• Emerald Logic
• Finch Computing
(was Synthos)
• First Rain
• ForeSee
• Fractal Analytics
• Guavus
• IBM
• indico
• KNIME
• KXEN (SAP)
• LiftIgniter
• MathWorks (Matlab)
• Microsoft
• Mu Sigma Nara Logics
• NuTonian
• Opera Solutions
• Oracle
• Palantir
• Pentaho
• Prediction IO
• Predixion
• Qliktech
• Quid
• Rapid Miner
• Revolution Analytics(MSFT)
• Salford Systems
• SAP
• SAS Institute
• SiSense
• Spark Beyond
• Spotfire (Tibco)
• StatSoft (Dell)
• Teradata
• Versium
• Wolfram Mathematica
• Yhat
Data Management
• Actian
• Aerospike
• Alation
• Basho
• Caspio
• Cognizant Technology
• Couchbase
• CrowdFlower
• CumuLogic
• Data Bricks
• DataRPM
• DataStax
• DataWeb, Inc.
• DDN
• diffbot
• GigaSpaces
• GridGain
• Hortonworks
• IBM
• import io
• kimono
• MapR
• MarkLogic
• MongoDB
• NeoTechnology
• Oracle
• Paxata
• RainStor
• SAP
Alt/Neuromorphic
Hardware
• Artificial Learning
• DWave
• HRL Laboratories
• IBM
• Nervana Systems
• Nvidia
• Qualcomm
• Teradeep

30. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Sentiment/Emotion Analysis
vs
Theme/Concept Analysis

31. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.Source: IBM Bluemix June 9, 2016

32. GestureRecognition/Analytics
Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

33. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
EmotionRecognition/Analytics

34. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
My Results
on the
Affectiva Demo
Affectiva: 7 Emotions
Anger
Sadness
Disgust
Joy
Surprise
Fear
Contempt

35. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.

36. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Sense and Sensors - Findings & Recommendations

37. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Sometimes the wisdom of crowds
leads to
Unintended Consequences
Findings & Recommendations

38. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
According to MaxMind…
This farm is home to
600,000,000 IP Addresses
Watch Out for Unintended Consequences,
Especially With Big Data
Findings & Recommendations

39. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Where there are sensors,
there are data.
Where there are data, there
should be sensors.
Findings & Recommendations
More applications create more
value for data, more data create
more value for applications.
Evaluate all data sources for
new applications, always look
to expand your data portfolio.

40. For more information:
Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
adrian@storminsights.com
Twitter @ajbowles
Skype ajbowles
Upcoming Webinar Dates & Topics
July 13 Modern AI & the Future of Work
August 11 Advances in Natural Language Processing
September 8 Autonomous Systems, from Science Fiction to Commercial Solutions
October 13 Deep QA (Question/Answer) - Lessons From Watson and Jeopardy!
November 10 Emerging Hardware Choices for Modern AI Data Management
December 8 Leverage the IOT to Build a Smart Data Ecosystem