Morning talk given at Big Mountain Data Conference Oct 2014

1. Deep Learning &
Unstructured
Data
or why you should use ☺

2. ??

3. The problem of doing justice to the implicit, the imponderable, and the unknown is of course not unique in politics. It is always
with us in science, it is with us in the most trivial of personal affairs, and it is one of the great problems of writing and of all forms
of art. The means by which it is solved is sometimes called style. It is style
which complements affirmation with limitation and with humility; it is style which makes it possible
to act effectively, but not absolutely; it is style which, in the domain of foreign policy, enables us
to find harmony between the pursuit of ends essential to us, and the regard for the views, the sensibilities, the aspirations of
those to whom the problem may appear in another light; it is style which is the deference that action pays to uncertainty; it is
above all style through which power defers to reason.

4. Elements of style
From: David Gonzalez <davidbgonzalez@gmail.com>
Mime-Version: 1.0 (1.0)
Date: Mon, 6 Mar 2011 14:57:38 -0700
Delivered-To: davidbgonzalez@gmail.com
Message-ID: <4484555894252760987@unknownmsgid>
Subject: Should I take Friday off?
To: Mindy Gonzalez <******@gmail.com>
Content-Type: text/plain; charset=ISO-8859-1
We could go out early and maybe just get take-out for the kiddos?
??

5. data?

6. Gathering text

7. {u'message_id':
4484555894252760987, u’subject’:
'Should I take Friday off', u’body’: 'We
could go out early and maybe just get
take-out for the kiddos. n ??', u’
time_sent’: u’Mon, 6 Mar 2011 14:57:
38 -0700’, u'user_id': 1}
store

8. Options?
Lexicon
● Curated
● Easy to understand
● Often wrong
● Not great w/
novelty
NN-style
● More accurate
● Domain specific
● Not great w/
novelty

9. Optimize Response?

13. Optimize Sentiment?

21. Optimize Emotion?

22. Options?
Lexicon
?
Unsupervised
?

23. What counts?
Subjective vs
Objective statements
Polarity
+, ?, -

24. Sentiment “Lexicon”

25. Sentiment “Lexicon”

26. Emotional State

27. Emotional State?

30. Lexicon

34. Sponsors!