1. DATA
SCIENCE *
PROJECT
KEVIN BLUER

2. DSRUPTION
http://www.dsruption.com/

3. TRENDS
TECHNOLOGY
http://www.dsruption.com/trend/wearable-computing

4. GOALS
Derive Insight from Dsruption
(www.dsruption.com)
Focus on establishing company (startup)
momentum & insights
#1 Article popularity (FB / Twitter shares)
#2 Auto generation of article tags

5. FEATURES
dsruption.activity, 691 documents (744 KB)
dsruption.articles, 14022 documents (125.61 MB)
dsruption.comment, 43 (40 KB)
dsruption.companies, 524 (3.65 MB)
dsruption.tags, 329 (40 KB)
dsruption.trends, 32 (140 KB)
dsruption.users, 39 (632 KB)

6. TECHNOLOGIES
MongoDB
JavaScript and Node.js
D3.js
Hadoop
Python
Facebook and Twitter API’s

7. ARTICLE POPULARITY

8. IMPORTING
TWEETS & SHARES
http://www.dsruption.com/dwolla/json-social

9. SIMPLE D3.JS
VISUALIZATION
http://www.dsruption.com/dwolla/visualize

10. COMPANY TAGS
FROM ARTICLES

11. HADOOP -> MONGO
http://www.dsruption.com/dwolla/articles
http://www.dsruption.com/data/dwolla.json

12. BEAUTIFUL SOUP
<p><ul><li><span style="font-family: arial;"><i>100,000 refrigerators
and freezers have now made their way through the revolutionary
UNTHA Recycling Technology system</i></span></li><li><span
style="font-family: arial;"><i>Innovative recycling system reduces
landfill waste and greenhouse gas and ozone-depleting substance
emissions</i></span></li><li><span style="font-family:
arial;"><i>Initiative has diverted 5.5 million pounds of material from
U.S. landfills<b><a href="#_ftn1"
name="_ftnref1">[1]</a></b></i></span></li></ul> </p><p
style="text-indent: -
0.25in;"><i><b><br/><br/></b></i></p><p><div><br/><div id="ftn1">
</div> </div></p>
100,000 refrigerators and freezers have now made their way through
the revolutionary UNTHA Recycling Technology systemInnovative
recycling system reduces landfill waste and greenhouse gas and
ozone-depleting substance emissionsInitiative has diverted 5.5
million pounds of material from U.S. landfills.

13. LOTS OF
NOISE
http://www.dsruption.com/dwolla/words

14. EXCLUDE NOISE
count: 252, word: "Dwolla”
count: 73, word: "money”
count: 45, word: "photo”
count: 44, word: "people”
count: 42, word: "pay”
count: 39, word: "payment”
count: 35, word: "payments”
count: 34, word: "business"

15. WHAT’S NEXT?
Sentiment Analysis (both on the articles / comments)
Integration of Additional Datasets (Crunchbase, etc)
Broader Visualization

16. THANK YOU 