Background: I prepared this slide deck for a couple of “Big Data 101” guest lectures I did in February 2013 at New York University’s Stern School of Business and at The New School. They’re intended for a college level, non technical audience, as a first exposure to Big Data and related concepts. I have re-used a number of stats, graphics, cartoons and other materials freely available on the internet. Thanks to the authors of those materials.

1. Big data, big deal?
February 2013
Matt Turck
Twitter: @mattturck
Blog: http://mattturck.com

2. Background: I prepared this slide deck for a couple of
“Big Data 101” guest lectures I did in February 2012 at
New York University’s Stern School of Business and at
The New School. They’re intended for a college
level, non technical audience, as a first exposure to Big
Data and related concepts. I have re-used a number of
stats, graphics, cartoons and other materials freely
available on the internet. Thanks to the authors of those
materials.

3. What does Target know about
pregnant women?

4. Hype
Data is…
"the new gold”
“the new black”
“the new plastic”
"the new oil”
“the new frontier”

5. Isn’t it what computers have always
done?

6. What’s different this time?
Volume.
Variety.
Velocity.

8. Facebook warehouses 180 petabytes
of data a year

9. Twitter manages 1.2 million deliveries
per second

10. New sources of data

11. Twitter manages 1.2 million deliveries
per second

12. Open Government Data

13. Big data is data that exceeds the
processing capacity of conventional
database systems. The data is too
big, moves too fast, or doesn’t fit the
strictures of your database
architectures. To gain value from this
data, you must choose an alternative
way to process it.
Edd Dumbill, O’Reilly

14. A new breed of technologies

15. Big Data Landscape
Infrastructure Analytics Applications
NoSQL Databases Hadoop Related Analytics Solutions Data Visualization Ad Optimization
Publisher Marketing
NewSQL Databases
Statistical Computing Tools
Social Media
MPP Databases Management / Cluster Services
Industry Applications
Monitoring
Sentiment Analysis Analytics Services
Security
Application Service Providers
Location / People /
Big Data Search
Events
Storage
IT Analytics Data Sources
Crowdsourcing
Data Data Sources
Collection / Real- Crowdsourced SMB Analytics Marketplaces
Transport Time Analytics
Cross Infrastructure / Analytics Personal Data
Open Source Projects
Framework Query / Data Data Access Coordination / Real - Statistical Machine Cloud
Flow Workflow Time Tools Learning Deployment
Matt Turck (@mattturck) and Shivon Zilis (@shivonz)

16. A new breed of people:
Data scientists
engineering
math
nerds
nerds nerds
nerds
comp sci
hacking
awesome nerds
Credit: Hilary Mason, Bitly

17. Sexy nerds?
“Data Scientist:
The Sexiest Job of the 21st Century”
October 2012

18. Nerd talent shortage

19. Terms worth remembering
Structured vs. unstructured data
Hadoop
Cloud computing
Data visualization
Machine learning
Predictive analytics

20. So what do you do with all that
technology?

21. Lending

22. Trading

23. Insurance

24. Agriculture

25. Healthcare

26. Energy

27. Music

28. Education

29. But what about small data?

30. Moneyball is (relatively) small data

31. Nate Silver is (relatively) small data

32. Most companies only have small data

33. It’s not about big data
for the sake of big data

34. Data-driven management
“In God we trust. Everyone else, bring data”

35. Data-driven culture

36. Easier than ever for any business to be
truly data-driven

37. Thanks!
Learn more:
NYC Data Business Meetup
meetup.com/NYC-Data-Business-Meetup/