Generative AI for Social Good at Open Data Science East 2024
Qubole State of the Big Data Industry
1. State of the Big Data Industry
For the AWS LOFT
September 17, 2015
2. Age
3
How old are you?
Under 25
26 to 35
36 to 45
46 to 55
56 to 65
Over 65
Prefer not to say
3. Roles
4
What is your job function?
CIO/CTO/Director of IT/Network/Security
IT/Network/Security Administration
Application Development
Business Analyst
Data Scientist
Business Operations
Product Management
Sales and Marketing Management
Sales and Marketing Operations
Customer Support
Senior Management
Other (please specify)
4. Industry
5
Which of the following
best describes your industry?
Accounting
Banking, Finance, and Insurance
Computer Hardware or Software
Construction
Education
Government and Public Administration
Health Care
Legal
Manufacturing
Media and Entertainment
Real Estate
Retail
Telecommunications
Transportation and Warehousing
Professional &Technical Services
Other (please specify)
8. Current and Planned Tools
9
0.0%
10.0%
20.0%
30.0%
40.0%
50.0%
60.0%
70.0%
80.0%
Hadoop
MapReduce
iPython
Pig
Spark
Storm
Presto
R
TalendOpenStudio
Pentaho
Tableau
QlikView
Microstrategy
Redshift
Cassandra
HBase
MongoDB
OtherNoSQL
Hive
Hana
Other(pleasespecify)
Engines, Languages and Tools
9. Data Patterns
10
0.0%
5.0%
10.0%
15.0%
20.0%
25.0%
30.0%
35.0%
What kind of Data?
Large volume, changes infrequently Large volume, growing rapidly
Large volume, analyzed in near real-time Data from multiple source systems
Multiple silos of data with significant potential overlap Other - please clarify your answer
10. Current and Planned Providers
11
0.0%
10.0%
20.0%
30.0%
40.0%
50.0%
60.0%
70.0%
AmazonAWS
MicrosoftAzure
GoogleCloud
HP
IBM
Oracle
Cloudera
Hortonworks
MapR
Pivotal
InfiniDB
Teradata
In-houseCustom
Development
Other(pleasespecify)
Rolled out now or planned for the next 2 years
11. Up next…
Big Data Platform at Pinterest
Mao Ye
The Right Tool for the Right Job on AWS
Praveen Seluka
12
Up next…