Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Design Thinking
to Jumpstart Your Big Data Projects
© 2016 Datameer, Inc. All rights reserved.
© 2016 Datameer, Inc. All rights reserved.
Problem
“Through 2018, 90% of deployed data lakes will be useless as they are
o...
© 2016 Datameer, Inc. All rights reserved.
Big Data Project Plan
Hire Chief Data Officer

Catalog All Data

Evaluate Big Dat...
© 2016 Datameer, Inc. All rights reserved.
Moore’s Law
© 2016 Datameer, Inc. All rights reserved.
Gordon Moore
© 2016 Datameer, Inc. All rights reserved.
Moore's Law (Ops / Sec / $1000)
10^4
10^6
10^8
10^10
10^12
10^14
10^16
10^2
0
1...
© 2016 Datameer, Inc. All rights reserved.
Acceleration of Innovation
© 2016 Datameer, Inc. All rights reserved.
Ray Kurzweil
© 2016 Datameer, Inc. All rights reserved.
Acceleration of Innovation
10^4
10^6
10^8
10^10
10^12
10^14
10^16
10^2
0
Stone
...
© 2016 Datameer, Inc. All rights reserved.
Acceleration of Complexity
Core Hadoop
HDFS, MR
2006
HBase
ZooKeeper
Core Hadoo...
© 2016 Datameer, Inc. All rights reserved.
Flow
© 2016 Datameer, Inc. All rights reserved.
Albert Einstein
“That is the way to learn the most, 

that when you are doing s...
© 2016 Datameer, Inc. All rights reserved.
Mihaly Csikszentmihalyi
© 2016 Datameer, Inc. All rights reserved.
Flow
Challenge
Skill
Boredom
Anxiety
© 2016 Datameer, Inc. All rights reserved.
Compute Power and Lower Barrier to Entry
© 2016 Datameer, Inc. All rights reserved.
Barrier
© 2016 Datameer, Inc. All rights reserved.
Barrier in Analytics
Schema Reporting
“Schema on Write”
ETL
© 2016 Datameer, Inc. All rights reserved.
Remove Barrier
HadoopRaw Load View
“Schema on Read”
© 2016 Datameer, Inc. All rights reserved.
Analytics at the Speed of Thought
Traditional Schema-on-write
A new “mold”/mode...
© 2016 Datameer, Inc. All rights reserved.
Design Thinking
© 2016 Datameer, Inc. All rights reserved.
Tim Brown, CEO, IDEO
“Design thinking is a human-centered approach
to innovatio...
© 2016 Datameer, Inc. All rights reserved.
Design Thinking
© 2016 Datameer, Inc. All rights reserved.
Design Thinking
Empathize
Define
Ideate
Prototype
Test
Use Cases, 

Requirements...
© 2016 Datameer, Inc. All rights reserved.
Iterative Analytics
Democratize Analytics
People Who Can Use Big Data
People Who Should Use Big Data
© 2016 Datameer, Inc. All rights reserved.
Problem
“Prioritize Incremental Improvements Over Business Transformation.“
© 2016 Datameer, Inc. All rights reserved.
#Win
Big Data Project Plan
Hire Chief Growth Officer

Identify Use Cases

Impleme...
© 2016 Datameer, Inc. All rights reserved.
Thank You!
Upcoming SlideShare
Loading in …5
×

Big Data Day LA 2016/ Use Case Driven track - How to Use Design Thinking to Jumpstart Your Big Data Projects?, Peter Reale, Solutions Engineer, Datameer

478 views

Published on

There is a novel approach to identifying big data use cases, one which will ultimately lower the barrier to entry to big data projects and increase overall implementation success. This talk describes the approach used by big data pioneer and Datameer CEO Stefan Groschupf to drive over 200 production implementations.

Published in: Technology
  • Be the first to comment

Big Data Day LA 2016/ Use Case Driven track - How to Use Design Thinking to Jumpstart Your Big Data Projects?, Peter Reale, Solutions Engineer, Datameer

  1. 1. Design Thinking to Jumpstart Your Big Data Projects © 2016 Datameer, Inc. All rights reserved.
  2. 2. © 2016 Datameer, Inc. All rights reserved. Problem “Through 2018, 90% of deployed data lakes will be useless as they are overwhelmed with information assets captured for uncertain use cases.”
  3. 3. © 2016 Datameer, Inc. All rights reserved. Big Data Project Plan Hire Chief Data Officer Catalog All Data Evaluate Big Data Stack Build Data Lake Transform Business to Data Driven #Fail
  4. 4. © 2016 Datameer, Inc. All rights reserved. Moore’s Law
  5. 5. © 2016 Datameer, Inc. All rights reserved. Gordon Moore
  6. 6. © 2016 Datameer, Inc. All rights reserved. Moore's Law (Ops / Sec / $1000) 10^4 10^6 10^8 10^10 10^12 10^14 10^16 10^2 0 1950 1955 1960 1965 1970 1975 1980 1985 1990 1995 2000 2005 2010 2015 2020 2025 Dec PDP 1 Altair 8800 Pentium Core i7 Quad Core 2 Duo Compaq Deskpro 386 Apple 2
  7. 7. © 2016 Datameer, Inc. All rights reserved. Acceleration of Innovation
  8. 8. © 2016 Datameer, Inc. All rights reserved. Ray Kurzweil
  9. 9. © 2016 Datameer, Inc. All rights reserved. Acceleration of Innovation 10^4 10^6 10^8 10^10 10^12 10^14 10^16 10^2 0 Stone Age 1950 1955 1960 1965 1970 1975 1980 1985 1990 1995 2000 2005 2010 2015 2020 2025 Dec PDP 1 Altair 8800 Pentium Core i7 Quad Core 2 Duo Compaq Deskpro 386 Apple 2
  10. 10. © 2016 Datameer, Inc. All rights reserved. Acceleration of Complexity Core Hadoop HDFS, MR 2006 HBase ZooKeeper Core Hadoop 2008 Hive Pig Mahout HBase ZooKeeper Core Hadoop 2009 Sqoop Whirr Avro Hive Pig Mahout HBase ZooKeeper Core Hadoop 2010 Flume Bigtop Oozie MRUnit HCatalog Sqoop Whirr Avro Hive Pig Mahout HBase ZooKeeper Core Hadoop 2011 Spark Impala Solr Kafka Flume Bigtop Oozie MRUnit HCatalog Sqoop Whirr Avro Hive Pig Mahout HBase ZooKeeper Core Hadoop 2012 Storm Parquet Sentry Spark Impala Solr Kafka Flume Bigtop Oozie MRUnit HCatalog Sqoop Whirr Avro Hive Pig Mahout HBase ZooKeeper Core Hadoop 2013 Flink Drill Ranger Ambari Ignite Storm Parquet Sentry Spark Impala Solr Kafka Flume Bigtop Oozie MRUnit HCatalog Sqoop Whirr Avro Hive Pig Mahout HBase ZooKeeper Core Hadoop 2014 Samza Kudu Samsara Atlas Apex NiFi Flink Drill Ranger Ambari Ignite Storm Parquet Sentry Spark Impala Solr Kafka Flume Bigtop Oozie MRUnit HCatalog Sqoop Whirr Avro Hive Pig Mahout HBase ZooKeeper Core Hadoop Present
  11. 11. © 2016 Datameer, Inc. All rights reserved. Flow
  12. 12. © 2016 Datameer, Inc. All rights reserved. Albert Einstein “That is the way to learn the most, 
 that when you are doing something with such enjoyment that you don’t notice the time passes.”
  13. 13. © 2016 Datameer, Inc. All rights reserved. Mihaly Csikszentmihalyi
  14. 14. © 2016 Datameer, Inc. All rights reserved. Flow Challenge Skill Boredom Anxiety
  15. 15. © 2016 Datameer, Inc. All rights reserved. Compute Power and Lower Barrier to Entry
  16. 16. © 2016 Datameer, Inc. All rights reserved. Barrier
  17. 17. © 2016 Datameer, Inc. All rights reserved. Barrier in Analytics Schema Reporting “Schema on Write” ETL
  18. 18. © 2016 Datameer, Inc. All rights reserved. Remove Barrier HadoopRaw Load View “Schema on Read”
  19. 19. © 2016 Datameer, Inc. All rights reserved. Analytics at the Speed of Thought Traditional Schema-on-write A new “mold”/model for every application Datameer Schema-on-read New applications without re-tooling/re-modeling
  20. 20. © 2016 Datameer, Inc. All rights reserved. Design Thinking
  21. 21. © 2016 Datameer, Inc. All rights reserved. Tim Brown, CEO, IDEO “Design thinking is a human-centered approach to innovation that draws from the designer's toolkit to integrate the needs of people, the possibilities of technology, and the requirements for business success.”
  22. 22. © 2016 Datameer, Inc. All rights reserved. Design Thinking
  23. 23. © 2016 Datameer, Inc. All rights reserved. Design Thinking Empathize Define Ideate Prototype Test Use Cases, 
 Requirements, Barriers Use Case Implementation Prototype Analytics Validate ROI Define Use Cases, ROI Rinse and Repeat
  24. 24. © 2016 Datameer, Inc. All rights reserved. Iterative Analytics
  25. 25. Democratize Analytics People Who Can Use Big Data People Who Should Use Big Data
  26. 26. © 2016 Datameer, Inc. All rights reserved. Problem “Prioritize Incremental Improvements Over Business Transformation.“
  27. 27. © 2016 Datameer, Inc. All rights reserved. #Win Big Data Project Plan Hire Chief Growth Officer Identify Use Cases Implement Use Case Prototype Implement MVP Incrementally Expand Use Cases and Platform
  28. 28. © 2016 Datameer, Inc. All rights reserved. Thank You!

×