Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
7-Step Big Data Journey
for Enterprises
1www.BigDataTrunk.com
www.BigDataTrunk.com
Raju Shreewastava
Engineer/Architect by Profession
Teacher at Heart
Artist in Soul
2
Working : Big Da...
www.BigDataTrunk.com 3
www.BigDataTrunk.com
1. Ask Why?
4
www.BigDataTrunk.com
1. Ask Why? – Typical Reasons
5
C-staff Competition Big data Problem
www.BigDataTrunk.com
Three Real Reasons
6
7
8
www.BigDataTrunk.com
Next Frontier
Artificial Intelligence Internet of Things ( IOT)
9
www.BigDataTrunk.com
STEP 1) Tips – Needs Commitment
a) Marathon
b) Business Driven
c) Not Free or Cheap
10
www.BigDataTrunk.com 11
www.BigDataTrunk.com 12
Blog Post : https://www.linkedin.com/pulse/open-source-different-beast-raju-shreewastava?trk=prof-...
www.BigDataTrunk.com 13
14
LearnabilityProcess
SME
15
Vacancy -Super Hero Engineer Needed
Hadoop, Hive ,Pig …
Spark
HBase, Cassandra,
MongoDB, or other NoSQL
Technology
Java...
16
Big Data Architect
New Hires
Engineers
Existing Staff
Engineers
Scrum Master
QA
SME..
www.BigDataTrunk.com 17
STEP 2) Tips – Change is the only Constant
a) Modular Design
b) Learnability
c) Hire Full team
www.BigDataTrunk.com 18
19
www.BigDataTrunk.com 20
www.BigDataTrunk.com
 Public Cloud
 Private Cloud
 Hybrid
21
www.BigDataTrunk.com
Agility
Cost
Maintenance
Scalability
22
www.BigDataTrunk.com
Security
Volume
Industry – Compliance
23
www.BigDataTrunk.com 24
STEP 3) Tips – Considerations to Cloud
a) Industry/Compliance
b) Company Strategy
c) Project Needs
www.BigDataTrunk.com 25
www.BigDataTrunk.com 26
www.BigDataTrunk.com
Common Services
27
Packaging Support Training
www.BigDataTrunk.com
4. Key Differentiators
Cloudera Hortonworks MapR Amazon EMR
Developing
Tools
• Cloudera
Manager
• Ima...
www.BigDataTrunk.com 29
STEP 4) Tips – Selection
a) Apache Hadoop is Mother
b) Align with Company Strategy
Apache Hadoop
www.BigDataTrunk.com 30
STEP 5. Take Test Drive (Pilot , not just POC)
www.BigDataTrunk.com
POC Vs Pilot
POC Pilot
• Will this technology meet our needs?
• Will this product perform as advertis...
www.BigDataTrunk.com 32
STEP 5) Tips – Take the plunge
a) First Use Case
b) Trial and Error
www.BigDataTrunk.com 33
www.BigDataTrunk.com
Big data is here to Stay
Focus on Business Value
Don’t underestimate Data Integration
Hiring is a...
www.BigDataTrunk.com 35
STEP 6) Tips – Adaptation
a) R&D – New technology
b) 6 months review
www.BigDataTrunk.com 36
Taking to the Enterprise Level
www.BigDataTrunk.com
7. Taking to the Enterprise (Tips)
Governance Monitoring
Usage Analysis Automation
Enterprise Scale
37
www.BigDataTrunk.com
1. Ask Why?
2. Build Team
3. To cloud or
Not?
4. Pick your
distribution
5. Perform a
pilot
6. Fail , ...
www.BigDataTrunk.com 39
slideshare.net/RajuShreewastavaPMP
www.BigDataTrunk.com 40
www.BigDataTrunk.com
Thank you
41
Upcoming SlideShare
Loading in …5
×

7 Steps Big Data Journey for Enterprises

1,368 views

Published on

Big data is being implemented or on the mind of majority of the enterprises. Though getting into Big data is neither cheap nor a easy task. Having a step-by-step path for this journey based on experience from other implementation play a crucial role in the success of the initiative. This session provide a 7 Steps Big Data Journey for Enterprises based on past successful implementations.

Published in: Data & Analytics
  • Be the first to comment

7 Steps Big Data Journey for Enterprises

  1. 1. 7-Step Big Data Journey for Enterprises 1www.BigDataTrunk.com
  2. 2. www.BigDataTrunk.com Raju Shreewastava Engineer/Architect by Profession Teacher at Heart Artist in Soul 2 Working : Big Data Consulting and Training
  3. 3. www.BigDataTrunk.com 3
  4. 4. www.BigDataTrunk.com 1. Ask Why? 4
  5. 5. www.BigDataTrunk.com 1. Ask Why? – Typical Reasons 5 C-staff Competition Big data Problem
  6. 6. www.BigDataTrunk.com Three Real Reasons 6
  7. 7. 7
  8. 8. 8
  9. 9. www.BigDataTrunk.com Next Frontier Artificial Intelligence Internet of Things ( IOT) 9
  10. 10. www.BigDataTrunk.com STEP 1) Tips – Needs Commitment a) Marathon b) Business Driven c) Not Free or Cheap 10
  11. 11. www.BigDataTrunk.com 11
  12. 12. www.BigDataTrunk.com 12 Blog Post : https://www.linkedin.com/pulse/open-source-different-beast-raju-shreewastava?trk=prof-post
  13. 13. www.BigDataTrunk.com 13
  14. 14. 14 LearnabilityProcess SME
  15. 15. 15 Vacancy -Super Hero Engineer Needed Hadoop, Hive ,Pig … Spark HBase, Cassandra, MongoDB, or other NoSQL Technology Java, Python, or Scala Kafka Apache Phoenix Cloud - AWS/Azure/Google Solr or Elastic Search
  16. 16. 16 Big Data Architect New Hires Engineers Existing Staff Engineers Scrum Master QA SME..
  17. 17. www.BigDataTrunk.com 17 STEP 2) Tips – Change is the only Constant a) Modular Design b) Learnability c) Hire Full team
  18. 18. www.BigDataTrunk.com 18
  19. 19. 19
  20. 20. www.BigDataTrunk.com 20
  21. 21. www.BigDataTrunk.com  Public Cloud  Private Cloud  Hybrid 21
  22. 22. www.BigDataTrunk.com Agility Cost Maintenance Scalability 22
  23. 23. www.BigDataTrunk.com Security Volume Industry – Compliance 23
  24. 24. www.BigDataTrunk.com 24 STEP 3) Tips – Considerations to Cloud a) Industry/Compliance b) Company Strategy c) Project Needs
  25. 25. www.BigDataTrunk.com 25
  26. 26. www.BigDataTrunk.com 26
  27. 27. www.BigDataTrunk.com Common Services 27 Packaging Support Training
  28. 28. www.BigDataTrunk.com 4. Key Differentiators Cloudera Hortonworks MapR Amazon EMR Developing Tools • Cloudera Manager • Imapala Staying Open Source Developing Open Source tools • Ambari Proprietary route E.g. MapRFS High Avalability Cloud Offering Integration to other AWS Services 28
  29. 29. www.BigDataTrunk.com 29 STEP 4) Tips – Selection a) Apache Hadoop is Mother b) Align with Company Strategy Apache Hadoop
  30. 30. www.BigDataTrunk.com 30 STEP 5. Take Test Drive (Pilot , not just POC)
  31. 31. www.BigDataTrunk.com POC Vs Pilot POC Pilot • Will this technology meet our needs? • Will this product perform as advertised? • Will the prospective end user communities be productive with the new way of doing things? • Will the ultimate solution be feasible? • Detailed Architectural Design based on an assessment of business and technical requirements • Environment build and configuration • Infrastructure testing to validate failover, high availability, and possibly scalability • User testing and iterative feedback to optimize the user experience • Documentation or training for pilot users and the help desk 31
  32. 32. www.BigDataTrunk.com 32 STEP 5) Tips – Take the plunge a) First Use Case b) Trial and Error
  33. 33. www.BigDataTrunk.com 33
  34. 34. www.BigDataTrunk.com Big data is here to Stay Focus on Business Value Don’t underestimate Data Integration Hiring is a Big Challenge Be ready to Re-invent yourself 34
  35. 35. www.BigDataTrunk.com 35 STEP 6) Tips – Adaptation a) R&D – New technology b) 6 months review
  36. 36. www.BigDataTrunk.com 36 Taking to the Enterprise Level
  37. 37. www.BigDataTrunk.com 7. Taking to the Enterprise (Tips) Governance Monitoring Usage Analysis Automation Enterprise Scale 37
  38. 38. www.BigDataTrunk.com 1. Ask Why? 2. Build Team 3. To cloud or Not? 4. Pick your distribution 5. Perform a pilot 6. Fail , Learn and Improve 7. Take it to the Enterprise 38
  39. 39. www.BigDataTrunk.com 39 slideshare.net/RajuShreewastavaPMP
  40. 40. www.BigDataTrunk.com 40
  41. 41. www.BigDataTrunk.com Thank you 41

×