Building an Enterprise PaaS

623 views

Published on

Video and slides synchronized, mp3 and slide download available at URL http://bit.ly/1mHE5qu.

Dave McCrory discusses what it takes to build an Enterprise Platform as a Service, covering data services, core application capabilities and design principles, CI, monitoring, coding standards, dependencies, security, and deployment. Filmed at qconnewyork.com.

Dave McCrory most recently served as SVP of engineering at Warner Music Group, where he led over 100 engineers building the company's new Digital Services Platform, based on an open source enterprise platform as a service. His extensive experience in the cloud and virtualization industry included positions as a senior architect in Cloud Foundry while at VMware and as a cloud architect at Dell.

Published in: Technology
0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
623
On SlideShare
0
From Embeds
0
Number of Embeds
9
Actions
Shares
0
Downloads
0
Comments
0
Likes
2
Embeds 0
No embeds

No notes for slide

Building an Enterprise PaaS

  1. 1. Building an Enterprise PaaS Dave McCrory - CTO
  2. 2. InfoQ.com: News & Community Site • 750,000 unique visitors/month • Published in 4 languages (English, Chinese, Japanese and Brazilian Portuguese) • Post content from our QCon conferences • News 15-20 / week • Articles 3-4 / week • Presentations (videos) 12-15 / week • Interviews 2-3 / week • Books 1 / month Watch the video with slide synchronization on InfoQ.com! http://www.infoq.com/presentations /warner-enterprise-paas
  3. 3. Presented at QCon New York www.qconnewyork.com Purpose of QCon - to empower software development by facilitating the spread of knowledge and innovation Strategy - practitioner-driven conference designed for YOU: influencers of change and innovation in your teams - speakers and topics driving the evolution and innovation - connecting and catalyzing the influencers and innovators Highlights - attended by more than 12,000 delegates since 2007 - held in 9 cities worldwide
  4. 4. Who am I?
  5. 5. Why am I up here?
  6. 6. What the PaaS? http://www.nytimes.com/2013/07/16/business/last-car-plant-brings-detroit-hope-and-cash.html Fabrizio Costantini for The New York Times
  7. 7. Agility • Agile (Not SCRUM or Kanban) • Transparency • The Business • Transformation • Communication
  8. 8. Competency Silos • Development/Engineering • Operations • Process • Business • DATA • Management
  9. 9. Coordinating Teams Epics Stories Backlogs Dependencies Interdependencies Platform Operations Application Development Product Management Business Owners Product Owners Testing SMEs
  10. 10. CI/CD&D Continuous Integration, Continuous Delivery and Deployment Git/Github CI Environment (Cloud Foundry) Staging Production Scale and Stress Testing
  11. 11. Deploy Early and Often
  12. 12. The Platform • Cloud Foundry Based • Enhanced • Security • Audit • Services • Development • Deployment • BOSH Used
  13. 13. More Platform Detail Cluster & Replicated Storage Object Storage Clustered Search Graph Database Cache Message Bus Robust and Unified Logging Audit Master Data Management Big Data Cloud Foundry BOSH Ruby/Node HTML5/CSS Javascript Java/Spring Scala/Akka Lots of Automation Monitoring
  14. 14. A The Services Problem Contact Service Cluster & Replicated Storage Contact Service Contact Service B 1 2
  15. 15. A The Services Problem Common Contact Service Cluster & Replicated Storage App 1 Contact Service App 2 Contact Service B 1 2
  16. 16. A bit more about Services Cluster & Replicated Storage Service API Wrapper
  17. 17. Not on our Infrastructure!
  18. 18. Let’s talk about Apps
  19. 19. User Interface • You need a team • Repeatable and Reusable • Performance • Responsive • Any modern Device • Any modern Browser
  20. 20. UI Standards Mocking Tools Formats Styling Fonts Colors Templates (Bootstrap/etc) Libraries “Widgets” Modularity Simplicity Single Store
  21. 21. The Frontend • Ruby/Node • Versioning • Approved Libraries • Automate (i.e. Grunt) • Custom Libraries standardizing Service Consumption • Speed/Responsiveness is king Applications (Web Based)
  22. 22. Beware Licenses Performance vs Resource Consumption Synchronous vs Asynchronous Failure to Externalize Logic Security and Data Access Single Threading/Blocking Code Poor or No Unit Tests Late Integration Testing
  23. 23. The Backend • You need an operations team • Elasticity • Performance • Redundancy / Backups • Service Oriented • Distributed Systems Expertise required • Infrastructure is there like it or not Services (Data Wrappers, Synchronization, Logic, Derivatives) Platform Capabilities (Clusters, Runtime Environments)
  24. 24. Lessons Learned Infrastructure is your lifeblood (This includes connectivity) Primitives, Services, Applications, UI Enterprise Developers can say they get Cloud Services (they don’t) Frameworks are required Don’t be afraid to fail, just do it quickly Be careful in what OSS you bet on Avoid IaaS Lock-in Data Gravity is a B**ch
  25. 25. Data! I thought we were Friends! :-(
  26. 26. Legacy Data New Data Iceberg
  27. 27. Legacy Data You
  28. 28. Legacy Data What does it look like? Formats Schemas Dirty Data Inconsistency Outdated formats
  29. 29. Dirty Data Q: How does it get that way? Errors/Typos Duplicates/Failed Merges Conflicts Incompatibility Incorrect Formulas/Logic Wrong Mappings Carelessness Unstructured/Non-Human Readable A: No Curation from Apps or People
  30. 30. Master Data Management to the Rescue! Or NOT!
  31. 31. Let’s Pretend
  32. 32. New DataLegacy Data
  33. 33. New DataLegacy Data Master Data Legacy Data Legacy Data Synch Synch Synch Synch Synch
  34. 34. New DataLegacy Data Master Data Legacy Data Legacy Data Waiting Waiting Waiting Waiting Waiting
  35. 35. New DataLegacy Data Synch Service
  36. 36. What does the end-state look like?
  37. 37. Platform Capabilities (Clusters, Runtime Environments) Infrastructure (as a Service) Services (Data Wrappers, Synchronization, Logic, Derivatives) Applications (Web Based) Data (What you really care about) Automation Security, Audit, Logging, Monitoring, Management, Testing, Integration
  38. 38. Questions?
  39. 39. Thank You! @mccrory
  40. 40. Watch the video with slide synchronization on InfoQ.com! http://www.infoq.com/presentations/warner- enterprise-paas

×