Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

How We Do DevOps at Walmart: OneOps OSS Application Lifecycle Management Platform


Published on

Recently, Dr. Qingsong Zhang spoke at a Meetup about how Walmart is using DevOps.

Within this slide deck, you'll learn about our DataOps, DevOps and OneOps, an application lifecycle management (ALM), and open source DevOps platform for cloud which was developed by Walmart Labs.

Feel free to follow us on Twitter: @one_ops!
Contribute to One_Ops:

Published in: Technology

How We Do DevOps at Walmart: OneOps OSS Application Lifecycle Management Platform

  1. 1. DevOps in Practice QINGSONG ZHANG, PH. D.
  2. 2. Something related to me Ph. D. Sr. IT Architect Software Manager Sr. DevOps Staff Sr. DevOps Manager
  3. 3. Outline • Internet  IoT • Information  Data • DevOps  DataOps • Why DevOps • How DevOps • DevOps inWalmart • From DevOps to DataOps • How DataOps
  4. 4. IoT 50 petabytes The Internet ofThings (IoT) is a system of interrelated computing devices, mechanical and digital machines, objects, animals or people that are provided with unique identifiersand the ability to transfer data over a network without requiring human-to- human or human-to-computer interaction. Connect, Monitor, Search, Manage, Control, Play 4000 Exabyte
  5. 5. Service / Information Intelligent/ Connected Systems Data service component in smart products driving increased value and differentiation Big Data Insights on new products by more efficiently interpreting massive quantities of data Cloud Demand for apps requires fast, scalable environments for dev and test, as well as production Instrumented Products Industry requirements demand faster response to regulations and standards, with traceability and quality Social Business Broader set of stakeholders collaborates to deliver continuous innovation and value Mobile Modern workforce expects constantly updated data to connect to enterprise systems Data
  6. 6. What is DevOps •Culture •Respect &Trust •Embrace Change •Transparent •Automation •Continuous integration (CI) and delivery (CD) •Infrastructure as code •Lean •Focus on producing value for end user •Small batch size •Measurement (Metrics) •Measure everything •Show the improvement •Sharing •Open information sharing •Collaboration & communication
  7. 7. Why do we need DevOps • Technical benefits: • Continuous software delivery • Less complex problems to fix • Faster resolution of problems • Business benefits: • Faster delivery of features • More stable operating environments • More time available to add value (rather than fix/maintain)
  8. 8. How to DevOps • Collaborative Development • Foster productive collaboration • lifecycle integrations • Development on the cloud for continuous delivery • ContinuousTesting • Enhanced integrations and capabilities to synchronize software testing with deployment and operations • Continuous Release and Deployment • Greater delivery speed and frequency for complex applications • Continuous Monitoring • Capabilities to improve service quality by monitoring application performance Agile development approach • It spans the entire lifecycle, includes business planning and creation to delivery and feedback. • Enable continuous delivery of software‐driven processes and innovation
  9. 9. Web Server App Server Database Internet/FirewallEnd Users Lan/network Web front-end Services Middleware Yesterday  Waterfall development  Weeks to provision  Static resources  Limited change windows  $100k+ of compute  Limited number of users, in business hours Now/Tomorrow  Agile development  Continuous deployment  Dynamic resourcing  Spans across data centers and clouds  Friction of compute costs  Millions of users with 24x7 access Private Public Public Web Server Message Q Database In Memory Cache App ServerApp Server
  10. 10. What about DataOps … Data is not only considered as an Asset FOR COMPETITIVE ADVANTAGE; but now a Strategic Asset for COMPETITIVE SURVIVAL …
  11. 11. Chief Information Officer Line of Business Executive Chief Data Officer Chief Analytics Officer Compliance Marketing Risk Chief Digital Officer
  12. 12. Chief Information Officer Devlopment (Software Engineering) Technology Operation Infrastructure Quality Assurance DevOps Definition: Collaboration between development, operations and quality assurance engineering across the entire application delivery pipeline --- from design and coding to testing and production support
  13. 13. Integration Chief Data Officer Acquisition Privacy Legal Security Quality DataOps Definition: A data management method that emphasize communication, collaboration, integration and automation of process between data engineers, data scientists and other data professionals
  14. 14. • Mission: To enable system developers and managers to handle modern, web- based application development and deployment. Infrastructure requirements: Need to support the quantity, performance demands and diversity of systems available to a modern enterprise --- from on-premise servers to hybrid clouds and container environments. • Mission: To enable data professionals to optimize for modern, web-based data storage and analytics. Infrastructure requirements: Needs to support highly scalable, highly available and diverse types of data and data storage environments.
  15. 15. Top 10 DevOps Companies
  16. 16. Mission Statement To help people save money so they can live better Goal Becoming an international brand Vison “If we work together, we’ll lower the cost of living for everyone … we’ll give the world an opportunity to see what it’s like to save and have a better life.” Slogan Save money, Live better • Founded in 1962 by SamWalton • Ranked 1st by Fortune 500 • $466 Billion sales • 2.2M associates • 11,500 stores in 28 countries • E-Commerce in 11 countries • 198M users @20M per day • 3417 Application in production • ~ 1000 Deployments per day • Share the responsibilities and serve the customers • It’s our problem!
  17. 17. • Founded in 2011, acquired byWalmart in 2013 • A new open source DevOps platform for cloud and application lifecycle management (ALM), which was developed byWalmart Labs. • Works with multiple public and private cloud platforms out of the box, including Microsoft Azure, Rackspace, AWS and CenturyLink Cloud, as well as any OpenStack clouds.
  18. 18. • Works with RDMS and NoSQL Databases, Node.js, Electrode, Docker, ElasticSearch and many others. • Includes monitoring tools, auto-healing, auto- replacing and auto-scaling. • Integrated with enterprise identity services, quota management and configuration management systems. • Released to public at the beginning of 2016
  19. 19. OneOps • OpenStack • 170,000+ cores • 30+ cloud regions • OneOps • 5000+ users • 3000+ applications/services • 60+ open source products • 40,000+ monthly deployment • 100,000+ monthly auto-repairs • 1000+ monthly auto-replace
  20. 20. Technologie s: Ruby, Chef, Tomcat, Postgres, LogStash, ActiveMq, Cassandra, ElastiSearch, Etc.
  21. 21. Minimum Requirement: 8 GB Memory 2 CPU