Fundamentals of DevOps for Data Testing Course - Module 1

1. © 2019 Real-Time Technology Solutions, Inc.
22 West 38th Street FL 11, New York, NY 10018
www.rttsweb.com | (212) 240-9050
1 a software division of
QuerySurge™
for
DATA

2. © 2019 Real-Time Technology Solutions, Inc.
22 West 38th Street FL 11, New York, NY 10018
www.rttsweb.com | (212) 240-9050
2 a software division of
QuerySurge™
• Module 1 – Introduction
o What is DevOps?
o What are the benefits of DevOps?
o Implementing DevOps
• Module 2 – Culture Change
o Changing the Culture for DevOps
• Module 3 – Continuous Integration
• What is Continuous Integration?
• Module 4 – Continuous Delivery
• What is Continuous Delivery?
• Module 5 – Continuous Testing
• What is Continuous Testing?
• Module 6 – DevOps for Data
• What is DevOps for Data?
• Challenges DataOps helps solve
• DevOps vs DataOps
• DataOps Pipelines
• DataOps Process
• Module 7 – Testing in DataOps
• Tests in DataOps
• DataOps testing with QuerySurge
• Module 8 – Wrapping it up
• Lab Exercises

3. © 2019 Real-Time Technology Solutions, Inc.
22 West 38th Street FL 11, New York, NY 10018
www.rttsweb.com | (212) 240-9050
3 a software division of
QuerySurge™

4. © 2019 Real-Time Technology Solutions, Inc.
22 West 38th Street FL 11, New York, NY 10018
www.rttsweb.com | (212) 240-9050
4 a software division of
QuerySurge™
Operations
Operations is the overarching term for the
processes and services administered by an
organization's information technology (IT)
department. As such, operations include
the software systems with support for
hardware and software.
Development
Software development is the process of
conceiving, specifying, designing, programming,
documenting, testing, and bug fixing involved in
creating and maintaining applications,
frameworks, or other software components.
DevOps

5. © 2019 Real-Time Technology Solutions, Inc.
22 West 38th Street FL 11, New York, NY 10018
www.rttsweb.com | (212) 240-9050
5 a software division of
QuerySurge™
Fast Delivery
Enhanced
Collaboration
Scalability
Security
Benefits of
DevOps
Improved
Quality

6. © 2019 Real-Time Technology Solutions, Inc.
22 West 38th Street FL 11, New York, NY 10018
www.rttsweb.com | (212) 240-9050
6 a software division of
QuerySurge™
DevOps
• DevOps can be defined as IT workers functioning
together to imagine, construct, build, and provide
secure software packages, rapidly with minimal
failures.
• DevOps practices enable software developers and
operations teams to accelerate delivery through
automation, collaboration, fast feedback, and
iterative improvement.

7. © 2019 Real-Time Technology Solutions, Inc.
22 West 38th Street FL 11, New York, NY 10018
www.rttsweb.com | (212) 240-9050
7 a software division of
QuerySurge™
People
Processes
Tools
DevOps
Includes:

8. © 2019 Real-Time Technology Solutions, Inc.
22 West 38th Street FL 11, New York, NY 10018
www.rttsweb.com | (212) 240-9050
8 a software division of
QuerySurge™
Fast Delivery
• Increase the speed and frequency of software builds
and releases, which will make software product
releases faster.
• The faster you can get new features to market, the
earlier you can respond to your customers’
requirements and build a competitive advantage.
• Continuous integration (CI) and continuous delivery
(CD) allow for automation of the software release
process, from build to deployment.

9. © 2019 Real-Time Technology Solutions, Inc.
22 West 38th Street FL 11, New York, NY 10018
www.rttsweb.com | (212) 240-9050
9 a software division of
QuerySurge™
Improved Quality
• Increased quality in software updates and
infrastructure changes will allow for reliable delivery at
a much speedier pace, while increasing the positive
experience for the product users.
• Practices like continuous integration (CI) and
continuous delivery (CD) allow for testing that each
software change is functionally correct and secure.
• Constant and automated monitoring helps you stay
informed of performance in real-time.

10. © 2019 Real-Time Technology Solutions, Inc.
22 West 38th Street FL 11, New York, NY 10018
www.rttsweb.com | (212) 240-9050
10 a software division of
QuerySurge™
Enhanced Collaboration
• Form more effective teams using a DevOps cultural
model, which lays emphasis on standards with a
greater focus on accountability.
• Both developers and operations teams collaborate
as one, share numerous responsibilities, and
combine their process workflows.
• This greatly diminishes inefficiencies, saves time,
and generally improves morale.

11. © 2019 Real-Time Technology Solutions, Inc.
22 West 38th Street FL 11, New York, NY 10018
www.rttsweb.com | (212) 240-9050
11 a software division of
QuerySurge™
Security
• Automated compliance policies allow the team to
implement a repeatable DevOps model while increasing
system security.
• Automation allows the team to identify vulnerabilities in
the early stages of the software development lifecycle while
saving valuable resources for other activities.

12. © 2019 Real-Time Technology Solutions, Inc.
22 West 38th Street FL 11, New York, NY 10018
www.rttsweb.com | (212) 240-9050
12 a software division of
QuerySurge™
Scalability
• Realize and execute infrastructure and development
processes at scale. Automation and consistency help the
team manage complex or altering systems proficiently and
with greatly reduced risk.
• Infrastructure as code allows the team to manage
development, testing, and production environments in a
repeatable and more efficient manner.

13. © 2019 Real-Time Technology Solutions, Inc.
22 West 38th Street FL 11, New York, NY 10018
www.rttsweb.com | (212) 240-9050
13 a software division of
QuerySurge™
Culture Change
Implementing
DevOps New Practices
Innovative Tools

14. © 2019 Real-Time Technology Solutions, Inc.
22 West 38th Street FL 11, New York, NY 10018
www.rttsweb.com | (212) 240-9050
14 a software division of
QuerySurge™
Culture Change
• DevOps involves a changing of culture and mindset.
• At its simplest, DevOps is about eliminating the walls
between two main teams which are conventionally siloed,
development and operations.
• Additionally, sub-teams within these areas, such as the
quality assurance team, will also need to work to break-
down these barriers.
• With DevOps, teams work together in a cross-functional
manner to optimize productivity, reliability, and quality.

15. © 2019 Real-Time Technology Solutions, Inc.
22 West 38th Street FL 11, New York, NY 10018
www.rttsweb.com | (212) 240-9050
15 a software division of
QuerySurge™
Culture Change (continued)
• The once siloed teams strive to communicate frequently,
increase efficiencies, and improve the excellence of services
and quality of the final product to their customers.
• The teams take on an increased responsibility for their
work, beyond their traditional roles by being accountable
for the customers requirements.
• With a DevOps model, all relevant teams involved view the
entire development lifecycle as part of their responsibility.

16. © 2019 Real-Time Technology Solutions, Inc.
22 West 38th Street FL 11, New York, NY 10018
www.rttsweb.com | (212) 240-9050
16 a software division of
QuerySurge™
New Practices
• The main shifts that assist organizational transformation
into a DevOps model help achieve faster and automated
processes.
• The first practice is to perform very frequent and small
updates to the software product.
• These small and frequent updates allow for a considerably
more incremental approach from the traditional
development lifecycle.

17. © 2019 Real-Time Technology Solutions, Inc.
22 West 38th Street FL 11, New York, NY 10018
www.rttsweb.com | (212) 240-9050
17 a software division of
QuerySurge™
Continuous
Integration
New Practices Continuous
Delivery
Infrastructure
as Code
Monitoring
Collaboration

18. © 2019 Real-Time Technology Solutions, Inc.
22 West 38th Street FL 11, New York, NY 10018
www.rttsweb.com | (212) 240-9050
18 a software division of
QuerySurge™
Continuous Integration
• Continuous integration is a practice in software
development where the development team frequently
merges their code changes into a central repository.
• Immediately following, automated builds and automated
tests are executed.
• The main concept of continuous integration is to discover
errors quicker, improve software quality, and decrease the
time it takes to validate and release new software updates.

19. © 2019 Real-Time Technology Solutions, Inc.
22 West 38th Street FL 11, New York, NY 10018
www.rttsweb.com | (212) 240-9050
19 a software division of
QuerySurge™
Continuous Delivery
• Continuous delivery is the practice where code
changes are automatically built, automatically tested,
and prepared for release to an environment.
• It works in conjunction with continuous integration by
automatically deploying code changes to an
environment after compiling of a build is complete.
• With continuous delivery, developers will always have
a validated and reliable build ready for release.

20. © 2019 Real-Time Technology Solutions, Inc.
22 West 38th Street FL 11, New York, NY 10018
www.rttsweb.com | (212) 240-9050
20 a software division of
QuerySurge™
Monitoring
• DevOps monitoring tools provide automated and expanded
measurement for visibility throughout the entire
development lifecycle including planning, development,
integration, testing, deployment, and operations.
• In the DevOps model monitoring can be an automated
process by which the DevOps team can detect compliance
issues and security threats during each phase of the
lifecycle.

21. © 2019 Real-Time Technology Solutions, Inc.
22 West 38th Street FL 11, New York, NY 10018
www.rttsweb.com | (212) 240-9050
21 a software division of
QuerySurge™
Infrastructure as Code
• Infrastructure as Code is the process of provisioning and
managing infrastructure defined through code, instead of
through a manual process.
• As infrastructure is defined as code, it allows users to easily
edit and distribute configurations while ensuring the
desired state of the infrastructure.
• This means you can create reproducible infrastructure
configurations.

22. © 2019 Real-Time Technology Solutions, Inc.
22 West 38th Street FL 11, New York, NY 10018
www.rttsweb.com | (212) 240-9050
22 a software division of
QuerySurge™
Collaboration
• DevOps tools institute collaboration by bringing together
the processes and responsibilities of the development and
operations teams.
• These teams set strong cultural standards for information
sharing and communication by using communication
applications, project tracking systems, and message boards.
• This speeds up communication and collaboration across all
the teams involved in the development lifecycle.
• Other teams can also get involved for complete
transparency. No more silos!

23. © 2019 Real-Time Technology Solutions, Inc.
22 West 38th Street FL 11, New York, NY 10018
www.rttsweb.com | (212) 240-9050
23 a software division of
QuerySurge™
Innovative Tools
• DevOps processes count on effective tools to allow teams to
implement automation through-out the development
lifecycle that will allow for the rapid and reliable release of
software that meets their customers needs.
• These tools automate tasks, assist in managing complex
environments, increase collaboration and keep the team in
control of the extraordinary speed that a successful DevOps
team requires.

24. © 2019 Real-Time Technology Solutions, Inc.
22 West 38th Street FL 11, New York, NY 10018
www.rttsweb.com | (212) 240-9050
24 a software division of
QuerySurge™
Coding: code development,
source code management
tools, code merging Building: continuous integration
tools (like Jenkins), build status
Testing: continuous automated
testing tools that provide
feedback on business risks Packaging: artifact repository,
application pre-deployment staging
Innovative Tools

25. © 2019 Real-Time Technology Solutions, Inc.
22 West 38th Street FL 11, New York, NY 10018
www.rttsweb.com | (212) 240-9050
25 a software division of
QuerySurge™
Innovative Tools
Releasing: change management,
release approvals, release automation
Configuring: infrastructure
configuration and management,
infrastructure as code tools
Monitoring: application performance
monitoring, end-user experience

26. © 2019 Real-Time Technology Solutions, Inc.
22 West 38th Street FL 11, New York, NY 10018
www.rttsweb.com | (212) 240-9050
26 a software division of
QuerySurge™
• The word DevOps is a combination of the two words
development and operations.
• DevOps includes people, tools and processes.
• DevOps benefits include faster delivery, enhanced collaboration,
better scalability, improved security, and improved quality.
• Implementing DevOps involves changes to the culture, new
practices, and innovative tools.
Introduction Highlights