Testing Hourglass at Jira Frontend - by Alexey Shpakov, Sr. Develop...

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

ALEXEY SHPAKOV | SENIOR DEVELOPER
Testing hourglass
at Jira Frontend
Hi, my name is Alexey Shpakov. I work in Jira Fronten...

Testing pyramid
e2e
unit
integration
complexity
maintenance
fragility
duration
Testing pyramid is a metaphor coined by Mik...

could sometimes be a huge effort on its own. If your service is stateful, you may need to prepopulate the database before ...

Is it good enough?
Photo by Ludovic Migneault on Unsplash
Testing pyramid is a great rule of thumb that can help structure...

Real world is more
complicated
Photo by Jean-Louis Paulin on Unsplash
As the web applications become more complicated and ...

Let's step back and recall, what testing is about. If you ask Google, you will get the following definition.
To test means...

e2e
unit
integration
deployment
PDV
monitoring
logging
Testing hourglass
At Atlassian we acknowledge that having a good te...

Type checking
Photo by Leighann Blackwood on Unsplash
The very first level of the testing pyramid we have is type checking...

• Force new code to be covered with types
• Update flow regularly
• Generate library definitions from Typescript
Type chec...

Unit tests
Photo by William Warby on Unsplash
On the second level of the pyramid we find unit tests.

• Mock timers and dates
• Avoid snapshot tests
• Fail on console methods
• Zero tolerance for flakes
Unit tests
We are usi...

Integration tests
Photo by Lenny Kuhne on Unsplash
There is a lot of different types of integration tests one can write. D...

• Use storybooks
• Cypress allows to retry
• Notify owners about flaky tests
Cypress tests
Cypress library allows us to us...

• Use storybooks
• A separate flakiness test
• Stop css animations and mock date
• Diminishing returns
Visual regression t...

• Pact tests
• Verify and upload pacts as a part of deployment
Contract tests
The goal of contract tests is to ensure the ...

End-to-end tests
Photo by Matt Botsford on Unsplash
End-to-end tests are the upper part of the pyramid. This means you wan...

• Flakiness
• High maintenance
• Unable to represent production
End-to-end tests
In Jira we used to have a lot of end-to-e...

Release
Photo by Kira auf der Heide on Unsplash
The middle point of the testing hourglass is the application release.
No m...

Feature flags
Photo by Sebastiano Piazzi on Unsplash
Feature toggles or feature flags is a technique, that allows develope...

• Feature flag for every feature
• Feature delivery tickets
• Monitor feature flag changes
• Feature flag cleanup
Feature ...

Dogfooding and blockers
Photo by Ben Hanson on Unsplash
However, certain features may not be feature-flagged.

• Use the app internally
• Anyone is able to halt production rollout
Dogfooding and blockers
Some of the commonly mentione...

Gradual rollouts
Photo by Aliko Sunawang on Unsplash
In order to further mitigate deployment risks we introduced release s...

• 1 staging, 3 production environments
• Canaries
• 3 hours to deploy to all environments
• Frequent releases (30 per week...

A production version myth
Photo by Eric Prouzet on Unsplash
Often times in conversations QAs and SREs talk about a product...

• 3+ versions in production
• Inconsistent feature flags
• Different versions of backend
A production version myth
Product...

Active monitoring (PDV)
Photo by Jared Brashier on Unsplash
PDV stands for post-deployment verification. The idea behind a...

• Similar to e2e tests
• Run 24/7 in production
• Failure threshold
Active monitoring (PDV)
We have a separate monitoring ...

Passive monitoring
Photo by Miłosz Klinowski on Unsplash
The second level of the upper part of the hourglass is monitoring.

• Reliable
• Alert priorities
• Runbooks
• War games
Passive monitoring
Monitoring is used to alert developers in case som...

Logging
Photo by Dorelys Smits on Unsplash
While monitoring allows us to react fast in case of incidents, it is usually qu...

• Long data retention
• Structured information
• Do not log PII/UGC
• Data ownership
Logging
For these scenarios we use lo...

You build it, you run it
Photo by Ethan Hu on Unsplash
At Atlassian we follow the “you build it you run it” approach. This...

• SLOs
• 24/7 on-call
• TechOps meetings
You build it, you run it
This includes defining Service Level Objectives, running...

e2e
unit
integration
pyramidTesting
These are some of the learnings we found on the way of converting a testing pyramid

e2e
unit
integration
deployment
PDV
monitoring
logging
hourglassTesting
into a testing hourglass.
I hope, they could save ...

Thank you
LINKEDIN.COM/IN/ALEXEYSHPAKOV
Thank you.

Share Slideshare

LinkedIn
Facebook
Twitter

Embed

Size (px)

Show related Slideshows at end

WordPress Shortcode

Link

Share
Email

2024 Trend Updates: What Really Wor... by Search Engine Jou... 1047773 views
Storytelling For The Web: Integrate... by Chiara Aliotta 961940 views
Artificial Intelligence, Data and C... by OECD Directorate ... 891371 views
How to Leverage AI to Boost Employe... by SocialHRCamp 375955 views
2024 State of Marketing Report – by... by Marius Sescu 213320 views
Everything You Need To Know About C... by Expeed Software 232066 views

View on Slideshare

1 of 37 Ad

View on Slideshare

1 of 37 Ad