Test automation belongs to the testers and as testers we care about quality more than the rest of the development team do, right? It’s easy to think this. I know, I’ve been there, as a Tester and a Test Manager.
But now I manage the whole development team and can see how the whole team should use test automation. And how we could get more efficient as a team when we all became responsible for quality.
Solving Flaky Automated Tests Using Machine LearningJames Farrier
Learn different ways of handling flaky tests/unreliable automation. We will go through the different processes that companies like Microsoft, Google and Facebook have used to stop Flaky tests from breaking the build and how you can implement similar techniques and processes.
Join Julian Harty as he discusses how to use Polychrome Testing and emotions to significantly improve how you communicate and how you test software in future.
Designing Self-maintaining UI Tests for Web ApplicationsTechWell
Test automation scripts are in a constant state of obsolescence. New features are added, changes are made, and testers learn about these changes long after they've been implemented. Marcus Merrell helped design a system in which a "model" is created each time a developer changes code that affects the UI. That model is checked against the suite of automated tests for validity. Changes that break the tests are apparent to the developer before his code is even checked in. Then, when features are added, the model is regenerated and automation can immediately address brand-new areas of the UI. Marcus describes fundamental test design and architecture best practices, applicable to any project. Then he demonstrates this new approach: parsing an application's presentation layer to generate an addressable model for testing. Marcus shows several case studies and successful implementations, as well as an open-source project that can have you prototyping your own model before you leave for home.
Seven Bad Habits to Avoid As a QA EngineerRock Interview
While you might truly care about product quality, all QA engineers tend to fall for these mistakes every now and then. Here are some habits that you should avoid to produce high-quality work.
Solving Flaky Automated Tests Using Machine LearningJames Farrier
Learn different ways of handling flaky tests/unreliable automation. We will go through the different processes that companies like Microsoft, Google and Facebook have used to stop Flaky tests from breaking the build and how you can implement similar techniques and processes.
Join Julian Harty as he discusses how to use Polychrome Testing and emotions to significantly improve how you communicate and how you test software in future.
Designing Self-maintaining UI Tests for Web ApplicationsTechWell
Test automation scripts are in a constant state of obsolescence. New features are added, changes are made, and testers learn about these changes long after they've been implemented. Marcus Merrell helped design a system in which a "model" is created each time a developer changes code that affects the UI. That model is checked against the suite of automated tests for validity. Changes that break the tests are apparent to the developer before his code is even checked in. Then, when features are added, the model is regenerated and automation can immediately address brand-new areas of the UI. Marcus describes fundamental test design and architecture best practices, applicable to any project. Then he demonstrates this new approach: parsing an application's presentation layer to generate an addressable model for testing. Marcus shows several case studies and successful implementations, as well as an open-source project that can have you prototyping your own model before you leave for home.
Seven Bad Habits to Avoid As a QA EngineerRock Interview
While you might truly care about product quality, all QA engineers tend to fall for these mistakes every now and then. Here are some habits that you should avoid to produce high-quality work.
These are the slides of the third talk of the first Tech Talk@TransferWise Singapore, which happened on the 23rd of November 2017.
These slides share advice on how to prepare for a software engineering interview.
This method is great to get early feedback on your product before writing a single line of code, or coding a mock-up.
Learn to use Rapid Paper Prototyping to quickly co-create and validate products with users. Bring your ideas to life at extremely low cost. It takes the bare minimum amount of details to create a functional interface so potential users can test it. This method is great to get early feedback on your product before writing a single line of code, or coding a mock-up. Paper and ink is all you need.
Acceptance And Story Testing Patterns - By Charles BradleySynerzip
This webinar discusses best practices for creating Story Tests (aka Acceptance Tests).
Acceptance Testing, also known as Story Testing, is vital to achieve the Agile vision of “working software over comprehensive documentation.”
Read more at https://www.synerzip.com/webinar/acceptance-and-story-testing-patterns/
Scaling Your Tests: Continued Change Without FearTechWell
Agile teams move faster when cycle times are short and code deployments are frequent. To release often, a robust suite of automated tests is a must-have. Tests are the safety net that enables fearless change. Throughout a software system's lifespan, its test suite grows, evolves, and decays. Left unchecked, test execution times increase and non-deterministic failures erode confidence. Ultimately, the test suite that once served as a change-enabler becomes an anchor, grinding progress to a halt. Scaling a test suite is complex and difficult—and vital to successful organizations. Drawing from experience in the trenches, Ryan Scott describes real-world examples of how and why test suites can become burdensome and shares solutions for keeping your test suites tidy. Ryan explores techniques for test parallelization and code restructuring that his company used to decrease the execution time of its test suites by more than 90 percent while more than tripling the number of tests. Take back new ways to fearlessly scale your agile testing.
How to Write an Efficient Defect Case & Save MoneyMediacurrent
Have you ever had to test a bug case and could not make heads or tails on what it is about?
End up spending a lot of time and effort on deciphering the description and trying duplicating the issue. Asking yourself, what in the world are they talking about?
All this effort and time cost money.
Thomas Burke outlines you how to write up a good defect case, so that whoever has to verify it can do it without having to spend a lot of precise time figuring what the issue is and how to test it.
Test automation and Agile software developmentBas Dijkstra
Slides for my workshop on test automation, creating realistic expectations around it and what the role of test automation in Agile software development is
Saksham Sarode - Innovation Through Introspection - EuroSTAR 2012TEST Huddle
EuroSTAR Software Testing Conference 2012 presentation on Innovation Through Introspection by Saksham Sarode. See more at: http://conference.eurostarsoftwaretesting.com/past-presentations/
These are the slides of the third talk of the first Tech Talk@TransferWise Singapore, which happened on the 23rd of November 2017.
These slides share advice on how to prepare for a software engineering interview.
This method is great to get early feedback on your product before writing a single line of code, or coding a mock-up.
Learn to use Rapid Paper Prototyping to quickly co-create and validate products with users. Bring your ideas to life at extremely low cost. It takes the bare minimum amount of details to create a functional interface so potential users can test it. This method is great to get early feedback on your product before writing a single line of code, or coding a mock-up. Paper and ink is all you need.
Acceptance And Story Testing Patterns - By Charles BradleySynerzip
This webinar discusses best practices for creating Story Tests (aka Acceptance Tests).
Acceptance Testing, also known as Story Testing, is vital to achieve the Agile vision of “working software over comprehensive documentation.”
Read more at https://www.synerzip.com/webinar/acceptance-and-story-testing-patterns/
Scaling Your Tests: Continued Change Without FearTechWell
Agile teams move faster when cycle times are short and code deployments are frequent. To release often, a robust suite of automated tests is a must-have. Tests are the safety net that enables fearless change. Throughout a software system's lifespan, its test suite grows, evolves, and decays. Left unchecked, test execution times increase and non-deterministic failures erode confidence. Ultimately, the test suite that once served as a change-enabler becomes an anchor, grinding progress to a halt. Scaling a test suite is complex and difficult—and vital to successful organizations. Drawing from experience in the trenches, Ryan Scott describes real-world examples of how and why test suites can become burdensome and shares solutions for keeping your test suites tidy. Ryan explores techniques for test parallelization and code restructuring that his company used to decrease the execution time of its test suites by more than 90 percent while more than tripling the number of tests. Take back new ways to fearlessly scale your agile testing.
How to Write an Efficient Defect Case & Save MoneyMediacurrent
Have you ever had to test a bug case and could not make heads or tails on what it is about?
End up spending a lot of time and effort on deciphering the description and trying duplicating the issue. Asking yourself, what in the world are they talking about?
All this effort and time cost money.
Thomas Burke outlines you how to write up a good defect case, so that whoever has to verify it can do it without having to spend a lot of precise time figuring what the issue is and how to test it.
Test automation and Agile software developmentBas Dijkstra
Slides for my workshop on test automation, creating realistic expectations around it and what the role of test automation in Agile software development is
Saksham Sarode - Innovation Through Introspection - EuroSTAR 2012TEST Huddle
EuroSTAR Software Testing Conference 2012 presentation on Innovation Through Introspection by Saksham Sarode. See more at: http://conference.eurostarsoftwaretesting.com/past-presentations/
I attended the Tabara de Testare testing group on 3rd February 2015 to present "Lessons Learned When Automating. A live stream from UK to Romania.
http://compendiumdev.co.uk/page/tabaradetestare201602
I've been asked some very challenging questions about lessons learned, and how decisions are made during the process of automating and performing technical testing. In this webinar I'm going to answer them based on my experience. We'll discus how we know 'what to automate' which means we have to split our analysis into 'detection' and 'testing'. We'll cover lessons learned from solving problems, and making mistakes, and steps we can take during the problem solving process e.g. for intermittent failures, and possible tool bugs. We'll discuss abstraction levels and the different levels of the technology stack to automate: how to do it, and how we make the decisions. We'll discuss coding primarily the differences, and the overlap, between the needs for coding for testing and coding for production deployment. We'll also cover some WebDriver specific answers to some of these questions. I'm also going to describe books and techniques that have helped me over the years when trying to deal with these questions on production projects.
A Common Sense Guide to Agile Development and Testing that might just change your Agile approach forever.
Answering the 9 most common questions asked about Agile Testing:
- What is Agile Testing?
- Do we still need testers in Agile?
- What is an Agile Tester?
- What does a Software Tester Actually Do?
- Should we automate our testing?
- What tools should we use for our Agile Testing?
- How Much Should we Automate?
- How can we automate and still finish the sprint?
- How can we finish all our testing in the sprint?
A high quality download of the 9 points as a free "Print out and Keep" Poster is available at http://eviltester.com/agile
Re-thinking Test Automation and Test Process Modelling (in pictures)Alan Richardson
- Why do we talk about Test Automation the way we do?
- Why do we talk about 100% Test Automation?
- How do we model automation as part of our Test Process?
- How does Testing provide information?
- Why was a Waterfall Test Process Different from an Agile Process?
- Why, in reality, both processes are fundamentally the same.
- How we modelled "Test Automation" incorrectly, and an alternative way to model it.
Read the associated blog post at http://blog.eviltester.com/2017/09/rethinking-test-process-automation-modelling.html
There is no doubt about the importance of automated frameworks in the Agile environment and as part of the day-to-day testing process. These are some insights to guide any automation project.
Only globally recongnized certification on Selenium brought to you by Agile Testing Alliance. Any one can take this exam if he or she is selenium. Practical Exam to assess your knowledge. #TesterBhiCoder
Why we need software testing?
- Find / prevent bug
- No more nightmare when you deploy to production
- Preserve product quality
End to End Test
- Testing the complete functionality of some application
- Real application
The presentation was delivered at Testing Automation & continuous testing summit at bangalore, organized by NextgenTesting team and unicom learning team.
A Context-Driven Approach to Automation in TestingBugRaptors
: "To help ourselves test better, Context-Driven testers use tools. But, there is no such thing as Automation”
While reading the James Bach's blog, I found an interesting view about “Automation” in testing from Michael Bolton and James Bach.
[QE 2018] Paul Gerrard – Automating Assurance: Tools, Collaboration and DevOpsFuture Processing
The Digital Transformation is real. It is having a profound effect on how business is done and the nature of the systems required to deliver productive customer experiences and consequent business benefits. The demand for flexible and rapid delivery of software and systems is there. Software development teams can deliver if they adopt the disciplines of Continuous Delivery, DevOps and in-production experimentation. The barrier to achieving success in the software delivery process is likely to be the inability of testers to align testing and automated testing in particular to the development processes. Our track record in test automation is not good enough. In order to succeed a new way of thinking about testing is required, and the New Model of Testing offers a way of identifying the elements of the test process that must be ‘shifted left’. This does not necessarily mean testers move, but rather that the thinking processes must move.
During this lecture, Paul has shown that it is possible that users, BAs, and developers take some responsibility in this area. The New Model applies to all testing, whether performed in development, integration, system or user testing, by people or tools.
Similar to Check This - Test Automation, A Development Managers View (20)
Understanding how a product will be used is a key skill for software professionals. In the past this knowledge has come from reading requirements documentation and working with others in the development team and the wider business that are responsible for the product design. But is this enough to understand how the product will be used?
Mobile users are different. The emotional attachment people have with their mobile devices is far greater than with websites and desktops. Their expectations are greater and it’s far easier to make their voices heard through application store feedback.
This presentation will explain the typical ways in which mobile users are different and what we can do in order to understand them better.
Why I Lost My Job As a Test Manager and What I Learnt As a ResultStephen Janaway
My career followed the typical path of someone in technology. Tester, Test Lead, Test Manager, Senior Test Manager. It started in 1999, back when we lived in a world of scripted tests and large, separate, test teams who designed and ran the tests. A world of silo’s and walls, a world where communication-by-bug- report was common.
Agile came, and fortunately disrupted things. Teams became cross-functional, and yet management did not change. Management became harder; there were more stakeholders to manage, and more areas to cover. Task switching came as standard.
Eventually the penny dropped with senior management and the management team was re-organised. A change had to come and that meant no more Test Managers….
Understanding how to use a product under test is a key skill for software testers. In the past this knowledge has come from reading requirements documentation and working with others in the development team and the wider business responsible for the product design. But is this enough to understand how the product will be used?
Mobile users are different. The emotional attachment people have with their mobile devices is far greater than with websites and desktops. Their expectations are greater, and it’s far easier for them to make their voices heard through application store feedback.
This presentation will explain the typical ways in which mobile users are different and what we, as testers, can do in order to understand them better so that we can test better. We’ll look at how to use persona’s and profiles and see how to use industry data and analytics.
You’ll learn how to work more closely with other roles within the team such as UX and Design in order to test more effectively. And let’s not forget about the users themselves; we’ll also look at how you can engage the users directly and work with them to ensure that mobile applications are as good quality as they can be. You’ll leave with the enthusiasm and knowledge to take your mobile testing to greater heights.
Mobile Testing, That's Just a Smaller Screen, RightStephen Janaway
We are increasingly moving towards mobile devices to fulfil our day-to-day computing needs. More smartphones are sold than PCs but many people are unclear on what changes to test strategies are needed when working with mobile.
This presentation gives an overview of mobile testing, explains some of the common mistakes that are made when starting to test mobile, and gives the audience a taster of what to study next.
Automation is a part of software testing and enables us to check more effectively. But it is not the whole of software testing.
This presentation from Agile In Covent Garden explains why.
Learn how your emotions play an important part in your success as a team member, how you can understand them better, and how you can use this to make you a better person.
Large Language Models and the End of ProgrammingMatt Welsh
Talk by Matt Welsh at Craft Conference 2024 on the impact that Large Language Models will have on the future of software development. In this talk, I discuss the ways in which LLMs will impact the software industry, from replacing human software developers with AI, to replacing conventional software with models that perform reasoning, computation, and problem-solving.
Globus Connect Server Deep Dive - GlobusWorld 2024Globus
We explore the Globus Connect Server (GCS) architecture and experiment with advanced configuration options and use cases. This content is targeted at system administrators who are familiar with GCS and currently operate—or are planning to operate—broader deployments at their institution.
Prosigns: Transforming Business with Tailored Technology SolutionsProsigns
Unlocking Business Potential: Tailored Technology Solutions by Prosigns
Discover how Prosigns, a leading technology solutions provider, partners with businesses to drive innovation and success. Our presentation showcases our comprehensive range of services, including custom software development, web and mobile app development, AI & ML solutions, blockchain integration, DevOps services, and Microsoft Dynamics 365 support.
Custom Software Development: Prosigns specializes in creating bespoke software solutions that cater to your unique business needs. Our team of experts works closely with you to understand your requirements and deliver tailor-made software that enhances efficiency and drives growth.
Web and Mobile App Development: From responsive websites to intuitive mobile applications, Prosigns develops cutting-edge solutions that engage users and deliver seamless experiences across devices.
AI & ML Solutions: Harnessing the power of Artificial Intelligence and Machine Learning, Prosigns provides smart solutions that automate processes, provide valuable insights, and drive informed decision-making.
Blockchain Integration: Prosigns offers comprehensive blockchain solutions, including development, integration, and consulting services, enabling businesses to leverage blockchain technology for enhanced security, transparency, and efficiency.
DevOps Services: Prosigns' DevOps services streamline development and operations processes, ensuring faster and more reliable software delivery through automation and continuous integration.
Microsoft Dynamics 365 Support: Prosigns provides comprehensive support and maintenance services for Microsoft Dynamics 365, ensuring your system is always up-to-date, secure, and running smoothly.
Learn how our collaborative approach and dedication to excellence help businesses achieve their goals and stay ahead in today's digital landscape. From concept to deployment, Prosigns is your trusted partner for transforming ideas into reality and unlocking the full potential of your business.
Join us on a journey of innovation and growth. Let's partner for success with Prosigns.
Experience our free, in-depth three-part Tendenci Platform Corporate Membership Management workshop series! In Session 1 on May 14th, 2024, we began with an Introduction and Setup, mastering the configuration of your Corporate Membership Module settings to establish membership types, applications, and more. Then, on May 16th, 2024, in Session 2, we focused on binding individual members to a Corporate Membership and Corporate Reps, teaching you how to add individual members and assign Corporate Representatives to manage dues, renewals, and associated members. Finally, on May 28th, 2024, in Session 3, we covered questions and concerns, addressing any queries or issues you may have.
For more Tendenci AMS events, check out www.tendenci.com/events
We describe the deployment and use of Globus Compute for remote computation. This content is aimed at researchers who wish to compute on remote resources using a unified programming interface, as well as system administrators who will deploy and operate Globus Compute services on their research computing infrastructure.
SOCRadar Research Team: Latest Activities of IntelBrokerSOCRadar
The European Union Agency for Law Enforcement Cooperation (Europol) has suffered an alleged data breach after a notorious threat actor claimed to have exfiltrated data from its systems. Infamous data leaker IntelBroker posted on the even more infamous BreachForums hacking forum, saying that Europol suffered a data breach this month.
The alleged breach affected Europol agencies CCSE, EC3, Europol Platform for Experts, Law Enforcement Forum, and SIRIUS. Infiltration of these entities can disrupt ongoing investigations and compromise sensitive intelligence shared among international law enforcement agencies.
However, this is neither the first nor the last activity of IntekBroker. We have compiled for you what happened in the last few days. To track such hacker activities on dark web sources like hacker forums, private Telegram channels, and other hidden platforms where cyber threats often originate, you can check SOCRadar’s Dark Web News.
Stay Informed on Threat Actors’ Activity on the Dark Web with SOCRadar!
How to Position Your Globus Data Portal for Success Ten Good PracticesGlobus
Science gateways allow science and engineering communities to access shared data, software, computing services, and instruments. Science gateways have gained a lot of traction in the last twenty years, as evidenced by projects such as the Science Gateways Community Institute (SGCI) and the Center of Excellence on Science Gateways (SGX3) in the US, The Australian Research Data Commons (ARDC) and its platforms in Australia, and the projects around Virtual Research Environments in Europe. A few mature frameworks have evolved with their different strengths and foci and have been taken up by a larger community such as the Globus Data Portal, Hubzero, Tapis, and Galaxy. However, even when gateways are built on successful frameworks, they continue to face the challenges of ongoing maintenance costs and how to meet the ever-expanding needs of the community they serve with enhanced features. It is not uncommon that gateways with compelling use cases are nonetheless unable to get past the prototype phase and become a full production service, or if they do, they don't survive more than a couple of years. While there is no guaranteed pathway to success, it seems likely that for any gateway there is a need for a strong community and/or solid funding streams to create and sustain its success. With over twenty years of examples to draw from, this presentation goes into detail for ten factors common to successful and enduring gateways that effectively serve as best practices for any new or developing gateway.
Understanding Globus Data Transfers with NetSageGlobus
NetSage is an open privacy-aware network measurement, analysis, and visualization service designed to help end-users visualize and reason about large data transfers. NetSage traditionally has used a combination of passive measurements, including SNMP and flow data, as well as active measurements, mainly perfSONAR, to provide longitudinal network performance data visualization. It has been deployed by dozens of networks world wide, and is supported domestically by the Engagement and Performance Operations Center (EPOC), NSF #2328479. We have recently expanded the NetSage data sources to include logs for Globus data transfers, following the same privacy-preserving approach as for Flow data. Using the logs for the Texas Advanced Computing Center (TACC) as an example, this talk will walk through several different example use cases that NetSage can answer, including: Who is using Globus to share data with my institution, and what kind of performance are they able to achieve? How many transfers has Globus supported for us? Which sites are we sharing the most data with, and how is that changing over time? How is my site using Globus to move data internally, and what kind of performance do we see for those transfers? What percentage of data transfers at my institution used Globus, and how did the overall data transfer performance compare to the Globus users?
Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...Globus
Large Language Models (LLMs) are currently the center of attention in the tech world, particularly for their potential to advance research. In this presentation, we'll explore a straightforward and effective method for quickly initiating inference runs on supercomputers using the vLLM tool with Globus Compute, specifically on the Polaris system at ALCF. We'll begin by briefly discussing the popularity and applications of LLMs in various fields. Following this, we will introduce the vLLM tool, and explain how it integrates with Globus Compute to efficiently manage LLM operations on Polaris. Attendees will learn the practical aspects of setting up and remotely triggering LLMs from local machines, focusing on ease of use and efficiency. This talk is ideal for researchers and practitioners looking to leverage the power of LLMs in their work, offering a clear guide to harnessing supercomputing resources for quick and effective LLM inference.
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...Shahin Sheidaei
Games are powerful teaching tools, fostering hands-on engagement and fun. But they require careful consideration to succeed. Join me to explore factors in running and selecting games, ensuring they serve as effective teaching tools. Learn to maintain focus on learning objectives while playing, and how to measure the ROI of gaming in education. Discover strategies for pitching gaming to leadership. This session offers insights, tips, and examples for coaches, team leads, and enterprise leaders seeking to teach from simple to complex concepts.
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERRORTier1 app
Even though at surface level ‘java.lang.OutOfMemoryError’ appears as one single error; underlyingly there are 9 types of OutOfMemoryError. Each type of OutOfMemoryError has different causes, diagnosis approaches and solutions. This session equips you with the knowledge, tools, and techniques needed to troubleshoot and conquer OutOfMemoryError in all its forms, ensuring smoother, more efficient Java applications.
Enhancing Research Orchestration Capabilities at ORNL.pdfGlobus
Cross-facility research orchestration comes with ever-changing constraints regarding the availability and suitability of various compute and data resources. In short, a flexible data and processing fabric is needed to enable the dynamic redirection of data and compute tasks throughout the lifecycle of an experiment. In this talk, we illustrate how we easily leveraged Globus services to instrument the ACE research testbed at the Oak Ridge Leadership Computing Facility with flexible data and task orchestration capabilities.
Listen to the keynote address and hear about the latest developments from Rachana Ananthakrishnan and Ian Foster who review the updates to the Globus Platform and Service, and the relevance of Globus to the scientific community as an automation platform to accelerate scientific discovery.
Advanced Flow Concepts Every Developer Should KnowPeter Caitens
Tim Combridge from Sensible Giraffe and Salesforce Ben presents some important tips that all developers should know when dealing with Flows in Salesforce.
Designing for Privacy in Amazon Web ServicesKrzysztofKkol1
Data privacy is one of the most critical issues that businesses face. This presentation shares insights on the principles and best practices for ensuring the resilience and security of your workload.
Drawing on a real-life project from the HR industry, the various challenges will be demonstrated: data protection, self-healing, business continuity, security, and transparency of data processing. This systematized approach allowed to create a secure AWS cloud infrastructure that not only met strict compliance rules but also exceeded the client's expectations.
5. Test Automation At a Leading
Fashion E-commerce Company
@stephenjanawayLicensed under Creative Commons Attribution 2.5 Denmark. - Benjamin Suomela/norden.org
6. You aren’t there to make
the automated tests pass
@stephenjanaway
11. Testing
The process of evaluating a product
by learning about it
through exploration and experimentation
Source: http://www.satisfice.com/blog/archives/856
@stephenjanaway
12. Checking
The process of making evaluations
by applying algorithmic decision rules
to specific observations of a product
Source: http://www.satisfice.com/blog/archives/856
@stephenjanaway
14. Team
A group of awesome people who want to deliver value
Your job as a manager is to enable them to do that
@stephenjanaway
15. Now what?
Train
them
Find the
people
What Is
Automation
anyway?
Saving the
world
Start here
Build a great team Get it live
What should
you care
about?
Choose
a tool
Let’s Go On a Journey
Plan
your
project
End here
16. Why Do We Need Test Automation Anyway?
@stephenjanaway
18. “People who don’t really get testing tend to want
to turn it into a programming problem instead”
Jeff Nyman
@stephenjanaway
19. What Should a Manager
Care About?
" Predictable, efficient software
delivery
" A happy, motivated team
" Easy (as possible) hiring of new
people
" A team that cares about quality
@stephenjanaway
20. Your Test Automation
Won’t Save The World
" It’s tempting to eat the
“Selenium” donut
" But is it short term
pleasure?
" Automation is not rocket
science, but it’s not trivial
either
@stephenjanaway
21. Recognise That Test
Automation Doesn’t Just
Mean Writing Checking Code
" The ickle test helper
" Testing tools save time and
promote efficiency
" This is automation in testing
@stephenjanaway
22. “Automation is the judicious
application of technology
to help humans do their jobs”
Paul Grizzaffi
@pgrizzaffi
@stephenjanaway
24. You Don’t Need a
Test Automation Team
" Silo’s breed apathy
" Testers should be in teams
" Pairing with developers -
building a bridge
" Team’s own quality
" A separate test automation
team is a lonely place
@stephenjanaway
25. Team’s Own Automation
UI Tests
API Contract Tests
Unit Tests
Web & Mobile
Clients
Platform
{Team
@stephenjanaway
29. 3rd Order Ignorance:
Lack of Process
I don't know a suitably efficient
way to find out I don't know
that I don't know something
2nd Order Ignorance:
Lack of Awareness
I don't know that I don't know
something
1st Order Ignorance: Lack
of Knowledge
I don't know something
0th Order Ignorance: Lack
of Ignorance
I (probably) know something
Good Testing
@stephenjanaway
30. Automation Can Do a Lot But It Can’t Check...
Thought
patterns
User
reactions
Usability
Perceived
Performance
Claims
Unknown
behaviours
What If I…?
Look and feel
Accessibility
Compatibility
@stephenjanaway
Ambiguity
Business
understanding
Value
judgements
Do you need more
tests?
31. Automation Can't Check All Of This...
Thought
patterns
User
reactions
Usability
Perceived
Performance
Claims
Unknown
behaviours
What If I…?
Look and feel
Accessibility
Compatibility
@stephenjanaway
Ambiguity
Business
understanding
Value
judgements
Do you need more
You Can Only Automate
What You Know and Expect
2nd Order Ignorance:
Lack of Awareness
I don't know that I don't know
something
32. You Need
Exploratory Testers
" Tools cannot reason
" Tools will not look for ambiguity
" Tools do not understand your
business
" Tools will not make any value
judgments about tests
" Tools don’t know how to produce
further tests
@stephenjanaway
33. If You Must Hire Test Automators
Then Do So With Care
" When you hire developers then talk to
them about testing
" Watch out for the developer foot in
the door
" Think about remit
" Hire like you would hire a developer.
Be technical. Have technical tests
" Expect them to think like a developer
" Expect them to think like a tester
@stephenjanaway
34. If You Must, Train With Care
" Don’t get your existing test
automators to train your
exploratory testers
" Invest in your team and that
means paying for training
" If you are serious about test
automation then be serious about
the cost
" Wouldn’t it be better to train the
developers to be better testers?
@stephenjanaway
35. No one would ask a developer to teach
an employee to code from scratch
Why Is This Acceptable For Test
Automation?
@stephenjanaway
36. Care About Flow
" Predictable cycle times
" Does my automation help?
" When team’s own
automation then work flows
more smoothly
@stephenjanaway
38. Present Bias
“The tendency to over-value immediate rewards
at the expense of our long-term intentions”
@stephenjanaway
39. Don’t Automate All The Things
Lots of automated tests is not
something to be proud of:
" Who debugs the tests?
" Who maintains the tests?
" Can you efficiently scale the team
to keep up?
" How quickly do the tests generate
results? Information? Value?
Exploit Present Bias with Tea
@stephenjanaway
41. Testing Tool Vendors Promise
You The Earth
Vendors and test centres make fancy
and outlandish claims.
" 100% test automation
" Replace all your manual testers
" 76% efficiency increase
Be wary
@stephenjanaway
42. Don’t Dictate That Every Team
Uses The Same Tools
Cost savings and overall efficiency
vs autonomy and buy-in
Your team know the best tools but
set some principles:
" Well supported
" Open source (with recent PRs)
" Uses existing team skill set
@stephenjanaway
43. Don’t Write From Scratch
" It’s expensive
" It wastes previous experience
" It locks knowledge in a few
people's heads
" Most production code isn’t
written this way
@stephenjanaway
44. Care about a test automation
project just like any other project
Test automation projects are so often
treated we less rigor and care
" Scope creep is bad
" It should deliver
" Don’t change language or
framework halfway through
" Think about requirements
" Same language, same repo, same
review processes, CI
@stephenjanaway
45. Automation Goes Stale
Even if you have a suitable number of
automated test cases:
" More features = more tests
" New test for every bug = more
tests
" More tests = bloated test suites
" Bloated test suites = less efficient
testing
You need a plan to manage growth
@stephenjanaway
46. Focus On The Outcome -
Failing and Passing Checks
" You need a process to
review results
" Triage
" Dashboards
" Stale tests
" Don’t forget why you are
testing in the first place
@stephenjanaway
50. What Have I Learnt?
" You need the right amount of test automation
" Separate automation teams are a bad thing
" Small cross functional teams owning test automation are a good thing
" People will promise that test automation solves every problem you have.
It doesn’t
" Treat test automation just like production code
" Treat test automation projects just like production projects
" Hire with care
" Invest in training but don’t expect your people to do it (all)
" Don’t forget why you are testing in the first place
" You need exploratory testers too
@stephenjanaway