- JMeter as a solution for API automation on small projects.
- Continuous Integration with JMeter (Bamboo).
- Bamboo Demo.
- HTML Reporting.
- Recommendations.
Once you have your Microservices setup, the most pertinent question is how to I test Microservices and ensure that all the moving parts of this distributed system stay in sync.
The presentation provides testing strategies on how to test Microservices and provides focussed understanding of using Consumer Driven Contracts (CDC) to test Microservices API. Additionally it provides pointers around how to do debug Microservices and trace the performance of individual services.
Please read the following presentations before referencing "Testing Microservices"
1. Introduction to Microservices - https://www.slideshare.net/anilallewar/introduction-to-microservices-78270318
2. Build the Microservices sample application -
https://www.slideshare.net/anilallewar/building-microservices-sample-application
Why to choose HP UFT: Automation testing toolBugRaptors
BugRaptors has expertise in UFT, one of the most useful commercial automation tool in the market. We specifically automate using UFT, as it supports almost all popular automation frameworks like Linear, Keyword, Data Driven, Hybrid etc.
A introduction to Microservices Architecture: definition, characterstics, framworks, success stories. It contains a demo about implementation of microservices with Spring Boot, Spring cloud an Eureka.
Apresentar um breve histórico do Teste de Software, juntamente com o processo de teste de software e seus níveis, técnicas, tipos e critérios realizando exercícios práticos.
Contextualizar os alunos de ferramentas de apoio ao teste e boas práticas nas atividades de teste de software.
Apresentação sobre Arquitetura de Automação para Testes Funcionais no TestDay em 20/09/2012 na PUC - SP
Esta apresentação quer mostrar todos os pontos importantes que são necessários para uma arquitetura de testes pensanod "fora da caixa", não somente em criar um script mas em todo o processo durante a automação como gerencimento de erros e logs, relatórios e estratégia para execução da automação.
@test_day
http://testday.com.br
Enterprises today are faced with the decision of determining the right messaging solution for their business. Open source solutions provide good base messaging, and can be seen as a low cost entry point. However, when it comes to the need for scalability and performance, IBM MQ is the leading industry messaging solution for your business.
Once you have your Microservices setup, the most pertinent question is how to I test Microservices and ensure that all the moving parts of this distributed system stay in sync.
The presentation provides testing strategies on how to test Microservices and provides focussed understanding of using Consumer Driven Contracts (CDC) to test Microservices API. Additionally it provides pointers around how to do debug Microservices and trace the performance of individual services.
Please read the following presentations before referencing "Testing Microservices"
1. Introduction to Microservices - https://www.slideshare.net/anilallewar/introduction-to-microservices-78270318
2. Build the Microservices sample application -
https://www.slideshare.net/anilallewar/building-microservices-sample-application
Why to choose HP UFT: Automation testing toolBugRaptors
BugRaptors has expertise in UFT, one of the most useful commercial automation tool in the market. We specifically automate using UFT, as it supports almost all popular automation frameworks like Linear, Keyword, Data Driven, Hybrid etc.
A introduction to Microservices Architecture: definition, characterstics, framworks, success stories. It contains a demo about implementation of microservices with Spring Boot, Spring cloud an Eureka.
Apresentar um breve histórico do Teste de Software, juntamente com o processo de teste de software e seus níveis, técnicas, tipos e critérios realizando exercícios práticos.
Contextualizar os alunos de ferramentas de apoio ao teste e boas práticas nas atividades de teste de software.
Apresentação sobre Arquitetura de Automação para Testes Funcionais no TestDay em 20/09/2012 na PUC - SP
Esta apresentação quer mostrar todos os pontos importantes que são necessários para uma arquitetura de testes pensanod "fora da caixa", não somente em criar um script mas em todo o processo durante a automação como gerencimento de erros e logs, relatórios e estratégia para execução da automação.
@test_day
http://testday.com.br
Enterprises today are faced with the decision of determining the right messaging solution for their business. Open source solutions provide good base messaging, and can be seen as a low cost entry point. However, when it comes to the need for scalability and performance, IBM MQ is the leading industry messaging solution for your business.
REST Assured is a Java library .Which, provides a domain-specific language (DSL) for writing powerful, maintainable tests for Restful APIs.
Library behaves like a headless Client to access REST web services.
Testando uma aplicação com Arquitetura Hexagonal e Spring BootHenrique Schmidt
Arquitetura hexagonal é um padrão de projeto que tem como objetivo criar aplicações com baixo acoplamento, possuindo componentes que podem ser facilmente substituídos quando necessário.
Como testar a lógica de negócio? E os adaptadores? Como garantir que a integração entre os componentes funciona?
Esta palestra tem como objetivo mostrar na prática, usando Spring Boot, como testar uma aplicação que utiliza a arquitetura hexagonal.
A test automation framework defines an organization's way of doing things. It is a set of assumptions, concepts and tools that provide support for automated software testing.
In this presentation, you will learn various aspects of ad hoc testing such as its characteristics, scenarios in which ad hoc testing is not recommended, ad hoc testing advantages and disadvantages.
2015-StarWest presentation on REST-assuredEing Ong
T9: Automate REST Services Testing with RestAssured
Many browser, UI, and Java-based tools and frameworks can help you test REST services. However, in the world of continuous integration and delivery, manual UI- or browser-based tools typically fall short in many aspects—from early test development to developer support. When using Java-based libraries such as HttpClient, much code has to be written for all aspects of a web service call. These extensions or wrappers tend to be complex, hard to read, and difficult to maintain. This is where RestAssured comes in. RestAssured is an open source Java DSL for testing REST-based services, making test code more readable, easier to write, and cheaper to maintain. Learn how easily you can write HTTP get and post requests as well as more complex scenarios involving session management, authentication, and (de)serialization of objects. Take back good practices and an open source command line tool that can help you jumpstart your RestAssured testing.
http://starwest.techwell.com/sessions/starwest-2015/automate-rest-services-testing-restassured
10,000 microservices are generated each month using JHipster!
During this in-depth session by the two JHipster lead developers, we’ll detail:
How to develop and deploy microservices easily
Scalability and failover of microservices
The JHipster Registry for scaling, configuring and monitoring microservices
Common architecture patterns and pitfalls
BPM Patterns & Best Practices with OutSystems BPTGonçalo Borrêga
Presentation shown at OutSystems NextStep 2010 event (www.outsystems.com/nextstep) regarding some tips on using BPM on your web application and how to best use BPT technology to do that.
Elasticsearch Query DSL - Not just for wizards...clintongormley
The Elasticsearch Query DSL is a rich, flexible, powerful query language for full text and structured search, but with power comes complexity. Which of the 40 available queries should you use? What's a filter and when should you use it? How do you combine multiple filters, or multiple queries or queries with filters?
To most users, "relevance", and how it is affected by different queries, is a black box. Multi-field queries in particular can be difficult to get right if you don't understand how they work.
In this talk, I will explain the Query DSL from the ground up: how filters and queries use the inverted index to find matching documents, how the relevance score is calculated, how to combine the filter/query building blocks into complex statements. And finally, I will talk about the pitfalls of multi-field queries and how to avoid them.
By Tom Wilkie, delivered at London Microservices User Group on 2/12/15
The rise of microservice-based applications has had many knock-on effects, not least on the complexity of monitoring your application. Order-of-magnitude increase in the number of moving parts and rate of change of the application require us to reassess traditional monitoring techniques.
In this talk we will discuss some different approaches to monitoring, visualising and tracing containerised, microservices-based applications. We’ll present different techniques to some of the emergent problems, and try not to rant too much.
In this webinar, Postman Developer Educator Sue Smith walks you through the basics of the Postman API Platform and what you can do with it. Topics include:
- How to get started with Postman
- Key tips and tricks every student should know, including how to build basic request configurations and which Postman features are most likely to be useful to you
- Best practices for using Postman to further your education
Building a Test Automation Strategy for SuccessLee Barnes
Choosing an appropriate tool and building the right framework are typically thought of as the main challenges in implementing successful test automation. However, long term success requires that other key questions must be answered including:
- What are our objectives?
- How should we be organized?
- Will our processes need to change?
- Will our test environment support test automation?
- What skills will we need?
- How and when should we implement?
In this workshop, Lee will discuss how to assess your test automation readiness and build a strategy for long term success. You will interactively walk through the assessment process and build a test automation strategy based on input from the group. Attend this workshop and you will take away a blue print and best practices for building an effective test automation strategy in your organization.
• Understand the key aspects of a successful test automation function
• Learn how to assess your test automation readiness
• Develop a test automation strategy specific to your organization
YouTube Link: https://youtu.be/xuH81XGWeGQ
** Microservices Architecture Training: https://www.edureka.co/microservices-architecture-training**
This Edureka's PPT on Microservices Design Patterns talks about the top design patterns you can use to build applications.
Follow us to never miss an update in the future.
YouTube: https://www.youtube.com/user/edurekaIN
Instagram: https://www.instagram.com/edureka_learning/
Facebook: https://www.facebook.com/edurekaIN/
Twitter: https://twitter.com/edurekain
LinkedIn: https://www.linkedin.com/company/edureka
Castbox: https://castbox.fm/networks/505?country=in
REST Assured is a Java library .Which, provides a domain-specific language (DSL) for writing powerful, maintainable tests for Restful APIs.
Library behaves like a headless Client to access REST web services.
Testando uma aplicação com Arquitetura Hexagonal e Spring BootHenrique Schmidt
Arquitetura hexagonal é um padrão de projeto que tem como objetivo criar aplicações com baixo acoplamento, possuindo componentes que podem ser facilmente substituídos quando necessário.
Como testar a lógica de negócio? E os adaptadores? Como garantir que a integração entre os componentes funciona?
Esta palestra tem como objetivo mostrar na prática, usando Spring Boot, como testar uma aplicação que utiliza a arquitetura hexagonal.
A test automation framework defines an organization's way of doing things. It is a set of assumptions, concepts and tools that provide support for automated software testing.
In this presentation, you will learn various aspects of ad hoc testing such as its characteristics, scenarios in which ad hoc testing is not recommended, ad hoc testing advantages and disadvantages.
2015-StarWest presentation on REST-assuredEing Ong
T9: Automate REST Services Testing with RestAssured
Many browser, UI, and Java-based tools and frameworks can help you test REST services. However, in the world of continuous integration and delivery, manual UI- or browser-based tools typically fall short in many aspects—from early test development to developer support. When using Java-based libraries such as HttpClient, much code has to be written for all aspects of a web service call. These extensions or wrappers tend to be complex, hard to read, and difficult to maintain. This is where RestAssured comes in. RestAssured is an open source Java DSL for testing REST-based services, making test code more readable, easier to write, and cheaper to maintain. Learn how easily you can write HTTP get and post requests as well as more complex scenarios involving session management, authentication, and (de)serialization of objects. Take back good practices and an open source command line tool that can help you jumpstart your RestAssured testing.
http://starwest.techwell.com/sessions/starwest-2015/automate-rest-services-testing-restassured
10,000 microservices are generated each month using JHipster!
During this in-depth session by the two JHipster lead developers, we’ll detail:
How to develop and deploy microservices easily
Scalability and failover of microservices
The JHipster Registry for scaling, configuring and monitoring microservices
Common architecture patterns and pitfalls
BPM Patterns & Best Practices with OutSystems BPTGonçalo Borrêga
Presentation shown at OutSystems NextStep 2010 event (www.outsystems.com/nextstep) regarding some tips on using BPM on your web application and how to best use BPT technology to do that.
Elasticsearch Query DSL - Not just for wizards...clintongormley
The Elasticsearch Query DSL is a rich, flexible, powerful query language for full text and structured search, but with power comes complexity. Which of the 40 available queries should you use? What's a filter and when should you use it? How do you combine multiple filters, or multiple queries or queries with filters?
To most users, "relevance", and how it is affected by different queries, is a black box. Multi-field queries in particular can be difficult to get right if you don't understand how they work.
In this talk, I will explain the Query DSL from the ground up: how filters and queries use the inverted index to find matching documents, how the relevance score is calculated, how to combine the filter/query building blocks into complex statements. And finally, I will talk about the pitfalls of multi-field queries and how to avoid them.
By Tom Wilkie, delivered at London Microservices User Group on 2/12/15
The rise of microservice-based applications has had many knock-on effects, not least on the complexity of monitoring your application. Order-of-magnitude increase in the number of moving parts and rate of change of the application require us to reassess traditional monitoring techniques.
In this talk we will discuss some different approaches to monitoring, visualising and tracing containerised, microservices-based applications. We’ll present different techniques to some of the emergent problems, and try not to rant too much.
In this webinar, Postman Developer Educator Sue Smith walks you through the basics of the Postman API Platform and what you can do with it. Topics include:
- How to get started with Postman
- Key tips and tricks every student should know, including how to build basic request configurations and which Postman features are most likely to be useful to you
- Best practices for using Postman to further your education
Building a Test Automation Strategy for SuccessLee Barnes
Choosing an appropriate tool and building the right framework are typically thought of as the main challenges in implementing successful test automation. However, long term success requires that other key questions must be answered including:
- What are our objectives?
- How should we be organized?
- Will our processes need to change?
- Will our test environment support test automation?
- What skills will we need?
- How and when should we implement?
In this workshop, Lee will discuss how to assess your test automation readiness and build a strategy for long term success. You will interactively walk through the assessment process and build a test automation strategy based on input from the group. Attend this workshop and you will take away a blue print and best practices for building an effective test automation strategy in your organization.
• Understand the key aspects of a successful test automation function
• Learn how to assess your test automation readiness
• Develop a test automation strategy specific to your organization
YouTube Link: https://youtu.be/xuH81XGWeGQ
** Microservices Architecture Training: https://www.edureka.co/microservices-architecture-training**
This Edureka's PPT on Microservices Design Patterns talks about the top design patterns you can use to build applications.
Follow us to never miss an update in the future.
YouTube: https://www.youtube.com/user/edurekaIN
Instagram: https://www.instagram.com/edureka_learning/
Facebook: https://www.facebook.com/edurekaIN/
Twitter: https://twitter.com/edurekain
LinkedIn: https://www.linkedin.com/company/edureka
Castbox: https://castbox.fm/networks/505?country=in
Katalon Studio - Successful Test Automation for both Testers and DevelopersKatalon Studio
There is a "great divide" between Developers' and Testers' disciplines, which leads to silo'ed test automation approaches with either inefficient or ineffective result. In this presentation, I introduce Katalon Studio, a free test automation IDE, as an attempt to help our developers and testers collaborate together towards a more reliable and robust test automation implementation.
Original source: https://www.slideshare.net/minhhai2209/successful-test-automation-for-both-testers-and-developers-75417401
Performance Testing is a type of testing to ensure software applications will perform well under their expected workload.
It evaluates the quality or capability of a product. Take your Performance Tests to next level with Gatling!
My name is Senthil Kumar and I hold a Degree in Master of Computer Application with the total working experience of 8.5+ years having a good knowledge of Automation test life cycle which includes the designing, coding, testing, documentation and implementation of the automation framework. Expertise in designing of Hybrid framework for web, windows, main-frame and Siebel applications. I had done Automation Test Estimation for the same. I am confident that my presentation skills and high quality and cost effective methodologies can secure big automation projects for the company. As I worked with a global company I am well aware about the work culture of MNCs. My command over QTP/UFT, QC/ALM, VB Scripting, VBA, SQL and languages like C, C++ makes me a qualified Automation Test Engineer.
A Comprehensive Look at Generative AI in Retail App Testing.pdfkalichargn70th171
Traditional software testing methods are being challenged in retail, where customer expectations and technological advancements continually shape the landscape. Enter generative AI—a transformative subset of artificial intelligence technologies poised to revolutionize software testing.
top nidhi software solution freedownloadvrstrong314
This presentation emphasizes the importance of data security and legal compliance for Nidhi companies in India. It highlights how online Nidhi software solutions, like Vector Nidhi Software, offer advanced features tailored to these needs. Key aspects include encryption, access controls, and audit trails to ensure data security. The software complies with regulatory guidelines from the MCA and RBI and adheres to Nidhi Rules, 2014. With customizable, user-friendly interfaces and real-time features, these Nidhi software solutions enhance efficiency, support growth, and provide exceptional member services. The presentation concludes with contact information for further inquiries.
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERRORTier1 app
Even though at surface level ‘java.lang.OutOfMemoryError’ appears as one single error; underlyingly there are 9 types of OutOfMemoryError. Each type of OutOfMemoryError has different causes, diagnosis approaches and solutions. This session equips you with the knowledge, tools, and techniques needed to troubleshoot and conquer OutOfMemoryError in all its forms, ensuring smoother, more efficient Java applications.
How Recreation Management Software Can Streamline Your Operations.pptxwottaspaceseo
Recreation management software streamlines operations by automating key tasks such as scheduling, registration, and payment processing, reducing manual workload and errors. It provides centralized management of facilities, classes, and events, ensuring efficient resource allocation and facility usage. The software offers user-friendly online portals for easy access to bookings and program information, enhancing customer experience. Real-time reporting and data analytics deliver insights into attendance and preferences, aiding in strategic decision-making. Additionally, effective communication tools keep participants and staff informed with timely updates. Overall, recreation management software enhances efficiency, improves service delivery, and boosts customer satisfaction.
SOCRadar Research Team: Latest Activities of IntelBrokerSOCRadar
The European Union Agency for Law Enforcement Cooperation (Europol) has suffered an alleged data breach after a notorious threat actor claimed to have exfiltrated data from its systems. Infamous data leaker IntelBroker posted on the even more infamous BreachForums hacking forum, saying that Europol suffered a data breach this month.
The alleged breach affected Europol agencies CCSE, EC3, Europol Platform for Experts, Law Enforcement Forum, and SIRIUS. Infiltration of these entities can disrupt ongoing investigations and compromise sensitive intelligence shared among international law enforcement agencies.
However, this is neither the first nor the last activity of IntekBroker. We have compiled for you what happened in the last few days. To track such hacker activities on dark web sources like hacker forums, private Telegram channels, and other hidden platforms where cyber threats often originate, you can check SOCRadar’s Dark Web News.
Stay Informed on Threat Actors’ Activity on the Dark Web with SOCRadar!
Navigating the Metaverse: A Journey into Virtual Evolution"Donna Lenk
Join us for an exploration of the Metaverse's evolution, where innovation meets imagination. Discover new dimensions of virtual events, engage with thought-provoking discussions, and witness the transformative power of digital realms."
Custom Healthcare Software for Managing Chronic Conditions and Remote Patient...Mind IT Systems
Healthcare providers often struggle with the complexities of chronic conditions and remote patient monitoring, as each patient requires personalized care and ongoing monitoring. Off-the-shelf solutions may not meet these diverse needs, leading to inefficiencies and gaps in care. It’s here, custom healthcare software offers a tailored solution, ensuring improved care and effectiveness.
Understanding Globus Data Transfers with NetSageGlobus
NetSage is an open privacy-aware network measurement, analysis, and visualization service designed to help end-users visualize and reason about large data transfers. NetSage traditionally has used a combination of passive measurements, including SNMP and flow data, as well as active measurements, mainly perfSONAR, to provide longitudinal network performance data visualization. It has been deployed by dozens of networks world wide, and is supported domestically by the Engagement and Performance Operations Center (EPOC), NSF #2328479. We have recently expanded the NetSage data sources to include logs for Globus data transfers, following the same privacy-preserving approach as for Flow data. Using the logs for the Texas Advanced Computing Center (TACC) as an example, this talk will walk through several different example use cases that NetSage can answer, including: Who is using Globus to share data with my institution, and what kind of performance are they able to achieve? How many transfers has Globus supported for us? Which sites are we sharing the most data with, and how is that changing over time? How is my site using Globus to move data internally, and what kind of performance do we see for those transfers? What percentage of data transfers at my institution used Globus, and how did the overall data transfer performance compare to the Globus users?
Exploring Innovations in Data Repository Solutions - Insights from the U.S. G...Globus
The U.S. Geological Survey (USGS) has made substantial investments in meeting evolving scientific, technical, and policy driven demands on storing, managing, and delivering data. As these demands continue to grow in complexity and scale, the USGS must continue to explore innovative solutions to improve its management, curation, sharing, delivering, and preservation approaches for large-scale research data. Supporting these needs, the USGS has partnered with the University of Chicago-Globus to research and develop advanced repository components and workflows leveraging its current investment in Globus. The primary outcome of this partnership includes the development of a prototype enterprise repository, driven by USGS Data Release requirements, through exploration and implementation of the entire suite of the Globus platform offerings, including Globus Flow, Globus Auth, Globus Transfer, and Globus Search. This presentation will provide insights into this research partnership, introduce the unique requirements and challenges being addressed and provide relevant project progress.
Enhancing Project Management Efficiency_ Leveraging AI Tools like ChatGPT.pdfJay Das
With the advent of artificial intelligence or AI tools, project management processes are undergoing a transformative shift. By using tools like ChatGPT, and Bard organizations can empower their leaders and managers to plan, execute, and monitor projects more effectively.
Providing Globus Services to Users of JASMIN for Environmental Data AnalysisGlobus
JASMIN is the UK’s high-performance data analysis platform for environmental science, operated by STFC on behalf of the UK Natural Environment Research Council (NERC). In addition to its role in hosting the CEDA Archive (NERC’s long-term repository for climate, atmospheric science & Earth observation data in the UK), JASMIN provides a collaborative platform to a community of around 2,000 scientists in the UK and beyond, providing nearly 400 environmental science projects with working space, compute resources and tools to facilitate their work. High-performance data transfer into and out of JASMIN has always been a key feature, with many scientists bringing model outputs from supercomputers elsewhere in the UK, to analyse against observational or other model data in the CEDA Archive. A growing number of JASMIN users are now realising the benefits of using the Globus service to provide reliable and efficient data movement and other tasks in this and other contexts. Further use cases involve long-distance (intercontinental) transfers to and from JASMIN, and collecting results from a mobile atmospheric radar system, pushing data to JASMIN via a lightweight Globus deployment. We provide details of how Globus fits into our current infrastructure, our experience of the recent migration to GCSv5.4, and of our interest in developing use of the wider ecosystem of Globus services for the benefit of our user community.
Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...Globus
Large Language Models (LLMs) are currently the center of attention in the tech world, particularly for their potential to advance research. In this presentation, we'll explore a straightforward and effective method for quickly initiating inference runs on supercomputers using the vLLM tool with Globus Compute, specifically on the Polaris system at ALCF. We'll begin by briefly discussing the popularity and applications of LLMs in various fields. Following this, we will introduce the vLLM tool, and explain how it integrates with Globus Compute to efficiently manage LLM operations on Polaris. Attendees will learn the practical aspects of setting up and remotely triggering LLMs from local machines, focusing on ease of use and efficiency. This talk is ideal for researchers and practitioners looking to leverage the power of LLMs in their work, offering a clear guide to harnessing supercomputing resources for quick and effective LLM inference.
Climate Science Flows: Enabling Petabyte-Scale Climate Analysis with the Eart...Globus
The Earth System Grid Federation (ESGF) is a global network of data servers that archives and distributes the planet’s largest collection of Earth system model output for thousands of climate and environmental scientists worldwide. Many of these petabyte-scale data archives are located in proximity to large high-performance computing (HPC) or cloud computing resources, but the primary workflow for data users consists of transferring data, and applying computations on a different system. As a part of the ESGF 2.0 US project (funded by the United States Department of Energy Office of Science), we developed pre-defined data workflows, which can be run on-demand, capable of applying many data reduction and data analysis to the large ESGF data archives, transferring only the resultant analysis (ex. visualizations, smaller data files). In this talk, we will showcase a few of these workflows, highlighting how Globus Flows can be used for petabyte-scale climate analysis.
Enhancing Research Orchestration Capabilities at ORNL.pdfGlobus
Cross-facility research orchestration comes with ever-changing constraints regarding the availability and suitability of various compute and data resources. In short, a flexible data and processing fabric is needed to enable the dynamic redirection of data and compute tasks throughout the lifecycle of an experiment. In this talk, we illustrate how we easily leveraged Globus services to instrument the ACE research testbed at the Oak Ridge Leadership Computing Facility with flexible data and task orchestration capabilities.
Globus Compute wth IRI Workflows - GlobusWorld 2024Globus
As part of the DOE Integrated Research Infrastructure (IRI) program, NERSC at Lawrence Berkeley National Lab and ALCF at Argonne National Lab are working closely with General Atomics on accelerating the computing requirements of the DIII-D experiment. As part of the work the team is investigating ways to speedup the time to solution for many different parts of the DIII-D workflow including how they run jobs on HPC systems. One of these routes is looking at Globus Compute as a way to replace the current method for managing tasks and we describe a brief proof of concept showing how Globus Compute could help to schedule jobs and be a tool to connect compute at different facilities.
2. 2
Skills | Knowledge | Collaboration
Speaker info
Hi, I’m Mykola Kovsh
PerformanceTestEngineer
Performance Testing Department at
Testing Centerof Excellence,
Ciklum,Ukraine
•Performance/ Automation / Manualtesting
www.linkedin.com/in/mykolakovsh/
3. 3
Skills | Knowledge | Collaboration
Content
6 Our Results
Demo5
Testing Product Description1
Our Problem2
Continuous Integration with JMeter (Bamboo). Reporting4
JMeter as a Solution3
Conclusions7
Links and Q&A session
4. 4
Skills | Knowledge | Collaboration
Testing Product Description
Client: Mobile / Facebookweb sport betting application
Server:Amazon cloud-based application, REST API based
Technology stack: Java, Cassandra DB, Unity 3D
Product is in active development for near 3years
A lot of parsing and integration logic with 3rd-party data providers
Frequent releases driven by business needs (startup)
5. 5
Skills | Knowledge | Collaboration
Our Problem
We should run full regression REST API functional tests each release
Manual runs took 4-5 days for 2 QAs what did not satisfy business
No QA automation specialist on the project, but we use JMeter for performance testing and have
expertise in it
A lot of GUI/usability testing in addition to functional
To sum up:often we did not have time for full functional regression testing before release what
resulted in bugs and frequent hotfixes on Production
6. 6
Skills | Knowledge | Collaboration
Solution 1: Postman
Goodas supplementarytoolfor manualtesting
CIintegration
Reports convertingtoHTML file
Team workoptionbut NOT FREE
Incase oftrickyparametrizationandcustom logic, some tool’s issues
couldinfluence autotests runs
JavaScriptbasicknowledgeis required
Hardtomaintainwhen alot oftest-cases
Noabilityofparallelruns
Reports arenot very comprehensive
7. 7
Skills | Knowledge | Collaboration
Solution 2: JMeter. Why for API?
Free toolwithlargecommunityandsupport
GUI based- fastlearning
Customization-throughJMeter API andusing scripting languages
Abilitytoreuse functionaltestsforload purposes
Abilitytoreuse GUI modulesin different tests
Assertions- allowyouto"test"whetheryourapplicationreturnstheresults youexpectit to
Paralleltest runs
CI integration
ComprehensiveHTML reports
Basicknowledgeofsomescripting languageandregularexpressionsis required
Hardtomaintainonlargeprojects
Version control:onlyJMX filescould betracked
8. 8
Skills | Knowledge | Collaboration
JMeter: Functional Tests Creation
1. ThreadGroup(user) ->Testset/Testsuite
2. LogicControllers:
a) TransactionController->Testsuite/Testcase
b) Loop/While/ForEachController
c) If Controlleretc.
3. Samplers->Requests(HTTP(s), TCP, SOAP,etc.)
4. Assertions->Testyourresponse/Customize/Parametrize
5. Timers
6. Configurationelements
1
2
3
4
5
6
9. 9
Skills | Knowledge | Collaboration
JMeter: Customize/Parametrize/Test
Assertion types:
JSR223Assertion
Response Assertion
Duration Assertion
SizeAssertion
XML Assertion
BeanShell Assertion
MD5Hex Assertion
HTML Assertion
XPath Assertion
XML Schema Assertion
Compare Assertion, etc.
10. 10
Skills | Knowledge | Collaboration
Reusable/Modular Scripts Approach
To makefunctional testing scripts easy
maintainable and reusableuse next JMeter
elements:
Test Fragment
Simple / Transaction Controller
Module Controller
Parameterized Controller
Include Controller
11. 11
Skills | Knowledge | Collaboration
Data + Keyword Driven Approach
To separatetest scriptsfrom test cases design
use next JMeter elements:
Test Fragment
Switch Controller
Simple / Transaction Controller
Module Controller
ForEach Controller
CSV Data Set Config
12. 12
Skills | Knowledge | Collaboration
JMeter: Continuous Integration
Process and tools:
1. JMeter:functional testing scripts
2. ANTbuild tool: converts results from JTL output files into HTML reports
- ANT parses JTL logs using XSLT stylesheet file
3. Bamboo CI tool
Development SourceControl Build Unit/IntegrationTesting FunctionalTesting Report
13. 13
Skills | Knowledge | Collaboration
What is ANT
Apache Ant (Another Neat Tool) is a general purpose build tool.
Ant is primarily used for building and deploying Java projects but can be used for
every possible repetitive tasks, e.g. generating documentation.
A build tool is used to automate repetitive tasks during some process:
- compiling source code,
- running software tests,
- creating files and documentation for the software deployment, etc.
Popular build tools in the Java space are Maven, Gradle and Apache Ant.
14. 14
Skills | Knowledge | Collaboration
JMeter CI: Approaches
ANTstandalone –all steps are executedin
ANT build.xml file, using 1 Bamboo Task:
• Run JMeter tests
• Convert JTL logs to HTML report
• Verify test results and pass/fail build
PowerShell(console) + ANTcombination
–3 Bamboo tasks:
• Task1Script:run JMeter tests
• Task2ANT: convertJTL log to HTML
report
• Task3Script:verify results and pass/fail
build
1 2
18. 18
Skills | Knowledge | Collaboration
Bamboo Task 2: ANT Build File
After tests executed, generate HTML report using
build_report.xml file (default name build.xml)
Wehave3 <target> here:
• report - log process
• xslt-report –convertusing XSLTfile
• copy_report –move reports to separate folder
tokeephistory
19. 19
Skills | Knowledge | Collaboration
What is XSLT
Wikipedia: XSLT (Extensible Stylesheet Language
Transformations) is a language for transforming XML
documents into other XML documents,
or other formats such as HTML for web pages, plain text or
XSL Formatting Objects, which may subsequently be
converted to other formats, such as PDF, PostScript and PNG
20. 20
Skills | Knowledge | Collaboration
HTML: XSLT Stylesheet File Update
OurImprovements:
• Statistics by test suites (threads) and request
• Expand/Collapse test suits option
• Show only failed transactions filter
before after
*Origin: http://shanhe.me/node/18/314
*UpdatedXSLT: https://drive.google.com/file/d/0B4SCa_HZT_OOQnoyQjc1TGw0a0E/view?usp=sharing
25. 25
Skills | Knowledge | Collaboration
Recommendations
1) Apply decomposition for faster tests runs:
-One functional area -One separate Test Plan
-Decompose tests runsby jobs inCItool (Bamboo, Jenkins)
2) Runsmoke functional test and, if success, make it trigger full coverage testing run
3) Use Modular approach to create maintainable/reusable scripts
4) Team work:use IncludeControllers to run scripts created by each member
5) UseJSR223Assertion element to customize/parametrize/test yourcustom logic in flexible way
6) UseUserDefined Variables element to create and fast switch between Test/Stage/Prod hosts
7) Shareyourscripts with developers to debug current and new features
8) UseJMeterscripts for Load testing, if needed
26. 26
Skills | Knowledge | Collaboration
Disadvantages
Inappropriate for largeprojects/teams
Hard to maintain scripts, if there are lot of them
Scripts version control is absent
Not veryconvenient for large QA team use(if more than 2-3 QAspecialists)
You still need time to learnsome scripting language (and regexp) to create comprehensive scripts with
JMeter
27. 27
Skills | Knowledge | Collaboration
Our Results
For 5 months ~200 (30%) of API functional high priority test cases were automated
~100 regression and ~80 new features bugs found
Functional API regression testing period shortened from 5 to 2 days
QA team has more time to focus on GUI and cross-platform testing
Overall quality of the application was improved and more stable builds released to Prod
28. 28
Skills | Knowledge | Collaboration
Conclusions
Involve automation QA engineer(s) to implement automation testing on the project within high
standards (Python/Java/etc. frameworks)
IF Your team/project is relatively small (near 5-8 members) and limited time for full regression runs, to
improve product quality you can:
• use JMeter automation testing as complement to manual testing
• automate high priority API test cases to verify main product functionality -smoke and short
acceptance testing
• automate new features testing
• integrate JMeter API testing into product CI pipeline
ELSE