Although the idea of doing performance testing throughout the software lifecycle sounds simple enough, as soon as you try to combine the concepts of “always testing” (in dev, pre-prod, and production) with “limited time and resources” and throw in the word “comprehensive,” the challenges can be monumental. Quickly the “how” of it emerges as the most important question—and one worth focusing on. Brad Stoner tackles this topic by explaining how he has been able to solve this seemingly impossible puzzle by applying various approaches such as early and often, learning when to say no, and seriously, I did say no—and more. Brad shares concrete examples of how he has successfully implemented full lifecycle performance testing at several companies. Join Brad to learn what performance tests to run at each development and delivery stage—from a simple load profile on a single server to full-scale soak tests over several days.
Nonfunctional Testing: Examine the Other Side of the CoinTechWell
Creating a highly available, scalable, and high-performing system requires a substantial amount of what we call nonfunctional testing. Developing nonfunctional testing skills is a must for many of today’s quality engineers (QEs). For the past several years, Balaji Arunachalam’s quality team for Intuit Core Services has experienced several highly available and disaster recovery buildup and testing challenges. Their journey includes the evolution of functional QEs into hybrid QEs who are capable of doing both functional and nonfunctional testing. Nonfunctional testing includes capacity, stability, benchmarking, FMEA/RAS, datacenter failover, and scalability testing. Balaji shares nonfunctional testing best practices, learnings, and mistakes they encountered on this journey. If you or your team is ready flip the coin and take a serious look at nonfunctional testing methods, opportunities, challenges, and solutions, this session is for you.
Andreas Grabner maintains that most performance and scalability problems don’t need a large or long running performance test or the expertise of a performance engineering guru. Don’t let anybody tell you that performance is too hard to practice because it actually is not. You can take the initiative and find these often serious defects. Andreas analyzed and spotted the performance and scalability issues in more than 200 applications last year. He shares his performance testing approaches and explores the top problem patterns that you can learn to spot in your apps. By looking at key metrics found in log files and performance monitoring data, you will learn to identify most problems with a single functional test and a simple five-user load test. The problem patterns Andreas explains are applicable to any type of technology and platform. Try out your new skills in your current testing project and take the first step toward becoming a performance diagnostic hero.
Is your company thinking about using Selenium to implement test automation in a joint development and operations environment? If your company has already started using Selenium, have you experienced execution or integration challenges? The path to a well-oiled and successful Selenium test automation program comes down to using the right techniques and development standards that incorporate modularity and flexibility. Jin Reck describes how to design effective web test automation development, and shares common challenges and solutions when implementing an automated testing framework in the real world. Jin shows how to incorporate Selenium with continuous integration platforms and discusses techniques, adjustments, lessons learned, and best practices from successful implementations. Leave with a better understanding of how to design and employ Selenium to create robust and reliable automated tests that increase the efficiency and productivity of test teams and make for a capable and successful testing program.
The PAC aims to promote engagement between various experts from around the world, to create relevant, value-added content sharing between members. For Neotys, to strengthen our position as a thought leader in load & performance testing.
Since its beginning, the PAC is designed to connect performance experts during a single event. In June, during 24 hours, 20 participants convened exploring several topics on the minds of today’s performance tester such as DevOps, Shift Left/Right, Test Automation, Blockchain and Artificial Intelligence.
Nonfunctional Testing: Examine the Other Side of the CoinTechWell
Creating a highly available, scalable, and high-performing system requires a substantial amount of what we call nonfunctional testing. Developing nonfunctional testing skills is a must for many of today’s quality engineers (QEs). For the past several years, Balaji Arunachalam’s quality team for Intuit Core Services has experienced several highly available and disaster recovery buildup and testing challenges. Their journey includes the evolution of functional QEs into hybrid QEs who are capable of doing both functional and nonfunctional testing. Nonfunctional testing includes capacity, stability, benchmarking, FMEA/RAS, datacenter failover, and scalability testing. Balaji shares nonfunctional testing best practices, learnings, and mistakes they encountered on this journey. If you or your team is ready flip the coin and take a serious look at nonfunctional testing methods, opportunities, challenges, and solutions, this session is for you.
Andreas Grabner maintains that most performance and scalability problems don’t need a large or long running performance test or the expertise of a performance engineering guru. Don’t let anybody tell you that performance is too hard to practice because it actually is not. You can take the initiative and find these often serious defects. Andreas analyzed and spotted the performance and scalability issues in more than 200 applications last year. He shares his performance testing approaches and explores the top problem patterns that you can learn to spot in your apps. By looking at key metrics found in log files and performance monitoring data, you will learn to identify most problems with a single functional test and a simple five-user load test. The problem patterns Andreas explains are applicable to any type of technology and platform. Try out your new skills in your current testing project and take the first step toward becoming a performance diagnostic hero.
Is your company thinking about using Selenium to implement test automation in a joint development and operations environment? If your company has already started using Selenium, have you experienced execution or integration challenges? The path to a well-oiled and successful Selenium test automation program comes down to using the right techniques and development standards that incorporate modularity and flexibility. Jin Reck describes how to design effective web test automation development, and shares common challenges and solutions when implementing an automated testing framework in the real world. Jin shows how to incorporate Selenium with continuous integration platforms and discusses techniques, adjustments, lessons learned, and best practices from successful implementations. Leave with a better understanding of how to design and employ Selenium to create robust and reliable automated tests that increase the efficiency and productivity of test teams and make for a capable and successful testing program.
The PAC aims to promote engagement between various experts from around the world, to create relevant, value-added content sharing between members. For Neotys, to strengthen our position as a thought leader in load & performance testing.
Since its beginning, the PAC is designed to connect performance experts during a single event. In June, during 24 hours, 20 participants convened exploring several topics on the minds of today’s performance tester such as DevOps, Shift Left/Right, Test Automation, Blockchain and Artificial Intelligence.
[Webinar] Test First, Fail Fast - Simplifying the Tester's Transition to DevOpsKMS Technology
DevOps is a spectacular mish-mash of development and operations processes and practices that has been growing increasingly popular in recent years. With the upward trending rate in adoption comes the need for organizations to fully understand the key practices as well as thoroughly integrating team members, especially testers, throughout the delivery pipeline. Getting started with DevOps practices can be a little tricky when choosing the right tools, people, and processes. In this webinar, we’ll focus on helping you make the switch without diminishing the team’s delivered product quality, so that the transition meets the enterprise objectives of speed and reliability.
Tune in to learn:
The biggest concern when moving to DevOps - and how to handle it
Why you need ‘Coding Testers’
The best tools for the job
The process of failing fast, and its significance to testers
Measuring the transition - recommended metrics
The value of DevOps long-term - efficiency, repeatability & reliability
Don’t worry about failing - it’s a part of the process!
Continuous Load Testing with CloudTest and JenkinsSOASTA
Two key challenges to continuous load testing are provisioning a test system to handle the load and accessing load generators to drive the traffic.
In this webinar from SOASTA & CloudBees, you will learn how to:
Build realistic automated web performance tests and run them in Jenkins
Architect and launch a test environment that auto-provisions in the cloud
Manage a load generation grid to drive load tests in a lights-out mode
Establish a performance baseline in your daily Jenkins reports
A CLI based tool that simplifies the task of apex code quality management. ApexUnit simplifies the challenges of code quality management in a multi-tenant architecture [Patent pending]
The PAC aims to promote engagement between various experts from around the world, to create relevant, value-added content sharing between members. For Neotys, to strengthen our position as a thought leader in load & performance testing.
Since its beginning, the PAC is designed to connect performance experts during a single event. In June, during 24 hours, 20 participants convened exploring several topics on the minds of today’s performance tester such as DevOps, Shift Left/Right, Test Automation, Blockchain and Artificial Intelligence.
Casestudy: Continuously Delivering Fitness with Redgate DLMRed Gate Software
Presentation at SQL in The city 2016 by Jon Forster and James Smith.
Fitness First is the largest privately owned health club group in the world. It consists of more than 360 Fitness First clubs worldwide reaching just over 927,000 members in 16 countries. DevOpsGuys have transformed the way that Fitness First deliver changes to their core club management systems, through Continuous Delivery and DevOps principles, and building quality into the process was a primary concern.
In this talk, DevOpsGuys will illustrate how the Redgate DLM toolset has been successfully deployed to transform integration and regression testing of fast flowing changes across 16 countries, increasing visibility and creating a robust process.
Managing Continuous Delivery of Mobile Apps - for the EnterpriseSauce Labs
Enabling CI / CD in your mobile development process means understanding the different solutions, overcoming unique challenges and ensuring the right ownership of the processes. In this webinar, you will learn the steps required to enable Continuous Delivery of Mobile Application Platforms.
Engineering Netflix Global Operations in the CloudJosh Evans
Delivered at re:Invent 2015.
Operating a massively scalable, constantly changing, distributed global service is a daunting task. We innovate at breakneck speed to attract new customers and stay ahead of the competition. This means more features, more experiments, more deployments, more engineers making changes in production environments, and ever-increasing complexity. Simultaneously improving service availability and accelerating rate of change seems impossible on the surface. At Netflix, operations engineering is both a technical and organizational construct designed to accomplish just that by integrating disciplines like continuous delivery, fault injection, regional traffic management, crisis response, best practice automation, and real-time analytics. In this talk, designed for technical leaders seeking a path to operational excellence, we'll explore these disciplines in depth and how they integrate and create competitive advantages.
Decoupled System Interface Testing at FedExTechWell
If you work in a large-scale environment, you know how difficult it is to have all the systems “code complete” and ready for testing at the same time. In order to fully test end-to-end scenarios, you must be able to validate results in numerous systems. But what if all those systems are not available for you to begin testing? Chris Reites describes “decoupled testing,” an enterprise-level solution for managing interface data for capture, injection, simulation, and comparison all along your testing paths. Decoupled testing provides the ability to validate and independently test systems without having to rely on end-to-end testing. This is accomplished by capturing intermediate interface transactions at pre-determined, critical points during processing and comparing them against previously captured or generated expected results. Chris shares a case study on how this approach has benefited FedEx on critical customer-facing systems.
Embracing Failure - Fault Injection and Service Resilience at NetflixJosh Evans
A presentation given at AWS re:Invent on how Netflix induces failure to validate and harden production systems. Technologies discussed include the Simian Army (Chaos Monkey, Gorilla, Kong) and our next gen Failure Injection Test framework (FIT).
Strong practices for rails applications continuous deliveryRobb Kidd
High-velocity organizations deliver change to their customers quickly in a repeatable and predictable way. This talk will explore some pre-requisites and best practices that will help your team move to safe, continuous delivery of your Rails applications. We will demonstrate the path from code commit, to packaged application, to an updated production environment. All of the necessary steps along the way will be fully automated using Chef Delivery. You will leave with some new ideas, practices, and techniques your team can adopt, continuously delivering value to your customers.
In our recent webinar hosted by Mike Current, a member of the Hyland Upgrade Council, and Mark Hamilton, DataBank's Infrastructure Engineer, we expanded on how upgrading OnBase offers the ability to not only gain enhancements and fixes, but also radically improve the security, stability and architecture of your entire OnBase environment.
In this presentation you will...
1. Learn the formula for upgrade success with actionable items to work through right away
2. Understand the team needed to get the job done and how DataBank can step in to help
3. The importance of establishing a test environment and more
You can also watch the full webinar here: http://info.databankimx.com/Upgrade-Webinar-RCD.html
Download the Hyland 3rd Part Compatibility Matrix from slide #25 here: http://info.databankimx.com/rs/167-SSD-475/images/Third%20Party%20Product%20Compatibility%20Matrix.pdf
CloudTest Lite is the newest member of SOASTA’s growing line of CloudTest editions. It is an enterprise-class offering that enables rapid test creation and real-time resolution for performance testing early and often throughout the development lifecycle. Delivering internal testing behind the firewall on a single server, customers can execute performance tests of up to 100 concurrent virtual users in development, QA, staging or production. With CloudTest Lite, customers can:
- Test Web and mobile applications, including applications using the latest technologies from HTML5 to REST Web services
- Quickly build tests with visual test creation tools
- Integrate application, system, and network monitoring data
- Analyze results in real-time through an interactive, integrated dashboard
- Easily upgrade to a more scalable CloudTest edition to meet expanding testing requirements
Meet Big Agile: Testing on Large-Scale ProjectsTechWell
Are you embarking on a large-scale, globally distributed, multi-team scrum project? Have you already identified the potential testing challenges that lie ahead? Or have you belatedly encountered them and are now working on them in real-time? Five years and more than 200 projects into its agile journey, Dell Enterprise Solutions (ESG) has empirically determined that once a project extends beyond three scrum teams, interesting testing challenges arise—inconsistent “done” criteria, integration testing underscored by epic/story interdependencies across teams, test automation inconsistency, and uncoordinated regression testing. Worse yet, the more teams involved, the less likely it is that a single scrum team has the visibility to validate the overall product from a customer usage perspective as the product evolves through sprints. Geoff Meyer serves up some lessons learned from within the Dell ESG Validation organization as it evolved its agile testing and automation strategies from a waterfall-based environment to one that fully embraced agile Scrum across its entire software product portfolio.
Adopting Cloud Testing for Continuous Delivery, with the premier global provi...SOASTA
IDC, the premier global provider of IT market research, and SOASTA, an IDC industry leader in cloud testing know that maintaining leadership means moving quickly to outpace the competition. Both IDC and SOASTA work with clients to realize the benefits that cloud computing brings to delivering high quality, rapidly deployable web and mobile applications.
Join them in this webinar where you will hear:
IDC speak on:
Perspectives on the state of cloud computing for agile web and mobile development
Market dynamics and maturity around the cloud and cloud testing
Recommendations for getting started with cloud testing
SOASTA speak on:
The business drivers for cloud and virtualization
Customer goals of using and implementing cloud testing
The road to implementing cloud testing in a continuous integration model
Case studies of customer cloud testing success
SOASTA’s services and technology will be highlighted and demonstrated as a solution for continuous web and mobile testing as utilized by the Paychex team.
Who Should Attend?
Senior IT Management
Development and QA Executives and Directors
Performance team leads and engineers
Test Automation leads and engineers
Mobile Development and Testing team leads and engineers
Agile Testing at Etsy: How and Why It WorksTechWell
Growing team skill sets, resource management, pipeline management, career development, career definition, scaling issues, and optimizing efficiencies are just a few of the problems agile QA test teams face. If you have asked yourself How can I do more with less?, How can I increase the impact of QA testing at my organization?, or How is the QA testing helping or hurting product launches?, then don’t miss this stimulating presentation! Join Arylee McSweaney as she shares Etsy’s value driven—yet individualistic—approach to quality assurance testing. Learn how this small, QA team meets these challenges while continuing to deliver high-quality features on multiple platforms within a continuous integration model. Consider the advantages of value-driven QA test teams, the benefits a centralized testing resource, and the opportunities available for team members to thrive in agile career paths. Discover alternative opportunities to introduce confidence into product launches, mitigate resource burnout, and consider the impact that can be enjoyed when testing becomes everyone’s responsibility.
Testing in an Agile World: The Current State and Future PossibilitiesTechWell
Delivering high quality applications in an agile world is becoming more complex and challenging because of the changes the web and mobile are undergoing. Web testing continues to get much more difficult due to: increasing use of open technologies (HTML, JavaScript, and CSS) and web components in apps; lengthening the approval processes for plugins; and Chrome, Mozilla, and Edge browsers blocking specific APIs. On the mobile front, Apple, Google, and Microsoft are making it easier for developers to build cross-platform apps, resulting in more to test in less time. With releases such as Windows 10, the lines between desktop and mobile continue to blur. Nikhil Kaul presents an overview of recent technological trends and discusses why they necessitate an alteration in existing agile testing practices. He shares how the transition to technologies like React and React Native is causing the worlds of mobile and web testing to collide. Nikhil shows how, by employing reusability practices and following a modular test design, testers can better prepare for these developments.
[Webinar] Test First, Fail Fast - Simplifying the Tester's Transition to DevOpsKMS Technology
DevOps is a spectacular mish-mash of development and operations processes and practices that has been growing increasingly popular in recent years. With the upward trending rate in adoption comes the need for organizations to fully understand the key practices as well as thoroughly integrating team members, especially testers, throughout the delivery pipeline. Getting started with DevOps practices can be a little tricky when choosing the right tools, people, and processes. In this webinar, we’ll focus on helping you make the switch without diminishing the team’s delivered product quality, so that the transition meets the enterprise objectives of speed and reliability.
Tune in to learn:
The biggest concern when moving to DevOps - and how to handle it
Why you need ‘Coding Testers’
The best tools for the job
The process of failing fast, and its significance to testers
Measuring the transition - recommended metrics
The value of DevOps long-term - efficiency, repeatability & reliability
Don’t worry about failing - it’s a part of the process!
Continuous Load Testing with CloudTest and JenkinsSOASTA
Two key challenges to continuous load testing are provisioning a test system to handle the load and accessing load generators to drive the traffic.
In this webinar from SOASTA & CloudBees, you will learn how to:
Build realistic automated web performance tests and run them in Jenkins
Architect and launch a test environment that auto-provisions in the cloud
Manage a load generation grid to drive load tests in a lights-out mode
Establish a performance baseline in your daily Jenkins reports
A CLI based tool that simplifies the task of apex code quality management. ApexUnit simplifies the challenges of code quality management in a multi-tenant architecture [Patent pending]
The PAC aims to promote engagement between various experts from around the world, to create relevant, value-added content sharing between members. For Neotys, to strengthen our position as a thought leader in load & performance testing.
Since its beginning, the PAC is designed to connect performance experts during a single event. In June, during 24 hours, 20 participants convened exploring several topics on the minds of today’s performance tester such as DevOps, Shift Left/Right, Test Automation, Blockchain and Artificial Intelligence.
Casestudy: Continuously Delivering Fitness with Redgate DLMRed Gate Software
Presentation at SQL in The city 2016 by Jon Forster and James Smith.
Fitness First is the largest privately owned health club group in the world. It consists of more than 360 Fitness First clubs worldwide reaching just over 927,000 members in 16 countries. DevOpsGuys have transformed the way that Fitness First deliver changes to their core club management systems, through Continuous Delivery and DevOps principles, and building quality into the process was a primary concern.
In this talk, DevOpsGuys will illustrate how the Redgate DLM toolset has been successfully deployed to transform integration and regression testing of fast flowing changes across 16 countries, increasing visibility and creating a robust process.
Managing Continuous Delivery of Mobile Apps - for the EnterpriseSauce Labs
Enabling CI / CD in your mobile development process means understanding the different solutions, overcoming unique challenges and ensuring the right ownership of the processes. In this webinar, you will learn the steps required to enable Continuous Delivery of Mobile Application Platforms.
Engineering Netflix Global Operations in the CloudJosh Evans
Delivered at re:Invent 2015.
Operating a massively scalable, constantly changing, distributed global service is a daunting task. We innovate at breakneck speed to attract new customers and stay ahead of the competition. This means more features, more experiments, more deployments, more engineers making changes in production environments, and ever-increasing complexity. Simultaneously improving service availability and accelerating rate of change seems impossible on the surface. At Netflix, operations engineering is both a technical and organizational construct designed to accomplish just that by integrating disciplines like continuous delivery, fault injection, regional traffic management, crisis response, best practice automation, and real-time analytics. In this talk, designed for technical leaders seeking a path to operational excellence, we'll explore these disciplines in depth and how they integrate and create competitive advantages.
Decoupled System Interface Testing at FedExTechWell
If you work in a large-scale environment, you know how difficult it is to have all the systems “code complete” and ready for testing at the same time. In order to fully test end-to-end scenarios, you must be able to validate results in numerous systems. But what if all those systems are not available for you to begin testing? Chris Reites describes “decoupled testing,” an enterprise-level solution for managing interface data for capture, injection, simulation, and comparison all along your testing paths. Decoupled testing provides the ability to validate and independently test systems without having to rely on end-to-end testing. This is accomplished by capturing intermediate interface transactions at pre-determined, critical points during processing and comparing them against previously captured or generated expected results. Chris shares a case study on how this approach has benefited FedEx on critical customer-facing systems.
Embracing Failure - Fault Injection and Service Resilience at NetflixJosh Evans
A presentation given at AWS re:Invent on how Netflix induces failure to validate and harden production systems. Technologies discussed include the Simian Army (Chaos Monkey, Gorilla, Kong) and our next gen Failure Injection Test framework (FIT).
Strong practices for rails applications continuous deliveryRobb Kidd
High-velocity organizations deliver change to their customers quickly in a repeatable and predictable way. This talk will explore some pre-requisites and best practices that will help your team move to safe, continuous delivery of your Rails applications. We will demonstrate the path from code commit, to packaged application, to an updated production environment. All of the necessary steps along the way will be fully automated using Chef Delivery. You will leave with some new ideas, practices, and techniques your team can adopt, continuously delivering value to your customers.
In our recent webinar hosted by Mike Current, a member of the Hyland Upgrade Council, and Mark Hamilton, DataBank's Infrastructure Engineer, we expanded on how upgrading OnBase offers the ability to not only gain enhancements and fixes, but also radically improve the security, stability and architecture of your entire OnBase environment.
In this presentation you will...
1. Learn the formula for upgrade success with actionable items to work through right away
2. Understand the team needed to get the job done and how DataBank can step in to help
3. The importance of establishing a test environment and more
You can also watch the full webinar here: http://info.databankimx.com/Upgrade-Webinar-RCD.html
Download the Hyland 3rd Part Compatibility Matrix from slide #25 here: http://info.databankimx.com/rs/167-SSD-475/images/Third%20Party%20Product%20Compatibility%20Matrix.pdf
CloudTest Lite is the newest member of SOASTA’s growing line of CloudTest editions. It is an enterprise-class offering that enables rapid test creation and real-time resolution for performance testing early and often throughout the development lifecycle. Delivering internal testing behind the firewall on a single server, customers can execute performance tests of up to 100 concurrent virtual users in development, QA, staging or production. With CloudTest Lite, customers can:
- Test Web and mobile applications, including applications using the latest technologies from HTML5 to REST Web services
- Quickly build tests with visual test creation tools
- Integrate application, system, and network monitoring data
- Analyze results in real-time through an interactive, integrated dashboard
- Easily upgrade to a more scalable CloudTest edition to meet expanding testing requirements
Meet Big Agile: Testing on Large-Scale ProjectsTechWell
Are you embarking on a large-scale, globally distributed, multi-team scrum project? Have you already identified the potential testing challenges that lie ahead? Or have you belatedly encountered them and are now working on them in real-time? Five years and more than 200 projects into its agile journey, Dell Enterprise Solutions (ESG) has empirically determined that once a project extends beyond three scrum teams, interesting testing challenges arise—inconsistent “done” criteria, integration testing underscored by epic/story interdependencies across teams, test automation inconsistency, and uncoordinated regression testing. Worse yet, the more teams involved, the less likely it is that a single scrum team has the visibility to validate the overall product from a customer usage perspective as the product evolves through sprints. Geoff Meyer serves up some lessons learned from within the Dell ESG Validation organization as it evolved its agile testing and automation strategies from a waterfall-based environment to one that fully embraced agile Scrum across its entire software product portfolio.
Adopting Cloud Testing for Continuous Delivery, with the premier global provi...SOASTA
IDC, the premier global provider of IT market research, and SOASTA, an IDC industry leader in cloud testing know that maintaining leadership means moving quickly to outpace the competition. Both IDC and SOASTA work with clients to realize the benefits that cloud computing brings to delivering high quality, rapidly deployable web and mobile applications.
Join them in this webinar where you will hear:
IDC speak on:
Perspectives on the state of cloud computing for agile web and mobile development
Market dynamics and maturity around the cloud and cloud testing
Recommendations for getting started with cloud testing
SOASTA speak on:
The business drivers for cloud and virtualization
Customer goals of using and implementing cloud testing
The road to implementing cloud testing in a continuous integration model
Case studies of customer cloud testing success
SOASTA’s services and technology will be highlighted and demonstrated as a solution for continuous web and mobile testing as utilized by the Paychex team.
Who Should Attend?
Senior IT Management
Development and QA Executives and Directors
Performance team leads and engineers
Test Automation leads and engineers
Mobile Development and Testing team leads and engineers
Agile Testing at Etsy: How and Why It WorksTechWell
Growing team skill sets, resource management, pipeline management, career development, career definition, scaling issues, and optimizing efficiencies are just a few of the problems agile QA test teams face. If you have asked yourself How can I do more with less?, How can I increase the impact of QA testing at my organization?, or How is the QA testing helping or hurting product launches?, then don’t miss this stimulating presentation! Join Arylee McSweaney as she shares Etsy’s value driven—yet individualistic—approach to quality assurance testing. Learn how this small, QA team meets these challenges while continuing to deliver high-quality features on multiple platforms within a continuous integration model. Consider the advantages of value-driven QA test teams, the benefits a centralized testing resource, and the opportunities available for team members to thrive in agile career paths. Discover alternative opportunities to introduce confidence into product launches, mitigate resource burnout, and consider the impact that can be enjoyed when testing becomes everyone’s responsibility.
Testing in an Agile World: The Current State and Future PossibilitiesTechWell
Delivering high quality applications in an agile world is becoming more complex and challenging because of the changes the web and mobile are undergoing. Web testing continues to get much more difficult due to: increasing use of open technologies (HTML, JavaScript, and CSS) and web components in apps; lengthening the approval processes for plugins; and Chrome, Mozilla, and Edge browsers blocking specific APIs. On the mobile front, Apple, Google, and Microsoft are making it easier for developers to build cross-platform apps, resulting in more to test in less time. With releases such as Windows 10, the lines between desktop and mobile continue to blur. Nikhil Kaul presents an overview of recent technological trends and discusses why they necessitate an alteration in existing agile testing practices. He shares how the transition to technologies like React and React Native is causing the worlds of mobile and web testing to collide. Nikhil shows how, by employing reusability practices and following a modular test design, testers can better prepare for these developments.
Big Data, Big Trouble: Getting into the Flow of Hadoop TestingTechWell
Big Data, one of the latest buzzwords in our industry, involves working with petabytes of data captured by various systems and making sense of that data in some way. Maryam Umar has found that testing systems like Hadoop is very challenging because of the frequency with which the data arrives in the system, the number of jobs that run to process that data, and the interdependency of the data. Maryam describes some of the projects at Hotels.com which involve identifying multiple users and using that data to make recommendations of hotels. Testing this is fairly difficult as we need an ability to represent the jobs being executed in the Hadoop ecosystem with an appropriate test tool. Maryam presents a few examples of how she has been able to overcome this challenge using the Oozie workflow coordinator as a test tool that works with the Hadoop file system (HDFS). She demonstrates how test code can be written in a non-testing tool to help gain confidence in the data produced as a result of running a job processor.
You've been through some initial automation bootstrapping and training. You're now three to six months down the road and spending too much time chasing intermittent test failures and maintaining your scripts. You're dealing with frustration and trust issues in the automated tests. What you're not doing is adding a lot of value around new feature work. Sound familiar? Jim Holmes says that pattern is common across nearly every team that is new to building significant automation suites. Jim helps you with a few approaches—all based on his years of experience and hard knocks—that may just save your sanity. This isn't a WebDriver 101 session. Jim won't be covering basics like waits, find logic, or basic page objects. Instead, he'll dive right into solving problems using software craftsmanship principles, custom-designed APIs, and approaches like Selenium Grid to help you scale up your test suites via parallel execution. Leave Jim’s session with practical tips to apply to your own testing.
Capital One’s highly integrated environment creates many interdependencies for its agile teams. Because these dependencies were not being completed until late in their sprints, Adam Auerbach says that Capital One faced prolonged integration and regression testing phases and did not realize expected improvements in quality or time-to-market. As technology leaders pushed for continuous delivery (CD), testing needed to shift left and occur simultaneously with development. To shift left, the testing community needed to learn basic development skills, including Ruby and Java, to take advantage of advanced automation practices, service virtualization, and the continuous integration (CI) pipeline. Adam shares Capital One’s experience implementing continuous testing and describes its core principles. He explains service virtualization and the CI/CD pipeline and why they are important concepts for testers to understand and leverage. Since continuous testing is not easy and many companies have large organizations of manual testers, Adam provides a learning map that will help organizations plan the transition.
Testing in a Continuous Delivery Pipeline: Faster, Better, CheaperTechWell
The continuous delivery pipeline is the process of taking new or changed features from developers, and getting features deployed into production and delivered quickly to the customer. Gene Gotimer says testing within continuous delivery pipelines should be designed so the earliest tests are the quickest and easiest to run, giving developers the fastest feedback. Successive rounds of testing lead to increased confidence that the code is a viable candidate for production and that more expensive tests—time, effort, cost—are justified. Manual testing is performed toward the end of the pipeline, leaving computers to do as much work as possible before people get involved. Although it is tempting to arrange the delivery pipeline in phases (e.g., functional tests, then acceptance tests, then load and performance tests, then security tests), this can lead to serious problems progressing far down the pipeline before they are caught. Gene shows how to arrange your tests so each round provides just enough testing to give you confidence that the next set of tests is worth the investment. He explores how to get the right types of testing into your pipeline at the right points.
Agile Metrics: Make Better Decisions with DataTechWell
Some consider measurement in agile development destructive—or at the very least useless. Larry Maccherone disagrees and offers insight into how you can use metrics in an agile environment to make life better. How do you know when you are ready to introduce metrics into the environment? What are the sources for these metrics? What tools and techniques are necessary to make decisions probabilistically? What are the mindset shifts necessary for metrics to help you making better decisions? How do teams and organizations avoid the anti-patterns that so often derail a metrics program? Larry answers these questions and shows how to create a culture where measurement is an insight amplification and feedback mechanism—not a club to beat people up; where your teams seek out—rather than dread—the use of quantitative insight; and where metrics bring stakeholders and teams closer together—not drive them apart. Leave with the vision and understanding necessary to implement your own metrics regimen and make better decisions with data.
It’s Time to Automate Your Exploratory TestingTechWell
Exploratory testing (ET) is a great complement to traditional test approaches. Testing professionals often see ET as an approach for manual testing. However, trying to organize ET from a test process perspective can be a challenge. There is an important question to ask—and answer: Is exploratory testing compatible with test automation? Jim Trentadue explores how automated test cases can be designed to include provisions for exploratory testing. Examples of this are data used in input fields, navigating various paths in your application, encountering unexpected active windows in the system under test, interfacing to other systems, or intermittent data injection. The goal is to wrap a level of structure around ET using test automation and ultimately produce more and better exploratory scenarios than would otherwise be possible. Each automated test result reports on the findings from your exploratory tests, allowing the tester to evaluate his efforts more readily and take action more rapidly. This is the time to explore automating your exploratory testing.
Adaptive Automation: Tests that Recover Instead of FailingTechWell
Are you tired of flaky automation scripts that fail without apparent cause? Are most script failures due to bugs in the test script rather than bugs in the product? Do you simply want to get more out of your automation framework? Many testers and organizations are frustrated with the high cost and low return of their automation frameworks. Scott Miles shares a range of techniques to convert your existing framework from brittle to adaptive. Learn how to improve the quality of your automation framework while reducing the required maintenance. Adaptive automation frameworks can locate modified UI elements that no longer match the previous selector, recover from unexpected interruptions in the test, and automatically update a test script when a change is detected. Scott says that the best part of adaptive automation techniques is that they can be applied to most existing frameworks without purchasing new tools or needing to re-write existing tests.
Agile Strategies for Traditional Software Development TeamsTechWell
Many development and test teams are still working on more traditional software projects that release every few months or longer, rather than daily or weekly. Benefits of adopting continuous development strategies into a standard software cycle include immediate feedback on code changes, a clear understanding of the current risk-state of the software, and current and historical data to assess progress. Melanie Drake shares specific “modern” strategies that her development team has added and how these strategies enhance software quality. Some tools include continuous integration to catch build errors; continuous test runs with baseline tests to catch egregious errors; automated tests to free testers to spend more time testing purposefully; and developer-contributed changelist-level tools, which help narrow found problems to specific changes. Processes and tools evolve over time, and you don't have to adopt all strategies at once. Melanie shows how you can adopt strategies piecemeal, as they fit best for your team and your product. In the end, your processes serve you and your product—not the other way around.
Agile Testing Process Analytics: From Data to Insightful InformationTechWell
In recent years, businesses have raised their expectations for development projects while cutting back on financial resources and demanding shorter production cycles. Jonathan Alexander says that to meet these growing demands and succeed as a testing manager, you need to leverage agile process data and insights to make critical decisions about your team and strategy. However, this is no easy task with everything there is to look at during a development project. How do managers distinguish meaningful data from meaningless data? Jonathan shares the analytics that agile development and testing teams can use to improve quality and efficiency. Data presented comes from the QASymphony labs, where the analytics team works with anonymized data gathered from hundreds of development organizations to find meaningful and useful testing metrics. In this session, learn about testing and quality metrics specifically useful to agile teams, analytics to improve quality and testing efficiency, and processes to make test teams more agile.
IoT Software Testing Challenges: The IoT World Is Really DifferentTechWell
With billions of devices containing new software connected to the Internet, the Internet of Things (IoT) is poised to become the next growth area for software development and testing. Although many traditional test techniques and strategies remain viable, challenges in IoT testing include huge amounts of data, multiple communication channels, device protocols, resource limitations (battery or memory), addressing sensors and controllers, cloud-hardware-device integration, and security concerns. Jon Hagar says that for IoT testers to be successful, they must develop new knowledge and skills, and apply them based on real data and proven test design methods. Testing analytics should include raw test data, data relationships across software integration boundaries, and social media inputs, as well as a keen understanding of sociological and psychological factors. Jon shares insights into math-based testing, model-based testing, attack-based exploratory testing, and appropriate types of standards as basics of IoT testing. Take back a new holistic view for your IoT testing which considers the world environment, connected systems, local systems, and the IoT device itself.
Making the Move to Behavior-Driven DevelopmentTechWell
Behavior-driven development (BDD) is a hot topic in the development community. Not only does a properly implemented BDD process help drive increased automation and quicker development cycles, it also facilitates better collaboration between departments and reduces siloed communication. An ideal partner of continuous integration/delivery, BDD can help solve many testing bottlenecks associated with DevOps. For all its benefits, BDD is underadopted. Only 10–25 percent of development organizations have implemented or are experimenting with a BDD process. Organizations are hesitant to transition to BDD from their current approach for many reasons, typically focusing on people, process, and technology changes. Kevin Dunne presents a successful framework for considering any potential roadblocks, evaluating your readiness for change, and making a seamless transition. Agile is an approach centered around continuous improvement, and Kevin provides plenty of takeaways for teams who are just learning about BDD, for teams who have undergone a stable transition—and for those teams that are somewhere in between.
Mobile testing is getting harder—more devices, multiple operating systems, higher quality expectations, and shorter development cycles. How do you deal with these demands? In order to align mobile testing with product strategies and market goals, Tom Chavez says you first need to (1) know your users and how they will use your app. (2) Knowing the app and how users may actually be using it differently are key to testing to satisfy users—not the designers. (3) With test case matrices vastly larger than ever, prioritizing tests into “must-haves” and “nice-to-haves” is necessary to make the testing process manageable. With so many devices on the market, you have to (4) determine which are required for testing, which are optional, which to purchase, and which you might borrow or rent from a device cloud. Tom advises (5) how to know which tests to automate, which should remain manual, and (6) how back-end performance affects user experience. And finally, (7) know your edges. Learn the key strategies for mobile testing and this seven-step process with the tools you can use to deliver the testing to meet your project goals.
A DevOps Primer: Whole Team Approaches for Better Software QualityTechWell
With fingers wagging and eyes squinting, they query Why didn’t you find this problem during testing? How many times have you tried to defend yourself with things like We can’t test everything or It’s a corner case? Everyone knows you can’t improve quality with testing alone, so what can you do? Marianne Hollier shares practices and tools that help improve your test effectiveness and overall software quality. Learn how early collaboration across your whole team can remove bottlenecks and surprises. See how capturing and agreeing on interfaces between dependent systems can eliminate common issues that occur when systems are finally integrated for testing and nothing works. Understand how service virtualization and test automation go hand-in-hand to get your testing effort started earlier to achieve higher coverage more quickly. Join Marianne to learn how continuous integration and continuous deployment can get your test environments ready to test immediately after a new build is made—with no wasted time.
Although Lee Hawkins stumbled into testing—in 1999 after migrating from the UK to Australia amid a tech boom time—he has since become a passionate member of the worldwide testing community and currently holds the title of principal test architect. So, what does that really mean? A test architect at Dell Software provides technical leadership and strategic direction for testing, and Lee describes what that means in his day-to-day work. His position involves advocacy for great new testing ideas gleaned from the wider testing community, mentoring new testers, and coaching testing teams in using context-appropriate approaches to their work. This leadership role extends beyond Dell, too, so a typical day might include sharing knowledge with a meetup group, blogging on a testing topic, or helping a new speaker with a conference proposal. Join Lee to discover that testing is far from being a dead-end career and learn how you can become an active participant in your testing community.
Load Testing Best Practices: Application complexity is increasing, yet the stringent requirements for web performance is increasing exponentially. Learn more about the three major types of load testing, determine which you need and how to conduct them.
Holiday Readiness: Best Practices for Successful Holiday Readiness TestingApica
Best Practices for Successful Holiday Readiness Testing: Are you already thinking of, and planning for Black Friday? Learn which load tests to use and why to load test early and often so that you are prepared for the holidays.
Load testing with Visual Studio and Azure - Andrew SiemerAndrew Siemer
In this presentation we will look at what web performance testing is and the various types of testing that can be performed. We will then dig into Visual Studio 2013 Ultimate to see that the Visual Studio platform is now a real contender in performance testing automation. And we will see how the Visual Studio integration with Visual Studio Online and Azure can take your web performance tests and spin up impressive load tests in a truly useful way.
My talk delivered on 10th of April 2014 in Bristol at ACCU Conference.
This is the combination of a few talks I delivered over 2012 and 2013 with some latest updates.
This is an experience report based on the work of many developers from Atlassian and Spartez working for years on Atlassian JIRA.
If you have (or going to have) thousands of automated tests and you are interested how it may impact you, this presentation is for you.
Continuous Load Testing with CloudTest and JenkinsSOASTA
Two key challenges to continuous load testing are provisioning a test system to handle the load and accessing load generators to drive the traffic.
In this webinar from SOASTA & CloudBees, you will learn how to:
Build realistic automated web performance tests and run them in Jenkins
Architect and launch a test environment that auto-provisions in the cloud
Manage a load generation grid to drive load tests in a lights-out mode
Establish a performance baseline in your daily Jenkins reports
App Dyanmics & SOASTA Testing & Monitoring Coverage, March 2012SOASTA
Dan Bartow, VP Performance Engineering, SOASTA and Steve Burton, Technology Evangelist, AppDynamics discuss the convergence of two traditionally separate domains and also demo testing and troubleshooting with CloudTest & AppDynamics.
Arthur Hicken Chief Evangelist of Parasoft @ PSQT 2016 discusses:
• What the shift from automated to
continuous means
• How disruption requires changes to how
we test software
• Addressing gaps between Dev and Ops
• Technologies that enable Continuous
In this webinar, Skytap and Sky IT Group share tips and advanced technology for how to build better software faster using cloud-based dev/test environments.
Similar to Comprehensive Performance Testing: From Early Dev to Live Production (20)
Do you ever feel you have lost confidence in your own abilities? Why does this happen? Isabel Evans spends a lot of time painting. Someone once commented, “Why are you doing this, when you are not very good at it?” And gradually she stopped drawing and painting, after being intimidated by a conventional vision of what good art should look like. At the same time, she experienced a parallel loss of confidence in her professional abilities. Attempting creative pursuits like drawing and painting is essential to cognitive, emotional, creative abilities and she began to understand the correlation between her creative activities and her confidence. Making errors, being wrong, failing – that is a generous gift we receive when we practice outside our skill level. By staying in a comfort zone and repeating successes, we stagnate. As Isabel started to create again she thought “I don’t feel good at it, I do feel good doing it” The difference was that she was learning, having ideas and the act of re-engaging with failure, together with the comradeship of friends and colleagues, including at Women Who Test, Isabel has regained her confidence in her professional abilities, and been able to reboot her career and joy. Join Isabel to share a journey from self-perceived failure, to recovery and renewed learning.
Instill a DevOps Testing Culture in Your Team and Organization TechWell
The DevOps movement is here. Companies across many industries are breaking down siloed IT departments and federating them into product development teams. Testing and its practices are at the heart of these changes. Traditionally, IT organizations have been staffed with mostly manual testers and a limited number of automation and performance engineers. To keep pace with development in the new “you build it, you own it” environment, testing teams and individuals must develop new technical skills and even embrace coding to stay relevant and add greater value to the business. DevOps really starts with testing. Join Adam Auerbach as he explains what DevOps is and how it relates to testing. He describes how testing must change from top to bottom and how to access your own environment to identify improvement opportunities. Adam dives into practices like service virtualization, test data management, and continuous testing so you can understand where you are now and identify steps needed to instill a DevOps testing culture in your team and organization.
Test Design for Fully Automated Build ArchitectureTechWell
Imagine this … As soon as any developed functionality is submitted into the code repository, it is automatically subjected to the appropriate battery of tests and then released straight into production. Setting up the pipeline capable of doing just that is becoming more and more common and something you need to know about. But most organizations hit the same stumbling block—just what IS the appropriate battery of tests? Automated build architectures don't always lend themselves well to the traditional stages of testing. In this hands-on tutorial, Melissa Benua introduces you to key test design principles—applicable to organizations both large and small—that allow you to take full advantage of the pipeline's capabilities without introducing unnecessary bottlenecks. Learn how to make highly reliable tests that run fast and preserve just enough information to let testers and developers determine exactly what went wrong and how to reproduce the error locally. Explore ways to reduce overlap while still maintaining adequate test coverage. Take back ideas about which test areas could benefit from being combined into a single suite and which areas could benefit most from being broken out altogether.
System-Level Test Automation: Ensuring a Good StartTechWell
Many organizations invest a lot of effort in test automation at the system level but then have serious problems later on. As a leader, how can you ensure that your new automation efforts will get off to a good start? What can you do to ensure that your automation work provides continuing value? This tutorial covers both “theory” and “practice”. Dot Graham explains the critical issues for getting a good start, and Chris Loder describes his experiences in getting good automation started at a number of companies. The tutorial covers the most important management issues you must address for test automation success, particularly when you are new to automation, and how to choose the best approaches for your organization—no matter which automation tools you use. Focusing on system level testing, Dot and Chris explain how automation affects staffing, who should be responsible for which automation tasks, how managers can best support automation efforts to promote success, what you can realistically expect in benefits and how to report them. They explain—for non-techies—the key technical issues that can make or break your automation effort. Come away with your own clarified automation objectives, and a draft test automation strategy to use to plan your own system-level test automation.
Build Your Mobile App Quality and Test StrategyTechWell
Let’s build a mobile app quality and testing strategy together. Whether you have a web, hybrid, or native app, building a quality and testing strategy means (1) knowing what data and tools you have available to make agile decisions, (2) understanding your customers and your competitors, and (3) testing your app under real-world conditions. Jason Arbon guides you through the latest techniques, data, and tools to ensure the awesomeness of your mobile app quality and testing strategy. Leave this interactive session with a strategy for your very own app—or one you pretend to own. The information Jason shares is based on data from Appdiff’s next-gen mobile app testing platform, lessons from Applause/uTest’s crowd, text mining hundreds of millions of app store reviews, and in-depth discussions with top mobile app development teams.
Testing Transformation: The Art and Science for SuccessTechWell
Technologies, testing processes, and the role of the tester have evolved significantly in the past few years with the advent of agile, DevOps, and other new technologies. It is critical that we testing professionals evaluate ourselves and continue to add tangible value to our organizations. In your work, are you focused on the trivial or on real game changers? Jennifer Bonine describes critical elements that help you artfully blend people, process, and technology to create a synergistic relationship that adds value. Jennifer shares ideas on mastering politics, maneuvering core vs. context, and innovating your technology strategies and processes. She explores how new processes can be introduced in an organization, what the role of organizational culture is in determining the success of a project, and how you can know what tools will add value vs. simply adding overhead and complexity. Jennifer reviews critically needed tester skills and discusses a continual learning model to evolve your skills and stay relevant. This discussion can lead you to technologies, processes, and skills you can stake your career on.
We’ve all been there. We work incredibly hard to develop a feature and design tests based on written requirements. We build a detailed test plan that aligns the tests with the software and the documented business needs. And when we put the tests to the software, it all falls apart because the requirements were changed without informing everyone. Mary Thorn says help is at hand. Enter behavior-driven development (BDD), and Cucumber and SpecFlow, tools for running automated acceptance tests and facilitating BDD. Mary explores the nuances of Cucumber and SpecFlow, and shows you how to implement BDD and agile acceptance testing. By fostering collaboration for implementing active requirements via a common language and format, Cucumber and SpecFlow bridge the communication gap between business stakeholders and implementation teams. In this workshop, practice writing feature files with the best practices Mary has discovered over numerous implementations. If you experience developers not coding to requirements, testers not getting requirements updates, or customers who feel out of the loop and don’t get what they ask for, Mary has answers for you.
Develop WebDriver Automated Tests—and Keep Your SanityTechWell
Many teams go crazy because of brittle, high-maintenance automated test suites. Jim Holmes helps you understand how to create a flexible, maintainable, high-value suite of functional tests using Selenium WebDriver. Learn the basics of what to test, what not to test, and how to avoid overlapping with other types of testing. Jim includes both philosophical concepts and hands-on coding. Testers who haven't written code should not be intimidated! We'll pair you up to make sure you're successful. Learn to create practical tests dealing with advanced situations such as input validation, AJAX delays, and working with file downloads. Additionally, discover when you need to work together with developers to create a system that's more easily testable. This tutorial focuses primarily on automating web tests, but many of the same concepts can be applied to other UI environments. Demos and labs will be in C# and Java using WebDriver. Leave this tutorial having learned how to write high-value WebDriver tests—and stay sane while doing so.
DevOps is a cultural shift aimed at streamlining intergroup communication and improving operational efficiency for development and operations groups. Over time, inclusion of other IT groups under the DevOps umbrella has become the norm for many organizations. But even broadening the boundaries of DevOps, the conversation has been largely devoid of the business units’ place at the table. A common mistake organizations make while going through the DevOps transformation is drawing a line at the IT boundary. If that occurs, a larger, more inclusive silo within the organization is created, operating in an informational vacuum and causing operational inefficiency and goal misalignment. Sharing his experiences working on both sides of the fence, Leon Fayer describes the importance of including business units in order to align technology decisions with business goals. Leon discusses inclusion of business units in existing agile processes, benefits of cross-departmental monitoring, and a business-first approach to technology decisions.
Eliminate Cloud Waste with a Holistic DevOps StrategyTechWell
Chris Parlette maintains that renting infrastructure on demand is the most disruptive trend in IT in decades. In 2016, enterprises spent $23B on public cloud IaaS services. By 2020, that figure is expected to reach $65B. The public cloud is now used like a utility, and like any utility, there is waste. Who's responsible for optimizing the infrastructure and reducing wasted expenses? It’s DevOps. The excess expense, known as cloud waste, comprises several interrelated problems: services running when they don't need to be, improperly sized infrastructure, orphaned resources, and shadow IT. There are a few core tenets of DevOps—holistic thinking, no silos, rapid useful feedback, and automation—that can be applied to reducing your cloud waste. Join Chris to learn why you should include continuous cost optimization in your DevOps processes. Automate cost control, reduce your cloud expenses, and make your life easier.
Transform Test Organizations for the New World of DevOpsTechWell
With the recent emergence of DevOps across the industry, testing organizations are being challenged to transform themselves significantly within a short period of time to stay meaningful within their organizations. It’s not easy to plan and approach these changes considering the way testing organizations have remained structured for ages. These challenges start from foundational organizational structures and can cut across leadership influence, competencies, tools strategy, infrastructure, and other dimensions. Sumit Kumar shares his experience assisting various organizations to overcome these challenges using an organized DevOps enablement framework. The framework includes radical restructuring, turning the tools strategy upside down, a multidimensional workforce enablement supported by infrastructure changes, redeveloped collaborations models, and more. From his real world experiences Sumit shares tips for approaching this journey and explains the roadmap for testing organizations to transform themselves to lead the quality in DevOps.
The Fourth Constraint in Project Delivery—LeadershipTechWell
All too often, the triple constraints—time, cost, and quality—are bandied about as if they are the be-all, end-all. While they are important, leadership—the fourth and larger underpinning constraint—influences the first three. Statistics on project success and failure abound, and these measurements are usually taken against the triple constraints. According to the Project Management Institute, only 53 percent of projects are completed within budget, and only 49 percent are completed on time. If so many projects overrun budget and are late, we can’t really say, “Good, fast, or cheap—pick two.” Rob Burkett talks about leadership at every level of a team. He shares his insights and stories gleaned from his years of IT and project management experience. Rob speaks to some of the glaring difficulties in the workplace in general and some specifically related to IT delivery and project management. Leave with a clearer understanding of how to communicate with teams and team members, and gain a better understanding of how you can be a leader—up and down your organization.
Resolve the Contradiction of Specialists within Agile TeamsTechWell
As teams grow, organizations often draw a distinction between feature teams, which deliver the visible business value to the user, and component teams, which manage shared work. Steve Berczuk says that this distinction can help organizations be more productive and scale effectively, but he recognizes that not all shared work fits into this model. Some work is best handled by “specialists,” that is people with unique skills. Although teams composed entirely of T-shaped people is ideal, certain skills are hard to come by and are used irregularly across an organization. Since these specialists often need to work closely with teams, rather than working from their own backlog, they don’t fit into the component team model. The use of shared resources presents challenges to the agile planning model. Steve Berczuk shares how teams such as those providing infrastructure services and specialists can fit into a feature+component team model, and how variations such as embedding specialists in a scrum team can both present process challenges and add significant value to both the team and the larger organization.
Pin the Tail on the Metric: A Field-Tested Agile GameTechWell
Metrics don’t have to be a necessary evil. If done right, metrics can help guide us to make better forward-looking decisions, rather than being used for simply managing or monitoring. They can help us identify trade-offs between options for what to do next versus punitive or worse, purely managerial measures. Steve Martin won’t be giving the Top Ten List of field-tested metrics you should use. Instead, in this interactive mini-workshop, he leads you through the critical thinking necessary for you to determine what is right for you to measure. First, Steve explores why you want to measure something—whether it’s for a team, a portfolio, or even an agile transformation. Next, he provides multiple real-life metrics examples to help drive home concepts behind characteristics of good and bad metrics. Finally, Steve shows how to run his field-tested agile game—Pin the Tail on the Metric. Take back this activity to help you guide metrics conversations at your organization.
Agile Performance Holarchy (APH)—A Model for Scaling Agile TeamsTechWell
A hierarchy is an organizational network that has a top and a bottom, and where position is determined by rank, importance, and value. A holarchy is a network that has no top or bottom and where each person’s value derives from his ability, rather than position. As more companies seek the benefits of agile, leaders need to build and sustain delivery capability while scaling agile without introducing unnecessary process and overhead. The Agile Performance Holarchy (APH) is an empirical model for scaling and sustaining agility while continuing to deliver great products. Jeff Dalton designed the APH by drawing from lessons learned observing and assessing hundreds of agile companies and teams. The APH helps implement a holarchy—a system composed of interacting organizational units called holons—centered on a series of performance circles that embody the behaviors of high performing agile organizations. Jeff describes how APH provides guidelines in the areas of leadership, values, teaming, visioning, governing, building, supporting, and engaging within an all-agile organization. Join Jeff to see what the APH is all about and how you can use it in your team and organization.
A Business-First Approach to DevOps ImplementationTechWell
DevOps is a cultural shift aimed at streamlining intergroup communication and improving operational efficiency for development and operations groups. Over time, inclusion of other IT groups under the DevOps umbrella has become the norm for many organizations. But even broadening the boundaries of DevOps, the conversation has been largely devoid of the business units’ place at the table. A common mistake organizations make while going through the DevOps transformation is drawing a line at the IT boundary. If that occurs, a larger, more inclusive silo within the organization is created, operating in an informational vacuum and causing operational inefficiency and goal misalignment. Sharing his experiences working on both sides of the fence, Leon Fayer describes the importance of including business units in order to align technology decisions with business goals. Leon discusses inclusion of business units in existing agile processes, benefits of cross-departmental monitoring, and a business-first approach to technology decisions.
Databases in a Continuous Integration/Delivery ProcessTechWell
DevOps is transforming software development with many organizations adopting lean development practices, implementing continuous integration (CI), and performing regular continuous deployment (CD) to their production environments. However, the database is largely ignored and often seen as a bottleneck in the DevOps process. Steve Jones discusses the challenges of database development and why many developers find the database to be an impediment to the CD process. Steve shares the techniques you can use to fit a database into the DevOps process. Learn how to store database code in a version control system, and the differences between that and application code. Steve demonstrates a CI process with SQL code and uses automated testing frameworks to check the code. Steve then shows how automated releases with manual gates can reduce the stress and risk of database deployments while ensuring consistent, reliable, repeatable releases to QA, UAT, and production.
Mobile Testing: What—and What Not—to AutomateTechWell
Organizations are moving rapidly into mobile technology, which has significantly increased the demand for testing of mobile applications. David Dangs says testers naturally are turning to automation to help ease the workload, increase potential test coverage, and improve testing efficiency. But should you try to automate all things mobile? Unfortunately, the answer is not always clear. Mobile has its own set of complications, compounded by a wide variety of devices and OS platforms. Join David to learn what mobile testing activities are ripe for automation—and those items best left to manual efforts. He describes the various considerations for automating each type of mobile application: mobile web, native app, and hybrid applications. David also covers device-level testing, types of testing, available automation tools, and recommendations for automation effectiveness. Finally, based on his years of mobile testing experience, David provides some tips and tricks to approach mobile automation. Leave with a clear plan for automating your mobile applications.
Cultural Intelligence: A Key Skill for SuccessTechWell
Diversity is becoming the norm in everyday life. However, introducing global delivery models without a proper understanding of intercultural differences can lead to difficulty, frustration, and reduced productivity. Priyanka Sharma and Thena Barry say that in our diverse world, we need teams with people who can cross these boundaries, communicate effectively, and build the diverse networks necessary to avoid problems. We need to learn about cultural intelligence (CI) and cultural quotient (CQ). CI is the ability to relate and work effectively across cultures. CQ is the cognitive, motivational, and behavioral capacity to understand and respond to beliefs, values, attitudes, and behaviors of individuals and groups. Together, CI and CQ can help us build behavioral capacities that aid motivation, behavior, and productivity in teams as well as individuals. Priyanka and Thena show how to build a more culturally intelligent place with tools and techniques from Leading with Cultural Intelligence, as well as content from the Hofstede cultural model. In addition, they illustrate the model with real-life experiences and demonstrate how they adapted in similar circumstances.
Turn the Lights On: A Power Utility Company's Agile TransformationTechWell
Why would a century-old utility with no direct competitors take on the challenge of transforming its entire IT application organization to an agile methodology? In an increasingly interconnected world, the expectations of customers continue to evolve. From smart meters to smart phones, IoT is creating a crisis point for industries not accustomed to rapid change. Glen Morris explains that pizzas can be tracked by the minute and packages at every stop, and customers now expect this same customer service model should exist for all industries—including power. Glen examines how to create momentum and transform non-IT-focused industries to an agile model. If you are struggling with gaining traction in your pursuit of agile within your business, Glen gives you concrete, practical experiences to leverage in your pursuit. Finally, he communicates how to gain buy-in from business partners who have no idea or concern about agile or its methodologies. If your business partners look at you with amusement when you mention the need for a dedicated Product Owner, join Glen as he walks you through the approaches to overcoming agile skepticism.
Software Engineering, Software Consulting, Tech Lead.
Spring Boot, Spring Cloud, Spring Core, Spring JDBC, Spring Security,
Spring Transaction, Spring MVC,
Log4j, REST/SOAP WEB-SERVICES.
AI Pilot Review: The World’s First Virtual Assistant Marketing SuiteGoogle
AI Pilot Review: The World’s First Virtual Assistant Marketing Suite
👉👉 Click Here To Get More Info 👇👇
https://sumonreview.com/ai-pilot-review/
AI Pilot Review: Key Features
✅Deploy AI expert bots in Any Niche With Just A Click
✅With one keyword, generate complete funnels, websites, landing pages, and more.
✅More than 85 AI features are included in the AI pilot.
✅No setup or configuration; use your voice (like Siri) to do whatever you want.
✅You Can Use AI Pilot To Create your version of AI Pilot And Charge People For It…
✅ZERO Manual Work With AI Pilot. Never write, Design, Or Code Again.
✅ZERO Limits On Features Or Usages
✅Use Our AI-powered Traffic To Get Hundreds Of Customers
✅No Complicated Setup: Get Up And Running In 2 Minutes
✅99.99% Up-Time Guaranteed
✅30 Days Money-Back Guarantee
✅ZERO Upfront Cost
See My Other Reviews Article:
(1) TubeTrivia AI Review: https://sumonreview.com/tubetrivia-ai-review
(2) SocioWave Review: https://sumonreview.com/sociowave-review
(3) AI Partner & Profit Review: https://sumonreview.com/ai-partner-profit-review
(4) AI Ebook Suite Review: https://sumonreview.com/ai-ebook-suite-review
Enhancing Research Orchestration Capabilities at ORNL.pdfGlobus
Cross-facility research orchestration comes with ever-changing constraints regarding the availability and suitability of various compute and data resources. In short, a flexible data and processing fabric is needed to enable the dynamic redirection of data and compute tasks throughout the lifecycle of an experiment. In this talk, we illustrate how we easily leveraged Globus services to instrument the ACE research testbed at the Oak Ridge Leadership Computing Facility with flexible data and task orchestration capabilities.
In software engineering, the right architecture is essential for robust, scalable platforms. Wix has undergone a pivotal shift from event sourcing to a CRUD-based model for its microservices. This talk will chart the course of this pivotal journey.
Event sourcing, which records state changes as immutable events, provided robust auditing and "time travel" debugging for Wix Stores' microservices. Despite its benefits, the complexity it introduced in state management slowed development. Wix responded by adopting a simpler, unified CRUD model. This talk will explore the challenges of event sourcing and the advantages of Wix's new "CRUD on steroids" approach, which streamlines API integration and domain event management while preserving data integrity and system resilience.
Participants will gain valuable insights into Wix's strategies for ensuring atomicity in database updates and event production, as well as caching, materialization, and performance optimization techniques within a distributed system.
Join us to discover how Wix has mastered the art of balancing simplicity and extensibility, and learn how the re-adoption of the modest CRUD has turbocharged their development velocity, resilience, and scalability in a high-growth environment.
Unleash Unlimited Potential with One-Time Purchase
BoxLang is more than just a language; it's a community. By choosing a Visionary License, you're not just investing in your success, you're actively contributing to the ongoing development and support of BoxLang.
Quarkus Hidden and Forbidden ExtensionsMax Andersen
Quarkus has a vast extension ecosystem and is known for its subsonic and subatomic feature set. Some of these features are not as well known, and some extensions are less talked about, but that does not make them less interesting - quite the opposite.
Come join this talk to see some tips and tricks for using Quarkus and some of the lesser known features, extensions and development techniques.
Check out the webinar slides to learn more about how XfilesPro transforms Salesforce document management by leveraging its world-class applications. For more details, please connect with sales@xfilespro.com
If you want to watch the on-demand webinar, please click here: https://www.xfilespro.com/webinars/salesforce-document-management-2-0-smarter-faster-better/
Custom Healthcare Software for Managing Chronic Conditions and Remote Patient...Mind IT Systems
Healthcare providers often struggle with the complexities of chronic conditions and remote patient monitoring, as each patient requires personalized care and ongoing monitoring. Off-the-shelf solutions may not meet these diverse needs, leading to inefficiencies and gaps in care. It’s here, custom healthcare software offers a tailored solution, ensuring improved care and effectiveness.
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...Juraj Vysvader
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I didn't get rich from it but it did have 63K downloads (powered possible tens of thousands of websites).
We describe the deployment and use of Globus Compute for remote computation. This content is aimed at researchers who wish to compute on remote resources using a unified programming interface, as well as system administrators who will deploy and operate Globus Compute services on their research computing infrastructure.
First Steps with Globus Compute Multi-User EndpointsGlobus
In this presentation we will share our experiences around getting started with the Globus Compute multi-user endpoint. Working with the Pharmacology group at the University of Auckland, we have previously written an application using Globus Compute that can offload computationally expensive steps in the researcher's workflows, which they wish to manage from their familiar Windows environments, onto the NeSI (New Zealand eScience Infrastructure) cluster. Some of the challenges we have encountered were that each researcher had to set up and manage their own single-user globus compute endpoint and that the workloads had varying resource requirements (CPUs, memory and wall time) between different runs. We hope that the multi-user endpoint will help to address these challenges and share an update on our progress here.
Enhancing Project Management Efficiency_ Leveraging AI Tools like ChatGPT.pdfJay Das
With the advent of artificial intelligence or AI tools, project management processes are undergoing a transformative shift. By using tools like ChatGPT, and Bard organizations can empower their leaders and managers to plan, execute, and monitor projects more effectively.
Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...Globus
Large Language Models (LLMs) are currently the center of attention in the tech world, particularly for their potential to advance research. In this presentation, we'll explore a straightforward and effective method for quickly initiating inference runs on supercomputers using the vLLM tool with Globus Compute, specifically on the Polaris system at ALCF. We'll begin by briefly discussing the popularity and applications of LLMs in various fields. Following this, we will introduce the vLLM tool, and explain how it integrates with Globus Compute to efficiently manage LLM operations on Polaris. Attendees will learn the practical aspects of setting up and remotely triggering LLMs from local machines, focusing on ease of use and efficiency. This talk is ideal for researchers and practitioners looking to leverage the power of LLMs in their work, offering a clear guide to harnessing supercomputing resources for quick and effective LLM inference.
Navigating the Metaverse: A Journey into Virtual Evolution"Donna Lenk
Join us for an exploration of the Metaverse's evolution, where innovation meets imagination. Discover new dimensions of virtual events, engage with thought-provoking discussions, and witness the transformative power of digital realms."
Globus Connect Server Deep Dive - GlobusWorld 2024Globus
We explore the Globus Connect Server (GCS) architecture and experiment with advanced configuration options and use cases. This content is targeted at system administrators who are familiar with GCS and currently operate—or are planning to operate—broader deployments at their institution.
Understanding Globus Data Transfers with NetSageGlobus
NetSage is an open privacy-aware network measurement, analysis, and visualization service designed to help end-users visualize and reason about large data transfers. NetSage traditionally has used a combination of passive measurements, including SNMP and flow data, as well as active measurements, mainly perfSONAR, to provide longitudinal network performance data visualization. It has been deployed by dozens of networks world wide, and is supported domestically by the Engagement and Performance Operations Center (EPOC), NSF #2328479. We have recently expanded the NetSage data sources to include logs for Globus data transfers, following the same privacy-preserving approach as for Flow data. Using the logs for the Texas Advanced Computing Center (TACC) as an example, this talk will walk through several different example use cases that NetSage can answer, including: Who is using Globus to share data with my institution, and what kind of performance are they able to achieve? How many transfers has Globus supported for us? Which sites are we sharing the most data with, and how is that changing over time? How is my site using Globus to move data internally, and what kind of performance do we see for those transfers? What percentage of data transfers at my institution used Globus, and how did the overall data transfer performance compare to the Globus users?
Globus Compute wth IRI Workflows - GlobusWorld 2024Globus
As part of the DOE Integrated Research Infrastructure (IRI) program, NERSC at Lawrence Berkeley National Lab and ALCF at Argonne National Lab are working closely with General Atomics on accelerating the computing requirements of the DIII-D experiment. As part of the work the team is investigating ways to speedup the time to solution for many different parts of the DIII-D workflow including how they run jobs on HPC systems. One of these routes is looking at Globus Compute as a way to replace the current method for managing tasks and we describe a brief proof of concept showing how Globus Compute could help to schedule jobs and be a tool to connect compute at different facilities.
Providing Globus Services to Users of JASMIN for Environmental Data AnalysisGlobus
JASMIN is the UK’s high-performance data analysis platform for environmental science, operated by STFC on behalf of the UK Natural Environment Research Council (NERC). In addition to its role in hosting the CEDA Archive (NERC’s long-term repository for climate, atmospheric science & Earth observation data in the UK), JASMIN provides a collaborative platform to a community of around 2,000 scientists in the UK and beyond, providing nearly 400 environmental science projects with working space, compute resources and tools to facilitate their work. High-performance data transfer into and out of JASMIN has always been a key feature, with many scientists bringing model outputs from supercomputers elsewhere in the UK, to analyse against observational or other model data in the CEDA Archive. A growing number of JASMIN users are now realising the benefits of using the Globus service to provide reliable and efficient data movement and other tasks in this and other contexts. Further use cases involve long-distance (intercontinental) transfers to and from JASMIN, and collecting results from a mobile atmospheric radar system, pushing data to JASMIN via a lightweight Globus deployment. We provide details of how Globus fits into our current infrastructure, our experience of the recent migration to GCSv5.4, and of our interest in developing use of the wider ecosystem of Globus services for the benefit of our user community.
Comprehensive Performance Testing: From Early Dev to Live Production
1.
T15
Performance
Testing
10/6/16
13:30
Comprehensive
Performance
Testing:
From
Early
Dev
to
Live
Production
Presented
by:
Brad
Stoner
AppDynamics
Brought
to
you
by:
350
Corporate
Way,
Suite
400,
Orange
Park,
FL
32073
888-‐-‐-‐268-‐-‐-‐8770
·∙·∙
904-‐-‐-‐278-‐-‐-‐0524
-‐
info@techwell.com
-‐
http://www.starwest.techwell.com/
2.
Brad
Stoner
Brad
StonerÊis
a
Senior
Sales
Engineer
with
AppDynamics.
In
his
fourteen
years
of
IT
experience,
Brad
has
held
roles
in
performance
engineering,
systems
engineering,
and
operations
management.
Previously,
Brad
managed
the
load
and
performance
team
at
H&R
Block
where
he
spent
seven
years
leading
his
five-‐person
team
in
pursuit
of
improved
application
performance
and
quality.
Brad
and
his
team
managed
the
performance
testing
process
for
more
than
fifty
projects
annually.
He
founded
Sandbreak
Digital
Solutions,
a
consulting
company
specializing
in
web
application
performance
testing,
web
page
optimization,
front
end
optimization,
capacity
testing,
infrastructure
validation,
and
cloud
testing.
4. My background
• 7 years @ H&R Block Load and Performance Team
• 5 person team
• 100k + user concurrency
• Tax peak 2nd week after go-live
• 70 applications annually
• Diverse technology stack – including 3rd party
• 2 years @ Neotys – Performance testing software vendor
• Currently Sales Engineer @ AppDynamics
brad.stoner@appdynamics.com
@sandbreak80
5. What is performance testing
In software engineering, performance testing is in
general, a testing practice performed to determine
how a system performs in terms of responsiveness
and stability under a particular workload. It can also
serve to investigate, measure, validate or verify
other quality attributes of the system, such as
scalability, reliability and resource usage.*
• Load Test
• Performance Test
• Stress Test
• Scalability Test
• Capacity Test
• Endurance Test
• Workload Test
• Device, FE, BE, end-to-end
* https://en.wikipedia.org/wiki/Software_performance_testing
6. Why bother?
Google - Using page speed in site ranking
Facebook - Launches 'lite' mobile app
Amazon - 100ms delay -> $6.79M sales
decrease
Recent airline industry outages
7. Legacy performance testing
• Test after QA and right before launch /
deployment to prod
• Test entire application in war room
• Complex workloads and use cases
• 3-5 weeks to complete
• 3-5 days to script single use case
• Difficult to pinpoint root cause
• Test high volume, long duration
• Peel back onion approach – GIANT ONION
(more later)
• Test system capacity and scalability
• Code focused – only if needed
• Require code freeze
• Potentially expensive and time consuming
changes
8. Increasing velocity
• Customers want everything faster
• Business demands quicker time to market
• Reduce risk and pain of ‘giant deployments’
• Resolve defects faster at a lower cost
• Keep competitive
• … Performance testing isn't historically fast
9. Main challenges
• Time
• Need to rescript use cases
• Fluid environments – both software and infrastructure
• Sequential workflows
• Test Data management and synthesis
• Complex load profiles
• Multiple user profiles
• Integrations
• Synchronizing builds and functionality
10. Keeping up with Agile / DevOps
• “It takes 2 weeks to script all our use cases and we get releases every 3 days”
• “The application is too difficult to test”
• “We are moving to agile on our legacy waterfall project. How we get started?”
• “QA will always be the bottleneck”
• “Issues are difficult to reproduce and our environment is unstable”
• “We don’t have visibility into our infrastructure”
• “If we find an issue, it still takes a week to fix”
• “We have no idea what changed in the application or why we are testing it again”
15. Dev / QA
• Front End Optimization (cache, minimize, round
trips, content size, compression)
• Code issues (concurrency, locking, blocking,
deadlock, single threaded)
• Queue build-up
• Code level performance (method / class)
• Slow responses (functional load)
• Issues with Memory allocation
• 3rd party code or frameworks
• Having debug enabled
• JS execution times
• Sync vs async calls
• Unlimited queries (return all rows)
• Caching (code / object)
• Excessive DB queries
• Logging Levels
16. Staging / Pre-Prod
• Memory leaks
• Thread exhaustion
• User limits
• Garbage collection (STW)
• Stored procedure inefficiencies
• Missing indexes / Schema issues
• DB connection pool issues
• Keep Alive issues
• Data Size Issues
• Issues with virus scan / security software
• 3rd party integrations
• Internal integrations
• CPU limitations
• Memory limitations
• Configuration issues / default install – Huge!
• Data growth issues
• Connection cleanup
• Using only clean data
• Swappiness
17. Prod / Perf
• Load balancing (active / active,
device, VIP)
• Firewall performance issues
• SAN performance issues
• Socket / connection issues
• Bandwidth limitations
• # Of servers required
• CDN issues
• Geographic limitations
• Backups causing issues
• Clustering issues / failover issues
• Issues with shared services (AD,
SSO)
• Disk performance issues
• Data replication performance
issues
• Performance impact of scheduled
tasks
• Load balancing and persistence
• Firmware / BIOS issues
• Proxy limitations
• Proxy / edge caching / FE caching
• DDOS / IDS configuration issues
• ISP limitations
• Noisy neighbors - virtualization
• Bad server in farm
• Switch / link configuration
• PDU / power / overheating issues
• OS limitation / tuning
• Disk space issues
• SAN caching
18. Dev testing - APIs
Mobile web/app example
Staging testing – Capacity w/
UI and API
Build automation
Baseline Pre-Prod / Staging -
platform
Prod / Perf testing
(inside firewall) –
stability / scalability
Prod / Perf testing
(outside firewall) –
network / load
balancing
QA testing – API flows
Optimize app
chatter and
network resources
Mobile app released
Mobile app built
Mobile site releasedMobile site built
APIs released/ BE functionality
Front End
Optimization
19. What if legacy testing principles were applied?
Staging testing – Capacity
w/ UI and API
Baseline Pre-Prod / Staging -
platform
Prod / Perf testing (inside firewall) –
stability / scalability
Prod / Perf testing (outside
firewall) – network / load
balancing
Front End
Optimization
Optimize app
chatter and
network resources
Mobile app released
Mobile app built
Mobile site releasedMobile site built
APIs released/ BE functionality
20. What worked?
• App was developed with testability in mind
• Testing earlier in the development of the mobile app
• Back end testing was completed prior to release any front end!
• Isolation of back end and front end
• Fast feedback for bad builds (functional, errors, performance)
• Build validation with automation led to faster iterations
• Reusability of test cases between teams and environments
• Baseline infrastructure; then focus of code changes
• Create experiments to isolate defect targets
• Document what defects were caught in each environment; refine
• Using production-like data sets as early as possible!
• Build test cases as close to dev as possible
23. • Pinpoint root cause!
• ”Its slower. Is it the database, or the application server, or the code?”
• Used for initial tuning and build testing
• Ensure visibility into infrastructure – automatically updated
• Get resources out of war rooms
• Remove the need to manually setup monitoring in performance tools
• Compare build performance
• Correlate performance and load
• Eliminate re-testing - some issues are difficult to reproduce (backups, virus scan updates) issues outside the
application
• Compare performance in different environments, code the same – what’s different?
• Pass / Fail based on performance – extend performance tools or use less sophisticated performance tools
24.
25.
26.
27. Result of test automation
• Ensure platform capacity and scalability
• Identify and fail poor performing builds automatically
• Performance tests can include functional validations
• Establish and monitor performance trends
• Identify performance issues early
• That’s great… what do we do if we discover a performance issue?
28.
29.
30.
31.
32.
33.
34. When to say no
• Not baselining infrastructure (there costs associated with auto-scaling)
• ‘Green Stamp’
• Empty database testing
• Capacity testing with a fraction of the web / app tier
• Testing 50 VUs and certifying 500 VUs
• 0 think time testing
• 10 minute performance tests
• No pass / fail criteria
• Just tell me if it will break
• … we will add caching later
