Are you embarking on a large-scale, globally distributed, multi-team scrum project? Have you already identified the potential testing challenges that lie ahead? Or have you belatedly encountered them and are now working on them in real-time? Five years and more than 200 projects into its agile journey, Dell Enterprise Solutions (ESG) has empirically determined that once a project extends beyond three scrum teams, interesting testing challenges arise—inconsistent “done” criteria, integration testing underscored by epic/story interdependencies across teams, test automation inconsistency, and uncoordinated regression testing. Worse yet, the more teams involved, the less likely it is that a single scrum team has the visibility to validate the overall product from a customer usage perspective as the product evolves through sprints. Geoff Meyer serves up some lessons learned from within the Dell ESG Validation organization as it evolved its agile testing and automation strategies from a waterfall-based environment to one that fully embraced agile Scrum across its entire software product portfolio.
How do measure our progress in a journey towards continuous integration? What are other people doing?
This presentation provides an measuring stick for CD Maturity and simple pattern for reviewing your current situation and deciding what to work on next.
Continuous Delivery presents a compelling vision of builds that are automatically deployed and tested until ready for production.
Most teams aren't there yet. Some never want to go that far. Others want to push the envelope further.
This deck presents a model for scoring yourself on the continuum and examples of how companies can decide what parts of CD to adopt first, later and not at all.
VMworld 2013: Best Practices for Application Lifecycle Management with vCloud...VMworld
VMworld 2013
Amjad Afanah, VMware
Rajesh Khazanchi, VMware
Learn more about VMworld and register at http://www.vmworld.com/index.jspa?src=socmed-vmworld-slideshare
How do measure our progress in a journey towards continuous integration? What are other people doing?
This presentation provides an measuring stick for CD Maturity and simple pattern for reviewing your current situation and deciding what to work on next.
Continuous Delivery presents a compelling vision of builds that are automatically deployed and tested until ready for production.
Most teams aren't there yet. Some never want to go that far. Others want to push the envelope further.
This deck presents a model for scoring yourself on the continuum and examples of how companies can decide what parts of CD to adopt first, later and not at all.
VMworld 2013: Best Practices for Application Lifecycle Management with vCloud...VMworld
VMworld 2013
Amjad Afanah, VMware
Rajesh Khazanchi, VMware
Learn more about VMworld and register at http://www.vmworld.com/index.jspa?src=socmed-vmworld-slideshare
Pivotal korea transformation_strategy_seminar_enterprise_dev_ops_20160630_v1.0minseok kim
devops has been popular in IT ever since emerging cloud technology. to make IT more agile, we need to keep setup goal and measure performance with adopting new cloud native tools.
SaaS Operations Practice Overview SoftServe DevOpsSoftServe
There has started a strong trend of moving to service based software in the last few years. A typical lifecycle of a software product in this case consists of two major phases – transition and operation.
Your organization may have the experience and capacity to conduct the Transition phase, however the Operation phase could introduce some additional risks and issues. This is caused by the difference between boxed- and service-based software delivery models.
SoftServe’s Development Operations Consulting services include an analysis and assessment as well as providing a solution for continuous delivery and build automation, data management, availability monitoring and operations automation.
This presentation by SoftServe`s Russ Hertzberg, VP Technology Solutions, describes SoftServe`s approach to Development Operations.
Infrastructure as Code Maturity Model v1Gary Stafford
Systematically Evolving an Organization’s Infrastructure . The original version of the IaC Maturity Model. See the latest version here: https://www.slideshare.net/garystafford/how-mature-is-your-infrastructure.
Operationalizing Enterprise Adoption of DevOps in the Application EconomyCA Technologies
See how companies have created transformational programs to make enterprise adoption of DevOps a success. Learn about customer successes and the adoption journey, while building out the necessary skillsets and capabilities within the organization.
For more information on DevOps solutions from CA Technologies, please visit: http://bit.ly/1wbjjqX
Leading the Transformation: Applying DevOps and Agile Principles at ScaleIBM UrbanCode Products
Software is becoming more and more important across a broad range of industries, yet technology executives often struggle to understand how to transform their current legacy systems and processes to scale across their organizations.
See how Gary Gruver, co-author of Leading the Transformation, and President of Practical Large Scale Agile, discusses how you can apply the basic principles of Agile and DevOps across your organization.
Agile-plus-DevOps Testing for Packaged ApplicationsWorksoft
Guest presenter Forrester VP and Principal Analyst Diego Lo Giudice joined Worksoft Agile expert Chris Kraus for an exploration of the state of adoption of Agile, DevOps and test automation in the enterprise packaged application space. Learn why it is important to include testing of packaged apps and mainframe as part of an Agile-plus-DevOps strategy and how the adoption of Agile and DevOps varies for packaged vs. custom-built applications. View the recorded event at: https://www.worksoft.com/downloads/worksoft-forrester-webinar-agile-plus-devops-testing-for-packaged-applications.
Using Lean Thinking to identify and address Delivery Pipeline bottlenecksSanjeev Sharma
Using Lean Thinking to identify and address Delivery Pipeline bottlenecks: This session explores 'Lean Thinking' techniques to help identify 'bottlenecks' in your delivery pipeline that can be addressed by adopting DevOps
Roles and Responsibilities of a DevOps EngineerZaranTech LLC
DevOps Training & Certification provided Online from USA industry expert trainers with real time project experience.
COURSE PAGE: https://www.zarantech.com/devops-certification-training/
REGISTER FOR FREE LIVE DEMO: http://promo.zarantech.com/free-webinar-devops
CONTACT: +1 (515) 309-7846 (or) Email - info@zarantech.com
Get More Free Videos - Subscribe ➜ https://goo.gl/5ZqDML
"DevOps tutorial"
"free DevOps training"
"online DevOps training"
"Best DevOps training"
"DevOps for Beginners"
"Best DevOps Training"
Reviews / Testimonials from past trainees are saying: https://goo.gl/ZVfnE4
Recommendations on Facebook - http://www.facebook.com/ZaranTechLLC
Testimonials on our website - http://www.zarantech.com/testimonials
Refer your friends to ZaranTech - http://www.zarantech.com/be-a-friend-tell-a-friend.
Get Mapped: Using Value Stream Mapping to Create a DevOps Adoption RoadmapIBM UrbanCode Products
Adopting DevOps is not a “one-and-done” project. It is adopting a mindset, a culture. It is a commitment to a journey of continuous improvement by adopting a set of capabilities and practices that are based on Lean principles. Adopting DevOps requires process improvement, automation of the processes using tools, and organizational change to enable a DevOps culture.
The question then becomes – where does one start?
Serena DevOps Drive-in: Leading the Agile and DevOps transformation with Gary...Serena Software
DevOps is not just for start-ups! However, scaling DevOps in large enterprises requires shifting of culture, coordination of work across teams, reinvention of legacy applications and much more. Before you undertake any change to improve your software development processes, you would want to learn from the person who has gone before you and tasted success. Join the conversation with Gary Gruver on our next DevOps drive-in webcast. Gary will share his best practices and recommendations from his groundbreaking work at HP and Macy's and talk about how to lead a successful DevOps transformation.
DevOps Evolution - The Next Generation ?Marc Hornbeek
Where is DevOps in its maturity? Is DevOps life near its beginning, middle, mature, near end-of-life or near extinction? What does the next generation look like? This presentation posits the next generation will be a new level of process optimization driven by coupling analytics with DevOps pipeline tools and associated role shifts.
This presentation starts with basic introduction to Cloud Computing and then move on to Virtualization and Containers, Dockers, some open source Cloud environments, industry Cloud platforms, then on to Mobile apps (native, mobile web and hybrid) and finally IoT. It also has some URLs where you can find suggestions for college projects and experiments for IoT based solutions
Automation Culture: Essential to Agile SuccessTechWell
For organizations developing large-scale applications, transitioning to agile is challenging enough. If your organization has not yet adopted an automation culture, brace yourself for a big surprise because automation is essential to agile success. From the safety nets provided by automated unit and acceptance tests to the automation of build, build verification, and deployment processes, the iterative nature of agile demands a culture of automation across your engineering organization. Geoff Meyer shares lessons learned in adopting a test automation culture as the Dell Enterprise Systems Group simultaneously adopted Scrum and agile processes across its entire software product portfolio. Learn to address the practical challenges of establishing an automation culture at the outset by ensuring that your organizational makeover incorporates changes to your hiring, staffing, and training practices. Find out how you can apply automation beyond the Scrum team in areas including continuous integration, scale and stress testing, and performance testing.
Large-Scale Agile Test Automation Strategies in PracticeTechWell
After providing an introduction to several key agile testing concepts—including the Automation Triangle and the Test Automation Quadrants—Geoff Meyer discusses approaches to effectively deliver automated testing. Geoff shares practical insights and demonstrates how they were employed in the test automation strategies developed for several large-scale agile projects at Dell. He shows how the overall test strategy and implementation of each underlying agile concept was influenced by the realities of the project’s organization structure, application architecture, incumbent tools, and tester skillsets. Geoff explores the similarities of the projects from their common goals of establishing automated regression suites, achieving in-sprint automation, and test staffing approaches. More importantly, he delves into the implications of organizational structures and how they led to divergent approaches to test strategy from the choice of automation frameworks to the decisions to automate at the REST/SOAP-based API level or UI level.
Pivotal korea transformation_strategy_seminar_enterprise_dev_ops_20160630_v1.0minseok kim
devops has been popular in IT ever since emerging cloud technology. to make IT more agile, we need to keep setup goal and measure performance with adopting new cloud native tools.
SaaS Operations Practice Overview SoftServe DevOpsSoftServe
There has started a strong trend of moving to service based software in the last few years. A typical lifecycle of a software product in this case consists of two major phases – transition and operation.
Your organization may have the experience and capacity to conduct the Transition phase, however the Operation phase could introduce some additional risks and issues. This is caused by the difference between boxed- and service-based software delivery models.
SoftServe’s Development Operations Consulting services include an analysis and assessment as well as providing a solution for continuous delivery and build automation, data management, availability monitoring and operations automation.
This presentation by SoftServe`s Russ Hertzberg, VP Technology Solutions, describes SoftServe`s approach to Development Operations.
Infrastructure as Code Maturity Model v1Gary Stafford
Systematically Evolving an Organization’s Infrastructure . The original version of the IaC Maturity Model. See the latest version here: https://www.slideshare.net/garystafford/how-mature-is-your-infrastructure.
Operationalizing Enterprise Adoption of DevOps in the Application EconomyCA Technologies
See how companies have created transformational programs to make enterprise adoption of DevOps a success. Learn about customer successes and the adoption journey, while building out the necessary skillsets and capabilities within the organization.
For more information on DevOps solutions from CA Technologies, please visit: http://bit.ly/1wbjjqX
Leading the Transformation: Applying DevOps and Agile Principles at ScaleIBM UrbanCode Products
Software is becoming more and more important across a broad range of industries, yet technology executives often struggle to understand how to transform their current legacy systems and processes to scale across their organizations.
See how Gary Gruver, co-author of Leading the Transformation, and President of Practical Large Scale Agile, discusses how you can apply the basic principles of Agile and DevOps across your organization.
Agile-plus-DevOps Testing for Packaged ApplicationsWorksoft
Guest presenter Forrester VP and Principal Analyst Diego Lo Giudice joined Worksoft Agile expert Chris Kraus for an exploration of the state of adoption of Agile, DevOps and test automation in the enterprise packaged application space. Learn why it is important to include testing of packaged apps and mainframe as part of an Agile-plus-DevOps strategy and how the adoption of Agile and DevOps varies for packaged vs. custom-built applications. View the recorded event at: https://www.worksoft.com/downloads/worksoft-forrester-webinar-agile-plus-devops-testing-for-packaged-applications.
Using Lean Thinking to identify and address Delivery Pipeline bottlenecksSanjeev Sharma
Using Lean Thinking to identify and address Delivery Pipeline bottlenecks: This session explores 'Lean Thinking' techniques to help identify 'bottlenecks' in your delivery pipeline that can be addressed by adopting DevOps
Roles and Responsibilities of a DevOps EngineerZaranTech LLC
DevOps Training & Certification provided Online from USA industry expert trainers with real time project experience.
COURSE PAGE: https://www.zarantech.com/devops-certification-training/
REGISTER FOR FREE LIVE DEMO: http://promo.zarantech.com/free-webinar-devops
CONTACT: +1 (515) 309-7846 (or) Email - info@zarantech.com
Get More Free Videos - Subscribe ➜ https://goo.gl/5ZqDML
"DevOps tutorial"
"free DevOps training"
"online DevOps training"
"Best DevOps training"
"DevOps for Beginners"
"Best DevOps Training"
Reviews / Testimonials from past trainees are saying: https://goo.gl/ZVfnE4
Recommendations on Facebook - http://www.facebook.com/ZaranTechLLC
Testimonials on our website - http://www.zarantech.com/testimonials
Refer your friends to ZaranTech - http://www.zarantech.com/be-a-friend-tell-a-friend.
Get Mapped: Using Value Stream Mapping to Create a DevOps Adoption RoadmapIBM UrbanCode Products
Adopting DevOps is not a “one-and-done” project. It is adopting a mindset, a culture. It is a commitment to a journey of continuous improvement by adopting a set of capabilities and practices that are based on Lean principles. Adopting DevOps requires process improvement, automation of the processes using tools, and organizational change to enable a DevOps culture.
The question then becomes – where does one start?
Serena DevOps Drive-in: Leading the Agile and DevOps transformation with Gary...Serena Software
DevOps is not just for start-ups! However, scaling DevOps in large enterprises requires shifting of culture, coordination of work across teams, reinvention of legacy applications and much more. Before you undertake any change to improve your software development processes, you would want to learn from the person who has gone before you and tasted success. Join the conversation with Gary Gruver on our next DevOps drive-in webcast. Gary will share his best practices and recommendations from his groundbreaking work at HP and Macy's and talk about how to lead a successful DevOps transformation.
DevOps Evolution - The Next Generation ?Marc Hornbeek
Where is DevOps in its maturity? Is DevOps life near its beginning, middle, mature, near end-of-life or near extinction? What does the next generation look like? This presentation posits the next generation will be a new level of process optimization driven by coupling analytics with DevOps pipeline tools and associated role shifts.
This presentation starts with basic introduction to Cloud Computing and then move on to Virtualization and Containers, Dockers, some open source Cloud environments, industry Cloud platforms, then on to Mobile apps (native, mobile web and hybrid) and finally IoT. It also has some URLs where you can find suggestions for college projects and experiments for IoT based solutions
Automation Culture: Essential to Agile SuccessTechWell
For organizations developing large-scale applications, transitioning to agile is challenging enough. If your organization has not yet adopted an automation culture, brace yourself for a big surprise because automation is essential to agile success. From the safety nets provided by automated unit and acceptance tests to the automation of build, build verification, and deployment processes, the iterative nature of agile demands a culture of automation across your engineering organization. Geoff Meyer shares lessons learned in adopting a test automation culture as the Dell Enterprise Systems Group simultaneously adopted Scrum and agile processes across its entire software product portfolio. Learn to address the practical challenges of establishing an automation culture at the outset by ensuring that your organizational makeover incorporates changes to your hiring, staffing, and training practices. Find out how you can apply automation beyond the Scrum team in areas including continuous integration, scale and stress testing, and performance testing.
Large-Scale Agile Test Automation Strategies in PracticeTechWell
After providing an introduction to several key agile testing concepts—including the Automation Triangle and the Test Automation Quadrants—Geoff Meyer discusses approaches to effectively deliver automated testing. Geoff shares practical insights and demonstrates how they were employed in the test automation strategies developed for several large-scale agile projects at Dell. He shows how the overall test strategy and implementation of each underlying agile concept was influenced by the realities of the project’s organization structure, application architecture, incumbent tools, and tester skillsets. Geoff explores the similarities of the projects from their common goals of establishing automated regression suites, achieving in-sprint automation, and test staffing approaches. More importantly, he delves into the implications of organizational structures and how they led to divergent approaches to test strategy from the choice of automation frameworks to the decisions to automate at the REST/SOAP-based API level or UI level.
An Automation Culture: The Key to Agile SuccessTechWell
For organizations developing large-scale applications, transitioning to agile is challenging enough. But if your organization has not yet adopted an automation culture, brace yourself for a big surprise because automation is essential to agile success. From the safety nets provided by automated unit and acceptance tests to the automation of build, build verification, and deployment processes, the iterative nature of agile demands a culture of automation across your engineering organization. Geoff Meyer shares lessons learned in adopting a test automation culture as the Dell Enterprise Systems Group simultaneously adopted Scrum and agile processes across its entire software product portfolio. Learn to address the practical challenges of establishing an automation culture at the outset by ensuring that your organizational makeover incorporates changes to your hiring, staffing, and training practices. Find out how you can apply automation beyond the Scrum team in areas of continuous integration, scale and stress testing, and performance testing.
DevOps, sibling of Agile is born of the need to improve IT service delivery agility to the more stable environment.
DevOps movement emphasizes tearing the boundaries between makers (Development) & caretakers (Operations) of IT services/products.
Slow Down to Speed Up - Leveraging Quality to Enable Productivity and Speed w...TEST Huddle
Despite extensive uptake in Agile and more recently Lean approaches, many teams and organisations still struggle to achieve a required level of software quality. To maintain sustained productivity and speed we need to achieve a sufficient level of quality in our software. This presentation will briefly explore the relationship between quality, speed and productivity in the context of value driven delivery. It will then highlight the real world mistakes being make by organisations and their agile teams in relation to quality and testing and suggest ways to improve.
Examples will include issues with
• agile test strategy and product risk,
• team competency,
• test automation,
• test design techniques,
• requirements (including non-functional),
• line management,
• planning for quality,
• use of the ‘Definition of Done’.
Scaling Agile at Dell: Real-life Problems - and SolutionsTechWell
The transition from waterfall-based software development to an agile, iterative model carries with it well-known challenges and problems-entrenched cultures, skill gaps, and organizational change management. For a large, globally distributed software development organization, an entirely different set of practical challenges comes with scaling agile practices. Last year the Dell Enterprise Solutions Group applied agile practices to more than forty projects ranging from a collocated single team project to projects that consisted of fifteen Scrum teams located across the US and India. Geoff Meyer and Brian Plunkett explain how Dell mined these real-life projects for their empirical value and adapted their agile practices into a flexible planning model that addresses the project complexities of staffing, scale, interdependency, and waterfall intersection. Join Geoff and Brian to see how they tackled the tough, real-life problems scaling agile at Dell: functional-based organizational boundaries, globally distributed teams, contractor challenges, multi-team projects, and dependencies on teams that continued to develop using waterfall methods.
Agile Testing – embedding testing into agile software development lifecycle Kari Kakkonen
My presentation on Agile Testing, including a tuning concept and a case study of agile testing choices in a project, held 16 of June, 2014 at a customer internal seminar.
Live Webinar- Making Test Automation 10x Faster for Continuous Delivery- By R...RapidValue
A live webinar hosted by RapidValue Solutions on "Making Test Automation 10X Faster for Continuous Delivery".
Key takeaways:
1. Achieving test automation in a DevOps world
2. Building a business-tailored test automation framework
3. Overcoming limitations of open source tools
4. Case study: Creating 2000+ test cases in less than a month for a product development firm
5. Demo: Zero-code test automation for non-testers using AccuRate ( test automation suite by RapidValue)
Marlabs’ independent testing services can help customers improve the quality and performance of their software applications along with faster time to market and reduced cost of testing. Our end-to-end outcome-based testing process is aligned with the client’s strategic and operational goals to provide maximum value. We offer a wide range of testing services including life cycle testing, test consulting, test automation services and specialized mobile and enterprise application testing services.
Similar to Meet Big Agile: Testing on Large-Scale Projects (20)
Do you ever feel you have lost confidence in your own abilities? Why does this happen? Isabel Evans spends a lot of time painting. Someone once commented, “Why are you doing this, when you are not very good at it?” And gradually she stopped drawing and painting, after being intimidated by a conventional vision of what good art should look like. At the same time, she experienced a parallel loss of confidence in her professional abilities. Attempting creative pursuits like drawing and painting is essential to cognitive, emotional, creative abilities and she began to understand the correlation between her creative activities and her confidence. Making errors, being wrong, failing – that is a generous gift we receive when we practice outside our skill level. By staying in a comfort zone and repeating successes, we stagnate. As Isabel started to create again she thought “I don’t feel good at it, I do feel good doing it” The difference was that she was learning, having ideas and the act of re-engaging with failure, together with the comradeship of friends and colleagues, including at Women Who Test, Isabel has regained her confidence in her professional abilities, and been able to reboot her career and joy. Join Isabel to share a journey from self-perceived failure, to recovery and renewed learning.
Instill a DevOps Testing Culture in Your Team and Organization TechWell
The DevOps movement is here. Companies across many industries are breaking down siloed IT departments and federating them into product development teams. Testing and its practices are at the heart of these changes. Traditionally, IT organizations have been staffed with mostly manual testers and a limited number of automation and performance engineers. To keep pace with development in the new “you build it, you own it” environment, testing teams and individuals must develop new technical skills and even embrace coding to stay relevant and add greater value to the business. DevOps really starts with testing. Join Adam Auerbach as he explains what DevOps is and how it relates to testing. He describes how testing must change from top to bottom and how to access your own environment to identify improvement opportunities. Adam dives into practices like service virtualization, test data management, and continuous testing so you can understand where you are now and identify steps needed to instill a DevOps testing culture in your team and organization.
Test Design for Fully Automated Build ArchitectureTechWell
Imagine this … As soon as any developed functionality is submitted into the code repository, it is automatically subjected to the appropriate battery of tests and then released straight into production. Setting up the pipeline capable of doing just that is becoming more and more common and something you need to know about. But most organizations hit the same stumbling block—just what IS the appropriate battery of tests? Automated build architectures don't always lend themselves well to the traditional stages of testing. In this hands-on tutorial, Melissa Benua introduces you to key test design principles—applicable to organizations both large and small—that allow you to take full advantage of the pipeline's capabilities without introducing unnecessary bottlenecks. Learn how to make highly reliable tests that run fast and preserve just enough information to let testers and developers determine exactly what went wrong and how to reproduce the error locally. Explore ways to reduce overlap while still maintaining adequate test coverage. Take back ideas about which test areas could benefit from being combined into a single suite and which areas could benefit most from being broken out altogether.
System-Level Test Automation: Ensuring a Good StartTechWell
Many organizations invest a lot of effort in test automation at the system level but then have serious problems later on. As a leader, how can you ensure that your new automation efforts will get off to a good start? What can you do to ensure that your automation work provides continuing value? This tutorial covers both “theory” and “practice”. Dot Graham explains the critical issues for getting a good start, and Chris Loder describes his experiences in getting good automation started at a number of companies. The tutorial covers the most important management issues you must address for test automation success, particularly when you are new to automation, and how to choose the best approaches for your organization—no matter which automation tools you use. Focusing on system level testing, Dot and Chris explain how automation affects staffing, who should be responsible for which automation tasks, how managers can best support automation efforts to promote success, what you can realistically expect in benefits and how to report them. They explain—for non-techies—the key technical issues that can make or break your automation effort. Come away with your own clarified automation objectives, and a draft test automation strategy to use to plan your own system-level test automation.
Build Your Mobile App Quality and Test StrategyTechWell
Let’s build a mobile app quality and testing strategy together. Whether you have a web, hybrid, or native app, building a quality and testing strategy means (1) knowing what data and tools you have available to make agile decisions, (2) understanding your customers and your competitors, and (3) testing your app under real-world conditions. Jason Arbon guides you through the latest techniques, data, and tools to ensure the awesomeness of your mobile app quality and testing strategy. Leave this interactive session with a strategy for your very own app—or one you pretend to own. The information Jason shares is based on data from Appdiff’s next-gen mobile app testing platform, lessons from Applause/uTest’s crowd, text mining hundreds of millions of app store reviews, and in-depth discussions with top mobile app development teams.
Testing Transformation: The Art and Science for SuccessTechWell
Technologies, testing processes, and the role of the tester have evolved significantly in the past few years with the advent of agile, DevOps, and other new technologies. It is critical that we testing professionals evaluate ourselves and continue to add tangible value to our organizations. In your work, are you focused on the trivial or on real game changers? Jennifer Bonine describes critical elements that help you artfully blend people, process, and technology to create a synergistic relationship that adds value. Jennifer shares ideas on mastering politics, maneuvering core vs. context, and innovating your technology strategies and processes. She explores how new processes can be introduced in an organization, what the role of organizational culture is in determining the success of a project, and how you can know what tools will add value vs. simply adding overhead and complexity. Jennifer reviews critically needed tester skills and discusses a continual learning model to evolve your skills and stay relevant. This discussion can lead you to technologies, processes, and skills you can stake your career on.
We’ve all been there. We work incredibly hard to develop a feature and design tests based on written requirements. We build a detailed test plan that aligns the tests with the software and the documented business needs. And when we put the tests to the software, it all falls apart because the requirements were changed without informing everyone. Mary Thorn says help is at hand. Enter behavior-driven development (BDD), and Cucumber and SpecFlow, tools for running automated acceptance tests and facilitating BDD. Mary explores the nuances of Cucumber and SpecFlow, and shows you how to implement BDD and agile acceptance testing. By fostering collaboration for implementing active requirements via a common language and format, Cucumber and SpecFlow bridge the communication gap between business stakeholders and implementation teams. In this workshop, practice writing feature files with the best practices Mary has discovered over numerous implementations. If you experience developers not coding to requirements, testers not getting requirements updates, or customers who feel out of the loop and don’t get what they ask for, Mary has answers for you.
Develop WebDriver Automated Tests—and Keep Your SanityTechWell
Many teams go crazy because of brittle, high-maintenance automated test suites. Jim Holmes helps you understand how to create a flexible, maintainable, high-value suite of functional tests using Selenium WebDriver. Learn the basics of what to test, what not to test, and how to avoid overlapping with other types of testing. Jim includes both philosophical concepts and hands-on coding. Testers who haven't written code should not be intimidated! We'll pair you up to make sure you're successful. Learn to create practical tests dealing with advanced situations such as input validation, AJAX delays, and working with file downloads. Additionally, discover when you need to work together with developers to create a system that's more easily testable. This tutorial focuses primarily on automating web tests, but many of the same concepts can be applied to other UI environments. Demos and labs will be in C# and Java using WebDriver. Leave this tutorial having learned how to write high-value WebDriver tests—and stay sane while doing so.
DevOps is a cultural shift aimed at streamlining intergroup communication and improving operational efficiency for development and operations groups. Over time, inclusion of other IT groups under the DevOps umbrella has become the norm for many organizations. But even broadening the boundaries of DevOps, the conversation has been largely devoid of the business units’ place at the table. A common mistake organizations make while going through the DevOps transformation is drawing a line at the IT boundary. If that occurs, a larger, more inclusive silo within the organization is created, operating in an informational vacuum and causing operational inefficiency and goal misalignment. Sharing his experiences working on both sides of the fence, Leon Fayer describes the importance of including business units in order to align technology decisions with business goals. Leon discusses inclusion of business units in existing agile processes, benefits of cross-departmental monitoring, and a business-first approach to technology decisions.
Eliminate Cloud Waste with a Holistic DevOps StrategyTechWell
Chris Parlette maintains that renting infrastructure on demand is the most disruptive trend in IT in decades. In 2016, enterprises spent $23B on public cloud IaaS services. By 2020, that figure is expected to reach $65B. The public cloud is now used like a utility, and like any utility, there is waste. Who's responsible for optimizing the infrastructure and reducing wasted expenses? It’s DevOps. The excess expense, known as cloud waste, comprises several interrelated problems: services running when they don't need to be, improperly sized infrastructure, orphaned resources, and shadow IT. There are a few core tenets of DevOps—holistic thinking, no silos, rapid useful feedback, and automation—that can be applied to reducing your cloud waste. Join Chris to learn why you should include continuous cost optimization in your DevOps processes. Automate cost control, reduce your cloud expenses, and make your life easier.
Transform Test Organizations for the New World of DevOpsTechWell
With the recent emergence of DevOps across the industry, testing organizations are being challenged to transform themselves significantly within a short period of time to stay meaningful within their organizations. It’s not easy to plan and approach these changes considering the way testing organizations have remained structured for ages. These challenges start from foundational organizational structures and can cut across leadership influence, competencies, tools strategy, infrastructure, and other dimensions. Sumit Kumar shares his experience assisting various organizations to overcome these challenges using an organized DevOps enablement framework. The framework includes radical restructuring, turning the tools strategy upside down, a multidimensional workforce enablement supported by infrastructure changes, redeveloped collaborations models, and more. From his real world experiences Sumit shares tips for approaching this journey and explains the roadmap for testing organizations to transform themselves to lead the quality in DevOps.
The Fourth Constraint in Project Delivery—LeadershipTechWell
All too often, the triple constraints—time, cost, and quality—are bandied about as if they are the be-all, end-all. While they are important, leadership—the fourth and larger underpinning constraint—influences the first three. Statistics on project success and failure abound, and these measurements are usually taken against the triple constraints. According to the Project Management Institute, only 53 percent of projects are completed within budget, and only 49 percent are completed on time. If so many projects overrun budget and are late, we can’t really say, “Good, fast, or cheap—pick two.” Rob Burkett talks about leadership at every level of a team. He shares his insights and stories gleaned from his years of IT and project management experience. Rob speaks to some of the glaring difficulties in the workplace in general and some specifically related to IT delivery and project management. Leave with a clearer understanding of how to communicate with teams and team members, and gain a better understanding of how you can be a leader—up and down your organization.
Resolve the Contradiction of Specialists within Agile TeamsTechWell
As teams grow, organizations often draw a distinction between feature teams, which deliver the visible business value to the user, and component teams, which manage shared work. Steve Berczuk says that this distinction can help organizations be more productive and scale effectively, but he recognizes that not all shared work fits into this model. Some work is best handled by “specialists,” that is people with unique skills. Although teams composed entirely of T-shaped people is ideal, certain skills are hard to come by and are used irregularly across an organization. Since these specialists often need to work closely with teams, rather than working from their own backlog, they don’t fit into the component team model. The use of shared resources presents challenges to the agile planning model. Steve Berczuk shares how teams such as those providing infrastructure services and specialists can fit into a feature+component team model, and how variations such as embedding specialists in a scrum team can both present process challenges and add significant value to both the team and the larger organization.
Pin the Tail on the Metric: A Field-Tested Agile GameTechWell
Metrics don’t have to be a necessary evil. If done right, metrics can help guide us to make better forward-looking decisions, rather than being used for simply managing or monitoring. They can help us identify trade-offs between options for what to do next versus punitive or worse, purely managerial measures. Steve Martin won’t be giving the Top Ten List of field-tested metrics you should use. Instead, in this interactive mini-workshop, he leads you through the critical thinking necessary for you to determine what is right for you to measure. First, Steve explores why you want to measure something—whether it’s for a team, a portfolio, or even an agile transformation. Next, he provides multiple real-life metrics examples to help drive home concepts behind characteristics of good and bad metrics. Finally, Steve shows how to run his field-tested agile game—Pin the Tail on the Metric. Take back this activity to help you guide metrics conversations at your organization.
Agile Performance Holarchy (APH)—A Model for Scaling Agile TeamsTechWell
A hierarchy is an organizational network that has a top and a bottom, and where position is determined by rank, importance, and value. A holarchy is a network that has no top or bottom and where each person’s value derives from his ability, rather than position. As more companies seek the benefits of agile, leaders need to build and sustain delivery capability while scaling agile without introducing unnecessary process and overhead. The Agile Performance Holarchy (APH) is an empirical model for scaling and sustaining agility while continuing to deliver great products. Jeff Dalton designed the APH by drawing from lessons learned observing and assessing hundreds of agile companies and teams. The APH helps implement a holarchy—a system composed of interacting organizational units called holons—centered on a series of performance circles that embody the behaviors of high performing agile organizations. Jeff describes how APH provides guidelines in the areas of leadership, values, teaming, visioning, governing, building, supporting, and engaging within an all-agile organization. Join Jeff to see what the APH is all about and how you can use it in your team and organization.
A Business-First Approach to DevOps ImplementationTechWell
DevOps is a cultural shift aimed at streamlining intergroup communication and improving operational efficiency for development and operations groups. Over time, inclusion of other IT groups under the DevOps umbrella has become the norm for many organizations. But even broadening the boundaries of DevOps, the conversation has been largely devoid of the business units’ place at the table. A common mistake organizations make while going through the DevOps transformation is drawing a line at the IT boundary. If that occurs, a larger, more inclusive silo within the organization is created, operating in an informational vacuum and causing operational inefficiency and goal misalignment. Sharing his experiences working on both sides of the fence, Leon Fayer describes the importance of including business units in order to align technology decisions with business goals. Leon discusses inclusion of business units in existing agile processes, benefits of cross-departmental monitoring, and a business-first approach to technology decisions.
Databases in a Continuous Integration/Delivery ProcessTechWell
DevOps is transforming software development with many organizations adopting lean development practices, implementing continuous integration (CI), and performing regular continuous deployment (CD) to their production environments. However, the database is largely ignored and often seen as a bottleneck in the DevOps process. Steve Jones discusses the challenges of database development and why many developers find the database to be an impediment to the CD process. Steve shares the techniques you can use to fit a database into the DevOps process. Learn how to store database code in a version control system, and the differences between that and application code. Steve demonstrates a CI process with SQL code and uses automated testing frameworks to check the code. Steve then shows how automated releases with manual gates can reduce the stress and risk of database deployments while ensuring consistent, reliable, repeatable releases to QA, UAT, and production.
Mobile Testing: What—and What Not—to AutomateTechWell
Organizations are moving rapidly into mobile technology, which has significantly increased the demand for testing of mobile applications. David Dangs says testers naturally are turning to automation to help ease the workload, increase potential test coverage, and improve testing efficiency. But should you try to automate all things mobile? Unfortunately, the answer is not always clear. Mobile has its own set of complications, compounded by a wide variety of devices and OS platforms. Join David to learn what mobile testing activities are ripe for automation—and those items best left to manual efforts. He describes the various considerations for automating each type of mobile application: mobile web, native app, and hybrid applications. David also covers device-level testing, types of testing, available automation tools, and recommendations for automation effectiveness. Finally, based on his years of mobile testing experience, David provides some tips and tricks to approach mobile automation. Leave with a clear plan for automating your mobile applications.
Cultural Intelligence: A Key Skill for SuccessTechWell
Diversity is becoming the norm in everyday life. However, introducing global delivery models without a proper understanding of intercultural differences can lead to difficulty, frustration, and reduced productivity. Priyanka Sharma and Thena Barry say that in our diverse world, we need teams with people who can cross these boundaries, communicate effectively, and build the diverse networks necessary to avoid problems. We need to learn about cultural intelligence (CI) and cultural quotient (CQ). CI is the ability to relate and work effectively across cultures. CQ is the cognitive, motivational, and behavioral capacity to understand and respond to beliefs, values, attitudes, and behaviors of individuals and groups. Together, CI and CQ can help us build behavioral capacities that aid motivation, behavior, and productivity in teams as well as individuals. Priyanka and Thena show how to build a more culturally intelligent place with tools and techniques from Leading with Cultural Intelligence, as well as content from the Hofstede cultural model. In addition, they illustrate the model with real-life experiences and demonstrate how they adapted in similar circumstances.
Turn the Lights On: A Power Utility Company's Agile TransformationTechWell
Why would a century-old utility with no direct competitors take on the challenge of transforming its entire IT application organization to an agile methodology? In an increasingly interconnected world, the expectations of customers continue to evolve. From smart meters to smart phones, IoT is creating a crisis point for industries not accustomed to rapid change. Glen Morris explains that pizzas can be tracked by the minute and packages at every stop, and customers now expect this same customer service model should exist for all industries—including power. Glen examines how to create momentum and transform non-IT-focused industries to an agile model. If you are struggling with gaining traction in your pursuit of agile within your business, Glen gives you concrete, practical experiences to leverage in your pursuit. Finally, he communicates how to gain buy-in from business partners who have no idea or concern about agile or its methodologies. If your business partners look at you with amusement when you mention the need for a dedicated Product Owner, join Glen as he walks you through the approaches to overcoming agile skepticism.
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...DanBrown980551
Do you want to learn how to model and simulate an electrical network from scratch in under an hour?
Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)!
During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook.
PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides:
- A fully editable and extendable library for grid component modelling;
- Visualization tools to display your network;
- Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses;
The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well.
What you will learn during the webinar:
- For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills;
- For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.
Accelerate your Kubernetes clusters with Varnish CachingThijs Feryn
A presentation about the usage and availability of Varnish on Kubernetes. This talk explores the capabilities of Varnish caching and shows how to use the Varnish Helm chart to deploy it to Kubernetes.
This presentation was delivered at K8SUG Singapore. See https://feryn.eu/presentations/accelerate-your-kubernetes-clusters-with-varnish-caching-k8sug-singapore-28-2024 for more details.
Key Trends Shaping the Future of Infrastructure.pdfCheryl Hung
Keynote at DIGIT West Expo, Glasgow on 29 May 2024.
Cheryl Hung, ochery.com
Sr Director, Infrastructure Ecosystem, Arm.
The key trends across hardware, cloud and open-source; exploring how these areas are likely to mature and develop over the short and long-term, and then considering how organisations can position themselves to adapt and thrive.
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Ramesh Iyer
In today's fast-changing business world, Companies that adapt and embrace new ideas often need help to keep up with the competition. However, fostering a culture of innovation takes much work. It takes vision, leadership and willingness to take risks in the right proportion. Sachin Dev Duggal, co-founder of Builder.ai, has perfected the art of this balance, creating a company culture where creativity and growth are nurtured at each stage.
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
Neuro-symbolic is not enough, we need neuro-*semantic*Frank van Harmelen
Neuro-symbolic (NeSy) AI is on the rise. However, simply machine learning on just any symbolic structure is not sufficient to really harvest the gains of NeSy. These will only be gained when the symbolic structures have an actual semantics. I give an operational definition of semantics as “predictable inference”.
All of this illustrated with link prediction over knowledge graphs, but the argument is general.
Securing your Kubernetes cluster_ a step-by-step guide to success !KatiaHIMEUR1
Today, after several years of existence, an extremely active community and an ultra-dynamic ecosystem, Kubernetes has established itself as the de facto standard in container orchestration. Thanks to a wide range of managed services, it has never been so easy to set up a ready-to-use Kubernetes cluster.
However, this ease of use means that the subject of security in Kubernetes is often left for later, or even neglected. This exposes companies to significant risks.
In this talk, I'll show you step-by-step how to secure your Kubernetes cluster for greater peace of mind and reliability.
UiPath Test Automation using UiPath Test Suite series, part 3DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 3. In this session, we will cover desktop automation along with UI automation.
Topics covered:
UI automation Introduction,
UI automation Sample
Desktop automation flow
Pradeep Chinnala, Senior Consultant Automation Developer @WonderBotz and UiPath MVP
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
The Art of the Pitch: WordPress Relationships and SalesLaura Byrne
Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes?
All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Albert Hoitingh
In this session I delve into the encryption technology used in Microsoft 365 and Microsoft Purview. Including the concepts of Customer Key and Double Key Encryption.
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Tobias Schneck
As AI technology is pushing into IT I was wondering myself, as an “infrastructure container kubernetes guy”, how get this fancy AI technology get managed from an infrastructure operational view? Is it possible to apply our lovely cloud native principals as well? What benefit’s both technologies could bring to each other?
Let me take this questions and provide you a short journey through existing deployment models and use cases for AI software. On practical examples, we discuss what cloud/on-premise strategy we may need for applying it to our own infrastructure to get it to work from an enterprise perspective. I want to give an overview about infrastructure requirements and technologies, what could be beneficial or limiting your AI use cases in an enterprise environment. An interactive Demo will give you some insides, what approaches I got already working for real.
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Jeffrey Haguewood
Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows.
We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases.
This video focuses on the notifications, alerts, and approval requests using Slack for Bonterra Impact Management. The solutions covered in this webinar can also be deployed for Microsoft Teams.
Interested in deploying notification automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Meet Big Agile: Testing on Large-Scale Projects
1. W16
Agile Testing
5/7/2014 3:00:00 PM
Meet Big Agile: Testing on
Large-Scale Projects
Presented by:
Geoff Meyer
Dell, Inc.
Brought to you by:
340 Corporate Way, Suite 300, Orange Park, FL 32073
888-268-8770 ∙ 904-278-0524 ∙ sqeinfo@sqe.com ∙ www.sqe.com
2. Geoff Meyer
Dell, Inc.
A test architect in the Dell Enterprise Solutions Group, Geoff Meyer has more than twenty-eight
years of experience as a software developer, manager, business analyst and test architect.
Geoff helps serve the software development practices of more than 800 development, test, and
UX engineers across four Global Design Centers. Geoff is an active member in and contributor
to the Agile Austin community.
3. 4/26/2014
1
Agile Testing @ Large
Geoff Meyer, geoffrey_meyer@dell.com
May 2014
Last updated: 25 February, 2014
Courtesy: Gulliver's Travels (2010)
Session Objectives
• Challenges to expect with Agile practices in
large-scale, multi-team projects
• Brief overview of Industry Models
• Real-world examples − from a large organization
perspective
• Organizational strategies & considerations
• Test automation considerations
• An In-depth Tools Discussion
• Focused on how to develop Test Automation
IS
IS
NOT
4. 4/26/2014
2
Geoff Meyer
• Dell Inc, 1998 – present
– Test Architect
› Agile Test & Automation Strategy
– Agile Steering Committee Co-Chair
– Global Projects
› 15 Scrum teams (2 regions)
› 11 Scrum teams (4 regions)
› 9 scrum teams (2 regions)
› 7 Scrum teams (4 regions)
• NCR Corp. 1984 – 1998
– SW developer, Project Lead, SW Manager
• B.S. Computer Science, San Diego State University
• Masters Engineering Management - NTU
3
4
Agenda
• The Dell Context and
• Early Agile Testing Challenges
• In Search of… Solutions for Scale
• Adaptations for Testing at Scale
• Automating in an Agile world
• Lessons of Large
Agile @
5. 4/26/2014
3
5
The Context at
Dell ESG
http://amazngwallpapers.blogspot.com
Dell Enterprise Solutions Group
Global Design and Development using Agile Scrum
6
Noida Design
Center
Bangalore
Design Center
Austin
Design Center
Silicon Valley
Design Center
6. 4/26/2014
4
Dell Enterprise Solutions
Software Products
• Server Systems Management
• Converged Infrastructure Systems Management
• Private Cloud Systems Management
• Console Plug-ins (i.e. for SCCM, vCenter…)
7
Common Product Characteristics:
• Embedded Software
• Large hardware support test matrix
• Software is installed in the Data Center
• Enterprise update cycles ~6 months
• Products must function even as underlying HW, FW,
BIOS, and Drivers are upgraded - SUSTAINING
Storage
Network
Compute
The Early
Challenges
8
?
http://cleaneatingchelsey.com/
7. 4/26/2014
5
Culture Transition
• Early commitment on Requirements
• Insufficient Detail in Requirements
• Development vs. Test
• A different “School” of Test1
• Fail Early, Inspect & Adapt
91 – Scott Barber “Approaches to Software Testing: An Introduction “
“ “Everybody, every team, every platform, every division,
every component is there not for individual competitive
profit or recognition, but for contribution to the system
as a whole”
W. Edwards Deming
Signs of Trouble
• Thursday’s Build
• Planning more stories into
sprint than team’s velocity
• High % of carry-overs
• Inability to Automate
Acceptance Tests within
Sprint
• “Engineering” Stories
Large-Scale
• Cross-team interdependencies block sprint
progress
• Large HW configuration validation consumes
test resources
• No single team had visibility to the entire product
• Insufficient Product Owner bandwidth
http://www.huffingtonpost.com/2012/03/21/truck-stuck-thomas-
circle_n_1369545.html?p=truck+and+underpass&vm=r
8. 4/26/2014
6
Test Automation Pitfalls
• Minimal guidance to Test beyond “Go forth and automate”
• Black Box Test Mentality
• Automation was interpreted by many as “Automate the UI”
11
• Insufficient SW engineering
skills across Test teams
• Architecture(s) not optimized
for Automatability
12
In Search of…
Solutions For
Scale
12. 4/26/2014
10
Agile Testing @ PG Enterprise Solutions Group
How did we go about it?
19
Process/Project
Culture/Organization
X-Large
project (15)
2011 2014
UI Automation
“Automate-First”
Service-level
automation ALM using
TFS
In-sprint
Automation
Accelerate
Automation
Skillset
Maximize
Utilization
Automation
Architects
Automated
Setup & Config
4 Geography
project (11)
2012
TDD &
Automated
UT
Non-Functional
Scale, Longevity
2010 2013
Test into
Scrum
2009
Collaborative
Seating
Rally
Agile @ Dell
Core Activities
• Pre-Sprint activities:
– Staffing
– Training - Project tools and processes
– CI/Build environment
– Automation Framework and BVT
• Establish Project-wide ‘Done’ criteria
• End-to-end, short duration User Stories
• Test Automation is included User Story acceptance
criteria
• Refresher Workshops for new projects
20
13. 4/26/2014
11
Week 1 Week 2
2 week Sprint Lifecycle Example
Manual Regression
Automated
Regression
Automated
Regression
Automated
Regression
Sprint
Planning
Automated
Regression
Automated
Regression
Sprint
Review
Retro
spective
Demo
Accept
User
Story
Demo
Accept
User
Story
Demo
Accept
User
Story
Demo
Accept
User
Story
Demo
Accept
User
Story
Product Owner
(or Proxy)
Scrum Master
Development
Test
Tech Pubs
UI
22
In-Sprint: Testing
• Design/Develop Test cases and Review with team
• Develop test automation and maintain in TFS
• Execute test cases (manual and automated)
• Immediate Feedback (IM, email, in-person) with team of
sightings… do not automatically enter defects
• Verify fixes for defects; re-test if needed
• Maintain test case status (in MTM)
• Cross-team coordination including Weekly SoS
Confidential
14. 4/26/2014
12
Agile @ Dell Roles/Responsibilities
23
Product
Owner
Product Owner Proxy
1 per Scrum
Scrum Master
1 per Scrum
Development
4-5 per Scrum
Test
3:1
Tech Pubs
1 per 3 scrum team
UI
1 per Scrum
Scrum teams
• Small teams
• Co-located
• Multi-disciplined
• Feature-based
• Distributed Projects
• Scrum of Scrums
• Teams formed from
functional silos
…
Release Manager
SW Architect
Test Architect
Automation Architect
Cross-team Test roles
24
• Test Architect
– Defines Test Strategy across all Scrum
teams
– Establishes non-Functional Test
approach
– Influences consistent Application
Architectures
• Automation Architect
– Leads Analysis and POC activities for
new automation needs
– Ensures automation consistency for
BVT and nightly regression suites
– Safeguards against automation tool
proliferation
15. 4/26/2014
13
EXAMPLE - Project-wide “Done” criteria
25
Code
– Junit Tests
– SONAR
– Code Reviews completed
– All User Story tasks completed
– Demo and accepted by Product
Owner
– All known error conditions caught
and handled appropriately
– Code is Globalized
Test
– Acceptance Tests Reviewed with
scrum team
– Acceptance Tests documented in
Tool
– All planned Acceptance Tests for
User Story has been attempted
– Acceptance Tests executed
against Test system configuration
– Defects that are “must fix” before
releasing must be fixed prior to
story acceptance
– Service-level automated tests
– Service-level automated Tests are
globalized
Large-Scale Complexities
26
Characteristic Description
Large-Scale Project consists of more
than 4 Scrum teams
Interdependency Requirements
implemented across
multiple Scrum teams
Extensive
Configuration
Matrix
Extensive HW or SW
configurations
Waterfall
Intersection
One or more
components are
managed using Waterfall
Geography Project members are
Geographically dispersed
16. 4/26/2014
14
Development
Usability
Test
Wireframes
Architecture
Automation FW/Tools
Release Planning
Pre-sprints
Pre-sprints
HW resources
HW resources
Pre-sprints
: Agile with Adaptations
27
Hardening
1 2 3 N-1 N
1 2 3 N-1 N
1 2 3 N-1 N
… Sprints
Define Plan Develop Launch
OLP
…
Software System Test
Extended Sprint Test
Stability
Agile @
Extended Sprint Test
Extended Hardware Configurations
• Optimizes HW utilization and cost in
support of Scrum teams
• Owns Test Execution against extended
configurations
• Scrum team:
– Establishes Acceptance criteria
– Identifies all Test scenarios
– Owns Test Execution against reference
configuration(s)
– Develops in-sprint automation tests
28
Configurations
Positive X X X X
Negative X X X
Boundary X X X
Stress X X
Scalability X X X
Concurrency X X X
Globalization X X
Candidate for
Extended Sprint Test
17. 4/26/2014
15
Pre-SST
Software System Test
“Alpha Customer”
29
Hardening
• Workflow Design
• Test Analysis
• Test Design
• Test Development
• Test Automation
Development
• Test Execution
• Regression Test
• Test Execution
• Regression Test
SST
IS IS NOT
Requirements-based Functional testing
Customer-usage based First time integration test of workflows
Interoperability coverage of HCL in
specific customer environments
Exhaustive interoperability matrix
coverage of the HCL
Three phased approach Performance baseline testing
SAFe1 &
30
Agile @
1- Courtesy of Dean Leffingwell and Al Goerner of Valtech
Scrum teams
System team
18. 4/26/2014
16
PG Enterprise Validation
Agile & Waterfall Converged Model
Dell Confidential31
SST
Hardware Product Test
EST
Final
EST NEST 1
Sprint1 Sprint2
Sprint
N-1
SprintN
Sprint1 Sprint2
Sprint
N-1
SprintN
Sprint1 Sprint2
Sprint
N-1
SprintN
Hardening
Stability
Sprint
ExtendedSprints
SW
Regression
Test
Solution stack with
software focus SST
EST Exit
CCB Review
Code Freeze
A-Rev
Final
Extended Regression
F
V
PT
Stability
SST
A-Rev
Candidate
SSI
Stability
Sprint
RC-0
Regression
Regression
HW-Specific User Stories Complete
HW Enablement Features Complete
Vendor Deliverables Required
100% PT Attempted
All Stories Accepted
Feature Complete
X-on-A Stories
Accepted
PG Enterprise Validation
Agile @ Dell
Geography
32
• Co-location of a Scrum
team is always preferred
• Limit geographical
distribution of Scrum
team to no more than
two time-zones
• Scrum teams within a
project can be distributed
19. 4/26/2014
17
33
Automating in
an Agile World
Opportunities for Automation
• It’s not just about automating test cases
• Can also provide efficiencies to:
–Test Preparation, Setup and Configuration
–Non-Functional Testing (“ility”)
› Longevity, Scale and Performance Characterization
–Compatibility Testing (Solution and Device)
34
20. 4/26/2014
18
Test Preparation
• Bare-metal Deployment
• Setup & Configuration
– OS Provisioning and
Configuration
• Test case staging
• Environment
Cleanup/Baseline
• Virtualization-based test
environments
35
Test Content Development
• UI automation on Customer
Usage workflows
36
CAUTION: Application Architecture can be an enabler or inhibitor
• Unit Test Automation
• In-Sprint, Automated
Acceptance Tests
• Web-services (or CLI) Test
Automation for Functional
Testing
• Automated CI (UT, Build,
BVT)
2 - Agile Testing: A Practical Guide for Testers and Agile teams
2
21. 4/26/2014
19
Application Architecture Matters
• Does it facilitate testing at the API/Services level?
• Does the Business/Error Logic reside below the services
level?
• Does the UI architecture support test automation other
than record-playback?
37
Large Scale Organizations:
• Standardize UI architectures across the product
portfolio
• HTML5, Flex, Silverlight…
• Standardize Service architectures across the
product portfolio
• SOAP, REST, CLI, API
Non-Functional Testing
• Performance Characterization
• Longevity
• Stress
• Scale
• Concurrency
38
Often times analysis of
these areas are simply
too cost-prohibitive to
be done manually
3- http://lisacrispin.com/wordpress/2011/11/08/using-the-agile-testing-quadrants/
3
23. 4/26/2014
21
The Lessons of ‘Large’
1. Co-located Teams
2. Project-wide ‘Done’
Criteria
3. Culture of Automation
4. System Test Team
5. Test Architect
6. ALM Tooling
Questions?
42
24. 4/26/2014
22
Resources
• Agile Manifesto - http://agilemanifesto.org/
• Articles/Blogs:
– http://support.smartbear.com/articles/testcomplete/automated-testing-agile-environment/ -
SmartBear
– http://lisacrispin.com/wordpress/2011/11/08/using-the-agile-testing-quadrants/ - Lisa Crispin
– http://www.stickyminds.com/sitewide.asp?Function=edetail&ObjectType=COL&ObjectId=177
93&tth=DYN&tt=siteemail&iDyn=2 – Rajini Padmanaban
– Beyond Agile Testing: http://www.utest.com/int-v1/a/beyond-agile-testing - uTest
– Testing and Checking Refined: http://www.satisfice.com/blog/archives/856 - James Bach
and Michael Bolton
• Books:
– Scaling Software Agility: Best Practices for Large Enterprises – Dean Leffingwell
– How Google Tests Software – James Whittaker, Jason Arbon, Jeff Carollo
– Agile Testing: A Practical Guide for Testers and Agile teams – Lisa Crispin, Janet Gregory
– http://www.dorothygraham.co.uk/automationExperiences/index.html - Dorothy Graham
• Presentations:
– Approaches to Software Testing: An Introduction – Scott Barber
– Scaled Agile Framework Big Picture – Dean Leffingwell
43
Backup
44