https://youtu.be/PmBIGP3M9sI
Understand how to migrate your Rundeck environment from the community edition to Enterprise, including the pros and cons of each migratory approach.
In this webinar, you will learn how to:
-Determine which migration approach is most appropriate for your environment
-Shift from a single-server to clustered environment
-Migrate jobs and projects while keeping a clean install
From Iterative to Continuous Delivery, PNSQC 2014John Ruberto
The business team complained that 3-week release cycle was not fast enough. We changed to a continuous delivery cycle, releasing stories as soon as they were ready to be released. This presentation was given at the Pacific Northwest Software Quality Conference in 2014. http://bit.ly/1xCuKWD
Worksoft certify online training basic demo tutorialITJobZone.biz
Worksoft Certify Basic Tutorials on Layout, Process, Variables, Recordset and More. Learn Worksoft Certify from the best trainers in the industry. http://www.itjobzone.biz/Worksoft-certify-training-automation-testing.html
See what is new with Worksoft Certify. This presentation covers the new features in Certify 10.0.01 including automated exploratory testing, process compare, and how to find and replace values and variables easily. It also explains how to test APIs via SoapUI.
Agile Testing Days 2017 Intoducing AgileBI Sustainably - ExcercisesRaphael Branger
"We now do Agile BI too” is often heard in todays BI community. But can you really "create" agile in Business Intelligence projects? This presentation shows that Agile BI doesn't necessarily start with the introduction of an iterative project approach. An organisation is well advised to establish first the necessary foundations in regards to organisation, business and technology in order to become capable of an iterative, incremental project approach in the BI domain.
In this session you learn which building blocks you need to consider. In addition you will see what a meaningful sequence to these building blocks is. Selected aspects like test automation, BI specific design patterns as well as the Disciplined Agile Framework will be explained in more and practical details.
Citrix Systems Inc. has an IT landscape consisting of diversified technologies that include SAP, SAP Ariba, Concur, and Workday solutions. Learn how Citrix put in place a test automation strategy to achieve end-to-end quality and validation of complex business processes that span multiple SAP technology solutions. Citrix HR, procurement, and travel and expenses business processes, which require integration between a hosted SAP solution and cloud-based Workday, SAP Ariba, and Concur platforms, will be explained.
Running automated, unattended, end-to-end tests in parallel at scale is challenging. Fortunately, Lights Out Testing makes it possible to test any business process on demand. During this webinar we discuss how you can get started with automated test execution.
https://youtu.be/PmBIGP3M9sI
Understand how to migrate your Rundeck environment from the community edition to Enterprise, including the pros and cons of each migratory approach.
In this webinar, you will learn how to:
-Determine which migration approach is most appropriate for your environment
-Shift from a single-server to clustered environment
-Migrate jobs and projects while keeping a clean install
From Iterative to Continuous Delivery, PNSQC 2014John Ruberto
The business team complained that 3-week release cycle was not fast enough. We changed to a continuous delivery cycle, releasing stories as soon as they were ready to be released. This presentation was given at the Pacific Northwest Software Quality Conference in 2014. http://bit.ly/1xCuKWD
Worksoft certify online training basic demo tutorialITJobZone.biz
Worksoft Certify Basic Tutorials on Layout, Process, Variables, Recordset and More. Learn Worksoft Certify from the best trainers in the industry. http://www.itjobzone.biz/Worksoft-certify-training-automation-testing.html
See what is new with Worksoft Certify. This presentation covers the new features in Certify 10.0.01 including automated exploratory testing, process compare, and how to find and replace values and variables easily. It also explains how to test APIs via SoapUI.
Agile Testing Days 2017 Intoducing AgileBI Sustainably - ExcercisesRaphael Branger
"We now do Agile BI too” is often heard in todays BI community. But can you really "create" agile in Business Intelligence projects? This presentation shows that Agile BI doesn't necessarily start with the introduction of an iterative project approach. An organisation is well advised to establish first the necessary foundations in regards to organisation, business and technology in order to become capable of an iterative, incremental project approach in the BI domain.
In this session you learn which building blocks you need to consider. In addition you will see what a meaningful sequence to these building blocks is. Selected aspects like test automation, BI specific design patterns as well as the Disciplined Agile Framework will be explained in more and practical details.
Citrix Systems Inc. has an IT landscape consisting of diversified technologies that include SAP, SAP Ariba, Concur, and Workday solutions. Learn how Citrix put in place a test automation strategy to achieve end-to-end quality and validation of complex business processes that span multiple SAP technology solutions. Citrix HR, procurement, and travel and expenses business processes, which require integration between a hosted SAP solution and cloud-based Workday, SAP Ariba, and Concur platforms, will be explained.
Running automated, unattended, end-to-end tests in parallel at scale is challenging. Fortunately, Lights Out Testing makes it possible to test any business process on demand. During this webinar we discuss how you can get started with automated test execution.
Packaged enterprise apps are different from custom apps, and that means testing has to be different too. During this webinar we discussed these differences and provided strategies for supporting every aspect of implementing, testing, and running large enterprise applications.
The changing role of a QA | QualiTest GroupQualitest
QualiTest considers the traditional role of Manual QA in the ever developing world of Software Testing. How will the changing role of developers affect manual QA? Let's think about that for a moment.
QualiTest is the world’s second largest pure play software testing and QA company. Testing and QA is all that we do! visit us at: www.QualiTestGroup.com
YETI Cooler's Guide to Pulling off a Rock Solid SAP S/4HANA Software Implemen...Worksoft
Learn how YETI built a comprehensive plan for its company-wide SAP S/4HANA software deployment by utilizing intelligent automation to document and validate business processes and support adoption.
Something old, something new, and the road between - Stephan PodevynComarch
Current trends in the Insurance Business. General overview of how the Insurance business will change in the upcoming years and how companies can adapt by using innovative technology. Tips on how to become the Insurer of the Future in the Benelux region. Presentation held by Stephan Podevyn at Comarch Benelux Insurance Breakfast on the 18th of September in Brussels.
Tired of spending countless hours updating and maintaining HP UFT test scripts? You’re not alone! Now you can escape the complexity and high cost of HP UFT test maintenance without losing your existing SAP GUI test cases.
The HP UFT Replacement Program makes it easy to eliminate duplicate tests and improve business process coverage while reducing test cases by 70% or more.
Operations in the Continuous Delivery EcosystemTechWell
As development teams move toward a more agile development process coupled with continuous delivery (CD), the role of operations has evolved from a support organization to an integral part of the product delivery ecosystem. Today, operations organizations need to be agile in their feature delivery, but as requests come from different stakeholders, operations must balance their investments in support tasks, urgent tooling requests, and strategic projects. Sumedha Ganjoo explains why it is important for an operations organization to move toward CD and identifies process, tools, and development changes required for its implementation. Sumedha shares changes her team made to be more agile while planning and prioritizing work, as well as changes to development practices that helped the team move toward CD. To explore the benefits of an operations organization adopting continuous delivery and to see how you can start moving toward it, join Sumedha for this session.
Do you have to learn code to create test automation? The answer is no. The latest technology enables business and QA teams to ensure enterprise application quality using easy to maintain, plain English tests. Powerful automated business process discovery, risk based analysis and lights-out regression tests can then be used to extend automation and create additional value – all without code!
Accelerate Your Test Automation Journey with Process Mining for SAPWorksoft
You’ve made the commitment to accelerate your business with automation, but then handicap that effort by manually capturing and documenting your current business processes. Why limit your discovery initiatives to time intensive SME interviews and motion studies? Accelerate and expand the scope of discovery efforts by using every historical transaction performed by every user to rapidly build a robust library of test cases automatically with Process Mining for SAP.
Everything You Need to Build a Risk-Based Testing Strategy for SAPWorksoft
SAP testing isn’t easy. Organizations are challenged to keep pace with an incredible (and growing) volume of enhancements, updates, upgrades, and new apps. But traditional SAP impact analysis is time consuming, costly, and difficult to manage. That’s why the world’s top companies are turning to risk-based testing. Here’s how you can get started too.
According to our customer surveys and confirmed by industry statistics, manual testers spend 50-70% of their effort on finding and preparing appropriate test data. Considering the fact that manual testing still accounts for 80+% of test operation efforts, up to half (!) of the overall testing effort goes into dealing with test data.
Find out how Tosca Testsuite can help you to lower the maintenance effort of your test data and operating costs of your test environment while building an efficient test data management strategy.
Agile Testing - Qualitia is a software testing tool offers continous delivery, test efficiency, reduce maintenance, re-usability and many other features.
AGILE methodology is a practice that promotes continuous iteration of development and testing throughout the software development lifecycle of the project.
VMworld 2013: SDDC IT Operations Transformation: Multi-customer Lessons LearnedVMworld
VMworld 2013
Bjoern Brundert, VMware
Valentin Hamburger, VMware
Learn more about VMworld and register at http://www.vmworld.com/index.jspa?src=socmed-vmworld-slideshare
From prototype to production - The journey of re-designing SmartUp.ioMáté Lang
Talk about the joureny of small tech team re-designing SmartUp.io from scratch, and the technical paths from MVP to Production.
High level overview of architecture and tech stack decisions, best-practices and culture.
Packaged enterprise apps are different from custom apps, and that means testing has to be different too. During this webinar we discussed these differences and provided strategies for supporting every aspect of implementing, testing, and running large enterprise applications.
The changing role of a QA | QualiTest GroupQualitest
QualiTest considers the traditional role of Manual QA in the ever developing world of Software Testing. How will the changing role of developers affect manual QA? Let's think about that for a moment.
QualiTest is the world’s second largest pure play software testing and QA company. Testing and QA is all that we do! visit us at: www.QualiTestGroup.com
YETI Cooler's Guide to Pulling off a Rock Solid SAP S/4HANA Software Implemen...Worksoft
Learn how YETI built a comprehensive plan for its company-wide SAP S/4HANA software deployment by utilizing intelligent automation to document and validate business processes and support adoption.
Something old, something new, and the road between - Stephan PodevynComarch
Current trends in the Insurance Business. General overview of how the Insurance business will change in the upcoming years and how companies can adapt by using innovative technology. Tips on how to become the Insurer of the Future in the Benelux region. Presentation held by Stephan Podevyn at Comarch Benelux Insurance Breakfast on the 18th of September in Brussels.
Tired of spending countless hours updating and maintaining HP UFT test scripts? You’re not alone! Now you can escape the complexity and high cost of HP UFT test maintenance without losing your existing SAP GUI test cases.
The HP UFT Replacement Program makes it easy to eliminate duplicate tests and improve business process coverage while reducing test cases by 70% or more.
Operations in the Continuous Delivery EcosystemTechWell
As development teams move toward a more agile development process coupled with continuous delivery (CD), the role of operations has evolved from a support organization to an integral part of the product delivery ecosystem. Today, operations organizations need to be agile in their feature delivery, but as requests come from different stakeholders, operations must balance their investments in support tasks, urgent tooling requests, and strategic projects. Sumedha Ganjoo explains why it is important for an operations organization to move toward CD and identifies process, tools, and development changes required for its implementation. Sumedha shares changes her team made to be more agile while planning and prioritizing work, as well as changes to development practices that helped the team move toward CD. To explore the benefits of an operations organization adopting continuous delivery and to see how you can start moving toward it, join Sumedha for this session.
Do you have to learn code to create test automation? The answer is no. The latest technology enables business and QA teams to ensure enterprise application quality using easy to maintain, plain English tests. Powerful automated business process discovery, risk based analysis and lights-out regression tests can then be used to extend automation and create additional value – all without code!
Accelerate Your Test Automation Journey with Process Mining for SAPWorksoft
You’ve made the commitment to accelerate your business with automation, but then handicap that effort by manually capturing and documenting your current business processes. Why limit your discovery initiatives to time intensive SME interviews and motion studies? Accelerate and expand the scope of discovery efforts by using every historical transaction performed by every user to rapidly build a robust library of test cases automatically with Process Mining for SAP.
Everything You Need to Build a Risk-Based Testing Strategy for SAPWorksoft
SAP testing isn’t easy. Organizations are challenged to keep pace with an incredible (and growing) volume of enhancements, updates, upgrades, and new apps. But traditional SAP impact analysis is time consuming, costly, and difficult to manage. That’s why the world’s top companies are turning to risk-based testing. Here’s how you can get started too.
According to our customer surveys and confirmed by industry statistics, manual testers spend 50-70% of their effort on finding and preparing appropriate test data. Considering the fact that manual testing still accounts for 80+% of test operation efforts, up to half (!) of the overall testing effort goes into dealing with test data.
Find out how Tosca Testsuite can help you to lower the maintenance effort of your test data and operating costs of your test environment while building an efficient test data management strategy.
Agile Testing - Qualitia is a software testing tool offers continous delivery, test efficiency, reduce maintenance, re-usability and many other features.
AGILE methodology is a practice that promotes continuous iteration of development and testing throughout the software development lifecycle of the project.
VMworld 2013: SDDC IT Operations Transformation: Multi-customer Lessons LearnedVMworld
VMworld 2013
Bjoern Brundert, VMware
Valentin Hamburger, VMware
Learn more about VMworld and register at http://www.vmworld.com/index.jspa?src=socmed-vmworld-slideshare
From prototype to production - The journey of re-designing SmartUp.ioMáté Lang
Talk about the joureny of small tech team re-designing SmartUp.io from scratch, and the technical paths from MVP to Production.
High level overview of architecture and tech stack decisions, best-practices and culture.
Always Be Deploying. How to make R great for machine learning in (not only) E...Wit Jakuczun
The presentation I delivered at WhyR 2019.
Abstract:
For many years software engineers have put enormous effort to develop best practices to deliver stable and maintainable software. How R users can benefit from this experience? I will try to answer this question going through several concepts and tools that are natural for software engineers but are often undervalued by R users.
I will start with a description of the deployment process because this is the ultimate step that exposes all weaknesses. You will learn about structuring R project, using abstractions to manage model’s features, automating models building process, optimizing the performance of the solution and the challenges of the deployment process itself.
Raggiungere nuovi livelli di time-to market ed efficienza: dallo sviluppo, al test, alla produzone in un solo passo.
Gabriele Giacomelli, HP ALM Solution Consultant
Presentation given at the OpenStack summit in Paris (Kilo) on Tue Nov 4th.
Last summit I had the pleasure to present a talk which encountered some success "Are enterprise ready for the OpenStack transformation?" (also published on SlideShare) . This talk is a follow up on what are the best practices that are successful in operating the transformation. We will first focus on identifying the right use cases for a generic enterprise, then define a roadmap with an organisational and a technical track, to finish with the definition what would be our success criterias for our group. This will happen as a workshop summary based on the multiple engagements eNovance has been delivering over the past 2 years.
Are you planning to move existing applications to the cloud and want to avoid setbacks? These slides are from a webinar jointly presented by Atmosera and iTrellis, LLC. The webinar can help you find out how to assess your needs, plan out a migration and successfully operate your applications in a modern cloud environment. The webinar will provide the following answers:
* What re-platforming means and why you need to think about it
* How to take full advantage of a cloud such as Azure: agility, flexibility, and cost savings
* Lessons learned and best practices for planning a successful move to a modern cloud.
The full webinar playback URL is at https://www.atmosera.com/webinar-replatforming-application-cloud/
Your Testing Is Flawed: Introducing A New Open Source Tool For Accurate Kuber...StormForge .io
Complimentary Live Webinar
Sponsored by StormForge
Analyzing the performance and behavior of applications run on Kubernetes is often challenging, making the need to optimize prior to production something that you must have. However, a problem has reared its head in the form of a question: How do you get an accurate measurement of application performance or other behavior without accurate testing or an accurate representation of how it will run in production? In this webinar, we will present and discuss a new fully Open Source tool for creating the needed tests with which to accurately measure your applications. We hope you will join us to learn more about this tool, and find out how you can help contribute.
This webinar is sponsored by StormForge and hosted by The Linux Foundation.
Speaker
Noah Abrahams, Open Source Advocate
Noah is an Open Source Advocate for StormForge, merging Open Source Strategy with Developer Advocacy. He has been involved in cloud for over 12 years, has been contributing to the Kubernetes ecosystem for 5 years, and has been up and down the business stack from DevOps and Architecture to Sales, Enablement, and Education. You will find him running meetups in Las Vegas and attending conferences, once those are both happening again.
Behaviour Driven Development: Oltre i limiti del possibileIosif Itkin
The QA Financial Forum: Milan 2019
23 January at the Excelsior Hotel Gallia.
Anna-Maria Lukina, Exactpro Business Development Director
The QA Financial Forum: Milan is one of the leading fintech conferences in Italy. The event focuses on the latest achievements in software risk management and automation of software testing. The predominant theme of the Milan event will be Quality Assurance for the entire Software Development Life Cycle (SDLC).
The topics under discussion will feature:
- Technologies for Automation & AI
- DevOps & CI/CD
- Value Stream Management
- Test Data Management
- Regulatory Compliance
- App Security & DevSecOps
- Testing and quality assurance of Blockchain platforms
The official language of the event is Italian.
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Tobias Schneck
As AI technology is pushing into IT I was wondering myself, as an “infrastructure container kubernetes guy”, how get this fancy AI technology get managed from an infrastructure operational view? Is it possible to apply our lovely cloud native principals as well? What benefit’s both technologies could bring to each other?
Let me take this questions and provide you a short journey through existing deployment models and use cases for AI software. On practical examples, we discuss what cloud/on-premise strategy we may need for applying it to our own infrastructure to get it to work from an enterprise perspective. I want to give an overview about infrastructure requirements and technologies, what could be beneficial or limiting your AI use cases in an enterprise environment. An interactive Demo will give you some insides, what approaches I got already working for real.
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
91mobiles recently conducted a Smart TV Buyer Insights Survey in which we asked over 3,000 respondents about the TV they own, aspects they look at on a new TV, and their TV buying preferences.
The Art of the Pitch: WordPress Relationships and SalesLaura Byrne
Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes?
All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.
Elevating Tactical DDD Patterns Through Object CalisthenicsDorra BARTAGUIZ
After immersing yourself in the blue book and its red counterpart, attending DDD-focused conferences, and applying tactical patterns, you're left with a crucial question: How do I ensure my design is effective? Tactical patterns within Domain-Driven Design (DDD) serve as guiding principles for creating clear and manageable domain models. However, achieving success with these patterns requires additional guidance. Interestingly, we've observed that a set of constraints initially designed for training purposes remarkably aligns with effective pattern implementation, offering a more ‘mechanical’ approach. Let's explore together how Object Calisthenics can elevate the design of your tactical DDD patterns, offering concrete help for those venturing into DDD for the first time!
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
DevOps and Testing slides at DASA ConnectKari Kakkonen
My and Rik Marselis slides at 30.5.2024 DASA Connect conference. We discuss about what is testing, then what is agile testing and finally what is Testing in DevOps. Finally we had lovely workshop with the participants trying to find out different ways to think about quality and testing in different parts of the DevOps infinity loop.
UiPath Test Automation using UiPath Test Suite series, part 4DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 4. In this session, we will cover Test Manager overview along with SAP heatmap.
The UiPath Test Manager overview with SAP heatmap webinar offers a concise yet comprehensive exploration of the role of a Test Manager within SAP environments, coupled with the utilization of heatmaps for effective testing strategies.
Participants will gain insights into the responsibilities, challenges, and best practices associated with test management in SAP projects. Additionally, the webinar delves into the significance of heatmaps as a visual aid for identifying testing priorities, areas of risk, and resource allocation within SAP landscapes. Through this session, attendees can expect to enhance their understanding of test management principles while learning practical approaches to optimize testing processes in SAP environments using heatmap visualization techniques
What will you get from this session?
1. Insights into SAP testing best practices
2. Heatmap utilization for testing
3. Optimization of testing processes
4. Demo
Topics covered:
Execution from the test manager
Orchestrator execution result
Defect reporting
SAP heatmap example with demo
Speaker:
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
JMeter webinar - integration with InfluxDB and GrafanaRTTS
Watch this recorded webinar about real-time monitoring of application performance. See how to integrate Apache JMeter, the open-source leader in performance testing, with InfluxDB, the open-source time-series database, and Grafana, the open-source analytics and visualization application.
In this webinar, we will review the benefits of leveraging InfluxDB and Grafana when executing load tests and demonstrate how these tools are used to visualize performance metrics.
Length: 30 minutes
Session Overview
-------------------------------------------
During this webinar, we will cover the following topics while demonstrating the integrations of JMeter, InfluxDB and Grafana:
- What out-of-the-box solutions are available for real-time monitoring JMeter tests?
- What are the benefits of integrating InfluxDB and Grafana into the load testing stack?
- Which features are provided by Grafana?
- Demonstration of InfluxDB and Grafana using a practice web application
To view the webinar recording, go to:
https://www.rttsweb.com/jmeter-integration-webinar
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Ramesh Iyer
In today's fast-changing business world, Companies that adapt and embrace new ideas often need help to keep up with the competition. However, fostering a culture of innovation takes much work. It takes vision, leadership and willingness to take risks in the right proportion. Sachin Dev Duggal, co-founder of Builder.ai, has perfected the art of this balance, creating a company culture where creativity and growth are nurtured at each stage.
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
Eliciting Operations Requirements for Applications
1. NICTA Copyright 2012 From imagination to impact
Eliciting
Operations
Requirements for
Applications
L. Bass, R. Jeffrey, I. Weber,
H. Wada and L. Zhu
2. NICTA Copyright 2012 From imagination to impact
Operations Requirements
● "Through 2015, 80% of outages will be caused
by people and process issues. 50% are caused
by change, config and release" - Gartner
● Devs and Ops are (still) isolated but Ops are
important source of product requirements
○ Before unit-test, less attention paid to "testability"
○ In DevOps era, we should incorporate "operatability"
into products
● Making applications operation process aware!
○ But where requirements come from?
3. NICTA Copyright 2012 From imagination to impact
Overview of Our Study
● Studied sources of operations requirements and
discuss in the context of our spin-out
○ Operations personnel
○ Internal development efforts
○ Operations standards
○ Organizational process descriptions
○ Academic studies
● Model processes and the product
○ Verify if a product satisfies operations
requirements
4. NICTA Copyright 2012 From imagination to impact
Standards and Organizational Process
● Process standards, ISO 15504 or ITIL, are good
source but not specific enough to turn into
product requirements
● Organizational process descriptions tends to
provide more details
○ e.g., resource migration in Amazon Web Services [1]
● We found standards are useful to (1) implement
(automate) into a product, and (2) define a method
to validate the process by operators
[1] media.amazonwebservices.com/AWS_Migrate_Resources_To_New_Region.pdf
5. NICTA Copyright 2012 From imagination to impact
Example Operational Requirement
● CP-6 Alternate Storage Site, NIST 800-53
○ "The organization establishes an alternate storage
site including necessary agreements to permit the
storage and recovery of information system backup
information"
● Derived product requirement
○ "The product shall maintain backup in an alternate
storage site. The product shall provide a method to
assess the recoverability of the system"
● Actual implementation in our product
○ Setup a backup site and a schedule job as part of
product initialization. Otherwise, launch fails
○ Provide a report to assess the quality of backup (e.g,
timestamp, execution time, capacity of disk, ...)
6. NICTA Copyright 2012 From imagination to impact
Academic Studies
● Difference between the environment is the most
common source of upgrade problem [2]
○ Called "hidden dependencies" - incorrect file path,
incorrect network address, library conflict, ...
● Hidden dependencies is a useful list of product
requirements
● Actual implementation in our product
○ e.g., run dependency check at boot. Terminate the
app immediately to prevent fatal issues occurring
later (e.g., getting data corrupted)
○ Boot failure is easy to detect - make Ops happy
[2] T. Dumitras, "Why do upgrades fail and what can we do about it?: towards dependable, online
upgrades in enterprise system", Middleware 2009
7. NICTA Copyright 2012 From imagination to impact
Internal DevOps Experience
● Context: Our spin-out provides a SaaS solution
for replicating resources in AWS
● Issue: Expensive to clean up resources
○ Tests
○ Handle unexpected failures
● "undo" functionality to revert the resource status
to a certain point [3]
○ Easy to run tests
○ Easy to clean up the mess
[3] I. Weber, et. al. "Automatic undo for cloud management via AI planning," HotDep'12
8. NICTA Copyright 2012 From imagination to impact
Towards the formal validation
● Incorporating Ops requirements into
development/product is useful; however, how to
verify the implementation is correct?
● Our on-going work - modeling process and
product together
○ Does the product satisfy ops requirements?
○ The process operates the product as required?
9. NICTA Copyright 2012 From imagination to impact
Example
● Model the mixed-
version upgrading
process
● Version conflict
between clients and
servers over long
running process
● We're evaluating this
method in a real
system
10. NICTA Copyright 2012 From imagination to impact
Conclusion
● Operations including release are a large source
of outages
● To improve the "operatability" of products, we
studied operations requirements
● Future work: validate whether the "operatabiliy"
is satisfied by implementations?