![Expectations ,[object Object],[object Object]](data:image/gif;base64,R0lGODlhAQABAIAAAAAAAP///yH5BAEAAAAALAAAAAABAAEAAAIBRAA7)
More Related Content
What's hot
What's hot (16)
Similar to Too Dependent on Shared Test Environments? Kick Start Local Workstation Testing!
Similar to Too Dependent on Shared Test Environments? Kick Start Local Workstation Testing! (20)
Recently uploaded
Recently uploaded (20)
Too Dependent on Shared Test Environments? Kick Start Local Workstation Testing!
- 1. Too Dependent on Shared Test Environments? Kick Start Local Workstation Testing! Stelios Pantazopoulos Eric Liu
- 4. Test Workflow Local Dev Sandbox Isolated Full Access Very Few Controls Integrated Test Environment Shared Restricted Access Controlled
- 5. Challenges Faced in Shared Test Environments Has the calculation fix been deployed to the QA environment? I’d like to re-test it. Sorry, the deployer is out for the rest of the afternoon, so we’ll have to wait till tomorrow.
- 6. Challenges Faced in Shared Test Environments (2) I’d like to re-test the screen which an administrator should be able to get to, but couldn’t. The fix to that screen has been deployed, but we’re still waiting for the administrator role to be added to your user in Active Directory…
- 7. Challenges Faced in Shared Test Environments (3) How can I test the behaviour of the system during the last hour of the day? We’ll have to setup data and wait till 11pm…
- 9. Test Workflow Integrated Test Environment Local Test Sandbox Local Dev Sandbox Integrated Test Environment
- 23. Fire up Local Workstation Test Build!
- 27. Application Architecture to Support Local Testing Application Database Corporate Directory External Service
- 29. Application Architecture to Support Testing Application Database Corporate Directory External Service Clock Configuration System
- 30. Application Configured to Support Local Testing Application Database Clock Security Groups Local Store Configuration Rich Data Set External Data
- 35. Questions?
Editor's Notes
- Intro: Stelios and Eric worked together on a large-scale legacy replacement project for a web-based gas accounting system in Calgary.
- We’ll quickly read out each one and discuss whether/how we will meet that expectation. Those expectations which we can’t meet will be placed in the ‘Parking Lot’ part of the wall. If we have time, we’ll get to them, or participants can talk to the facilitators after the workshop.
- Eric
- Stelios Production-Like Hardware and Data Integrated with External Dependencies Controlled Access May Affect Problem Diagnosis Shared Environment Data Coordination with Other Testers Complex and Lengthy Deployment Process Change Requests Schedule Deployer Time
- Restricted Access
- Hard to test aspects of application
- Hard to test aspects of application
- Have you faced similar challenges on your projects, where your testing is hindered by long wait times or just the nature of these environments?
- WHAT IF, you have access to both an integrated test environment, AND a rich and sophisticated enough local test sandbox environment? And that you can do a majority the testing in that environment? How would that change your test strategy? When we find something in testing, cycle for fixing and waiting for another deployment is long Illustrate how test cycles can be shortened with a local test sandbox
- Reduce Dependency on Shared Test Environment: Take Control of the Test Sandbox (What if you don’t have to wait?) (What if a developer checks in a fix, announces it, and you can be testing that on your local workstation within the hour?) Not All Types of Testing Have to be Performed in a Shared Test Environment
- Impact on Story Acceptance Test Strategy How to Orchestrate Testing on a Local Test Sandbox
- Impact on User Interface Test Strategy How to Orchestrate Testing on a Local Test Sandbox
- Impact on System Integration Test Strategy How to Orchestrate Testing on a Local Test Sandbox
- FLEXIBILITY – exploratory testing with users having combinations of roles. Definition of Security Roles based access: Impact on Security Roles Based Access Test Strategy How to Orchestrate Testing on a Local Test Sandbox
- Impact on Security Penetration Test Strategy How to Orchestrate Testing on a Local Test Sandbox
- Impact on Exploratory and Usability Test Strategy How to Orchestrate Testing on a Local Test Sandbox
- Impact on Data Migration Test Strategy
- Impact on End-to-End Functional Integrated Test Strategy How to Orchestrate Testing on a Local Test Sandbox
- Failover/Recoverability: Database clustering, production hardware configuration, … cannot be duplicated locally. Example: Compliance/SOX requires testing in Support Group’s pre-production environment.
- Eric
- At this point, we will bring up the demo application. Participants may fire theirs up to and follow along if they wish, but it’s not necessary. They may wish to play around and explore some of the test support screens later.
- Show in demo application – manipulate the clock from the test support screen. Attend Event – Final Destination Sep 7 19:30. Set time now to Sep 7 at 19:31. Attend should give us an error, “Sorry, movie has already started.” Set time now to Sep 7 at 19:29. Attend should be successful!
- Show in demo application – edit the security roles we belong to in the text file. Verify that an attendee cannot organize events Open up the LocalTestSecurityGroups.txt Comment out all groups except for MovieEventAttendee Try to Organize an Event for any movie; should get error. Make us a MovieEventOrganizer Try to Organize an Event for District 9 Sep 7 19:40; should get success.
- Show in demo application – change the clock and trigger the job that will send out text messages. Look at who signed up for a particular event and examine the text files generated, each corresponding to an attendee. Verify SMS We need two events that are upcoming From previous test, we already have District 9 Sep 7 19:40 In addition, organize GI Joe Sep 7 22:30 Make sure someone is attending District 9 and GI Joe. Check the SmsMovieEventReminder.log file => clear rows out of it. Remind attendees => notice that reminders only sent to District 9. Check the SmsMovieEventReminder.log file => notice that attendees reminded about District 9. Verify retrieve show times: 1. Try to Organize event => notice there’s no recent movie… like Surrogate. 2. Look at the NewMovieShowings.csv file => it has a recent listing for Oct 9 19:40 3. Close the file; click on Retrieve New Showtimes 4. Try to Organize event => notice we now have the choice of organizing an event for the new movie!
- Typical architecture layout for an application.
- Open Explorer and show contents of USB memory key
- Stelios Best case 3days 15 days
- We’ll quickly go back to the wall with the sticky notes and make sure we have met them.