SlideShare a Scribd company logo
1 of 63
Download to read offline
ALM 4 Azure
TFS 2010 for Azure Cloud Development




                          26 mei 2011
                                       1
Clemens Reijnen
• Sogeti | Management Consultant




                              www.ClemensReijnen.nl
                                   @ClemensReijnen
                           Clemens.Reijnen@Sogeti.nl

                                               2
work together
__with work packages
__on alm artifacts
                       3
4
http://msdn.microsoft.com/en-us/library/bb385832.aspx
ALM 4 Azure




                         Cloud System
Goals:   Collaborative
         High Quality
         Flexible
         Automated
         Repeatable
         Efficient
                           5
Scenario 1: Dev only
Scenario 2: Dev and Test
Scenario 3: Dev, Test and Build, Deploy
Scenario 4: Dev, Auto Tests and Build, Deploy
Scenario 5: Dev, Auto Tests, Build, Deploy, Acc test
            and Operations




                                                   6
Scenario 1: Dev only
Scenario 2: Dev and Test
Scenario 3: Dev, Test and Build, Deploy
Scenario 4: Dev, Auto Tests and Build, Deploy
Scenario 5: Dev, Auto Tests, Build, Deploy, Acc test
            and Operations




                                                   7
Scenario 1:
Developer only


       1                                            Source                                     Production
                                                    Repository                       Staging
                      C#                                                    3
    TEAM              (implementatie + unittests)      (TFS)




   Developers implementeren het systeem
    Local unittesting

                                                               ‘SprintReview’Build
                                                                Compile
                                                                Run Unit Tests
                                                               2




                                                                                                    8
dry run – local storage and compute
test run – cloud storage and local compute



                                             10
debug – Intellitrace deploy



                              11
12
debug – Get Intellitrace file



                                13
debug – Find exception




                         14
debug




        15
debug – send to peer




                       16
Scenario 1:
Developer only



                                  Pro: Con:
       Easy installation and configuration No collaboration
    Single click deployment from VS2010 Easy deployment errors (configuration)
                                           What about test and ops




                                                                                 17
Scenario 1: Dev only
Scenario 2: Dev and Test
Scenario 3: Dev, Test and Build, Deploy
Scenario 4: Dev, Auto Tests and Build, Deploy
Scenario 5: Dev, Auto Tests, Build, Deploy, Acc test
            and Operations




                                                   18
Scenario 2:
Developer with
manual tester


                                                       Source                                         Production
                                                       Repository                           Staging
                         C#                                                    3
     TEAM                (implementatie + unittests)      (TFS)




  1 Developers implementeren het systeem
    Local unittesting

   Testers specificeren testcases                                 ‘SprintReview’Build   4
    “Dry” run van tests tegen Development Fabric                  Compile
                                                                   Run Unit Tests
                                                                  2




                                                                                                          19
Alm 4 Azure with screenshots
Microsoft Test
Manager




                 21
Source                                       Production
                              Repository                          Staging
     TEAM                        (TFS)           3




 1


                                                          4


                                         2




            1                    2                            4
 Functional, system,      Build Verification         Platform accepatance
manual tests executed   Tests (unit tests) and         tests executed on
in compute emulator      other quality gates,        Azure staging - tested
     with MTM.          executed in the build.             with MTM.
Microsoft Test Manager – Specify Test Cases




                                              23
Link Requirements to Tasks and Test Cases



                                            24
Specify test case




                    25
Test with or without debugging




                                 26
without Visual Studio




                        27
1
    Get the CSX folder and CSFG file



2


3


4
Challenges with changing URL’s
Shared Steps 2 the rescue




                            30
1 Shared Step : open application




                                   31
1 Shared Step : used by all test cases



                                         32
Fast Forward



               33
Diagnostic Data
Adapters
Capture information during test execution



                                            35
Create your own adapter.
For example: WAD




                   37
Or Intellitrace Files




                        38
Capabilities
•   Link test cases to requirements
•   Fast Forward
•   Test data Iterations
•   Test case management
•   Test configurations

Interesting capabilities 4 Azure
• Shared steps ( 4 VIPS Swap )
     – common practice:
       new hosted service only change the name in the DNS…
• Diagnostic adapters ( Rich bug reports ) capturing the logs

Not working capabilities in Azure
• Test Impact 4 manual tests
• IntelliTrace 4 manual tests (although possible custom adapter)

                                                                   39
Scenario 2:
Developer with
manual tester




                                        Pro: Con:
          Easy installation and configuration   Easy deployment errors (configuration)
       Single click deployment from VS2010      Time consuming (deploy and test)
  Testers connected, same heartbeat as dev      Not repeatable (annoyed testers)
                               Proven quality   Testers connected 




                                                                                         40
Scenario 1: Dev only
Scenario 2: Dev and Test
Scenario 3: Dev, Test and Build, Deploy
Scenario 4: Dev, Auto Tests and Build, Deploy
Scenario 5: Dev, Auto Tests, Build, Deploy, Acc test
            and Operations




                                                   41
Scenario 3:
Developer with manual tester
and deployment build

                                                                             3
                                                       Source                                                       Production
                                                       Repository                                      Staging
                         C#
     TEAM                (implementatie + unittests)      (TFS)




  1 Developers implementeren het systeem
    Local unittesting

   Testers specificeren testcases                                 ‘SprintReview’Build        4
    Dry run van tests tegen Development Fabric                    Compile
                                                                   Run Unit Tests
                                                                  2
                                                                   Package (CSRun.exe, CSPack,exe, CSManage.exe)
                                                                   Deploy 2 Staging (CMdLets, Powershell)




                                                                                                                        42
Automatic Deployment
                    Management API
                    CSPack
                    CSRun
                    CSManage
                    PowerShell CmdLets
                    Build Targets
http://scottdensmore.typepad.com/blog/2010/03/azure-deployment-for-your-build-server.html

http://blogs.msdn.com/b/tomholl/archive/2011/02/23/using-msbuild-to-deploy-to-multiple-windows-
azure-environments.aspx
                                                                                            43
Change .ccproj project




                         44
CSPack used in Target file




Use PowerShell script

                                                     45
Configure build definition
Deploy during build
   1. Change .ccproj project
     •   New build target which uses the built-in CorePublish target

   2. Create PowerShell script
     •   Called by build target and uses Azure CMDLets

   3. Edit Build Config
     •   Add the necessary parameters

   4. Do something with certificates
     •   Put the Azure certificate on the build server


                                                                       47
Scenario 3:
Developer with manual tester
and deployment build




                                                                Pro: Con:
             Easy installation and configuration                           Time consuming testing
                No click deployment from build                             Application can contain ‘annoying’ bugs
            Repeatable ‘proven’ deployments*                               Build workflow knowledge necessary
     Testers connected, same heartbeat as dev                              Powershell, ccproj tweaks, target files,
                                  Proven quality                           certificates

 *demo needs some additional environment tweaks for different csfg files
                                                     per environment


                                                                                                                      48
Scenario 1: Dev only
Scenario 2: Dev and Test
Scenario 3: Dev, Test and Build, Deploy
Scenario 4: Dev, Auto Tests and Build, Deploy
Scenario 5: Dev, Auto Tests, Build, Deploy, Acc test
            and Operations




                                                   49
Scenario 4:
Developer with automated regresion
tests, manual tests and deployment build

                                                                             3
                                                        Source                                                      Production
                                                       Repository                                      Staging
                         C#
     TEAM                (implementatie + unittests)      (TFS)
                         Test cases
                         (automated UI tests)

  1 Developers implementeren het systeem
    Local unittesting
                                                                                             4
   Testers specificeren testcases                                 ‘SprintReview’Build
    Dry run van tests tegen Development Fabric                    Compile
    Automation van testcases      5                               Run Unit Tests
      (moeten gedraaide testcases zijn voor CodedUI)              2
    UI automation tests run tegen Development Fabric              Package (CSRun.exe, CSPack,exe, CSManage.exe)
      en associëren met test plan                                  Deploy 2 Staging (CMdLets, Powershell)




                                                                                                                        50
CodedUI
52
Different URL’s

                  1



                      2


                          53
UIMap Editor




               54
Execute from MTM




Execute from VS

                        55
Execute from Build




Execute from Test Agent


                                      56
Automated Test Settings




                          57
Where to run the auto test?
   a) At the Build server? (no … only unit test)

   b) In the Development environment? (only
      dry run for autoamtion)

   c) In the Test environment? (sure, functional
      tests.. You need emulator at the test env)

   d) In the Azure environment? Some definitely
      not all (money)
                                               58
Scenario 4:
Developer with automated regresion
tests, manual tests and deployment build




                                                                Pro: Con:
               No click deployment from build                              Build workflow knowledge necessary
           Repeatable ‘proven’ deployments*                                Powershell, ccproj tweaks, target files,
    Testers connected, same heartbeat as dev                               Certificates
                               Proven quality                              Test Infrastructure knowledge necessary
    Automated BVT on different Environments                                A balanced thinking of test automation
                       Comfortable Acc Testing
                                   Done Done

 *demo needs some additional environment tweaks for different csfg files
                                                     per environment                                                  59
Scenario 1: Dev only
Scenario 2: Dev and Test
Scenario 3: Dev, Test and Build, Deploy
Scenario 4: Dev, Auto Tests and Build, Deploy
Scenario 5: Dev, Auto Tests, Build, Deploy, Acc test
            and Operations




                                                   60
Automated ALM for Azure Cloud development                                                                                                     App fa
                                                                                                                                              Applic
Efficient, repeatable with proven quality fast                                                                                                Manag
flexible delivering of useful functionality …                                                                                        4        (June)
                                                                        Acceptation
Making optimal use of the characteristics of Azure:
- Identical environments (Guest OS versioning).
- Separate in depended staging production environments.                   ‘Release ’Drop
- Easy up and downgrade of applications.                                   Package (same as test env
- Unambiguous deployment mechanism                                       3 package)
- rich diagnostic capabilities                                             Acc testing met MTM en
- Simplified Application Deployment & Management                             Diagnostic Data Collectors
- …




                                                               BUILD                                                            Production
                                                                (TFS)                                              Staging
                               C#
            TEAM               (implementation + unittests)
                               Test cases
                               (automated UI tests)

           Developers implement the system
            Local unit testing

           Testers specify test cases                                    ‘SprintReview’Build
            Dry run tests cases against Development Fabric               Compile
            Automation of test cases                                     Run Unit Tests
       1                                                                 
                                                                         2 Package (CSRun.exe, CSPack,exe, CSManage.exe)
            UI automation tests execute against Development              Deploy 2 Staging (CMdLets, Powershell)
             Fabric and associate with a test case                        Run automated Test Suites (MTC.exe) with different
                                                                            environments (test controller – agents infrastructure)
           Operations determine instrumentation data                      Collect and publish test results
            DFO, SLA                                                     “Build Verification Tests” green -> deployment 2 ‘test
            Usages Metrics, payment                                        'production                                                  61
Scenario 1: Dev only
Scenario 2: Dev and Test
Scenario 3: Dev, Test and Build, Deploy
Scenario 4: Dev, Auto Tests and Build, Deploy
Scenario 5: Dev, Auto Tests, Build, Deploy, Acc test
            and Operations
Scenario 6: TFS on Azure
Scenario 7: Other Infrastructure on Azure

                                                   62
63

More Related Content

What's hot

Alliance Successful Selenium Automation
Alliance Successful Selenium AutomationAlliance Successful Selenium Automation
Alliance Successful Selenium Automationsadams22
 
Att lyckas med integration av arbetet från flera scrum team - Christophe Acho...
Att lyckas med integration av arbetet från flera scrum team - Christophe Acho...Att lyckas med integration av arbetet från flera scrum team - Christophe Acho...
Att lyckas med integration av arbetet från flera scrum team - Christophe Acho...manssandstrom
 
Infinum Android Talks #17 - Testing your Android applications by Ivan Kust
Infinum Android Talks #17 - Testing your Android applications by Ivan KustInfinum Android Talks #17 - Testing your Android applications by Ivan Kust
Infinum Android Talks #17 - Testing your Android applications by Ivan KustInfinum
 
Lab 7b) test a web application
Lab 7b) test a web applicationLab 7b) test a web application
Lab 7b) test a web applicationtechbed
 
Постоянное тестирование интеграции
Постоянное тестирование интеграцииПостоянное тестирование интеграции
Постоянное тестирование интеграцииSQALab
 
Visual Studio 2010: A Perspective - David Chappell
Visual Studio 2010: A Perspective - David ChappellVisual Studio 2010: A Perspective - David Chappell
Visual Studio 2010: A Perspective - David ChappellSpiffy
 
Softsphere - Development for administrators
Softsphere - Development for administratorsSoftsphere - Development for administrators
Softsphere - Development for administratorsBill Buchan
 
01 - Introduction to Version Control
01 - Introduction to Version Control01 - Introduction to Version Control
01 - Introduction to Version ControlSergii Shmarkatiuk
 
Software Build processes and Git
Software Build processes and GitSoftware Build processes and Git
Software Build processes and GitAlec Clews
 
Android Meetup Slovenija #3 - Testing with Robolectric by Ivan Kust
Android Meetup Slovenija #3 - Testing with Robolectric by Ivan KustAndroid Meetup Slovenija #3 - Testing with Robolectric by Ivan Kust
Android Meetup Slovenija #3 - Testing with Robolectric by Ivan KustInfinum
 
UFT An advance version of QTP
UFT  An advance version of QTPUFT  An advance version of QTP
UFT An advance version of QTPRita Singh
 
Neil Tompson - SoftTest Ireland
Neil Tompson - SoftTest IrelandNeil Tompson - SoftTest Ireland
Neil Tompson - SoftTest IrelandDavid O'Dowd
 
Quality on Submit
Quality on SubmitQuality on Submit
Quality on SubmitAgileSparks
 

What's hot (19)

Alliance Successful Selenium Automation
Alliance Successful Selenium AutomationAlliance Successful Selenium Automation
Alliance Successful Selenium Automation
 
Att lyckas med integration av arbetet från flera scrum team - Christophe Acho...
Att lyckas med integration av arbetet från flera scrum team - Christophe Acho...Att lyckas med integration av arbetet från flera scrum team - Christophe Acho...
Att lyckas med integration av arbetet från flera scrum team - Christophe Acho...
 
Infinum Android Talks #17 - Testing your Android applications by Ivan Kust
Infinum Android Talks #17 - Testing your Android applications by Ivan KustInfinum Android Talks #17 - Testing your Android applications by Ivan Kust
Infinum Android Talks #17 - Testing your Android applications by Ivan Kust
 
Lab 7b) test a web application
Lab 7b) test a web applicationLab 7b) test a web application
Lab 7b) test a web application
 
AAA Automated Testing
AAA Automated TestingAAA Automated Testing
AAA Automated Testing
 
Deep Dive Modern Apps Lifecycle with Visual Studio 2012: Application Lifecycl...
Deep Dive Modern Apps Lifecycle with Visual Studio 2012: Application Lifecycl...Deep Dive Modern Apps Lifecycle with Visual Studio 2012: Application Lifecycl...
Deep Dive Modern Apps Lifecycle with Visual Studio 2012: Application Lifecycl...
 
Постоянное тестирование интеграции
Постоянное тестирование интеграцииПостоянное тестирование интеграции
Постоянное тестирование интеграции
 
Unit Testing
Unit TestingUnit Testing
Unit Testing
 
Visual Studio 2010: A Perspective - David Chappell
Visual Studio 2010: A Perspective - David ChappellVisual Studio 2010: A Perspective - David Chappell
Visual Studio 2010: A Perspective - David Chappell
 
2012 01-jenkins-udeploy
2012 01-jenkins-udeploy2012 01-jenkins-udeploy
2012 01-jenkins-udeploy
 
Softsphere - Development for administrators
Softsphere - Development for administratorsSoftsphere - Development for administrators
Softsphere - Development for administrators
 
Hudson: from build jobs to build pipelines
Hudson: from build jobs to build pipelinesHudson: from build jobs to build pipelines
Hudson: from build jobs to build pipelines
 
01 - Introduction to Version Control
01 - Introduction to Version Control01 - Introduction to Version Control
01 - Introduction to Version Control
 
Resume
ResumeResume
Resume
 
Software Build processes and Git
Software Build processes and GitSoftware Build processes and Git
Software Build processes and Git
 
Android Meetup Slovenija #3 - Testing with Robolectric by Ivan Kust
Android Meetup Slovenija #3 - Testing with Robolectric by Ivan KustAndroid Meetup Slovenija #3 - Testing with Robolectric by Ivan Kust
Android Meetup Slovenija #3 - Testing with Robolectric by Ivan Kust
 
UFT An advance version of QTP
UFT  An advance version of QTPUFT  An advance version of QTP
UFT An advance version of QTP
 
Neil Tompson - SoftTest Ireland
Neil Tompson - SoftTest IrelandNeil Tompson - SoftTest Ireland
Neil Tompson - SoftTest Ireland
 
Quality on Submit
Quality on SubmitQuality on Submit
Quality on Submit
 

Similar to Alm 4 Azure with screenshots

Visual Studio 2010 Testing Overview
Visual Studio 2010 Testing OverviewVisual Studio 2010 Testing Overview
Visual Studio 2010 Testing OverviewSteve Lange
 
Drupal & Continous Integration - SF State Study Case
Drupal & Continous Integration - SF State Study CaseDrupal & Continous Integration - SF State Study Case
Drupal & Continous Integration - SF State Study CaseEmanuele Quinto
 
Technical meeting automated testing with vs2010
Technical meeting automated testing with vs2010Technical meeting automated testing with vs2010
Technical meeting automated testing with vs2010Clemens Reijnen
 
Containerize your Blackbox tests
Containerize your Blackbox testsContainerize your Blackbox tests
Containerize your Blackbox testsKevin Beeman
 
Coded UI - Test automation Practices from the Field
Coded UI - Test automation Practices from the FieldCoded UI - Test automation Practices from the Field
Coded UI - Test automation Practices from the FieldClemens Reijnen
 
Software Testen mit Visual Studio Lab Management
Software Testen mit Visual Studio Lab ManagementSoftware Testen mit Visual Studio Lab Management
Software Testen mit Visual Studio Lab ManagementNico Orschel
 
Unit testing with visual studio 2012
Unit testing with visual studio 2012Unit testing with visual studio 2012
Unit testing with visual studio 2012Abhimanyu Singhal
 
Visual Studio 2010 ALM Tools Overview
Visual Studio 2010 ALM Tools Overview Visual Studio 2010 ALM Tools Overview
Visual Studio 2010 ALM Tools Overview Ayman El-Hattab
 
Leveraging Azure for Performance Testing
Leveraging Azure for Performance TestingLeveraging Azure for Performance Testing
Leveraging Azure for Performance TestingTarun Arora
 
Managing Test Labs Without the Headaches
Managing Test Labs Without the HeadachesManaging Test Labs Without the Headaches
Managing Test Labs Without the HeadachesImaginet
 
Automated testing DrupalCamp in Asheville
Automated testing DrupalCamp in AshevilleAutomated testing DrupalCamp in Asheville
Automated testing DrupalCamp in AshevillePromet Source
 
Hadoop testing workshop - july 2013
Hadoop testing workshop - july 2013Hadoop testing workshop - july 2013
Hadoop testing workshop - july 2013Ophir Cohen
 
Continuous Delivery Applied
Continuous Delivery AppliedContinuous Delivery Applied
Continuous Delivery AppliedExcella
 
Continuous Delivery Applied (Agile Richmond)
Continuous Delivery Applied (Agile Richmond)Continuous Delivery Applied (Agile Richmond)
Continuous Delivery Applied (Agile Richmond)Mike McGarr
 

Similar to Alm 4 Azure with screenshots (20)

Visual Studio 2010 Testing Overview
Visual Studio 2010 Testing OverviewVisual Studio 2010 Testing Overview
Visual Studio 2010 Testing Overview
 
Drupal & Continous Integration - SF State Study Case
Drupal & Continous Integration - SF State Study CaseDrupal & Continous Integration - SF State Study Case
Drupal & Continous Integration - SF State Study Case
 
Technical meeting automated testing with vs2010
Technical meeting automated testing with vs2010Technical meeting automated testing with vs2010
Technical meeting automated testing with vs2010
 
Deep Dive Modern Apps Lifecycle with Visual Studio 2012: Software Testing wit...
Deep Dive Modern Apps Lifecycle with Visual Studio 2012: Software Testing wit...Deep Dive Modern Apps Lifecycle with Visual Studio 2012: Software Testing wit...
Deep Dive Modern Apps Lifecycle with Visual Studio 2012: Software Testing wit...
 
Containerize your Blackbox tests
Containerize your Blackbox testsContainerize your Blackbox tests
Containerize your Blackbox tests
 
Coded UI - Test automation Practices from the Field
Coded UI - Test automation Practices from the FieldCoded UI - Test automation Practices from the Field
Coded UI - Test automation Practices from the Field
 
Coding Naked
Coding NakedCoding Naked
Coding Naked
 
Software Testen mit Visual Studio Lab Management
Software Testen mit Visual Studio Lab ManagementSoftware Testen mit Visual Studio Lab Management
Software Testen mit Visual Studio Lab Management
 
Unit testing with visual studio 2012
Unit testing with visual studio 2012Unit testing with visual studio 2012
Unit testing with visual studio 2012
 
Visual Studio 2010 ALM Tools Overview
Visual Studio 2010 ALM Tools Overview Visual Studio 2010 ALM Tools Overview
Visual Studio 2010 ALM Tools Overview
 
Leveraging Azure for Performance Testing
Leveraging Azure for Performance TestingLeveraging Azure for Performance Testing
Leveraging Azure for Performance Testing
 
05 test infrastructure
05   test infrastructure05   test infrastructure
05 test infrastructure
 
Managing Test Labs Without the Headaches
Managing Test Labs Without the HeadachesManaging Test Labs Without the Headaches
Managing Test Labs Without the Headaches
 
Automated testing DrupalCamp in Asheville
Automated testing DrupalCamp in AshevilleAutomated testing DrupalCamp in Asheville
Automated testing DrupalCamp in Asheville
 
Hadoop testing workshop - july 2013
Hadoop testing workshop - july 2013Hadoop testing workshop - july 2013
Hadoop testing workshop - july 2013
 
Selenium Camp 2012
Selenium Camp 2012Selenium Camp 2012
Selenium Camp 2012
 
Continuous Delivery Applied
Continuous Delivery AppliedContinuous Delivery Applied
Continuous Delivery Applied
 
Testing In Java
Testing In JavaTesting In Java
Testing In Java
 
Continuous Delivery Applied
Continuous Delivery AppliedContinuous Delivery Applied
Continuous Delivery Applied
 
Continuous Delivery Applied (Agile Richmond)
Continuous Delivery Applied (Agile Richmond)Continuous Delivery Applied (Agile Richmond)
Continuous Delivery Applied (Agile Richmond)
 

More from Clemens Reijnen

Azure for software development teams
Azure for software development teamsAzure for software development teams
Azure for software development teamsClemens Reijnen
 
06 operations and feedback
06   operations and feedback06   operations and feedback
06 operations and feedbackClemens Reijnen
 
04 test controlling and tracking
04   test controlling and tracking04   test controlling and tracking
04 test controlling and trackingClemens Reijnen
 
03 test specification and execution
03   test specification and execution03   test specification and execution
03 test specification and executionClemens Reijnen
 
Test Tooling in Visual Studio 2012 an overview
Test Tooling in Visual Studio 2012 an overviewTest Tooling in Visual Studio 2012 an overview
Test Tooling in Visual Studio 2012 an overviewClemens Reijnen
 
ALM - Getting Testing done in a Sprint
ALM - Getting Testing done in a SprintALM - Getting Testing done in a Sprint
ALM - Getting Testing done in a SprintClemens Reijnen
 
TFS11 on Azure the basics
TFS11 on Azure the basicsTFS11 on Azure the basics
TFS11 on Azure the basicsClemens Reijnen
 
MTLM Visual Studio 2010 ALM workshop - day1
MTLM Visual Studio 2010 ALM workshop  - day1MTLM Visual Studio 2010 ALM workshop  - day1
MTLM Visual Studio 2010 ALM workshop - day1Clemens Reijnen
 
MTLM Visual Studio 2010 ALM - day2
MTLM Visual Studio 2010 ALM - day2MTLM Visual Studio 2010 ALM - day2
MTLM Visual Studio 2010 ALM - day2Clemens Reijnen
 
MTLM Visual Studio 2010 ALM workshop
MTLM Visual Studio 2010 ALM workshopMTLM Visual Studio 2010 ALM workshop
MTLM Visual Studio 2010 ALM workshopClemens Reijnen
 
Talk Through Sogeti ALM 4 Azure
Talk Through Sogeti ALM 4 AzureTalk Through Sogeti ALM 4 Azure
Talk Through Sogeti ALM 4 AzureClemens Reijnen
 
TMap for VS2010 - SlideShare.
TMap for VS2010 - SlideShare.TMap for VS2010 - SlideShare.
TMap for VS2010 - SlideShare.Clemens Reijnen
 

More from Clemens Reijnen (18)

Azure for software development teams
Azure for software development teamsAzure for software development teams
Azure for software development teams
 
06 operations and feedback
06   operations and feedback06   operations and feedback
06 operations and feedback
 
04 test controlling and tracking
04   test controlling and tracking04   test controlling and tracking
04 test controlling and tracking
 
03 test specification and execution
03   test specification and execution03   test specification and execution
03 test specification and execution
 
02 test planning
02   test planning02   test planning
02 test planning
 
01 the value of quality
01   the value of quality01   the value of quality
01 the value of quality
 
A Collaborative culture
A Collaborative cultureA Collaborative culture
A Collaborative culture
 
Test Tooling in Visual Studio 2012 an overview
Test Tooling in Visual Studio 2012 an overviewTest Tooling in Visual Studio 2012 an overview
Test Tooling in Visual Studio 2012 an overview
 
ALM - Getting Testing done in a Sprint
ALM - Getting Testing done in a SprintALM - Getting Testing done in a Sprint
ALM - Getting Testing done in a Sprint
 
TFS11 on Azure advanced
TFS11 on Azure advancedTFS11 on Azure advanced
TFS11 on Azure advanced
 
TFS11 on Azure the basics
TFS11 on Azure the basicsTFS11 on Azure the basics
TFS11 on Azure the basics
 
MTLM Visual Studio 2010 ALM workshop - day1
MTLM Visual Studio 2010 ALM workshop  - day1MTLM Visual Studio 2010 ALM workshop  - day1
MTLM Visual Studio 2010 ALM workshop - day1
 
MTLM Visual Studio 2010 ALM - day2
MTLM Visual Studio 2010 ALM - day2MTLM Visual Studio 2010 ALM - day2
MTLM Visual Studio 2010 ALM - day2
 
MTLM Visual Studio 2010 ALM workshop
MTLM Visual Studio 2010 ALM workshopMTLM Visual Studio 2010 ALM workshop
MTLM Visual Studio 2010 ALM workshop
 
Scrum with VS2010
Scrum with VS2010  Scrum with VS2010
Scrum with VS2010
 
Talk Through Sogeti ALM 4 Azure
Talk Through Sogeti ALM 4 AzureTalk Through Sogeti ALM 4 Azure
Talk Through Sogeti ALM 4 Azure
 
TMap for VS2010 - SlideShare.
TMap for VS2010 - SlideShare.TMap for VS2010 - SlideShare.
TMap for VS2010 - SlideShare.
 
Work agile with VS2010
Work agile with VS2010Work agile with VS2010
Work agile with VS2010
 

Recently uploaded

Empowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintEmpowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintMahmoud Rabie
 
Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Commit University
 
Computer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsComputer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsSeth Reyes
 
Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1DianaGray10
 
UiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPathCommunity
 
OpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureOpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureEric D. Schabell
 
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesAI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesMd Hossain Ali
 
Videogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfVideogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfinfogdgmi
 
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...Aggregage
 
Comparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioComparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioChristian Posta
 
Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024D Cloud Solutions
 
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostMatt Ray
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URLRuncy Oommen
 
Introduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxIntroduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxMatsuo Lab
 
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve DecarbonizationUsing IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve DecarbonizationIES VE
 
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdfUiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdfDianaGray10
 
Linked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesLinked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesDavid Newbury
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsIgniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsSafe Software
 
AI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity WebinarAI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity WebinarPrecisely
 
Cybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxCybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxGDSC PJATK
 

Recently uploaded (20)

Empowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintEmpowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership Blueprint
 
Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)
 
Computer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsComputer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and Hazards
 
Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1
 
UiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation Developers
 
OpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureOpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability Adventure
 
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesAI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
 
Videogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfVideogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdf
 
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
 
Comparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioComparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and Istio
 
Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024
 
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URL
 
Introduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxIntroduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptx
 
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve DecarbonizationUsing IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
 
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdfUiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
 
Linked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesLinked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond Ontologies
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsIgniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
 
AI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity WebinarAI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity Webinar
 
Cybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxCybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptx
 

Alm 4 Azure with screenshots

  • 1. ALM 4 Azure TFS 2010 for Azure Cloud Development 26 mei 2011 1
  • 2. Clemens Reijnen • Sogeti | Management Consultant www.ClemensReijnen.nl @ClemensReijnen Clemens.Reijnen@Sogeti.nl 2
  • 3. work together __with work packages __on alm artifacts 3
  • 5. ALM 4 Azure Cloud System Goals: Collaborative High Quality Flexible Automated Repeatable Efficient 5
  • 6. Scenario 1: Dev only Scenario 2: Dev and Test Scenario 3: Dev, Test and Build, Deploy Scenario 4: Dev, Auto Tests and Build, Deploy Scenario 5: Dev, Auto Tests, Build, Deploy, Acc test and Operations 6
  • 7. Scenario 1: Dev only Scenario 2: Dev and Test Scenario 3: Dev, Test and Build, Deploy Scenario 4: Dev, Auto Tests and Build, Deploy Scenario 5: Dev, Auto Tests, Build, Deploy, Acc test and Operations 7
  • 8. Scenario 1: Developer only 1 Source Production Repository Staging C# 3 TEAM (implementatie + unittests) (TFS) Developers implementeren het systeem  Local unittesting ‘SprintReview’Build  Compile  Run Unit Tests 2 8
  • 9. dry run – local storage and compute
  • 10. test run – cloud storage and local compute 10
  • 12. 12
  • 13. debug – Get Intellitrace file 13
  • 14. debug – Find exception 14
  • 15. debug 15
  • 16. debug – send to peer 16
  • 17. Scenario 1: Developer only Pro: Con: Easy installation and configuration No collaboration Single click deployment from VS2010 Easy deployment errors (configuration) What about test and ops 17
  • 18. Scenario 1: Dev only Scenario 2: Dev and Test Scenario 3: Dev, Test and Build, Deploy Scenario 4: Dev, Auto Tests and Build, Deploy Scenario 5: Dev, Auto Tests, Build, Deploy, Acc test and Operations 18
  • 19. Scenario 2: Developer with manual tester Source Production Repository Staging C# 3 TEAM (implementatie + unittests) (TFS) 1 Developers implementeren het systeem  Local unittesting Testers specificeren testcases ‘SprintReview’Build 4  “Dry” run van tests tegen Development Fabric  Compile  Run Unit Tests 2 19
  • 22. Source Production Repository Staging TEAM (TFS) 3 1 4 2 1 2 4 Functional, system, Build Verification Platform accepatance manual tests executed Tests (unit tests) and tests executed on in compute emulator other quality gates, Azure staging - tested with MTM. executed in the build. with MTM.
  • 23. Microsoft Test Manager – Specify Test Cases 23
  • 24. Link Requirements to Tasks and Test Cases 24
  • 26. Test with or without debugging 26
  • 28. 1 Get the CSX folder and CSFG file 2 3 4
  • 30. Shared Steps 2 the rescue 30
  • 31. 1 Shared Step : open application 31
  • 32. 1 Shared Step : used by all test cases 32
  • 35. Capture information during test execution 35
  • 36. Create your own adapter.
  • 39. Capabilities • Link test cases to requirements • Fast Forward • Test data Iterations • Test case management • Test configurations Interesting capabilities 4 Azure • Shared steps ( 4 VIPS Swap ) – common practice: new hosted service only change the name in the DNS… • Diagnostic adapters ( Rich bug reports ) capturing the logs Not working capabilities in Azure • Test Impact 4 manual tests • IntelliTrace 4 manual tests (although possible custom adapter) 39
  • 40. Scenario 2: Developer with manual tester Pro: Con: Easy installation and configuration Easy deployment errors (configuration) Single click deployment from VS2010 Time consuming (deploy and test) Testers connected, same heartbeat as dev Not repeatable (annoyed testers) Proven quality Testers connected  40
  • 41. Scenario 1: Dev only Scenario 2: Dev and Test Scenario 3: Dev, Test and Build, Deploy Scenario 4: Dev, Auto Tests and Build, Deploy Scenario 5: Dev, Auto Tests, Build, Deploy, Acc test and Operations 41
  • 42. Scenario 3: Developer with manual tester and deployment build 3 Source Production Repository Staging C# TEAM (implementatie + unittests) (TFS) 1 Developers implementeren het systeem  Local unittesting Testers specificeren testcases ‘SprintReview’Build 4  Dry run van tests tegen Development Fabric  Compile  Run Unit Tests 2  Package (CSRun.exe, CSPack,exe, CSManage.exe)  Deploy 2 Staging (CMdLets, Powershell) 42
  • 43. Automatic Deployment Management API CSPack CSRun CSManage PowerShell CmdLets Build Targets http://scottdensmore.typepad.com/blog/2010/03/azure-deployment-for-your-build-server.html http://blogs.msdn.com/b/tomholl/archive/2011/02/23/using-msbuild-to-deploy-to-multiple-windows- azure-environments.aspx 43
  • 45. CSPack used in Target file Use PowerShell script 45
  • 47. Deploy during build 1. Change .ccproj project • New build target which uses the built-in CorePublish target 2. Create PowerShell script • Called by build target and uses Azure CMDLets 3. Edit Build Config • Add the necessary parameters 4. Do something with certificates • Put the Azure certificate on the build server 47
  • 48. Scenario 3: Developer with manual tester and deployment build Pro: Con: Easy installation and configuration Time consuming testing No click deployment from build Application can contain ‘annoying’ bugs Repeatable ‘proven’ deployments* Build workflow knowledge necessary Testers connected, same heartbeat as dev Powershell, ccproj tweaks, target files, Proven quality certificates *demo needs some additional environment tweaks for different csfg files per environment 48
  • 49. Scenario 1: Dev only Scenario 2: Dev and Test Scenario 3: Dev, Test and Build, Deploy Scenario 4: Dev, Auto Tests and Build, Deploy Scenario 5: Dev, Auto Tests, Build, Deploy, Acc test and Operations 49
  • 50. Scenario 4: Developer with automated regresion tests, manual tests and deployment build 3 Source Production Repository Staging C# TEAM (implementatie + unittests) (TFS) Test cases (automated UI tests) 1 Developers implementeren het systeem  Local unittesting 4 Testers specificeren testcases ‘SprintReview’Build  Dry run van tests tegen Development Fabric  Compile  Automation van testcases 5  Run Unit Tests (moeten gedraaide testcases zijn voor CodedUI) 2  UI automation tests run tegen Development Fabric  Package (CSRun.exe, CSPack,exe, CSManage.exe) en associëren met test plan  Deploy 2 Staging (CMdLets, Powershell) 50
  • 52. 52
  • 56. Execute from Build Execute from Test Agent 56
  • 58. Where to run the auto test? a) At the Build server? (no … only unit test) b) In the Development environment? (only dry run for autoamtion) c) In the Test environment? (sure, functional tests.. You need emulator at the test env) d) In the Azure environment? Some definitely not all (money) 58
  • 59. Scenario 4: Developer with automated regresion tests, manual tests and deployment build Pro: Con: No click deployment from build Build workflow knowledge necessary Repeatable ‘proven’ deployments* Powershell, ccproj tweaks, target files, Testers connected, same heartbeat as dev Certificates Proven quality Test Infrastructure knowledge necessary Automated BVT on different Environments A balanced thinking of test automation Comfortable Acc Testing Done Done *demo needs some additional environment tweaks for different csfg files per environment 59
  • 60. Scenario 1: Dev only Scenario 2: Dev and Test Scenario 3: Dev, Test and Build, Deploy Scenario 4: Dev, Auto Tests and Build, Deploy Scenario 5: Dev, Auto Tests, Build, Deploy, Acc test and Operations 60
  • 61. Automated ALM for Azure Cloud development App fa Applic Efficient, repeatable with proven quality fast Manag flexible delivering of useful functionality … 4 (June) Acceptation Making optimal use of the characteristics of Azure: - Identical environments (Guest OS versioning). - Separate in depended staging production environments. ‘Release ’Drop - Easy up and downgrade of applications.  Package (same as test env - Unambiguous deployment mechanism 3 package) - rich diagnostic capabilities  Acc testing met MTM en - Simplified Application Deployment & Management Diagnostic Data Collectors - … BUILD Production (TFS) Staging C# TEAM (implementation + unittests) Test cases (automated UI tests) Developers implement the system  Local unit testing Testers specify test cases ‘SprintReview’Build  Dry run tests cases against Development Fabric  Compile  Automation of test cases  Run Unit Tests 1  2 Package (CSRun.exe, CSPack,exe, CSManage.exe)  UI automation tests execute against Development  Deploy 2 Staging (CMdLets, Powershell) Fabric and associate with a test case  Run automated Test Suites (MTC.exe) with different environments (test controller – agents infrastructure) Operations determine instrumentation data  Collect and publish test results  DFO, SLA  “Build Verification Tests” green -> deployment 2 ‘test  Usages Metrics, payment 'production 61
  • 62. Scenario 1: Dev only Scenario 2: Dev and Test Scenario 3: Dev, Test and Build, Deploy Scenario 4: Dev, Auto Tests and Build, Deploy Scenario 5: Dev, Auto Tests, Build, Deploy, Acc test and Operations Scenario 6: TFS on Azure Scenario 7: Other Infrastructure on Azure 62
  • 63. 63