Presentation Euroforum Ibc Copenhagen 6 Nov 2003 Ver Handouts [2,2]
Upcoming SlideShare
Loading in...5
×
 

Presentation Euroforum Ibc Copenhagen 6 Nov 2003 Ver Handouts [2,2]

on

  • 230 views

Practical introduction to testing methodology

Practical introduction to testing methodology
for new projects

Statistics

Views

Total Views
230
Views on SlideShare
224
Embed Views
6

Actions

Likes
0
Downloads
2
Comments
0

1 Embed 6

http://www.linkedin.com 6

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    Presentation Euroforum Ibc Copenhagen 6 Nov 2003 Ver Handouts [2,2] Presentation Euroforum Ibc Copenhagen 6 Nov 2003 Ver Handouts [2,2] Document Transcript

    • Volvo Information Technology Invänta publiken II Volvo Information Technology Presentation 06.11.2003 Copenhagen Volvo Information Technology Invänta publiken IIVOLVO INFORMATION TECHNOLOGY AB, SE-405 08 GÖTEBORG PHONE: +46 31 66 70 00 VOLVOIT@VOLVO.COM WWW.IT.VOLVO.COM Volvo Information Technology Presentation 06.11.2003 Copenhagen 1
    • Test Sida (Försättsblad presentation) Volvo Information Technology VOLVO INFORMATION TECHNOLOGY Development and Implementation of quality assured test methodologies at Volvo IT Copenhagen Conference Euroforum ibc Kvalitetssisikring og test af softwaresystemer Wednesday the 6:th of Nov 2003 Volvo Information Technology Presentation 06.11.2003 Copenhagen Start ----------------------- (Personlig Presentation) Volvo Information Technology VOLVO INFORMATION TECHNOLOGY Jacek Jack Janiczko Method Specialist Test & Configuration Management Business Consultant & Business Analyst, Coach and mentor within change management Volvo Information Technology Presentation 06.11.2003 Copenhagen 2
    • Ämnes titel Volvo Information Technology VOLVO INFORMATION TECHNOLOGY Practical introduction to testing methodology for new projects - Practical experiences from progressive projects within Volvo IT. - Importance of requirement work and its relation closeness to the test process. - Clear communication is essential in a successful test process - Volvo IT developed adaptations and development recommendations for improved quality assurance for organizations that work with the *RUP * Rational Unified Process Volvo Information Technology Presentation 06.11.2003 CopenhagenVolvo IT Volvo Information Technology Volvo Information Technology GLOBAL ORGANISATION EUROPA NORD AMERIKA SYD AMERIKA 9 Counties BELGIEN ASIEN BRASILIEN FRANKRIKE STOR BIRITANIEN 4330 Employees MALAYSIA POLEN Incl. contractors SVERIGE SPANIEN Established 1966 USA Formed 1998 Turnover 5,7 Billion sKR / 620 Euro 70 000 Users in 300 sites Volvo Information Technology Presentation 06.11.2003 Copenhagen 3
    • Volvo IT (världs karta, var vi finns) Volvo Information Technology GLOBAL ORGANISATION Great Britain Sweden _________ 2790 Employees Poland Belgium France Spain USA Asia South America Volvo Information Technology Presentation 06.11.2003 CopenhagenVolvo IT Europa Volvo Information Technology VOLVO IT Europe and Sweden Umeå GÖTEBORG Köping Eskilstuna TROLLHÄTTAN Trollhättan Skövde Göteborg OLOFSTRÖM Daventry Olofström SKÖVDE Dunstable ESKILSTUNA Wroclaw Gent KÖPING UMEÅ Blainville (Caen) Bourg-en-Bresse Limoges Vénissieux – St-Priest (Lyon) Villa verde (Madrid) 3680 Employees Volvo Information Technology Presentation 06.11.2003 Copenhagen 4
    • Våra kunder Volvo Information Technology Volvo Information Technology VOLVO INFORMATION TECHNOLOGY External Customers Main Customers NOBEL BIOCARE ABB CONGSBERG AstraZenica ORD MOTOR SchlumbergerSEMA AB VOLVO ASSA ABLOY Euromation VOLVO CARS (FORD) The VOLVO Group GAMBRO LINDEX RENAULT V.I. MACK TRUCKS VOLVO Trucks 36% VOLVO CARS 38% VOLVO Busses 3% VOLVO AERO 3% VOLVO PENTA 3% VOLVO construction equipment 7% Other Volvo companies Sweden 9% International 3% Volvo Information Technology Presentation 06.11.2003 CopenhagenKap A : Ämne: ---” Avd. för metod och tekniker/kompbentes” Volvo Information Technology Volvo Information Technology MY Home Department Consulting Services and ADT (Application Development Techniques) 120 staff members Purpose: To promote skills and methodology within the Volvo IT organization by educating skillful professionals that can participate and incorporate new techniques and methods into new system development projects and the efficient running of system administration operations. Volvo Information Technology Presentation 06.11.2003 Copenhagen 5
    • Vår grupp Vad vi gör ! Volvo Information Technology Volvo Information Technology CM , TEST & Project management Consulting Services and ADT (Application Development Techniques) RESOURCE CENTER - Operational staff skilled in - Project Management, Test, CM, QA and Change management INFORMATION POOL - First point of Contact ACTIVE SUPPORT ORGANIZATION - Operational support , Start Up, Coaching, Mentoring reviews and assessments TOOL SUPPORT - Information and education METHOD SUPPORT - Know how in RUP,PCM and MCM Volvo Information Technology Presentation 06.11.2003 CopenhagenKapp I:------------ ”Införandet av ett gemensamt arbetssätt” Volvo Information Technology The test organizations dilemma Quality TEST Cost Volvo Information Technology Presentation 06.11.2003 Copenhagen 6
    • Test organisationens vardag Volvo Information Technology The test organization. A common ordinary day scenario TEST ”Keep cost at minimum…” ”We expect high quality and a low costs...” ”You will be finished anyway..” ”Test is something we can take care of later...” Volvo Information Technology Presentation 06.11.2003 CopenhagenIntressenter och testarbete Volvo Information Technology Directly involved stakeholders in Test & Verification activities DBA Project Management Implementation Functional management Configuration Management Line Management TEST Requirements management Computer Centre Accountants Principal Steering Committee Volvo Information Technology Presentation 06.11.2003 Copenhagen 7
    • Höga krav och förväntningar Volvo Information Technology TESTER Demands from Demands from business developers and other owners project members High demands and expectations How do we go about ? How do we solve and manage this situation ? Volvo Information Technology Presentation 06.11.2003 Copenhagen4 grund krav på test dokumentation ”The Mission”” Volvo Information Technology A Basic Requirement is a clear and concise documentation The mission of documentation Customer orderly, methodical - documentation I can Prove I can Trace I can Update I can Redo I can Prove that I can find the right info. I can change and update all documents I can redo this thru the whole project and lifecycle Volvo Information Technology Presentation 06.11.2003 Copenhagen 8
    • 4 grund krav på test dokumentation ”The Mission”” Volvo Information Technology The Basic Requirements on documentation Clear & Concise Traceable The mission Easy to change of documentation is: Aha! Yes! Customer I can Prove I can Trace I can Change I can Redo Volvo Information Technology Presentation 06.11.2003 CopenhagenVital information + mervärde Volvo Information Technology Added Value The mission of documentation is: orderly, methodical The Customer I can Prove I can Trace I can Change I can Redo Costs and Time performance expenses and follow-up Volvo Information Technology Presentation 06.11.2003 Copenhagen 9
    • Kvitto ( underlag för förbättring ) Volvo Information Technology Basic foundation for project follow-up and control History C (Receipt) Who ? When ? ID: TIME Delivery Status 007-C/P-TC-S-DR/FR = TC-SV What is ready ? Test & Change Status What is undergoing tests? Verification What is under development ? Nr 1 Cost = spent time on labor X (Use Case Realisation Doc.) A (Test Case) B (Test Case Resultat/s C (Receipt) ID: ID: ID: ID: 007-C/P-TC-S-DR/FR TC-SV 007-C/P-S 007-C/P-S--TC 007-C/P-TC-S---DR/FR Test & Change Status Defect report/Fault report Verification Component/Package Test Case Nr 1 Nr 1 specification Nr 1 Volvo Information Technology Presentation 06.11.2003 CopenhagenKvitto ( nyttoeffekter ) Volvo Information Technology Foundation for re-planning and priority states The Receipt and Foundation for time & cost estimation its benefits Foundation for future improvements C (Receipt) TID ID: PROJECT STATUS 007-C/P-TC-S-DR/FR Receipt on cost / delivered component TC-SV Test & Change Status Receipt on our efficiency Verification Cost data Nr 1 Priority foundations TEST LEDER Used resources Customers receipt confirming the performed test efforts X (Use Case Realisation Doc.) A (Test Case) B (Test Case Resultat/s C (Receipt) ID: ID: ID: ID: 007-C/P-TC-S-DR/FR TC-SV 007-C/P-S 007-C/P-S--TC 007-C/P-TC-S---DR/FR Test & Change Status Defect report/Fault report Verification Component/Package Test Case Nr 1 Nr 1 specification Nr 1 Volvo Information Technology Presentation 06.11.2003 Copenhagen 10
    • Kap II: ------------ ”Att jobba enligt samma modell” (Bakgrund Volvo Information Technology Volvo IT ! Traditional IT organization Operation and administration of large systems Software development model developed during the 80:th The AU-model (Administration Development Model) Good test organization nevertheless in same point person dependent. A common way of working was missing. Volvo Information Technology Presentation 06.11.2003 CopenhagenRecept för framtidens succé Volvo Information Technology Prescription for future success ! Good /excellent Most likely to succeed Project Management Most likely to fail Poor/Bad Good /excellent Iterative Process CHAOS Report by The Standish Group, a study of 23.000+ IT projects since 1994 Volvo Information Technology Presentation 06.11.2003 Copenhagen 11
    • Bakgrund - Varför valde vi en ny process-metod ? Volvo Information Technology Why did we choose a new method ? • Need for an integrated system development environment • Out of date and development model (AU-model) at Volvo developed in the middle of the (1980) eighties • Out of time • Usage not coherent at Volvo IT • CHAOS Report from The Standish Group: • “Only 28% of all software projects have been successful due to time, cost and functionality. • “45% of all delivered functions ware never used Volvo Information Technology Presentation 06.11.2003 Copenhagen§ Volvo Information Technology Expected positive effects within TEST • Homogeneous view at the test discipline • Homogeneous view on quality goals - Higher quality in production systems • Independent position in projects - Access to a central lab - The best people (spearhead competence) members at one ”Skill Center” • Less complex test environment • Less amount of different test tools - Genuine knowledge • Homogeneous knowledge on complex test tools - All tools with the exception of tools used for Unit testing are handled outside the projects Volvo Information Technology Presentation 06.11.2003 Copenhagen 12
    • Förväntade positiva effekter på Volvo IT Volvo Information Technology Expected and positive effects for Volvo IT Good / • increased number of successful projects excellent • Shorter development time • Higher delivery precision • Better product adaptation to real needs Projekt • Reduced labor costs Management • Better product maintenance - Project Control Model Most likely (PCM) to fail Poor/Bad Good / Iterative Process excellent - Rational Unified Process (RUP) Volvo Information Technology Presentation 06.11.2003 CopenhagenKap III: Ämne :-------- ”Erfarenheter med att jobba med RUP med avseende på TEST” + RUP-processen och svagheter inom Test Volvo Information Technology Our experiences when working with RUP with reference on the TEST discipline Positive and negative experiences RUP / TEST + - Volvo Information Technology Presentation 06.11.2003 Copenhagen 13
    • Info 2000 - 2002 Volvo Information Technology RUP 2003 [Test] Historical experience RUP 2002 [Test] RUP 2000 [TEST] RUP 2001 [Test] Volvo Information Technology Presentation 06.11.2003 CopenhagenAnpassningar av RUP Volvo Information Technology Templates Methods RUP - VOLVO IT Guidelines Tools + Practical experiences + Our adaptations Volvo Information Technology Presentation 06.11.2003 Copenhagen 14
    • Test Plan improvement/adaptation for RUP 2001 (Decision maker) Volvo Information Technology Clear decisions Example: Test Templates Clear risk taking Testing Types Data and Database Integrity Testing Test Objective: Technique: Completion Criteria: All database access methods and processes function as designed an without any data corruption. Special Considerations: Test type decision template Status Description Annotations Decision status Status Test environment Consequences of a “No Go” decision on test type Justification Decision maker [Name, date and project status/role] (Responsible for risk) Volvo Information Technology Presentation 06.11.2003 CopenhagenVåra ambitioner ---------(Målsättning Vår framtid !) Volvo Information Technology Our ambitions Where do we want to go ? Volvo Information Technology Presentation 06.11.2003 Copenhagen 15
    • Vad vill vi uppnå Volvo Information Technology What do we want to achieve ? ”Ambitions” A controlled system development process Why ? We know what we are doing ! We know were are ! We know why we are doing specific tasks ! What know what will come next ! We can trace and follow -up ! Therefore we have better prerequisites to succeed ! Clear documentation requirements is a way of achieving better results ! Volvo Information Technology Presentation 06.11.2003 CopenhagenFem steg till bättre utveckling Volvo Information Technology SPICE / CMM 5. Optimizing level 4. Managed level 3. Defined level 2. Repeatable level Initial level 1. Volvo Information Technology Presentation 06.11.2003 Copenhagen 16
    • Fem steg till bättre utveckling (Definitioner) Volvo Information Technology The Optimizing level: has an incorporated continuous process improvement based on quantified measurements that are continuously brought back to the development process from 5. pilot projects and new techniques. The Managed level: here the organization performs detailed measurements on the development processes and productivity. All programs and products 4. are defined in quantified terms. VOLVO IT The defined level: have the development process documented and all projects 3. that are handled by the main organization follows the established model. The repeated level: has basic project handling routines 2. in place for the control of cost, time plans and functionality. The initial level: is characterized by chaos. Success here i based 1. on individual achievement and hero culture. Volvo Information Technology Presentation 06.11.2003 CopenhagenVad vill vi uppnå Volvo Information Technology Team Work I test and verify ! I design ! Volvo Information Technology Presentation 06.11.2003 Copenhagen 17
    • Samma utgångspunkt Strategi Volvo Information Technology Documentation levels within a project organization (Large projects) Strategy Customer Project leader Verifies Carries out Architect Decides Realizes Test leader Tactics Designs Verifies Developer Operative functions Tester Designer Test Designer Volvo Information Technology Presentation 06.11.2003 CopenhagenViktig ”Överlämnande” Volvo Information Technology Is it easy for my counterparts to understand my documentation ? Important ! A formalized delivery of project Information. Volvo Information Technology Presentation 06.11.2003 Copenhagen 18
    • Volvo Information TechnologyAvslutning -------------(Tack)----- -------------(Tack)----- -------------- VOLVO INFORMATION TECHNOLOGY End of Part 1 Thank You Volvo Information Technology Presentation 06.11.2003 Copenhagen Volvo Information Technology Avslutning (Frågor II Extra del:) VOLVO INFORMATION TECHNOLOGY End of part I Questions ? Volvo Information Technology Presentation 06.11.2003 Copenhagen 19
    • Volvo Information Technology Avslutning------------- (SLUT)---- Avslutning------------- (SLUT)---- --------------- VOLVO INFORMATION TECHNOLOGY Part 2 How we introduce quality based testing to new projects Volvo Information Technology Presentation 06.11.2003 Copenhagen4 grund dokument Volvo Information Technology Basic Project Documentation X (Use Case Realisation Doc.) A (Test Case) B (Test Case Resultat/s) C (Receipt) ID: ID: ID: ID: 007-C/P-S 007-C/P-S--TC 007-C/P-TC-S-DR/FR 007-C/P-TC-S---DR/FR TC-SV Component/Package Defect report/Fault report Test Case Test & Change Status specification Verification Nr 1 Nr 1 Nr 1 Customer perspective I can Prove I can Trace I can Update I can Redo Volvo Information Technology Presentation 06.11.2003 Copenhagen 20
    • Specificera på komponent nivå Volvo Information Technology Planad time X (Use Case Realisation Doc.) ID: Specify on component level 007-C/P-S Clearly defied relations between physical components Component/Package specification & design documents All nödvändig information om en specifik komponent finns samlad i ett och endast ett dokument All necessary information on a specific component is collected into one document that can be used and understood by any designer that will be able to build the actual component X (Use Case Realisation Doc.) A (Test Case) B (Test Case Resultat/s C (Receipt) ID: ID: ID: ID: 007-C/P-TC-S-DR/FR TC-SV 007-C/P-S 007-C/P-S--TC 007-C/P-TC-S---DR/FR Test & Change Status Defect report/Fault report Verification Component/Package Test Case Nr 1 Nr 1 specification Nr 1 Volvo Information Technology Presentation 06.11.2003 CopenhagenFelrapport, underlag för verifiering Volvo Information Technology B (Test Case Resultat/s) Work order to designer ID: Controlled follow-up and history 007-C/P-TC-S---DR/FR Defect report/Fault report Test certificate / evidence = Quality guarantee Nr 1 Analysis document Verification of work results X (Use Case Realisation Doc.) A (Test Case) B (Test Case Resultat/s C (Receipt) ID: ID: ID: ID: 007-C/P-TC-S-DR/FR TC-SV 007-C/P-S 007-C/P-S--TC 007-C/P-TC-S---DR/FR Test & Change Status Defect report/Fault report Verification Component/Package Test Case Nr 1 Nr 1 specification Nr 1 Volvo Information Technology Presentation 06.11.2003 Copenhagen 21
    • Spårbarhet direkt till implementerad komponent Volvo Information Technology A (Test Case) Direct traceability to an implemented or executable component ID: 007-C/P-S--TC Test Case X (Use Case Realisation Doc.) Nr 1 .exe ID: 007-C/P-S Component/Package specification Direct traceability to a corresponding test case X (Use Case Realisation Doc.) A (Test Case) B (Test Case Resultat/s C (Receipt) ID: ID: ID: ID: 007-C/P-TC-S-DR/FR TC-SV 007-C/P-S 007-C/P-S--TC 007-C/P-TC-S---DR/FR Test & Change Status Defect report/Fault report Verification Component/Package Test Case Nr 1 Nr 1 specification Nr 1 Volvo Information Technology Presentation 06.11.2003 CopenhagenTydlig koppling mot funktionalitet Volvo Information Technology Clearly defined relations towards functional requirements X (Use Case Realisation Doc.) ID: 007-C/P-S FUNCTION 1 [ name ] = Service = Business value FUNCTION n+ [ name ] Component/Package specification Planed moment of delivery GUI Scenario User Case Functions X (Use Case Realisation Doc.) A (Test Case) B (Test Case Resultat/s C (Receipt) DB-tables Validation rules ID: ID: ID: ID: 007-C/P-TC-S-DR/FR TC-SV 007-C/P-S 007-C/P-S--TC 007-C/P-TC-S---DR/FR Test & Change Status Defect report/Fault report Verification Component/Package Test Case Nr 1 Nr 1 specification Nr 1 Volvo Information Technology Presentation 06.11.2003 Copenhagen 22
    • Kvitto ( Utformning ) Volvo Information Technology Test & Change Test Case number(ID)………Example: Simple Receipt Status verification Test Type: Functional Who ? Test Run 1 Test Start.……………..Test Ready…………… Name Sign....... TEST LEADER Change Start……………Change Ready…….. Name Sign....... C (Receipt) Test Run 2 Test Start.……………..Test Ready…………… Name Sign....... Change Start……… …Change Ready…….. Name Sign....... ID: Test Run (approved by CCB) Test Start.……………..Test Ready…………… Name Sign....... 007-C/P-TC-S-DR/FR TC-SV Change Start……………Change Ready…….. Name Sign....... Test & Change Status ___________________________________________________ Verification Test Case Comments (Notes) Nr 1 ____________________________________________________ TEST performer Deploy! Component ready. Developer ________________________________ Tester Project leader (Test Leader) Date..... Sign....... Sign...... X (Use Case Realisation Doc.) A (Test Case) B (Test Case Resultat/s C (Receipt) ID: ID: ID: ID: 007-C/P-TC-S-DR/FR TC-SV 007-C/P-S 007-C/P-S--TC 007-C/P-TC-S---DR/FR Test & Change Status Defect report/Fault report Verification Component/Package Test Case Nr 1 Nr 1 specification Nr 1 Volvo Information Technology Presentation 06.11.2003 CopenhagenKvitto Ex: original Volvo Information Technology Example: Simple Receipt Test Start.……………..Test Ready…………… Name Sign....... Change Start……………Change Ready…….. Name Sign....... ___________________________________________________ Test Case Comments (Notes) ____________________________________________________ Deploy! Component ready. ________________________________ Tester Project leader (Test Leader) Date..... Sign....... Sign...... Test & Change Status Verification document Volvo Information Technology Presentation 06.11.2003 Copenhagen 23
    • Test på specificerad leverans Volvo Information Technology A (Test Case) Tests are performed on executable components ID: 007-C/P-S--TC Test Case Nr 1 .exe On preplanned time - baseline X (Use Case Realisation Doc.) A (Test Case) B (Test Case Resultat/s C (Receipt) ID: ID: ID: ID: 007-C/P-TC-S-DR/FR TC-SV 007-C/P-S 007-C/P-S--TC 007-C/P-TC-S---DR/FR Test & Change Status Defect report/Fault report Verification Component/Package Test Case Nr 1 Nr 1 specification Nr 1 Volvo Information Technology Presentation 06.11.2003 CopenhagenÄndringar görs alltid med full Spårbarhet Volvo Information Technology C (Receipt) Changes are always B (Test Case Resultat/s ID: done with full traceability 007-C/P-TC-S-DR/FR ID: TC-SV Test & Change Status Verification 007-C/P-TC-S---DR/FR Nr 1 Defect report/Fault report Nr 1 CR (Change Request) A (Test Case) X (Use Case Realisation Doc.) ID: ID: ID: 007-C/P-S 007-C/P-S--CRQ 007-C/P-S--TC Component/Package Change Request Test Case specification Nr 1 Nr 1 .exe Volvo Information Technology Presentation 06.11.2003 Copenhagen 24
    • Ändringar görs alltid med full Spårbarhet Volvo Information Technology Changes should be distinct and methodically traceable RUP-exempel Volvo Information Technology Presentation 06.11.2003 Copenhagen Ändringar ska vara tydliga och metodiskt spårbara Volvo Information Technology Changes should always be distinct and methodically traceable .exe CR (Change Request) A (Test Case) X (Use Case Realisation Doc.) ID: ID: ID: 007-C/P-S 007-C/P-S--CRQ 007-C/P-S--TC Component/Package Change Request Test Case specification Nr 1 Nr 1 Volvo Information Technology Presentation 06.11.2003 Copenhagen 25
    • Volvo Information TechnologyAvslutning -------------(Tack II )-- -------------(Tack )-- ----------------- Thank You Volvo Information Technology Presentation 06.11.2003 Copenhagen Volvo Information Technology Avslutning (Frågor II Extra del:) VOLVO INFORMATION TECHNOLOGY Questions ? Volvo Information Technology Presentation 06.11.2003 Copenhagen 26
    • Kontakt Sida (Visit kort) Volvo Information Technology VOLVO INFORMATION TECHNOLOGY Jacek Janiczko Method Specialist Test & Configuration Management Business Consultant & Business Analyst, Coach and mentor within change management Mail: jacek.janiczko@volvo.com Phone: + 46 31 – 322 13 25 Volvo Information Technology Presentation 06.11.2003 CopenhagenKontakt Sida (Volvo IT) Volvo Information Technology VOLVO INFORMATION TECHNOLOGY Volvo Information Technology AB SE-405 08 Göteborg Sweden Phone +46 31 66 70 00 www.it.volvo.com Volvo Information Technology Presentation 06.11.2003 Copenhagen 27
    • Volvo Information TechnologyVolvo Information TechnologyPresentation 06.11.2003 Copenhagen 28