• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
Lessons learned in agile testing
 

Lessons learned in agile testing

on

  • 1,116 views

 

Statistics

Views

Total Views
1,116
Views on SlideShare
1,097
Embed Views
19

Actions

Likes
0
Downloads
22
Comments
0

3 Embeds 19

http://www.linkedin.com 17
http://www.slideshare.net 1
http://www.lmodules.com 1

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

CC Attribution License

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    Lessons learned in agile testing   Lessons learned in agile testing Document Transcript

    • ‹ 'DQLHO +RKOIHOG  )RWROLDFRP /HVVRQV /HDUQHG LQ $JLOH 7HVWLQJ by Rajneesh Namta 5HFHQWO P FROOHDJXH DQG , SUHVHQWHG DW $JLOH 1&5 *XUJDRQ SURIHVVLRQDOV DV ZHOO +HUH DUH VRPH OHVVRQV WKDW ZH KDYH OHDU ,QGLD
    •  ,Q WKLV SUHVHQWDWLRQ ZH WDONHG DERXW RXU H[SHULHQFHV RI QHG ZKLOH WUDQVLWLRQLQJ IURP D WUDGLWLRQDO WR DQ DJLOH ZD RI ZRU ZRUNLQJ DV 4$ RU WHVWHUV RQ $JLOH SURMHFWV RIIVKRUH
    • LQ ,QGLD RYHU NLQJ D FRQVLGHUDEOH SHULRG RI WLPH :KLOH RQ WKHVH SURMHFWV ZH FRQ WLQXH WR OHDUQ DQG GDLO JDLQ VRPH QHZ LQVLJKWV DERXW RXU ZRUN 2QH 7HDP  2QH *RDO PHWKRGRORJ DQG WKH SHRSOH ZH ZRUN ZLWK 7KH FRQFHSW RI ´2QH 7HDPµ LV D YHU SRZHUIXO RQH ,W HQWDLOV D FRPSOHWH FKDQJH RI PLQGVHW ZKLFK LV YHU UHIUHVKLQJ DV ZHOO DV , KDG D IHHOLQJ WKDW WKH VOLGHV LQ RXU SUHVHQWDWLRQ PD QRW KDYH UHZDUGLQJ 7KH WHDP VLWWLQJ LQ RQH SODFH DW RQH WDEOH LV RQH VXFK EHHQ VXIÀFLHQW WR JHW DFURVV WKH PHVVDJH ZH ZHUH WULQJ WR FRQ H[DPSOH ZKHUH WKH FRQFHSW LV DFWXDOO UHDOL]HG DV SKVLFDO EDU YH DQG KHQFH WKLV DUWLFOH 7KH LQWHQW RI WKLV DUWLFOH LV WR UHDFK ULHUV DUH UHPRYHG &RQYHQWLRQDOO WHVW WHDPV RU WKH LQGHSHQGHQW D ZLGHU DXGLHQFH DQG VKDUH WKHVH OHVVRQV ZLWK WKH FRPPXQLW YHULÀFDWLRQ DQG YDOLGDWLRQ XQLWV VRPH IDQF QDPHV LQ RUJDQL ]DWLRQV IRU WKH WHVW WHDP
    • DUH VHSDUDWHG IURP WKH GHYHORSPHQW $V ZH XQFRYHU EHWWHU ZDV RI GHYHORSLQJ VRIWZDUH VR DUH ZH ÀQ WHDPV DQG XVXDOO VLW LQ VHSDUDWH FXELFOHV RQ D GLIIHUHQW ÁRRU GLQJ EHWWHU ZDV WR WHVW LW 2QH RI WKH EHVW WKLQJV DERXW $JLOH LV RU LQ GLIIHUHQW EXLOGLQJV 7KLV OHDGV WR REYLRXV FRPPXQLFDWLRQ WKDW HYHURQH RQ WKH WHDP GHYHORSHUV WHVWHUV DUFKLWHFWV DQD EDUULHUV EXW PRUH LPSRUWDQWO LW EUHHGV D PHQWDOLW RI XV YHUVXV OVWV HW DO
    • VWDUWV ULJKW IURP SURMHFW LQLWLDWLRQ DQG LI WKLV LV QRW WKH WKHP LQ WKH WHDP )DXOW ÀQGLQJ DQG EODPH JDPH HQVXH DV SHRS FDVH ZKLFK PD EH SRVVLEOH ZLWK VRPH RUJDQL]DWLRQV
    •  LW LV VWLOO OH ORRN GRZQ XSRQ HDFK RWKHU DQG HQG XS IDFLQJ HDFK RWKHU DQG WKH SUHIHUUHG URXWH ,W KHOSV JUHDWO WR EH D SDUW RI WKH WHDP IURP EORFNLQJ SURJUHVV $ WHDP RI ¶FRPUDGH LQ DUPV· UDWKHU WKDQ ¶DG GD RQH VLQFH DV D WHVWHU RX JHW WKH OHDG WLPH WR JHW DFTXDLQWHG YHUVDULHV· LV PXFK PRUH OLNHO WR VXFFHHG DQG WKDW·V ZKDW ´2QH ZLWK WKH LQIUDVWUXFWXUH DQG WHFKQRORJ XQGHUVWDQG WHDP GQD 7HDPµ PHDQV 7KLV DOVR PHDQV WKDW WKH 4$ JX LV QR ORQJHU WKH PLFV DQG LQLWLDWH D FXVWRPHU GLDORJ WR JHW DQ LQVLJKW LQWR WKH EXVL ´4XDOLW 3ROLFHµ RQ WKH SURMHFW DQG WKH ZKROH WHDP RZQV TXDOLW QHVV DW D YHU HDUO VWDJH 7KLV LV VRPHWKLQJ ZKLFK ZLOO SD RII LQ UHVXOWLQJ LQ EHWWHU TXDOLW SURGXFWV WKH ORQJHU UXQ DV DOO WKLV LV YHU FUXFLDO IRU D WHVWHU WR FRQWULEXWH HIIHFWLYHO ZKHQ WKH DFWXDO DFWLRQ WDNHV SODFH $ WHDP ZLWK SHRS 7KH WHDP VKRXOG EH OLNH D ZHOO RLOHG PDFKLQH ZKHUH DOO LQGLYLGXDO OH RI PL[HG VNLOOV ULJKW IURP WKH VWDUW ZLOO DGG D ORW RI YDOXH UDWKHU SDUWV ZRUN LQ XQLVRQ WR DFKLHYH WKH JRDO (YHU VXFFHVV LV D WHDP WKDQ D WHDP RI SHRSOH ZLWK D YHU VSHFLÀF VNLOO 7KLV LV VRPHWKLQJ VXFFHVV DQG HDFK SUREOHP LV D WHDP SUREOHP LQ VXFK D VHWXS ZKLFK UDUHO KDSSHQV LQ D WUDGLWLRQDO IUDPHZRUN ZKHUH SHRSOH 7HDP PHPEHUV WDNH FROOHFWLYH GHFLVLRQV DQG RZQHUVKLS IRU WKH DUH JHQHUDOO DGGHG DQG WDNHQ RII RQ QHHG EDVLV ,QWHUHVWLQJO ZRUN WKH GR VORZO DQG VWHDGLO WKH UHDOL]DWLRQ KDV GDZQHG RQ PDQ WKDW WKH FDQ FUHDWH PRUH YDOXH IRU WKHLU FXVWRPHUV ZKLOH PDLQWDLQLQJ D +DYH D 7HVW 6WUDWHJ FRQVLVWHQW OHYHO RI TXDOLW LQ HDFK VSULQW E KDYLQJ SHRSOH ZLWK 2QH RI WKH NH TXHVWLRQV D WHVWHU RIWHQ HQFRXQWHUV ZKHQ KH PL[HG VNLOOV ,W DOVR EULQJV LQ D SRZHUIXO FKDQJH RI PLQGVHW ZKLFK VKH WUDQVLWLRQV IURP D WUDGLWLRQDO WR DQ $JLOH ZD RI ZRUNLQJ LV HQDEOHV HYHURQH WR VHH WKH WHVWHU DV DQ LQWHJUDO SDUW RI WKH FRUH ZKHWKHU WR FUHDWH WKH KHDYZHLJKW WHVW SODQ VWUDWHJ DQG RWKHU WHDP UDWKHU WKDQ VRPHRQH IURP D GLIIHUHQW SODQHW WDONLQJ LQ DQ VLPLODU GRFXPHQWV RU QRW  7KHVH GRFXPHQWV DUH JLYHQ ZD WRR DOLHQ ODQJXDJH DV KH LV QRW LQ VQF ZLWK WKH SURMHFW UHDOLW PXFK LPSRUWDQFH LQ D SURFHVVRULHQWHG VHWXS DQG DUH SUHUH TXLVLWH WR VWDUW DQ WHVWLQJ DFWLYLW ,Q FRQWUDVW $JLOH IRFXVHV RQ $JLOH QRW RQO KHOSV FUHDWH EHWWHU VRIWZDUH EXW SUREDEO EHWWHU ¶MXVW HQRXJK· GRFXPHQWDWLRQ DQG LV RIWHQ PLVXQGHUVWRRG IRU QR ZZZDJLOHUHFRUGFRP 
    • GRFXPHQWDWLRQ (LVHQKRZHU RQFH VDLG ¶SODQV DUH XVHOHVV EXW SO QRW LQWURGXFHG DQ UHJUHVVLRQV $GGLWLRQDOO LW ZRXOG PDNH VHQ DQQLQJ LV LQGLVSHQVDEOH· DQG WKDW·V WKH NH ZKLOH SODQQLQJ LQ DQ VH WR KDYH D FKHFNOLVW LQ SODFH ZKLFK WHVWHUV FDQ UHIHU WR ZKHQ DJLOH SURMHFW PRYLQJ D WDVN IURP ¶7HVW· WR ¶'RQH· VR DV WR UHGXFH WKH ULVN RI PLVVLQJ DQWKLQJ GXH WR SODLQ RYHUVLJKW RU DQ UHVRXUFH FUXQFK $V D WHVWHU RX VKRXOG SRVVHVV D KLJK OHYHO RI FODULW DERXW WKH ZKROH WHVWLQJ DFWLYLW $ WHVW VWUDWHJ ZLOO KHOS WKH ZKROH WHDP WR 7KH GHÀQLWLRQ RI GRQH RU WKH 'R' LV QHJRWLDWHG EHWZHHQ WKH VHH WKH WHVWLQJ DFWLYLW FOHDUO DQG HQDEOH WKHP WR FRQWULEXWH LQ WHDP DQG WKH VWDNHKROGHUV DV D JHQHULF VHW RI JXLGHOLQHV RI ZKHQ ÀQH WXQLQJ LW <RX ZLOO JHW EULOOLDQW LGHDV IURP WKH WHDP DV HYHU WR FRQVLGHU WKH XVHU VWRULHV GRQH IRU VSULQWV LQ D UHOHDVH $ WHVWHU RQH ZRXOG EH LQWHUHVWHG LQ KDYLQJ D WHVW SURFHVV LQ SODFH ZKLFK LV VKRXOG DOVR FUHDWH D 'R' EDVHG RQ WKH VSULQWUHOHDVH JRDOV DQG KHOSLQJ WKH ÀQDO FDXVH ,W ZLOO JLYH WKH WHVWHU D FOHDU SDWK WR WDNH KLV WHVWLQJ REMHFWLYH IRU WKH SURMHFW EDVHG RQ GLVFXVVLRQV ZLWK ZKHQ WHVWLQJ GXULQJ D VSULQW RU D UHOHDVH WKH WHDP DQG WKH VWDNHKROGHUV 2QFH WKH FULWHULD IRU GRQH LV GH FLGHG LW FDQ EH DGGHG WR WKH 'R' IRU WKH SURMHFW 7KLV ZLOO PDNH 7HVW VWUDWHJ VKRXOG FRQWDLQ GHWDLOV RQ D KLJK OHYHO D SODQ IRU LW YLVLEOH WR HYHURQH LQYROYHG DQG DFW DV D JXLGLQJ SULQFLSOH DQG D UHOHDVH IRU H[DPSOH ZLWK WKLQJV OLNH WHVWLQJ WHFKQLTXHV DQG UHIHUHQFH WR WKH WHVWHU $ 'R' IRU WKH WHVWHU FDQ EH VRPHWKLQJ WRROV WR EH XVHG DXWRPDWLRQ RI UHJUHVVLRQ WHVWV WHVWLQJ DQ LQ OLNH WKH IROORZLQJ WHUDFWLRQ ZLWK WKLUGSDUW WRROV DQG LQWHUIDFHV GDWDEDVH WHVWLQJ ‡ 5HTXLUHG IXQFWLRQDOLW DV GHVFULEHG LQ WKH XVHU VWRU LV LP DPRQJ RWKHUV 7KHUH LV QR VHW WHPSODWH IRU D WHVW VWUDWHJ DQG LW SOHPHQWHG FDQ EH DQWKLQJ D SLHFH RI SDSHU D :LNL SDJH D WH[W GRFXPHQW D GLDJUDP RU DQ HPDLO GHWDLOLQJ RXU DSSURDFK 7KH RQO LPSRU ‡ 7HVW GDWD DQG FDVHV DUH GRFXPHQWHG DXWRPDWHG LQ %'' WDQW WKLQJ LV WKDW RX KDYH D VWUDWHJ DQG LW·V FRPPXQLFDWHG WR WRRO
    • RU RQ D :LNL FRQÁXHQFH
    •  HYHURQH LQ WKH WHDP ([WHQVLYH GRFXPHQWDWLRQ VKRXOG RQO EH ‡ 7KH LPSOHPHQWDWLRQ KDV SDVVHG WKH IXQFWLRQDO WHVWV FUHDWHG ZKHQ RX DUH DEOH WR NHHS LW XSWRGDWH RWKHUZLVH LW ZLOO VRRQ JR VWDOH ‡ $OO DXWRPDWHG UHJUHVVLRQ WHVWV DUH JUHHQ ,QYROYH &XVWRPHUV LQ WKH 7HVW 3URFHVV &ODULI 6SHFLILFDWLRQV 8VLQJ ([DPSOHV 1R RQH LQ WKH WHDP KDV WKH NLQG RI LQVLJKW DQG GRPDLQ NQRZ ,W LV JRRG SUDFWLFH WR JLYH FRQFUHWH H[DPSOHV ZKHQ DVNLQJ VR OHGJH WKDW D FXVWRPHU RU WKH HQG XVHU RI WKH SURGXFW KDV ,QYRO PHWKLQJ IURP WKH 3URGXFW 2ZQHU GHYHORSHU RU WKH XVHU $ TXHU YLQJ WKH FXVWRPHU LQ WKH WHVW SURFHVV ZLOO LQFUHDVH WKH HIÀFDF RI DVNHG LQ SODLQ ODQJXDJH RU D OHQJWK HPDLO PLJKW QRW JHW WKH UH WKH WHVWLQJ DFWLYLW 7R DFKLHYH WKLV RX ZLOO KDYH WR FUHDWH D WUDQV VSRQVH RX QHHG EXW VHHLQJ D UHDO H[DPSOH ZLOO GHÀQLWHO HYRNH SDUHQW DQG WUXVWZRUWK UHODWLRQVKLS DQG LQLWLDWH WKH ULJKW NLQG RI SRVLWLYH UHDFWLRQ GLDORJ 1RZDGDV PDQ %'' DQG $7'' WRROV DUH DYDLODEOH DQG JDLQLQJ SRSXODULW WKHVH VSHFLI WKH WHVWV LQ D GRPDLQ ODQJXDJH 7KLV KHOSV WUHPHQGRXVO LI RX ZRUN RQ RIIVKRUH SURMHFWV LQ D GLV ZKLFK FDQ EH HDVLO XQGHUVWRRG DQG OHDUQHG E FXVWRPHUV % WULEXWHG PRGH DQG QHHG WR FODULI RU GLVDPELJXDWH UHTXLUHPHQWV XVLQJ WKHVH WRROV WKH XVHUV FDQ JR RQH VWHS DKHDG DQG GHVLJQ RU ZLWK WKH FXVWRPHU 6LQFH WKH FXVWRPHU ZLOO EH JHRJUDSKLFDOO OR ZULWH WHVW FDVHV IRU UHTXLUHPHQWV WKHPVHOYHV ZKLFK ZRXOG VHUYH FDWHG HOVHZKHUH LW·V YHU LPSRUWDQW WR NHHS WKH IHHGEDFN FFOH DV DFFHSWDQFH FULWHULD IDVW DQG VKRUW DV VSULQW FFOHV DUH XVXDOO VKRUW DV ZHOO $GGLWLR QDOO WKH XVHU PLJKW KLPVHOI FRPH XS ZLWK DOWHUQDWLYH VFHQDULRV 7KHUH DUH QXPHURXV ZDV LQ ZKLFK WKH FXVWRPHU FDQ FRQWULEXWH XVLQJ H[DPSOHV ZKLFK FDQ KHOS WR GLVDPELJXDWH UHTXLUHPHQWV WR WKH WHVWLQJ DFWLYLW ZLWKLQ RU RXWVLGH D VSULQW )RU GDWDFHQWULF DSSOLFDWLRQV RU LQ IDFW IRU DQ DSSOLFDWLRQ RQO WKH FXVWRPHU FDQ $Q H[DPSOH RI VXFK D FDVH FRXOG EH D SURMHFW ZKHUH RX DUH SURYLGH WKH DFWXDO SURGXFWLRQ GDWD ZKLFK LV D FULWLFDO UHTXLUH WHVWLQJ D ÀQDQFH DSSOLFDWLRQ LQ ZKLFK FRPSOH[ FDOFXODWLRQV DUH PHQW IRU WHVWLQJ 7HVWLQJ WKH DSSOLFDWLRQ ZLWK WKH ULJKW NLQG RI GRQH ,W ZRXOG EH JRRG LGHD WR FUHDWH D VPDOO VSUHDGVKHHW ZLWK GDWD LV NH WR XQFRYHULQJ WKH GHIHFWV ZKLFK PD RWKHUZLVH RQO FDOFXODWLRQV IRU GLIIHUHQW VFHQDULRV DQG DVN IRU DQ FODULÀFDWLRQ EH IRXQG RQFH WKH VRIWZDUH JRHV LQWR SURGXFWLRQ FLWLQJ VSHFLÀF H[DPSOHV RQ WKH VKHHW $GGLWLRQDOO WKH FXVWRPHU FDQ SURYLGH DFWXDO XVDJH VFHQDULRV 7HVW DV SHU WKH &RQWH[W RI WKH 6SULQW DQG RWKHU UHTXLUHPHQWV VXFK DV SHUIRUPDQFH EHQFKPDUNV HDU 7HVWLQJ LQKHUHQWO UHPDLQV WKH VDPH LQ $JLOH RQO WKH ZD LW·V O LQ WKH UHOHDVH FFOH ZKLFK XOWLPDWHO ZLOO WUDQVODWH LQWR D PRUH DSSOLHG LQ DQ DJLOH SURMHFW LV GLIIHUHQW $OWHUQDWLYHO ZH FDQ VD XVDEOH IDVW DQG VWDEOH SURGXFW WKDW WKH UXOHV RI WKH JDPH UHPDLQ WKH VDPH EXW LW·V DOWRJHWKHU D GLIIHUHQW SODLQJ ÀHOG $ WHVWHU LQ DQ DJLOH IUDPHZRUN ZRXOG EH +DYH D 'HILQLWLRQ RI 'RQH LQ 3ODFH ÁH[LEOH HQRXJK WR DOORZ FKDQJHV WR D VHW SODQ UHVSRQGLQJ WR 6RPHWKLQJ ZKLFK ERWKHUV WHVWHUV IUHTXHQWO LV KRZ WR PDNH D GH FKDQJH RYHU IROORZLQJ D SODQ
    •  +HQFH WR WHVW DV SHU WKH FRQWH[W FLVLRQ WR VWRS WHVWLQJ DQG HQVXUH WKDW WKH XVHU VWRU RU IHDWXUH RI D VSULQW ZRXOG EH D ORJLFDO DQG ZLVH FKRLFH ,W·V YHU LPSRU XQGHU WHVW KDV EHHQ WHVWHG DGHTXDWHO 7KHRUHWLFDOO WHVWHUV DUH WDQW WKDW WKH WHVWHU UHPDLQV DZDUH RI WKH FRQWH[W DQG FRQVWDQWO QHYHU GRQH EXW WKH QHHG WR PDNH D GHFLVLRQ DW VRPH SRLQW WR PDNHV DGMXVWPHQWV LQ KLVKHU VWUDWHJ WR DFFRPPRGDWH FKDQJH VWRS WHVWLQJ ZKDW WKH DUH WHVWLQJ DQG WDNH XS QHZ WDVNV 2QH SRVVLEOH DSSURDFK ZRXOG EH WR GR ULVNEDVHG WHVWLQJ ZLWKLQ D $W WKH VWDUW RI D VSULQW WKH WHVWHU FDQ EULQJ LQ KLV XQLTXH SHU VSULQW IRFXVLQJ PRUH RQ FULWLFDO LWHPV DQG HQVXULQJ WKDW WKH KDYH VSHFWLYH DQG GR UHTXLUHPHQWV WHVWLQJ DQG VWRU H[SORUDWLRQ DORQJ  ZZZDJLOHUHFRUGFRP
    • ZLWK DXWRPDWLQJ OHIWRYHUV IURP SUHYLRXV VSULQWV WR DGG WR WKH NHSW VLPSOH DSSO WKH .,66 SULQFLSOH KHUH
    •  HW VKRXOG LQFOXGH UHJUHVVLRQ WHVW VXLWH $V D VSULQW SURJUHVVHV WKH WHVWHU FDQ WHVW HYHU SRVVLEOH LQGLFDWRU WKDW DOORZV WKH GHYHORSHU WR GHEXJ WKH WKH IHDWXUHV EHLQJ FRGHG LGHDOO LW ZRXOG EH IDVWHU WR GR LW PD SUREOHP TXLFNO DQG HIÀFLHQWO 7HVWGHIHFW UHSRUWV DXWRPDWLF RU QXDOO WKH ÀUVW WLPH
    • XVLQJ H[SORUDWRU DQG RWKHU PHWKRGV ZKLFK RWKHUZLVH
    • VKRXOG EH VPDUW HQRXJK WKDW RQO D JODQFH WKURXJK ZRXOG UHVXOW LQ WKH PRVW HIIHFWLYH XWLOL]DWLRQ RI WLPH DQG HIIRUW $V WKHP LV HQRXJK WR NQRZ DERXW WKH IDLOXUHV WKDW KDYH KDSSHQHG WKH VSULQW QHDUV FRPSOHWLRQ WKH IRFXV VKRXOG VKLIW WRZDUG WHVWLQJ DQG WKHLU SUREDEOH FDXVH HQGWRHQG ZRUNÁRZV DQG UHJUHVVLRQ WHVWLQJ WR HQVXUH HYHUWKLQJ WKDW ZRUNHG EHIRUH VWLOO ZRUNV *HQHUDOO ZRUNÁRZ DQG UHJUHVVL 5HJXODUO 5HDVVHVV RXU 7HVW 3URFHVV RQ WHVWV DUH DXWRPDWHG DQG VKRXOG QRW WDNH PXFK WLPH WR H[H ,W·V YHU LPSRUWDQW WR UHDVVHVV WKH WHVW SURFHVV VLQFH RQO WKHQ LW FXWH +HQFH LW·V YHU LPSRUWDQW WR ÀUVW ÀJXUH RXW WKH FRQWH[W RI D ZLOO EH RI UHOHYDQFH 7KH VRIWZDUH ZKLFK LV EHLQJ FUHDWHG JURZV LQ VSULQW DQG WKHQ WHVW DFFRUGLQJO VL]H DQG FRPSOH[LW LQ HYHU VSULQW 6LPLODUO WKH WHVW DVVHWV DQG DUWHIDFWV DOVR JURZ ERWK LQ QXPEHU DQG FRPSOH[LW 7KH PDLQ 7HVW $XWRPDWLRQ LV D 7HDP (IIRUW WHQDQFH QLJKWPDUH VHWV LQ DV WKH UHOHDVH FFOH SURJUHVVHV DQG 7HVW DXWRPDWLRQ LV QRW RQO DERXW DQ DXWRPDWLF H[HFXWLRQ RI WKH UHOHYDQFH RI DXWRPDWHG UHJUHVVLRQ WHVWV DQG RWKHU WHVW DUWHIDFWV WHVW FDVHV ,W KDV D PXFK ZLGHU DSSOLFDWLRQ OLNH LQWHJUDWLQJ DX EHFRPHV D PDMRU LVVXH $ VWUDWHJ WKDW ZRUNHG HVWHUGD PD QRW WRPDWLF WHVWV ZLWK WKH EXLOG SURFHVV LQWHJUDWLQJ WRROVHWVIUDPH EH UHOHYDQW DQPRUH DV WKHUH KDYH EHHQ FRQWLQXRXV FKDQJHV ZRUNV GHYHORSHG WR WHVW GLIIHUHQW FRPSRQHQWV RI WKH DSSOLFDWLRQ +HQFH WKH WHVWHUV QHHG WR UHYLVLW DQG UHWKLQN WKHLU WHVW SURFHVV DXWRPDWLF UHSRUWLQJ DQG QRWLÀFDWLRQ PHFKDQLVPV HWF WR NHHS LW UHOHYDQW DQG XSWRGDWH $ WHVWHU PLJKW EH LQYROYHG LQ FUHDWLQJ DQG PDLQWDLQLQJ PRVW RI $ WHVWHU PXVW EH VPDUW HQRXJK WR WU DQG VHH EHRQG D VSULQW DQG WKH WHVW DUWHIDFWV EXW KH QHHGV WKH KHOS RI WKH HQWLUH WHDP WR VWUDWHJL]H DFFRUGLQJO 7KH UHOHDVH EDFNORJ LV DOZDV DFFHVVLEOH NHHS LW JRLQJ 6RPH VLWXDWLRQV PLJKW GHPDQG DQ LQGHSWK WHFKQL DQG KHVKH VKRXOG OHDUQ WR PDNH JRRG XVH RI LW :KLOH DXWRPD FDO NQRZKRZ OLNH PRFNLQJ VRPH H[WHUQDO LQWHUIDFHV RU PDNLQJ WLQJ DQG FUHDWLQJ D WHVW VWUDWHJ WKH WHVWHU VKRXOG DOZDV IDFWRU LQ GLVSDUDWH WRROV WDON WR HDFK RWKHU
    •  ZKLFK D WHVWHU PLJKW JHQHUDOO WKH WSH DQG FRPSOH[LW RI VWRULHV ZKLFK DUH IXUWKHU GRZQVWUHDP ODFN DQG KHQFH LW·V DOO WKH PRUH LPSRUWDQW WKDW WKH WHDP LV WKHUH VR DV WR PLQLPL]H WKH UHZRUN ZKHQ LW·V WLPH WR DFWXDOO LPSOHPHQW WR VXSSRUW RX ,W·V DJDLQ DQ RIIVKRRW RI WKH ´2QH 7HDPµ FRQFHSW WKHP $ WHVWHU VKRXOG EH HYDOXDWLQJ DQG UHYLVLWLQJ WKH WHVW GHVLJQ ZKHUH HYHU SUREOHP LV D WHDP SUREOHP HYHU VSULQW WR HQVXUH WKDW KHVKH LV RQ WKH ULJKW WUDFN (YROXWL RQDU WHVW GHVLJQ VKRXOG KDSSHQ LQ SDUDOOHO WR WKH HYROXWLRQDU ,W DOVR JLYHV WKH WHDP HVSHFLDOO GHYHORSHUV
    • D ORW RI FRQÀGHQFH GHVLJQ RI WKH VVWHP EHIRUH PDNLQJ DQ FKDQJH LI D UREXVW IUDPHZRUN LV LQ SODFH WKDW WKH FDQ UHO RQ 6R LW·V IRU WKH EHQHÀW RI WKH ZKROH WHDP DQG WKH ([SORUH /HDUQ ,QQRYDWH DQG ,PSURYH &RQVWDQWO ZKROH WHDP RZQV LW $ WHVWHU PLJKW WDNH WKH RZQHUVKLS RI PDLQ $JLOH LV QRW RQO DERXW ZRUNLQJ RQ DQ RQH SURMHFW ,W·V D FRQWL WDLQLQJ DQG NHHSLQJ LW UHOHYDQW LQ WKH ORQJ UXQ EXW QRW ZLWKRXW WKH QXRXV OHDUQLQJ SURFHVV ZKHUH SHRSOH FRQVWDQWO HQKDQFH H[LV FRPPLWPHQW RI WKH WHDP WLQJ VNLOOV DQG DGG QHZ RQHV $V D WHVWHU RX DGG PRUH YDOXH WR RXUVHOI RXU RUJDQL]DWLRQ DQG RXU FXVWRPHU E FRQVWDQWO 3URYLGH )DVW DQG 4XDOLW )HHGEDFN OHDUQLQJ DQG H[SORULQJ QHZ WKLQJV <RX ZLOO OHDUQ QHZ WRROV DQG )DVWHU IHHGEDFN LV WKH YHU HVVHQFH RI DJLOH GHYHORSPHQW +DYLQJ WHFKQLTXHV ZKLFK ZLOO QRW RQO KHOS RX WR ZRUN PRUH HIÀFLHQWO DXWRPDWLF FKHFNV LQ SODFH OLNH &, DXWRPDWHG XQLW WHVWLQJ DQG UH DQG EHWWHU LQ WKH FXUUHQW SURMHFW EXW ZLOO VWD ZLWK RX ORQJ DIWHU JUHVVLRQ WHVWLQJ
    • HQVXUH WKDW IHHGEDFN LV LQVWDQWDQHRXV 7DNLQJ WKH SURMHFW LV RYHU D FXH IURP VXFK SUDFWLFHV GHVLJQ RXU IXQFWLRQDO WHVWV VXFK WKDW WKH FDQ EH LQWHJUDWHG LQWR WKH EXLOG ,I VRPH WHVWV VORZ GRZQ WKH 7U VRPHWKLQJ QHZ ZLWKLQ D SURMHFW DQG LQWURGXFH QHZ WRROVHWV EXLOG DEVWUDFW WKHP RXW SXW WKHP LQWR LQVLGH D VHSDUDWH VXLWH RU D ZRUNLQJ PHWKRGRORJ WR LPSURYH WKH FXUUHQW VWDWH RI DIIDLUV DQG VFKHGXOH WKHP WR UXQ RYHUQLJKW ZLWK VRPH QRWLÀFDWLRQ PH VD D TXLFN 32&
    •  7KLV ZLOO SUREDEO KHOS RX WR PDNH WKLQJV EHW FKDQLVP 7KHUH LV QR SRLQW LQ FUHDWLQJ VXLWHV RU WHVWV WKDW NHHS WHU DQG HYHQ LI GR QRW DQG IDLO TXLFNO RX NQRZ VRPHWKLQJ ZKLFK RQ UXQQLQJ IRU GDV DV GHODHG IHHGEDFN ZRXOG VORZ GRZQ WKH GLGQ·W ZRUN HQWLUH FKDLQ DQG KDPSHU WKH VSHHG DQG SURGXFWLYLW RI WKH WHDP 0DEH RX ZRXOG DOVR OLNH WR VKDUH RXU NQRZOHGJH DQG H[SHU $GGLWLRQDOO RX VKRXOG QRW ZDLW IRU D EXJ WR EH ORJJHG DQG JR WLVH ZLWK RWKHUV DQG JLYH VRPHWKLQJ EDFN WR WKH FRPPXQLW DQG WKURXJK WKH FRPSOHWH OLIHFFOH LQ WKH EXJ WUDFNLQJ VVWHP EHIRUH FRQWULEXWH IRU H[DPSOH WR RSHQ VRXUFH RU RWKHU LQLWLDWLYHV %ORJ LW·V À[HG DQG UHYHULÀHG $V VRRQ DV DQ LVVXH LV IRXQG LW·V JRRG JLQJ ZULWLQJ SDSHUV SDUWLFLSDWLQJ LQ FRQIHUHQFHV DQG HQJDJLQJ WR DQQRXQFH LW ZULWH LW RQ WKH ZKLWHERDUG LQVWDQWO PHVVDJH WKH LQ GLVFXVVLRQV ZLWK WKH FRPPXQLW DW YDULRXV IRUXPV ZLOO QRW RQO GHYHORSHU FRQFHUQHG RU MXVW VKRXW
    • *HW LW À[HG WKHUH DQG WKHQ DGG WR RXU NQRZOHGJH DQG VNLOO EXW ZLOO PDNH RX YLVLEOH WR WKH FRPPXQLW DV ZHOO 4XDOLW IHHGEDFN PHDQV WKDW HYHUWKLQJ EXJ UHSRUW LQFLGHQW ORJ RU D WHVW UHSRUW
    • WKDW D WHVWHU SURYLGHV IRU WKH FRQVXPSWLRQ RI 7R FRQFOXGH LW·V JUHDW IXQ DQG KLJKO UHZDUGLQJ WR EH SDUW RI DQ WKH RWKHU WHDP PHPEHUV VKRXOG EH VR SUHFLVH DQG UHÀQHG WKDW DJLOH WHDP VLQFH DV D WHVWHU RX QRW RQO FRQWULEXWH VLJQLÀFDQWO RQO D FXUVRU JODQFH WKURXJK LW VKRXOG EH HQRXJK WR JHW DQ LGHD WR WKH HQWLUH OLIHFFOH EXW RX DOVR LPSURYH DV D SHUVRQ DQG SUR DERXW ZKDW SUREOHP ZDV IRXQG ZKHUH LQ WKH VVWHP ,W VKRXOG EH IHVVLRQDO $ WHVWHU IHHOV PRUH YDOXHG DQG HPSRZHUHG ZKHQ KH ZZZDJLOHUHFRUGFRP 
    • VKH LV KHDUG DQG FRQVXOWHG IRU HDFK DFWLYLW ! $ERXW WKH DXWKRU 7HVWHUV WKDW DUH SDUW RI WKH FRUH WHDP QR ORQJHU KDYH WR WDNH RYHU 5DMQHHVK 1DPWD WKH UROH RI ¶VHQWLQHOV RI TXDOLW ¶RU WKH ¶ODVW OLQH RI GHIHQFH· DV HYH LV D 6HQLRU 7HVW &RQVXOWDQW URQH RQ WKH WHDP LV FRPPLWWHG WR EXLOG WKH ULJKW SURGXFW 7HVWHUV DW ;HELD ,QGLD +H LV D SDV KHOS LQ FUHDWLQJ DQG PDLQWDLQLQJ WKH VDIHW QHW ZKLFK HQDEOHV WKH VLRQDWH WHVWHU DQG KDV QRZ GHYHORSHUV WR DFFRPPRGDWH DQG PDNH FKDQJHV ZLWK FRQÀGHQFH ZRUNHG IRU DOPRVW  HDUV 7HVWHUV FROOHFW WKH LQIRUPDWLRQ HPLWWHG E YDULRXV VLJQDOV SXW LQ LQ YDULRXV UROHV LQ 4$ +H LV SODFH DQG SUHVHQW WKDW WR WKH VWDNHKROGHUV VR WKDW WKH FDQ PDNH FHUWLÀHG 6FUXP 0DVWHU DQG LQIRUPHG GHFLVLRQV DERXW WKH VRIWZDUH EHLQJ EXLOW $ERYH DOO WHV KDV EHHQ SUDFWLFLQJ $JLOH WHUV TXHVWLRQ WKH VRIWZDUH WR NQRZ PRUH DERXW LW DQG JRRG TXHV IRU WKH ODVW  HDUV QRZ WLRQV FDQ RQO RULJLQDWH LQ DQ DJLOH PLQG +H KDV ZRUNHG DFURVV GLI IHUHQW VWDJHV RI VRIWZDUH GHYHORSPHQW LQFOXGLQJ UHTXLUHPHQWV VSHFLÀFDWLRQ XVHU DFFHSWDQFH WHVWLQJ DQG SRVWSURGXFWLRQ WUDLQLQJ , ZRXOG OLNH WKDQN +DUVK 6DLQL P FROOHDJXH DQG IULHQG
    • IRU WKH 5DMQHHVK LV SDVVLRQDWH DERXW VRIWZDUH TXDOLW DQG UH WKRXJKWSURYRNLQJ DQG VWLPXODWLQJ GLVFXVVLRQV , KDG ZLWK KLP ODWHG WRROV DQG WHFKQLTXHV DQG KDV PDGH FRQVLVWHQW HI ZKLFK WUDQVODWHG LQWR WKH RULJLQDO SUHVHQWDWLRQ DQG XOWLPDWHO OHG IRUWV WR LPSURYH WKH H[LVWLQJ ZD RI ZRUNLQJ QRW RQO IRU WR WKLV DUWLFOH KLPVHOI EXW IRU WKH WHDPV DQG RUJDQL]DWLRQV KH ZRUNHG IRU +H IUHTXHQWO EORJV DERXW VRIWZDUH WHVWLQJ RQ KLV FRPSDQ EORJ DQG UHFHQWO SUHVHQWHG DW $JLOH 1&5 *XUJDRQ ,QGLD
    • D WDON WLWOHG Ä/HVVRQV OHDUQHG LQ $JLOH 7HVWLQJ¶ ZKLFK ZDV YHU ZHOO UHFHLYHG E WKH DXGLHQFH 7KLV WDON LV WKH LGHD EHKLQG KLV DUWLFOH Your Ad here www.agilerecord.com  ZZZDJLOHUHFRUGFRP