#WhyTestingMatters
From our favoritesoftware fails towords of
wisdom from testing experts- see why we
think testing matters.
Our Favorite Fails…
Presentation Title
Page
Proprietary & Confidential
3
Apple’s recentiOS 11.1 update camewith a host of glitches. Users report that the new
system won’t type the letter“I,”and emits a cracklingsound during phone calls.As a
result, many customers inadvertently bought afancy,white paperweight instead of a new
iPhone 8
Presentation Title
Page
Proprietary & Confidential
4
Haveyou everwondered who removes the more unsavory content fromyour newsfeed so that
you don’t haveto see it?This summer, a software bug at Facebook helped hate groups answer that
question by revealingthe identities of 1000+ of their moderators.
Presentation Title
Page
Proprietary & Confidential
5
Has your GPS everled you astray?It could have been atiming anomaly! Last year,a bug
caused a global GPS time delayof a whopping 13 microseconds, affectingusers for
severalhours.
Presentation Title
Page
Proprietary & Confidential
6
Delaysin testing caused the release of BART’s new fleetof traincarsto be pushed back by
severalmonths. Reports indicate that the exterior of the newtrams aregood to go, but that
performance monitoring maybe holding up the process.
Presentation Title
Experts’ Insight
Presentation Title
Page
Proprietary & Confidential
Jess Ingrassellino
8
Senior TechnicalStaffin QA at Salesforce
Earlyinmycareer,Iworked onaproduct thatusedmultiple datapointstomakepredictions abouthow muchtraffic astorecouldexpect.
Becausetheproduct usedmultipledata points,itwasimportant foreachdatapointtodelivercorrect information.
Atonejuncture, ourcustomerssaidthattheirvideocapture datawasreturning different numbers thanourreports. Uponfirstglance,our
numberswere notdifferent thanreported numbers.Idug deeper. Therewere discrepanciesinthevideoscapture thatwere not reflected
inthesoftware. By watching hoursofvideos,Iidentified what washappening, andbrought samplestotheengineering team.
Inthiscase,testing andfollowing myhunchresulted inreplacing ourthird-party vendor,whichresulted inmore accuratevideocapture
data.Ultimately,mytestsresultedinmoreaccuratedata,which tighteneduptheprediction engine.Fortunately, wewere abletocatch
andaddressthisissueintesting,butitmighthavebeenadifferent storyifthecompanyhadinaccuratetraffic predictions aroundthe
holidays.
Presentation Title
Page
Proprietary & Confidential
T.J. Maher
9
Senior QA Engineer and Ministry of Testing Boston Organizer
TheteamdevelopinganewEuropeanUnionshoppingcartfoundoutquicklythattheVATtaxtestserverwasflaky.Butwas
thatthecauseoftheone-centdiscrepancybetweentheestimatedandactualpricethatrandomlyappeared?Everyoneonthe
teamthoughtso.Iwasn’tsure.
TakingmySeleniumscriptthatplacedanEUorder,Iloopedittwentytimes,collectingdataallthewhile.Ithadafailure rateof
40–60%.AftershowingthemetricsgatheredtothenewdeveloperassignedtotheEUcart,hecheckedhiscode.Itturnedout
hehadmadearoundingerrorcalculatingtheestimatedandactualtaxdifferently.
Doessomethingnotfeelright?Don’tjustgowithahunchoragutfeeling.Makesuretodothelegworkrequired.
Presentation Title
Page
Proprietary & Confidential
Mike Lyles
10
QA Directorat MikeWLyles.com
Testingdoesn’tmatter.Notalways.Butitdoesmatterwhenyourfavoriteappdoesn’twork,oryourfinancialtransactionfailsto
processforyou!Thereisanoldsaying“ifatreefallsinthewoodsandnoonehearsit,doesitreallymakeanoise”.Thesame
appliestotesting.Testingneedsapurpose.
Weneverrealizethepowerofautocorrectuntilsomethingassimpleastheword“It”isautocorrectedto“I.T.”inthelatest
versionofiOS.Therefore,I.T.matterstothatpersonusingtheirphoneandappearingtosaythewrongthings!Testingis
importantwhenweneedtocommunicatecorrectly!
Somanytimes,eventhesimplestofdefectscancausethemostgrieftous.Thefirsttimeyoufindyourselftryingtousea
productthatsimplydoesnotworkasexpected,youtoowillrealizethattestingdoesmatter.
Presentation Title
Page
Proprietary & Confidential
Trevor Atkins
11
Principal Consultant at ThinkTesting.com
Therearesomanyfactorsthatcontributetosoftwarebeing‘ofquality‘thattypicallyyouhaveonlytheresourcestomakea
fewstandout.Thosethatareemphasizedbecomepartofyourbrand.Youwouldn’twantyourbrandtobecomeinfamousfor
afaultydecisionthatcouldhavebeenpreventedbysmartertesting,wouldyou?
Testingcanbeatrustedadvisortohelpthebusinessmakeinformeddecisionsaroundquality–likewhentorelease.Inother
words:Testingmattersbecausequalitykeepscustomerscomingbackformore.
Presentation Title
Page
Proprietary & Confidential
Rosie Sherry
12
Ministry of Testing Founder and Former BossBoss
Testingmattersbecausesoftwareiscomplex.Increasinglycomplexasthetechnologyconnectsandintegrateswithsomany
othermind-boggling‘things’.
Testingmattersbecausehumansarecomplexandfallible.Nomatterhowhardateamwilltry,mistakeswillhappen.Good
testingincreasesthechanceofstoppingthemgetthrough.
Testingmattersbecausethesoftwareexperienceiscrucialtoabusiness’ssuccess.Whoelsewillgothroughtheeffortof
gettingtoknowyoursoftwareinsideout?
Testingmattersbecausebugswillexist,likeitornot,andwhilstintheoryanycanfindabug,testersaretheonesthatwillhave
thetimeandknowledgetohelpyouhavetheconfidencetorelease.
Presentation Title
Insiders’ Perspectives
Presentation Title
Page
Proprietary & Confidential
Testing Matters Because…
14
User experience affectsyour brand image.
Presentation Title
Page
Proprietary & Confidential
Testing Matters Because…
15
You can’tmeetyour business objectiveswithout quality software.
Presentation Title
Page
Proprietary & Confidential
Testing Matters Because…
16
You could be exposing your customers (and your company!) to security risks.
Presentation Title
Page
Proprietary & Confidential
Testing Matters Because…
17
Attention spans areshorter than ever.
Presentation Title
Page
Proprietary & Confidential
Testing Matters Because…
18
You can’tcontrol the future, but software testing is the next best thing.
Presentation Title
Community Comments
Presentation Title
Page
Proprietary & Confidential
Input from the SmartBear Community
“Fewercomplaints meanslesstimeputting outfiresandlettingthe
teamworkonnewdevelopment andisn’tthatthefunpart? Dothe
testingevenifitseemsboringanditwillendupgivingyoumoretimeto
dowhatyoureally wanttodo.”
“Macy’sUSisthetopshopping destination. Oneofthebestseasonsto
earnandmakeprofitforMacy’sisBlackFriday.ThisblackFriday,there
wasanissuewithworkingofCreditcards.Customerslineupforhours
andthenifthesystemdoesn’t respond, thefrustration levelslineup
too!!!”
“Oneofmyco-workersusedtoworkforarailroad companywherethe
softwarethatcontrols theautomaticbreaking oftheengines wasbeing
tested.Heusedaruleofthumbthattheywould allclimbaboard thetrain
withthenewsoftwarerunning andaimthetrainatawall,expecting the
softwaretokickinandstopthetrain. Iftheycouldnotconfidently do
that,thenthesoftwarewasnotreadyforrelease.”
Marsha_R
Sweta_Desa
tristaanogre
20
Presentation Title
Page
Proprietary & Confidential
Join Us on YouTube Live: Why Testing Matters
21
Wednesday, April 18th at10 AM EDT
Presentation Title
What new software testing trends are
coming in 2018? What are the best hidden
gems in TestComplete & ReadyAPI? Jeff
Martin, Test Product Owner & Temil Sanchez,
Sales Engineer Team Lead, will answer all
your burning questions LIVE on Thursday,
March 29th. Submit your questions in
advance by asking a Zoom question.
YouTube Live Link:
https://www.youtube.com/watch?v=bJFHaGwC0Z8
Thank you!
Subtitle

Why Testing Matters

  • 1.
    #WhyTestingMatters From our favoritesoftwarefails towords of wisdom from testing experts- see why we think testing matters.
  • 2.
  • 3.
    Page Proprietary & Confidential 3 Apple’srecentiOS 11.1 update camewith a host of glitches. Users report that the new system won’t type the letter“I,”and emits a cracklingsound during phone calls.As a result, many customers inadvertently bought afancy,white paperweight instead of a new iPhone 8 Presentation Title
  • 4.
    Page Proprietary & Confidential 4 Haveyoueverwondered who removes the more unsavory content fromyour newsfeed so that you don’t haveto see it?This summer, a software bug at Facebook helped hate groups answer that question by revealingthe identities of 1000+ of their moderators. Presentation Title
  • 5.
    Page Proprietary & Confidential 5 Hasyour GPS everled you astray?It could have been atiming anomaly! Last year,a bug caused a global GPS time delayof a whopping 13 microseconds, affectingusers for severalhours. Presentation Title
  • 6.
    Page Proprietary & Confidential 6 Delaysintesting caused the release of BART’s new fleetof traincarsto be pushed back by severalmonths. Reports indicate that the exterior of the newtrams aregood to go, but that performance monitoring maybe holding up the process. Presentation Title
  • 7.
  • 8.
    Page Proprietary & Confidential JessIngrassellino 8 Senior TechnicalStaffin QA at Salesforce Earlyinmycareer,Iworked onaproduct thatusedmultiple datapointstomakepredictions abouthow muchtraffic astorecouldexpect. Becausetheproduct usedmultipledata points,itwasimportant foreachdatapointtodelivercorrect information. Atonejuncture, ourcustomerssaidthattheirvideocapture datawasreturning different numbers thanourreports. Uponfirstglance,our numberswere notdifferent thanreported numbers.Idug deeper. Therewere discrepanciesinthevideoscapture thatwere not reflected inthesoftware. By watching hoursofvideos,Iidentified what washappening, andbrought samplestotheengineering team. Inthiscase,testing andfollowing myhunchresulted inreplacing ourthird-party vendor,whichresulted inmore accuratevideocapture data.Ultimately,mytestsresultedinmoreaccuratedata,which tighteneduptheprediction engine.Fortunately, wewere abletocatch andaddressthisissueintesting,butitmighthavebeenadifferent storyifthecompanyhadinaccuratetraffic predictions aroundthe holidays. Presentation Title
  • 9.
    Page Proprietary & Confidential T.J.Maher 9 Senior QA Engineer and Ministry of Testing Boston Organizer TheteamdevelopinganewEuropeanUnionshoppingcartfoundoutquicklythattheVATtaxtestserverwasflaky.Butwas thatthecauseoftheone-centdiscrepancybetweentheestimatedandactualpricethatrandomlyappeared?Everyoneonthe teamthoughtso.Iwasn’tsure. TakingmySeleniumscriptthatplacedanEUorder,Iloopedittwentytimes,collectingdataallthewhile.Ithadafailure rateof 40–60%.AftershowingthemetricsgatheredtothenewdeveloperassignedtotheEUcart,hecheckedhiscode.Itturnedout hehadmadearoundingerrorcalculatingtheestimatedandactualtaxdifferently. Doessomethingnotfeelright?Don’tjustgowithahunchoragutfeeling.Makesuretodothelegworkrequired. Presentation Title
  • 10.
    Page Proprietary & Confidential MikeLyles 10 QA Directorat MikeWLyles.com Testingdoesn’tmatter.Notalways.Butitdoesmatterwhenyourfavoriteappdoesn’twork,oryourfinancialtransactionfailsto processforyou!Thereisanoldsaying“ifatreefallsinthewoodsandnoonehearsit,doesitreallymakeanoise”.Thesame appliestotesting.Testingneedsapurpose. Weneverrealizethepowerofautocorrectuntilsomethingassimpleastheword“It”isautocorrectedto“I.T.”inthelatest versionofiOS.Therefore,I.T.matterstothatpersonusingtheirphoneandappearingtosaythewrongthings!Testingis importantwhenweneedtocommunicatecorrectly! Somanytimes,eventhesimplestofdefectscancausethemostgrieftous.Thefirsttimeyoufindyourselftryingtousea productthatsimplydoesnotworkasexpected,youtoowillrealizethattestingdoesmatter. Presentation Title
  • 11.
    Page Proprietary & Confidential TrevorAtkins 11 Principal Consultant at ThinkTesting.com Therearesomanyfactorsthatcontributetosoftwarebeing‘ofquality‘thattypicallyyouhaveonlytheresourcestomakea fewstandout.Thosethatareemphasizedbecomepartofyourbrand.Youwouldn’twantyourbrandtobecomeinfamousfor afaultydecisionthatcouldhavebeenpreventedbysmartertesting,wouldyou? Testingcanbeatrustedadvisortohelpthebusinessmakeinformeddecisionsaroundquality–likewhentorelease.Inother words:Testingmattersbecausequalitykeepscustomerscomingbackformore. Presentation Title
  • 12.
    Page Proprietary & Confidential RosieSherry 12 Ministry of Testing Founder and Former BossBoss Testingmattersbecausesoftwareiscomplex.Increasinglycomplexasthetechnologyconnectsandintegrateswithsomany othermind-boggling‘things’. Testingmattersbecausehumansarecomplexandfallible.Nomatterhowhardateamwilltry,mistakeswillhappen.Good testingincreasesthechanceofstoppingthemgetthrough. Testingmattersbecausethesoftwareexperienceiscrucialtoabusiness’ssuccess.Whoelsewillgothroughtheeffortof gettingtoknowyoursoftwareinsideout? Testingmattersbecausebugswillexist,likeitornot,andwhilstintheoryanycanfindabug,testersaretheonesthatwillhave thetimeandknowledgetohelpyouhavetheconfidencetorelease. Presentation Title
  • 13.
  • 14.
    Page Proprietary & Confidential TestingMatters Because… 14 User experience affectsyour brand image. Presentation Title
  • 15.
    Page Proprietary & Confidential TestingMatters Because… 15 You can’tmeetyour business objectiveswithout quality software. Presentation Title
  • 16.
    Page Proprietary & Confidential TestingMatters Because… 16 You could be exposing your customers (and your company!) to security risks. Presentation Title
  • 17.
    Page Proprietary & Confidential TestingMatters Because… 17 Attention spans areshorter than ever. Presentation Title
  • 18.
    Page Proprietary & Confidential TestingMatters Because… 18 You can’tcontrol the future, but software testing is the next best thing. Presentation Title
  • 19.
  • 20.
    Page Proprietary & Confidential Inputfrom the SmartBear Community “Fewercomplaints meanslesstimeputting outfiresandlettingthe teamworkonnewdevelopment andisn’tthatthefunpart? Dothe testingevenifitseemsboringanditwillendupgivingyoumoretimeto dowhatyoureally wanttodo.” “Macy’sUSisthetopshopping destination. Oneofthebestseasonsto earnandmakeprofitforMacy’sisBlackFriday.ThisblackFriday,there wasanissuewithworkingofCreditcards.Customerslineupforhours andthenifthesystemdoesn’t respond, thefrustration levelslineup too!!!” “Oneofmyco-workersusedtoworkforarailroad companywherethe softwarethatcontrols theautomaticbreaking oftheengines wasbeing tested.Heusedaruleofthumbthattheywould allclimbaboard thetrain withthenewsoftwarerunning andaimthetrainatawall,expecting the softwaretokickinandstopthetrain. Iftheycouldnotconfidently do that,thenthesoftwarewasnotreadyforrelease.” Marsha_R Sweta_Desa tristaanogre 20 Presentation Title
  • 21.
    Page Proprietary & Confidential JoinUs on YouTube Live: Why Testing Matters 21 Wednesday, April 18th at10 AM EDT Presentation Title What new software testing trends are coming in 2018? What are the best hidden gems in TestComplete & ReadyAPI? Jeff Martin, Test Product Owner & Temil Sanchez, Sales Engineer Team Lead, will answer all your burning questions LIVE on Thursday, March 29th. Submit your questions in advance by asking a Zoom question. YouTube Live Link: https://www.youtube.com/watch?v=bJFHaGwC0Z8
  • 22.